mirror of https://github.com/ROCm/composable_kernel.git synced 2026-04-19 22:39:03 +00:00

Files

Erwin Terpstra 6a6177a246 [CK_Tile] Support for a4w4 (fp4) in block scale gemm AB quant (#3603 )

* chore: split block scale example instances in more separate files to speed up compile times

* wip: fp4 scaffolding for abquant

* feat: add fp4 decoding-while-loading to abquant pipeline

* feat: add support for fp4 CPU verification in abquant

* chore: add time tracking to reference calculation

* feat: add a4w4 test for blockscale gemm

* feat: optimize reference calculation by preconverting values to AccType

* feat: add fp4 to fp8 look-up table

* fix: reference to wrong ComputeDataType field in QuantProblem

* feat: type utilities for determining MFMA compute types

* feat: packed fp4 for abquant weight preshuffle

* feat: add separate tests for a4w4 base case, padding and preshuffleB

* fix: fp4 conversion on gfx950 attempting to use non-supported method

* fix: test case was using quant group sizes which don't work on gfx950 due to larger mfma tile size

* chore: add fp4 preshuffleb mode to block scale example

* chore: sanity check for packed types being 1 byte

* chore: clarify tensor dimension indices with constants

* chore: replace traits check with specialized check for packed types

* style: some minor refactoring and cleanup

* fix: correct conversion table for FNUZ fp8

* chore: add fp4 instances to main abquant instances again

* chore: use same initialization branch for int4 and fp4

* chore: add missing initialization for fp4 in block scale gemm example

---------

Co-authored-by: Thomas Ning <Thomas.Ning@amd.com>

2026-01-30 04:40:50 -07:00

algorithm

Shuffle fix for gfx950 (#3491 )

2026-01-13 09:21:29 -08:00

arch

[CK_Tile] Support for a4w4 (fp4) in block scale gemm AB quant (#3603 )

2026-01-30 04:40:50 -07:00

container

Shuffle fix for gfx950 (#3491 )

2026-01-13 09:21:29 -08:00

numeric

[CK_Tile] Support for a4w4 (fp4) in block scale gemm AB quant (#3603 )

2026-01-30 04:40:50 -07:00

tensor

Optimize batch prefill kernel performance for VECTORIZED_LAYOUT KV cache (#3657 )

2026-01-29 07:18:41 +08:00

utility

[CK_Tile] Support for a4w4 (fp4) in block scale gemm AB quant (#3603 )

2026-01-30 04:40:50 -07:00

config.hpp

Add support to gfx1153 and fix gfx115X WMMA config (#3496 )

2026-01-05 10:03:30 -08:00

README.md

introducing ck_tile! (#1216 )

2024-04-15 19:27:12 -05:00

README.md

ck_tile/core

ck_tile/core contains every basic functions and structures to create a GPU kernel using ck_tile. User should only include ck_tile/core.hpp this single header to use all the functionality. Everything is under ck_tile namespace. The coding style under this folder should be similar to std (snake_case for structure/function, Camel for template types...)

algorithm/
    coordinate transform and some other reusable algorithm
arch/
    contains some basic device building block like mma, buffer addressing, etc...
container/
    contains basic container data structure, array/sequence/tuple/...
numeric/
    data type, and data type related math
tensor/
    tensor descriptors and tile level API
utility/
    other utility function for both host/device