mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-14 18:17:44 +00:00

Files

Sami Remes 038417bd3d [CK_TILE] Grouped GEMM tile loop (#2146 )

* Add trait to use a persistent kernel and split the entrypoints in grouped gemm

* Some helper functions for persistent kernel case

* Get max occupancy grid using device properties

* Implement tile loop in main entry point to grouped gemm

* Enable GridSize() on device

* Handle offset tile index using real current block index

* Add persistent kernel choice to grouped gemm example

* Use a for-loop for iterating over the group

* Reduce VGPR spills by early-exit

* Enable persistent kernel choice in grouped_gemm example

* Add persistent kernel option to grouped_gemm test

* Fix formatting with remod.py

* Remove GridUpdateBlocks as blocks are now iteratively computed

* Add comment about VGPR spilling

* Fix formatting

* Use CK_TILE_HOST instead of __host__

* Enable all Row/Col combinations in grouped gemm unit test

* Add some KBatch=2 cases to grouped gemm tests

* Fix SplitK for grouped gemm

* Enable pipeline hotloop/tailnumber selection in-kernel for grouped gemm

* Add type traits

* Split examples to regular and tileloop

* Formatting

* Use hipExtStreamGetCUMask to get current active CUs for the given stream

* Align test and example kernel config, and disable validation for splitk repeats

* Remove debug options from CMakeLists.txt

* Separate the code paths for persistent/non-persistent in test

* Fix formatting

* Address review comments

---------

Co-authored-by: Adam Osewski <19374865+aosewski@users.noreply.github.com>

[ROCm/composable_kernel commit: d1e6f0982d]

2025-05-20 17:18:57 +03:00

algorithm

Solve the Static Encoding Pattern compile error when the tile size is too small (#2079 )

2025-04-13 20:09:30 -07:00

arch

Update the buffer load/store intrinsic names for clang>=20. (#2192 )

2025-05-13 10:18:14 -07:00

container

Add documentation for ck_tile::array<T,N> (#2078 )

2025-04-30 16:43:36 -07:00

numeric

[CK_TILE] Add logits soft-capping & customization support to the FMHA forward kernel/pipelines (#2163 )

2025-05-13 12:19:25 +08:00

tensor

Update the buffer load/store intrinsic names for clang>=20. (#2192 )

2025-05-13 10:18:14 -07:00

utility

[CK_TILE] Grouped GEMM tile loop (#2146 )

2025-05-20 17:18:57 +03:00

config.hpp

[CK_TILE] optimize moe sorting kernel, boost large context case up to 20x (#2153 )

2025-05-06 17:32:07 +08:00

README.md

introducing ck_tile! (#1216 )

2024-04-15 19:27:12 -05:00

README.md

ck_tile/core

ck_tile/core contains every basic functions and structures to create a GPU kernel using ck_tile. User should only include ck_tile/core.hpp this single header to use all the functionality. Everything is under ck_tile namespace. The coding style under this folder should be similar to std (snake_case for structure/function, Camel for template types...)

algorithm/
    coordinate transform and some other reusable algorithm
arch/
    contains some basic device building block like mma, buffer addressing, etc...
container/
    contains basic container data structure, array/sequence/tuple/...
numeric/
    data type, and data type related math
tensor/
    tensor descriptors and tile level API
utility/
    other utility function for both host/device