mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-04 05:31:24 +00:00

Files

Haocong WANG 05a6e92705 Re-enable optimization for gfx950 fmha fwd (#2671 )

* Fix for fwd/bwd kernel build filter

* fix bwd code

* save an example for __bf16 type

* temp save, waiting for debug

* tempsave, fmha_decode

* temp save, change all instance to 1wave

* fix async copytest bug

* Add block_sync_lds_direct_load utility

* fix the s_waitcnt_imm calculation

* Improve s_waitcnt_imm calculation

* fix vmcnt shift

* add input validation and bug fix

* remove unnecessary output

* move test_copy into test

* temp save

* tempsave

* compile pass

* tempsave, trload+asyncload done

* tempsave. asynccopy+trload sanity checked

* remove unnecessary features

* fix the lds alignment caused performance regression

* enable prefill overload operator().

* remove all lds bankconflict with xor layouts

* enable larger tile size; upgrade xor pattern

* upgrade prefill pipeline; simple iglp; consistent data produce and consume order

* small refactor

* Load Q through lds, implement xor;

* add vmcnt guard before load ktile

* Add v_permlaneb32 for block_reduce. Disable it as it will cause un-coexecutable packed math in FA

* Add XOR fold strategy for hdim<128, but perf dropped; disable it by default; wait further perf debug

* add __restrict__ to tr load

* merge fa_decode pipeline into fmha_fwd api

* remove unnecessary files; rename some files

* Remove unnecessary changes

* bug fix, clang format;

* remove non-necessary change

* fix clangformat with 18.1.3

* fix bugs

* fix bug

* fix bug on non-gfx950

* fix bugs in gemm

* fix bug in pki4

* tempsave, update the blocksync functions

* change the warp setting for hdim32 fmha fwd

* clang format

* fix conflict. disable all v-col instance for fmha fwd

* Fix the bug

* clang format

* refactor blockgemm change, isolate to v2;

---------

Co-authored-by: Max Podkorytov <4273004+tenpercent@users.noreply.github.com>
Co-authored-by: asleepzzz <hanwen.chang@amd.com>

2025-08-13 14:57:43 +08:00

algorithm

[CK_TILE] Enable printing more structures in CK-Tile (#2443 )

2025-08-07 15:45:27 +03:00

arch

Re-enable optimization for gfx950 fmha fwd (#2671 )

2025-08-13 14:57:43 +08:00

container

[CK_TILE] Enable printing more structures in CK-Tile (#2443 )

2025-08-07 15:45:27 +03:00

numeric

Re-enable optimization for gfx950 fmha fwd (#2671 )

2025-08-13 14:57:43 +08:00

tensor

[CK_TILE] FMHA BWD Optimization For GFX950 (#2628 )

2025-08-12 11:11:55 +08:00

utility

Fixes to "General 2D Reduction Kernel" (#2535 ) (#2656 )

2025-08-11 15:01:33 +02:00

config.hpp

Re-enable optimization for gfx950 fmha fwd (#2671 )

2025-08-13 14:57:43 +08:00

README.md

introducing ck_tile! (#1216 )

2024-04-15 19:27:12 -05:00

README.md

ck_tile/core

ck_tile/core contains every basic functions and structures to create a GPU kernel using ck_tile. User should only include ck_tile/core.hpp this single header to use all the functionality. Everything is under ck_tile namespace. The coding style under this folder should be similar to std (snake_case for structure/function, Camel for template types...)

algorithm/
    coordinate transform and some other reusable algorithm
arch/
    contains some basic device building block like mma, buffer addressing, etc...
container/
    contains basic container data structure, array/sequence/tuple/...
numeric/
    data type, and data type related math
tensor/
    tensor descriptors and tile level API
utility/
    other utility function for both host/device