ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-06-06 15:54:31 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,305 Commits 766 Branches 40 Tags
eac0f3cc47e08a7ea0d9baa8a29f749c712ae2b9
Commit Graph

1305 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Po-Yen, Chen
eac0f3cc47 Fix mismatched return type 2024-06-11 13:46:13 +00:00
PoYen, Chen
9ac2654b55 Add SplitKV combine kernel codegen logics 2024-06-11 13:46:13 +00:00
PoYen, Chen
cacce74f2c Add SplitKV kernel codegen logics 2024-06-11 13:46:13 +00:00
PoYen, Chen
78b64d11c4 Generate fmha_fwd_splitkv() 2024-06-11 13:46:13 +00:00
PoYen, Chen
c928fefaae Add num_splits option and dummy split-kv api method 2024-06-11 13:46:13 +00:00
Po Yen Chen
abc7e7ed30 Merge branch 'develop' into ck_tile/fa_train 2024-06-04 16:03:01 +08:00
dependabot[bot]
76827d82ca Bump rocm-docs-core from 1.2.0 to 1.2.1 in /docs/sphinx (#1322) 
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core) from 1.2.0 to 1.2.1.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases)
- [Changelog](https://github.com/ROCm/rocm-docs-core/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v1.2.0...v1.2.1)

---
updated-dependencies:
- dependency-name: rocm-docs-core
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-06-03 22:41:56 -07:00
danyao12
327074c3f8 fix error in WarpGemm 2024-06-04 11:42:33 +08:00
danyao12
bdd4a87199 format 2024-06-04 08:26:53 +08:00
Illia Silin
3fa7e2a6c4 disable the hipTensor test by default, only run once daily (#1321) 2024-06-03 14:07:30 -07:00
rocking
9ceff3a5c8 Generate the instance for FA required 2024-06-03 20:03:16 +00:00
zjing14
6fb1f4e03f Post-merge fix of PR 1300 (#1313) 
* add f8 gemm with multiD for both row/col wise

* change compute_type to fp8

* changed tuning parameters in the example

* add rcr example

* post-merge fix

* fix

* reduce init range
 2024-05-31 22:46:41 -07:00
root
c70662a92e format 2024-06-01 01:42:45 +00:00
Jing Zhang
09e9f10f97 format 2024-05-31 13:59:47 +00:00
root
60b328d597 Merge branch 'ck_tile/fa_train' of github.com:ROCm/composable_kernel into ck_tile/fa_train 2024-05-31 13:51:37 +00:00
Jing Zhang
0d7f71779b format 2024-05-31 13:51:28 +00:00
Po Yen Chen
ff31c6a70c Merge branch 'develop' into ck_tile/fa_train 2024-05-31 15:52:47 +08:00
danyao12
87f73f30e8 Transpose -> transpose 2024-05-29 16:54:26 +08:00
danyao12
58f61716b5 CK_TILE_HOST_DEVICE in philox 2024-05-29 16:20:34 +08:00
Illia Silin
34f3dfdd61 Build CK library for all supported targets. (#1312) 
* test library build for all supported targets

* increase the number of threads to build lib in CI to 64
 2024-05-28 12:36:06 -07:00
dependabot[bot]
66de8a02ba Bump rocm-docs-core from 1.1.3 to 1.2.0 in /docs/sphinx (#1311) 
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core) from 1.1.3 to 1.2.0.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases)
- [Changelog](https://github.com/ROCm/rocm-docs-core/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v1.1.3...v1.2.0)

---
updated-dependencies:
- dependency-name: rocm-docs-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-28 11:36:09 -07:00
zjing14
80db62f08d add f8 gemm multiD with both row/col wise scale (#1300) 
* add f8 gemm with multiD for both row/col wise

* change compute_type to fp8

* changed tuning parameters in the example

* add rcr example
 2024-05-28 12:04:22 -05:00
danyao12
1c511b3e7d update bwd kernel launch 2024-05-28 23:14:18 +08:00
danyao12
ba6437868b Merge branch 'develop' into ck_tile/fa_train 2024-05-28 11:42:38 +08:00
carlushuang
5055b3bdcb [CK_TILE] support group from cmdline (#1295) 
* support cmdline seqlen decode

* silent print

* update readme

* update kernel launch 3d

* update tile partitioner

* fix spill for bf16

* modify based on comment

* modify payload_t

* fix bug for alibi mode

* fix alibi test err

* refactor kernel launch, support select timer

* add missing file

* remove useless code

* add some comments
 2024-05-28 11:13:21 +08:00
Joseph Macaranas
02fa2c298b Enable external CI pipeline triggers (#1310) 2024-05-23 18:21:34 -04:00
Illia Silin
ec2bae27ff Split the gemm_multi_abd instances. (#1306) 
* split the gemm_multi_abd instances

* update the dates
 2024-05-23 09:17:02 -07:00
dependabot[bot]
06a9b72caf Bump rocm-docs-core from 1.1.2 to 1.1.3 in /docs/sphinx (#1308) 
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core) from 1.1.2 to 1.1.3.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases)
- [Changelog](https://github.com/ROCm/rocm-docs-core/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v1.1.2...v1.1.3)

---
updated-dependencies:
- dependency-name: rocm-docs-core
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-23 07:45:53 -07:00
danyao12
7ed2ca79ac update generated filenames 2024-05-23 17:20:10 +08:00
danyao12
ff6f33d4f7 add bwd validation stream_config 2024-05-23 15:18:43 +08:00
Max Podkorytov
29e58d5b28 Make the library which generates CK instances for pytorch2 inductor's CK backend usage 
Also bundle the CK library and include files with the pip package.

The package is pip-installable with
`pip install
git+https://github.com/tenpercent/composable_kernel@enable-pip`

(substitute the repo path and branch if necessary)

Testing:

`myenv/bin/python3 -m ck4inductor.universal_gemm.gen_instances`

(prints a list of instances)

`tree myenv/lib/python3.12/site-packages/ck4inductor`

(observe the list of sources along the installed package)
 2024-05-22 13:44:22 -07:00
Bartłomiej Kocot
fd72380aeb Optimize grouped conv bwd weight for small M and N (#1303) 
* Optimize grouped conv bwd weight for small M and N

* Fixes
 2024-05-22 21:01:01 +02:00
Illia Silin
7b027d5643 Select appropriate GPU targets for instances, tests, and examples. (#1304) 
* set individual gpu targets for instances, examples, tests

* fix path to hip compiler

* fix path to hip compiler once more

* aggregate device macros in ck_tile config header

* fix the cmake logic for instances

* fix clang format

* add gfx900 and gfx906 to default set of targets
 2024-05-22 11:45:27 -07:00
Rostyslav Geyyer
204da9c522 Move grouped conv fwd client examples (#1299) 
* Move grouped conv fwd client examples

* Update existing examples

* Format
 2024-05-21 09:52:41 -05:00
Illia Silin
06b891c5c2 aggregate device macros in ck_tile config header (#1297) 2024-05-20 08:34:45 -07:00
Illia Silin
1274861a9d replace the ENV macro with CK_ENV (#1296) 2024-05-17 10:42:51 -07:00
dependabot[bot]
6637a810d0 Bump rocm-docs-core from 1.1.1 to 1.1.2 in /docs/sphinx (#1293) 
Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core) from 1.1.1 to 1.1.2.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases)
- [Changelog](https://github.com/ROCm/rocm-docs-core/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v1.1.1...v1.1.2)

---
updated-dependencies:
- dependency-name: rocm-docs-core
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-17 07:44:48 -07:00
rocking
aaa8dfdae9 Fix compile error (#1292) 
error: no viable conversion from returned value of type '__half' to function return type 'fp16_hip_t' (aka '_Float16')

Co-authored-by: carlushuang <carlus.huang@amd.com>
 2024-05-17 17:19:17 +08:00
Illia Silin
c44137838e remove wrong use of nonexistent class members (#1290) 2024-05-15 08:08:17 -07:00
carlushuang
dd0dd13d4e remove operator-deref (#1291) 2024-05-15 08:06:50 -07:00
danyao12
826a894335 support bwd alibi 2024-05-15 21:55:02 +08:00
jakpiase
3e3471d5d2 Add unit tests for grouped gemm two stage (#1256) 
* add unit tests for grouped gemm two stage

* add reviewers suggestions

---------

Co-authored-by: Adam Osewski <19374865+aosewski@users.noreply.github.com>
 2024-05-15 10:03:39 +02:00
danyao12
a84009f83b bwd alibi 2024-05-13 10:39:44 +08:00
carlushuang
35f59c04e6 Merge remote-tracking branch 'origin/develop' into ck_tile/fa_train 2024-05-12 23:03:10 +00:00
carlushuang
bd9cd53885 now fwd/bwd can build 2024-05-12 22:33:22 +00:00
carlushuang
90700dbefa [CK_TILE] support alibi (#1269) 
* add alibi support

* fix code

* update code based on comment

* Support more hdim

* fix fp8 bias

* support seqlen_k=0 case

* remove unused printf

* fix format

---------

Co-authored-by: rocking <ChunYu.Lai@amd.com>
 2024-05-11 10:43:56 +00:00
Illia Silin
7843a8a7fb re-enable convnd_fwd_xdl_fp64 testing (#1289) 2024-05-10 22:48:28 -07:00
Illia Silin
566b6480a2 Code clean-up (#1285) 
* code clean-up

* remove the profiling output samples
 2024-05-10 09:41:39 -07:00
carlushuang
fcba889ef4 [CK_TILE] fix some rand number init (#1287) 
* add random norm

* normalized default to 0/3

* change squant->auto
 2024-05-10 09:03:39 -07:00
Bartłomiej Kocot
8346af9c68 Change output gemm type to AccDataType in two stage conv bwd wei (#1283) 2024-05-10 10:57:42 +02:00