1042 Commits

Author SHA1 Message Date
Alan Turner
b7775add2d Formatting 2024-11-18 19:22:25 +00:00
Alan Turner
3adf36beaa Move error throwing to default case 2024-11-18 18:10:11 +00:00
Alan Turner
57cdd70b7c Add gfx942 to supported architectures 2023-10-23 17:13:33 +00:00
Alan Turner
70eefcf4f2 Change config_header to literal "" 2023-10-10 23:15:03 +00:00
Alan Turner
37c3bc1a44 Add empty config.h to headers 2023-10-10 23:06:58 +00:00
Alan Turner
7d602254ff Add build_interface to ck_headers 2023-10-10 22:30:40 +00:00
Alan Turner
d01af027c1 Update embed.cmake 2023-10-10 20:05:46 +00:00
Alan Turner
36674bdc8a Changes to embed.cmake 2023-10-10 16:39:22 +00:00
Alan Turner
761899c259 Update embed.cmake 2023-10-09 19:45:02 +00:00
Alan Turner
740caa9ee8 Update embed.cmake 2023-10-09 18:13:28 +00:00
Umang Yadav
4b0b327b81 merge migx-jit-lib-hiprtc branch 2023-10-02 20:38:26 +00:00
Umang Yadav
ba251e4a11 Formatting and put find_package(hip) behind JIT_LIB flag 2023-09-29 15:14:55 +00:00
Umang Yadav
000c8bcf79 Merge branch 'migx-jit-lib' into migraphx 2023-09-28 14:06:00 +00:00
Alan Turner
8f9c0243c7 Merge branch 'develop' into migx-jit-lib 2023-09-22 23:27:30 +00:00
Alan Turner
181ea79a3d Avoid pipeline version 2 when k % kpb != 0 2023-09-22 20:09:41 +00:00
Alan Turner
11cab2d533 Remove copied comments 2023-09-21 22:27:05 +00:00
Alan Turner
8a5e3fb02b Fix sequence regex 2023-09-21 22:14:10 +00:00
Alan Turner
e10cbe9ee2 Add constexpr IsSupported 2023-09-21 16:40:41 +00:00
Alan Turner
d967621546 Add Descriptor and Run to device op 2023-09-20 00:52:47 +00:00
Alan Turner
611196d598 Fix cmake, constexpr issupported 2023-08-29 17:26:15 -07:00
Alan Turner
45ff21e156 Add jit lib for batched_gemm_softmax_gemm 2023-08-29 12:48:41 -07:00
Alan Turner
e8b54cb376 Update parse_instance_strings 2023-08-29 11:04:29 -07:00
Alan Turner
4f7d9bbed8 Add descriptor class and run method 2023-08-28 16:12:50 -07:00
Alan Turner
4100d1d821 Merge remote-tracking branch 'origin/develop' into migx-flash-attn 2023-08-23 13:28:55 -07:00
Jun Liu
c8a8385fdd [HotFix] add config and version files to pass on build info (#856)
* experiment with config file

* experiment with version.h config

* add more info to version.h

* minor updates

* minor updates

* fix case where DTYPE is not used

* large amount of files but minor changes

* remove white space

* minor changes to add more MACROs

* fix cmakedefine01

* fix issue with CK internal conflict

* fix define and define value

* fix clang-format

* fix formatting issue

* experiment with cmake

* clang format v12 to be consistent with miopen

* avoid clang-format for config file
2023-08-23 11:36:17 -07:00
Qianfeng
350d64f351 Add workspace setting up for batchnorm bwd/fwd client examples (#860) 2023-08-24 01:13:07 +08:00
Illia Silin
7c71dc7e70 use correct data types in cmake conditions for splitk gemm example (#862) 2023-08-23 09:52:11 -07:00
zjing14
8ebea3a56e add generic instances (#858)
Co-authored-by: Jing Zhang <jizha@amd.com>
2023-08-23 09:18:10 -05:00
zjing14
ca3115e7e8 Ck profiler splitk (#857)
* updated regular gemm

* update ckProfiler

* fixed gtests

---------

Co-authored-by: Jing Zhang <jizha@amd.com>
2023-08-22 16:54:34 -07:00
Bartłomiej Kocot
595d23be14 Fix transform and instances for grouped conv bwd data (#848)
* Fix transform and instances for grouped conv bwd data

* Add instances for small K and small C

* Remove workaround after fix

* Fix interface tests
2023-08-22 11:25:41 -05:00
Rostyslav Geyyer
eac50708d9 Add instances/ckProfiler/client example for fp8/fp16 mixed precision Gemm (#853)
* Add ComputeType arg to splitk device and gridwise ops

* Update for gridwise op compatibility

* Update bf16 and int8 splitk gemm examples with ComputeType

* Add instances

* Update ckProfiler for mixed precision cases

* Add a mixed precision splitK gemm client example

---------

Co-authored-by: zjing14 <zhangjing14@gmail.com>
2023-08-22 09:34:49 -05:00
cloudhan
d52ec01652 Use asynchronous version of hipMemset (#850) 2023-08-18 11:14:59 +08:00
Bartlomiej Wroblewski
32fe996da0 Fix datatype in inner_product when V_DOT2 is disabled (#849) 2023-08-17 10:54:11 -05:00
Bartlomiej Wroblewski
d4c84256f7 Implement DPP8 based GEMM for Navi21 (#826) 2023-08-14 15:46:27 -05:00
rocking
f60f0a5e03 Refactor pool fwd (#815)
* Do not hardcode stride

* devicePool2DFwd Inherit devicePool3DFwd

* Move instance declaration out of common

* Add dilation

* use the pool3d rank, because pool2d inherit pooo3d

* calculate Do Ho Wo for the dilation

* Fix header name

* Modify ckProfiler

* Remove pool2d instance

* Remove pool2d in profiler

* Remove pool2d and add dilation

* In to client example, this commit revise following:
1. Add dilation.
2. Use pool3d to implement pool2d

* Refine naming and IsSupportedArgument()

* Add dilation to maxpool bwd example

* clang format

* 1. Remove useless header
2. Fix copyright
3. Refine naming

* Add layout parameter to pool fwd

* clang format

* Fix merge error

* Fix compile error

* Remove layout parameter in derived class

* Refine changlog

* Fix compile error

* Fix compiler error

* Add layout to external api and profiler
2023-08-15 02:25:28 +08:00
rocking
03b8119e2e Add Normalization splitk instances (#829)
* Add normalization splitK to layernorm and groupnorm instances

* Fix bug of GetKPerThread()

* Refine naming

* clang format
2023-08-12 01:31:31 +08:00
dependabot[bot]
a5343db00d Bump rocm-docs-core from 0.10.3 to 0.20.0 in /docs/sphinx (#844)
* Bump rocm-docs-core from 0.10.3 to 0.20.0 in /docs/sphinx

Bumps [rocm-docs-core](https://github.com/RadeonOpenCompute/rocm-docs-core) from 0.10.3 to 0.20.0.
- [Release notes](https://github.com/RadeonOpenCompute/rocm-docs-core/releases)
- [Changelog](https://github.com/RadeonOpenCompute/rocm-docs-core/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/RadeonOpenCompute/rocm-docs-core/compare/v0.10.3...v0.20.0)

---
updated-dependencies:
- dependency-name: rocm-docs-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* set min version of rocm-docs-core

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sam Wu <sam.wu2@amd.com>
2023-08-11 11:27:56 -06:00
Illia Silin
6237bd1247 Add the rocm5.7 RC1 compiler and use it for QA builds. (#842)
* add docker for rocm5.7 RC1

* fix rocm5.7 rc1 build

* build QA with rocm5.7 rc1 compiler
2023-08-10 09:25:21 -07:00
rocking
578142db3a Average pool backward deviceOP and example (#797)
* Add avgpool bwd reference code

* Refine naming

* Fix invalid in_element op in ref_conv

* Add example (only reference now)

* Add the full example of avgpool bwd

* Fix copyright

* Imitate MakeDescriptor from  transform_conv_bwd_data_to_gemm_v1.hpp

* rename channel to c from k

* Arrange the code

* Imitate the argument from conv bwd

* Implement invoker

* Fix order of parameter in example

* Refactor reference code for different dimension

* Support different stride

* Check if argument is valid

* Fix kernel parameter for NDHWC, fastest dimension C is not reduced

* Add more data type in example

* Fix bug in example

* calculate Do Ho Wo according to the dilation

* Remove useless header

* Add comment in reference code

* Add layout parameter

* Remove layout in derived class

* Refine reference comment
2023-08-10 12:04:35 +08:00
Illia Silin
cbbd172fd6 Update the rocm version threshold to apply the -fno-offload-uniform-block flag. (#839)
* add fno-offload-uniform-block flag for rocm5.7 and up

* add a comment and compiler ticket number

* update the threshold rocm version
2023-08-09 13:50:04 -07:00
Illia Silin
1b7da171c9 Update the list of contributors. (#836)
* add linting and update contributors list

* skip the linting and doc changes

* add Astha

* add YanXing
2023-08-09 13:44:13 -07:00
Illia Silin
9af519ee86 add gfx941 to the ckProfiler package (#840) 2023-08-09 10:30:40 -07:00
Bartłomiej Kocot
472fa029ba Enable grouped conv with small K or C (#822)
* Enable grouped conv with small K or C

* Add missing instances

* Refactor grouped conv fwd instances

* Fix fp16 instances since it supports src_per_vec %2 = 0

* Add generic instances
2023-08-09 10:40:55 -05:00
Rostyslav Geyyer
9c54eaab04 Enable f16/f8 mixed precision mode (#820)
* Enable f16/f8 mixed precision

* Add an argument to enable mixed precision

* Update for compatibility

* Add mixed precision example

* Introduce ComputeType argument
2023-08-09 08:44:23 -05:00
Illia Silin
6802611334 add no-offload-uniform-block flag for rocm5.7 and up (#838)
* add -fno-offload-uniform-block flag for rocm5.7 and up

* add a comment and compiler ticket number
2023-08-08 17:58:31 -07:00
Illia Silin
08eb176929 Allow building CK for specific data types and split off last remaining DL instances. (#830)
* properly split conv_nd_bwd_data instances

* split conv2d_fwd instance data types

* split the gemm, conv2d_fwd and batched_gemm_softamx_gemm

* split the tests by data types where possible

* filter examples by DTYPES

* split few remaining examples by DTYPES

* filter most instances by DTYPES

* add new lines at end of headers, fix grouped_gemm profiler

* fix syntax

* split the ckprofiler instances by DTYPES

* split the conv2d and quantization DL and XDL instances

* fix the splitting of conv2d DL instances

* split softmax and pool_fwd tests for fp16 and fp32 types

* fix syntax

* fix the dl_int8 quantization instances isolation
2023-08-07 14:56:10 -07:00
Bartłomiej Kocot
22443f7aae Add wei_strides to grouped conv3d wei to keep consistency (#817)
* Add wei_strides to grouped conv3d wei to keep consistency

* Fix strides in client examples

* Unify backward weight api with forward

* Fix for example

* Fixes for examples

---------

Co-authored-by: zjing14 <zhangjing14@gmail.com>
2023-08-07 10:23:45 -05:00
Illia Silin
2474dddbee add an option to build ckProfiler package for specific architectures (#828) 2023-08-03 10:10:27 -07:00
Bartlomiej Kocot
aac65a031e Change to github_issue prefix 2023-08-03 16:38:28 +02:00
Bartlomiej Kocot
e6a826d35a Rename the workaround to a proper issue name 2023-08-03 16:38:28 +02:00