From 0b4203702c9f2dd18fd18f770374ed78b580813e Mon Sep 17 00:00:00 2001 From: "assistant-librarian[bot]" <210906412+assistant-librarian[bot]@users.noreply.github.com> Date: Fri, 6 Feb 2026 16:10:23 -0800 Subject: [PATCH] [CK] add inter/intrawave scheduling concept doc (#4300) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit ## Proposed changes Adding information about inter/intrawave scheduling --- 🔁 Imported from [ROCm/composable_kernel#3660](https://github.com/ROCm/composable_kernel/pull/3660) 🧑‍💻 Originally authored by @spolifroni-amd --------- Co-authored-by: spolifroni-amd Co-authored-by: assistant-librarian[bot] Co-authored-by: Illia Silin <98187287+illsilin@users.noreply.github.com> Co-authored-by: illsilin_amdeng --- Jenkinsfile | 4 +-- docs/conceptual/CK-Tile-intra-inter-wave.rst | 26 ++++++++++++++++++++ docs/index.rst | 1 + docs/sphinx/_toc.yml.in | 2 ++ 4 files changed, 31 insertions(+), 2 deletions(-) create mode 100644 docs/conceptual/CK-Tile-intra-inter-wave.rst diff --git a/Jenkinsfile b/Jenkinsfile index 9d775bf848..717ca593cb 100644 --- a/Jenkinsfile +++ b/Jenkinsfile @@ -272,10 +272,10 @@ def shouldRunCICheck() { script: ''' if [ "$CHANGE_ID" != "" ]; then # For PR builds, compare against target branch - git diff --name-only origin/$CHANGE_TARGET...HEAD --projects/composablekernel/ + git diff --name-only origin/$CHANGE_TARGET...HEAD -- projects/composablekernel/ else # For regular builds, compare against previous commit - git diff --name-only HEAD~1..HEAD --projects/composablekernel/ + git diff --name-only HEAD~1..HEAD -- projects/composablekernel/ fi ''' ).trim().split('\n') diff --git a/docs/conceptual/CK-Tile-intra-inter-wave.rst b/docs/conceptual/CK-Tile-intra-inter-wave.rst new file mode 100644 index 0000000000..1d9e634c0f --- /dev/null +++ b/docs/conceptual/CK-Tile-intra-inter-wave.rst @@ -0,0 +1,26 @@ +.. meta:: + :description: Intrawave and interwave scheduling with CK Tile + :keywords: composable kernel, CK, CK Tile, ROCm, API, scheduling, intrawave, interwave + +************************************************************ +Intrawave and interwave scheduling with CK Tile +************************************************************ + +Two different scheduling pipelines are available to use with CK Tile's GEMM implementation. + +The interwave and intrawave scheduling pipelines coordinate waves in K dimension accumulation loops. Whether to use the interwave or intrawave pipeline depends on whether the workload is memory-bound or compute-bound. + +In interwave scheduling, the K dimension is separated into chunks. The same chunk is loaded into each wave. When the chunk has been loaded into all the waves, the same operation is run on the chunk. + +Once all the waves have completed the operation, the next chunk is loaded into the waves. + +Because all the waves are synchronized, memory accesses are coordinated, and the cache hit rate is optimized, interwave scheduling is best for memory-bound workloads. + +In intrawave scheduling, the full K dimension is loaded into each wave. Each wave runs its own operation on the K dimension independently of the other waves, and without any synchronization with the other waves. The compute unit (CU) is responsible for interleaving the independent operations. + +Because the CU has flexibility in scheduling operations, intrawave scheduling is best for compute-bound workloads. + +An example of both interwave and intrawave scheduling can be found in |gemm_utils.hpp|_, which is part of the `GEMM with CK Tile example `_. + +.. |gemm_utils.hpp| replace:: ``gemm_utils.hpp`` +.. _gemm_utils.hpp: https://github.com/ROCm/composable_kernel/blob/develop/example/ck_tile/03_gemm/gemm_utils.hpp#L37 \ No newline at end of file diff --git a/docs/index.rst b/docs/index.rst index 31d8484dc2..6744318e51 100644 --- a/docs/index.rst +++ b/docs/index.rst @@ -25,6 +25,7 @@ The Composable Kernel repository is located at `https://github.com/ROCm/composab * :doc:`Composable Kernel structure <./conceptual/Composable-Kernel-structure>` * :doc:`Composable Kernel mathematical basis <./conceptual/Composable-Kernel-math>` + * :doc:`CK Tile intrawave and interwave scheduling <../conceptual/CK-Tile-intra-inter-wave>` * :doc:`CK Tile conceptual documentation <./conceptual/ck_tile/CK-tile-index>` .. grid-item-card:: Tutorials diff --git a/docs/sphinx/_toc.yml.in b/docs/sphinx/_toc.yml.in index 90592879c0..a74b8cd363 100644 --- a/docs/sphinx/_toc.yml.in +++ b/docs/sphinx/_toc.yml.in @@ -18,6 +18,8 @@ subtrees: title: Structure - file: conceptual/Composable-Kernel-math.rst title: Mathematical basis + - file: conceptual/CK-Tile-intra-inter-wave.rst + title: Intrawave and interwave scheduling - file: conceptual/ck_tile/CK-tile-index.rst title: CK Tile conceptual documentation