mirror of
https://github.com/ROCm/composable_kernel.git
synced 2026-05-05 06:01:23 +00:00
642d5e9155
* Add contraction profiler and tests * Build and style fixes * Allow to use any elementwise operator for ref_contraction * Introduce profile_contraction_scale and profile_contraction_bilinear * Make ref_contraction generic and extend interface tests * Stylistic minor fixes * Extend test_contraction_interface
79 lines
3.5 KiB
Markdown
79 lines
3.5 KiB
Markdown
## Profile GEMM kernels
|
|
```bash
|
|
#arg1: tensor operation (gemm=GEMM)
|
|
#arg2: data type (0=fp32, 1=fp16)
|
|
#arg3: matrix layout (0=NN, 1=NT, 2=TN, 3=TT)
|
|
#arg4: verification (0=no, 1=yes)
|
|
#arg5: initialization (0=no init, 1=integer value, 2=decimal value)
|
|
#arg6: print matrix value (0=no, 1=yes)
|
|
#arg7: run kernel # of times (>1)
|
|
#arg8 to 13: M, N, K, StrideA, StrideB, StrideC
|
|
|
|
################ op datatype layout verify init log repeat M___ N___ K___ StrideA StrideB StrideC
|
|
./bin/ckProfiler gemm 1 1 1 1 0 5 3840 4096 4096 4096 4096 4096
|
|
```
|
|
|
|
Result (MI100 @ 1087Mhz, 133.5TFlops peak FP16)
|
|
```bash
|
|
a_m_k: dim 2, lengths {3840, 4096}, strides {4096, 1}
|
|
b_k_n: dim 2, lengths {4096, 4096}, strides {1, 4096}
|
|
c_m_n: dim 2, lengths {3840, 4096}, strides {4096, 1}
|
|
....
|
|
Best Perf: 1.1933 ms, 107.977 TFlops, 79.0848 GB/s
|
|
```
|
|
|
|
## Profile 2d forward convolution kernels
|
|
```bash
|
|
#arg1: tensor operation (conv=Convolution)
|
|
#arg2: data type (0=fp32, 1=fp16)
|
|
#arg3: input tensor layout (0=NCHW, 1=NHWC)
|
|
#arg4: weight tensor layout (0=KCYX, 1=KYXC)
|
|
#arg5: output tensor layout (0=NKHW, 1=NHWK)
|
|
#arg6: verification (0=no, 1=yes)
|
|
#arg7: initialization (0=no init, 1=integer value, 2=decimal value)
|
|
#arg8: print matrix value (0=no, 1=yes)
|
|
#arg9: run kernel # of times (>1)
|
|
#arg10 to 24: N, K, C, Y, X, Hi, Wi, Sy, Sx, Dy, Dx, LeftPy, LeftPx, RightPy, RightPx
|
|
################ op datatype in_layout wei_layout out_layout verify init log repeat N__ K___ C___ Y X Hi__ Wi__ Strides Dilations LeftPads RightPads
|
|
./bin/ckProfiler conv2d_fwd 1 1 1 1 1 1 0 5 128 256 192 3 3 71 71 2 2 1 1 1 1 1 1
|
|
```
|
|
|
|
Result (MI100 @ 1087Mhz, 133.5TFlops peak FP16)
|
|
```
|
|
in_n_c_hi_wi: dim 4, lengths {128, 192, 71, 71}, strides {967872, 1, 13632, 192}
|
|
wei_k_c_y_x: dim 4, lengths {256, 192, 3, 3}, strides {1728, 1, 576, 192}
|
|
out_n_k_ho_wo: dim 4, lengths {128, 256, 36, 36}, strides {331776, 1, 9216, 256}
|
|
....
|
|
Best Perf: 1.42509 ms, 102.988 TFlops, 234.086 GB/s
|
|
```
|
|
|
|
## Profile contraction kernels
|
|
```bash
|
|
#arg1: tensor operation (contraction_bilinear=CONTRACTION+Bilinear)
|
|
#arg2: data type (0: fp32; 1: f64)\n"
|
|
#arg3: matrix layout (0: A[m0, m1, k0, k1] * B[k0, k1, n0, n1] + D[m0, m1, n0, n1] = E[m0, m1, n0, n1];
|
|
# 1: A[m0, m1, k0, k1] * B[n0, n1, k0, k1] + D[m0, m1, n0, n1] = E[m0, m1, n0, n1];
|
|
# 2: A[k0, k1, m0, m1] * B[k0, k1, n0, n1] + D[m0, m1, n0, n1] = E[m0, m1, n0, n1];
|
|
# 3: A[k0, k1, m0, m1] * B[n0, n1, k0, k1] + D[m0, m1, n0, n1] = E[m0, m1, n0, n1])
|
|
#arg4: verification (0: no; 1: yes)
|
|
#arg5: initialization (0: no init; 1: integer value; 2: decimal value)
|
|
#arg6: print tensor value (0: no; 1: yes)
|
|
#arg7: time kernel (0: no, 1: yes)
|
|
#arg8 and arg9: alpha and beta
|
|
#arg10 to 15: M0, M1, N0, N1, K0, K1
|
|
#arg16 to 31: Strides for A, B, D and E (skip for default)
|
|
|
|
################ op datatype layout verify init log time alpha beta M0 M1 N0 N1 K0 K1
|
|
./bin/ckProfiler contraction_bilinear 0 1 0 0 0 1 1.0 1.0 128 128 128 128 128 128
|
|
```
|
|
|
|
Result (MI100)
|
|
```bash
|
|
a_m_k: dim 4, lengths {128, 128, 128, 128}, strides {2097152, 16384, 128, 1}
|
|
b_k_n: dim 4, lengths {128, 128, 128, 128}, strides {128, 1, 2097152, 16384}
|
|
d_m_n: dim 4, lengths {128, 128, 128, 128}, strides {2097152, 16384, 128, 1}
|
|
e_m_n: dim 4, lengths {128, 128, 128, 128}, strides {2097152, 16384, 128, 1}
|
|
....
|
|
Best Perf: 211.405 ms, 41.6077 TFlops, 15.2372 GB/s
|
|
```
|