Meghana Vankadari 7243a5d521 Implemented group level static quantization for s8s8s32of32|bf16 APIs ...

Details:
- Group quantization is technique to improve accuracy
  where scale factors to quantize inputs and weights
  varies at group level instead of per channel
  and per tensor level.
- Added new bench files to test GEMM with symmetric static
  quantization.
- Added new get_size and reorder functions to account for
  storing sum of col-values separately per group.
- Added new framework, kernels to support the same.
- The scalefactors could be of type float or bf16.

AMD-Internal:[SWLCSG-3274]

Change-Id: I3e69ecd56faa2679a4f084031d35ffb76556230f

2025-02-28 04:44:44 -05:00

..

armsve

Merge commit 'cfa3db3f' into amd-main

2024-07-08 06:09:11 -04:00

armv7a

Add explicit handling for beta == 0 in armsve sd and armv7a d gemm ukrs.

2021-09-29 16:43:38 -05:00

armv8a

Armv8 Trash New Bulk Kernels

2021-10-08 02:35:58 +09:00

bgq

Replaced use of bool_t type with C99 bool.

2020-08-03 11:27:13 +05:30

bulldozer

Code cleanup: Copyright notices

2024-08-05 15:35:08 -04:00

generic

Added a dummy file to kernels/generic.

2017-11-21 12:34:20 -06:00

haswell

BLIS: Missing clobbers (batch 8)

2025-02-07 10:39:24 -05:00

knc

Remove UT-Austin from copyright headers' clause 3.

2018-12-04 14:31:06 -06:00

knl

Code cleanup: Copyright notices

2024-08-05 15:35:08 -04:00

old

Remove UT-Austin from copyright headers' clause 3.

2018-12-04 14:31:06 -06:00

penryn

Optionally disable trsm diagonal pre-inversion.

2020-12-04 16:08:15 -06:00

piledriver

Code cleanup: Miscellaneous fixes

2024-08-06 06:56:01 -04:00

power7

Remove UT-Austin from copyright headers' clause 3.

2018-12-04 14:31:06 -06:00

power9

Merge commit 'e366665c' into amd-main

2023-10-18 09:09:54 -04:00

power10

Code cleanup: No newline at end of file

2023-04-21 10:02:48 -04:00

sandybridge

BLIS: Missing clobbers (batch 7)

2023-11-22 17:51:46 -05:00

skx

Code cleanup: Copyright notices

2024-08-05 15:35:08 -04:00

zen

Added Support for General Stride in DGEMV

2025-02-27 12:47:21 -05:00

zen2

Code cleanup: AMD copyright notice

2023-11-23 08:54:31 -05:00

zen3

Added support for zen3 configuration

2020-07-22 18:24:26 +05:30

zen4

Implemented group level static quantization for s8s8s32of32|bf16 APIs

2025-02-28 04:44:44 -05:00

zen5

Added new ZTRSM small code path for ZEN5

2025-02-06 18:01:10 +05:30

CMakeLists.txt

Code cleanup: Copyright notices

2024-08-05 15:35:08 -04:00