Nallani Bhaskar c6dd7c1b4b Added new API in aocl_gemm to support A bf16 data type and B s4 data type ...

Description:

1. Added a new API aocl_gemm_bf16s4f32of32 to support
   for WoQ (Weight-only-Quantization) in LLM's

2. The API supports only reordered B matrix of data
   size signed 4 bits (S4).

3. Substracting zero point and multiplying with scale
   on B matrix is performed in packing B.

4. zero point and scale data should be passed by user
   through pre-ops data structure.

5. The API is still in experimental state and NOT tested.

   AMD-Internal: SWLCSG-2943

Change-Id: I10b159b64c2e2aaf39da5462685618ba8cc800ee

2024-07-25 11:59:03 +00:00

..

armsve

Merge commit 'cfa3db3f' into amd-main

2024-07-08 06:09:11 -04:00

armv7a

Add explicit handling for beta == 0 in armsve sd and armv7a d gemm ukrs.

2021-09-29 16:43:38 -05:00

armv8a

Armv8 Trash New Bulk Kernels

2021-10-08 02:35:58 +09:00

bgq

Replaced use of bool_t type with C99 bool.

2020-08-03 11:27:13 +05:30

bulldozer

BLIS: Missing clobbers (batch 7)

2023-11-22 17:51:46 -05:00

generic

Added a dummy file to kernels/generic.

2017-11-21 12:34:20 -06:00

haswell

BUGFIX: Updated ZGEMM microkernel to handle alpha = 0 case

2024-06-20 02:58:43 -04:00

knc

Remove UT-Austin from copyright headers' clause 3.

2018-12-04 14:31:06 -06:00

knl

BLIS: Missing clobbers (batch 7)

2023-11-22 17:51:46 -05:00

old

Remove UT-Austin from copyright headers' clause 3.

2018-12-04 14:31:06 -06:00

penryn

Optionally disable trsm diagonal pre-inversion.

2020-12-04 16:08:15 -06:00

piledriver

BLIS library porting on to Windows:

2020-06-16 18:29:00 +05:30

power7

Remove UT-Austin from copyright headers' clause 3.

2018-12-04 14:31:06 -06:00

power9

Merge commit 'e366665c' into amd-main

2023-10-18 09:09:54 -04:00

power10

Code cleanup: No newline at end of file

2023-04-21 10:02:48 -04:00

sandybridge

BLIS: Missing clobbers (batch 7)

2023-11-22 17:51:46 -05:00

skx

Code cleanup: AMD copyright notice

2023-11-23 08:54:31 -05:00

zen

Framework enhancements for ?AXPBYV APIs

2024-07-18 10:06:31 -04:00

zen2

Code cleanup: AMD copyright notice

2023-11-23 08:54:31 -05:00

zen3

Added support for zen3 configuration

2020-07-22 18:24:26 +05:30

zen4

Added new API in aocl_gemm to support A bf16 data type and B s4 data type

2024-07-25 11:59:03 +00:00

zen5

DGEMM optimizations for Turin Classic

2024-07-09 07:53:27 -04:00

CMakeLists.txt

Removed -fno-tree-loop-vectorize from kernel flags

2024-07-19 00:49:52 -04:00