mirror of
https://github.com/amd/blis.git
synced 2026-05-11 17:50:00 +00:00
Details: - Reworked the build system around a configuration registry file, named config_registry', that identifies valid configuration targets, their constituent sub-configurations, and the kernel sets that are needed by those sub-configurations. The build system now facilitates the building of a single library that can contains kernels and cache/register blocksizes for multiple configurations (microarchitectures). Reference kernels are also built on a per-configuration basis. - Updated the Makefile to use new variables set by configure via the config.mk.in template, such as CONFIG_LIST, KERNEL_LIST, and KCONFIG_MAP, in determining which sub-configurations (CONFIG_LIST) and kernel sets (KERNEL_LIST) are included in the library, and which make_defs.mk files' CFLAGS (KCONFIG_MAP) are used when compiling kernels. - Reorganized 'kernels' directory into a "flat" structure. Renamed kernel functions into a standard format that includes the kernel set name (e.g. 'haswell'). Created a "bli_kernels_<kernelset>.h" file in each kernels sub-directory. These files exist to provide prototypes for the kernels present in those directories. - Reorganized reference kernels into a top-level 'ref_kernels' directory. This directory includes a new source file, bli_cntx_ref.c (compiled on a per-configuration basis), that defines the code needed to initialize a reference context and a context for induced methods for the microarchitecture in question. - Rewrote make_defs.mk files in each configuration so that the compiler variables (e.g. CFLAGS) are "stored" (renamed) on a per-configuration basis. - Modified bli_config.h.in template so that bli_config.h is generated with #defines for the config (family) name, the sub-configurations that are associated with the family, and the kernel sets needed by those sub-configurations. - Deprecated all kernel-related information in bli_kernel.h and transferred what remains to new header files named "bli_arch_<configname>.h", which are conditionally #included from a new header bli_arch.h. These files are still needed to set library-wide parameters such as custom malloc()/free() functions or SIMD alignment values. - Added bli_cntx_init_<configname>.c files to each configuration directory. The files contain a function, named the same as the file, that initializes a "native" context for a particular configuration (microarchitecture). The idea is that optimized kernels, if available, will be initialized into these contexts. Other fields will retain pointers to reference functions, which will be compiled on a per-configuration basis. These bli_cntx_init_*() functions will be called during the initialization of the global kernel structure. They are thought of as initializing for "native" execution, but they also form the basis for contexts that use induced methods. These functions are prototyped, along with their _ref() and _ind() brethren, by prototype-generating macros in bli_arch.h. - Added a new typedef enum in bli_type_defs.h to define an arch_t, which identifies the various sub-configurations. - Redesigned the global kernel structure (gks) around a 2D array of cntx_t structures (pointers to cntx_t, actually). The first dimension is indexed over arch_t and the inner dimension is the ind_t (induced method) for each microarchitecture. When a microarchitecture (configuration) is "registered" at init-time, the inner array for that configuration in the 2D array is initialized (and allocated, if it hasn't been already). The cntx_t slot for BLIS_NAT is initialized immediately and those for other induced method types are initialized and cached on-demand, as needed. At cntx_t registration, we also store function pointers to cntx_init functions that will initialize (a) "reference" contexts and (b) contexts for use with induced methods. We don't cache the full contexts for reference contexts since they are rarely needed. The functions that initialize these two kinds of contexts are generated automatically for each targeted sub-configuration from cpp-templatized code at compile-time. Induced method contexts that need "stage" adjustments can still obtain them via functions in bli_cntx_ind_stage.c. - Added new functions and functionality to bli_cntx.c, such as for setting the level-1f, level-1v, and packm kernels, and for converting a native context into one for executing an induced method. - Moved the checking of register/cache blocksize consistency from being cpp macros in bli_kernel_macro_defs.h to being runtime checks defined in bli_check.c and called from bli_gks_register_cntx() at the time that the global kernel structure's internal context is initialized for a given microarchitecture/configuration. - Deprecated all of the old per-operation bli_*_cntx.c files and removed the previous operation-level cntx_t_init()/_finalize() invocations. Instead, we now query the gks for a suitable context, usually via bli_gks_query_cntx(). - Deprecated support for the 3m2 and 3m3 induced methods. (They required hackery that I was no longer willing to support.) - Consolidated the 1e and 1r packm kernels for any given register blocksize into a single kernel that will branch on the schema and support packing to both formats. - Added the cntx_t* argument to all packm kernel signatures. - Deprecated the local function pointer array in all bli_packm_cxk*.c files and instead obtain the packm kernel from the cntx_t. - Added bli_calloc_intl(), which serves as the calloc-equivalent to to bli_malloc_intl(). Useful when we wish to allocate and initialize to zero/NULL. - Converted existing cpp macro functions defined in bli_blksz.h, bli_func.h, bli_cntx.h into static functions.
210 lines
6.4 KiB
C
210 lines
6.4 KiB
C
/*
|
|
|
|
BLIS
|
|
An object-based framework for developing high-performance BLAS-like
|
|
libraries.
|
|
|
|
Copyright (C) 2014, The University of Texas at Austin
|
|
|
|
Redistribution and use in source and binary forms, with or without
|
|
modification, are permitted provided that the following conditions are
|
|
met:
|
|
- Redistributions of source code must retain the above copyright
|
|
notice, this list of conditions and the following disclaimer.
|
|
- Redistributions in binary form must reproduce the above copyright
|
|
notice, this list of conditions and the following disclaimer in the
|
|
documentation and/or other materials provided with the distribution.
|
|
- Neither the name of The University of Texas at Austin nor the names
|
|
of its contributors may be used to endorse or promote products
|
|
derived from this software without specific prior written permission.
|
|
|
|
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
|
|
"AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
|
|
LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
|
|
A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
|
|
HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
|
|
SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
|
|
LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
|
|
DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
|
|
THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
|
|
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
|
|
OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
|
|
|
|
*/
|
|
|
|
#ifndef BLIS_KERNEL_H
|
|
#define BLIS_KERNEL_H
|
|
|
|
/* Use the same parameters as non-SIMD PNaCl */
|
|
|
|
// -- LEVEL-3 MICRO-KERNEL CONSTANTS -------------------------------------------
|
|
|
|
#define BLIS_SIMD_ALIGN_SIZE 16
|
|
|
|
// -- Cache blocksizes --
|
|
|
|
//
|
|
// Constraints:
|
|
//
|
|
// (1) MC must be a multiple of:
|
|
// (a) MR (for zero-padding purposes)
|
|
// (b) NR (for zero-padding purposes when MR and NR are "swapped")
|
|
// (2) NC must be a multiple of
|
|
// (a) NR (for zero-padding purposes)
|
|
// (b) MR (for zero-padding purposes when MR and NR are "swapped")
|
|
//
|
|
|
|
#define BLIS_DEFAULT_MC_S 252
|
|
#define BLIS_DEFAULT_KC_S 264
|
|
#define BLIS_DEFAULT_NC_S 8196
|
|
|
|
#define BLIS_DEFAULT_MC_D 1080
|
|
#define BLIS_DEFAULT_KC_D 120
|
|
#define BLIS_DEFAULT_NC_D 8400
|
|
|
|
#define BLIS_DEFAULT_MC_C 120
|
|
#define BLIS_DEFAULT_KC_C 264
|
|
#define BLIS_DEFAULT_NC_C 4092
|
|
|
|
#define BLIS_DEFAULT_MC_Z 60
|
|
#define BLIS_DEFAULT_KC_Z 264
|
|
#define BLIS_DEFAULT_NC_Z 2040
|
|
|
|
// -- Register blocksizes --
|
|
|
|
#define BLIS_DEFAULT_MR_S 4
|
|
#define BLIS_DEFAULT_NR_S 3
|
|
|
|
#define BLIS_DEFAULT_MR_D 4
|
|
#define BLIS_DEFAULT_NR_D 3
|
|
|
|
#define BLIS_DEFAULT_MR_C 2
|
|
#define BLIS_DEFAULT_NR_C 3
|
|
|
|
#define BLIS_DEFAULT_MR_Z 2
|
|
#define BLIS_DEFAULT_NR_Z 3
|
|
|
|
// NOTE: If the micro-kernel, which is typically unrolled to a factor
|
|
// of f, handles leftover edge cases (ie: when k % f > 0) then these
|
|
// register blocksizes in the k dimension can be defined to 1.
|
|
|
|
//#define BLIS_DEFAULT_KR_S 1
|
|
//#define BLIS_DEFAULT_KR_D 1
|
|
//#define BLIS_DEFAULT_KR_C 1
|
|
//#define BLIS_DEFAULT_KR_Z 1
|
|
|
|
// -- Maximum cache blocksizes (for optimizing edge cases) --
|
|
|
|
// NOTE: These cache blocksize "extensions" have the same constraints as
|
|
// the corresponding default blocksizes above. When these values are
|
|
// larger than the default blocksizes, blocksizes used at edge cases are
|
|
// enlarged if such an extension would encompass the remaining portion of
|
|
// the matrix dimension.
|
|
|
|
//#define BLIS_MAXIMUM_MC_S (BLIS_DEFAULT_MC_S + BLIS_DEFAULT_MC_S/4)
|
|
//#define BLIS_MAXIMUM_KC_S (BLIS_DEFAULT_KC_S + BLIS_DEFAULT_KC_S/4)
|
|
//#define BLIS_MAXIMUM_NC_S (BLIS_DEFAULT_NC_S + BLIS_DEFAULT_NC_S/4)
|
|
|
|
//#define BLIS_MAXIMUM_MC_D (BLIS_DEFAULT_MC_D + BLIS_DEFAULT_MC_D/4)
|
|
//#define BLIS_MAXIMUM_KC_D (BLIS_DEFAULT_KC_D + BLIS_DEFAULT_KC_D/4)
|
|
//#define BLIS_MAXIMUM_NC_D (BLIS_DEFAULT_NC_D + BLIS_DEFAULT_NC_D/4)
|
|
|
|
//#define BLIS_MAXIMUM_MC_C (BLIS_DEFAULT_MC_C + BLIS_DEFAULT_MC_C/4)
|
|
//#define BLIS_MAXIMUM_KC_C (BLIS_DEFAULT_KC_C + BLIS_DEFAULT_KC_C/4)
|
|
//#define BLIS_MAXIMUM_NC_C (BLIS_DEFAULT_NC_C + BLIS_DEFAULT_NC_C/4)
|
|
|
|
//#define BLIS_MAXIMUM_MC_Z (BLIS_DEFAULT_MC_Z + BLIS_DEFAULT_MC_Z/4)
|
|
//#define BLIS_MAXIMUM_KC_Z (BLIS_DEFAULT_KC_Z + BLIS_DEFAULT_KC_Z/4)
|
|
//#define BLIS_MAXIMUM_NC_Z (BLIS_DEFAULT_NC_Z + BLIS_DEFAULT_NC_Z/4)
|
|
|
|
// -- Packing register blocksize (for packed micro-panels) --
|
|
|
|
// NOTE: These register blocksize "extensions" determine whether the
|
|
// leading dimensions used within the packed micro-panels are equal to
|
|
// or greater than their corresponding register blocksizes above.
|
|
|
|
//#define BLIS_PACKDIM_MR_S (BLIS_DEFAULT_MR_S + ...)
|
|
//#define BLIS_PACKDIM_NR_S (BLIS_DEFAULT_NR_S + ...)
|
|
|
|
//#define BLIS_PACKDIM_MR_D (BLIS_DEFAULT_MR_D + ...)
|
|
//#define BLIS_PACKDIM_NR_D (BLIS_DEFAULT_NR_D + ...)
|
|
|
|
//#define BLIS_PACKDIM_MR_C (BLIS_DEFAULT_MR_C + ...)
|
|
//#define BLIS_PACKDIM_NR_C (BLIS_DEFAULT_NR_C + ...)
|
|
|
|
//#define BLIS_PACKDIM_MR_Z (BLIS_DEFAULT_MR_Z + ...)
|
|
//#define BLIS_PACKDIM_NR_Z (BLIS_DEFAULT_NR_Z + ...)
|
|
|
|
|
|
|
|
// -- LEVEL-2 KERNEL CONSTANTS -------------------------------------------------
|
|
|
|
|
|
|
|
|
|
// -- LEVEL-1F KERNEL CONSTANTS ------------------------------------------------
|
|
|
|
|
|
|
|
|
|
// -- LEVEL-3 KERNEL DEFINITIONS -----------------------------------------------
|
|
|
|
// -- gemm --
|
|
|
|
// -- trsm-related --
|
|
|
|
|
|
|
|
|
|
// -- LEVEL-1M KERNEL DEFINITIONS ----------------------------------------------
|
|
|
|
// -- packm --
|
|
|
|
// -- unpackm --
|
|
|
|
|
|
|
|
|
|
// -- LEVEL-1F KERNEL DEFINITIONS ----------------------------------------------
|
|
|
|
// -- axpy2v --
|
|
|
|
// -- dotaxpyv --
|
|
|
|
// -- axpyf --
|
|
|
|
// -- dotxf --
|
|
|
|
// -- dotxaxpyf --
|
|
|
|
|
|
|
|
|
|
// -- LEVEL-1V KERNEL DEFINITIONS ----------------------------------------------
|
|
|
|
// -- addv --
|
|
|
|
// -- axpyv --
|
|
|
|
// -- copyv --
|
|
|
|
// -- dotv --
|
|
|
|
// -- dotxv --
|
|
|
|
// -- invertv --
|
|
|
|
// -- scal2v --
|
|
|
|
// -- scalv --
|
|
|
|
// -- setv --
|
|
|
|
// -- subv --
|
|
|
|
// -- swapv --
|
|
|
|
|
|
|
|
#endif
|