mirror of
https://github.com/amd/blis.git
synced 2026-05-13 10:35:38 +00:00
39fa7136f4
Details: - Implemented optional packing for A or B (or both) within the sup framework (which currently only supports gemm). The request for packing either matrix A or matrix B can be made via setting environment variables BLIS_PACK_A or BLIS_PACK_B (to any non-zero value; if set, zero means "disable packing"). It can also be made globally at runtime via bli_pack_set_pack_a() and bli_pack_set_pack_b() or with individual rntm_t objects via bli_rntm_set_pack_a() and bli_rntm_set_pack_b() if using the expert interface of either the BLIS typed or object APIs. (If using the BLAS API, environment variables are the only way to communicate the packing request.) - One caveat (for now) with the current implementation of selective packing is that any blocksize extension registered in the _cntx_init function (such as is currently used by haswell and zen subconfigs) will be ignored if the affected matrix is packed. The reason is simply that I didn't get around to implementing the necessary logic to pack a larger edge-case micropanel, though this is entirely possible and should be done in the future. - Spun off the variant-choosing portion of bli_gemmsup_ref() into bli_gemmsup_int(), in bli_l3_sup_int.c. - Added new files, bli_l3_sup_packm_a.c, bli_l3_sup_packm_b.c, along with corresponding headers, in which higher-level packm-related functions are defined for use within the sup framework. The actual packm variant code resides in bli_l3_sup_packm_var.c. - Pass the following new parameters into var1n and var2m: packa, packb bool_t's, pointer to a rntm_t, pointer to a cntl_t (which is for now always NULL), and pointer to a thrinfo_t* (which for nowis the address of the global single-threaded packm thread control node). - Added panel strides ps_a and ps_b to the auxinfo_t structure so that the millikernel can query the panel stride of the packed matrix and step through it accordingly. If the matrix isn't packed, the panel stride of interest for the given millikernel will be set to the appropriate value so that the mkernel may step through the unpacked matrix as it normally would. - Modified the rv_6x8m and rv_6x8n millikernels to read the appropriate panel strides (ps_a and ps_b, respectively) instead of computing them on the fly. - Spun off the environment variable getting and setting functions into a new file, bli_env.c (with a corresponding prototype header). These functions are now used by the threading infrastructure (e.g. BLIS_NUM_THREADS, BLIS_JC_NT, etc.) as well as the selective packing infrastructure (e.g. BLIS_PACK_A, BLIS_PACK_B). - Added a static initializer for mem_t objects, BLIS_MEM_INITIALIZER. - Added a static initializer for pblk_t objects, BLIS_PBLK_INITIALIZER, for use within the definition of BLIS_MEM_INITIALIZER. - Moved the global_rntm object to bli_rntm.c and extern it where needed. This means that the function bli_thread_init_rntm() was renamed to bli_rntm_init_from_global() and relocated accordingly. - Added a new bli_pack.c function, which serves as the home for functions that manage the pack_a and pack_b fields of the global rntm_t, including from environment variables, just as we have functions to manage the threading fields of the global rntm_t in bli_thread.c. - Reorganized naming for files in frame/thread, which mostly involved spinning off the bli_l3_thread_decorator() functions into their own files. This change makes more sense when considering the further addition of bli_l3_sup_thread_decorator() functions (for now limited only to the single-threaded form found in the _single.c file). - Explicitly initialize the reference sup handlers in both bli_cntx_init_haswell.c and bli_cntx_init_zen.c so that it's more obvious how to customize to a different handler, if desired. - Removed various snippets of disabled code. - Various comment updates.
214 lines
4.7 KiB
C
214 lines
4.7 KiB
C
/*
|
|
|
|
BLIS
|
|
An object-based framework for developing high-performance BLAS-like
|
|
libraries.
|
|
|
|
Copyright (C) 2014, The University of Texas at Austin
|
|
Copyright (C) 2016, Hewlett Packard Enterprise Development LP
|
|
Copyright (C) 2018 - 2019, Advanced Micro Devices, Inc.
|
|
|
|
Redistribution and use in source and binary forms, with or without
|
|
modification, are permitted provided that the following conditions are
|
|
met:
|
|
- Redistributions of source code must retain the above copyright
|
|
notice, this list of conditions and the following disclaimer.
|
|
- Redistributions in binary form must reproduce the above copyright
|
|
notice, this list of conditions and the following disclaimer in the
|
|
documentation and/or other materials provided with the distribution.
|
|
- Neither the name(s) of the copyright holder(s) nor the names of its
|
|
contributors may be used to endorse or promote products derived
|
|
from this software without specific prior written permission.
|
|
|
|
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
|
|
"AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
|
|
LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
|
|
A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
|
|
HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
|
|
SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
|
|
LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
|
|
DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
|
|
THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
|
|
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
|
|
OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
|
|
|
|
*/
|
|
|
|
#ifndef BLIS_H
|
|
#define BLIS_H
|
|
|
|
|
|
// Allow C++ users to include this header file in their source code. However,
|
|
// we make the extern "C" conditional on whether we're using a C++ compiler,
|
|
// since regular C compilers don't understand the extern "C" construct.
|
|
#ifdef __cplusplus
|
|
extern "C" {
|
|
#endif
|
|
|
|
// NOTE: PLEASE DON'T CHANGE THE ORDER IN WHICH HEADERS ARE INCLUDED UNLESS
|
|
// YOU ARE SURE THAT IT DOESN'T BREAK INTER-HEADER MACRO DEPENDENCIES.
|
|
|
|
// -- System headers --
|
|
// NOTE: This header must be included before bli_config_macro_defs.h.
|
|
|
|
#include "bli_system.h"
|
|
|
|
|
|
// -- configure definitions --
|
|
|
|
#include "bli_config.h"
|
|
#include "bli_config_macro_defs.h"
|
|
|
|
|
|
// -- Common BLIS definitions --
|
|
|
|
#include "bli_type_defs.h"
|
|
#include "bli_macro_defs.h"
|
|
|
|
|
|
// -- pragma definitions --
|
|
|
|
#include "bli_pragma_macro_defs.h"
|
|
|
|
|
|
// -- Threading definitions --
|
|
|
|
#include "bli_thread.h"
|
|
#include "bli_pthread.h"
|
|
|
|
|
|
// -- Constant definitions --
|
|
|
|
#include "bli_extern_defs.h"
|
|
|
|
|
|
// -- BLIS architecture/kernel definitions --
|
|
|
|
#include "bli_l1v_ker_prot.h"
|
|
#include "bli_l1f_ker_prot.h"
|
|
#include "bli_l1m_ker_prot.h"
|
|
#include "bli_l3_ukr_prot.h"
|
|
#include "bli_l3_sup_ker_prot.h"
|
|
|
|
#include "bli_arch_config_pre.h"
|
|
#include "bli_arch_config.h"
|
|
|
|
#include "bli_kernel_macro_defs.h"
|
|
|
|
|
|
// -- Base operation prototypes --
|
|
|
|
#include "bli_init.h"
|
|
#include "bli_const.h"
|
|
#include "bli_obj.h"
|
|
#include "bli_obj_scalar.h"
|
|
#include "bli_blksz.h"
|
|
#include "bli_func.h"
|
|
#include "bli_mbool.h"
|
|
#include "bli_cntx.h"
|
|
#include "bli_rntm.h"
|
|
#include "bli_gks.h"
|
|
#include "bli_ind.h"
|
|
#include "bli_membrk.h"
|
|
#include "bli_pool.h"
|
|
#include "bli_array.h"
|
|
#include "bli_apool.h"
|
|
#include "bli_sba.h"
|
|
#include "bli_memsys.h"
|
|
#include "bli_mem.h"
|
|
#include "bli_part.h"
|
|
#include "bli_prune.h"
|
|
#include "bli_query.h"
|
|
#include "bli_auxinfo.h"
|
|
#include "bli_param_map.h"
|
|
#include "bli_clock.h"
|
|
#include "bli_check.h"
|
|
#include "bli_error.h"
|
|
#include "bli_f2c.h"
|
|
#include "bli_machval.h"
|
|
#include "bli_getopt.h"
|
|
#include "bli_opid.h"
|
|
#include "bli_cntl.h"
|
|
#include "bli_env.h"
|
|
#include "bli_pack.h"
|
|
#include "bli_info.h"
|
|
#include "bli_arch.h"
|
|
#include "bli_cpuid.h"
|
|
#include "bli_string.h"
|
|
#include "bli_setgetij.h"
|
|
#include "bli_setri.h"
|
|
|
|
#include "bli_castm.h"
|
|
#include "bli_castnzm.h"
|
|
#include "bli_castv.h"
|
|
#include "bli_projm.h"
|
|
#include "bli_projv.h"
|
|
|
|
|
|
// -- Level-0 operations --
|
|
|
|
#include "bli_l0.h"
|
|
|
|
|
|
// -- Level-1v operations --
|
|
|
|
#include "bli_l1v.h"
|
|
|
|
|
|
// -- Level-1d operations --
|
|
|
|
#include "bli_l1d.h"
|
|
|
|
|
|
// -- Level-1f operations --
|
|
|
|
#include "bli_l1f.h"
|
|
|
|
|
|
// -- Level-1m operations --
|
|
|
|
#include "bli_l1m.h"
|
|
|
|
|
|
// -- Level-2 operations --
|
|
|
|
#include "bli_l2.h"
|
|
|
|
|
|
// -- Level-3 operations --
|
|
|
|
#include "bli_l3.h"
|
|
|
|
|
|
// -- Utility operations --
|
|
|
|
#include "bli_util.h"
|
|
|
|
|
|
// -- sandbox implementation --
|
|
|
|
#include "bli_sbox.h"
|
|
|
|
|
|
// -- BLAS compatibility layer --
|
|
|
|
#include "bli_blas.h"
|
|
|
|
|
|
// -- CBLAS compatibility layer --
|
|
|
|
#include "bli_cblas.h"
|
|
|
|
// -- Windows definitions
|
|
|
|
#include "bli_winsys.h"
|
|
|
|
|
|
// End extern "C" construct block.
|
|
#ifdef __cplusplus
|
|
}
|
|
#endif
|
|
|
|
#endif
|
|
|