mirror of
https://github.com/amd/blis.git
synced 2026-05-11 17:50:00 +00:00
Details: - Reworked the build system around a configuration registry file, named config_registry', that identifies valid configuration targets, their constituent sub-configurations, and the kernel sets that are needed by those sub-configurations. The build system now facilitates the building of a single library that can contains kernels and cache/register blocksizes for multiple configurations (microarchitectures). Reference kernels are also built on a per-configuration basis. - Updated the Makefile to use new variables set by configure via the config.mk.in template, such as CONFIG_LIST, KERNEL_LIST, and KCONFIG_MAP, in determining which sub-configurations (CONFIG_LIST) and kernel sets (KERNEL_LIST) are included in the library, and which make_defs.mk files' CFLAGS (KCONFIG_MAP) are used when compiling kernels. - Reorganized 'kernels' directory into a "flat" structure. Renamed kernel functions into a standard format that includes the kernel set name (e.g. 'haswell'). Created a "bli_kernels_<kernelset>.h" file in each kernels sub-directory. These files exist to provide prototypes for the kernels present in those directories. - Reorganized reference kernels into a top-level 'ref_kernels' directory. This directory includes a new source file, bli_cntx_ref.c (compiled on a per-configuration basis), that defines the code needed to initialize a reference context and a context for induced methods for the microarchitecture in question. - Rewrote make_defs.mk files in each configuration so that the compiler variables (e.g. CFLAGS) are "stored" (renamed) on a per-configuration basis. - Modified bli_config.h.in template so that bli_config.h is generated with #defines for the config (family) name, the sub-configurations that are associated with the family, and the kernel sets needed by those sub-configurations. - Deprecated all kernel-related information in bli_kernel.h and transferred what remains to new header files named "bli_arch_<configname>.h", which are conditionally #included from a new header bli_arch.h. These files are still needed to set library-wide parameters such as custom malloc()/free() functions or SIMD alignment values. - Added bli_cntx_init_<configname>.c files to each configuration directory. The files contain a function, named the same as the file, that initializes a "native" context for a particular configuration (microarchitecture). The idea is that optimized kernels, if available, will be initialized into these contexts. Other fields will retain pointers to reference functions, which will be compiled on a per-configuration basis. These bli_cntx_init_*() functions will be called during the initialization of the global kernel structure. They are thought of as initializing for "native" execution, but they also form the basis for contexts that use induced methods. These functions are prototyped, along with their _ref() and _ind() brethren, by prototype-generating macros in bli_arch.h. - Added a new typedef enum in bli_type_defs.h to define an arch_t, which identifies the various sub-configurations. - Redesigned the global kernel structure (gks) around a 2D array of cntx_t structures (pointers to cntx_t, actually). The first dimension is indexed over arch_t and the inner dimension is the ind_t (induced method) for each microarchitecture. When a microarchitecture (configuration) is "registered" at init-time, the inner array for that configuration in the 2D array is initialized (and allocated, if it hasn't been already). The cntx_t slot for BLIS_NAT is initialized immediately and those for other induced method types are initialized and cached on-demand, as needed. At cntx_t registration, we also store function pointers to cntx_init functions that will initialize (a) "reference" contexts and (b) contexts for use with induced methods. We don't cache the full contexts for reference contexts since they are rarely needed. The functions that initialize these two kinds of contexts are generated automatically for each targeted sub-configuration from cpp-templatized code at compile-time. Induced method contexts that need "stage" adjustments can still obtain them via functions in bli_cntx_ind_stage.c. - Added new functions and functionality to bli_cntx.c, such as for setting the level-1f, level-1v, and packm kernels, and for converting a native context into one for executing an induced method. - Moved the checking of register/cache blocksize consistency from being cpp macros in bli_kernel_macro_defs.h to being runtime checks defined in bli_check.c and called from bli_gks_register_cntx() at the time that the global kernel structure's internal context is initialized for a given microarchitecture/configuration. - Deprecated all of the old per-operation bli_*_cntx.c files and removed the previous operation-level cntx_t_init()/_finalize() invocations. Instead, we now query the gks for a suitable context, usually via bli_gks_query_cntx(). - Deprecated support for the 3m2 and 3m3 induced methods. (They required hackery that I was no longer willing to support.) - Consolidated the 1e and 1r packm kernels for any given register blocksize into a single kernel that will branch on the schema and support packing to both formats. - Added the cntx_t* argument to all packm kernel signatures. - Deprecated the local function pointer array in all bli_packm_cxk*.c files and instead obtain the packm kernel from the cntx_t. - Added bli_calloc_intl(), which serves as the calloc-equivalent to to bli_malloc_intl(). Useful when we wish to allocate and initialize to zero/NULL. - Converted existing cpp macro functions defined in bli_blksz.h, bli_func.h, bli_cntx.h into static functions.
248 lines
10 KiB
C
248 lines
10 KiB
C
/*
|
|
|
|
BLIS
|
|
An object-based framework for developing high-performance BLAS-like
|
|
libraries.
|
|
|
|
Copyright (C) 2014, The University of Texas at Austin
|
|
|
|
Redistribution and use in source and binary forms, with or without
|
|
modification, are permitted provided that the following conditions are
|
|
met:
|
|
- Redistributions of source code must retain the above copyright
|
|
notice, this list of conditions and the following disclaimer.
|
|
- Redistributions in binary form must reproduce the above copyright
|
|
notice, this list of conditions and the following disclaimer in the
|
|
documentation and/or other materials provided with the distribution.
|
|
- Neither the name of The University of Texas at Austin nor the names
|
|
of its contributors may be used to endorse or promote products
|
|
derived from this software without specific prior written permission.
|
|
|
|
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
|
|
"AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
|
|
LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
|
|
A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
|
|
HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
|
|
SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
|
|
LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
|
|
DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
|
|
THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
|
|
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
|
|
OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
|
|
|
|
*/
|
|
|
|
#include "blis.h"
|
|
|
|
static bool_t bli_error_is_init = FALSE;
|
|
|
|
void bli_error_init( void )
|
|
{
|
|
// If the API is already initialized, return early.
|
|
if ( bli_error_is_initialized() ) return;
|
|
|
|
bli_error_init_msgs();
|
|
|
|
// Mark API as initialized.
|
|
bli_error_is_init = TRUE;
|
|
}
|
|
|
|
void bli_error_finalize( void )
|
|
{
|
|
// Mark API as uninitialized.
|
|
bli_error_is_init = FALSE;
|
|
}
|
|
|
|
bool_t bli_error_is_initialized( void )
|
|
{
|
|
return bli_error_is_init;
|
|
}
|
|
|
|
// -----------------------------------------------------------------------------
|
|
|
|
// Internal array to hold error strings.
|
|
static char bli_error_string[BLIS_MAX_NUM_ERR_MSGS][BLIS_MAX_ERR_MSG_LENGTH];
|
|
|
|
void bli_error_init_msgs( void )
|
|
{
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_ERROR_CHECKING_LEVEL),
|
|
"Invalid error checking level." );
|
|
sprintf( bli_error_string_for_code(BLIS_UNDEFINED_ERROR_CODE),
|
|
"Undefined error code." );
|
|
sprintf( bli_error_string_for_code(BLIS_NULL_POINTER),
|
|
"Encountered unexpected null pointer." );
|
|
sprintf( bli_error_string_for_code(BLIS_NOT_YET_IMPLEMENTED),
|
|
"Requested functionality not yet implemented." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_SIDE),
|
|
"Invalid side parameter value." );
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_UPLO),
|
|
"Invalid uplo_t parameter value." );
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_TRANS),
|
|
"Invalid trans_t parameter value." );
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_CONJ),
|
|
"Invalid conj_t parameter value." );
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_DIAG),
|
|
"Invalid diag_t parameter value." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_NONUNIT_DIAG),
|
|
"Expected object with non-unit diagonal." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_DATATYPE),
|
|
"Invalid datatype value." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_FLOATING_POINT_DATATYPE),
|
|
"Expected floating-point datatype value." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_NONINTEGER_DATATYPE),
|
|
"Expected non-integer datatype value." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_NONCONSTANT_DATATYPE),
|
|
"Expected non-constant datatype value." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_REAL_DATATYPE),
|
|
"Expected real datatype value." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_INTEGER_DATATYPE),
|
|
"Expected integer datatype value." );
|
|
sprintf( bli_error_string_for_code(BLIS_INCONSISTENT_DATATYPES),
|
|
"Expected consistent datatypes (equal, or one being constant)." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_REAL_PROJ_OF),
|
|
"Expected second datatype to be real projection of first." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_REAL_VALUED_OBJECT),
|
|
"Expected real-valued object (ie: if complex, imaginary component equals zero)." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_NONCONFORMAL_DIMENSIONS),
|
|
"Encountered non-conformal dimensions between objects." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_SCALAR_OBJECT),
|
|
"Expected scalar object." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_VECTOR_OBJECT),
|
|
"Expected vector object." );
|
|
sprintf( bli_error_string_for_code(BLIS_UNEQUAL_VECTOR_LENGTHS),
|
|
"Encountered unequal vector lengths." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_SQUARE_OBJECT),
|
|
"Expected square object." );
|
|
sprintf( bli_error_string_for_code(BLIS_UNEXPECTED_OBJECT_LENGTH),
|
|
"Unexpected object length." );
|
|
sprintf( bli_error_string_for_code(BLIS_UNEXPECTED_OBJECT_WIDTH),
|
|
"Unexpected object width." );
|
|
sprintf( bli_error_string_for_code(BLIS_UNEXPECTED_VECTOR_DIM),
|
|
"Unexpected vector dimension." );
|
|
sprintf( bli_error_string_for_code(BLIS_UNEXPECTED_DIAG_OFFSET),
|
|
"Unexpected object diagonal offset." );
|
|
sprintf( bli_error_string_for_code(BLIS_NEGATIVE_DIMENSION),
|
|
"Encountered negative dimension." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_ROW_STRIDE),
|
|
"Encountered invalid row stride relative to n dimension." );
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_COL_STRIDE),
|
|
"Encountered invalid col stride relative to m dimension." );
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_DIM_STRIDE_COMBINATION),
|
|
"Encountered invalid stride/dimension combination." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_GENERAL_OBJECT),
|
|
"Expected general object." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_HERMITIAN_OBJECT),
|
|
"Expected Hermitian object." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_SYMMETRIC_OBJECT),
|
|
"Expected symmetric object." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_TRIANGULAR_OBJECT),
|
|
"Expected triangular object." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_UPPER_OR_LOWER_OBJECT),
|
|
"Expected upper or lower triangular object." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_3x1_SUBPART),
|
|
"Encountered invalid 3x1 (vertical) subpartition label." );
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_1x3_SUBPART),
|
|
"Encountered invalid 1x3 (horizontal) subpartition label." );
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_3x3_SUBPART),
|
|
"Encountered invalid 3x3 (diagonal) subpartition label." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_UNEXPECTED_NULL_CONTROL_TREE),
|
|
"Encountered unexpected null control tree node." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_PACK_SCHEMA_NOT_SUPPORTED_FOR_UNPACK),
|
|
"Pack schema not yet supported/implemented for use with unpacking." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_NONNULL_OBJECT_BUFFER),
|
|
"Encountered object with non-zero dimensions containing null buffer." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_PACKBUF),
|
|
"Invalid packbuf_t value." );
|
|
sprintf( bli_error_string_for_code(BLIS_REQUESTED_CONTIG_BLOCK_TOO_BIG ),
|
|
"Attempted to allocate contiguous memory block that is too big for implementation." );
|
|
sprintf( bli_error_string_for_code(BLIS_EXHAUSTED_CONTIG_MEMORY_POOL),
|
|
"Attempted to allocate more memory from contiguous pool than is available." );
|
|
sprintf( bli_error_string_for_code(BLIS_INSUFFICIENT_STACK_BUF_SIZE),
|
|
"Configured maximum stack buffer size is insufficient for register blocksizes currently in use." );
|
|
sprintf( bli_error_string_for_code(BLIS_ALIGNMENT_NOT_POWER_OF_TWO),
|
|
"Encountered memory alignment value that is either zero or not a power of two." );
|
|
sprintf( bli_error_string_for_code(BLIS_ALIGNMENT_NOT_MULT_OF_PTR_SIZE),
|
|
"Encountered memory alignment value that is not a multiple of sizeof(void*)." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_EXPECTED_OBJECT_ALIAS),
|
|
"Expected object to be alias." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_INVALID_ARCH_ID),
|
|
"Invalid architecture id value." );
|
|
|
|
sprintf( bli_error_string_for_code(BLIS_MC_DEF_NONMULTIPLE_OF_MR),
|
|
"Default MC is non-multiple of MR for one or more datatypes." );
|
|
sprintf( bli_error_string_for_code(BLIS_MC_DEF_NONMULTIPLE_OF_MR),
|
|
"Maximum MC is non-multiple of MR for one or more datatypes." );
|
|
sprintf( bli_error_string_for_code(BLIS_NC_DEF_NONMULTIPLE_OF_NR),
|
|
"Default NC is non-multiple of NR for one or more datatypes." );
|
|
sprintf( bli_error_string_for_code(BLIS_NC_DEF_NONMULTIPLE_OF_NR),
|
|
"Maximum NC is non-multiple of NR for one or more datatypes." );
|
|
sprintf( bli_error_string_for_code(BLIS_KC_DEF_NONMULTIPLE_OF_KR),
|
|
"Default KC is non-multiple of KR for one or more datatypes." );
|
|
sprintf( bli_error_string_for_code(BLIS_KC_DEF_NONMULTIPLE_OF_KR),
|
|
"Maximum KC is non-multiple of KR for one or more datatypes." );
|
|
}
|
|
|
|
void bli_print_msg( char* str, char* file, guint_t line )
|
|
{
|
|
fprintf( stderr, "\n" );
|
|
fprintf( stderr, "libblis: %s (line %lu):\n", file, ( long unsigned int )line );
|
|
fprintf( stderr, "libblis: %s\n", str );
|
|
fflush( stderr );
|
|
}
|
|
|
|
void bli_abort( void )
|
|
{
|
|
fprintf( stderr, "libblis: Aborting.\n" );
|
|
//raise( SIGABRT );
|
|
abort();
|
|
}
|
|
|
|
// -----------------------------------------------------------------------------
|
|
|
|
// Current error checking level.
|
|
static errlev_t bli_err_chk_level = BLIS_FULL_ERROR_CHECKING;
|
|
|
|
errlev_t bli_error_checking_level( void )
|
|
{
|
|
return bli_err_chk_level;
|
|
}
|
|
|
|
errlev_t bli_error_checking_level_set( errlev_t new_level )
|
|
{
|
|
err_t e_val;
|
|
errlev_t old_level;
|
|
|
|
e_val = bli_check_valid_error_level( new_level );
|
|
bli_check_error_code( e_val );
|
|
|
|
old_level = bli_err_chk_level;
|
|
|
|
bli_err_chk_level = new_level;
|
|
|
|
return old_level;
|
|
}
|
|
|
|
bool_t bli_error_checking_is_enabled( void )
|
|
{
|
|
return bli_error_checking_level() != BLIS_NO_ERROR_CHECKING;
|
|
}
|
|
|
|
char* bli_error_string_for_code( gint_t code )
|
|
{
|
|
return bli_error_string[-code];
|
|
}
|
|
|