mirror of
https://github.com/ROCm/composable_kernel.git
synced 2026-05-11 17:00:18 +00:00
e17c0d8008
* Initial adding of generic reduction * Initial adding of generic reduction ... * Updates to make compiling done * clang-format all files * clang-format some files again * Renaming in profiler/include/profile_reduce.hpp * Updates and make BlockWise cases passed * Updates and make ThreadWise and MultiBlockTwoCall cases passed * Remove the support for MUL and NORM1 reduceOp from the profiler and the device instances * Change to replace the dim0_max_vector_size/dim1_max_vector_size template argument in the device reduce classes * format * adding pooling * added max and average pooling * comment out cout and kernel timing * Tiny simplification in profiler/reduce_profiler.cpp * Add example for reduce_blockwise * Tiny updates * Change to pass the ElementWiseOp from device layer to kernel * Fix the vectorDim and vectorSize in Device layer * Enable vector load on both dim0 and dim1 for Threadwise method * Tiny updates * Change to let the user to pass the preUnaryOp and posUnaryOp * Make pooling example work * split device_reduce_instance into two libraries * Tiny update * Replace nanPropaOpt enum by boolean propagate_nan * Simplification in DeviceReduce layer codes * update build * Change to clarify the difference between ck::half_t and half_float::half * Renaming in all the reduction codes * Add VectorSize as template parameter for device layer * Add BetaIsZero as kernel template and as AccDataType for alpha * print * Small updates for pooling * Updates for host_generic_reduction for reference * Update to make AVG pooling pass * Update to make MAX pooling with indices output pass * fix * add OutDst vector store to threadwise reduction and pooling * tweak * turn off check_indices that caused build issue * refactor pooling * clean up * turn off check_indices for building issue for php-compiler * add more tile size for odd C * tweak conv for odd C * update script * clean up elementwise op * add hack in reduction_operator.hpp to avoid compile error. To fix it, need to use element_wise_op in reduction op * Add OutVectorSize as device and kernel tunable, also update to Elementwise Operations * Move reduce operator mapping to host layer file reduction_operator_mapping.hpp from reduction_operator.hpp * Change to the unary operators * Move the definitions of unary operations to element_wise_operation.hpp * re-org files * Refine in device interfaces and multiblock kernels * Split the reduction configurations into instances for specific methods * Update in getTypeString() of device pool2d * Renaming in host and kernel * Tiny update in profiler/src/profiler.cpp * Uncomment in device_operation/CMakeLists.txt to enable the building of all operations * Make check_indices a templated function to remove some linking issue * Renaming in the profiler reduce module * Add support for double Reduction (but disable MultiblockAtomicAdd for double) * Tiny correction of literal string * Rename DevicePoolFwd to DevicePool2dFwd * Split device_reduce_instance_xxx.cpp files according to the data types to speed up compiling * Add comments for lists of configurations, lists of instances and references of add_reduce_instances_xxx * Remove un-used header file gridwise_generic_reduction_wrapper_common.hpp * Renaming and refining in the Reduction codes * Tiny change in the unary operators * Renaming symbols and files * Renaming symbols in the kernels * Move kernel kernel_set_buffer_value to separate file * Add IndexDataType template parameter for kernels and use int32_t as index data type in device layer * Tiny update in the kernels * Remove definition of sqrtf()/isnan()/abs() for half_t due to some ADL issue * Simplify a helper function in device layer * Tiny adjustment in testing data initialization * Renaming in kernel/device/host * Add two testing scripts for reduction * Refine the Unary operators in element_wise_operation.hpp * Update in the reduce profiler module * Update to the reduction testing scripts * reduce compile parallelism * change CI docker to rocm5.0 * remove unused variables * fix build Co-authored-by: Chao Liu <chao.liu2@amd.com>
102 lines
3.0 KiB
Docker
102 lines
3.0 KiB
Docker
FROM ubuntu:18.04
|
|
|
|
ARG ROCMVERSION=5.0
|
|
ARG OSDB_BKC_VERSION
|
|
|
|
RUN set -xe
|
|
|
|
ARG BUILD_THREADS=8
|
|
ARG DEB_ROCM_REPO=http://repo.radeon.com/rocm/apt/.apt_$ROCMVERSION/
|
|
# Add rocm repository
|
|
RUN apt-get update
|
|
RUN apt-get install -y wget gnupg
|
|
RUN wget -qO - http://repo.radeon.com/rocm/rocm.gpg.key | apt-key add -
|
|
RUN if ! [ -z $OSDB_BKC_VERSION ]; then \
|
|
echo "Using BKC VERISION: $OSDB_BKC_VERSION";\
|
|
sh -c "echo deb [arch=amd64 trusted=yes] http://compute-artifactory.amd.com/artifactory/list/rocm-osdb-deb/ compute-rocm-dkms-no-npi-hipclang ${OSDB_BKC_VERSION} > /etc/apt/sources.list.d/rocm.list" ;\
|
|
cat /etc/apt/sources.list.d/rocm.list;\
|
|
else \
|
|
sh -c "echo deb [arch=amd64] $DEB_ROCM_REPO ubuntu main > /etc/apt/sources.list.d/rocm.list" ;\
|
|
fi
|
|
RUN wget --no-check-certificate -qO - https://apt.kitware.com/keys/kitware-archive-latest.asc 2>/dev/null | apt-key add -
|
|
RUN sh -c "echo deb https://apt.kitware.com/ubuntu/ bionic main | tee -a /etc/apt/sources.list"
|
|
|
|
# ADD requirements.txt requirements.txt
|
|
# Install dependencies
|
|
RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y --allow-unauthenticated \
|
|
apt-utils \
|
|
sshpass \
|
|
build-essential \
|
|
cmake-data=3.15.1-0kitware1 \
|
|
cmake=3.15.1-0kitware1 \
|
|
curl \
|
|
doxygen \
|
|
g++ \
|
|
gdb \
|
|
git \
|
|
hip-rocclr \
|
|
jq \
|
|
lcov \
|
|
libelf-dev \
|
|
libncurses5-dev \
|
|
libnuma-dev \
|
|
libpthread-stubs0-dev \
|
|
llvm-amdgpu \
|
|
miopengemm \
|
|
pkg-config \
|
|
python \
|
|
python3 \
|
|
python-dev \
|
|
python3-dev \
|
|
python-pip \
|
|
python3-pip \
|
|
software-properties-common \
|
|
sqlite3 \
|
|
wget \
|
|
rocm-dev \
|
|
rocm-device-libs \
|
|
rocm-opencl \
|
|
rocm-opencl-dev \
|
|
rocm-cmake \
|
|
rocblas \
|
|
vim \
|
|
zlib1g-dev \
|
|
openssh-server \
|
|
kmod \
|
|
mysql-client && \
|
|
apt-get clean && \
|
|
rm -rf /var/lib/apt/lists/*
|
|
|
|
# RUN pip3 install --default-timeout=100000 -r requirements.txt
|
|
|
|
# Setup ubsan environment to printstacktrace
|
|
RUN ln -s /usr/bin/llvm-symbolizer-3.8 /usr/local/bin/llvm-symbolizer
|
|
ENV UBSAN_OPTIONS=print_stacktrace=1
|
|
|
|
# Install an init system
|
|
RUN wget https://github.com/Yelp/dumb-init/releases/download/v1.2.0/dumb-init_1.2.0_amd64.deb
|
|
RUN dpkg -i dumb-init_*.deb && rm dumb-init_*.deb
|
|
|
|
# Install cget
|
|
RUN pip install cget
|
|
|
|
# Install rclone
|
|
RUN pip install https://github.com/pfultz2/rclone/archive/master.tar.gz
|
|
|
|
ARG PREFIX=/opt/rocm
|
|
# Install dependencies
|
|
RUN cget install pfultz2/rocm-recipes
|
|
# Install rbuild
|
|
RUN pip3 install https://github.com/RadeonOpenCompute/rbuild/archive/6d78a0553babdaea8d2da5de15cbda7e869594b8.tar.gz
|
|
# Setup ubsan environment to printstacktrace
|
|
ENV UBSAN_OPTIONS=print_stacktrace=1
|
|
|
|
ENV LC_ALL=C.UTF-8
|
|
ENV LANG=C.UTF-8
|
|
ADD rbuild.ini /rbuild.ini
|
|
ADD dev-requirements.txt dev-requirements.txt
|
|
RUN rbuild prepare -s develop -d $PREFIX
|
|
RUN groupadd -f render
|
|
# RUN cget install -f min-requirements.txt
|
|
# RUN CXXFLAGS='-isystem $PREFIX/include' cget install -f ./mlir-requirements.txt
|