2 Commits

Author	SHA1	Message	Date
rocking5566	3b685d0452	ckProfiler for layernorm (#330) ... * Refine parameter * Add base class for layernorm * Add layernorm instance * Add layernorm to ckProfiler * Remove redundant * Add verification * Fix compile error due to merge [ROCm/composable_kernel commit: fdfd7eb597]	2022-08-11 17:03:54 -05:00
Anthony Chang	d41b1a7c2c	Standalone sweep once softmax kernel w/ ckProfiler (#295) ... * use 'sweep once' softmax kernel where applicable * threadwise copy's dst buffer can specify invalid element value * add int8 in/out float compute softmax support give a bit of leeway for int absolute tolerance as there's a single data point of all test cases showing off-by-1 error * format * softmax inherits DeviceNormalization * softmax profiler stub * tighten up reference softmax interface * example prints tensor dimension * add fp32 to softmax profiler * rename header * hook with ckProfiler * format * resolve merge conflict * resolve merge conflicts * update normalization profiler help string * resolve conflict * typo * remove residual * softmax profiler: address feedback * test for mixed precision input/output * fully qualify ck::math::isnan * add comment for device normalization interface * revise wording * constness for alpha/beta scaler pointer [ROCm/composable_kernel commit: 93c99f3d87]	2022-06-30 12:08:50 -05:00