Qianfeng Zhang
|
cfbd8a342a
|
Renaming the test_hstu_attention_seqlen_kv.sh to test_hstu_cross_attention.sh
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
67f9461b42
|
Simplification in the cross_attention testing/benchmarking scripts
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
bd46155431
|
Remove max_target 3200 cases from cross_attention testing and benchmarking
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
6f2a73b17d
|
Add scripts for testing/benchmarking cross_attention cases
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
0462d44215
|
Update to support grouped mode hstu attention
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
57d837977b
|
Align the masking logic in HstuCrossAttentionBlockMask with pytorch mask_v2 scripts
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
7d110e3872
|
Add softmax selection to two of the testing scripts
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
24d6e49323
|
Add scripts for benchmark sparsity 0.9 cases with mattn256 & full256
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
ea9e4d8e00
|
Update to use BottomRight-Diagonal masking when seqlen_kv is bigger than seqlen_q
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
d0fab4c34c
|
Rename and add scripts for testing hdim96
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
ff54459c23
|
Enable the using of WarpTile-32x32x16 and add scripts to verify
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
2ae759c5b3
|
Add scripts for testing the using of separate sequence lengths for k/v
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
91afdfee40
|
Update to benchmark scripts to consider for using softmax
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
be3b27edd3
|
Add support of softmax in hstu attention
|
2026-06-23 09:27:59 +00:00 |
|
Qianfeng Zhang
|
ee06d0b4fc
|
Add norm_dist parameter for hstu example to select either normal or uniform distribution to initialize data
|
2026-06-23 09:27:58 +00:00 |
|
Qianfeng Zhang
|
de47bfe752
|
Update HstuBlockMaskWithLocal::GetTileRangeAlongX, add comments and test cases for causal == false
|
2026-06-23 09:27:58 +00:00 |
|
Qianfeng Zhang
|
4ad55eab4d
|
Update to support min_full_attn_seqlen be bigger than max_uih_len
|
2026-06-23 09:27:58 +00:00 |
|
Qianfeng Zhang
|
0b54f1f43d
|
Add attn_scale MakeKargs() parameter support and update in example, reference codes
|
2026-06-23 09:20:58 +00:00 |
|
Qianfeng Zhang
|
492c724b14
|
Fix added case in test_hstu_attention.sh
|
2026-06-23 09:20:58 +00:00 |
|
Qianfeng Zhang
|
d3ed6ac473
|
Update in GetTileRangeAlongX to consider for non-causal+local_size>0 situation and add test case to test_hstu_attention.sh
|
2026-06-23 09:20:58 +00:00 |
|
Qianfeng Zhang
|
7d698c2b78
|
Add three scripts for verification of jagged causal cases
|
2026-06-23 09:20:58 +00:00 |
|
Qianfeng Zhang
|
508f4ac632
|
Update to test_ck_hstu_mask.sh and test_pytorch_hstu_mask.py to align their testings
|
2026-06-23 09:20:58 +00:00 |
|
Qianfeng Zhang
|
dcef0260ff
|
Align the -seqlens=xxx in the mattn0_full0 and mattn256_full256 scripts with the required benchmarks
|
2026-06-23 09:20:57 +00:00 |
|
Qianfeng Zhang
|
cbc5485589
|
Move all test and bench scripts to folder scripts
|
2026-06-23 09:20:57 +00:00 |
|