Anthony Chang 9287b7c6b3 Grouped batched attention + permute (#412) ...

* grouped attn without batch validates; now move toward grouped batched attn

* grouped batched attention

* working

* remove debug logging

clean up

clean up

* reintroduce g_ prefix back to host tensor variables

* format

* rename file

* restore old file

* rename

* consolidate padded/non-padded attention example

* harmonize padding specialization in attn examples

2022-09-19 16:09:44 -05:00

..

block

Fused attention instances & padding tests (#395)

2022-09-06 14:38:56 -05:00

device

Grouped batched attention + permute (#412)

2022-09-19 16:09:44 -05:00

element

batched_gemm + multiple_d + gemm + multiple_d (#394)

2022-09-14 17:54:18 -05:00

grid

Grouped batched attention + permute (#412)

2022-09-19 16:09:44 -05:00

thread

Layernorm welford (#346)

2022-08-13 09:43:18 -05:00

warp

Hotfix LDS data hazard in fused attention (#360)

2022-08-15 12:04:20 -05:00