Add Birch-san's sub-quadratic attention implementation

This commit is contained in:
brkirch
2022-12-27 08:50:55 -05:00
parent 4af3ca5393
commit d782a95967
6 changed files with 312 additions and 35 deletions

View File

@@ -30,4 +30,4 @@ inflection
GitPython
torchsde
safetensors
psutil; sys_platform == 'darwin'
psutil