rattus ae79e33345 llama: use a more efficient rope implementation (#12434) ...

Get rid of the cat and unary negation and inplace add-cmul the two
halves of the rope. Precompute -sin once at the start of the model
rather than every transformer block.

This is slightly faster on both GPU and CPU bound setups.

2026-02-12 19:56:42 -05:00

..

ace_lyrics_tokenizer

Initial ACE-Step model implementation. (#7972)

2025-05-07 08:33:34 -04:00

byt5_tokenizer

Support hunyuan image 2.1 regular model. (#9792)

2025-09-10 02:05:07 -04:00

hydit_clip_tokenizer

Basic hunyuan dit implementation. (#4102)

2024-07-25 18:21:08 -04:00

llama_tokenizer

Basic Hunyuan Video model support.

2024-12-16 19:35:40 -05:00

qwen25_tokenizer

Update qwen tokenizer to add qwen 3 tokens. (#11029)

2025-12-01 17:13:48 -05:00

t5_pile_tokenizer

…

t5_tokenizer

…

ace15.py

Update ace15.py to allow min_p sampling (#12373)

2026-02-11 20:28:48 -05:00

ace_text_cleaners.py

Make japanese hiragana and katakana characters work with ACE. (#7997)

2025-05-08 03:32:36 -04:00

ace.py

Make japanese hiragana and katakana characters work with ACE. (#7997)

2025-05-08 03:32:36 -04:00

anima.py

Fix bug with last pr (#12338)

2026-02-06 19:48:20 -05:00

aura_t5.py

More flexible long clip support.

2025-04-15 10:32:21 -04:00

bert.py

P2 of qwen edit model. (#9412)

2025-08-18 22:38:34 -04:00

byt5_config_small_glyph.json

Support hunyuan image 2.1 regular model. (#9792)

2025-09-10 02:05:07 -04:00

cosmos.py

Fix chroma fp8 te being treated as fp16. (#11795)

2026-01-10 14:40:42 -08:00

flux.py

Enable embeddings for some qwen 3 models. (#12218)

2026-02-02 03:51:09 -05:00

genmo.py

Fix chroma fp8 te being treated as fp16. (#11795)

2026-01-10 14:40:42 -08:00

hidream.py

Make old scaled fp8 format use the new mixed quant ops system. (#11000)

2025-12-05 14:35:42 -05:00

hunyuan_image.py

Make old scaled fp8 format use the new mixed quant ops system. (#11000)

2025-12-05 14:35:42 -05:00

hunyuan_video.py

Support loading flux 2 klein checkpoints saved with SaveCheckpoint. (#12033)

2026-01-22 18:20:48 -05:00

hydit_clip.json

Basic hunyuan dit implementation. (#4102)

2024-07-25 18:21:08 -04:00

hydit.py

Add a T5TokenizerOptions node to set options for the T5 tokenizer. (#7803)

2025-04-25 19:36:00 -04:00

jina_clip_2.py

Implement Jina CLIP v2 and NewBie dual CLIP (#11415)

2025-12-20 00:57:22 -05:00

kandinsky5.py

Fix qwen scaled fp8 not working with kandinsky. Make basic t2i wf work. (#11162)

2025-12-06 17:50:10 -08:00

llama.py

llama: use a more efficient rope implementation (#12434)

2026-02-12 19:56:42 -05:00

long_clipl.py

Cleanup.

2025-04-15 12:13:28 -04:00

lt.py

Disable prompt weights for ltxv2. (#12354)

2026-02-07 19:16:28 -05:00

lumina2.py

Only apply gemma quant config to gemma model for newbie. (#11436)

2025-12-20 01:02:43 -05:00

mt5_config_xl.json

Basic hunyuan dit implementation. (#4102)

2024-07-25 18:21:08 -04:00

newbie.py

Only apply gemma quant config to gemma model for newbie. (#11436)

2025-12-20 01:02:43 -05:00

omnigen2.py

Make old scaled fp8 format use the new mixed quant ops system. (#11000)

2025-12-05 14:35:42 -05:00

ovis.py

Fix #11963 (#11982)

2026-01-19 22:32:40 -05:00

pixart_t5.py

Fix chroma fp8 te being treated as fp16. (#11795)

2026-01-10 14:40:42 -08:00

qwen_image.py

Make old scaled fp8 format use the new mixed quant ops system. (#11000)

2025-12-05 14:35:42 -05:00

qwen_vl.py

P2 of qwen edit model. (#9412)

2025-08-18 22:38:34 -04:00

sa_t5.py

More flexible long clip support.

2025-04-15 10:32:21 -04:00

sd2_clip_config.json

Fix potential issue with non clip text embeddings.

2024-07-30 14:41:13 -04:00

sd2_clip.py

More flexible long clip support.

2025-04-15 10:32:21 -04:00

sd3_clip.py

Make old scaled fp8 format use the new mixed quant ops system. (#11000)

2025-12-05 14:35:42 -05:00

spiece_tokenizer.py

Fix hard crash when the spiece tokenizer path is bad.

2025-04-19 15:55:43 -04:00

t5_config_base.json

…

t5_config_xxl.json

…

t5_old_config_xxl.json

WIP support for Nvidia Cosmos 7B and 14B text to world (video) models.

2025-01-10 09:14:16 -05:00

t5_pile_config_xl.json

…

t5.py

P2 of qwen edit model. (#9412)

2025-08-18 22:38:34 -04:00

umt5_config_base.json

Initial ACE-Step model implementation. (#7972)

2025-05-07 08:33:34 -04:00

umt5_config_xxl.json

WIP support for Wan t2v model.

2025-02-25 17:20:35 -05:00

wan.py

Make old scaled fp8 format use the new mixed quant ops system. (#11000)

2025-12-05 14:35:42 -05:00

z_image.py

Enable embeddings for some qwen 3 models. (#12218)

2026-02-02 03:51:09 -05:00