Atream 412055d450 [feature] experts can be injected using CPUInfer ...

[fix] fix ktransformers interface when use new CUDAGraphRunner
[fix] fix YAML and optimize logic, the top rule has the highest priority

2024-08-14 16:10:54 +08:00

..

DeepSeek-V2-Chat-multi-gpu-4.yaml

[feature] experts can be injected using CPUInfer

2024-08-14 16:10:54 +08:00

DeepSeek-V2-Chat-multi-gpu.yaml

[feature] experts can be injected using CPUInfer

2024-08-14 16:10:54 +08:00

DeepSeek-V2-Chat.yaml

[feature] experts can be injected using CPUInfer

2024-08-14 16:10:54 +08:00

DeepSeek-V2-Lite-Chat-multi-gpu.yaml

[feature] experts can be injected using CPUInfer

2024-08-14 16:10:54 +08:00

Mixtral.yaml

[feature] experts can be injected using CPUInfer

2024-08-14 16:10:54 +08:00

Qwen2-57B-A14B-Instruct-multi-gpu.yaml

[feature] experts can be injected using CPUInfer

2024-08-14 16:10:54 +08:00

Qwen2-57B-A14B-Instruct.yaml

[feature] experts can be injected using CPUInfer

2024-08-14 16:10:54 +08:00