ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-23 22:54:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
ik/deepseek_fa_opt
ik_llama.cpp/src
History
Kawrakow 7747000f3b DeepSeek TG optimizations for TG (#928) 
* Fuse concat and copy into K cache
* Avoid ggml_cont() when n_token = 1

Combined effect: about +2% in TG performance with full GPU offload

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2025-11-10 09:52:07 +02:00
..
CMakeLists.txt
Enable and clean up compiler warnings in src (#824)
2025-10-11 16:01:13 +03:00
llama-arch.cpp
model : Port Minimax M2 from mainline (#907)
2025-11-06 18:09:24 +02:00
llama-arch.h
model : Port Minimax M2 from mainline (#907)
2025-11-06 18:09:24 +02:00
llama-build-context.cpp
DeepSeek TG optimizations for TG (#928)
2025-11-10 09:52:07 +02:00
llama-build-context.h
model : Port Minimax M2 from mainline (#907)
2025-11-06 18:09:24 +02:00
llama-context.h
Support --device and --device-draft parameter (#866)
2025-10-27 18:13:28 +02:00
llama-cparams.h
CUDA: set compute parameters via command line arguments (#910)
2025-11-07 07:11:23 +02:00
llama-grammar.cpp
Tool calls support from mainline (#723)
2025-09-01 08:38:49 +03:00
llama-grammar.h
Tool calls support from mainline (#723)
2025-09-01 08:38:49 +03:00
llama-hparams.cpp
model : Port Minimax M2 from mainline (#907)
2025-11-06 18:09:24 +02:00
llama-hparams.h
Port of Qwen3-VL support from mainline (#883)
2025-11-04 19:20:54 +02:00
llama-impl.h
Fix warnings about LLAMA_DEBUG being redefined
2025-10-27 18:41:03 +02:00
llama-load-tensors.cpp
model : Port Minimax M2 from mainline (#907)
2025-11-06 18:09:24 +02:00
llama-mmap.cpp
Enable CUDA graphs for MoE models + GPT-OSS support (#689)
2025-08-15 09:18:07 +03:00
llama-mmap.h
Enable CUDA graphs for MoE models + GPT-OSS support (#689)
2025-08-15 09:18:07 +03:00
llama-model-loader.cpp
CUDA: set compute parameters via command line arguments (#910)
2025-11-07 07:11:23 +02:00
llama-model-loader.h
Merge Q, K, V (#878)
2025-10-30 10:49:48 +02:00
llama-model.cpp
model : Port Minimax M2 from mainline (#907)
2025-11-06 18:09:24 +02:00
llama-model.h
model : Port Minimax M2 from mainline (#907)
2025-11-06 18:09:24 +02:00
llama-quantize.cpp
Allow quantization of ffn_gate_inp (#896)
2025-11-05 10:44:32 +02:00
llama-sampling.cpp
Enable and clean up compiler warnings in src (#824)
2025-10-11 16:01:13 +03:00
llama-sampling.h
add dry sampler (#513)
2025-06-19 10:24:53 +03:00
llama-vocab.cpp
model : Port Minimax M2 from mainline (#907)
2025-11-06 18:09:24 +02:00
llama-vocab.h
model : Port Minimax M2 from mainline (#907)
2025-11-06 18:09:24 +02:00
llama.cpp
CUDA: set compute parameters via command line arguments (#910)
2025-11-07 07:11:23 +02:00
unicode-data.cpp
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
unicode-data.h
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
unicode.cpp
Enable CUDA graphs for MoE models + GPT-OSS support (#689)
2025-08-15 09:18:07 +03:00
unicode.h
Enable CUDA graphs for MoE models + GPT-OSS support (#689)
2025-08-15 09:18:07 +03:00