mirror of
https://github.com/kvcache-ai/sglang.git
synced 2026-07-12 02:16:57 +00:00
Co-authored-by: Rishitshivam <164783543+Rishitshivam@users.noreply.github.com> Co-authored-by: Ratish P <114130421+Ratish1@users.noreply.github.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Co-authored-by: Adarsh Shirawalmath <114558126+adarshxs@users.noreply.github.com> Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
470 B
470 B
Diffusion Language Models (dLLMs)
These are text-generation models that use diffusion (denoising) instead of autoregressive decoding:
- LLaDA - Large Language Diffusion with mAsking
# Example: Launch LLaDA for text generation
python3 -m sglang.launch_server \
--model-path GSAI-ML/LLaDA-8B-Instruct \
--host 0.0.0.0 --port 30000
Full model list: Diffusion Language Models