mirror of
https://github.com/kvcache-ai/custom_flashinfer.git
synced 2026-06-29 18:57:09 +00:00
a69350756d
Documentation build failed since #654 probably because of directory structure change, this PR fixes the issue. This PR also improves the AOT compilation documentations.
23 lines
457 B
ReStructuredText
23 lines
457 B
ReStructuredText
.. _apisampling:
|
|
|
|
flashinfer.sampling
|
|
===================
|
|
|
|
Kernels for LLM sampling.
|
|
|
|
.. currentmodule:: flashinfer.sampling
|
|
|
|
.. autosummary::
|
|
:toctree: ../generated
|
|
|
|
sampling_from_probs
|
|
top_p_sampling_from_probs
|
|
top_k_sampling_from_probs
|
|
min_p_sampling_from_probs
|
|
top_k_top_p_sampling_from_logits
|
|
top_k_top_p_sampling_from_probs
|
|
top_p_renorm_probs
|
|
top_k_renorm_probs
|
|
top_k_mask_logits
|
|
chain_speculative_sampling
|