ntohidi 159207b86f feat(docker): Add temperature and base_url parameters for LLM configuration. ref #1035 ...

Implement hierarchical configuration for LLM parameters with support for:
  - Temperature control (0.0-2.0) to adjust response creativity
  - Custom base_url for proxy servers and alternative endpoints
  - 4-tier priority: request params > provider env > global env > defaults

  Add helper functions in utils.py, update API schemas and handlers,
  support environment variables (LLM_TEMPERATURE, OPENAI_TEMPERATURE, etc.),
  and provide comprehensive documentation with examples.

2025-08-26 16:44:07 +08:00

21 KiB

Raw Permalink Blame History

View Raw