mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-11-05 01:07:28 +00:00
[GH-ISSUE #91] How can I use opencompass benchmark tools to test ktransformers in long context? #46
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/ktransformers#46
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @AsVoider on GitHub (Sep 19, 2024).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/91
The document tells that long context is supported only in local_chat now. If I can't use REST API, Is there any way to test ktransofrmers under opencompass framework locally?
@qiyuxinlin commented on GitHub (Oct 5, 2024):
According to the official documentation of opencompass, we implemented a generate function, and then you need to refer to the source code in opencompass to modify the configuration of opencompass. The following is the official documentation:
https://opencompass.org.cn/doc
@ErvinXie commented on GitHub (Dec 11, 2025):
This issue has been automatically closed due to inactivity for 60 days.
If you believe this issue is still relevant, please feel free to reopen it with additional information or context.
Thank you for your contribution to KTransformers!
此 issue 因超过 60 天无活动而被自动关闭。
如果您认为此问题仍然存在,请随时重新打开并提供更多信息或上下文。
感谢您对 KTransformers 的贡献!