[GH-ISSUE #91] How can I use opencompass benchmark tools to test ktransformers in long context? #46

Closed
opened 2026-10-29 14:33:00 +00:00 by bsakaguchi · 2 comments
Owner

Originally created by @AsVoider on GitHub (Sep 19, 2024).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/91

The document tells that long context is supported only in local_chat now. If I can't use REST API, Is there any way to test ktransofrmers under opencompass framework locally?

Originally created by @AsVoider on GitHub (Sep 19, 2024). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/91 The document tells that long context is supported only in local_chat now. If I can't use REST API, Is there any way to test ktransofrmers under opencompass framework locally?
bsakaguchi 2026-10-29 14:33:00 +00:00
  • closed this issue
  • added the
    stale
    label
Author
Owner

@qiyuxinlin commented on GitHub (Oct 5, 2024):

According to the official documentation of opencompass, we implemented a generate function, and then you need to refer to the source code in opencompass to modify the configuration of opencompass. The following is the official documentation:
https://opencompass.org.cn/doc

<!-- gh-comment-id:2395001681 --> @qiyuxinlin commented on GitHub (Oct 5, 2024): According to the official documentation of opencompass, we implemented a generate function, and then you need to refer to the source code in opencompass to modify the configuration of opencompass. The following is the official documentation: https://opencompass.org.cn/doc
Author
Owner

@ErvinXie commented on GitHub (Dec 11, 2025):

This issue has been automatically closed due to inactivity for 60 days.

If you believe this issue is still relevant, please feel free to reopen it with additional information or context.

Thank you for your contribution to KTransformers!


此 issue 因超过 60 天无活动而被自动关闭。

如果您认为此问题仍然存在,请随时重新打开并提供更多信息或上下文。

感谢您对 KTransformers 的贡献!

<!-- gh-comment-id:3639876975 --> @ErvinXie commented on GitHub (Dec 11, 2025): This issue has been automatically closed due to inactivity for 60 days. If you believe this issue is still relevant, please feel free to reopen it with additional information or context. Thank you for your contribution to KTransformers! --- 此 issue 因超过 60 天无活动而被自动关闭。 如果您认为此问题仍然存在,请随时重新打开并提供更多信息或上下文。 感谢您对 KTransformers 的贡献!
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/ktransformers#46
No description provided.