kvcache-ai/ktransformers

Fork 0

mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-11-05 01:07:28 +00:00

[GH-ISSUE #12] Awesome project #7

New issue

Closed

opened 2026-10-29 14:32:36 +00:00 by bsakaguchi · 4 comments

bsakaguchi commented

2026-10-29 14:32:36 +00:00

Owner

Originally created by @LysandreJik on GitHub (Jul 29, 2024).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/12

Hey, core maintainer of transformers here,

This is really an awesome project, kudos to you for building it 🙌

Please let us know if you faced any issues integrating transformers/if there's anything we can do to make your life simpler by developing this tool.

Lysandre

Originally created by @LysandreJik on GitHub (Jul 29, 2024). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/12 Hey, core maintainer of transformers here, This is really an awesome project, kudos to you for building it :raised_hands: Please let us know if you faced any issues integrating `transformers`/if there's anything we can do to make your life simpler by developing this tool. Lysandre

bsakaguchi

2026-10-29 14:32:36 +00:00

closed this issue
added the
stale
label

bsakaguchi commented

2026-10-29 14:32:37 +00:00

Author

Owner

@Azure-Tang commented on GitHub (Jul 29, 2024):

Screenshot with big name lol

@Azure-Tang commented on GitHub (Jul 29, 2024): Screenshot with big name lol

bsakaguchi commented

2026-10-29 14:32:37 +00:00

Author

Owner

@james0zan commented on GitHub (Jul 29, 2024):

It is our honor! We really appreciate the extensibility of transformers and want to build on it. Indeed, some functionalities require minor modifications to the transformers itself. We will upstream such PRs soon.

@james0zan commented on GitHub (Jul 29, 2024): It is our honor! We really appreciate the extensibility of transformers and want to build on it. Indeed, some functionalities require minor modifications to the transformers itself. We will upstream such PRs soon.

bsakaguchi commented

2026-10-29 14:32:37 +00:00

Author

Owner

@LysandreJik commented on GitHub (Jul 29, 2024):

We'd be very happy to take a look at those! And don't hesitate to let us know if any other changes would have helped/will help you build ktransformers, we're very excited to work with you.

@LysandreJik commented on GitHub (Jul 29, 2024): We'd be very happy to take a look at those! And don't hesitate to let us know if any other changes would have helped/will help you build `ktransformers`, we're very excited to work with you.

bsakaguchi commented

2026-10-29 14:32:38 +00:00

Author

Owner

@ErvinXie commented on GitHub (Dec 11, 2025):

This issue has been automatically closed due to inactivity for 60 days.

If you believe this issue is still relevant, please feel free to reopen it with additional information or context.

Thank you for your contribution to KTransformers!

此 issue 因超过 60 天无活动而被自动关闭。

如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。

感谢您对 KTransformers 的贡献！

@ErvinXie commented on GitHub (Dec 11, 2025): This issue has been automatically closed due to inactivity for 60 days. If you believe this issue is still relevant, please feel free to reopen it with additional information or context. Thank you for your contribution to KTransformers! --- 此 issue 因超过 60 天无活动而被自动关闭。如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。感谢您对 KTransformers 的贡献！

bsakaguchi referenced this issue

2026-10-29 14:37:20 +00:00

[GH-ISSUE #420] deepseek r1 using 4090 nvidia running, meet segmentation fault(core dumped) problem #288

bsakaguchi referenced this issue

2026-10-29 14:37:56 +00:00

[GH-ISSUE #465] /pytorch/aten/src/ATen/native/cuda/TensorCompare.cu:110: _assert_async_cuda_kernel: block: [0,0,0], thread: [0,0,0] Assertion probability tensor contains either inf, nan or element < 0 failed. #327

bsakaguchi referenced this issue

2026-10-29 14:42:22 +00:00

[GH-ISSUE #903] Rocm run deepseek r1 671b q4 failed #646

bsakaguchi referenced this issue

2026-10-29 14:45:29 +00:00

[GH-ISSUE #1269] [Question] benchmark with evalscope failed #859