[GH-ISSUE #388] per_layer_prefill_flag开启后怎么理解？ #256

New issue

Closed

opened 2026-10-29 14:36:44 +00:00 by bsakaguchi · 1 comment

bsakaguchi commented

2026-10-29 14:36:44 +00:00

Owner

Originally created by @ningpengtao-coder on GitHub (Feb 17, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/388

按照优化配置per_layer_prefill_flag默认不开启，开启了逐层填充后会将61层mlp在预填充阶段放到gpu，在生成阶段放到cpu。不会受到PCIe限制吗？怎么理解per_layer_prefill_flag开启后的流程。

Originally created by @ningpengtao-coder on GitHub (Feb 17, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/388 按照优化配置per_layer_prefill_flag默认不开启，开启了逐层填充后会将61层mlp在预填充阶段放到gpu，在生成阶段放到cpu。不会受到PCIe限制吗？怎么理解per_layer_prefill_flag开启后的流程。

bsakaguchi

2026-10-29 14:36:44 +00:00

closed this issue
added the
stale
label

bsakaguchi commented

2026-10-29 14:36:45 +00:00

Author

Owner

@ErvinXie commented on GitHub (Dec 11, 2025):

This issue has been automatically closed due to inactivity for 60 days.

If you believe this issue is still relevant, please feel free to reopen it with additional information or context.

Thank you for your contribution to KTransformers!

此 issue 因超过 60 天无活动而被自动关闭。

如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。

感谢您对 KTransformers 的贡献！

@ErvinXie commented on GitHub (Dec 11, 2025): This issue has been automatically closed due to inactivity for 60 days. If you believe this issue is still relevant, please feel free to reopen it with additional information or context. Thank you for your contribution to KTransformers! --- 此 issue 因超过 60 天无活动而被自动关闭。如果您认为此问题仍然存在，请随时重新打开并提供更多信息或上下文。感谢您对 KTransformers 的贡献！