mrhaoxx 07fd9328fa refactor(sft): move SFT logic into kt_kernel.sft submodule ...

- Create python/sft/ with 11 modules: base, amx, arch, autograd, layer,
  lora, weights, wrapper, dist_utils, config, __init__
- Move BaseSFTMoEWrapper + buffer management into sft/base.py (template
  method pattern: subclass provides _make_forward/backward_task)
- Move AMXSFTMoEWrapper into sft/amx.py (thinner, no buffer logic)
- Move from accelerate kt_moe.py: KTMoEFunction, KTMoELayerWrapper,
  MOEArchConfig, PEFT LoRA adaptation, weight extraction, wrapping
- Add KTConfig dataclass (DeepSpeed pattern: opaque config passthrough)
- Add _get_kt_config() with old→new field name compat conversion
- Rename forward_sft→forward, submit_forward_sft→submit_forward,
  sync_forward_sft→sync_forward (Python only, C++ binding names unchanged)
- Delete dump utilities from sft_moe.hpp (-526) and moe-sft-tp.hpp (-78)
- Delete experts_sft.py and utils/amx_sft.py (moved to sft/)
- Remove SFT stubs from BaseMoEWrapper (experts_base.py)
- Lazy SFT import in __init__.py and experts.py (inference isolation)
- Delete all lifecycle/debug logging (~500 lines)

Verified: Qwen3-235B 4GPU AMXBF16 training, 3 steps loss converges.

2026-04-08 23:07:41 +08:00

..

__init__.py

refactor(sft): move SFT logic into kt_kernel.sft submodule

2026-04-08 23:07:41 +08:00

amx.py

refactor(sft): move SFT logic into kt_kernel.sft submodule

2026-04-08 23:07:41 +08:00

arch.py

refactor(sft): move SFT logic into kt_kernel.sft submodule

2026-04-08 23:07:41 +08:00

autograd.py

refactor(sft): move SFT logic into kt_kernel.sft submodule

2026-04-08 23:07:41 +08:00

base.py

refactor(sft): move SFT logic into kt_kernel.sft submodule

2026-04-08 23:07:41 +08:00

config.py

refactor(sft): move SFT logic into kt_kernel.sft submodule

2026-04-08 23:07:41 +08:00

dist_utils.py

refactor(sft): move SFT logic into kt_kernel.sft submodule

2026-04-08 23:07:41 +08:00

layer.py

refactor(sft): move SFT logic into kt_kernel.sft submodule

2026-04-08 23:07:41 +08:00

lora.py

refactor(sft): move SFT logic into kt_kernel.sft submodule

2026-04-08 23:07:41 +08:00

weights.py

refactor(sft): move SFT logic into kt_kernel.sft submodule

2026-04-08 23:07:41 +08:00

wrapper.py

refactor(sft): move SFT logic into kt_kernel.sft submodule

2026-04-08 23:07:41 +08:00