[PR #781] [MERGED] update documentation to fix error in numa enablement #1480

New issue

Closed

opened 2026-10-29 14:52:47 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 14:52:47 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/ktransformers/pull/781
Author: @3wweiweiwu
Created: 3/3/2025
Status: ✅ Merged
Merged: 3/5/2025
Merged by: @Atream

Base: main ← Head: main

📝 Commits (2)

bbcc548 update documentation to fix error in numa enablement
b936bcc use 'make dev_install' to make minimum change

📊 Changes

1 file changed (+3 additions, -2 deletions)

View changed files

📝 doc/en/install.md (+3 -2)

📄 Description

Problem Statement

The current documentation does not correctly explain how to enable NUMA mode. Several issues have pointed out this issue:

#634
#769

Solution

This update improves the installation guide based on suggestions from these posts. I also tested the steps in my environment, and NUMA mode worked correctly.

Recommended steps:

# Ensure your system has dual sockets and at least double the RAM size compared to the model size (e.g., 1TB RAM for a 512GB model)
apt install libnuma-dev
export USE_NUMA=1
make install_numa

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/ktransformers/pull/781 **Author:** [@3wweiweiwu](https://github.com/3wweiweiwu) **Created:** 3/3/2025 **Status:** ✅ Merged **Merged:** 3/5/2025 **Merged by:** [@Atream](https://github.com/Atream) **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (2) - [`bbcc548`](https://github.com/kvcache-ai/ktransformers/commit/bbcc5481bbe40c7d92601671da1b3190abf33986) update documentation to fix error in numa enablement - [`b936bcc`](https://github.com/kvcache-ai/ktransformers/commit/b936bcc72eae0a618173dc9b5676fb193739d055) use 'make dev_install' to make minimum change ### 📊 Changes **1 file changed** (+3 additions, -2 deletions) <details> <summary>View changed files</summary> 📝 `doc/en/install.md` (+3 -2) </details> ### 📄 Description ### Problem Statement The current documentation does not correctly explain how to enable NUMA mode. Several issues have pointed out this issue: - #634 - #769 ### Solution This update improves the installation guide based on suggestions from these posts. I also tested the steps in my environment, and NUMA mode worked correctly. ### Recommended steps: ```shell # Ensure your system has dual sockets and at least double the RAM size compared to the model size (e.g., 1TB RAM for a 512GB model) apt install libnuma-dev export USE_NUMA=1 make install_numa ``` --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 14:52:47 +00:00