[PR #19] Add blog post: HiCache L3 for Hybrid Attention Models #19

Open
opened 2026-10-29 14:31:59 +00:00 by bsakaguchi · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/kvcache-blog/pull/19
Author: @stmatengss
Created: 6/20/2026
Status: 🔄 Open

Base: main ← Head: blog/hicache-l3-hybrid-attention


📝 Commits (1)

  • 70fa903 Add blog post: HiCache L3 for Hybrid Attention Models

📊 Changes

2 files changed (+598 additions, -0 deletions)

View changed files

➕ content/blog/hicache-l3-deepseek-v4/index.md (+300 -0)
➕ content/blog/hicache-l3-deepseek-v4/index.zh.md (+298 -0)

📄 Description

Summary

  • New blog post covering the full HiCache L3 optimization stack for hybrid attention architectures (MLA + SWA)
  • Topics: periodic SWA checkpoints, window-aware LRU refresh, eviction correctness fixes, C4/C128 compress-state offload, NSA indexer serialization frontier, draft KV pool registration, and Mooncake group semantics
  • Includes benchmark data: 18 GB → 4 GB per million tokens, agent cache hit 8% → 94%, TTFT 163s → 5.68s
  • Both English (index.md) and Chinese (index.zh.md) versions included

Test plan

  • Verify Hugo builds cleanly with the new post (hugo --minify)
  • Check frontmatter renders correctly on blog index
  • Confirm both EN and ZH versions display properly
  • Review PR links in post body resolve correctly

🤖 Generated with [Qoder][https://qoder.com]


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/kvcache-blog/pull/19 **Author:** [@stmatengss](https://github.com/stmatengss) **Created:** 6/20/2026 **Status:** 🔄 Open **Base:** `main` ← **Head:** `blog/hicache-l3-hybrid-attention` --- ### 📝 Commits (1) - [`70fa903`](https://github.com/kvcache-ai/kvcache-blog/commit/70fa903471514275bb911aa2aeacd4c450b4c687) Add blog post: HiCache L3 for Hybrid Attention Models ### 📊 Changes **2 files changed** (+598 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `content/blog/hicache-l3-deepseek-v4/index.md` (+300 -0) ➕ `content/blog/hicache-l3-deepseek-v4/index.zh.md` (+298 -0) </details> ### 📄 Description ## Summary - New blog post covering the full HiCache L3 optimization stack for hybrid attention architectures (MLA + SWA) - Topics: periodic SWA checkpoints, window-aware LRU refresh, eviction correctness fixes, C4/C128 compress-state offload, NSA indexer serialization frontier, draft KV pool registration, and Mooncake group semantics - Includes benchmark data: 18 GB → 4 GB per million tokens, agent cache hit 8% → 94%, TTFT 163s → 5.68s - Both English (`index.md`) and Chinese (`index.zh.md`) versions included ## Test plan - [ ] Verify Hugo builds cleanly with the new post (`hugo --minify`) - [ ] Check frontmatter renders correctly on blog index - [ ] Confirm both EN and ZH versions display properly - [ ] Review PR links in post body resolve correctly 🤖 Generated with [Qoder][https://qoder.com] --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/kvcache-blog#19
No description provided.