[PR #161] [MERGED] kb: DLSS5 neural rendering + DLSS frame generation in a custom REFramework build, with Tobii eye tracking (Resident Evil 2 (2019)) #172

New issue

Closed

opened 2026-10-15 20:54:00 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-15 20:54:00 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/rehan-remade/universal-modder/pull/161
Author: @GautamtmD
Created: 10/8/2026
Status: ✅ Merged
Merged: 10/10/2026
Merged by: @rehan-remade

Base: main ← Head: kb/resident-evil-2-2019-dlss5-nr-frame-generation-tobii

📝 Commits (9)

0515319 kb: DLSS5 neural rendering + DLSS frame generation in a custom REFramework build, with Tobii eye tracking (Resident Evil 2 (2019))
1e3d203 kb(re2): Tobii runtime is not redistributable; load Tobii Experience's copy; NR DLL source
d9822a7 kb: Tobii eye tracking in any PC game (technique): Stream Engine docs vs headers, licensing, gotchas
b79e1c0 kb(tobii): rewrite as a self-contained Stream Engine reference + tuned extended-view recipe
bf8259c kb(tobii): describe the API in original wording; own struct/field names, no header enum listings or quotes
e69377c kb(tobii): state the tested Stream Engine runtime range (4.1 to 4.25) instead of exact builds
d20fd29 kb: RE2 DLSS 5 + frame generation, Tobii Stream Engine: review fixes
9d2c56d Merge remote-tracking branch 'origin/main' into land/pr-161
000eeb6 kb: regenerate the index

📊 Changes

4 files changed (+569 additions, -2 deletions)

View changed files

📝 knowledge/INDEX.md (+4 -2)
➕ knowledge/games/resident-evil-2-2019/dlss5-neural-rendering-dlss-frame-generation-in-a-custom-ref.md (+270 -0)
📝 knowledge/index.json (+74 -0)
➕ knowledge/techniques/tobii-eye-tracking-in-any-pc-game-stream-engine-without-ship.md (+221 -0)

📄 Description

Field note: DLSS5 neural rendering + DLSS frame generation in a custom REFramework build, with Tobii eye tracking

game: Resident Evil 2 (2019), Steam build 11636119 (DX12)
engine / route: re-engine / native-hook
status: working (verified in game: logs, PresentMon, pixel A/B, human visual checks)
agents: Claude Code (Opus 5.5)
verified on: Ryzen 7 5800X3D, RTX 5070 Ti, NVIDIA 617.42, Windows 11 26200, Streamline 2.14.1, DLSS SR/NR 310.8.0, DLSS-G 310.9.1

What's in it: the RE2 main/render thread timeline (where Reflex/PCL frame tokens go), NR (NGX feature 18) through the driver's public NGX core instead of a caller-identity spoof, getting Streamline in front of a swap chain that is created before REFramework hooks, hooking the Streamline proxy so REFramework's compose sits above frame generation, the ReShade/RenoDX layering for RE2's broken HDR, and 15 numbered gotchas.

Also adds a technique note, Tobii eye tracking in any PC game: Stream Engine without shipping Tobii's files (knowledge/techniques/): a self-contained Stream Engine API reference for agents without the SDK (enums, struct layouts with offsets, function declarations, callback/threading rules), a lifecycle sample, an "extended view" recipe (eye + head blended camera turn) with play-tested ratios, deadzones and smoothing, and the gotchas the public docs miss (outdated public 3-parameter tobii_device_create, radians, reconnect after loading stalls, loading the runtime Tobii Experience installs instead of shipping it).

Checked with um kb check; index regenerated with um kb index (um kb check --index passes, 130 notes).

no game files, decompiled code dumps or secrets
versions and verification written down

🤖 Generated with Claude Code

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/rehan-remade/universal-modder/pull/161 **Author:** [@GautamtmD](https://github.com/GautamtmD) **Created:** 10/8/2026 **Status:** ✅ Merged **Merged:** 10/10/2026 **Merged by:** [@rehan-remade](https://github.com/rehan-remade) **Base:** `main` ← **Head:** `kb/resident-evil-2-2019-dlss5-nr-frame-generation-tobii` --- ### 📝 Commits (9) - [`0515319`](https://github.com/rehan-remade/universal-modder/commit/05153191d03f6267a0ea10a1994670c2de4b42bb) kb: DLSS5 neural rendering + DLSS frame generation in a custom REFramework build, with Tobii eye tracking (Resident Evil 2 (2019)) - [`1e3d203`](https://github.com/rehan-remade/universal-modder/commit/1e3d203f5f86ffd18d420967653c654667a17629) kb(re2): Tobii runtime is not redistributable; load Tobii Experience's copy; NR DLL source - [`d9822a7`](https://github.com/rehan-remade/universal-modder/commit/d9822a722131315ff06d7312a84d1fcb4ba48fad) kb: Tobii eye tracking in any PC game (technique): Stream Engine docs vs headers, licensing, gotchas - [`b79e1c0`](https://github.com/rehan-remade/universal-modder/commit/b79e1c0cdd591121eaed291b2f99c5772aceeab6) kb(tobii): rewrite as a self-contained Stream Engine reference + tuned extended-view recipe - [`bf8259c`](https://github.com/rehan-remade/universal-modder/commit/bf8259c0d5c84932392c62442f61637fa8481998) kb(tobii): describe the API in original wording; own struct/field names, no header enum listings or quotes - [`e69377c`](https://github.com/rehan-remade/universal-modder/commit/e69377ce62be28d36d66637476eda03a4491e5a3) kb(tobii): state the tested Stream Engine runtime range (4.1 to 4.25) instead of exact builds - [`d20fd29`](https://github.com/rehan-remade/universal-modder/commit/d20fd29dccf7a18a7d5d17147c2c344d446642f2) kb: RE2 DLSS 5 + frame generation, Tobii Stream Engine: review fixes - [`9d2c56d`](https://github.com/rehan-remade/universal-modder/commit/9d2c56d32687a91606a9b0fd6a1d31a811e365f1) Merge remote-tracking branch 'origin/main' into land/pr-161 - [`000eeb6`](https://github.com/rehan-remade/universal-modder/commit/000eeb61d560418ce701aaa074ce4c1a8e8b42b9) kb: regenerate the index ### 📊 Changes **4 files changed** (+569 additions, -2 deletions) <details> <summary>View changed files</summary> 📝 `knowledge/INDEX.md` (+4 -2) ➕ `knowledge/games/resident-evil-2-2019/dlss5-neural-rendering-dlss-frame-generation-in-a-custom-ref.md` (+270 -0) 📝 `knowledge/index.json` (+74 -0) ➕ `knowledge/techniques/tobii-eye-tracking-in-any-pc-game-stream-engine-without-ship.md` (+221 -0) </details> ### 📄 Description Field note: **DLSS5 neural rendering + DLSS frame generation in a custom REFramework build, with Tobii eye tracking** - game: Resident Evil 2 (2019), Steam build 11636119 (DX12) - engine / route: re-engine / native-hook - status: working (verified in game: logs, PresentMon, pixel A/B, human visual checks) - agents: Claude Code (Opus 5.5) - verified on: Ryzen 7 5800X3D, RTX 5070 Ti, NVIDIA 617.42, Windows 11 26200, Streamline 2.14.1, DLSS SR/NR 310.8.0, DLSS-G 310.9.1 What's in it: the RE2 main/render thread timeline (where Reflex/PCL frame tokens go), NR (NGX feature 18) through the driver's public NGX core instead of a caller-identity spoof, getting Streamline in front of a swap chain that is created before REFramework hooks, hooking the Streamline proxy so REFramework's compose sits above frame generation, the ReShade/RenoDX layering for RE2's broken HDR, and 15 numbered gotchas. Also adds a technique note, **Tobii eye tracking in any PC game: Stream Engine without shipping Tobii's files** (`knowledge/techniques/`): a self-contained Stream Engine API reference for agents without the SDK (enums, struct layouts with offsets, function declarations, callback/threading rules), a lifecycle sample, an "extended view" recipe (eye + head blended camera turn) with play-tested ratios, deadzones and smoothing, and the gotchas the public docs miss (outdated public 3-parameter `tobii_device_create`, radians, reconnect after loading stalls, loading the runtime Tobii Experience installs instead of shipping it). Checked with `um kb check`; index regenerated with `um kb index` (`um kb check --index` passes, 130 notes). - [x] no game files, decompiled code dumps or secrets - [x] versions and verification written down 🤖 Generated with [Claude Code](https://claude.com/claude-code) --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-15 20:54:00 +00:00