mirror of
https://github.com/morluto/rea.git
synced 2026-11-05 06:45:22 +00:00
[GH-ISSUE #5168] [Bug] e_lfanew inside the DOS header (Tiny PE) is refused before provider admission #3175
Open
opened 2026-10-31 00:37:31 +00:00 by bsakaguchi
·
5 comments
No Branch/Tag specified
main
codex/procedure-reference-stacked
release-please--branches--main--components--rea-agents
release-please--branches--main--components--rea-agents--release-notes
codex/kuna-independent-retry
codex/byte-search-overlay-coverage
codex/open-failure-target-receipt
codex/kuna-xref-evidence
codex/ghidra-ambiguous-procedure-recovery
codex/function-source-bundle
codex/trace-function-integration-prototype
codex/snapshot-source-closure
codex/recorded-evidence-array-pages
codex/evidence-recovery-redesign
codex/trace-feature-address-scope
codex/call-discovery-scope
codex/ghidra-literal-candidate-evidence
codex/decompile-directory-independent-retry
codex/retry-provenance-base
codex/value-flow-capability-experiment
codex/ghidra-containing-instruction
cursor/readme-discord-button-ef9f
dependabot/github_actions/actions/setup-node-7.1.0
dependabot/github_actions/actions/upload-artifact-7.0.2
dependabot/npm_and_yarn/npm-minor-and-patch-d8d97ce6df
codex/kuna-1989
fix/8559-native-ui-fixture-ownership
fix/8555-go-verifier-mcp-ownership
codex/provider-capability-recovery
fix/8642-rizin-target-stdin
codex/ghidra-memory-effect-scope
codex/ghidra-annotation-entry-selector
codex/ghidra-readonly-recovery
codex/ghidra-regex-verifier-recovery
codex/evidence-discovery-view-guidance
fix/8545-bulk-append-overflow
fix/8428-navigation-refusal-alternatives
codex/address-context-recovery
codex/matching-member-limitations
codex/unknown-scope-contract
codex/evidence-view-guidance
feat/8373-native-trace-views
codex/ghidra-snapshot-verifier-binding
codex/elf-export-visibility
codex/evidence-view-recovery
codex/native-reference-cli-help
codex/provider-candidate-observation-scope
codex/kuna-session-verification
codex/ghidra-switch-lifetime-guidance
codex/pseudocode-paging-discovery
codex/clarify-evidence-view-support
codex/kuna-xrefs-selector-recovery
codex/context-capacity-recovery
codex/evidence-closure-large-links
codex/same-function-evidence-identity
codex/ghidra-verifier-inspected-jdk
codex/audit-guided-workflows
codex/crash-prompt-retained-dossiers
codex/analysis-view-error-recovery
codex/kuna-verifier-target-selection
codex/ghidra-selected-project-call-coverage
codex/docs-native-analysis-scope
codex/ghidra-java-socket-boundary
codex/ghidra-retained-snapshot-verifier
codex/ghidra-search-inventory-facts
fix/8284-zero-argument-parameter-bindings
fix/8198-ui-action-handler-offset
fix/8257-elf-entry-label-identity
fix/8304-deferred-output-schema-projection
fix/8277-call-path-computed-target-uncertainty
fix/pr-8089-conflicts
fix/ci-static-duplicate-export
dependabot/npm_and_yarn/lint-staged-17.6.0
dependabot/github_actions/actions/download-artifact-8.0.2
dependabot/npm_and_yarn/write-file-atomic-8.0.0
dependabot/npm_and_yarn/canonicalize-5.1.0
dependabot/github_actions/actions/cache/restore-6.1.0
dependabot/npm_and_yarn/toon-format/toon-4.4.0
dependabot/github_actions/actions/deploy-pages-5.0.1
codex/review-fixes-pr-2403
codex/review-fixes-pr-2400
codex/process-terminal-width
codex/test-brittleness-cleanup
verify/7167-browser-connect-macos
fix/7167-browser-connect
feat/native-matching-allowance-setting
feat/browser-scenario-dry-run
test/managed-caller-parameters-20261024
codex/parser-fortythird-boundaries
fix/6926-pinvoke-platform-decorations-20261023
fix/6889-har-body-encoding-20261023
fix/6888-sqlite-schema-budget-20261023
fix/dependency-security-gates-6708
cursor/evidence-overwrite-rebase-b4ac
feat/4057-verify-native-exports
fix/windows-acl-observer-overhead-20261022
cursor/erlang-beam-restack-4476
cursor/pe-certificate-review-bf32
fix/6116-javascript-application-fs-errors
fix/6061-unmapped-runtime-script-unknown
feat/browser-scenario-summary
fix/pe-certificates
codex/verify-3407
cursor/rebase-5699
cursor/rebase-5352
cursor/rebase-5600
cursor/fix-cli-schema-omission-10a8
codex/audit-hopper-shutdown-reasons-20261021
fix/demangle-swift-omitted-record
fix/nib-boolean-value-types
cursor/cancellation-partial-observation-a5ac
fix/ib-object-limit-reasons
fix/electron-fuse-limit-advice
fix/kuna-doctor-dangling-cache
fix/fixed-budget-refusal-advice
fix/js-ipc-listener-dedup
fix/js-return-member-provenance
fix/dmg-integrity-retry-advice
fix/ida-doctor-readiness
fix/kuna-version-probe-output-drain
fix/legacy-swift-runtime-name-matching
fix/dylib-lazy-load-commands
fix/browser-scenario-startup-cancel
fix/swift-nested-punycode-classification
fix/compare-unselected-scopes
fix/objc-method-budget-coverage
fix/dmg-mounted-root-observations
audit/ci-tests-20261019-round2
release/6.7.0
fix/wabt-cleanup-retry-resolution
fix/electron-fuse-elf-pe-architecture
fix/native-plist-descriptor-ownership
fix/kuna-caller-cleanup-ownership
experiment/atomic-codemode-20261016
review/first-contributor-3776
fix/call-resolution-full-read-cycles
fix/member-mutation-selection-repeat
experiment/atomic-re-tools-20261015
perf/member-mutation-lazy-origins
perf/static-network-mutation-index
fix/hopper-startup-lifecycle
audit/3050-windows-proof-20261015
feat/windows-window-capture-2183
audit/3049-windows-proof-20261015
audit/3735-macos-fixtures-20261015
fix/batch-decompile-null-pseudocode
fix/kuna-inventory-honors-jobs
experiment/browser-codemode-tool-design-20261015
fix/hopper-clean-runtime-argv
codex/review-2049-27f1b367
review-fixes/pr-2787-routing
fix/3360-scoped-this-emitters
fix/3367-replaced-global-effects
fix/3838-compact-any-value-items
test/hopper-download-probe-20261015
codex/windows-runtime-creation-red-green-20261015
codex/windows-readonly-root-red-green-20261015
codex/windows-root-share-red-green-20261015
codex/exp-1685-win-mcp-startup
codex/bug-sweep-20261015
investigate/2190-windows-package-phases
investigate/3543-macos-cli-deadline
perf/3281-reverse-tools-feedback-quality
fix/3406-hopper-doctor-fixture
fix/3341-wrapper-require-test-context
fix/3301-owned-uninstall-fixtures
fix/3164-compiler-input-ownership
fix/pcap-cleanup-stdout-newline-20261014
perf/interface-builder-summary
codex/review-fixes-pr-1977
fix/ghidra-effective-jvm-platform
fix/docs-turkish-rust-link-20261013
fix/main-maintenance-ci-20261010
fix/recover-binary-session-process-effects
codex/review-fixes-pr-2457
codex/ci-required-cancellation-gate
fix/main-format-baseline-20261013
fix/setup-preserve-entry-fields
cursor/restore-main-checks-1ffc
fix/ghidra-bridge-hashmap-import
codex/shared-ci-jadx-json-default-20261013
codex/shared-ci-ghidra-test-groups-20261013
codex/shared-ci-java-fixture-format-20261013
codex/fix-intrinsic-invocation-boundaries
test/release-preflight-reusable-jobs
test/js-parameter-provenance-expectation
fix/linux-hopper-verification-current
test/2419-ghidra-elf-probe-size
followup/pr-1544-native-ida
codex/fold-pr-2230-contribution
docs/readme-responsible-use
fix/issue-2064
fix/issue-2050
fix/issue-2053
fix/issue-1968
fix/issue-1945
experiment/codemode-bridge-20261011
fix/tool-effects-negative-wording-1904-20261012
fix/1842-electron-interop-provenance
feat/recover-javascript-multi-input
refactor/website-i18n-prep
fix/nativeaot-pe-virtual-extent
fix/browser-verifier-ci-hang
fix/pe-resources-input-selection
docs/beginner-friendly-guides
docs/beginner-setup-guide
fix/javascript-analysis-worker-1563
fix/1649-ghidra-duplicate-names
fix/javascript-export-keys-integration-1369
test/maintenance-boundary-contracts-20261011
review/javascript-export-keys-1369
review/process-live-progress-1483
test/javascript-1495-growth-ratio
fix/ci-escape-timing
docs/normalized-terminal-geometry-1450
release/6.3.0
archive/release-6.3.0-pr1381
release/6.2.0
fix/electron-preload-dynamic-override
fix/javascript-self-referential-bundler-edges
release/6.1.0
cursor/grok-client-cherry-pick-0b56
feat/signature-posture
feat/dyld-shared-cache
feat/artifact-integrity-policy
feat/pkg-inventory
release/6.0.0
chore/sync-release-5.0.0
release/5.0.0
cursor/cloud-agent-node-787e
fix/javascript-xhr-open-endpoints
review/pr-711-realpath-fallback-wording
cleanup/replay-confinement
codex/test-suite-performance
codex/issue-foundations
codex/address-open-issues-2026-07-20
agent/javascript-vite-rollup-esbuild-adapters
agent/process-cleanup
agent/triage-integration
agent/unknown-commands-registry
feat/mcp-identity-metadata
morlvps/issue_cleanup
codex/installer-redesign
morl/roadmap-investigation-core
morl/roadmap-investigation-docs
release-please--branches--main--components--rea
rea-agents-6.8.0
rea-agents-6.7.0
rea-agents-6.6.0
experiment/atomic-codemode-wait-runtime-20261016
rea-agents-6.5.0
rea-agents-6.4.0
rea-agents-6.3.0
rea-agents-6.2.0
rea-agents-6.1.0
rea-agents-6.0.0
rea-agents-5.0.0
rea-agents-4.1.0
rea-agents-4.0.1
rea-agents-4.0.0
rea-agents-3.2.1
rea-agents-3.2.0
rea-agents-3.1.0
rea-agents-3.0.0
rea-agents-2.7.0
rea-agents-2.6.0
rea-agents-2.5.1
rea-agents-2.5.0
rea-agents-2.4.0
rea-agents-2.3.0
rea-agents-2.2.0
rea-agents-2.1.0
rea-agents-2.0.0
rea-agents-1.7.0
rea-agents-1.6.0
rea-agents-1.5.0
rea-agents-1.4.0
rea-agents-1.3.0
rea-agents-1.2.0
rea-agents-1.1.0
rea-agents-1.0.0
rea-agents-0.5.0
rea-agents-0.4.0
rea-agents-0.3.0
rea-0.2.1
rea-0.2.0
Labels
Clear labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
Mirrored from GitHub Pull Request
question
roadmap
triage
No labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
question
roadmap
triage
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set.
Reference
morluto/rea#3175
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @Endirdev on GitHub (Oct 19, 2026).
Original GitHub issue: https://github.com/morluto/rea/issues/5168
Observed behavior
REA refuses MZ images whose Windows new-header pointer (
e_lfanew) lies inside the 64-byte DOS header, before any provider is selected — even when a validPE\0\0signature sits at the declared offset. Canonical case: Sotirov's 97-byte Tiny PE (e_lfanew = 4).MCP
open_binarywithprovider_id: "ghidra"(paths redacted):rea inspect --provider ghidra --json ./tiny.97.exeexits 1 with the samereason. (The appended "Check that the path exists, is readable, and points to a supported file." wording is #1979, already fixed on main; it is not part of this report.)The
ghidraprovider is available on this host:/bin/trueopens through it on the same install (Ghidra 12.1.4 profile).observeMzWindowsHeader(src/domain/dosMz.ts:43) already computessignature: "PE"at the declared offset for this fixture; the guards cited below ignore that observation.Reproduction
Fixture: 97-byte Tiny PE (
e_lfanew=4, 1 section,SizeOfOptionalHeader=4, COFF machine0x014c, optional-header magic0x10b):rea inspect --provider ghidra --json ./tiny.97.exe→ exit 1, reasoninvalid Windows new-header offset in MZ imageopen_binary {path: "./tiny.97.exe"}→target_unavailable, same reasonDeterministic on this host across repeat runs. Alternative fixture source: http://www.phreedom.org/research/tinype/tinype.zip. A second fixture —
4KB.exe, the released executable of "Oscar's Chair" by Eos (4092 B,MZ20PE,e_lfanew=4, 0 sections,SizeOfOptionalHeader=8, sha256d00f3da0e3a7ab0ecb43841cd922f6abcb1a40fae9c95f9f0ef38fe6aff1eea9; provenance in Additional context) — is refused identically.Expected behavior
An overlapped-but-signature-confirmed PE should be admitted to the PE route. PE/COFF defines
e_lfanewas a file offset and does not define a 64-byte floor; Windows reads the optional header at fixed offsets, and the smallest known working value (Sotirov, then-current non-2000 Windows) is 4. At minimum, the refusal should be an explicit unsupported-layout reason rather than an "invalid offset" error, so a caller can distinguish a malformed file from an unsupported layout.Grounding: Sotirov's article (the 97-byte file ran on then-current non-2000 Windows); REA's own
inspect_pe_resourcesroute contains noe_lfanewfloor (src/native/pe/PeResourceLayout.ts:65fails later atoptionalSize < 64); Ghidra 12.1.4 importse_lfanew=4PEs when file length permits (see Additional context); and a real-world production using this exact layout ("Oscar's Chair", shown at Revision 2018 and ranked 1st) is refused identically. I have not re-executed the files myself; direct execution is marked untested rather than claimed.Impact and scope
format:"dos-com"treats the PE bytes as a headerless 16-bit COM image, 1 segment / 1 procedure) or external.REA version
rea --version→6.4.0. Both guards verified present on main commitdfe8378cf5a727e3d93d47a5986233175c6ef898(2026-10-19) and in the published 6.4.0 build.Runtime and platform
Node v24.21.0; Ubuntu 24.04 x64 (distrobox container on Bazzite); Ghidra 12.1.4 PUBLIC; provider
ghidra(hopper/ida not configured; not needed).Target and artifact context
tiny.97.exe— x86 PE32, 97 bytes, sha256e872a508a28fe08ad4d309d6949e3dbe26efad305c2c114303e01af1241a6a67. Secondary:4KB.exe— the released executable of "Oscar's Chair" by Eos (Revision 2018 PC 4k compo, ranked 1st), 4092 B, sha256d00f3da0e3a7ab0ecb43841cd922f6abcb1a40fae9c95f9f0ef38fe6aff1eea9; byte-identical to the official scene.org release member, uses the samee_lfanew=4overlapped layout, and is refused identically.Relevant output or evidence
Source refs at main@
dfe8378(BinaryTargetResolver.ts#L493-L494, binaryTarget.ts#L287-L288, dosMz.ts#L43, PeResourceLayout.ts#L65, binaryTarget.ts#L516):src/application/BinaryTargetResolver.ts#L493-L494:src/domain/binaryTarget.ts#L287-L288:observeMzWindowsHeadercomputedsignature: "PE"atoffset=4for this fixture (src/domain/dosMz.ts:43).inspect_pe_resourceson both fixtures →invalid_format: "Truncated PE optional header."— a distinct, later limitation (declaredSizeOfOptionalHeader4/8 B vs fixed-offset reads), not an offset refusal.Typed outcome or recovery expected
Either
pe/x86classification admitted (optionally with a non-standard-layout warning), or a typed unsupported-layout reason distinct from an offset/path error.Analysis or suspected cause
Source-derived (not a fix commitment): the two
< 64guards are the blocker on the resolver/domain routes.observeMzWindowsHeaderalready yieldssignature: "PE", so gating the guards on that observation with a minimum offset of 4 (or documenting the floor as deliberate) resolves the refusal. Follow-on if relaxed:peManagedStatus(src/domain/binaryTarget.ts:516) requires the declaredSizeOfOptionalHeaderto cover the standard fields, so expect atruncated PE optional headerrefusal next for these fixtures; Windows and Ghidra read those fields at fixed offsets regardless and only warn. Internally,readPeResourceLayoutkeeps noe_lfanewfloor, soopen_binaryrefusing whatinspect_pe_resourcesaccepts is inconsistent.Additional context
c9fed506, short-DOS-stub classification), #1979 (fixed byf28f3382, path-advice wording), #2408 (NE-support proposal under review).4KB.exe(e_lfanew=4, 4092 B): import succeeded asx86:LE:32:default:windows, withWARN Non-standard optional header size: 8 bytes.WARN Non-standard optional header size: 4 bytes.tiny.97.exe: does not import in Ghidra either — default loader selection is MZ (import fails), and forced-loader PeLoaderreports "No load spec found" because its fixed-offset reads run past EOF. That is a file-length limitation, not ane_lfanewpolicy, so it does not weaken the inconsistency above but must not be glossed over.4KB.exeis thereleased executable of "Oscar's Chair" by Eos — pouët 75721
(Windows 4k, Revision 2018 PC 4k compo, ranked 1st; The Meteoriks 2019
winner, Best Small High-End Intro), Demozoo.
The scene.org release archive
member
eos_-_oscar's_chair_1280x720.exeis byte-identical (sha256) to thelocal fixture. It was downloaded, extracted, and hashed only — not executed.
🤖 Prepared with an AI agent (OpenCode) against REA 6.4.0 via MCP; commands were re-run and outputs captured locally.
@XinwangTao commented on GitHub (Oct 19, 2026):
The < 64 guard is a reasonable sanity check for ordinary images, but applying it before checking the PE signature does drop a real class of overlapped-header PEs (Sotirov's Tiny PE being the canonical one). Gating the guard on observeMzWindowsHeader's signature result — allowing e_lfanew >= 4 when the PE\0\0 magic is confirmed at the declared offset — looks like the right minimal fix, plus the typed unsupported-layout reason you propose would make the failure mode much clearer for callers.
I also agree the inconsistency with inspect_pe_resources (which keeps no e_lfanew floor) is worth aligning: open_binary refusing what another route accepts is surprising and hard to debug. The Ghidra comparison strengthens the case that this is a policy decision rather than a malformed-file case, and the 'Oscar's Chair' real-world fixture shows it isn't just synthetic. Good write-up.
@vanshsharma3777 commented on GitHub (Oct 19, 2026):
I’d like to take this. I plan to go with option A (admit when PE signature confirmed at offset >= 4) and add tests with the Tiny PE fixture. Does that direction work, or do you prefer the typed unsupported-layout reason?
@XinwangTao commented on GitHub (Oct 19, 2026):
Both, actually — they're complementary rather than competing. Option A (admit when the PE signature is confirmed at offset >= 4) is the primary fix, and the typed unsupported-layout reason is still worth adding because relaxing the guard doesn't make these fixtures fully analyzable: per the write-up, inspect_pe_resources then fails later on the truncated optional header (SizeOfOptionalHeader 4/8 B vs fixed-offset reads). A caller hitting that next stage should get a distinct reason, not a generic invalid-offset error. So: A for admission, and map the follow-on truncated-optional-header failure to the typed reason. The Tiny PE and 4KB.exe fixtures cover both stages nicely — one test for admission, one asserting the distinct later failure.
@vanshsharma3777 commented on GitHub (Oct 19, 2026):
PR opened: #5216. It fixes the two offset guards (floor of 4 for signature-confirmed PE). tiny.97.exe is now refused later at peManagedStatus ("truncated PE optional header").
Should I also relax the SizeOfOptionalHeader check in this PR, or handle it in a separate PR?
@vanshsharma3777 commented on GitHub (Oct 20, 2026):
Pushed a follow-up commit applying the same minimumWindowsHeaderOffset rule to the independent guards Codex flagged: ArtifactGraphConstruction.ts (inventory now classifies a signature-confirmed overlapped PE as pe; the old “rejects” test is updated accordingly), GoPeImage.ts, and ElectronFuseReader.ts (new regression test with e_lfanew = 4). I did not add an overlapped-header test for the Go reader, because createGoBinaryFixture hardcodes the PE signature at offset 128 and an overlapped Go image would need a larger fixture change; happy to follow up if wanted. The 11 ElectronFuseProvider symlink tests fail on my Windows machine with EPERM both with and without my changes.