mirror of
https://github.com/morluto/rea.git
synced 2026-11-05 06:45:22 +00:00
[GH-ISSUE #3981] [Bug] Overlapping DOS relocations produce a false load-image mismatch #1576
Closed
opened 2026-10-16 21:07:21 +00:00 by bsakaguchi
·
1 comment
No Branch/Tag specified
main
codex/procedure-reference-stacked
release-please--branches--main--components--rea-agents
release-please--branches--main--components--rea-agents--release-notes
codex/kuna-independent-retry
codex/byte-search-overlay-coverage
codex/open-failure-target-receipt
codex/kuna-xref-evidence
codex/ghidra-ambiguous-procedure-recovery
codex/function-source-bundle
codex/trace-function-integration-prototype
codex/snapshot-source-closure
codex/recorded-evidence-array-pages
codex/evidence-recovery-redesign
codex/trace-feature-address-scope
codex/call-discovery-scope
codex/ghidra-literal-candidate-evidence
codex/decompile-directory-independent-retry
codex/retry-provenance-base
codex/value-flow-capability-experiment
codex/ghidra-containing-instruction
cursor/readme-discord-button-ef9f
dependabot/github_actions/actions/setup-node-7.1.0
dependabot/github_actions/actions/upload-artifact-7.0.2
dependabot/npm_and_yarn/npm-minor-and-patch-d8d97ce6df
codex/kuna-1989
fix/8559-native-ui-fixture-ownership
fix/8555-go-verifier-mcp-ownership
codex/provider-capability-recovery
fix/8642-rizin-target-stdin
codex/ghidra-memory-effect-scope
codex/ghidra-annotation-entry-selector
codex/ghidra-readonly-recovery
codex/ghidra-regex-verifier-recovery
codex/evidence-discovery-view-guidance
fix/8545-bulk-append-overflow
fix/8428-navigation-refusal-alternatives
codex/address-context-recovery
codex/matching-member-limitations
codex/unknown-scope-contract
codex/evidence-view-guidance
feat/8373-native-trace-views
codex/ghidra-snapshot-verifier-binding
codex/elf-export-visibility
codex/evidence-view-recovery
codex/native-reference-cli-help
codex/provider-candidate-observation-scope
codex/kuna-session-verification
codex/ghidra-switch-lifetime-guidance
codex/pseudocode-paging-discovery
codex/clarify-evidence-view-support
codex/kuna-xrefs-selector-recovery
codex/context-capacity-recovery
codex/evidence-closure-large-links
codex/same-function-evidence-identity
codex/ghidra-verifier-inspected-jdk
codex/audit-guided-workflows
codex/crash-prompt-retained-dossiers
codex/analysis-view-error-recovery
codex/kuna-verifier-target-selection
codex/ghidra-selected-project-call-coverage
codex/docs-native-analysis-scope
codex/ghidra-java-socket-boundary
codex/ghidra-retained-snapshot-verifier
codex/ghidra-search-inventory-facts
fix/8284-zero-argument-parameter-bindings
fix/8198-ui-action-handler-offset
fix/8257-elf-entry-label-identity
fix/8304-deferred-output-schema-projection
fix/8277-call-path-computed-target-uncertainty
fix/pr-8089-conflicts
fix/ci-static-duplicate-export
dependabot/npm_and_yarn/lint-staged-17.6.0
dependabot/github_actions/actions/download-artifact-8.0.2
dependabot/npm_and_yarn/write-file-atomic-8.0.0
dependabot/npm_and_yarn/canonicalize-5.1.0
dependabot/github_actions/actions/cache/restore-6.1.0
dependabot/npm_and_yarn/toon-format/toon-4.4.0
dependabot/github_actions/actions/deploy-pages-5.0.1
codex/review-fixes-pr-2403
codex/review-fixes-pr-2400
codex/process-terminal-width
codex/test-brittleness-cleanup
verify/7167-browser-connect-macos
fix/7167-browser-connect
feat/native-matching-allowance-setting
feat/browser-scenario-dry-run
test/managed-caller-parameters-20261024
codex/parser-fortythird-boundaries
fix/6926-pinvoke-platform-decorations-20261023
fix/6889-har-body-encoding-20261023
fix/6888-sqlite-schema-budget-20261023
fix/dependency-security-gates-6708
cursor/evidence-overwrite-rebase-b4ac
feat/4057-verify-native-exports
fix/windows-acl-observer-overhead-20261022
cursor/erlang-beam-restack-4476
cursor/pe-certificate-review-bf32
fix/6116-javascript-application-fs-errors
fix/6061-unmapped-runtime-script-unknown
feat/browser-scenario-summary
fix/pe-certificates
codex/verify-3407
cursor/rebase-5699
cursor/rebase-5352
cursor/rebase-5600
cursor/fix-cli-schema-omission-10a8
codex/audit-hopper-shutdown-reasons-20261021
fix/demangle-swift-omitted-record
fix/nib-boolean-value-types
cursor/cancellation-partial-observation-a5ac
fix/ib-object-limit-reasons
fix/electron-fuse-limit-advice
fix/kuna-doctor-dangling-cache
fix/fixed-budget-refusal-advice
fix/js-ipc-listener-dedup
fix/js-return-member-provenance
fix/dmg-integrity-retry-advice
fix/ida-doctor-readiness
fix/kuna-version-probe-output-drain
fix/legacy-swift-runtime-name-matching
fix/dylib-lazy-load-commands
fix/browser-scenario-startup-cancel
fix/swift-nested-punycode-classification
fix/compare-unselected-scopes
fix/objc-method-budget-coverage
fix/dmg-mounted-root-observations
audit/ci-tests-20261019-round2
release/6.7.0
fix/wabt-cleanup-retry-resolution
fix/electron-fuse-elf-pe-architecture
fix/native-plist-descriptor-ownership
fix/kuna-caller-cleanup-ownership
experiment/atomic-codemode-20261016
review/first-contributor-3776
fix/call-resolution-full-read-cycles
fix/member-mutation-selection-repeat
experiment/atomic-re-tools-20261015
perf/member-mutation-lazy-origins
perf/static-network-mutation-index
fix/hopper-startup-lifecycle
audit/3050-windows-proof-20261015
feat/windows-window-capture-2183
audit/3049-windows-proof-20261015
audit/3735-macos-fixtures-20261015
fix/batch-decompile-null-pseudocode
fix/kuna-inventory-honors-jobs
experiment/browser-codemode-tool-design-20261015
fix/hopper-clean-runtime-argv
codex/review-2049-27f1b367
review-fixes/pr-2787-routing
fix/3360-scoped-this-emitters
fix/3367-replaced-global-effects
fix/3838-compact-any-value-items
test/hopper-download-probe-20261015
codex/windows-runtime-creation-red-green-20261015
codex/windows-readonly-root-red-green-20261015
codex/windows-root-share-red-green-20261015
codex/exp-1685-win-mcp-startup
codex/bug-sweep-20261015
investigate/2190-windows-package-phases
investigate/3543-macos-cli-deadline
perf/3281-reverse-tools-feedback-quality
fix/3406-hopper-doctor-fixture
fix/3341-wrapper-require-test-context
fix/3301-owned-uninstall-fixtures
fix/3164-compiler-input-ownership
fix/pcap-cleanup-stdout-newline-20261014
perf/interface-builder-summary
codex/review-fixes-pr-1977
fix/ghidra-effective-jvm-platform
fix/docs-turkish-rust-link-20261013
fix/main-maintenance-ci-20261010
fix/recover-binary-session-process-effects
codex/review-fixes-pr-2457
codex/ci-required-cancellation-gate
fix/main-format-baseline-20261013
fix/setup-preserve-entry-fields
cursor/restore-main-checks-1ffc
fix/ghidra-bridge-hashmap-import
codex/shared-ci-jadx-json-default-20261013
codex/shared-ci-ghidra-test-groups-20261013
codex/shared-ci-java-fixture-format-20261013
codex/fix-intrinsic-invocation-boundaries
test/release-preflight-reusable-jobs
test/js-parameter-provenance-expectation
fix/linux-hopper-verification-current
test/2419-ghidra-elf-probe-size
followup/pr-1544-native-ida
codex/fold-pr-2230-contribution
docs/readme-responsible-use
fix/issue-2064
fix/issue-2050
fix/issue-2053
fix/issue-1968
fix/issue-1945
experiment/codemode-bridge-20261011
fix/tool-effects-negative-wording-1904-20261012
fix/1842-electron-interop-provenance
feat/recover-javascript-multi-input
refactor/website-i18n-prep
fix/nativeaot-pe-virtual-extent
fix/browser-verifier-ci-hang
fix/pe-resources-input-selection
docs/beginner-friendly-guides
docs/beginner-setup-guide
fix/javascript-analysis-worker-1563
fix/1649-ghidra-duplicate-names
fix/javascript-export-keys-integration-1369
test/maintenance-boundary-contracts-20261011
review/javascript-export-keys-1369
review/process-live-progress-1483
test/javascript-1495-growth-ratio
fix/ci-escape-timing
docs/normalized-terminal-geometry-1450
release/6.3.0
archive/release-6.3.0-pr1381
release/6.2.0
fix/electron-preload-dynamic-override
fix/javascript-self-referential-bundler-edges
release/6.1.0
cursor/grok-client-cherry-pick-0b56
feat/signature-posture
feat/dyld-shared-cache
feat/artifact-integrity-policy
feat/pkg-inventory
release/6.0.0
chore/sync-release-5.0.0
release/5.0.0
cursor/cloud-agent-node-787e
fix/javascript-xhr-open-endpoints
review/pr-711-realpath-fallback-wording
cleanup/replay-confinement
codex/test-suite-performance
codex/issue-foundations
codex/address-open-issues-2026-07-20
agent/javascript-vite-rollup-esbuild-adapters
agent/process-cleanup
agent/triage-integration
agent/unknown-commands-registry
feat/mcp-identity-metadata
morlvps/issue_cleanup
codex/installer-redesign
morl/roadmap-investigation-core
morl/roadmap-investigation-docs
release-please--branches--main--components--rea
rea-agents-6.8.0
rea-agents-6.7.0
rea-agents-6.6.0
experiment/atomic-codemode-wait-runtime-20261016
rea-agents-6.5.0
rea-agents-6.4.0
rea-agents-6.3.0
rea-agents-6.2.0
rea-agents-6.1.0
rea-agents-6.0.0
rea-agents-5.0.0
rea-agents-4.1.0
rea-agents-4.0.1
rea-agents-4.0.0
rea-agents-3.2.1
rea-agents-3.2.0
rea-agents-3.1.0
rea-agents-3.0.0
rea-agents-2.7.0
rea-agents-2.6.0
rea-agents-2.5.1
rea-agents-2.5.0
rea-agents-2.4.0
rea-agents-2.3.0
rea-agents-2.2.0
rea-agents-2.1.0
rea-agents-2.0.0
rea-agents-1.7.0
rea-agents-1.6.0
rea-agents-1.5.0
rea-agents-1.4.0
rea-agents-1.3.0
rea-agents-1.2.0
rea-agents-1.1.0
rea-agents-1.0.0
rea-agents-0.5.0
rea-agents-0.4.0
rea-agents-0.3.0
rea-0.2.1
rea-0.2.0
Labels
Clear labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
Mirrored from GitHub Pull Request
question
roadmap
triage
No labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
question
roadmap
triage
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set.
Reference
morluto/rea#1576
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @coygeek on GitHub (Oct 15, 2026).
Original GitHub issue: https://github.com/morluto/rea/issues/3981
Before submitting
Area
Evidence, artifacts, or reconstruction
Observed behavior
An admitted DOS MZ image with two overlapping relocation words receives
status: "mismatch"frominspect_native_load_imageeven when the observations describe the correct fully relocated bytes. In the executed simulated-provider MCP case, every check exceptrelocation_recordsmatched. The comparison expects an intermediate word that a later relocation has changed.Reproduction
src/ghidra/loadImageReproduction.test.ts. It constructs a DOS MZ image whose 48-byte header contains relocation records for module offsets 9 then 8. Both original words are zero. The probe computes the final bytes and digests independently, supplies the observations through a simulated provider client, then calls the registered MCP tools.final-memoryoutput. Theopen_binarycall succeeds withprovider_id: "ghidra". Theinspect_native_load_imagecall with{}succeeds as an MCP request but reportsstatus: "mismatch"with onlyrelocation_recordsunmatched. The control changes only the first relocation observation to the intermediate memory word; that second call reportsverified.Expected behavior
For the admitted DOS MZ image, independent load-image verification should return
verifiedwhen the snapshot identity, complete modified bytes, mappings, external entry and both relocation records agree with the final loaded Program. Each relocation record's memory window must correspond to the current loaded bytes, including changes made by later overlapping relocations. Multiplicity and both distinct relocation addresses must remain visible.Impact and scope
A bounded DOS MZ input gives an incorrect independent attestation result despite matching complete final-file and mapping digests. The reproduced failure concerns load-image evidence; ordinary disassembly, executable integrity and runtime execution were not shown to fail.
Raw observations are returned, but no alternative independent attestation for the same unchanged image was demonstrated. Substituting the intermediate observation makes the records disagree with final loaded memory, so that control is not a valid workaround.
REA version
rea 6.5.0 at source commit
4692bb3330Runtime and platform
Node 24.18.0; macOS arm64
Target and artifact context
Generated DOS MZ fixture; two in-bounds relocation words at module offsets 9 then 8; simulated Ghidra observations.
Interface
MCP
Earliest failure stage
Native analysis or reconstruction
Relevant output or evidence
docs/ghidra-dos.md:118, "Loaded-image evidence", promises independent comparison against the loaded Program, including relocation fixups and records with multiplicity.src/contracts/officialToolContracts.ts:46registers the empty-input operation for DOS MZ;docs/mcp-contracts.md:11identifies the normalized MCP result field.relocation_records.src/ghidra/GhidraLoadImageValues.ts:41captures expected memory words during sequential relocation application.bridge/ghidra/ReaGhidraBridge.java:648enumerates records and reads each current Program memory window at line 669.The probe asserts that the parser admits the exact image and that its final bytes are
001010. Productionopen_binaryalso admitted it, and the registered inspection tool reached the Ghidra adapter and attestation. Source inspection atsrc/domain/dosMz.ts:159confirms that relocation validation checks the module extent without rejecting overlap. The fake replaces engine observations and snapshot acquisition; it does not replace the session, attestation or MCP result path. The bridge read timing was inspected in source rather than measured in a real Ghidra process.The executed MCP case returned
mismatch. Applying the relocation at offset 9 writes00 10at offsets 9 and 10. Applying the next at offset 8 writes00 10at offsets 8 and 9. Final module bytes 8 through 10 are therefore00 10 10, so the first record's final memory window is10 10. The failing check instead expected00 10for that record. All whole-file and mapping digests matched the final relocated buffer.The observed output reduces to:
As a discriminating control, replacing only the first record's observation with
"0010"producedstatus: "verified", while the source and mapping digests still described the final relocated buffer. The focused probe passed once with both calls asserted. The existing load-image test file also passed all 38 tests. This establishes the adapter's comparison behavior with the simulated observations; the real bridge's current-memory semantics are source-derived. It does not establish source-file mutation, incorrect DOS execution, or a real-engine loader failure.Typed outcome or recovery expected
With the same source image and final-memory observations, the public MCP request should return
verifiedand all checks should match. The deliberately intermediate0010first-record observation must fail the relocation check because its final memory window is1010. Keep both records and their addresses, and preserve rejection of an actually incorrect modified-file digest or mapping digest. Dropping a record, ignoring relocation windows or rejecting the previously admitted image would not restore the documented verification contract.Analysis or suspected cause
The source references above explain the observed behavior. Runtime claims are limited to the explicitly described simulation boundaries.
Additional context
Runtime claims above describe the supplied local reproduction at the baseline commit. Real-provider frequency remains unmeasured.
The relevant failure code is unchanged on current
origin/mainfc712b3750.@morluto commented on GitHub (Oct 17, 2026):
Fixed on main in
969aafcf28, adapting @berelels' correction and authored control from #4156 to the prepared MZ image owner introduced by #4770.The producer retains each fixup's pre-application bytes and applied value, then derives every memory window from the completed relocated image. Comparison also consumes the producer's load segment instead of defining it again. Only the MZ evidence profile advances, to
independent-mz-mapping-relocations-v2.At baseline
2f9b9c48b, two real-file controls failed: final windows producedmismatch, while a deliberately intermediate first word producedverified. Both are corrected. The final first window is1410; the stale0410window now fails onlyrelocation_records.Rebased validation: 152 source/comparison/shared-MCP checks passed, 41 selected provider checks passed (81 deselected), and 14 lifecycle checks passed (74 deselected): 207 distinct focused checks. Static checks, runtime build and docs checks passed, including 5 README checks. Seven MCP overlap controls retain Evidence and distinguish stale windows, missing/duplicate records and unrelated source/mapping digest mismatches; record reordering is accepted. Two scoped source reviews found no blocker. The eight changed files and source-comparison dependencies remained byte-identical through rebase over
34239d445; affected checks were rerun.Twelve completed normal source-comparison tasks (160-byte authored image, overlays 23/65,539 bytes, real descriptor reads) retained byte-identical full replies at 2199/2180 cl100k_base token estimates. Warm-repeat baseline/candidate medians:
Every task used a fresh Node process; first attempts were separated from two alternating repeats with existing OS caches. No true-cold or persistent-runtime-cache claim. One Node process/no children: wait4 peak RSS represents its process-family peak; periodic samples were incomplete. These tiny samples establish no speed or memory improvement. Full public provider/Evidence replies intentionally change profile revision and were not the performance comparison. Whole-agent/catalog tokens, real engines, maximal relocation counts, large inputs and failure-path costs remain unmeasured.
No real Ghidra/target execution was performed here. #4156's reported real-engine observations remain the PR author's evidence. Pinned Ghidra 12.1.4 MzLoader source uses original-file fixup values and HashSet iteration; loader/model differences for other overlap orders or duplicate source relocations remain separate and can correctly produce mismatches. This correction preserves cumulative DOS comparison semantics. Heavy profiling/stress remains stopped.