mirror of
https://github.com/morluto/rea.git
synced 2026-11-05 06:45:22 +00:00
[GH-ISSUE #3195] [Bug] Function comparison and reconstruction verification drop complete call-coverage diagnostics #1132
Closed
opened 2026-10-15 18:31:22 +00:00 by bsakaguchi
·
1 comment
No Branch/Tag specified
main
codex/procedure-reference-stacked
release-please--branches--main--components--rea-agents
release-please--branches--main--components--rea-agents--release-notes
codex/kuna-independent-retry
codex/byte-search-overlay-coverage
codex/open-failure-target-receipt
codex/kuna-xref-evidence
codex/ghidra-ambiguous-procedure-recovery
codex/function-source-bundle
codex/trace-function-integration-prototype
codex/snapshot-source-closure
codex/recorded-evidence-array-pages
codex/evidence-recovery-redesign
codex/trace-feature-address-scope
codex/call-discovery-scope
codex/ghidra-literal-candidate-evidence
codex/decompile-directory-independent-retry
codex/retry-provenance-base
codex/value-flow-capability-experiment
codex/ghidra-containing-instruction
cursor/readme-discord-button-ef9f
dependabot/github_actions/actions/setup-node-7.1.0
dependabot/github_actions/actions/upload-artifact-7.0.2
dependabot/npm_and_yarn/npm-minor-and-patch-d8d97ce6df
codex/kuna-1989
fix/8559-native-ui-fixture-ownership
fix/8555-go-verifier-mcp-ownership
codex/provider-capability-recovery
fix/8642-rizin-target-stdin
codex/ghidra-memory-effect-scope
codex/ghidra-annotation-entry-selector
codex/ghidra-readonly-recovery
codex/ghidra-regex-verifier-recovery
codex/evidence-discovery-view-guidance
fix/8545-bulk-append-overflow
fix/8428-navigation-refusal-alternatives
codex/address-context-recovery
codex/matching-member-limitations
codex/unknown-scope-contract
codex/evidence-view-guidance
feat/8373-native-trace-views
codex/ghidra-snapshot-verifier-binding
codex/elf-export-visibility
codex/evidence-view-recovery
codex/native-reference-cli-help
codex/provider-candidate-observation-scope
codex/kuna-session-verification
codex/ghidra-switch-lifetime-guidance
codex/pseudocode-paging-discovery
codex/clarify-evidence-view-support
codex/kuna-xrefs-selector-recovery
codex/context-capacity-recovery
codex/evidence-closure-large-links
codex/same-function-evidence-identity
codex/ghidra-verifier-inspected-jdk
codex/audit-guided-workflows
codex/crash-prompt-retained-dossiers
codex/analysis-view-error-recovery
codex/kuna-verifier-target-selection
codex/ghidra-selected-project-call-coverage
codex/docs-native-analysis-scope
codex/ghidra-java-socket-boundary
codex/ghidra-retained-snapshot-verifier
codex/ghidra-search-inventory-facts
fix/8284-zero-argument-parameter-bindings
fix/8198-ui-action-handler-offset
fix/8257-elf-entry-label-identity
fix/8304-deferred-output-schema-projection
fix/8277-call-path-computed-target-uncertainty
fix/pr-8089-conflicts
fix/ci-static-duplicate-export
dependabot/npm_and_yarn/lint-staged-17.6.0
dependabot/github_actions/actions/download-artifact-8.0.2
dependabot/npm_and_yarn/write-file-atomic-8.0.0
dependabot/npm_and_yarn/canonicalize-5.1.0
dependabot/github_actions/actions/cache/restore-6.1.0
dependabot/npm_and_yarn/toon-format/toon-4.4.0
dependabot/github_actions/actions/deploy-pages-5.0.1
codex/review-fixes-pr-2403
codex/review-fixes-pr-2400
codex/process-terminal-width
codex/test-brittleness-cleanup
verify/7167-browser-connect-macos
fix/7167-browser-connect
feat/native-matching-allowance-setting
feat/browser-scenario-dry-run
test/managed-caller-parameters-20261024
codex/parser-fortythird-boundaries
fix/6926-pinvoke-platform-decorations-20261023
fix/6889-har-body-encoding-20261023
fix/6888-sqlite-schema-budget-20261023
fix/dependency-security-gates-6708
cursor/evidence-overwrite-rebase-b4ac
feat/4057-verify-native-exports
fix/windows-acl-observer-overhead-20261022
cursor/erlang-beam-restack-4476
cursor/pe-certificate-review-bf32
fix/6116-javascript-application-fs-errors
fix/6061-unmapped-runtime-script-unknown
feat/browser-scenario-summary
fix/pe-certificates
codex/verify-3407
cursor/rebase-5699
cursor/rebase-5352
cursor/rebase-5600
cursor/fix-cli-schema-omission-10a8
codex/audit-hopper-shutdown-reasons-20261021
fix/demangle-swift-omitted-record
fix/nib-boolean-value-types
cursor/cancellation-partial-observation-a5ac
fix/ib-object-limit-reasons
fix/electron-fuse-limit-advice
fix/kuna-doctor-dangling-cache
fix/fixed-budget-refusal-advice
fix/js-ipc-listener-dedup
fix/js-return-member-provenance
fix/dmg-integrity-retry-advice
fix/ida-doctor-readiness
fix/kuna-version-probe-output-drain
fix/legacy-swift-runtime-name-matching
fix/dylib-lazy-load-commands
fix/browser-scenario-startup-cancel
fix/swift-nested-punycode-classification
fix/compare-unselected-scopes
fix/objc-method-budget-coverage
fix/dmg-mounted-root-observations
audit/ci-tests-20261019-round2
release/6.7.0
fix/wabt-cleanup-retry-resolution
fix/electron-fuse-elf-pe-architecture
fix/native-plist-descriptor-ownership
fix/kuna-caller-cleanup-ownership
experiment/atomic-codemode-20261016
review/first-contributor-3776
fix/call-resolution-full-read-cycles
fix/member-mutation-selection-repeat
experiment/atomic-re-tools-20261015
perf/member-mutation-lazy-origins
perf/static-network-mutation-index
fix/hopper-startup-lifecycle
audit/3050-windows-proof-20261015
feat/windows-window-capture-2183
audit/3049-windows-proof-20261015
audit/3735-macos-fixtures-20261015
fix/batch-decompile-null-pseudocode
fix/kuna-inventory-honors-jobs
experiment/browser-codemode-tool-design-20261015
fix/hopper-clean-runtime-argv
codex/review-2049-27f1b367
review-fixes/pr-2787-routing
fix/3360-scoped-this-emitters
fix/3367-replaced-global-effects
fix/3838-compact-any-value-items
test/hopper-download-probe-20261015
codex/windows-runtime-creation-red-green-20261015
codex/windows-readonly-root-red-green-20261015
codex/windows-root-share-red-green-20261015
codex/exp-1685-win-mcp-startup
codex/bug-sweep-20261015
investigate/2190-windows-package-phases
investigate/3543-macos-cli-deadline
perf/3281-reverse-tools-feedback-quality
fix/3406-hopper-doctor-fixture
fix/3341-wrapper-require-test-context
fix/3301-owned-uninstall-fixtures
fix/3164-compiler-input-ownership
fix/pcap-cleanup-stdout-newline-20261014
perf/interface-builder-summary
codex/review-fixes-pr-1977
fix/ghidra-effective-jvm-platform
fix/docs-turkish-rust-link-20261013
fix/main-maintenance-ci-20261010
fix/recover-binary-session-process-effects
codex/review-fixes-pr-2457
codex/ci-required-cancellation-gate
fix/main-format-baseline-20261013
fix/setup-preserve-entry-fields
cursor/restore-main-checks-1ffc
fix/ghidra-bridge-hashmap-import
codex/shared-ci-jadx-json-default-20261013
codex/shared-ci-ghidra-test-groups-20261013
codex/shared-ci-java-fixture-format-20261013
codex/fix-intrinsic-invocation-boundaries
test/release-preflight-reusable-jobs
test/js-parameter-provenance-expectation
fix/linux-hopper-verification-current
test/2419-ghidra-elf-probe-size
followup/pr-1544-native-ida
codex/fold-pr-2230-contribution
docs/readme-responsible-use
fix/issue-2064
fix/issue-2050
fix/issue-2053
fix/issue-1968
fix/issue-1945
experiment/codemode-bridge-20261011
fix/tool-effects-negative-wording-1904-20261012
fix/1842-electron-interop-provenance
feat/recover-javascript-multi-input
refactor/website-i18n-prep
fix/nativeaot-pe-virtual-extent
fix/browser-verifier-ci-hang
fix/pe-resources-input-selection
docs/beginner-friendly-guides
docs/beginner-setup-guide
fix/javascript-analysis-worker-1563
fix/1649-ghidra-duplicate-names
fix/javascript-export-keys-integration-1369
test/maintenance-boundary-contracts-20261011
review/javascript-export-keys-1369
review/process-live-progress-1483
test/javascript-1495-growth-ratio
fix/ci-escape-timing
docs/normalized-terminal-geometry-1450
release/6.3.0
archive/release-6.3.0-pr1381
release/6.2.0
fix/electron-preload-dynamic-override
fix/javascript-self-referential-bundler-edges
release/6.1.0
cursor/grok-client-cherry-pick-0b56
feat/signature-posture
feat/dyld-shared-cache
feat/artifact-integrity-policy
feat/pkg-inventory
release/6.0.0
chore/sync-release-5.0.0
release/5.0.0
cursor/cloud-agent-node-787e
fix/javascript-xhr-open-endpoints
review/pr-711-realpath-fallback-wording
cleanup/replay-confinement
codex/test-suite-performance
codex/issue-foundations
codex/address-open-issues-2026-07-20
agent/javascript-vite-rollup-esbuild-adapters
agent/process-cleanup
agent/triage-integration
agent/unknown-commands-registry
feat/mcp-identity-metadata
morlvps/issue_cleanup
codex/installer-redesign
morl/roadmap-investigation-core
morl/roadmap-investigation-docs
release-please--branches--main--components--rea
rea-agents-6.8.0
rea-agents-6.7.0
rea-agents-6.6.0
experiment/atomic-codemode-wait-runtime-20261016
rea-agents-6.5.0
rea-agents-6.4.0
rea-agents-6.3.0
rea-agents-6.2.0
rea-agents-6.1.0
rea-agents-6.0.0
rea-agents-5.0.0
rea-agents-4.1.0
rea-agents-4.0.1
rea-agents-4.0.0
rea-agents-3.2.1
rea-agents-3.2.0
rea-agents-3.1.0
rea-agents-3.0.0
rea-agents-2.7.0
rea-agents-2.6.0
rea-agents-2.5.1
rea-agents-2.5.0
rea-agents-2.4.0
rea-agents-2.3.0
rea-agents-2.2.0
rea-agents-2.1.0
rea-agents-2.0.0
rea-agents-1.7.0
rea-agents-1.6.0
rea-agents-1.5.0
rea-agents-1.4.0
rea-agents-1.3.0
rea-agents-1.2.0
rea-agents-1.1.0
rea-agents-1.0.0
rea-agents-0.5.0
rea-agents-0.4.0
rea-agents-0.3.0
rea-0.2.1
rea-0.2.0
Labels
Clear labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
Mirrored from GitHub Pull Request
question
roadmap
triage
No labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
question
roadmap
triage
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set.
Reference
morluto/rea#1132
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @coygeek on GitHub (Oct 14, 2026).
Original GitHub issue: https://github.com/morluto/rea/issues/3195
Before submitting
Area
Evidence, artifacts, or reconstruction
Observed behavior
Valid inline
analyze_functionEvidence with complete relationship coverage and a provider diagnostic loses that diagnostic when passed tocompare_functions. A subsequentverify_reconstructionclaim selecting thecallsdimension also omits it. In the reproduced synthetic-input case, the comparison reportscalls.status: unchangedwith zero left and right counts and empty dimension limitations. Its normalized-result limitations are empty, and the full MCP response contains no supplied diagnostic. Verification returnspasswithobserved_status: unchanged, also without the diagnostic.These statuses can remain correct for the complete provider-observed set. The defect is the omitted caveat about the scope of that set. The canonical comparison Evidence and verification claim retain the unrelated artifact-identity notice, so their limitation arrays are not entirely empty.
The controls show that partial coverage retains the diagnostic and read-limit reason and produces
unknownin both tools. Complete coverage without a diagnostic producesunchangedandpass. A separate dossier caveat survives comparison and verification while the complete-coverage diagnostic still disappears.get_evidence_bundleretains the original source diagnostic on the same MCP connection.Reproduction
58300885207133422af235e0f2b10658cf958b03. Install the locked dependencies and build the runtime. The verifier used an already prepared baseline and did not rerun these preparation commands. Use an isolated home for the reproduction.Expected behavior
docs/tool-design.md:60-64defines complete relationship coverage as the provider-observed direct relationship set returned without a known read limit. It requires provider and execution caveats to stay in limitations without implying incomplete relationship coverage.docs/mcp-contracts.md:19-21supports inlineanalyze_functionEvidence as comparison input, anddocs/mcp-contracts.md:56-65defines comparison coverage semantics.src/domain/relationshipCoverage.ts:3-7permits diagnostics on complete coverage.The calls comparison and downstream calls claim should retain the supplied diagnostic while preserving the complete observed-set conclusion. A diagnostic alone should not make otherwise equal complete call sets
unknown.Impact and scope
The supported inline-Evidence workflow loses a provider caveat in two derived results. This affects interpretation of the observed call-set scope. The independent verifier rated it P2 because the loss is consequential but bounded, with a demonstrated workaround. Inspect the retained source Evidence's
relationship_coverage.diagnostics, available throughget_evidence_bundle, when interpreting the derived result.No source-data loss, crash, or security boundary crossing was observed. Ghidra engine execution was not performed. Static source inspection establishes provider applicability, but real Ghidra dossiers also carry separate unresolved-flow and classification caveats. This report does not establish that real Ghidra comparisons lose every warning about indirect calls. The dossier-caveat control demonstrates that independent caveats survive.
REA version
6.4.0 (main at
5830088520)Runtime and platform
Node 26.10.0; macOS 27.0 arm64
Target and artifact context
Synthetic canonical
analyze_functionEvidence, with synthetic Mach-O artifact paths and digests and an explicitly synthetic provider identity. All input records are created inline. Each dossier declares its empty caller and callee sets available. No executable artifact is opened, no target is executed, and no Ghidra installation is required.Interface
MCP
Earliest failure stage
Native analysis or reconstruction
Relevant output or evidence
The first line is the complete-diagnostic case. The supplied diagnostic is
Only resolved Ghidra call references are returned; unresolved computed or indirect calls remain unknown, while function classifications distinguish thunks and externals.The last line confirms source retention after the comparison and verification controls.Typed outcome or recovery expected
The comparison's calls limitations and the downstream calls claim must carry the supplied diagnostic. Equal complete observed call sets should remain
unchanged, and verification should retain its complete-set conclusion with that caveat. Partial coverage must remainunknownwith its read-limit reasons and diagnostics. Complete coverage without diagnostics must not gain a fabricated caveat. The dossier-caveat control must retain both the independent caveat and the coverage diagnostic. Original source Evidence must remain accessible.Analysis or suspected cause
Source-derived at the reported baseline:
src/server/registerFunctionComparisonTool.ts:38-75validates inline Evidence and reaches comparison.src/domain/functionDossierEvidence.ts:25-28computes call limitations throughsrc/domain/functionCallCoverage.ts:82-92. The conditional at line 88 excludes diagnostics whenever coverage is complete.src/domain/functionComparisonDimensions.ts:328-365consumes that result when comparing calls.src/domain/reconstructionVerification.ts:219-222independently rereads retained source coverage through the same helper, so source retention does not restore the diagnostic in verification.Source-derived repair constraint:
src/domain/functionComparisonDimensions.ts:335-346treats every call-coverage limitation as an equality blocker. Simply removing the helper's conditional would therefore turn a complete observed-set comparison intounknown, contrary to the documented distinction between caveats and incomplete coverage. Diagnostic preservation must respect that distinction.Source-derived Ghidra applicability, without engine execution:
bridge/ghidra/ReaGhidraBridge.java:1539-1654emits dossier call coverage, andbridge/ghidra/ReaGhidraBridge.java:3373-3416supplies the diagnostic on complete coverage.src/ghidra/GhidraFunctionValues.ts:445-486preserves the declared field, andsrc/ghidra/GhidraProviderClient.ts:853-861andsrc/ghidra/GhidraProviderClient.ts:952-959carry it into provider execution. Separate dossier caveats are supplied atbridge/ghidra/ReaGhidraBridge.java:1610-1622.Additional context
Related reports #2222, #2951, #2980, #2326, and #1964 address incomplete-coverage verdicts, missing producer declarations, primitive warning generation, or graph/path caveat classification; this report requires retaining an already supplied complete-coverage diagnostic in comparison and verification while preserving valid observed-set equality.
@morluto commented on GitHub (Oct 14, 2026):
Delivered on main in fffb07419.
One limitation list mixed descriptive diagnostics with equality blockers and dropped complete-coverage diagnostics. Their owner now separates those facts; comparisons block only on actual uncertainty while Evidence retains diagnostics on every result path.
Validation: Function comparison and reconstruction regressions, including complete equality with diagnostics and unresolved function paths. Real Ghidra execution was not performed. Full exact-revision qualification passed.