mirror of
https://github.com/morluto/rea.git
synced 2026-11-05 06:45:22 +00:00
[PR #500] [MERGED] feat(native): add inspection primitives, dispatch traces and approved UI observation #2028
Closed
opened 2026-10-16 21:13:30 +00:00 by bsakaguchi
·
0 comments
No Branch/Tag specified
main
codex/procedure-reference-stacked
release-please--branches--main--components--rea-agents
release-please--branches--main--components--rea-agents--release-notes
codex/kuna-independent-retry
codex/byte-search-overlay-coverage
codex/open-failure-target-receipt
codex/kuna-xref-evidence
codex/ghidra-ambiguous-procedure-recovery
codex/function-source-bundle
codex/trace-function-integration-prototype
codex/snapshot-source-closure
codex/recorded-evidence-array-pages
codex/evidence-recovery-redesign
codex/trace-feature-address-scope
codex/call-discovery-scope
codex/ghidra-literal-candidate-evidence
codex/decompile-directory-independent-retry
codex/retry-provenance-base
codex/value-flow-capability-experiment
codex/ghidra-containing-instruction
cursor/readme-discord-button-ef9f
dependabot/github_actions/actions/setup-node-7.1.0
dependabot/github_actions/actions/upload-artifact-7.0.2
dependabot/npm_and_yarn/npm-minor-and-patch-d8d97ce6df
codex/kuna-1989
fix/8559-native-ui-fixture-ownership
fix/8555-go-verifier-mcp-ownership
codex/provider-capability-recovery
fix/8642-rizin-target-stdin
codex/ghidra-memory-effect-scope
codex/ghidra-annotation-entry-selector
codex/ghidra-readonly-recovery
codex/ghidra-regex-verifier-recovery
codex/evidence-discovery-view-guidance
fix/8545-bulk-append-overflow
fix/8428-navigation-refusal-alternatives
codex/address-context-recovery
codex/matching-member-limitations
codex/unknown-scope-contract
codex/evidence-view-guidance
feat/8373-native-trace-views
codex/ghidra-snapshot-verifier-binding
codex/elf-export-visibility
codex/evidence-view-recovery
codex/native-reference-cli-help
codex/provider-candidate-observation-scope
codex/kuna-session-verification
codex/ghidra-switch-lifetime-guidance
codex/pseudocode-paging-discovery
codex/clarify-evidence-view-support
codex/kuna-xrefs-selector-recovery
codex/context-capacity-recovery
codex/evidence-closure-large-links
codex/same-function-evidence-identity
codex/ghidra-verifier-inspected-jdk
codex/audit-guided-workflows
codex/crash-prompt-retained-dossiers
codex/analysis-view-error-recovery
codex/kuna-verifier-target-selection
codex/ghidra-selected-project-call-coverage
codex/docs-native-analysis-scope
codex/ghidra-java-socket-boundary
codex/ghidra-retained-snapshot-verifier
codex/ghidra-search-inventory-facts
fix/8284-zero-argument-parameter-bindings
fix/8198-ui-action-handler-offset
fix/8257-elf-entry-label-identity
fix/8304-deferred-output-schema-projection
fix/8277-call-path-computed-target-uncertainty
fix/pr-8089-conflicts
fix/ci-static-duplicate-export
dependabot/npm_and_yarn/lint-staged-17.6.0
dependabot/github_actions/actions/download-artifact-8.0.2
dependabot/npm_and_yarn/write-file-atomic-8.0.0
dependabot/npm_and_yarn/canonicalize-5.1.0
dependabot/github_actions/actions/cache/restore-6.1.0
dependabot/npm_and_yarn/toon-format/toon-4.4.0
dependabot/github_actions/actions/deploy-pages-5.0.1
codex/review-fixes-pr-2403
codex/review-fixes-pr-2400
codex/process-terminal-width
codex/test-brittleness-cleanup
verify/7167-browser-connect-macos
fix/7167-browser-connect
feat/native-matching-allowance-setting
feat/browser-scenario-dry-run
test/managed-caller-parameters-20261024
codex/parser-fortythird-boundaries
fix/6926-pinvoke-platform-decorations-20261023
fix/6889-har-body-encoding-20261023
fix/6888-sqlite-schema-budget-20261023
fix/dependency-security-gates-6708
cursor/evidence-overwrite-rebase-b4ac
feat/4057-verify-native-exports
fix/windows-acl-observer-overhead-20261022
cursor/erlang-beam-restack-4476
cursor/pe-certificate-review-bf32
fix/6116-javascript-application-fs-errors
fix/6061-unmapped-runtime-script-unknown
feat/browser-scenario-summary
fix/pe-certificates
codex/verify-3407
cursor/rebase-5699
cursor/rebase-5352
cursor/rebase-5600
cursor/fix-cli-schema-omission-10a8
codex/audit-hopper-shutdown-reasons-20261021
fix/demangle-swift-omitted-record
fix/nib-boolean-value-types
cursor/cancellation-partial-observation-a5ac
fix/ib-object-limit-reasons
fix/electron-fuse-limit-advice
fix/kuna-doctor-dangling-cache
fix/fixed-budget-refusal-advice
fix/js-ipc-listener-dedup
fix/js-return-member-provenance
fix/dmg-integrity-retry-advice
fix/ida-doctor-readiness
fix/kuna-version-probe-output-drain
fix/legacy-swift-runtime-name-matching
fix/dylib-lazy-load-commands
fix/browser-scenario-startup-cancel
fix/swift-nested-punycode-classification
fix/compare-unselected-scopes
fix/objc-method-budget-coverage
fix/dmg-mounted-root-observations
audit/ci-tests-20261019-round2
release/6.7.0
fix/wabt-cleanup-retry-resolution
fix/electron-fuse-elf-pe-architecture
fix/native-plist-descriptor-ownership
fix/kuna-caller-cleanup-ownership
experiment/atomic-codemode-20261016
review/first-contributor-3776
fix/call-resolution-full-read-cycles
fix/member-mutation-selection-repeat
experiment/atomic-re-tools-20261015
perf/member-mutation-lazy-origins
perf/static-network-mutation-index
fix/hopper-startup-lifecycle
audit/3050-windows-proof-20261015
feat/windows-window-capture-2183
audit/3049-windows-proof-20261015
audit/3735-macos-fixtures-20261015
fix/batch-decompile-null-pseudocode
fix/kuna-inventory-honors-jobs
experiment/browser-codemode-tool-design-20261015
fix/hopper-clean-runtime-argv
codex/review-2049-27f1b367
review-fixes/pr-2787-routing
fix/3360-scoped-this-emitters
fix/3367-replaced-global-effects
fix/3838-compact-any-value-items
test/hopper-download-probe-20261015
codex/windows-runtime-creation-red-green-20261015
codex/windows-readonly-root-red-green-20261015
codex/windows-root-share-red-green-20261015
codex/exp-1685-win-mcp-startup
codex/bug-sweep-20261015
investigate/2190-windows-package-phases
investigate/3543-macos-cli-deadline
perf/3281-reverse-tools-feedback-quality
fix/3406-hopper-doctor-fixture
fix/3341-wrapper-require-test-context
fix/3301-owned-uninstall-fixtures
fix/3164-compiler-input-ownership
fix/pcap-cleanup-stdout-newline-20261014
perf/interface-builder-summary
codex/review-fixes-pr-1977
fix/ghidra-effective-jvm-platform
fix/docs-turkish-rust-link-20261013
fix/main-maintenance-ci-20261010
fix/recover-binary-session-process-effects
codex/review-fixes-pr-2457
codex/ci-required-cancellation-gate
fix/main-format-baseline-20261013
fix/setup-preserve-entry-fields
cursor/restore-main-checks-1ffc
fix/ghidra-bridge-hashmap-import
codex/shared-ci-jadx-json-default-20261013
codex/shared-ci-ghidra-test-groups-20261013
codex/shared-ci-java-fixture-format-20261013
codex/fix-intrinsic-invocation-boundaries
test/release-preflight-reusable-jobs
test/js-parameter-provenance-expectation
fix/linux-hopper-verification-current
test/2419-ghidra-elf-probe-size
followup/pr-1544-native-ida
codex/fold-pr-2230-contribution
docs/readme-responsible-use
fix/issue-2064
fix/issue-2050
fix/issue-2053
fix/issue-1968
fix/issue-1945
experiment/codemode-bridge-20261011
fix/tool-effects-negative-wording-1904-20261012
fix/1842-electron-interop-provenance
feat/recover-javascript-multi-input
refactor/website-i18n-prep
fix/nativeaot-pe-virtual-extent
fix/browser-verifier-ci-hang
fix/pe-resources-input-selection
docs/beginner-friendly-guides
docs/beginner-setup-guide
fix/javascript-analysis-worker-1563
fix/1649-ghidra-duplicate-names
fix/javascript-export-keys-integration-1369
test/maintenance-boundary-contracts-20261011
review/javascript-export-keys-1369
review/process-live-progress-1483
test/javascript-1495-growth-ratio
fix/ci-escape-timing
docs/normalized-terminal-geometry-1450
release/6.3.0
archive/release-6.3.0-pr1381
release/6.2.0
fix/electron-preload-dynamic-override
fix/javascript-self-referential-bundler-edges
release/6.1.0
cursor/grok-client-cherry-pick-0b56
feat/signature-posture
feat/dyld-shared-cache
feat/artifact-integrity-policy
feat/pkg-inventory
release/6.0.0
chore/sync-release-5.0.0
release/5.0.0
cursor/cloud-agent-node-787e
fix/javascript-xhr-open-endpoints
review/pr-711-realpath-fallback-wording
cleanup/replay-confinement
codex/test-suite-performance
codex/issue-foundations
codex/address-open-issues-2026-07-20
agent/javascript-vite-rollup-esbuild-adapters
agent/process-cleanup
agent/triage-integration
agent/unknown-commands-registry
feat/mcp-identity-metadata
morlvps/issue_cleanup
codex/installer-redesign
morl/roadmap-investigation-core
morl/roadmap-investigation-docs
release-please--branches--main--components--rea
rea-agents-6.8.0
rea-agents-6.7.0
rea-agents-6.6.0
experiment/atomic-codemode-wait-runtime-20261016
rea-agents-6.5.0
rea-agents-6.4.0
rea-agents-6.3.0
rea-agents-6.2.0
rea-agents-6.1.0
rea-agents-6.0.0
rea-agents-5.0.0
rea-agents-4.1.0
rea-agents-4.0.1
rea-agents-4.0.0
rea-agents-3.2.1
rea-agents-3.2.0
rea-agents-3.1.0
rea-agents-3.0.0
rea-agents-2.7.0
rea-agents-2.6.0
rea-agents-2.5.1
rea-agents-2.5.0
rea-agents-2.4.0
rea-agents-2.3.0
rea-agents-2.2.0
rea-agents-2.1.0
rea-agents-2.0.0
rea-agents-1.7.0
rea-agents-1.6.0
rea-agents-1.5.0
rea-agents-1.4.0
rea-agents-1.3.0
rea-agents-1.2.0
rea-agents-1.1.0
rea-agents-1.0.0
rea-agents-0.5.0
rea-agents-0.4.0
rea-agents-0.3.0
rea-0.2.1
rea-0.2.0
Labels
Clear labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
Mirrored from GitHub Pull Request
question
roadmap
triage
No labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
question
roadmap
triage
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set.
Reference
morluto/rea#2028
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
📋 Pull Request Information
Original PR: https://github.com/morluto/rea/pull/500
Author: @morluto
Created: 10/4/2026
Status: ✅ Merged
Merged: 10/4/2026
Merged by: @morluto
Base:
main← Head:codex/native-investigation-tools📝 Commits (8)
d649138fix(hopper): normalize string-backed addresses and update verificationbbb1dcbfeat(native): add inspection primitives, dispatch traces and approved UI observationdb984d1test: prioritize real artifact E2E and captured golden regressionscf240a4fix(process): queue observed output before reactive rendering actions4cfce90test: prune redundant cases and strengthen boundary assertionsccf10ebfix(cli): route native value tracing through shared workflows7606863test: replace synthetic success with real workflows and captured data80048dffix(catalog): separate portable metadata from native host availability📊 Changes
205 files changed (+8145 additions, -1825 deletions)
View changed files
📝
.github/workflows/ci.yml(+19 -1)📝
AGENTS.md(+1 -1)📝
README.md(+13 -11)📝
README_ar.md(+4 -4)📝
README_ja.md(+4 -4)📝
README_ko.md(+4 -4)📝
README_zh.md(+4 -4)📝
bridge/ghidra/ReaGhidraBridge.java(+310 -42)📝
bridge/hopper_bridge.py(+5 -0)➕
bridge/native/ReaNativeUI.swift(+156 -0)📝
docs/native-investigation.md(+144 -76)📝
docs/product-catalog.json(+39 -16)📝
docs/provider-evaluation.md(+17 -18)➕
docs/test-suite-audit.md(+169 -0)📝
docs/testing.md(+69 -9)📝
docs/verification/managed-conformance-manifest.json(+2 -2)📝
package.json(+7 -1)📝
scripts/fixtures/browser-verifier-site.mjs(+15 -0)📝
scripts/generate-mcp-tool-catalog.mjs(+1 -1)➕
scripts/lib/artifact-e2e.mjs(+64 -0)...and 80 more files
📄 Description
Summary
Add native investigation primitives and shared CLI/MCP workflows for the requested issue set. Previously, analysts had to join provider text, symbol inventories, serialized Apple resources and runtime UI evidence themselves. REA now exposes explicit object and relationship results with artifact identity, source locations, evidence references and coverage limits.
The changes are split into two commits: a Hopper address normalization fix with updated real-provider assertions, and the native investigation implementation with its contracts, fixtures, verification lanes and generated catalog.
Issue coverage
Refs #497, #496, #495, #492, #491, #490, #487, #484, #483, #482, #481.
Contracts and behavior
inspect_asset_catalog,inspect_keyed_archive,inspect_native_instruction,resolve_native_call_targets,inspect_native_data_type,trace_native_values,observe_native_uiandcapture_native_ui_scenario, with matching CLI commands and canonical output/effect contracts.MCP examples
After opening a supported target, callers can inspect an explicit location or seed a bounded trace:
For an already-running application matching the active target, replace the illustrative PID/window IDs with the approved selected window:
Verification
Completed locally on macOS ARM64:
npm run check:pr— latest expanded audit: 352 test files; 1,797 tests passed, 2 skipped. Typecheck, lint, format, unused-code and generated documentation checks passed. Latestcheck:fastreports 68 warnings and zero errors.npm run verify:package— packaged CLI, MCP, setup and lifecycle verification passed; complete catalog contains 122 tools.node scripts/verify-real-ghidra.mjswith configured Ghidra 12.1.4/JDK 21 — real host Mach-O debug/stripped and DWARF type-layout fixtures, exact instruction/call/type facts, value bindings and cleanup passed.node scripts/verify-real-ghidra.mjs --aarch64-jump-tablewith the same prerequisites — eight fixture variants passed, including byte/halfword relative tables in ELF and Mach-O and an optimized dense ELF switch.node scripts/verify-apple-dispatch.mjs— source-built Objective-C and Swift metadata fixtures, including stripped local symbols, passed without executing targets.node scripts/verify-keyed-archive.mjs— real Foundation binary archive writer, shared/cyclic references and inert reader passed.node scripts/verify-native-ui.mjs— selected fixture-window screenshot/accessibility observation, approved button action, actual CLI scenario parity, digest mismatch rejection and fixture cleanup passed.npx vitest run tests/boundary/mcp/enhancedTools.01-lists-the-complete-target-open.test.ts— enhanced registration/transport regression passed after the final test update.git diff --checkpassed; commit hooks completed successfully.Coverage limits
These implementations establish the supported static and runtime boundaries; broader facets remain explicit unknowns. Call targets are static candidates, and value graphs do not prove runtime reachability, complete alias behavior, persistent-state roles or RNG semantics. The AArch64 recovery supports validated guarded layouts. Apple metadata decoding does not claim complete chained-fixup/PAC, external binding, generic/resilient Swift or async dispatch coverage. Asset inspection returns metadata rather than rendition bytes. Native scenarios require macOS permissions and leave state as-is; an action can occur before a subsequent capture fails.
Real macOS Ghidra proof was performed on ARM64. macOS Intel and Windows were not verified on real hosts in this session. This PR does not claim to resolve Hopper's long-running script overlay or sequential GUI-window reuse issues (#494 and #479).
Test audit follow-up
Commit
db984d1dapplies the requested preference for full unmocked E2E, boundary integration and real-data goldens. Detailed decisions and remaining coverage gaps are indocs/test-suite-audit.md.positive_e2e: falsewhen permission denial prevents capture.Initial audit verification:
npm run check:prpassed (355 files; 1,828 passed, 2 skipped);check:fast,npm run verify:packageand the relocated verifier tests passed. Real artifact CLI/stdio MCP E2E, Apple dispatch, compiled nib and required native UI capture/action lanes all passed. Lint remains at 68 warnings and zero errors. No Hopper windows were opened during this audit.Real dispatch/UI-handler workflow transport goldens, native UI stdio MCP scenarios and approved real-runner CI remain follow-up coverage. Native value tracing now has real CLI/stdio MCP parity coverage. The audit does not claim that all recording-provider application tests have been replaced.
Exhaustive test cleanup
Reviewed all 355 test files across domain/contracts, services/composition, adapters/process boundaries and public transports/conformance. Three passes checked deletions against existing coverage and then checked the final diff for lost claims. This follow-up reduces the suite by another 31 test declarations and removes three redundant files; the remaining suite has 352 files. No further immediately safe pruning was identified without new independent replacement coverage or retiring source behavior.
Verification after the expanded audit:
npm run check:prpassed (352 files, 1,797 passed, 2 skipped);npm run check:fastpassed (68 lint warnings, zero errors). Repeated realverify:browser,verify:asset-catalog,verify:keyed-archiveandverify:fixturesall passed, including actual browser scenario lifecycle, production CLI/stdio MCP artifact routes and seven source-built host fixtures. No new Hopper windows or Ghidra runs were started. The initial test run collided with verifier rebuilds; the final gate ran without concurrent builds and passed after fixing the independent rendering race.Stronger replacement tests and closing audit
Final verification:
npm run check:prpassed (351 files, 1,794 passed, 2 skipped); typecheck, lint, formatting, unused-code and generated-document checks passed (70 lint warnings, zero errors). Real macOS ARM64 Ghidra 12.1.4/JDK 21 verification passed, including 171 graph nodes, 298 edges and six decompilations through CLI/stdio MCP. Real Chrome 153 observation/scenario verification and the large PNG capture passed. No Hopper windows were opened. No new hosted CI result is claimed.CI catalog portability fix
Fix the Linux Docs Generation failure caused by host-dependent asset catalog metadata. The generator now supplies its canonical platform to ArtifactProvider; runtime lazy discovery applies actual native host restrictions separately. Strengthen the existing real archive/SDK MCP integration to use production session composition and verify actual host availability. No generated catalog bytes or check expectations were weakened.
Verification: local
npm run docs:check,npm run check:pr(351 files, 1,794 passed, 2 skipped) and the MCP integration passed. GitHub verification is running for commit80048dfa.🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.