mirror of
https://github.com/morluto/rea.git
synced 2026-11-05 07:47:29 +00:00
[GH-ISSUE #1783] [Bug] Ghidra provider times out on a 1.85 MB Swift/ObjC arm64 Mach-O: auto-analysis stalls in ObjcMessageAnalyzer and cannot be skipped #603
Closed
opened 2026-10-15 18:26:32 +00:00 by bsakaguchi
·
5 comments
No Branch/Tag specified
main
release-please--branches--main--components--rea-agents
release-please--branches--main--components--rea-agents--release-notes
codex/procedure-reference-stacked
codex/kuna-independent-retry
codex/byte-search-overlay-coverage
codex/open-failure-target-receipt
codex/kuna-xref-evidence
codex/ghidra-ambiguous-procedure-recovery
codex/function-source-bundle
codex/trace-function-integration-prototype
codex/snapshot-source-closure
codex/recorded-evidence-array-pages
codex/evidence-recovery-redesign
codex/trace-feature-address-scope
codex/call-discovery-scope
codex/ghidra-literal-candidate-evidence
codex/decompile-directory-independent-retry
codex/retry-provenance-base
codex/value-flow-capability-experiment
codex/ghidra-containing-instruction
cursor/readme-discord-button-ef9f
dependabot/github_actions/actions/setup-node-7.1.0
dependabot/github_actions/actions/upload-artifact-7.0.2
dependabot/npm_and_yarn/npm-minor-and-patch-d8d97ce6df
codex/kuna-1989
fix/8559-native-ui-fixture-ownership
fix/8555-go-verifier-mcp-ownership
codex/provider-capability-recovery
fix/8642-rizin-target-stdin
codex/ghidra-memory-effect-scope
codex/ghidra-annotation-entry-selector
codex/ghidra-readonly-recovery
codex/ghidra-regex-verifier-recovery
codex/evidence-discovery-view-guidance
fix/8545-bulk-append-overflow
fix/8428-navigation-refusal-alternatives
codex/address-context-recovery
codex/matching-member-limitations
codex/unknown-scope-contract
codex/evidence-view-guidance
feat/8373-native-trace-views
codex/ghidra-snapshot-verifier-binding
codex/elf-export-visibility
codex/evidence-view-recovery
codex/native-reference-cli-help
codex/provider-candidate-observation-scope
codex/kuna-session-verification
codex/ghidra-switch-lifetime-guidance
codex/pseudocode-paging-discovery
codex/clarify-evidence-view-support
codex/kuna-xrefs-selector-recovery
codex/context-capacity-recovery
codex/evidence-closure-large-links
codex/same-function-evidence-identity
codex/ghidra-verifier-inspected-jdk
codex/audit-guided-workflows
codex/crash-prompt-retained-dossiers
codex/analysis-view-error-recovery
codex/kuna-verifier-target-selection
codex/ghidra-selected-project-call-coverage
codex/docs-native-analysis-scope
codex/ghidra-java-socket-boundary
codex/ghidra-retained-snapshot-verifier
codex/ghidra-search-inventory-facts
fix/8284-zero-argument-parameter-bindings
fix/8198-ui-action-handler-offset
fix/8257-elf-entry-label-identity
fix/8304-deferred-output-schema-projection
fix/8277-call-path-computed-target-uncertainty
fix/pr-8089-conflicts
fix/ci-static-duplicate-export
dependabot/npm_and_yarn/lint-staged-17.6.0
dependabot/github_actions/actions/download-artifact-8.0.2
dependabot/npm_and_yarn/write-file-atomic-8.0.0
dependabot/npm_and_yarn/canonicalize-5.1.0
dependabot/github_actions/actions/cache/restore-6.1.0
dependabot/npm_and_yarn/toon-format/toon-4.4.0
dependabot/github_actions/actions/deploy-pages-5.0.1
codex/review-fixes-pr-2403
codex/review-fixes-pr-2400
codex/process-terminal-width
codex/test-brittleness-cleanup
verify/7167-browser-connect-macos
fix/7167-browser-connect
feat/native-matching-allowance-setting
feat/browser-scenario-dry-run
test/managed-caller-parameters-20261024
codex/parser-fortythird-boundaries
fix/6926-pinvoke-platform-decorations-20261023
fix/6889-har-body-encoding-20261023
fix/6888-sqlite-schema-budget-20261023
fix/dependency-security-gates-6708
cursor/evidence-overwrite-rebase-b4ac
feat/4057-verify-native-exports
fix/windows-acl-observer-overhead-20261022
cursor/erlang-beam-restack-4476
cursor/pe-certificate-review-bf32
fix/6116-javascript-application-fs-errors
fix/6061-unmapped-runtime-script-unknown
feat/browser-scenario-summary
fix/pe-certificates
codex/verify-3407
cursor/rebase-5699
cursor/rebase-5352
cursor/rebase-5600
cursor/fix-cli-schema-omission-10a8
codex/audit-hopper-shutdown-reasons-20261021
fix/demangle-swift-omitted-record
fix/nib-boolean-value-types
cursor/cancellation-partial-observation-a5ac
fix/ib-object-limit-reasons
fix/electron-fuse-limit-advice
fix/kuna-doctor-dangling-cache
fix/fixed-budget-refusal-advice
fix/js-ipc-listener-dedup
fix/js-return-member-provenance
fix/dmg-integrity-retry-advice
fix/ida-doctor-readiness
fix/kuna-version-probe-output-drain
fix/legacy-swift-runtime-name-matching
fix/dylib-lazy-load-commands
fix/browser-scenario-startup-cancel
fix/swift-nested-punycode-classification
fix/compare-unselected-scopes
fix/objc-method-budget-coverage
fix/dmg-mounted-root-observations
audit/ci-tests-20261019-round2
release/6.7.0
fix/wabt-cleanup-retry-resolution
fix/electron-fuse-elf-pe-architecture
fix/native-plist-descriptor-ownership
fix/kuna-caller-cleanup-ownership
experiment/atomic-codemode-20261016
review/first-contributor-3776
fix/call-resolution-full-read-cycles
fix/member-mutation-selection-repeat
experiment/atomic-re-tools-20261015
perf/member-mutation-lazy-origins
perf/static-network-mutation-index
fix/hopper-startup-lifecycle
audit/3050-windows-proof-20261015
feat/windows-window-capture-2183
audit/3049-windows-proof-20261015
audit/3735-macos-fixtures-20261015
fix/batch-decompile-null-pseudocode
fix/kuna-inventory-honors-jobs
experiment/browser-codemode-tool-design-20261015
fix/hopper-clean-runtime-argv
codex/review-2049-27f1b367
review-fixes/pr-2787-routing
fix/3360-scoped-this-emitters
fix/3367-replaced-global-effects
fix/3838-compact-any-value-items
test/hopper-download-probe-20261015
codex/windows-runtime-creation-red-green-20261015
codex/windows-readonly-root-red-green-20261015
codex/windows-root-share-red-green-20261015
codex/exp-1685-win-mcp-startup
codex/bug-sweep-20261015
investigate/2190-windows-package-phases
investigate/3543-macos-cli-deadline
perf/3281-reverse-tools-feedback-quality
fix/3406-hopper-doctor-fixture
fix/3341-wrapper-require-test-context
fix/3301-owned-uninstall-fixtures
fix/3164-compiler-input-ownership
fix/pcap-cleanup-stdout-newline-20261014
perf/interface-builder-summary
codex/review-fixes-pr-1977
fix/ghidra-effective-jvm-platform
fix/docs-turkish-rust-link-20261013
fix/main-maintenance-ci-20261010
fix/recover-binary-session-process-effects
codex/review-fixes-pr-2457
codex/ci-required-cancellation-gate
fix/main-format-baseline-20261013
fix/setup-preserve-entry-fields
cursor/restore-main-checks-1ffc
fix/ghidra-bridge-hashmap-import
codex/shared-ci-jadx-json-default-20261013
codex/shared-ci-ghidra-test-groups-20261013
codex/shared-ci-java-fixture-format-20261013
codex/fix-intrinsic-invocation-boundaries
test/release-preflight-reusable-jobs
test/js-parameter-provenance-expectation
fix/linux-hopper-verification-current
test/2419-ghidra-elf-probe-size
followup/pr-1544-native-ida
codex/fold-pr-2230-contribution
docs/readme-responsible-use
fix/issue-2064
fix/issue-2050
fix/issue-2053
fix/issue-1968
fix/issue-1945
experiment/codemode-bridge-20261011
fix/tool-effects-negative-wording-1904-20261012
fix/1842-electron-interop-provenance
feat/recover-javascript-multi-input
refactor/website-i18n-prep
fix/nativeaot-pe-virtual-extent
fix/browser-verifier-ci-hang
fix/pe-resources-input-selection
docs/beginner-friendly-guides
docs/beginner-setup-guide
fix/javascript-analysis-worker-1563
fix/1649-ghidra-duplicate-names
fix/javascript-export-keys-integration-1369
test/maintenance-boundary-contracts-20261011
review/javascript-export-keys-1369
review/process-live-progress-1483
test/javascript-1495-growth-ratio
fix/ci-escape-timing
docs/normalized-terminal-geometry-1450
release/6.3.0
archive/release-6.3.0-pr1381
release/6.2.0
fix/electron-preload-dynamic-override
fix/javascript-self-referential-bundler-edges
release/6.1.0
cursor/grok-client-cherry-pick-0b56
feat/signature-posture
feat/dyld-shared-cache
feat/artifact-integrity-policy
feat/pkg-inventory
release/6.0.0
chore/sync-release-5.0.0
release/5.0.0
cursor/cloud-agent-node-787e
fix/javascript-xhr-open-endpoints
review/pr-711-realpath-fallback-wording
cleanup/replay-confinement
codex/test-suite-performance
codex/issue-foundations
codex/address-open-issues-2026-07-20
agent/javascript-vite-rollup-esbuild-adapters
agent/process-cleanup
agent/triage-integration
agent/unknown-commands-registry
feat/mcp-identity-metadata
morlvps/issue_cleanup
codex/installer-redesign
morl/roadmap-investigation-core
morl/roadmap-investigation-docs
release-please--branches--main--components--rea
rea-agents-6.8.0
rea-agents-6.7.0
rea-agents-6.6.0
experiment/atomic-codemode-wait-runtime-20261016
rea-agents-6.5.0
rea-agents-6.4.0
rea-agents-6.3.0
rea-agents-6.2.0
rea-agents-6.1.0
rea-agents-6.0.0
rea-agents-5.0.0
rea-agents-4.1.0
rea-agents-4.0.1
rea-agents-4.0.0
rea-agents-3.2.1
rea-agents-3.2.0
rea-agents-3.1.0
rea-agents-3.0.0
rea-agents-2.7.0
rea-agents-2.6.0
rea-agents-2.5.1
rea-agents-2.5.0
rea-agents-2.4.0
rea-agents-2.3.0
rea-agents-2.2.0
rea-agents-2.1.0
rea-agents-2.0.0
rea-agents-1.7.0
rea-agents-1.6.0
rea-agents-1.5.0
rea-agents-1.4.0
rea-agents-1.3.0
rea-agents-1.2.0
rea-agents-1.1.0
rea-agents-1.0.0
rea-agents-0.5.0
rea-agents-0.4.0
rea-agents-0.3.0
rea-0.2.1
rea-0.2.0
Labels
Clear labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
Mirrored from GitHub Pull Request
question
roadmap
triage
No labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
question
roadmap
triage
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set.
Reference
morluto/rea#603
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @okz247 on GitHub (Oct 11, 2026).
Original GitHub issue: https://github.com/morluto/rea/issues/1783
Before submitting
Area
Native analysis or decompilation
Observed behavior
With the Ghidra provider, the first query against a 1.85 MB thin arm64 Mach-O (a Swift/Objective-C macOS app executable) never returns. Both
searchattempts ended inprovider_timeout: one at the default 330,000 ms startup deadline and one withREA_GHIDRA_STARTUP_TIMEOUT_MS=2400000(40 minutes).During the 40-minute run, Ghidra's default auto-analysis was stuck in one analyzer. Two thread dumps taken about 2.3 minutes apart show the same single worker thread inside
ghidra.app.plugin.core.analysis.ObjcMessageAnalyzer, recursing throughgetNameForVarnode/getAddressFromVarnode:decompileprocesses had each used between 0.06 s and 11.4 s of CPU in total and were idle.ghidra.loghad no new lines after the first 35 seconds of analysis when checked about 35 minutes in.Two controls with plain
analyzeHeadless, outside REA, on the same file:-analysisTimeoutPerFile 300:Analysis timed out at 300 seconds. Ghidra's own timing table attributes 259.5 s of the 299 s toObjective-C Message Analyzer.Objective-C Message Analyzertofalse:Analysis succeeded,Total Time 76 secs.So the stall reproduces in Ghidra 12.1.4 without REA, and REA's part is that it gives a caller no way around it and no indication of what stalled.
None of REA 6.4.0's Ghidra settings (install directory, startup deadline, import language and compiler spec, seed file, NativeAOT jar) changes analyzer options, and the analysis profile records
analyzer_preset: "ghidra-default", so a caller cannot select that outcome through REA.Reproduction
Install Ghidra 12.1.4 and JDK 21, and set
GHIDRA_INSTALL_DIRandJAVA_HOME.rea doctor --provider ghidra --jsonreports healthy.Take the main executable of coconutBattery 4.4.0 for macOS (
com.coconut-flavour.coconutBattery, universal x86_64 + arm64) and thin it, since Ghidra v1 rejects universal Mach-O:Resulting slice: 1,854,496 bytes, SHA-256
a20f773dbb13d23e782d6771906f8fa83abe5c52b3145c4e77ddb0d44cf120a9.Run any Ghidra-backed query:
Result after about 5.5 minutes:
provider_timeout,timeout_ms: 330000.Repeat with a longer deadline:
Result after 2,402 s:
provider_timeout,timeout_ms: 2400000.Control, outside REA, with default analyzers:
Result:
Analysis timed out at 300 seconds;Objective-C Message Analyzer 259.543 secsin the timing table.Control, outside REA, with only the one analyzer disabled:
where the pre-script body is
setAnalysisOption(currentProgram, "Objective-C Message Analyzer", "false");. Result:Analysis succeeded,Total Time 76 secs.For comparison, a thin arm64e copy of
/bin/lsthrough the same REA + Ghidra installation returns asearchresult in 11 seconds.Expected behavior
A caller can obtain Ghidra-backed results for this target, or at least learn why not. Either of these would do it:
provider_timeout.Impact and scope
searchon this target. I expect every Ghidra-backed operation, through CLI and MCP, to behave the same, since the documentation says operations begin only after default auto-analysis completes, butsearchis the only one I ran. Raising the deadline does not help within 40 minutes. I have not tested longer./bin/lsslice works), and cleanup. After the 40-minute timeout no Ghidra ordecompileprocesses remained and the session's private temp directory was removed; after the 330 s timeout no Ghidra processes remained (I did not check the temp directory that time).REA version
6.4.0 (npm
rea-agents@6.4.0). The source lines cited below are the same at the 6.4.0 release commita56f7bb6and onmainat713db4dc.Runtime and platform
Node 22.22.0; macOS 27.0 (26A428) arm64, Apple M4 Pro (12 cores); Ghidra 12.1.4 (Homebrew formula); OpenJDK 21.0.12.1 (Homebrew
openjdk@21)Target and artifact context
Thin Mach-O 64-bit arm64 executable, 1.85 MB, Swift + Objective-C macOS app (SwiftUI/AppKit), lipo-thinned from a universal binary
Interface
CLI
Earliest failure stage
Native analysis or reconstruction
Relevant output or evidence
Typed outcome or recovery expected
On a startup deadline during auto-analysis, a timeout error whose details identify the stage (import, auto-analysis, bridge readiness) and, where Ghidra exposes it, the active analyzer or the last log line. The current remediation text ("Try a smaller request, then run
rea doctor") does not apply: the request is already minimal and doctor is healthy.Analysis or suspected cause
Observed: one
ObjcMessageAnalyzerworker consumes essentially all CPU for the whole run while every other worker is idle; plainanalyzeHeadlesswith default analyzers stalls in the same analyzer; and disabling that analyzer lets analysis finish in 76 s. The stall itself is therefore Ghidra 12.1.4 behavior, not something REA's launch environment introduces.Also observed: Ghidra's own
-analysisTimeoutPerFilecancelled the stuck analyzer at 300 s and printed per-analyzer timings, which is the diagnostic REA'sprovider_timeoutcurrently lacks.Hypothesis, not verified: the recursive varnode walk in
ObjcMessageAnalyzer.getNameForVarnode/getAddressFromVarnoderevisits the same definitions without memoization on some function in this binary, so its cost grows exponentially. I have not identified the specific function, tested other Ghidra versions, or searched the Ghidra tracker.The
VarnodeContext: out of address spaceserror appears in both the failing run and the successful control, so it is probably unrelated.Source-derived:
src/ghidra/GhidraAnalysisProfile.tssetsanalyzer_preset: "ghidra-default", andsrc/ghidra/GhidraLauncher.tspasses-preScriptonly for DOS COM preparation and seed files, andbridge/ghidra/ReaGhidraPrepareCom.javais the only packaged script that touches analysis options (DOS COM only). I found no caller path to change analyzer options for a Mach-O target.Additional context
The full thread dumps and both Ghidra logs are available if useful. A possible regression fixture would need a redistributable binary that triggers the same analyzer path; I do not have a reduced one.
@akushonkamen commented on GitHub (Oct 11, 2026):
Confirmed on main @
ce845ba4:src/ghidra/GhidraLauncher.ts(ghidraHeadlessArguments, interface at lines 371-386, argv builder at 388-468) only injects-preScriptfor the DOS COM loader branch (lines 446-449,ReaGhidraPrepareCom.java) and seed files, so there is no channel to pass analyzer options;src/ghidra/GhidraAnalysisProfile.ts:152hardcodesanalyzer_preset: "ghidra-default"with no configurable analyzer field anywhere inresolveGhidraAnalysisProfile. This matches the report exactly.I'm working on a fix: an analysis-phase preScript that runs
setAnalysisOption(currentProgram, "<Analyzer>", "false")for analyzers named through a newREA_GHIDRA_DISABLED_ANALYZERSsetting (comma-separated), threaded through the session config into the launcher, with the analysis profile'sanalyzer_presetreflecting the override so snapshots stay bound to the analysis that actually ran. Offline unit tests will cover the argv construction (preScript ordering before the bridge postScript, byte-identical argv when unset).Disclosure: this contribution is prepared with AI assistance (Claude), reviewed and verified by me.
@akushonkamen commented on GitHub (Oct 11, 2026):
Opened https://github.com/morluto/rea/pull/1800 implementing this:
REA_GHIDRA_DISABLED_ANALYZERS(comma-separated, whitelist-validated) drives a packaged analysis-phase preScript (bridge/ghidra/ReaGhidraAnalysisOptions.java) that disables each named analyzer before default auto-analysis; the profile recordsghidra-default+disabled:<names>plusanalysis_options.disabled_analyzersand sessions fail closed on profile/setting mismatch. Details, red→green reproduction, and the no-local-Ghidra proof gap are in the PR description.@ramchander7834-cloud commented on GitHub (Oct 11, 2026):
Cham
@CassieFox23 commented on GitHub (Oct 14, 2026):
Heads up: this looks fixed on main in
9878bb729. The change is insrc/config/ghidraDisabledAnalyzers.ts, andadmits the documented Objective-C analyzer namecovers it. This skip is opt-in, throughREA_GHIDRA_DISABLED_ANALYZERS. It is listed on tracker #3582. If it still happens on main, please say so here and I'll take it off the list.🤖 Generated with Claude Code (Sonnet 5.5, verified by Opus 5.5) 🦊
@morluto commented on GitHub (Oct 14, 2026):
Closing the REA-side analyzer opt-out gap as addressed by merged #1800 (
9878bb729), present in qualified mainfffb07419.REA_GHIDRA_DISABLED_ANALYZERS="Objective-C Message Analyzer"now selects the requested opt-out. The packaged analysis pre-script disables and reads back the named option before default auto-analysis; the selected options participate in the analysis profile and mismatches fail closed. The named analyzer admission has a regression, and current main passed full qualification 38629313022.This closes the missing caller control, the report's proposed recovery. It does not claim the upstream Ghidra analyzer was fixed or that this audit reran the reported coconutBattery Mach-O; that real-target verification remains unavailable here.