mirror of
https://github.com/morluto/rea.git
synced 2026-11-05 06:45:22 +00:00
[GH-ISSUE #1658] [Bug] A function is cut at a wrongly flagged no-return call (malloc, __tls_get_addr) and REA gives no warning #560
Closed
opened 2026-10-15 18:26:10 +00:00 by bsakaguchi
·
1 comment
No Branch/Tag specified
main
codex/procedure-reference-stacked
release-please--branches--main--components--rea-agents
release-please--branches--main--components--rea-agents--release-notes
codex/kuna-independent-retry
codex/byte-search-overlay-coverage
codex/open-failure-target-receipt
codex/kuna-xref-evidence
codex/ghidra-ambiguous-procedure-recovery
codex/function-source-bundle
codex/trace-function-integration-prototype
codex/snapshot-source-closure
codex/recorded-evidence-array-pages
codex/evidence-recovery-redesign
codex/trace-feature-address-scope
codex/call-discovery-scope
codex/ghidra-literal-candidate-evidence
codex/decompile-directory-independent-retry
codex/retry-provenance-base
codex/value-flow-capability-experiment
codex/ghidra-containing-instruction
cursor/readme-discord-button-ef9f
dependabot/github_actions/actions/setup-node-7.1.0
dependabot/github_actions/actions/upload-artifact-7.0.2
dependabot/npm_and_yarn/npm-minor-and-patch-d8d97ce6df
codex/kuna-1989
fix/8559-native-ui-fixture-ownership
fix/8555-go-verifier-mcp-ownership
codex/provider-capability-recovery
fix/8642-rizin-target-stdin
codex/ghidra-memory-effect-scope
codex/ghidra-annotation-entry-selector
codex/ghidra-readonly-recovery
codex/ghidra-regex-verifier-recovery
codex/evidence-discovery-view-guidance
fix/8545-bulk-append-overflow
fix/8428-navigation-refusal-alternatives
codex/address-context-recovery
codex/matching-member-limitations
codex/unknown-scope-contract
codex/evidence-view-guidance
feat/8373-native-trace-views
codex/ghidra-snapshot-verifier-binding
codex/elf-export-visibility
codex/evidence-view-recovery
codex/native-reference-cli-help
codex/provider-candidate-observation-scope
codex/kuna-session-verification
codex/ghidra-switch-lifetime-guidance
codex/pseudocode-paging-discovery
codex/clarify-evidence-view-support
codex/kuna-xrefs-selector-recovery
codex/context-capacity-recovery
codex/evidence-closure-large-links
codex/same-function-evidence-identity
codex/ghidra-verifier-inspected-jdk
codex/audit-guided-workflows
codex/crash-prompt-retained-dossiers
codex/analysis-view-error-recovery
codex/kuna-verifier-target-selection
codex/ghidra-selected-project-call-coverage
codex/docs-native-analysis-scope
codex/ghidra-java-socket-boundary
codex/ghidra-retained-snapshot-verifier
codex/ghidra-search-inventory-facts
fix/8284-zero-argument-parameter-bindings
fix/8198-ui-action-handler-offset
fix/8257-elf-entry-label-identity
fix/8304-deferred-output-schema-projection
fix/8277-call-path-computed-target-uncertainty
fix/pr-8089-conflicts
fix/ci-static-duplicate-export
dependabot/npm_and_yarn/lint-staged-17.6.0
dependabot/github_actions/actions/download-artifact-8.0.2
dependabot/npm_and_yarn/write-file-atomic-8.0.0
dependabot/npm_and_yarn/canonicalize-5.1.0
dependabot/github_actions/actions/cache/restore-6.1.0
dependabot/npm_and_yarn/toon-format/toon-4.4.0
dependabot/github_actions/actions/deploy-pages-5.0.1
codex/review-fixes-pr-2403
codex/review-fixes-pr-2400
codex/process-terminal-width
codex/test-brittleness-cleanup
verify/7167-browser-connect-macos
fix/7167-browser-connect
feat/native-matching-allowance-setting
feat/browser-scenario-dry-run
test/managed-caller-parameters-20261024
codex/parser-fortythird-boundaries
fix/6926-pinvoke-platform-decorations-20261023
fix/6889-har-body-encoding-20261023
fix/6888-sqlite-schema-budget-20261023
fix/dependency-security-gates-6708
cursor/evidence-overwrite-rebase-b4ac
feat/4057-verify-native-exports
fix/windows-acl-observer-overhead-20261022
cursor/erlang-beam-restack-4476
cursor/pe-certificate-review-bf32
fix/6116-javascript-application-fs-errors
fix/6061-unmapped-runtime-script-unknown
feat/browser-scenario-summary
fix/pe-certificates
codex/verify-3407
cursor/rebase-5699
cursor/rebase-5352
cursor/rebase-5600
cursor/fix-cli-schema-omission-10a8
codex/audit-hopper-shutdown-reasons-20261021
fix/demangle-swift-omitted-record
fix/nib-boolean-value-types
cursor/cancellation-partial-observation-a5ac
fix/ib-object-limit-reasons
fix/electron-fuse-limit-advice
fix/kuna-doctor-dangling-cache
fix/fixed-budget-refusal-advice
fix/js-ipc-listener-dedup
fix/js-return-member-provenance
fix/dmg-integrity-retry-advice
fix/ida-doctor-readiness
fix/kuna-version-probe-output-drain
fix/legacy-swift-runtime-name-matching
fix/dylib-lazy-load-commands
fix/browser-scenario-startup-cancel
fix/swift-nested-punycode-classification
fix/compare-unselected-scopes
fix/objc-method-budget-coverage
fix/dmg-mounted-root-observations
audit/ci-tests-20261019-round2
release/6.7.0
fix/wabt-cleanup-retry-resolution
fix/electron-fuse-elf-pe-architecture
fix/native-plist-descriptor-ownership
fix/kuna-caller-cleanup-ownership
experiment/atomic-codemode-20261016
review/first-contributor-3776
fix/call-resolution-full-read-cycles
fix/member-mutation-selection-repeat
experiment/atomic-re-tools-20261015
perf/member-mutation-lazy-origins
perf/static-network-mutation-index
fix/hopper-startup-lifecycle
audit/3050-windows-proof-20261015
feat/windows-window-capture-2183
audit/3049-windows-proof-20261015
audit/3735-macos-fixtures-20261015
fix/batch-decompile-null-pseudocode
fix/kuna-inventory-honors-jobs
experiment/browser-codemode-tool-design-20261015
fix/hopper-clean-runtime-argv
codex/review-2049-27f1b367
review-fixes/pr-2787-routing
fix/3360-scoped-this-emitters
fix/3367-replaced-global-effects
fix/3838-compact-any-value-items
test/hopper-download-probe-20261015
codex/windows-runtime-creation-red-green-20261015
codex/windows-readonly-root-red-green-20261015
codex/windows-root-share-red-green-20261015
codex/exp-1685-win-mcp-startup
codex/bug-sweep-20261015
investigate/2190-windows-package-phases
investigate/3543-macos-cli-deadline
perf/3281-reverse-tools-feedback-quality
fix/3406-hopper-doctor-fixture
fix/3341-wrapper-require-test-context
fix/3301-owned-uninstall-fixtures
fix/3164-compiler-input-ownership
fix/pcap-cleanup-stdout-newline-20261014
perf/interface-builder-summary
codex/review-fixes-pr-1977
fix/ghidra-effective-jvm-platform
fix/docs-turkish-rust-link-20261013
fix/main-maintenance-ci-20261010
fix/recover-binary-session-process-effects
codex/review-fixes-pr-2457
codex/ci-required-cancellation-gate
fix/main-format-baseline-20261013
fix/setup-preserve-entry-fields
cursor/restore-main-checks-1ffc
fix/ghidra-bridge-hashmap-import
codex/shared-ci-jadx-json-default-20261013
codex/shared-ci-ghidra-test-groups-20261013
codex/shared-ci-java-fixture-format-20261013
codex/fix-intrinsic-invocation-boundaries
test/release-preflight-reusable-jobs
test/js-parameter-provenance-expectation
fix/linux-hopper-verification-current
test/2419-ghidra-elf-probe-size
followup/pr-1544-native-ida
codex/fold-pr-2230-contribution
docs/readme-responsible-use
fix/issue-2064
fix/issue-2050
fix/issue-2053
fix/issue-1968
fix/issue-1945
experiment/codemode-bridge-20261011
fix/tool-effects-negative-wording-1904-20261012
fix/1842-electron-interop-provenance
feat/recover-javascript-multi-input
refactor/website-i18n-prep
fix/nativeaot-pe-virtual-extent
fix/browser-verifier-ci-hang
fix/pe-resources-input-selection
docs/beginner-friendly-guides
docs/beginner-setup-guide
fix/javascript-analysis-worker-1563
fix/1649-ghidra-duplicate-names
fix/javascript-export-keys-integration-1369
test/maintenance-boundary-contracts-20261011
review/javascript-export-keys-1369
review/process-live-progress-1483
test/javascript-1495-growth-ratio
fix/ci-escape-timing
docs/normalized-terminal-geometry-1450
release/6.3.0
archive/release-6.3.0-pr1381
release/6.2.0
fix/electron-preload-dynamic-override
fix/javascript-self-referential-bundler-edges
release/6.1.0
cursor/grok-client-cherry-pick-0b56
feat/signature-posture
feat/dyld-shared-cache
feat/artifact-integrity-policy
feat/pkg-inventory
release/6.0.0
chore/sync-release-5.0.0
release/5.0.0
cursor/cloud-agent-node-787e
fix/javascript-xhr-open-endpoints
review/pr-711-realpath-fallback-wording
cleanup/replay-confinement
codex/test-suite-performance
codex/issue-foundations
codex/address-open-issues-2026-07-20
agent/javascript-vite-rollup-esbuild-adapters
agent/process-cleanup
agent/triage-integration
agent/unknown-commands-registry
feat/mcp-identity-metadata
morlvps/issue_cleanup
codex/installer-redesign
morl/roadmap-investigation-core
morl/roadmap-investigation-docs
release-please--branches--main--components--rea
rea-agents-6.8.0
rea-agents-6.7.0
rea-agents-6.6.0
experiment/atomic-codemode-wait-runtime-20261016
rea-agents-6.5.0
rea-agents-6.4.0
rea-agents-6.3.0
rea-agents-6.2.0
rea-agents-6.1.0
rea-agents-6.0.0
rea-agents-5.0.0
rea-agents-4.1.0
rea-agents-4.0.1
rea-agents-4.0.0
rea-agents-3.2.1
rea-agents-3.2.0
rea-agents-3.1.0
rea-agents-3.0.0
rea-agents-2.7.0
rea-agents-2.6.0
rea-agents-2.5.1
rea-agents-2.5.0
rea-agents-2.4.0
rea-agents-2.3.0
rea-agents-2.2.0
rea-agents-2.1.0
rea-agents-2.0.0
rea-agents-1.7.0
rea-agents-1.6.0
rea-agents-1.5.0
rea-agents-1.4.0
rea-agents-1.3.0
rea-agents-1.2.0
rea-agents-1.1.0
rea-agents-1.0.0
rea-agents-0.5.0
rea-agents-0.4.0
rea-agents-0.3.0
rea-0.2.1
rea-0.2.0
Labels
Clear labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
Mirrored from GitHub Pull Request
question
roadmap
triage
No labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
question
roadmap
triage
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set.
Reference
morluto/rea#560
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @CassieFox23 on GitHub (Oct 11, 2026).
Original GitHub issue: https://github.com/morluto/rea/issues/1658
TL;DR: On a stripped Rust library, Ghidra treats two libc calls as calls that never return. That cuts one function from 78 instructions to 8, and REA shows it with no warning. REA already has a script that undoes this for some functions, but it skips these two.
Before submitting
Area
Native analysis or decompilation
Observed behavior
I pointed REA at
loot.cpython-313-x86_64-linux-gnu.sowith the Ghidra provider. The file is the Python module of libloot 0.29.6 (GPL-3.0-or-later). It ships inside Amethyst Mod Manager 2.5.3 (GPL-3.0-or-later). It is Rust with PyO3 0.25.1, and it is stripped.The one exported function is
PyInit_loot. REA returns this for it (the three try/catch comment lines are removed):The assembly view stops at the same call, after 8 instructions. The procedure info says the body is 43 bytes. The function dossier returns the same body. It reports
confidence: observedand only the generic limitations.The real function is longer. In
objdump -dit runs from file offset 0x3e1020 to aud2at 0x3e1172. That range holds 78 instructions. The code reads a thread-local counter, calls the module init, and builds the Python error on failure.Ghidra alone gives the same result. I ran
analyzeHeadlesson the same file with default analysis and no REA script. The function has the same 8 instructions. The external__tls_get_addrcarries the no-return flag. So Ghidra sets the flag. REA does not clear it, and it does not say the body may be cut.The flag is wrong for more than one call. These are Ghidra's counts after default analysis, before any REA script ran:
"Sites" are the calls where Ghidra ends the flow. "Functions" is how many functions hold them. I did not measure how many of those functions are really cut. A call can end the flow while the code after it is reached some other way.
PyInit_lootis cut.PyInit_amethyst_filegraphis not cut, and it decompiles in full.Reproduction
AmethystModManager.flatpak. The file sits at/app/lib/python3.13/site-packages/loot.cpython-313-x86_64-linux-gnu.soinside it.7777474017b65531258cc1678f2c1ee45e61f4b76de4890c02c7436cbbbe60a8.rea decompile /abs/path/loot.cpython-313-x86_64-linux-gnu.so PyInit_loot --provider ghidra --format json. Over MCP, callopen_binarywithprovider_idset toghidra. Then callprocedure_pseudo_codeforPyInit_loot.objdump -d --start-address=0x3e1020 --stop-address=0x3e1180on the same file.The CLI command and the MCP route gave the same result on main.
The first import took 4 to 5 minutes here, with three or four Ghidra processes running. After
open_binary, later calls on the same MCP session answered in under a second.A small Rust library I built myself did not reproduce this. In it,
__tls_get_addrwas not flagged. The function decompiled in full, with 48 instructions. So the Amethyst file is needed. I do not know what makes Ghidra set the flag on this file.Expected behavior
PyInit_lootshould come back whole. If Ghidra's flag cannot be trusted, the result should say so. Today nothing tells the reader that the body may be cut at a no-return call.Impact and scope
read_bytesat 0x4e1046 returns the call and the code after it.inspect_binary_layoutis also untouched.observedand carries no limitation. A caller readsPyInit_lootas a function that never returns.REA version
Main branch, at commit
4999e4be2(#1651). Its package.json says 6.3.0. The released 6.3.0 package gave the same output in an earlier run. I did not re-run it today.Main has moved to
639b73097since then. The no-return script has not changed there. I checked with git diff.Runtime and platform
Node 24.18.0; Nobara 44 (Fedora 44 base), Linux 7.2.9, x86-64; Ghidra 12.1.4 (Apache-2.0); JDK 21.0.12.1
Target and artifact context
ELF64 x86-64 shared object, stripped, Rust with PyO3 0.25.1, 5,836,952 bytes. A second file,
amethyst_filegraph.abi3.so, was used for the filegraph rows.Interface
MCP
Earliest failure stage
Native analysis or reconstruction
Relevant output or evidence
The decompile and the table are above. These are the first lines of the real function, from
objdump -d:In this file, Ghidra adds 0x100000 to file offsets. The call is at 0x4e1046 in REA.
Typed outcome or recovery expected
When a function body ends at a call whose callee has the no-return flag, the result could carry a limitation. It would name the callee.
Analysis or suspected cause
This part is read from source, and I tested the fix idea once.
The script
bridge/ghidra/ReaGhidraNoReturnFix.javaat4999e4be2already clears wrong no-return flags. Its rule is: flagged no-return, and the body holds a real return. Its loop skips thunks, which covers the PLT stubs. An external function has no body with a return in it. So neither one is ever cleared.After the script ran on loot, it reported
cleared=4 sites=75 refit=23. The external__tls_get_addrstayed flagged on all 197 call sites. The externalmallocstayed flagged on all 1,611.I tried a copy of that script that also clears the flag on six externals and their stubs. The six are
malloc,__tls_get_addr,memcpy,memset,strlenand__errno_location. The copy then re-disassembles the call sites the same way. After that, the function came back with 59 instructions. The decompile has 74 lines. It now shows the real calls andPyErr_SetRaisedException.That copy re-disassembled 1,812 call sites and refit 994 functions in loot. I did not check whether those refits are right (unverified). I tried it on one file.
Commands
The script
P4Dump2.javatakes a label, a function name prefix and a list of search terms. It lists the instructions of the matching function. It also prints the no-return flag of each call target and the decompiler text. The scriptP4Nr.javacounts call sites per no-return external. I can share both scripts if that helps. The fix idea from the last section is this diff against the REA script:Test setup
4999e4be2(#1651)Related, but not the same, is #1244. It asks for a warning when a guessed signature clashes with the code.
🤖 Generated with Claude Code (Sonnet 5.5, verified by Opus 5.5) 🦊
@CassieFox23 commented on GitHub (Oct 11, 2026):
TL;DR: I ran main
1e51c732bon the Linux file that the close note called unverified. That is from before #1666 landed. The function still stopped after 8 instructions. But every view named the call and said the flag is only Ghidra's. That matches what69a8b3a95set out to do. The #1666 fix then brought back the full body on this file.What I ran
I built main at
1e51c732b. I openedloot.cpython-313-x86_64-linux-gnu.sowithopen_binaryandprovider_idset toghidra, in one MCP session. The file is the Python module of libloot 0.29.6 (GPL-3.0-or-later). It ships in Amethyst Mod Manager (GPL-3.0-or-later). I then called four tools forPyInit_loot.1e51c732b__tls_get_addrand 0x4e1046procedure_pseudo_code__tls_get_addr(&PTR_0068ee28);procedure_assembly0x4e1046: CALL 0x00629080procedure_infoanalyze_functionThe line is the same in all four results:
The body did not change, as expected:
69a8b3a95does not clear flags or recover code. Inobjdump -dthe function runs from file offset 0x3e1020 to theud2at 0x3e1172. That range holds 75 instructions. The issue body says 78, which was my mistake. I counted the linesobjdumpprints, and three long instructions wrap onto a second line.The other file,
amethyst_filegraph.abi3.so, was already whole.PyInit_amethyst_filegraphon1e51c732bhas 31 instructions and 157 bytes. Its decompile is 53 lines. It has no terminal-call line.#1666 landed on main as
49e6f00edwhile I tested. Its head takesPyInit_lootfrom 8 instructions to 59 on this file. The details are in my comment on #1666.Not run
malloc,memcpy,memset,strlen,__errno_location). I checked only__tls_get_addrat 0x4e1046.Thanks, morluto, for the fix in
69a8b3a95.Test setup
1e51c732b🤖 Generated with Claude Code (Sonnet 5.5, verified by Opus 5.5) 🦊