mirror of
https://github.com/morluto/rea.git
synced 2026-11-05 06:45:22 +00:00
[GH-ISSUE #969] [Feature] Modular binary diagnostics and debugger adapters using pwntools and pwndbg #370
Closed
opened 2026-10-15 18:24:22 +00:00 by bsakaguchi
·
4 comments
No Branch/Tag specified
main
codex/procedure-reference-stacked
release-please--branches--main--components--rea-agents
release-please--branches--main--components--rea-agents--release-notes
codex/kuna-independent-retry
codex/byte-search-overlay-coverage
codex/open-failure-target-receipt
codex/kuna-xref-evidence
codex/ghidra-ambiguous-procedure-recovery
codex/function-source-bundle
codex/trace-function-integration-prototype
codex/snapshot-source-closure
codex/recorded-evidence-array-pages
codex/evidence-recovery-redesign
codex/trace-feature-address-scope
codex/call-discovery-scope
codex/ghidra-literal-candidate-evidence
codex/decompile-directory-independent-retry
codex/retry-provenance-base
codex/value-flow-capability-experiment
codex/ghidra-containing-instruction
cursor/readme-discord-button-ef9f
dependabot/github_actions/actions/setup-node-7.1.0
dependabot/github_actions/actions/upload-artifact-7.0.2
dependabot/npm_and_yarn/npm-minor-and-patch-d8d97ce6df
codex/kuna-1989
fix/8559-native-ui-fixture-ownership
fix/8555-go-verifier-mcp-ownership
codex/provider-capability-recovery
fix/8642-rizin-target-stdin
codex/ghidra-memory-effect-scope
codex/ghidra-annotation-entry-selector
codex/ghidra-readonly-recovery
codex/ghidra-regex-verifier-recovery
codex/evidence-discovery-view-guidance
fix/8545-bulk-append-overflow
fix/8428-navigation-refusal-alternatives
codex/address-context-recovery
codex/matching-member-limitations
codex/unknown-scope-contract
codex/evidence-view-guidance
feat/8373-native-trace-views
codex/ghidra-snapshot-verifier-binding
codex/elf-export-visibility
codex/evidence-view-recovery
codex/native-reference-cli-help
codex/provider-candidate-observation-scope
codex/kuna-session-verification
codex/ghidra-switch-lifetime-guidance
codex/pseudocode-paging-discovery
codex/clarify-evidence-view-support
codex/kuna-xrefs-selector-recovery
codex/context-capacity-recovery
codex/evidence-closure-large-links
codex/same-function-evidence-identity
codex/ghidra-verifier-inspected-jdk
codex/audit-guided-workflows
codex/crash-prompt-retained-dossiers
codex/analysis-view-error-recovery
codex/kuna-verifier-target-selection
codex/ghidra-selected-project-call-coverage
codex/docs-native-analysis-scope
codex/ghidra-java-socket-boundary
codex/ghidra-retained-snapshot-verifier
codex/ghidra-search-inventory-facts
fix/8284-zero-argument-parameter-bindings
fix/8198-ui-action-handler-offset
fix/8257-elf-entry-label-identity
fix/8304-deferred-output-schema-projection
fix/8277-call-path-computed-target-uncertainty
fix/pr-8089-conflicts
fix/ci-static-duplicate-export
dependabot/npm_and_yarn/lint-staged-17.6.0
dependabot/github_actions/actions/download-artifact-8.0.2
dependabot/npm_and_yarn/write-file-atomic-8.0.0
dependabot/npm_and_yarn/canonicalize-5.1.0
dependabot/github_actions/actions/cache/restore-6.1.0
dependabot/npm_and_yarn/toon-format/toon-4.4.0
dependabot/github_actions/actions/deploy-pages-5.0.1
codex/review-fixes-pr-2403
codex/review-fixes-pr-2400
codex/process-terminal-width
codex/test-brittleness-cleanup
verify/7167-browser-connect-macos
fix/7167-browser-connect
feat/native-matching-allowance-setting
feat/browser-scenario-dry-run
test/managed-caller-parameters-20261024
codex/parser-fortythird-boundaries
fix/6926-pinvoke-platform-decorations-20261023
fix/6889-har-body-encoding-20261023
fix/6888-sqlite-schema-budget-20261023
fix/dependency-security-gates-6708
cursor/evidence-overwrite-rebase-b4ac
feat/4057-verify-native-exports
fix/windows-acl-observer-overhead-20261022
cursor/erlang-beam-restack-4476
cursor/pe-certificate-review-bf32
fix/6116-javascript-application-fs-errors
fix/6061-unmapped-runtime-script-unknown
feat/browser-scenario-summary
fix/pe-certificates
codex/verify-3407
cursor/rebase-5699
cursor/rebase-5352
cursor/rebase-5600
cursor/fix-cli-schema-omission-10a8
codex/audit-hopper-shutdown-reasons-20261021
fix/demangle-swift-omitted-record
fix/nib-boolean-value-types
cursor/cancellation-partial-observation-a5ac
fix/ib-object-limit-reasons
fix/electron-fuse-limit-advice
fix/kuna-doctor-dangling-cache
fix/fixed-budget-refusal-advice
fix/js-ipc-listener-dedup
fix/js-return-member-provenance
fix/dmg-integrity-retry-advice
fix/ida-doctor-readiness
fix/kuna-version-probe-output-drain
fix/legacy-swift-runtime-name-matching
fix/dylib-lazy-load-commands
fix/browser-scenario-startup-cancel
fix/swift-nested-punycode-classification
fix/compare-unselected-scopes
fix/objc-method-budget-coverage
fix/dmg-mounted-root-observations
audit/ci-tests-20261019-round2
release/6.7.0
fix/wabt-cleanup-retry-resolution
fix/electron-fuse-elf-pe-architecture
fix/native-plist-descriptor-ownership
fix/kuna-caller-cleanup-ownership
experiment/atomic-codemode-20261016
review/first-contributor-3776
fix/call-resolution-full-read-cycles
fix/member-mutation-selection-repeat
experiment/atomic-re-tools-20261015
perf/member-mutation-lazy-origins
perf/static-network-mutation-index
fix/hopper-startup-lifecycle
audit/3050-windows-proof-20261015
feat/windows-window-capture-2183
audit/3049-windows-proof-20261015
audit/3735-macos-fixtures-20261015
fix/batch-decompile-null-pseudocode
fix/kuna-inventory-honors-jobs
experiment/browser-codemode-tool-design-20261015
fix/hopper-clean-runtime-argv
codex/review-2049-27f1b367
review-fixes/pr-2787-routing
fix/3360-scoped-this-emitters
fix/3367-replaced-global-effects
fix/3838-compact-any-value-items
test/hopper-download-probe-20261015
codex/windows-runtime-creation-red-green-20261015
codex/windows-readonly-root-red-green-20261015
codex/windows-root-share-red-green-20261015
codex/exp-1685-win-mcp-startup
codex/bug-sweep-20261015
investigate/2190-windows-package-phases
investigate/3543-macos-cli-deadline
perf/3281-reverse-tools-feedback-quality
fix/3406-hopper-doctor-fixture
fix/3341-wrapper-require-test-context
fix/3301-owned-uninstall-fixtures
fix/3164-compiler-input-ownership
fix/pcap-cleanup-stdout-newline-20261014
perf/interface-builder-summary
codex/review-fixes-pr-1977
fix/ghidra-effective-jvm-platform
fix/docs-turkish-rust-link-20261013
fix/main-maintenance-ci-20261010
fix/recover-binary-session-process-effects
codex/review-fixes-pr-2457
codex/ci-required-cancellation-gate
fix/main-format-baseline-20261013
fix/setup-preserve-entry-fields
cursor/restore-main-checks-1ffc
fix/ghidra-bridge-hashmap-import
codex/shared-ci-jadx-json-default-20261013
codex/shared-ci-ghidra-test-groups-20261013
codex/shared-ci-java-fixture-format-20261013
codex/fix-intrinsic-invocation-boundaries
test/release-preflight-reusable-jobs
test/js-parameter-provenance-expectation
fix/linux-hopper-verification-current
test/2419-ghidra-elf-probe-size
followup/pr-1544-native-ida
codex/fold-pr-2230-contribution
docs/readme-responsible-use
fix/issue-2064
fix/issue-2050
fix/issue-2053
fix/issue-1968
fix/issue-1945
experiment/codemode-bridge-20261011
fix/tool-effects-negative-wording-1904-20261012
fix/1842-electron-interop-provenance
feat/recover-javascript-multi-input
refactor/website-i18n-prep
fix/nativeaot-pe-virtual-extent
fix/browser-verifier-ci-hang
fix/pe-resources-input-selection
docs/beginner-friendly-guides
docs/beginner-setup-guide
fix/javascript-analysis-worker-1563
fix/1649-ghidra-duplicate-names
fix/javascript-export-keys-integration-1369
test/maintenance-boundary-contracts-20261011
review/javascript-export-keys-1369
review/process-live-progress-1483
test/javascript-1495-growth-ratio
fix/ci-escape-timing
docs/normalized-terminal-geometry-1450
release/6.3.0
archive/release-6.3.0-pr1381
release/6.2.0
fix/electron-preload-dynamic-override
fix/javascript-self-referential-bundler-edges
release/6.1.0
cursor/grok-client-cherry-pick-0b56
feat/signature-posture
feat/dyld-shared-cache
feat/artifact-integrity-policy
feat/pkg-inventory
release/6.0.0
chore/sync-release-5.0.0
release/5.0.0
cursor/cloud-agent-node-787e
fix/javascript-xhr-open-endpoints
review/pr-711-realpath-fallback-wording
cleanup/replay-confinement
codex/test-suite-performance
codex/issue-foundations
codex/address-open-issues-2026-07-20
agent/javascript-vite-rollup-esbuild-adapters
agent/process-cleanup
agent/triage-integration
agent/unknown-commands-registry
feat/mcp-identity-metadata
morlvps/issue_cleanup
codex/installer-redesign
morl/roadmap-investigation-core
morl/roadmap-investigation-docs
release-please--branches--main--components--rea
rea-agents-6.8.0
rea-agents-6.7.0
rea-agents-6.6.0
experiment/atomic-codemode-wait-runtime-20261016
rea-agents-6.5.0
rea-agents-6.4.0
rea-agents-6.3.0
rea-agents-6.2.0
rea-agents-6.1.0
rea-agents-6.0.0
rea-agents-5.0.0
rea-agents-4.1.0
rea-agents-4.0.1
rea-agents-4.0.0
rea-agents-3.2.1
rea-agents-3.2.0
rea-agents-3.1.0
rea-agents-3.0.0
rea-agents-2.7.0
rea-agents-2.6.0
rea-agents-2.5.1
rea-agents-2.5.0
rea-agents-2.4.0
rea-agents-2.3.0
rea-agents-2.2.0
rea-agents-2.1.0
rea-agents-2.0.0
rea-agents-1.7.0
rea-agents-1.6.0
rea-agents-1.5.0
rea-agents-1.4.0
rea-agents-1.3.0
rea-agents-1.2.0
rea-agents-1.1.0
rea-agents-1.0.0
rea-agents-0.5.0
rea-agents-0.4.0
rea-agents-0.3.0
rea-0.2.1
rea-0.2.0
Labels
Clear labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
Mirrored from GitHub Pull Request
question
roadmap
triage
No labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
question
roadmap
triage
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set.
Reference
morluto/rea#370
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @N0zoM1z0 on GitHub (Oct 7, 2026).
Original GitHub issue: https://github.com/morluto/rea/issues/969
Before submitting
Area
Native analysis or decompilation
Current limitation
REA has static native function analysis, process capture and archive inspection, but lacks a modular workflow connecting native binary layout/mitigation facts, recorded crash state, and explicitly selected debugger state/actions.
This is a general binary reverse-engineering capability. Native application reconstruction, crash diagnosis, ABI/memory-layout investigation, firmware userspace analysis and CTF tasks can consume the same primitives. pwntools supplies a reusable analysis library; pwndbg supplies optional debugger enrichment. CTF is one application domain/showcase. Public contracts and module boundaries should express reusable analyst questions.
Research baseline: REA main
b5afa5f91eed9ae31d670aeab9bbf5112d790ec2, 2026-10-07. Open/closed searches found no dedicated pwntools/pwndbg integration proposal. #71/#385 and open PR #964 concern narrower native call observation, not a general Linux GDB session or offline core diagnostics. Parent: #32.Use cases
Desired outcome and success criteria
Organize this roadmap into independent adapters and useful PRs:
Acceptance uses source-built fixtures and separate lanes:
Routine deterministic tests should not require every optional debugger/assembler/emulator. Each real lane declares only its own prerequisites and actual host/architecture/allocator coverage.
Authority boundaries and non-goals
ELF.libs,ELF.mapsandELF.libcexecute a modified target to resolve libraries/mappings. Static inspection must avoid these accessors.DT_NEEDEDnames do not establish the runtime-selected library path.process.corefile, expression evaluation, function calls and raw debugger commands can require execution; disclose those operations separately.~/.gdbinit, system Python, ptrace/sysctl settings or host defaults. Preflight missing dependencies and attach errors by their actual reason.Alternatives considered
pygdbmifor existing parsing/controller code before building a new MI parser.pwntools.gdbprovides useful helpers, but may launch a terminal/gdbserver; its Python/RPyC access is documented as experimental. Probe exact Python/debugger compatibility rather than making that helper a mandatory REA transport.luantq0/pwndbg-mcpoffers prior art for debugger operations and byte input. Selected controller source uses a shared PTY, idle-based resume completion and output compaction. REA needs structured stop/lifecycle evidence, retained raw output and bounded resource cleanup. Source review alone does not establish its failure behavior.Possible direction
Use independent binary diagnostics and native debugger application ports. Provider-neutral domain results describe exact bytes/addresses, artifact and process identity, stopped-state observations and action outcomes. pwnlib, MI, GDB Python and pwndbg internals belong to provider/bridge modules.
Start with a small isolated Python bridge to the unchanged pwntools package. For GDB, compare a versioned MI adapter using existing parsing with an in-debugger Python bridge for structured snapshots/enrichment. Pwndbg internal APIs are version-specific; feature-probe them and retain native diagnostics when a facet cannot be normalized. Coordinate shared native call/identity semantics with #964 and the Frida instrumentation workstream #968.
Use per-request pwntools context for architecture/endianness and record original pattern parameters. Preserve offsets, virtual addresses and runtime load bases distinctly; gadget or heap interpretations are derived observations, not evidence of successful execution or a vulnerability.
Observed releases: pwntools 4.15.0 and pwndbg 2026.09.15. Official pwndbg supports GDB and experimental LLDB with different Python/debugger prerequisites. These are research observations; compatibility needs real fixtures before being advertised.
References
Research reviewed official documentation, release/license metadata and selected implementations. No pwntools/pwndbg/GDB runtime integration has been verified by this issue. Split implementation and real-provider proof into focused follow-ups.
@N0zoM1z0 commented on GitHub (Oct 8, 2026):
First modular implementation is ready for review in #1037: target-free offline ELF layout through unchanged BYO pwntools/pyelftools/Unicorn. Final installed CLI/MCP verification passed 27 real cases (including linked/section/TLS values, high uint64 addresses, raw names, malformed/unsupported inputs), with syscall evidence that no selected target or patched copy executed and zero remaining descendants; 63 focused tests passed. Core analysis, GDB state/control and optional pwndbg enrichment remain separate increments under this issue. CTF remains one showcase for these general capabilities.
@N0zoM1z0 commented on GitHub (Oct 8, 2026):
ELF-layout increment merged in #1037 (
4fc6565b). Added target-freeinspect_binary_layout/ CLI parity through exact BYO pwntools, with raw identities, source ranges, full inline Evidence and explicit inferred/unknown facets. All30 final-head checks passed; real installed CLI/MCP CI passed149 public + four bootstrap cases. Targeted genuine large-index MCP proof passed separately; large-result usability is tracked in #1050.This roadmap stays open: recorded crash/core inspection and optional GDB/pwndbg context remain separate increments. Next I am finishing the EVM bytecode interface adapter in #972, then returning to the recorded-core/pwndbg boundary. CTF remains one application of these general capabilities.
@N0zoM1z0 commented on GitHub (Oct 8, 2026):
Completed the first two independent binary diagnostics increments:
inspect_binary_layoutprovides offline ELF layout, relocation/GOT/PLT and mitigation evidence through unchanged pwntools/pyelftools, without executing the selected target.inspect_recorded_crashpreserves recorded Linux amd64 core notes, every supported thread/register and meaningful signal fields, with optional core-only GDB/pwndbg mapping context. CLI and MCP share the application workflow and return full inline Evidence. Historical PIDs remain metadata; debugger maps and their enclosing Evidence are derived, with unknown current file identities.The recorded-crash increment uses separate modular adapters and unchanged pinned upstream code. Final verification includes 102 focused core and shared Evidence/CLI tests, a fresh installed CLI/MCP smoke, and the hosted 42-case installed-package proof with all 139 tool schemas, original inputs unchanged, a surviving PID-collision sentinel and no remaining descendants. Review regressions cover raw owner/ABI interpretation, source-bound PID/signal/register fields, missing/duplicate interpretations, complete register identities, exact physical coverage and source headers. No VPS defaults, system Python,
.gdbinit, ptrace or sysctl settings were changed.This remains an open roadmap: executable/library pairing, unwinding, live GDB state/control, allocator/pointer-chain facets, instruction-sequence/pattern queries, other targets/hosts and large result views (#1050) are future work. These are general reusable binary-analysis capabilities; CTF is one application domain.
PR #1054 was squash-merged as
163ee09a7425479385e0ed0b5d74043e2587eab2. At merge, 31/32 checks had passed, with no failures; the macOS x64 native package baseline was still running. The existing website runtime lane passed on a same-head rerun after its initial failure; no website code was changed. The owner explicitly asked to proceed without waiting for bot review. Normal merge was used without bypassing branch protection.Per the owner's latest direction, development stops after this already-started increment. No additional features are being started. The remaining roadmap is available for future contributors to pick up in separate PRs with corresponding real-provider proof.
@morluto commented on GitHub (Oct 8, 2026):
Verified fixed on main (
7a7460f0). bridge/pwntools/ + bridge/pwndbg/ adapters ship with src/native/pwntools, CLI binaryDiagnosticsCommands, and docs/binary-diagnostics.md. Closing per audit.