mirror of
https://github.com/morluto/rea.git
synced 2026-11-05 06:45:22 +00:00
[GH-ISSUE #5732] [Bug] Artifact inspection and extraction reject ZIPs with a valid executable prefix #3479
Closed
opened 2026-10-31 00:40:57 +00:00 by bsakaguchi
·
2 comments
No Branch/Tag specified
main
codex/procedure-reference-stacked
release-please--branches--main--components--rea-agents
release-please--branches--main--components--rea-agents--release-notes
codex/kuna-independent-retry
codex/byte-search-overlay-coverage
codex/open-failure-target-receipt
codex/kuna-xref-evidence
codex/ghidra-ambiguous-procedure-recovery
codex/function-source-bundle
codex/trace-function-integration-prototype
codex/snapshot-source-closure
codex/recorded-evidence-array-pages
codex/evidence-recovery-redesign
codex/trace-feature-address-scope
codex/call-discovery-scope
codex/ghidra-literal-candidate-evidence
codex/decompile-directory-independent-retry
codex/retry-provenance-base
codex/value-flow-capability-experiment
codex/ghidra-containing-instruction
cursor/readme-discord-button-ef9f
dependabot/github_actions/actions/setup-node-7.1.0
dependabot/github_actions/actions/upload-artifact-7.0.2
dependabot/npm_and_yarn/npm-minor-and-patch-d8d97ce6df
codex/kuna-1989
fix/8559-native-ui-fixture-ownership
fix/8555-go-verifier-mcp-ownership
codex/provider-capability-recovery
fix/8642-rizin-target-stdin
codex/ghidra-memory-effect-scope
codex/ghidra-annotation-entry-selector
codex/ghidra-readonly-recovery
codex/ghidra-regex-verifier-recovery
codex/evidence-discovery-view-guidance
fix/8545-bulk-append-overflow
fix/8428-navigation-refusal-alternatives
codex/address-context-recovery
codex/matching-member-limitations
codex/unknown-scope-contract
codex/evidence-view-guidance
feat/8373-native-trace-views
codex/ghidra-snapshot-verifier-binding
codex/elf-export-visibility
codex/evidence-view-recovery
codex/native-reference-cli-help
codex/provider-candidate-observation-scope
codex/kuna-session-verification
codex/ghidra-switch-lifetime-guidance
codex/pseudocode-paging-discovery
codex/clarify-evidence-view-support
codex/kuna-xrefs-selector-recovery
codex/context-capacity-recovery
codex/evidence-closure-large-links
codex/same-function-evidence-identity
codex/ghidra-verifier-inspected-jdk
codex/audit-guided-workflows
codex/crash-prompt-retained-dossiers
codex/analysis-view-error-recovery
codex/kuna-verifier-target-selection
codex/ghidra-selected-project-call-coverage
codex/docs-native-analysis-scope
codex/ghidra-java-socket-boundary
codex/ghidra-retained-snapshot-verifier
codex/ghidra-search-inventory-facts
fix/8284-zero-argument-parameter-bindings
fix/8198-ui-action-handler-offset
fix/8257-elf-entry-label-identity
fix/8304-deferred-output-schema-projection
fix/8277-call-path-computed-target-uncertainty
fix/pr-8089-conflicts
fix/ci-static-duplicate-export
dependabot/npm_and_yarn/lint-staged-17.6.0
dependabot/github_actions/actions/download-artifact-8.0.2
dependabot/npm_and_yarn/write-file-atomic-8.0.0
dependabot/npm_and_yarn/canonicalize-5.1.0
dependabot/github_actions/actions/cache/restore-6.1.0
dependabot/npm_and_yarn/toon-format/toon-4.4.0
dependabot/github_actions/actions/deploy-pages-5.0.1
codex/review-fixes-pr-2403
codex/review-fixes-pr-2400
codex/process-terminal-width
codex/test-brittleness-cleanup
verify/7167-browser-connect-macos
fix/7167-browser-connect
feat/native-matching-allowance-setting
feat/browser-scenario-dry-run
test/managed-caller-parameters-20261024
codex/parser-fortythird-boundaries
fix/6926-pinvoke-platform-decorations-20261023
fix/6889-har-body-encoding-20261023
fix/6888-sqlite-schema-budget-20261023
fix/dependency-security-gates-6708
cursor/evidence-overwrite-rebase-b4ac
feat/4057-verify-native-exports
fix/windows-acl-observer-overhead-20261022
cursor/erlang-beam-restack-4476
cursor/pe-certificate-review-bf32
fix/6116-javascript-application-fs-errors
fix/6061-unmapped-runtime-script-unknown
feat/browser-scenario-summary
fix/pe-certificates
codex/verify-3407
cursor/rebase-5699
cursor/rebase-5352
cursor/rebase-5600
cursor/fix-cli-schema-omission-10a8
codex/audit-hopper-shutdown-reasons-20261021
fix/demangle-swift-omitted-record
fix/nib-boolean-value-types
cursor/cancellation-partial-observation-a5ac
fix/ib-object-limit-reasons
fix/electron-fuse-limit-advice
fix/kuna-doctor-dangling-cache
fix/fixed-budget-refusal-advice
fix/js-ipc-listener-dedup
fix/js-return-member-provenance
fix/dmg-integrity-retry-advice
fix/ida-doctor-readiness
fix/kuna-version-probe-output-drain
fix/legacy-swift-runtime-name-matching
fix/dylib-lazy-load-commands
fix/browser-scenario-startup-cancel
fix/swift-nested-punycode-classification
fix/compare-unselected-scopes
fix/objc-method-budget-coverage
fix/dmg-mounted-root-observations
audit/ci-tests-20261019-round2
release/6.7.0
fix/wabt-cleanup-retry-resolution
fix/electron-fuse-elf-pe-architecture
fix/native-plist-descriptor-ownership
fix/kuna-caller-cleanup-ownership
experiment/atomic-codemode-20261016
review/first-contributor-3776
fix/call-resolution-full-read-cycles
fix/member-mutation-selection-repeat
experiment/atomic-re-tools-20261015
perf/member-mutation-lazy-origins
perf/static-network-mutation-index
fix/hopper-startup-lifecycle
audit/3050-windows-proof-20261015
feat/windows-window-capture-2183
audit/3049-windows-proof-20261015
audit/3735-macos-fixtures-20261015
fix/batch-decompile-null-pseudocode
fix/kuna-inventory-honors-jobs
experiment/browser-codemode-tool-design-20261015
fix/hopper-clean-runtime-argv
codex/review-2049-27f1b367
review-fixes/pr-2787-routing
fix/3360-scoped-this-emitters
fix/3367-replaced-global-effects
fix/3838-compact-any-value-items
test/hopper-download-probe-20261015
codex/windows-runtime-creation-red-green-20261015
codex/windows-readonly-root-red-green-20261015
codex/windows-root-share-red-green-20261015
codex/exp-1685-win-mcp-startup
codex/bug-sweep-20261015
investigate/2190-windows-package-phases
investigate/3543-macos-cli-deadline
perf/3281-reverse-tools-feedback-quality
fix/3406-hopper-doctor-fixture
fix/3341-wrapper-require-test-context
fix/3301-owned-uninstall-fixtures
fix/3164-compiler-input-ownership
fix/pcap-cleanup-stdout-newline-20261014
perf/interface-builder-summary
codex/review-fixes-pr-1977
fix/ghidra-effective-jvm-platform
fix/docs-turkish-rust-link-20261013
fix/main-maintenance-ci-20261010
fix/recover-binary-session-process-effects
codex/review-fixes-pr-2457
codex/ci-required-cancellation-gate
fix/main-format-baseline-20261013
fix/setup-preserve-entry-fields
cursor/restore-main-checks-1ffc
fix/ghidra-bridge-hashmap-import
codex/shared-ci-jadx-json-default-20261013
codex/shared-ci-ghidra-test-groups-20261013
codex/shared-ci-java-fixture-format-20261013
codex/fix-intrinsic-invocation-boundaries
test/release-preflight-reusable-jobs
test/js-parameter-provenance-expectation
fix/linux-hopper-verification-current
test/2419-ghidra-elf-probe-size
followup/pr-1544-native-ida
codex/fold-pr-2230-contribution
docs/readme-responsible-use
fix/issue-2064
fix/issue-2050
fix/issue-2053
fix/issue-1968
fix/issue-1945
experiment/codemode-bridge-20261011
fix/tool-effects-negative-wording-1904-20261012
fix/1842-electron-interop-provenance
feat/recover-javascript-multi-input
refactor/website-i18n-prep
fix/nativeaot-pe-virtual-extent
fix/browser-verifier-ci-hang
fix/pe-resources-input-selection
docs/beginner-friendly-guides
docs/beginner-setup-guide
fix/javascript-analysis-worker-1563
fix/1649-ghidra-duplicate-names
fix/javascript-export-keys-integration-1369
test/maintenance-boundary-contracts-20261011
review/javascript-export-keys-1369
review/process-live-progress-1483
test/javascript-1495-growth-ratio
fix/ci-escape-timing
docs/normalized-terminal-geometry-1450
release/6.3.0
archive/release-6.3.0-pr1381
release/6.2.0
fix/electron-preload-dynamic-override
fix/javascript-self-referential-bundler-edges
release/6.1.0
cursor/grok-client-cherry-pick-0b56
feat/signature-posture
feat/dyld-shared-cache
feat/artifact-integrity-policy
feat/pkg-inventory
release/6.0.0
chore/sync-release-5.0.0
release/5.0.0
cursor/cloud-agent-node-787e
fix/javascript-xhr-open-endpoints
review/pr-711-realpath-fallback-wording
cleanup/replay-confinement
codex/test-suite-performance
codex/issue-foundations
codex/address-open-issues-2026-07-20
agent/javascript-vite-rollup-esbuild-adapters
agent/process-cleanup
agent/triage-integration
agent/unknown-commands-registry
feat/mcp-identity-metadata
morlvps/issue_cleanup
codex/installer-redesign
morl/roadmap-investigation-core
morl/roadmap-investigation-docs
release-please--branches--main--components--rea
rea-agents-6.8.0
rea-agents-6.7.0
rea-agents-6.6.0
experiment/atomic-codemode-wait-runtime-20261016
rea-agents-6.5.0
rea-agents-6.4.0
rea-agents-6.3.0
rea-agents-6.2.0
rea-agents-6.1.0
rea-agents-6.0.0
rea-agents-5.0.0
rea-agents-4.1.0
rea-agents-4.0.1
rea-agents-4.0.0
rea-agents-3.2.1
rea-agents-3.2.0
rea-agents-3.1.0
rea-agents-3.0.0
rea-agents-2.7.0
rea-agents-2.6.0
rea-agents-2.5.1
rea-agents-2.5.0
rea-agents-2.4.0
rea-agents-2.3.0
rea-agents-2.2.0
rea-agents-2.1.0
rea-agents-2.0.0
rea-agents-1.7.0
rea-agents-1.6.0
rea-agents-1.5.0
rea-agents-1.4.0
rea-agents-1.3.0
rea-agents-1.2.0
rea-agents-1.1.0
rea-agents-1.0.0
rea-agents-0.5.0
rea-agents-0.4.0
rea-agents-0.3.0
rea-0.2.1
rea-0.2.0
Labels
Clear labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
Mirrored from GitHub Pull Request
question
roadmap
triage
No labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
question
roadmap
triage
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set.
Reference
morluto/rea#3479
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @coygeek on GitHub (Oct 21, 2026).
Original GitHub issue: https://github.com/morluto/rea/issues/5732
Originally assigned to: @kaoru0822-kitauji on GitHub.
Before submitting
Area
Evidence, artifacts, or reconstruction
Observed behavior
Both
inspect-artifactandextract-artifactreject a readable ZIP with a 17-byte inert shell prefix, returningtarget_unavailable/unsupported_targetbefore inventory or extraction. The ZIP was written after the prefix, so its stored offsets include the prefix; independent readers accept it without warnings. The equivalent plain ZIP passes both REA commands. The prefix is never executed.Reproduction
Run from a built source checkout with locked dependencies, its pinned Node runtime, Python 3, Info-ZIP and bsdtar. The following exact reproduction was independently verified and replayed during submission:
Both independent listing tools,
unzip -t, and Python accept the prefixed archive. Each REA operation exits 0 for the plain control and 1 for the prefixed input.Expected behavior
Inspect the original prefixed ZIP as a ZIP root with three member occurrences; extract its two regular files with the same bytes and hashes as the plain control. The prefix need not become a member or be executed.
Source-derived contract:
src/contracts/artifactToolContracts.ts:82-88advertises archive inspection and regular-file extraction.docs/tool-design.mdrequires limits to follow real format, protocol, authority or resource constraints. No public byte-zero ZIP admission requirement or prefixed-ZIP exclusion was found.ZIP_NON_ENTRY_LIMITATIONinsrc/domain/zipPackageFormat.tsdescribes member coverage and omitted surrounding bytes; that coverage note alone is not an explicit promise to admit every prefixed layout.Impact and scope
P2: this bounded class of readable ZIPs cannot be inspected or extracted through REA. Independent readers provide a demonstrated way to examine the original archive. Repacking its members into an ordinary ZIP was independently tested and allows both REA commands to succeed, but changes the original container identity. No data loss or security-boundary crossing was observed. Real installers, MZ stubs, longer prefixes and MCP were not tested.
REA version
rea-agents6.7.0; source baseline9d8e7803326a382cbbb3ffdb900f5e93e5442d68. Fetchedorigin/mainatd0067ba34a39ea47dd7e11bb2e6169bc0938cc3f: none of the five cited contract/failure-source files changed since the baseline. Main was source-rechecked; runtime observations are from the baseline, not a fresh main build. The latest published release checked was also 6.7.0.Runtime and platform
Node.js v24.18.0 (repository pin); macOS 27.0.1 arm64. An earlier independent run with Node.js v26.12.0 produced the same refusal. Hopper/Ghidra are not involved.
Target and artifact context
Locally generated 309-byte ZIP beginning with
#!/bin/shandexit 0, followed by ZIP structures. Its first local header is at offset 17; actual and declared central-directory offsets are 135; the first declared local-header offset is 17. Members area.txt,d/, andd/b.txt. The 292-byte plain control contains identical member bytes. No private target data is needed.Interface
CLI
Earliest failure stage
Setup or provider admission
Relevant output or evidence
Observed on both prefixed CLI calls (exit 1; operand path omitted):
unzip -l,unzip -t,zipinfo -1,bsdtar -tf, and Python zipfile all accept the offset-correct prefixed input with exit 0 and no warning. The plain REA inspection returns the root plus three members, with directoryd/normalized tod; extraction producesa.txt=hello world\nandd/b.txt=x\n. Evidence provenance: observed; local verification: independently reproduced and replayed at submission.Typed outcome or recovery expected
Return inventory and extraction results for the original prefixed container, preserving its identity and regular-file bytes. Proposed restoration check: rerun both operations on that same input and compare member hashes with the plain control; preserve rejection of inputs without valid ZIP structures. Rewriting the input as an ordinary ZIP is a workaround, not proof that the original container is supported.
Analysis or suspected cause
Source-derived reasoning:
src/application/BinaryTargetResolver.ts:186-214,317-333checkshasZipSignatureon a 4 KiB leading window before selecting an archive target.src/domain/zipPackageFormat.ts:20-28examines only bytes 0-3. This rejects the prefix before the ZIP reader is reached. Root inventory separately uses the same predicate atsrc/artifacts/inventory/classify.ts:163, initially on an 8 KiB classification prefix; that downstream path was not reached by these failing CLI calls. The admission predicate belongs to REA; no bundled dependency was identified as the cause.Additional context
Prepared with AI assistance and independent verification. No earlier known-good REA version or successful restoration was established. Simply concatenating a prefix with a finished ZIP also fails, but leaves stored offsets unadjusted and triggers an Info-ZIP warning; this report instead uses the offset-correct construction above.
Distinct from #4124 / #4126 (current-directory prefixes inside member names) and #2330 / #1485 / #2059 (non-entry coverage reporting). #1491 concerns false format claims based only on filename suffixes. This report asks to recognize a valid ZIP structure, not to trust its suffix or inventory the prefix as a member. #4554 concerns a dedicated CRX/XPI manifest inspector, not admission of a ZIP with an inert executable prefix.
@xu91102 commented on GitHub (Oct 21, 2026):
Independently reproduced on built main
d0067ba34a39ea47dd7e11bb2e6169bc0938cc3f, macOS arm64, Node 24.18.0. The same Pythonzipfile-created member list passes bothinspect-artifactandextract-artifactwithout a prefix (exit 0), but adding a 17-byte inert shell prefix through the ZIP writer makes both commands returntarget_unavailable/unsupported binary format(exit 1). Pythonzipfile.testzip()and exact member-byte reads accept both originals. A truncated-marker negative control is refused by both commands. All six CLI calls preserve input SHA-256. The prefix was never executed. This confirms the reported root-admission failure on this captured main; installed-package/MCP and a fix have not been tested yet. I am preparing a shared recognition fix; no upstream PR exists from my branch yet.Local source preparation update (2026-10-21)
The shared root-input fix is now committed and normally pushed to my fork:
github.com/xu91102/rea@a23559d861. The final source is based ond0067ba34a39ea47dd7e11bb2e6169bc0938cc3f. It recognizes an EOF ZIP end record only for an otherwise unrecognized root, retains the complete carrier hash, and delegates directory/member validation to the existing ZIP reader. Native-format refusals and established ASAR/plist/map/JavaScript filename routing retain their previous behavior; no prefix is executed.Final validation: 14 focused files / 197 PASS, plus five fresh README checks (15 distinct files / 202 PASS / 0 skip). Check, docs, discovery (1,880 files once), installed-package verification and explicit pack dry run pass. The same original six compiled CLI controls and two ASAR-preservation controls pass; a fresh tarball's 1,974 installed files match, six installed CLI controls and one real stdio MCP session (four open/inspect/extract/close calls) preserve source hashes and exact member bytes. The package reports 212 tools and six prompts. Independent Standards and Spec review of the final frozen patch both pass. Two review-found routing regressions were first reproduced and then fixed at their shared owners.
This is fork source preparation, not an upstream PR or upstream CI result. I have not created an upstream PR for this fix because the account's three existing open PRs are unchanged and no new legitimate capacity restoration is established. Full agent/model workflows, Windows/Linux runtime, native installer launch, nested prefixed carriers and performance qualification were not run. An earlier excluded harness run's full log was accidentally overwritten and only its original tail recovered; current acceptance has separate complete final logs, with original product/review regression failures retained.
2026-10-21: overlapping upstream implementation; local branch held
I have read the complete production diff of #5803 at
93e55760ef7a6daa23e630afcfc22c36f4f391ed(kaoru0822-kitauji). It addresses the same ZIP root-admission problem inBinaryTargetResolverand inventory classification, using a trailing-directory locator and shared ZIP root roles. That algorithm differs from my footer-admission helper, but the production root overlaps, so I have put my fork branch ata23559d8617ee1e06fae036e12e5be1ab34e5570on read-only hold and will not submit a duplicate PR or repackage residual cases.At this check #5803 is open and unmerged. I have not run its head and do not claim it covers every local control, uses my source, or gives me author credit. My previous results remain evidence only for my frozen local branch; no upstream PR or CI was created for that branch. The issue state is unchanged by this update.
2026-10-22: upstream implementation merged; local hold continues
PR #5803 was merged on 2026-10-21 at 12:06:29 UTC as
35d6d5bb0acaf8cd99399c1167dfef309d6add19, and this issue was closed at 12:06:30 UTC. I read the complete actual merge patch, including its four production files, and confirmed that commit is an ancestor of the captured current main421d527bfefa7c268ccb1e6aca68d59e45ebe643. Its shared root-admission and root-format changes address the same reported problem.My branch remains read-only at
a23559d8617ee1e06fae036e12e5be1ab34e5570; I did not create an upstream PR, close this issue, or execute the foreign or merged ZIP workflow. My earlier local tests and package/MCP results do not qualify the merged implementation. Adoption of my fork source or author credit is not established. I will not repackage residual ZIP/native/ASAR/CLI/MCP/docs cases as a replacement contribution.@XinwangTao commented on GitHub (Oct 21, 2026):
Supporting the recognition fix direction. A prefixed ZIP (self-extracting style) is a legitimate, widely-produced format — Info-ZIP and bsdtar read it without warnings, so rejecting on a plain PK magic check will keep tripping real artifacts. The fix should locate the End of Central Directory record from the tail and derive the start offset from its fields, instead of requiring the archive at byte 0. One caution: once prefixed ZIPs are admitted, extraction must keep the zip-slip / path-containment checks and ideally verify the central directory offsets against the actual file length, otherwise a truncated marker plus a forged EOCD could bypass the negative control you mentioned.