mirror of
https://github.com/morluto/rea.git
synced 2026-11-05 06:45:22 +00:00
[GH-ISSUE #5659] [Bug] Firmware publication timeout can crash the CLI before returning its timeout result #3429
Closed
opened 2026-10-31 00:40:22 +00:00 by bsakaguchi
·
3 comments
No Branch/Tag specified
main
codex/procedure-reference-stacked
release-please--branches--main--components--rea-agents
release-please--branches--main--components--rea-agents--release-notes
codex/kuna-independent-retry
codex/byte-search-overlay-coverage
codex/open-failure-target-receipt
codex/kuna-xref-evidence
codex/ghidra-ambiguous-procedure-recovery
codex/function-source-bundle
codex/trace-function-integration-prototype
codex/snapshot-source-closure
codex/recorded-evidence-array-pages
codex/evidence-recovery-redesign
codex/trace-feature-address-scope
codex/call-discovery-scope
codex/ghidra-literal-candidate-evidence
codex/decompile-directory-independent-retry
codex/retry-provenance-base
codex/value-flow-capability-experiment
codex/ghidra-containing-instruction
cursor/readme-discord-button-ef9f
dependabot/github_actions/actions/setup-node-7.1.0
dependabot/github_actions/actions/upload-artifact-7.0.2
dependabot/npm_and_yarn/npm-minor-and-patch-d8d97ce6df
codex/kuna-1989
fix/8559-native-ui-fixture-ownership
fix/8555-go-verifier-mcp-ownership
codex/provider-capability-recovery
fix/8642-rizin-target-stdin
codex/ghidra-memory-effect-scope
codex/ghidra-annotation-entry-selector
codex/ghidra-readonly-recovery
codex/ghidra-regex-verifier-recovery
codex/evidence-discovery-view-guidance
fix/8545-bulk-append-overflow
fix/8428-navigation-refusal-alternatives
codex/address-context-recovery
codex/matching-member-limitations
codex/unknown-scope-contract
codex/evidence-view-guidance
feat/8373-native-trace-views
codex/ghidra-snapshot-verifier-binding
codex/elf-export-visibility
codex/evidence-view-recovery
codex/native-reference-cli-help
codex/provider-candidate-observation-scope
codex/kuna-session-verification
codex/ghidra-switch-lifetime-guidance
codex/pseudocode-paging-discovery
codex/clarify-evidence-view-support
codex/kuna-xrefs-selector-recovery
codex/context-capacity-recovery
codex/evidence-closure-large-links
codex/same-function-evidence-identity
codex/ghidra-verifier-inspected-jdk
codex/audit-guided-workflows
codex/crash-prompt-retained-dossiers
codex/analysis-view-error-recovery
codex/kuna-verifier-target-selection
codex/ghidra-selected-project-call-coverage
codex/docs-native-analysis-scope
codex/ghidra-java-socket-boundary
codex/ghidra-retained-snapshot-verifier
codex/ghidra-search-inventory-facts
fix/8284-zero-argument-parameter-bindings
fix/8198-ui-action-handler-offset
fix/8257-elf-entry-label-identity
fix/8304-deferred-output-schema-projection
fix/8277-call-path-computed-target-uncertainty
fix/pr-8089-conflicts
fix/ci-static-duplicate-export
dependabot/npm_and_yarn/lint-staged-17.6.0
dependabot/github_actions/actions/download-artifact-8.0.2
dependabot/npm_and_yarn/write-file-atomic-8.0.0
dependabot/npm_and_yarn/canonicalize-5.1.0
dependabot/github_actions/actions/cache/restore-6.1.0
dependabot/npm_and_yarn/toon-format/toon-4.4.0
dependabot/github_actions/actions/deploy-pages-5.0.1
codex/review-fixes-pr-2403
codex/review-fixes-pr-2400
codex/process-terminal-width
codex/test-brittleness-cleanup
verify/7167-browser-connect-macos
fix/7167-browser-connect
feat/native-matching-allowance-setting
feat/browser-scenario-dry-run
test/managed-caller-parameters-20261024
codex/parser-fortythird-boundaries
fix/6926-pinvoke-platform-decorations-20261023
fix/6889-har-body-encoding-20261023
fix/6888-sqlite-schema-budget-20261023
fix/dependency-security-gates-6708
cursor/evidence-overwrite-rebase-b4ac
feat/4057-verify-native-exports
fix/windows-acl-observer-overhead-20261022
cursor/erlang-beam-restack-4476
cursor/pe-certificate-review-bf32
fix/6116-javascript-application-fs-errors
fix/6061-unmapped-runtime-script-unknown
feat/browser-scenario-summary
fix/pe-certificates
codex/verify-3407
cursor/rebase-5699
cursor/rebase-5352
cursor/rebase-5600
cursor/fix-cli-schema-omission-10a8
codex/audit-hopper-shutdown-reasons-20261021
fix/demangle-swift-omitted-record
fix/nib-boolean-value-types
cursor/cancellation-partial-observation-a5ac
fix/ib-object-limit-reasons
fix/electron-fuse-limit-advice
fix/kuna-doctor-dangling-cache
fix/fixed-budget-refusal-advice
fix/js-ipc-listener-dedup
fix/js-return-member-provenance
fix/dmg-integrity-retry-advice
fix/ida-doctor-readiness
fix/kuna-version-probe-output-drain
fix/legacy-swift-runtime-name-matching
fix/dylib-lazy-load-commands
fix/browser-scenario-startup-cancel
fix/swift-nested-punycode-classification
fix/compare-unselected-scopes
fix/objc-method-budget-coverage
fix/dmg-mounted-root-observations
audit/ci-tests-20261019-round2
release/6.7.0
fix/wabt-cleanup-retry-resolution
fix/electron-fuse-elf-pe-architecture
fix/native-plist-descriptor-ownership
fix/kuna-caller-cleanup-ownership
experiment/atomic-codemode-20261016
review/first-contributor-3776
fix/call-resolution-full-read-cycles
fix/member-mutation-selection-repeat
experiment/atomic-re-tools-20261015
perf/member-mutation-lazy-origins
perf/static-network-mutation-index
fix/hopper-startup-lifecycle
audit/3050-windows-proof-20261015
feat/windows-window-capture-2183
audit/3049-windows-proof-20261015
audit/3735-macos-fixtures-20261015
fix/batch-decompile-null-pseudocode
fix/kuna-inventory-honors-jobs
experiment/browser-codemode-tool-design-20261015
fix/hopper-clean-runtime-argv
codex/review-2049-27f1b367
review-fixes/pr-2787-routing
fix/3360-scoped-this-emitters
fix/3367-replaced-global-effects
fix/3838-compact-any-value-items
test/hopper-download-probe-20261015
codex/windows-runtime-creation-red-green-20261015
codex/windows-readonly-root-red-green-20261015
codex/windows-root-share-red-green-20261015
codex/exp-1685-win-mcp-startup
codex/bug-sweep-20261015
investigate/2190-windows-package-phases
investigate/3543-macos-cli-deadline
perf/3281-reverse-tools-feedback-quality
fix/3406-hopper-doctor-fixture
fix/3341-wrapper-require-test-context
fix/3301-owned-uninstall-fixtures
fix/3164-compiler-input-ownership
fix/pcap-cleanup-stdout-newline-20261014
perf/interface-builder-summary
codex/review-fixes-pr-1977
fix/ghidra-effective-jvm-platform
fix/docs-turkish-rust-link-20261013
fix/main-maintenance-ci-20261010
fix/recover-binary-session-process-effects
codex/review-fixes-pr-2457
codex/ci-required-cancellation-gate
fix/main-format-baseline-20261013
fix/setup-preserve-entry-fields
cursor/restore-main-checks-1ffc
fix/ghidra-bridge-hashmap-import
codex/shared-ci-jadx-json-default-20261013
codex/shared-ci-ghidra-test-groups-20261013
codex/shared-ci-java-fixture-format-20261013
codex/fix-intrinsic-invocation-boundaries
test/release-preflight-reusable-jobs
test/js-parameter-provenance-expectation
fix/linux-hopper-verification-current
test/2419-ghidra-elf-probe-size
followup/pr-1544-native-ida
codex/fold-pr-2230-contribution
docs/readme-responsible-use
fix/issue-2064
fix/issue-2050
fix/issue-2053
fix/issue-1968
fix/issue-1945
experiment/codemode-bridge-20261011
fix/tool-effects-negative-wording-1904-20261012
fix/1842-electron-interop-provenance
feat/recover-javascript-multi-input
refactor/website-i18n-prep
fix/nativeaot-pe-virtual-extent
fix/browser-verifier-ci-hang
fix/pe-resources-input-selection
docs/beginner-friendly-guides
docs/beginner-setup-guide
fix/javascript-analysis-worker-1563
fix/1649-ghidra-duplicate-names
fix/javascript-export-keys-integration-1369
test/maintenance-boundary-contracts-20261011
review/javascript-export-keys-1369
review/process-live-progress-1483
test/javascript-1495-growth-ratio
fix/ci-escape-timing
docs/normalized-terminal-geometry-1450
release/6.3.0
archive/release-6.3.0-pr1381
release/6.2.0
fix/electron-preload-dynamic-override
fix/javascript-self-referential-bundler-edges
release/6.1.0
cursor/grok-client-cherry-pick-0b56
feat/signature-posture
feat/dyld-shared-cache
feat/artifact-integrity-policy
feat/pkg-inventory
release/6.0.0
chore/sync-release-5.0.0
release/5.0.0
cursor/cloud-agent-node-787e
fix/javascript-xhr-open-endpoints
review/pr-711-realpath-fallback-wording
cleanup/replay-confinement
codex/test-suite-performance
codex/issue-foundations
codex/address-open-issues-2026-07-20
agent/javascript-vite-rollup-esbuild-adapters
agent/process-cleanup
agent/triage-integration
agent/unknown-commands-registry
feat/mcp-identity-metadata
morlvps/issue_cleanup
codex/installer-redesign
morl/roadmap-investigation-core
morl/roadmap-investigation-docs
release-please--branches--main--components--rea
rea-agents-6.8.0
rea-agents-6.7.0
rea-agents-6.6.0
experiment/atomic-codemode-wait-runtime-20261016
rea-agents-6.5.0
rea-agents-6.4.0
rea-agents-6.3.0
rea-agents-6.2.0
rea-agents-6.1.0
rea-agents-6.0.0
rea-agents-5.0.0
rea-agents-4.1.0
rea-agents-4.0.1
rea-agents-4.0.0
rea-agents-3.2.1
rea-agents-3.2.0
rea-agents-3.1.0
rea-agents-3.0.0
rea-agents-2.7.0
rea-agents-2.6.0
rea-agents-2.5.1
rea-agents-2.5.0
rea-agents-2.4.0
rea-agents-2.3.0
rea-agents-2.2.0
rea-agents-2.1.0
rea-agents-2.0.0
rea-agents-1.7.0
rea-agents-1.6.0
rea-agents-1.5.0
rea-agents-1.4.0
rea-agents-1.3.0
rea-agents-1.2.0
rea-agents-1.1.0
rea-agents-1.0.0
rea-agents-0.5.0
rea-agents-0.4.0
rea-agents-0.3.0
rea-0.2.1
rea-0.2.0
Labels
Clear labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
Mirrored from GitHub Pull Request
question
roadmap
triage
No labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
question
roadmap
triage
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set.
Reference
morluto/rea#3429
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @coygeek on GitHub (Oct 20, 2026).
Original GitHub issue: https://github.com/morluto/rea/issues/5659
Before submitting
Area
Evidence, artifacts, or reconstruction
Observed behavior
extract-firmware --publication-timeout-ms 1 --jsoncan exit with an unhandled Node.js Readable error instead of returning its structured publication timeout. The failing call emits no JSON and leaves its newly created output directory behind.Independent verification reproduced this through the unmodified CLI on Linux after successful extraction by a Python gzip stand-in. The stand-in actually decompresses the input and emits matching task, stat, hash and chunk records; it introduces no delay or injected failure. Real Unblob was not run. The submission recheck below inspected current source and the retained verification logs; it did not rerun the container.
Reproduction
Run from the source checkout root with locked dependencies installed and CLI built, on Linux with Node.js, Python 3, util-linux
prlimitand procpsps. Use a container-local filesystem for the working directory. Binwalk is not required for extraction.errexit, since timeout calls intentionally exit 1:In the independent container-local 1 ms run, attempt 28 of 60 crashed; the other 59 returned structured timeouts and removed their output trees. A separate shared-filesystem 1 ms run returned 40 structured timeouts in 40 calls without crashing. An additional container-local 60-call run using budgets
2+i%9ms crashed seven times, returned 51 structured timeouts and completed twice. These are bounded samples, not estimated failure rates. The 60000 ms control succeeded and published all 3400 bytes matching independent Python gzip decompression.Expected behavior
A deadline expiring during publication setup or copying should return structured
provider_timeoutJSON identifying phasepublicationand verified-file progress, and roll back failed uncommitted output. Accepted publication budgets include 1 ms.Source contract at the verified baseline: rollback, valid budgets and timeout progress, and typed publication timeout construction.
Impact and scope
P2: some accepted short publication budgets terminate the operation without its timeout result or rollback. No loss of preexisting data or security boundary crossing was observed. A larger budget and fresh absent destination provide a demonstrated workaround: the 60000 ms control succeeded. Default-budget incidence, real Unblob, Linux x64 and MCP behavior were not tested. The source admits Linux without an architecture restriction; documentation describes Linux x64 as its verified lane.
REA version
rea-agents6.7.0, source commit5b676ba9f302228b44c28ab076525abed3e647c1(runtime reproduction). Currentorigin/main1629266e3c08c90fed6bba5383528af7986a12b7is also 6.7.0: fetched and read all five cited source files; no changes to them since the baseline. No runtime rebuild or rerun was needed for this source recheck.Runtime and platform
Reproduction: Node.js v24.18.0, Linux arm64 in Docker, real util-linux
prlimitand procpsps, Python 3 gzip stand-in reporting version 26.6.4. Checkout mounted read-only; networking disabled. Submission host only:node --versionv26.12.0,sw_vers -productVersion27.0.1,uname -marm64; no macOS firmware reproduction claimed.Target and artifact context
Synthetic nonempty gzip input made from
b"firmware payload\n" * 200; one regular decompressedpayloadfile, 3400 bytes. No target execution. Each destination is initially absent and absolute, with an existing parent.Interface
CLI
Earliest failure stage
Cleanup, cancellation, or lifecycle
Relevant output or evidence
Retained independent verification logs show the container-local 1 ms attempt 28 exited 1, wrote zero stdout bytes, and left its output directory present. The same signature appears in the additional 2–10 ms run:
The successful control returned extraction Evidence, empty stderr, and byte-identical decompressed output. The other 59 calls in the 1 ms container-local run returned
provider_timeout, phasepublication, with no leftover destination. These observations come from the independent verifier's retained logs and control checks, not a new submission-time execution.Typed outcome or recovery expected
Always emit a valid JSON result. On timeout, return
provider_timeout, publication phase and verified-file progress, then remove the uncommitted output tree. Successful calls must continue publishing the verified bytes. A proposed restoration check is to repeat the bounded loops and byte-equality control, then separately check the documented Linux x64 lane with real Unblob.Analysis or suspected cause
Source-derived reasoning: FirmwareFiles.ts:179–185 creates the cancellation-bound source before passing it to the writer. SafeOutputTree.ts:178–218 awaits destination setup before attaching its async consumer. Meanwhile readFileHandleChunks.ts:98–108 can destroy the unread stream with a cancellation error. This leaves a gap in which the timeout can emit an unhandled error before the normal typed failure and rollback path settles. The stack agrees with this sequence. No bundled dependency is identified as the cause.
Additional context
Related #4176 / #4602 separated the analysis and publication deadlines; this report concerns an unhandled source-stream error after the separate publication budget starts. #4558 / #4563 concern cleanup-retry test expectations; #4475 and open #4493 concern descriptor-close ownership and readback cancellation, rather than this pre-consumption error event. Their descriptions do not cover this trigger and failure path.
Prepared with AI assistance using an independently verified reproduction. Last known good version is unknown. Real-provider conformance and a successful fix have not been established.
@matbrgz commented on GitHub (Oct 20, 2026):
Cross-referencing with canonical issue #4558 (
[Bug] firmwareIntegration publication cleanup-retry tests fail deterministically since 2d163c12). Both uncover stream handling, publication lifecycle, and unhandled timeout failure boundaries during firmware extraction. Cataloged under Cluster BU in consolidation tracker #4330.@CassieFox23 commented on GitHub (Oct 20, 2026):
TL;DR: This still happens on main on Linux. With a publication budget of 2 to 10 ms, the CLI sometimes crashes with an unhandled Readable error. It prints no JSON and leaves the output folder behind.
Checked on main
dceefa22cwith a gzip stand-in for Unblob, written like the one in the report. Each call used a fresh absent output folder. The budgets were2 + i % 9ms, so 2 to 10 ms, as in the report's extra run.provider_timeoutUnhandled 'error' eventandArtifactReaderFailure: Artifact file read cancelled. The cause was aTimeoutError, like the report.Separate note: in some timeout runs (16 on Node 24, 27 on Node 22, 15 on Node 26) the output folder stayed. It held the full 3,400-byte payload. The message said "Extraction already completed." I did not check if that is meant to happen.
Not run
Thanks, coygeek, for the detailed report and the loop.
Commands
The loop ran in a Python script, not a shell loop. Each call had an isolated HOME, XDG and TMPDIR under /tmp. Crash stderr, trimmed:
Test setup
dceefa22c🤖 Written and tested with Claude Code (Sonnet 5.5, verified by Opus 5.5), posted with my OK 🦊
@coygeek commented on GitHub (Oct 24, 2026):
Checked the reported fix on
mainatd87e73f2db.The firmware publisher now passes a lazy outer Readable to the tree and creates the abort-bound descriptor stream only when consumption begins. This removes the exact pre-consumption error-emission gap identified in the report. Its deterministic regression aborts at tree.write handoff, yields an event-loop turn with no consumer, then checks a typed cancellation with exact reason, rollback and unchanged input.
Implementation: FirmwareFiles.ts, firmwareReportFiles.test.ts.
The relevant regression checks in firmwareReportFiles.test.ts passed in the focused test run on this revision. This closure is based on the current source and those checks; provider fixtures do not establish a real-engine run. Closing as completed on main.