mirror of
https://github.com/morluto/rea.git
synced 2026-11-05 06:45:22 +00:00
[PR #2117] [MERGED] fix(wasm): report WABT output past its budget as a resource constraint #5041
Closed
opened 2026-10-31 01:00:15 +00:00 by bsakaguchi
·
0 comments
No Branch/Tag specified
main
codex/procedure-reference-stacked
release-please--branches--main--components--rea-agents
release-please--branches--main--components--rea-agents--release-notes
codex/kuna-independent-retry
codex/byte-search-overlay-coverage
codex/open-failure-target-receipt
codex/kuna-xref-evidence
codex/ghidra-ambiguous-procedure-recovery
codex/function-source-bundle
codex/trace-function-integration-prototype
codex/snapshot-source-closure
codex/recorded-evidence-array-pages
codex/evidence-recovery-redesign
codex/trace-feature-address-scope
codex/call-discovery-scope
codex/ghidra-literal-candidate-evidence
codex/decompile-directory-independent-retry
codex/retry-provenance-base
codex/value-flow-capability-experiment
codex/ghidra-containing-instruction
cursor/readme-discord-button-ef9f
dependabot/github_actions/actions/setup-node-7.1.0
dependabot/github_actions/actions/upload-artifact-7.0.2
dependabot/npm_and_yarn/npm-minor-and-patch-d8d97ce6df
codex/kuna-1989
fix/8559-native-ui-fixture-ownership
fix/8555-go-verifier-mcp-ownership
codex/provider-capability-recovery
fix/8642-rizin-target-stdin
codex/ghidra-memory-effect-scope
codex/ghidra-annotation-entry-selector
codex/ghidra-readonly-recovery
codex/ghidra-regex-verifier-recovery
codex/evidence-discovery-view-guidance
fix/8545-bulk-append-overflow
fix/8428-navigation-refusal-alternatives
codex/address-context-recovery
codex/matching-member-limitations
codex/unknown-scope-contract
codex/evidence-view-guidance
feat/8373-native-trace-views
codex/ghidra-snapshot-verifier-binding
codex/elf-export-visibility
codex/evidence-view-recovery
codex/native-reference-cli-help
codex/provider-candidate-observation-scope
codex/kuna-session-verification
codex/ghidra-switch-lifetime-guidance
codex/pseudocode-paging-discovery
codex/clarify-evidence-view-support
codex/kuna-xrefs-selector-recovery
codex/context-capacity-recovery
codex/evidence-closure-large-links
codex/same-function-evidence-identity
codex/ghidra-verifier-inspected-jdk
codex/audit-guided-workflows
codex/crash-prompt-retained-dossiers
codex/analysis-view-error-recovery
codex/kuna-verifier-target-selection
codex/ghidra-selected-project-call-coverage
codex/docs-native-analysis-scope
codex/ghidra-java-socket-boundary
codex/ghidra-retained-snapshot-verifier
codex/ghidra-search-inventory-facts
fix/8284-zero-argument-parameter-bindings
fix/8198-ui-action-handler-offset
fix/8257-elf-entry-label-identity
fix/8304-deferred-output-schema-projection
fix/8277-call-path-computed-target-uncertainty
fix/pr-8089-conflicts
fix/ci-static-duplicate-export
dependabot/npm_and_yarn/lint-staged-17.6.0
dependabot/github_actions/actions/download-artifact-8.0.2
dependabot/npm_and_yarn/write-file-atomic-8.0.0
dependabot/npm_and_yarn/canonicalize-5.1.0
dependabot/github_actions/actions/cache/restore-6.1.0
dependabot/npm_and_yarn/toon-format/toon-4.4.0
dependabot/github_actions/actions/deploy-pages-5.0.1
codex/review-fixes-pr-2403
codex/review-fixes-pr-2400
codex/process-terminal-width
codex/test-brittleness-cleanup
verify/7167-browser-connect-macos
fix/7167-browser-connect
feat/native-matching-allowance-setting
feat/browser-scenario-dry-run
test/managed-caller-parameters-20261024
codex/parser-fortythird-boundaries
fix/6926-pinvoke-platform-decorations-20261023
fix/6889-har-body-encoding-20261023
fix/6888-sqlite-schema-budget-20261023
fix/dependency-security-gates-6708
cursor/evidence-overwrite-rebase-b4ac
feat/4057-verify-native-exports
fix/windows-acl-observer-overhead-20261022
cursor/erlang-beam-restack-4476
cursor/pe-certificate-review-bf32
fix/6116-javascript-application-fs-errors
fix/6061-unmapped-runtime-script-unknown
feat/browser-scenario-summary
fix/pe-certificates
codex/verify-3407
cursor/rebase-5699
cursor/rebase-5352
cursor/rebase-5600
cursor/fix-cli-schema-omission-10a8
codex/audit-hopper-shutdown-reasons-20261021
fix/demangle-swift-omitted-record
fix/nib-boolean-value-types
cursor/cancellation-partial-observation-a5ac
fix/ib-object-limit-reasons
fix/electron-fuse-limit-advice
fix/kuna-doctor-dangling-cache
fix/fixed-budget-refusal-advice
fix/js-ipc-listener-dedup
fix/js-return-member-provenance
fix/dmg-integrity-retry-advice
fix/ida-doctor-readiness
fix/kuna-version-probe-output-drain
fix/legacy-swift-runtime-name-matching
fix/dylib-lazy-load-commands
fix/browser-scenario-startup-cancel
fix/swift-nested-punycode-classification
fix/compare-unselected-scopes
fix/objc-method-budget-coverage
fix/dmg-mounted-root-observations
audit/ci-tests-20261019-round2
release/6.7.0
fix/wabt-cleanup-retry-resolution
fix/electron-fuse-elf-pe-architecture
fix/native-plist-descriptor-ownership
fix/kuna-caller-cleanup-ownership
experiment/atomic-codemode-20261016
review/first-contributor-3776
fix/call-resolution-full-read-cycles
fix/member-mutation-selection-repeat
experiment/atomic-re-tools-20261015
perf/member-mutation-lazy-origins
perf/static-network-mutation-index
fix/hopper-startup-lifecycle
audit/3050-windows-proof-20261015
feat/windows-window-capture-2183
audit/3049-windows-proof-20261015
audit/3735-macos-fixtures-20261015
fix/batch-decompile-null-pseudocode
fix/kuna-inventory-honors-jobs
experiment/browser-codemode-tool-design-20261015
fix/hopper-clean-runtime-argv
codex/review-2049-27f1b367
review-fixes/pr-2787-routing
fix/3360-scoped-this-emitters
fix/3367-replaced-global-effects
fix/3838-compact-any-value-items
test/hopper-download-probe-20261015
codex/windows-runtime-creation-red-green-20261015
codex/windows-readonly-root-red-green-20261015
codex/windows-root-share-red-green-20261015
codex/exp-1685-win-mcp-startup
codex/bug-sweep-20261015
investigate/2190-windows-package-phases
investigate/3543-macos-cli-deadline
perf/3281-reverse-tools-feedback-quality
fix/3406-hopper-doctor-fixture
fix/3341-wrapper-require-test-context
fix/3301-owned-uninstall-fixtures
fix/3164-compiler-input-ownership
fix/pcap-cleanup-stdout-newline-20261014
perf/interface-builder-summary
codex/review-fixes-pr-1977
fix/ghidra-effective-jvm-platform
fix/docs-turkish-rust-link-20261013
fix/main-maintenance-ci-20261010
fix/recover-binary-session-process-effects
codex/review-fixes-pr-2457
codex/ci-required-cancellation-gate
fix/main-format-baseline-20261013
fix/setup-preserve-entry-fields
cursor/restore-main-checks-1ffc
fix/ghidra-bridge-hashmap-import
codex/shared-ci-jadx-json-default-20261013
codex/shared-ci-ghidra-test-groups-20261013
codex/shared-ci-java-fixture-format-20261013
codex/fix-intrinsic-invocation-boundaries
test/release-preflight-reusable-jobs
test/js-parameter-provenance-expectation
fix/linux-hopper-verification-current
test/2419-ghidra-elf-probe-size
followup/pr-1544-native-ida
codex/fold-pr-2230-contribution
docs/readme-responsible-use
fix/issue-2064
fix/issue-2050
fix/issue-2053
fix/issue-1968
fix/issue-1945
experiment/codemode-bridge-20261011
fix/tool-effects-negative-wording-1904-20261012
fix/1842-electron-interop-provenance
feat/recover-javascript-multi-input
refactor/website-i18n-prep
fix/nativeaot-pe-virtual-extent
fix/browser-verifier-ci-hang
fix/pe-resources-input-selection
docs/beginner-friendly-guides
docs/beginner-setup-guide
fix/javascript-analysis-worker-1563
fix/1649-ghidra-duplicate-names
fix/javascript-export-keys-integration-1369
test/maintenance-boundary-contracts-20261011
review/javascript-export-keys-1369
review/process-live-progress-1483
test/javascript-1495-growth-ratio
fix/ci-escape-timing
docs/normalized-terminal-geometry-1450
release/6.3.0
archive/release-6.3.0-pr1381
release/6.2.0
fix/electron-preload-dynamic-override
fix/javascript-self-referential-bundler-edges
release/6.1.0
cursor/grok-client-cherry-pick-0b56
feat/signature-posture
feat/dyld-shared-cache
feat/artifact-integrity-policy
feat/pkg-inventory
release/6.0.0
chore/sync-release-5.0.0
release/5.0.0
cursor/cloud-agent-node-787e
fix/javascript-xhr-open-endpoints
review/pr-711-realpath-fallback-wording
cleanup/replay-confinement
codex/test-suite-performance
codex/issue-foundations
codex/address-open-issues-2026-07-20
agent/javascript-vite-rollup-esbuild-adapters
agent/process-cleanup
agent/triage-integration
agent/unknown-commands-registry
feat/mcp-identity-metadata
morlvps/issue_cleanup
codex/installer-redesign
morl/roadmap-investigation-core
morl/roadmap-investigation-docs
release-please--branches--main--components--rea
rea-agents-6.8.0
rea-agents-6.7.0
rea-agents-6.6.0
experiment/atomic-codemode-wait-runtime-20261016
rea-agents-6.5.0
rea-agents-6.4.0
rea-agents-6.3.0
rea-agents-6.2.0
rea-agents-6.1.0
rea-agents-6.0.0
rea-agents-5.0.0
rea-agents-4.1.0
rea-agents-4.0.1
rea-agents-4.0.0
rea-agents-3.2.1
rea-agents-3.2.0
rea-agents-3.1.0
rea-agents-3.0.0
rea-agents-2.7.0
rea-agents-2.6.0
rea-agents-2.5.1
rea-agents-2.5.0
rea-agents-2.4.0
rea-agents-2.3.0
rea-agents-2.2.0
rea-agents-2.1.0
rea-agents-2.0.0
rea-agents-1.7.0
rea-agents-1.6.0
rea-agents-1.5.0
rea-agents-1.4.0
rea-agents-1.3.0
rea-agents-1.2.0
rea-agents-1.1.0
rea-agents-1.0.0
rea-agents-0.5.0
rea-agents-0.4.0
rea-agents-0.3.0
rea-0.2.1
rea-0.2.0
Labels
Clear labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
Mirrored from GitHub Pull Request
question
roadmap
triage
No labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
question
roadmap
triage
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set.
Reference
morluto/rea#5041
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
📋 Pull Request Information
Original PR: https://github.com/morluto/rea/pull/2117
Author: @JayOfTheKeyboard
Created: 10/12/2026
Status: ✅ Merged
Merged: 10/13/2026
Merged by: @morluto
Base:
main← Head:fix/wasm-output-limit📝 Commits (10+)
c1e7292fix(wasm): report WABT output past its budget as a resource constrainte8fba3afix(wasm): keep observed sizes and whole code points in output-limit excerptsadcb053fix(wasm): match sibling captured-output fields for WABT output limits463a917docs(wasm): scope the output-budget error to inspection commands913cd9cchore: merge upstream CI baseline fixesb266431docs(wasm): distinguish reported warm costs from unmeasured gapsc5beb60docs(wasm): clarify the scope of reported warm measurements5eeccabchore: merge captured monotonic deadline fixesab9214aMerge commit '8fef2aa64e' into HEAD15a783fMerge branch 'main' into fix/wasm-output-limit📊 Changes
3 files changed (+219 additions, -9 deletions)
View changed files
📝
docs/wasm-artifacts.md(+18 -3)📝
src/wasm/WabtArtifactProvider.test.ts(+156 -0)📝
src/wasm/WabtFailures.ts(+45 -6)📄 Description
Summary
inspect-wasm-artifactreports the wrong kind of failure when a module's WABT output is larger than the 32 MiB output budget. It returnsunreadable_output, tells the caller to runrea doctor, and puts the first 33,554,432 bytes of WAT intodetails.captured_output.stdout, so the error is 33.6 MB of JSON. No issue is linked. I found this by running the tool over the real.wasmfiles on one machine, and the fix is small enough to explain here.Problem and expected behavior
runOwnedCommandstops a WABT command when its output passesWABT_LIMITS.outputBytes(32 MiB) and throwsOwnedCommandFailurewith reasonoutput-limit.wabtFailureinsrc/wasm/WabtFailures.tshas branches forcancelled,timeoutandprocess, and none foroutput-limit. The failure falls through toAnalysisOutputError, which the CLI shows as an unreadable result, with all of the retained stdout attached.The budget works as documented. The caller is told the result was unreadable when that documented limit was hit, and gets back the partial WAT that the limit exists to refuse.
3 of the 28 valid modules I ran hit this. All three are tree-sitter grammars. Sizes from WABT 1.0.42 run directly:
wasm2wat --enable-allbyteswasm-objdump -h -xbytestree-sitter-cpp.wasm(VS Code Copilot)tree-sitter-bash.wasm(@vscode/tree-sitter-wasm)tree-sitter-powershell.wasm(@vscode/tree-sitter-wasm)Expected: an error that says which limit was hit and does not carry 32 MiB of partial output. The apktool provider (
src/apktool/ApktoolProvider.ts) and the native macOS provider (src/native/NativeMacOSProvider.ts) already mapoutput-limittoAnalysisResourceConstraintErrorwith resourcememoryandmax_output_bytes.Change and scope
wabtFailuremapsoutput-limittoAnalysisResourceConstraintError, as apktool and native macOS do. The message gives the budget in bytes, andreported_limitscarriesmax_output_bytes.memoryconstraint says to retry with more memory, and no memory setting changes this budget. The text does not say the module is too large, because any of the three tools can fill the budget, includingwasm-validateprinting diagnostics for a malformed module.output-limitfailure,captured_outputkeeps up to the first 4,096 bytes that stdout and stderr each retained. The two streams share one budget, so either can be the one that filled it, and a stream that starts after the other has filled it retains nothing. The cut uses the existingboundedUtf8Texthelper, so it never splits a character.truncatedis always true here, because the command raisesoutput-limitonly after it truncated what it retained. It also recordsstdout_bytes,stderr_bytes,exit_codeandsignal, as apktool does. The byte counts are retained bytes, the meaning apktool and the firmware command give them.cleanup_incomplete. Its diagnostics now record the output limit and the budget asprevious_error, and carry the same bounded excerpt.capturedEvmOutputandcapturedPwntoolsOutputalready build captured output from a snapshot. They copy the full text and have no excerpt step, and importing them would make WABT depend on EVM or pwntools code, so I did not reuse them.--versionprobe in the configuration phase keeps its current mapping. A misconfigured tool should not be reported as an oversized module.wasm-validate,wasm-objdumpandwasm2watall run through the sameexecutehelper, so all three reach this mapping. REA does not runwasm-decompileor any other WABT tool.docs/wasm-artifacts.mdsaid "truncation fails". It now gives the error code and the excerpt size.Not changed, and yours to decide:
memory, as in apktool and native macOS for the same output budget. No sibling uses a closer value, so I kept it for consistency.WabtArtifactProvider.ts(around line 385) still attach full captured output. Only the output-limit path is bounded here.causestill holds the full snapshot in memory. It is not serialized.output-limittoAnalysisOutputError, so they show the samerea doctoradvice for a size limit. Apktool keeps its capture unbounded. One excerpt step at the owning boundary insrc/process/could cover all of them. That touches more providers, so I left it out of this PR.stdout_bytesandstderr_byteskeep their shared meaning of retained bytes. The snapshot also knows how many bytes each stream produced before it stopped. That could go into the message or a new field if you want it.execute()throws before it re-checks the executable digest and the module snapshot. So a swapped binary that floods output is reported as over budget, and its changed digest goes unnoticed. That control flow predates this change.--versionprobe still maps tounreadable_output.capability_unavailablemay fit a wrong tool better, as it does for a wrong banner.src/wasm/WabtFailures.tsand its test file. The two branches merge without conflicts.Contract and boundary impact
wabtFailure(src/wasm/WabtFailures.ts).inspect_wasm_artifactreturns the existingresource_constraintcode instead ofunreadable_output. No schemas change.captured_outputkeeps up to 4,096 bytes of what each stream retained, the retained byte counts,exit_code,signalandtruncated.Evidence and regression coverage
src/wasm/WabtArtifactProvider.test.ts:inspect, the real child processes run for the version probes andwasm-objdump, and the launcher raises an output-limit failure forwasm2wat. The test checks the error tag, resource,max_output_bytes, the projectedresource_constraintcode, that the message names the budget, the remediation, and the fullcaptured_outputwith the excerpt, byte counts, exit code and signal. No test writes 32 MiB.previous_error.--versionprobe staysAnalysisOutputError.mainthe first four tests fail. The fifth passes there, since it guards the configuration-phase behaviour this change keeps. Each part of the fix is needed. Keeping the full text fails the four excerpt tests. Cutting by UTF-16 units fails the emoji test. Settingtruncatedto false, reporting observed instead of retained byte counts, or droppingexit_codeandsignaleach fails theinspectand stderr tests. Recording the generic command message asprevious_errorfails the cleanup test. Dropping the phase condition fails the--versiontest. Changing the resource tocpu, droppingmax_output_bytes, dropping the byte count from the message, or using the old module-size remediation each fails theinspecttest.tree-sitter-cpp.wasm(stdout excerpt shortened here):For evidence-bearing changes:
Validation performed
vitestoversrc/wasm,tests/boundary/mcp/wasmArtifactMcp.test.ts,tests/acceptance/tools/localToolContracts.test.ts,src/contracts/toolEffects.test.tsandtests/boundary/filesystem/targetDiagnostics.test.ts: 6 files, 56 tests passed.npm run check:fast: passed.npm run docs:check: passed.npm run verify:test-discovery: "Discovered all 915 test files exactly once."stdout_bytes33,554,432.exit_codeandsignaldepend on whether WABT finished before it was stopped: the same module gave exit 0 on one run andSIGKILLon another.tree-sitter-cpp.wasmunreadable_output, 33,606,368-byte errorresource_constraint, 4,932-byte errortree-sitter-bash.wasmunreadable_output, 33,584,062-byte errorresource_constraint, 4,931-byte errortree-sitter-powershell.wasmunreadable_output, 33,568,405-byte errorresource_constraint, 4,926-byte errortree-sitter-c-sharp.wasm,onig.wasm,crc32.wasmvsda_bg.wasm(not WebAssembly)invalid_requestinvalid_requestCosts, measured 2026-10-13 with the built CLI on this branch and on
mainat4276aaf1, WABT 1.0.42, Linux x64, 12 cores. Each run had its own cgroup, so CPU and peak memory cover the whole process family, WABT children included. Per module and tree: one first run and three warm runs, withmainand the branch alternating. The machine was shared, with a load average of 8 to 14 during the runs, so differences of a few hundred milliseconds are noise. "First" is not truly cold: the page cache was already warm from the build, and I could not drop it.tree-sitter-cpp.wasmmaintree-sitter-bash.wasmmaintree-sitter-powershell.wasmmaintree-sitter-c-sharp.wasm(control, succeeds)mainElapsed time, CPU time and peak memory show no change outside that noise. The process still reads the full 32 MiB before stopping, and
causestill holds the snapshot, so I did not expect one. The change is in what the caller receives: about 4.9 KB instead of about 33.6 MB per failure. Token usage was not measured. I had no tokenizer for the agent's model on this machine, and fewer bytes alone do not prove fewer tokens.Compatibility, safety, and release
unreadable_outputfor oversized modules now getsresource_constraint. Neither code is retryable.Review checklist
type(scope): outcome.🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.