mirror of
https://github.com/morluto/rea.git
synced 2026-11-05 07:47:29 +00:00
[PR #4954] [MERGED] feat(analysis-view): project an environment manifest from web network captures #6690
Closed
opened 2026-11-01 21:42:20 +00:00 by bsakaguchi
·
0 comments
No Branch/Tag specified
main
release-please--branches--main--components--rea-agents
release-please--branches--main--components--rea-agents--release-notes
codex/procedure-reference-stacked
codex/kuna-independent-retry
codex/byte-search-overlay-coverage
codex/open-failure-target-receipt
codex/kuna-xref-evidence
codex/ghidra-ambiguous-procedure-recovery
codex/function-source-bundle
codex/trace-function-integration-prototype
codex/snapshot-source-closure
codex/recorded-evidence-array-pages
codex/evidence-recovery-redesign
codex/trace-feature-address-scope
codex/call-discovery-scope
codex/ghidra-literal-candidate-evidence
codex/decompile-directory-independent-retry
codex/retry-provenance-base
codex/value-flow-capability-experiment
codex/ghidra-containing-instruction
cursor/readme-discord-button-ef9f
dependabot/github_actions/actions/setup-node-7.1.0
dependabot/github_actions/actions/upload-artifact-7.0.2
dependabot/npm_and_yarn/npm-minor-and-patch-d8d97ce6df
codex/kuna-1989
fix/8559-native-ui-fixture-ownership
fix/8555-go-verifier-mcp-ownership
codex/provider-capability-recovery
fix/8642-rizin-target-stdin
codex/ghidra-memory-effect-scope
codex/ghidra-annotation-entry-selector
codex/ghidra-readonly-recovery
codex/ghidra-regex-verifier-recovery
codex/evidence-discovery-view-guidance
fix/8545-bulk-append-overflow
fix/8428-navigation-refusal-alternatives
codex/address-context-recovery
codex/matching-member-limitations
codex/unknown-scope-contract
codex/evidence-view-guidance
feat/8373-native-trace-views
codex/ghidra-snapshot-verifier-binding
codex/elf-export-visibility
codex/evidence-view-recovery
codex/native-reference-cli-help
codex/provider-candidate-observation-scope
codex/kuna-session-verification
codex/ghidra-switch-lifetime-guidance
codex/pseudocode-paging-discovery
codex/clarify-evidence-view-support
codex/kuna-xrefs-selector-recovery
codex/context-capacity-recovery
codex/evidence-closure-large-links
codex/same-function-evidence-identity
codex/ghidra-verifier-inspected-jdk
codex/audit-guided-workflows
codex/crash-prompt-retained-dossiers
codex/analysis-view-error-recovery
codex/kuna-verifier-target-selection
codex/ghidra-selected-project-call-coverage
codex/docs-native-analysis-scope
codex/ghidra-java-socket-boundary
codex/ghidra-retained-snapshot-verifier
codex/ghidra-search-inventory-facts
fix/8284-zero-argument-parameter-bindings
fix/8198-ui-action-handler-offset
fix/8257-elf-entry-label-identity
fix/8304-deferred-output-schema-projection
fix/8277-call-path-computed-target-uncertainty
fix/pr-8089-conflicts
fix/ci-static-duplicate-export
dependabot/npm_and_yarn/lint-staged-17.6.0
dependabot/github_actions/actions/download-artifact-8.0.2
dependabot/npm_and_yarn/write-file-atomic-8.0.0
dependabot/npm_and_yarn/canonicalize-5.1.0
dependabot/github_actions/actions/cache/restore-6.1.0
dependabot/npm_and_yarn/toon-format/toon-4.4.0
dependabot/github_actions/actions/deploy-pages-5.0.1
codex/review-fixes-pr-2403
codex/review-fixes-pr-2400
codex/process-terminal-width
codex/test-brittleness-cleanup
verify/7167-browser-connect-macos
fix/7167-browser-connect
feat/native-matching-allowance-setting
feat/browser-scenario-dry-run
test/managed-caller-parameters-20261024
codex/parser-fortythird-boundaries
fix/6926-pinvoke-platform-decorations-20261023
fix/6889-har-body-encoding-20261023
fix/6888-sqlite-schema-budget-20261023
fix/dependency-security-gates-6708
cursor/evidence-overwrite-rebase-b4ac
feat/4057-verify-native-exports
fix/windows-acl-observer-overhead-20261022
cursor/erlang-beam-restack-4476
cursor/pe-certificate-review-bf32
fix/6116-javascript-application-fs-errors
fix/6061-unmapped-runtime-script-unknown
feat/browser-scenario-summary
fix/pe-certificates
codex/verify-3407
cursor/rebase-5699
cursor/rebase-5352
cursor/rebase-5600
cursor/fix-cli-schema-omission-10a8
codex/audit-hopper-shutdown-reasons-20261021
fix/demangle-swift-omitted-record
fix/nib-boolean-value-types
cursor/cancellation-partial-observation-a5ac
fix/ib-object-limit-reasons
fix/electron-fuse-limit-advice
fix/kuna-doctor-dangling-cache
fix/fixed-budget-refusal-advice
fix/js-ipc-listener-dedup
fix/js-return-member-provenance
fix/dmg-integrity-retry-advice
fix/ida-doctor-readiness
fix/kuna-version-probe-output-drain
fix/legacy-swift-runtime-name-matching
fix/dylib-lazy-load-commands
fix/browser-scenario-startup-cancel
fix/swift-nested-punycode-classification
fix/compare-unselected-scopes
fix/objc-method-budget-coverage
fix/dmg-mounted-root-observations
audit/ci-tests-20261019-round2
release/6.7.0
fix/wabt-cleanup-retry-resolution
fix/electron-fuse-elf-pe-architecture
fix/native-plist-descriptor-ownership
fix/kuna-caller-cleanup-ownership
experiment/atomic-codemode-20261016
review/first-contributor-3776
fix/call-resolution-full-read-cycles
fix/member-mutation-selection-repeat
experiment/atomic-re-tools-20261015
perf/member-mutation-lazy-origins
perf/static-network-mutation-index
fix/hopper-startup-lifecycle
audit/3050-windows-proof-20261015
feat/windows-window-capture-2183
audit/3049-windows-proof-20261015
audit/3735-macos-fixtures-20261015
fix/batch-decompile-null-pseudocode
fix/kuna-inventory-honors-jobs
experiment/browser-codemode-tool-design-20261015
fix/hopper-clean-runtime-argv
codex/review-2049-27f1b367
review-fixes/pr-2787-routing
fix/3360-scoped-this-emitters
fix/3367-replaced-global-effects
fix/3838-compact-any-value-items
test/hopper-download-probe-20261015
codex/windows-runtime-creation-red-green-20261015
codex/windows-readonly-root-red-green-20261015
codex/windows-root-share-red-green-20261015
codex/exp-1685-win-mcp-startup
codex/bug-sweep-20261015
investigate/2190-windows-package-phases
investigate/3543-macos-cli-deadline
perf/3281-reverse-tools-feedback-quality
fix/3406-hopper-doctor-fixture
fix/3341-wrapper-require-test-context
fix/3301-owned-uninstall-fixtures
fix/3164-compiler-input-ownership
fix/pcap-cleanup-stdout-newline-20261014
perf/interface-builder-summary
codex/review-fixes-pr-1977
fix/ghidra-effective-jvm-platform
fix/docs-turkish-rust-link-20261013
fix/main-maintenance-ci-20261010
fix/recover-binary-session-process-effects
codex/review-fixes-pr-2457
codex/ci-required-cancellation-gate
fix/main-format-baseline-20261013
fix/setup-preserve-entry-fields
cursor/restore-main-checks-1ffc
fix/ghidra-bridge-hashmap-import
codex/shared-ci-jadx-json-default-20261013
codex/shared-ci-ghidra-test-groups-20261013
codex/shared-ci-java-fixture-format-20261013
codex/fix-intrinsic-invocation-boundaries
test/release-preflight-reusable-jobs
test/js-parameter-provenance-expectation
fix/linux-hopper-verification-current
test/2419-ghidra-elf-probe-size
followup/pr-1544-native-ida
codex/fold-pr-2230-contribution
docs/readme-responsible-use
fix/issue-2064
fix/issue-2050
fix/issue-2053
fix/issue-1968
fix/issue-1945
experiment/codemode-bridge-20261011
fix/tool-effects-negative-wording-1904-20261012
fix/1842-electron-interop-provenance
feat/recover-javascript-multi-input
refactor/website-i18n-prep
fix/nativeaot-pe-virtual-extent
fix/browser-verifier-ci-hang
fix/pe-resources-input-selection
docs/beginner-friendly-guides
docs/beginner-setup-guide
fix/javascript-analysis-worker-1563
fix/1649-ghidra-duplicate-names
fix/javascript-export-keys-integration-1369
test/maintenance-boundary-contracts-20261011
review/javascript-export-keys-1369
review/process-live-progress-1483
test/javascript-1495-growth-ratio
fix/ci-escape-timing
docs/normalized-terminal-geometry-1450
release/6.3.0
archive/release-6.3.0-pr1381
release/6.2.0
fix/electron-preload-dynamic-override
fix/javascript-self-referential-bundler-edges
release/6.1.0
cursor/grok-client-cherry-pick-0b56
feat/signature-posture
feat/dyld-shared-cache
feat/artifact-integrity-policy
feat/pkg-inventory
release/6.0.0
chore/sync-release-5.0.0
release/5.0.0
cursor/cloud-agent-node-787e
fix/javascript-xhr-open-endpoints
review/pr-711-realpath-fallback-wording
cleanup/replay-confinement
codex/test-suite-performance
codex/issue-foundations
codex/address-open-issues-2026-07-20
agent/javascript-vite-rollup-esbuild-adapters
agent/process-cleanup
agent/triage-integration
agent/unknown-commands-registry
feat/mcp-identity-metadata
morlvps/issue_cleanup
codex/installer-redesign
morl/roadmap-investigation-core
morl/roadmap-investigation-docs
release-please--branches--main--components--rea
rea-agents-6.8.0
rea-agents-6.7.0
rea-agents-6.6.0
experiment/atomic-codemode-wait-runtime-20261016
rea-agents-6.5.0
rea-agents-6.4.0
rea-agents-6.3.0
rea-agents-6.2.0
rea-agents-6.1.0
rea-agents-6.0.0
rea-agents-5.0.0
rea-agents-4.1.0
rea-agents-4.0.1
rea-agents-4.0.0
rea-agents-3.2.1
rea-agents-3.2.0
rea-agents-3.1.0
rea-agents-3.0.0
rea-agents-2.7.0
rea-agents-2.6.0
rea-agents-2.5.1
rea-agents-2.5.0
rea-agents-2.4.0
rea-agents-2.3.0
rea-agents-2.2.0
rea-agents-2.1.0
rea-agents-2.0.0
rea-agents-1.7.0
rea-agents-1.6.0
rea-agents-1.5.0
rea-agents-1.4.0
rea-agents-1.3.0
rea-agents-1.2.0
rea-agents-1.1.0
rea-agents-1.0.0
rea-agents-0.5.0
rea-agents-0.4.0
rea-agents-0.3.0
rea-0.2.1
rea-0.2.0
Labels
Clear labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
Mirrored from GitHub Pull Request
question
roadmap
triage
No labels
area: bridge
area: bridge
area: build
area: build
area: build
area: cli
area: domain
area: evidence
area: mcp
area: native
area: providers
area: runtime
area: server
area: setup
area: tests
bug
design
documentation
enhancement
enhancement
enhancement
experiment
help wanted
i18n
invalid
P0: critical
P1: high
P2: medium
P2: medium
P2: medium
P3: low
performance
provider-request
pull-request
question
roadmap
triage
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set.
Reference
morluto/rea#6690
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
📋 Pull Request Information
Original PR: https://github.com/morluto/rea/pull/4954
Author: @earakely-scale
Created: 10/18/2026
Status: ✅ Merged
Merged: 10/18/2026
Merged by: @morluto
Base:
main← Head:feat/environment-manifest-view📝 Commits (10+)
61d3536feat(analysis-view): project an environment manifest from web network captures2d95597test(web-network): check the manifest refusal text like the api-surface refusal6cb38b5docs(specs): record the hosted web-network lane run for the manifest viewb6d18d2docs(specs): reconcile the manifest view verification scope note with the hosted run44203ecfix(analysis-view): bound body, route and name work in the environment manifestbfe5a36fix(analysis-view): keep manifest folding, naming and media-type reads linear71d7513fix(analysis-view): charge the manifest group key before building it2679323fix(analysis-view): accept a +json suffix only on application media types692453bchore: merge main into environment manifest reviewf73af11fix(analysis-view): require the capture parent's exact subject for a manifest📊 Changes
33 files changed (+4096 additions, -361 deletions)
View changed files
📝
.agents/skills/reverse-engineer-anything/references/evidence-workflows.md(+8 -0)📝
docs/mcp-contracts.md(+8 -0)➕
docs/specs/agent-environments/manifest-view/plan.md(+28 -0)➕
docs/specs/agent-environments/manifest-view/spec.md(+63 -0)➕
docs/specs/agent-environments/manifest-view/tasks.md(+12 -0)➕
docs/specs/agent-environments/manifest-view/verification.md(+186 -0)📝
docs/web-network-captures.md(+88 -0)📝
scripts/verify-web-network-captures.mjs(+26 -0)📝
src/application/analysisView/AnalysisViewService.test.ts(+116 -31)📝
src/application/analysisView/AnalysisViewService.ts(+17 -4)📝
src/contracts/analysisDetail.test.ts(+6 -5)➕
src/contracts/analysisViewEnvironmentManifestExample.ts(+132 -0)📝
src/contracts/analysisViewToolContracts.ts(+6 -1)➕
src/domain/analysisView/EnvironmentManifestAccumulator.test.ts(+122 -0)➕
src/domain/analysisView/EnvironmentManifestAccumulator.ts(+543 -0)📝
src/domain/analysisView/WebNetworkApiSurfaceAccumulator.ts(+44 -241)➕
src/domain/analysisView/WebNetworkProjectionAccumulator.ts(+158 -0)📝
src/domain/analysisView/analysisView.ts(+27 -0)📝
src/domain/analysisView/binaryLayoutView.ts(+4 -1)➕
src/domain/analysisView/environmentManifestRules.test.ts(+45 -0)...and 13 more files
📄 Description
Summary
Adds the
environment-manifestview kind toinspect_analysis_viewfor retained HAR Evidence: the primary origin's recorded request lines become a deterministic, replayable tool surface (names, path templates, parameters, observed query names, value-free body shapes, record pointers), with excluded groups, three fixed unknowns and the shared projection budget. Literal fold-in under the opt-in rules never touches format-rule parameters.Refs morluto/rea#4933 (design discussion; scope decision requested there).
Opened as a draft until the scope decision in the design discussion lands and the human owner has reviewed the final diff; the body is complete so the review can start now.
Problem and expected behavior
An agent environment needs a manifest of what a captured application exposes, without serving or replaying anything yet. Existing api-surface groups are not named tools and cannot carry opt-in identifier rules. Expected:
view: {kind: "environment-manifest", template_rules?, include_query_parameter_names?}oninspect_web_network_captureHAR Evidence returns tools whose templates equal the api-surface grouping without rules and applyafter-uid-literal,opaque-token,sibling-varianceonly when listed; a parameter produced by one of the four format rules must keep its exact-format meaning (a literal sibling such as/api/teams/searchor/api/teams/minestays its own tool instead of becoming an observed value of/api/teams/{numeric}).Change and scope
New: environmentManifestRules.ts (opt-in rules, re-bucketing, sibling merge with fold-in restricted to opt-in parameters, naming), EnvironmentManifestAccumulator.ts, environmentManifestView.ts, WebNetworkProjectionAccumulator.ts and webNetworkRouteTemplates.ts (helpers lifted from the api-surface accumulator), a generated contract example, domain tests, and docs/specs/agent-environments/manifest-view/. Pre-existing files, one line each: WebNetworkApiSurfaceAccumulator.ts - behaviour-preserving refactor onto the shared route/media-type/budget helpers so both views share one interpretation and stay under jscpd; webNetworkApiSurfaceView.ts - parent guards replaced by shared admitHarCaptureParent, rule enum from ROUTE_RULES; analysisView.ts - registers request/result schemas, UnsignedAnalysisView member and projector dispatch for the new kind; AnalysisViewService.ts - builds the manifest accumulator for the kind and extends the inferred-confidence rule to it; binaryLayoutView.ts / javascriptApplicationView.ts - type-level Exclude widened so the kind never reaches those projectors; webNetworkCaptureView.ts - unsupported-view message names the kind; analysisViewToolContracts.ts - tool description and example; analysisDetail.test.ts - asserts the kind appears only in inspect_analysis_view's output schema; AnalysisViewService.test.ts, analysisViewCli.test.ts, analysisViewMcp.test.ts, qlogCapture.test.ts - mirror api-surface coverage for the kind (qlog parent refused by both); tests/fixtures/historicalHar.ts + analysisView.ts - Grafana-shaped 28-entry HAR as a TS builder and its capture fixture; scripts/verify-web-network-captures.mjs - real-capture verifier also projects the manifest and asserts refusal/pointer-only records; docs/web-network-captures.md - new 'Environment manifest' section; docs/mcp-contracts.md and the skill evidence-workflows.md - pointer paragraphs. No file outside the slice is modified; CHANGELOG.md, server.json, README.md, docs/readme/* and package.json dependencies are untouched.
Follow the contribution scope.
Contract and boundary impact
src/domain/analysisView/); the earliest changed stage is the view request schema inanalysisView.ts, dispatched kind-first like api-surface.AnalysisViewService.tsonly extends the inferred-confidence rule to the new kind.inspect_analysis_viewacceptsview.kind = "environment-manifest"withtemplate_rules?(each rule at most once) andinclude_query_parameter_names?; its description and examples grow by one example, so the catalog digest changes at build and running servers report the usual restart-required status after upgrade.rea.analysis-viewEvidence linked to the parent; confidenceinferredwhenever any tool or excluded group is templated,derivedotherwise; authority stays the parent'shistorical-reference;view_digestpresent. Records are pointers only and no header, cookie, query or body value is copied into the result.docs/public/product-catalog.json), package, or installation impact (CI generates and validates ignored catalogs andskills/; edit authored instructions in.agents/skills/reverse-engineer-anything/and never commit build outputs): No tracked generated file changes (npm run docs:checkpasses with an empty diff);docs/public/product-catalog.jsonandskills/regenerate in CI..agents/skills/reverse-engineer-anything/references/evidence-workflows.mdgains a pointer paragraph. No package or installation change.Expected effects (check known effects; use documentation-only on its own).
Unchecked items do not establish absence; leave uncertainties visible.
Evidence and regression coverage
For evidence-bearing changes:
Representative output
Validation performed
18aa9af2export (pre-existing, unrelated)18aa9af2b2)b6d18d23) addressed in44203ecd: top-level-only body shapes, every route part admitted before allocation, a 32-segment bound on sibling-variance stated as a limitation, stop words kept literal after a uid literal, per-base collision suffixes, templated exclusions preserved on a row collision; each thread has a reply.bfe5a364keeps sibling folding, name suffixes and request media-type reads linear;71d7513ccharges the group key before building it;2679323eaccepts a+jsonsuffix only on application media types;f73af11crequires the capture parent's exact subject at admission;dd87f54emerges only identifier-like siblings under sibling-variance. Each has a regression test and a reply in its thread.692453bf), replaced the suffix counter with one keyed by the truncated prefix and suffix width with its own tests (d6cb57e3), re-applied the subject check on top (99be275e) and posted independent verification on every finding thread, including a run over the five published showcase corpora. The fork CI run on99be275eis green (https://github.com/earakely-scale/rea/actions/runs/39146579873);dd87f54eis appended on top of it.Compatibility, safety, and release
analysisViewRequestSchema/analysisViewResultSchema; existing view kinds and their outputs are unchanged.environment-manifest(message text only; codes unchanged).Author readiness
Human owner: @earakely-scale
Before merge
type(scope): outcome.🤖 Generated with Claude Code
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.