morluto/rea

Fork

You've already forked rea

mirror of https://github.com/morluto/rea.git synced 2026-11-05 06:45:22 +00:00

Code Issues 1.3k Projects Packages Wiki Activity

[GH-ISSUE #268] Build an evidence-backed reconstruction workspace and coverage closure workflow #157

New issue

Closed

opened 2026-10-15 18:21:47 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-15 18:21:47 +00:00

Owner

Copy link

Originally created by @morluto on GitHub (Jul 16, 2026).
Original GitHub issue: https://github.com/morluto/rea/issues/268

Problem

Passing component tests and individual differential fixtures does not prove that every shipped surface has been reconstructed. Large reconstruction projects need a durable, evidence-linked account of what exists in the authority, who owns each reconstructed surface, what verifier exercises it, and which claims remain unknown or contradicted.

Today agents often maintain separate spreadsheets, Markdown plans, generated manifests, process-parity reports, and residual-unknown ledgers. These drift independently. A narrow green verifier can be mistaken for replacement readiness even when commands, event families, persistence formats, UI states, native boundaries, or packaged workflows remain unowned.

Outcome

Add an evidence-backed reconstruction workspace and fail-closed coverage-closure workflow.

The workspace is not a project manager or source generator. It is a typed, durable graph connecting authoritative surfaces, evidence, reconstruction ownership, specifications, verifier results, residual unknowns, and replacement/completion claims.

Domain model

Represent at least:

authoritative artifact/version/environment;
surface family and stable surface ID;
artifact occurrence and exact source/binary location;
observed, derived, inferred, historical, or external authority;
reconstructed package/module/export/process owner;
finite behavioral, structural, protocol, persistence, UI, native, or packaging claim;
characterization fixture and evidence bundle;
verifier, required dimensions, latest result, freshness, and coverage;
normalization rules and rationales;
residual unknowns, contradictions, unavailable authority, and recommended probes;
replacement boundary and executable/package integration proof;
dependency relationships between surfaces and claims.

Surface families must be extensible and include CLI commands/options/output, MCP tools/schemas/dispatch, protocols/endpoints/events, state and persistence formats, process lifecycles, UI routes/states/interactions, native exports/ABI behavior, packaged files, and installation/upgrade behavior.

Discovery and inventory

Build workspace inventories from explicit authoritative evidence:

artifact graphs and semantic indexes;
protocol and schema catalogs;
process/browser/Electron/native captures;
imported historical-source mappings;
user-supplied finite specifications;
generated route/operation/export manifests.

Discovery never silently creates a completion claim. Unsupported or truncated inventory creates scoped unknown coverage.

Ownership

Each required surface maps to exactly one primary reconstructed owner or an explicit external/non-goal disposition. Detect:

missing owner;
duplicate or conflicting owners;
implementation routing back into the authority;
copied generated/runtime helpers outside an approved adapter;
owner path no longer present;
surface present in code but absent from distributable/package;
claim covered only by a mock or weaker boundary than required.

Ownership is architectural evidence, not proof of behavioral parity.

Verification graph

A verifier registration declares:

claims and surfaces it covers;
authority and candidate bindings;
required evidence dimensions;
acceptable freshness and repeat count;
approved normalization contract;
pass/fail/unknown/unsupported/truncated semantics;
output artifacts and evidence IDs.

The workspace computes closure only from current compatible results. Test counts, builds, or a parent aggregate cannot cover unnamed claims.

Replacement readiness

A replacement boundary requires proof that:

every required surface has an owner or accepted disposition;
all finite claims pass at comparable authority;
no required verifier is missing, stale, skipped, truncated, or unknown;
no active contradiction affects the boundary;
the distributable routes through reconstructed owners;
authority imports/runtime delegation are absent;
clean installation/build/package/runtime workflows pass;
residual unknowns are bounded and permitted by the completion specification.

Return partial, failed, unknown, or ready. Never collapse partial into ready.

Durable workflow

Provide operations to:

create/open a workspace under an approved evidence root;
import/update authoritative surface inventories;
register reconstructed owners and replacement boundaries;
register finite claims and verifier contracts;
ingest canonical Evidence v2 bundles and verifier results;
reconcile changed artifacts, code, schemas, or evidence;
query missing/duplicate/stale/contradicted coverage;
recommend the next highest-impact probe or verifier;
produce deterministic machine and human reports;
verify a named replacement/completion specification.

Use monotonic CAS revisions so concurrent agents cannot overwrite newer state. Preserve invalidated history rather than deleting old claims.

Anti-cheating rules

A verifier cannot broaden its coverage after the fact without a contract revision.
Weak evidence cannot satisfy a stronger required authority.
Normalization cannot remove fields or dimensions.
Snapshot updates require semantic review.
Mock-only results cannot prove real process/browser/native/package behavior.
Missing or stale evidence is unknown, not pass.
External/non-goal dispositions require an explicit rationale and completion-spec allowance.
Completion cannot be inferred from absence of discovered gaps.

Acceptance criteria

A provider-neutral workspace schema models surfaces, owners, claims, verifiers, evidence, unknowns, contradictions, and replacement boundaries.
Inventories are deterministic and tied to artifact/evidence digests.
Missing, duplicate, stale, authority-routing, and undistributed owners are detected.
Verifier coverage is explicit per finite claim and cannot be inferred from test counts.
Changed artifacts, owners, schemas, normalization, or verifier contracts invalidate dependent closure.
CAS revisions prevent lost concurrent updates.
Reports distinguish pass, fail, unknown, unsupported, truncated, stale, contradicted, and accepted disposition.
A deliberately incomplete CLI/package fixture remains partial despite all registered component tests passing.
Adding the missing process fixture advances only the claims it actually covers.
A distributable that still imports the authority fails replacement readiness.
Clean-check mode regenerates deterministic reports and detects manual tampering.
The workflow integrates residual unknowns from #73 and generated ledgers from #72 without duplicating their authority.
verify_reconstruction can consume a named workspace specification and canonical evidence bundle.
Large reports and inventories are exposed as MCP resources.
CLI/MCP behavior, typed errors, progress, cancellation, and Tasks support remain equivalent.

Relationships

Differential and reconstruction workflows: #37
Generated evidence/completion ledgers: #72
Residual unknown registry: #73
Artifact graph: #35
Evidence v2 and resources: #48, #49, and #99
Fixture export: #62
JavaScript and historical mapping: #117, #68, and #67
Browser/Electron comparison: #63 through #65

Non-goals

Generating reconstruction source code automatically.
Replacing Git, issue trackers, or project plans.
Declaring global equivalence from a finite specification.
Treating architecture ownership as behavioral proof.
Requiring unavailable private implementation details when client-observable contracts are the declared boundary.

Originally created by @morluto on GitHub (Jul 16, 2026). Original GitHub issue: https://github.com/morluto/rea/issues/268 ## Problem Passing component tests and individual differential fixtures does not prove that every shipped surface has been reconstructed. Large reconstruction projects need a durable, evidence-linked account of what exists in the authority, who owns each reconstructed surface, what verifier exercises it, and which claims remain unknown or contradicted. Today agents often maintain separate spreadsheets, Markdown plans, generated manifests, process-parity reports, and residual-unknown ledgers. These drift independently. A narrow green verifier can be mistaken for replacement readiness even when commands, event families, persistence formats, UI states, native boundaries, or packaged workflows remain unowned. ## Outcome Add an evidence-backed reconstruction workspace and fail-closed coverage-closure workflow. The workspace is not a project manager or source generator. It is a typed, durable graph connecting authoritative surfaces, evidence, reconstruction ownership, specifications, verifier results, residual unknowns, and replacement/completion claims. ## Domain model Represent at least: - authoritative artifact/version/environment; - surface family and stable surface ID; - artifact occurrence and exact source/binary location; - observed, derived, inferred, historical, or external authority; - reconstructed package/module/export/process owner; - finite behavioral, structural, protocol, persistence, UI, native, or packaging claim; - characterization fixture and evidence bundle; - verifier, required dimensions, latest result, freshness, and coverage; - normalization rules and rationales; - residual unknowns, contradictions, unavailable authority, and recommended probes; - replacement boundary and executable/package integration proof; - dependency relationships between surfaces and claims. Surface families must be extensible and include CLI commands/options/output, MCP tools/schemas/dispatch, protocols/endpoints/events, state and persistence formats, process lifecycles, UI routes/states/interactions, native exports/ABI behavior, packaged files, and installation/upgrade behavior. ## Discovery and inventory Build workspace inventories from explicit authoritative evidence: - artifact graphs and semantic indexes; - protocol and schema catalogs; - process/browser/Electron/native captures; - imported historical-source mappings; - user-supplied finite specifications; - generated route/operation/export manifests. Discovery never silently creates a completion claim. Unsupported or truncated inventory creates scoped unknown coverage. ## Ownership Each required surface maps to exactly one primary reconstructed owner or an explicit external/non-goal disposition. Detect: - missing owner; - duplicate or conflicting owners; - implementation routing back into the authority; - copied generated/runtime helpers outside an approved adapter; - owner path no longer present; - surface present in code but absent from distributable/package; - claim covered only by a mock or weaker boundary than required. Ownership is architectural evidence, not proof of behavioral parity. ## Verification graph A verifier registration declares: - claims and surfaces it covers; - authority and candidate bindings; - required evidence dimensions; - acceptable freshness and repeat count; - approved normalization contract; - pass/fail/unknown/unsupported/truncated semantics; - output artifacts and evidence IDs. The workspace computes closure only from current compatible results. Test counts, builds, or a parent aggregate cannot cover unnamed claims. ## Replacement readiness A replacement boundary requires proof that: - every required surface has an owner or accepted disposition; - all finite claims pass at comparable authority; - no required verifier is missing, stale, skipped, truncated, or unknown; - no active contradiction affects the boundary; - the distributable routes through reconstructed owners; - authority imports/runtime delegation are absent; - clean installation/build/package/runtime workflows pass; - residual unknowns are bounded and permitted by the completion specification. Return partial, failed, unknown, or ready. Never collapse partial into ready. ## Durable workflow Provide operations to: 1. create/open a workspace under an approved evidence root; 2. import/update authoritative surface inventories; 3. register reconstructed owners and replacement boundaries; 4. register finite claims and verifier contracts; 5. ingest canonical Evidence v2 bundles and verifier results; 6. reconcile changed artifacts, code, schemas, or evidence; 7. query missing/duplicate/stale/contradicted coverage; 8. recommend the next highest-impact probe or verifier; 9. produce deterministic machine and human reports; 10. verify a named replacement/completion specification. Use monotonic CAS revisions so concurrent agents cannot overwrite newer state. Preserve invalidated history rather than deleting old claims. ## Anti-cheating rules - A verifier cannot broaden its coverage after the fact without a contract revision. - Weak evidence cannot satisfy a stronger required authority. - Normalization cannot remove fields or dimensions. - Snapshot updates require semantic review. - Mock-only results cannot prove real process/browser/native/package behavior. - Missing or stale evidence is unknown, not pass. - External/non-goal dispositions require an explicit rationale and completion-spec allowance. - Completion cannot be inferred from absence of discovered gaps. ## Acceptance criteria - [ ] A provider-neutral workspace schema models surfaces, owners, claims, verifiers, evidence, unknowns, contradictions, and replacement boundaries. - [ ] Inventories are deterministic and tied to artifact/evidence digests. - [ ] Missing, duplicate, stale, authority-routing, and undistributed owners are detected. - [ ] Verifier coverage is explicit per finite claim and cannot be inferred from test counts. - [ ] Changed artifacts, owners, schemas, normalization, or verifier contracts invalidate dependent closure. - [ ] CAS revisions prevent lost concurrent updates. - [ ] Reports distinguish pass, fail, unknown, unsupported, truncated, stale, contradicted, and accepted disposition. - [ ] A deliberately incomplete CLI/package fixture remains partial despite all registered component tests passing. - [ ] Adding the missing process fixture advances only the claims it actually covers. - [ ] A distributable that still imports the authority fails replacement readiness. - [ ] Clean-check mode regenerates deterministic reports and detects manual tampering. - [ ] The workflow integrates residual unknowns from #73 and generated ledgers from #72 without duplicating their authority. - [ ] verify_reconstruction can consume a named workspace specification and canonical evidence bundle. - [ ] Large reports and inventories are exposed as MCP resources. - [ ] CLI/MCP behavior, typed errors, progress, cancellation, and Tasks support remain equivalent. ## Relationships - Differential and reconstruction workflows: #37 - Generated evidence/completion ledgers: #72 - Residual unknown registry: #73 - Artifact graph: #35 - Evidence v2 and resources: #48, #49, and #99 - Fixture export: #62 - JavaScript and historical mapping: #117, #68, and #67 - Browser/Electron comparison: #63 through #65 ## Non-goals - Generating reconstruction source code automatically. - Replacing Git, issue trackers, or project plans. - Declaring global equivalence from a finite specification. - Treating architecture ownership as behavioral proof. - Requiring unavailable private implementation details when client-observable contracts are the declared boundary.

bsakaguchi

2026-10-15 18:21:47 +00:00

closed this issue
added the
area: evidence

enhancement
labels

bsakaguchi added

enhancement

and removed

enhancement

labels

2026-10-31 00:28:46 +00:00

No Branch/Tag specified

main

codex/procedure-reference-stacked

release-please--branches--main--components--rea-agents

release-please--branches--main--components--rea-agents--release-notes

codex/kuna-independent-retry

codex/byte-search-overlay-coverage

codex/open-failure-target-receipt

codex/kuna-xref-evidence

codex/ghidra-ambiguous-procedure-recovery

codex/function-source-bundle

codex/trace-function-integration-prototype

codex/snapshot-source-closure

codex/recorded-evidence-array-pages

codex/evidence-recovery-redesign

codex/trace-feature-address-scope

codex/call-discovery-scope

codex/ghidra-literal-candidate-evidence

codex/decompile-directory-independent-retry

codex/retry-provenance-base

codex/value-flow-capability-experiment

codex/ghidra-containing-instruction

cursor/readme-discord-button-ef9f

dependabot/github_actions/actions/setup-node-7.1.0

dependabot/github_actions/actions/upload-artifact-7.0.2

dependabot/npm_and_yarn/npm-minor-and-patch-d8d97ce6df

codex/kuna-1989

fix/8559-native-ui-fixture-ownership

fix/8555-go-verifier-mcp-ownership

codex/provider-capability-recovery

fix/8642-rizin-target-stdin

codex/ghidra-memory-effect-scope

codex/ghidra-annotation-entry-selector

codex/ghidra-readonly-recovery

codex/ghidra-regex-verifier-recovery

codex/evidence-discovery-view-guidance

fix/8545-bulk-append-overflow

fix/8428-navigation-refusal-alternatives

codex/address-context-recovery

codex/matching-member-limitations

codex/unknown-scope-contract

codex/evidence-view-guidance

feat/8373-native-trace-views

codex/ghidra-snapshot-verifier-binding

codex/elf-export-visibility

codex/evidence-view-recovery

codex/native-reference-cli-help

codex/provider-candidate-observation-scope

codex/kuna-session-verification

codex/ghidra-switch-lifetime-guidance

codex/pseudocode-paging-discovery

codex/clarify-evidence-view-support

codex/kuna-xrefs-selector-recovery

codex/context-capacity-recovery

codex/evidence-closure-large-links

codex/same-function-evidence-identity

codex/ghidra-verifier-inspected-jdk

codex/audit-guided-workflows

codex/crash-prompt-retained-dossiers

codex/analysis-view-error-recovery

codex/kuna-verifier-target-selection

codex/ghidra-selected-project-call-coverage

codex/docs-native-analysis-scope

codex/ghidra-java-socket-boundary

codex/ghidra-retained-snapshot-verifier

codex/ghidra-search-inventory-facts

fix/8284-zero-argument-parameter-bindings

fix/8198-ui-action-handler-offset

fix/8257-elf-entry-label-identity

fix/8304-deferred-output-schema-projection

fix/8277-call-path-computed-target-uncertainty

fix/pr-8089-conflicts

fix/ci-static-duplicate-export

dependabot/npm_and_yarn/lint-staged-17.6.0

dependabot/github_actions/actions/download-artifact-8.0.2

dependabot/npm_and_yarn/write-file-atomic-8.0.0

dependabot/npm_and_yarn/canonicalize-5.1.0

dependabot/github_actions/actions/cache/restore-6.1.0

dependabot/npm_and_yarn/toon-format/toon-4.4.0

dependabot/github_actions/actions/deploy-pages-5.0.1

codex/review-fixes-pr-2403

codex/review-fixes-pr-2400

codex/process-terminal-width

codex/test-brittleness-cleanup

verify/7167-browser-connect-macos

fix/7167-browser-connect

feat/native-matching-allowance-setting

feat/browser-scenario-dry-run

test/managed-caller-parameters-20261024

codex/parser-fortythird-boundaries

fix/6926-pinvoke-platform-decorations-20261023

fix/6889-har-body-encoding-20261023

fix/6888-sqlite-schema-budget-20261023

fix/dependency-security-gates-6708

cursor/evidence-overwrite-rebase-b4ac

feat/4057-verify-native-exports

fix/windows-acl-observer-overhead-20261022

cursor/erlang-beam-restack-4476

cursor/pe-certificate-review-bf32

fix/6116-javascript-application-fs-errors

fix/6061-unmapped-runtime-script-unknown

feat/browser-scenario-summary

fix/pe-certificates

codex/verify-3407

cursor/rebase-5699

cursor/rebase-5352

cursor/rebase-5600

cursor/fix-cli-schema-omission-10a8

codex/audit-hopper-shutdown-reasons-20261021

fix/demangle-swift-omitted-record

fix/nib-boolean-value-types

cursor/cancellation-partial-observation-a5ac

fix/ib-object-limit-reasons

fix/electron-fuse-limit-advice

fix/kuna-doctor-dangling-cache

fix/fixed-budget-refusal-advice

fix/js-ipc-listener-dedup

fix/js-return-member-provenance

fix/dmg-integrity-retry-advice

fix/ida-doctor-readiness

fix/kuna-version-probe-output-drain

fix/legacy-swift-runtime-name-matching

fix/dylib-lazy-load-commands

fix/browser-scenario-startup-cancel

fix/swift-nested-punycode-classification

fix/compare-unselected-scopes

fix/objc-method-budget-coverage

fix/dmg-mounted-root-observations

audit/ci-tests-20261019-round2

release/6.7.0

fix/wabt-cleanup-retry-resolution

fix/electron-fuse-elf-pe-architecture

fix/native-plist-descriptor-ownership

fix/kuna-caller-cleanup-ownership

experiment/atomic-codemode-20261016

review/first-contributor-3776

fix/call-resolution-full-read-cycles

fix/member-mutation-selection-repeat

experiment/atomic-re-tools-20261015

perf/member-mutation-lazy-origins

perf/static-network-mutation-index

fix/hopper-startup-lifecycle

audit/3050-windows-proof-20261015

feat/windows-window-capture-2183

audit/3049-windows-proof-20261015

audit/3735-macos-fixtures-20261015

fix/batch-decompile-null-pseudocode

fix/kuna-inventory-honors-jobs

experiment/browser-codemode-tool-design-20261015

fix/hopper-clean-runtime-argv

codex/review-2049-27f1b367

review-fixes/pr-2787-routing

fix/3360-scoped-this-emitters

fix/3367-replaced-global-effects

fix/3838-compact-any-value-items

test/hopper-download-probe-20261015

codex/windows-runtime-creation-red-green-20261015

codex/windows-readonly-root-red-green-20261015

codex/windows-root-share-red-green-20261015

codex/exp-1685-win-mcp-startup

codex/bug-sweep-20261015

investigate/2190-windows-package-phases

investigate/3543-macos-cli-deadline

perf/3281-reverse-tools-feedback-quality

fix/3406-hopper-doctor-fixture

fix/3341-wrapper-require-test-context

fix/3301-owned-uninstall-fixtures

fix/3164-compiler-input-ownership

fix/pcap-cleanup-stdout-newline-20261014

perf/interface-builder-summary

codex/review-fixes-pr-1977

fix/ghidra-effective-jvm-platform

fix/docs-turkish-rust-link-20261013

fix/main-maintenance-ci-20261010

fix/recover-binary-session-process-effects

codex/review-fixes-pr-2457

codex/ci-required-cancellation-gate

fix/main-format-baseline-20261013

fix/setup-preserve-entry-fields

cursor/restore-main-checks-1ffc

fix/ghidra-bridge-hashmap-import

codex/shared-ci-jadx-json-default-20261013

codex/shared-ci-ghidra-test-groups-20261013

codex/shared-ci-java-fixture-format-20261013

codex/fix-intrinsic-invocation-boundaries

test/release-preflight-reusable-jobs

test/js-parameter-provenance-expectation

fix/linux-hopper-verification-current

test/2419-ghidra-elf-probe-size

followup/pr-1544-native-ida

codex/fold-pr-2230-contribution

docs/readme-responsible-use

fix/issue-2064

fix/issue-2050

fix/issue-2053

fix/issue-1968

fix/issue-1945

experiment/codemode-bridge-20261011

fix/tool-effects-negative-wording-1904-20261012

fix/1842-electron-interop-provenance

feat/recover-javascript-multi-input

refactor/website-i18n-prep

fix/nativeaot-pe-virtual-extent

fix/browser-verifier-ci-hang

fix/pe-resources-input-selection

docs/beginner-friendly-guides

docs/beginner-setup-guide

fix/javascript-analysis-worker-1563

fix/1649-ghidra-duplicate-names

fix/javascript-export-keys-integration-1369

test/maintenance-boundary-contracts-20261011

review/javascript-export-keys-1369

review/process-live-progress-1483

test/javascript-1495-growth-ratio

fix/ci-escape-timing

docs/normalized-terminal-geometry-1450

release/6.3.0

archive/release-6.3.0-pr1381

release/6.2.0

fix/electron-preload-dynamic-override

fix/javascript-self-referential-bundler-edges

release/6.1.0

cursor/grok-client-cherry-pick-0b56

feat/signature-posture

feat/dyld-shared-cache

feat/artifact-integrity-policy

feat/pkg-inventory

release/6.0.0

chore/sync-release-5.0.0

release/5.0.0

cursor/cloud-agent-node-787e

fix/javascript-xhr-open-endpoints

review/pr-711-realpath-fallback-wording

cleanup/replay-confinement

codex/test-suite-performance

codex/issue-foundations

codex/address-open-issues-2026-07-20

agent/javascript-vite-rollup-esbuild-adapters

agent/process-cleanup

agent/triage-integration

agent/unknown-commands-registry

feat/mcp-identity-metadata

morlvps/issue_cleanup

codex/installer-redesign

morl/roadmap-investigation-core

morl/roadmap-investigation-docs

release-please--branches--main--components--rea

rea-agents-6.8.0

rea-agents-6.7.0

rea-agents-6.6.0

experiment/atomic-codemode-wait-runtime-20261016

rea-agents-6.5.0

rea-agents-6.4.0

rea-agents-6.3.0

rea-agents-6.2.0

rea-agents-6.1.0

rea-agents-6.0.0

rea-agents-5.0.0

rea-agents-4.1.0

rea-agents-4.0.1

rea-agents-4.0.0

rea-agents-3.2.1

rea-agents-3.2.0

rea-agents-3.1.0

rea-agents-3.0.0

rea-agents-2.7.0

rea-agents-2.6.0

rea-agents-2.5.1

rea-agents-2.5.0

rea-agents-2.4.0

rea-agents-2.3.0

rea-agents-2.2.0

rea-agents-2.1.0

rea-agents-2.0.0

rea-agents-1.7.0

rea-agents-1.6.0

rea-agents-1.5.0

rea-agents-1.4.0

rea-agents-1.3.0

rea-agents-1.2.0

rea-agents-1.1.0

rea-agents-1.0.0

rea-agents-0.5.0

rea-agents-0.4.0

rea-agents-0.3.0

rea-0.2.1

rea-0.2.0

Labels

Clear labels

Mirrored from GitHub Pull Request

No labels

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

morluto/rea#157

Reference in a new issue

Repository

morluto/rea

Title

Body

No description provided.

Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?

Rows
Columns