[GH-ISSUE #405] Emit reconstruction obligation ledgers and verify coverage closure #249

New issue

Closed

opened 2026-10-15 18:22:58 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented 2026-10-15 18:22:58 +00:00

Owner

Copy link

Originally created by @morluto on GitHub (Jul 22, 2026).
Original GitHub issue: https://github.com/morluto/rea/issues/405

Problem

REA can produce application graphs, Evidence v2 records, comparisons, process captures, and reconstruction verification for finite claims. What is missing is a machine-readable closure model that answers:

Which observed behaviors and boundaries have an owned reconstructed implementation and verifier, and which obligations remain open?

Without this, a reconstruction can accumulate many green component tests while still lacking an executable owner for a command, parser, persistence format, runtime lifecycle, or negative path.

Proposal

Add a Reconstruction Obligation Ledger derived from authenticated static/runtime Evidence plus an explicitly supplied reconstruction manifest.

Each obligation should represent one finite claim, not global application equivalence.

Obligation record

An obligation should include:

• stable obligation ID and version;
• authority Evidence IDs and exact locations;
• target artifact/application-graph node;
• boundary or behavior family;
• observed positive, negative, malformed, cancellation, and teardown cases;
• reconstructed owning module and symbol;
• parser/schema/domain type where applicable;
• fixture IDs and fixture authority;
• verifier command/claim ID and latest result Evidence;
• allowed nondeterminism/partial-order specification;
• dependencies on other obligations;
• status: unowned, characterized, implemented, verified, contradicted, blocked, out-of-scope, or unknown;
• residual unknowns, unavailable authority, and required next evidence.

Coverage generation

Candidate obligations may be generated from:

• CLI commands/options/errors;
• REST/GraphQL/Phoenix/WebSocket/JSON-RPC/MCP endpoints and schemas;
• IPC/contextBridge/preload/native-addon boundaries;
• persisted paths/formats/migrations;
• process roles, signals, children, and cleanup;
• routes, operations, UI states, and desktop bridge calls;
• native exports and ABI surfaces;
• application-version deltas;
• runtime capture events and negative outcomes.

Generation must be conservative. A static literal establishes a candidate obligation, not runtime reachability. One-sided evidence cannot prove behavioral absence.

Closure rules

• verified requires comparable authority and reconstruction evidence for the declared finite claim.
• A module existing is not proof it owns the behavior.
• A unit test is insufficient when the obligation is process-, packaging-, renderer-, ABI-, or protocol-level.
• Missing negative coverage remains open when malformed/error behavior is part of the boundary.
• A broad verifier cannot silently satisfy obligations it does not enumerate.
• Unknown, blocked, waived, and out-of-scope obligations remain visible and cannot count as verified.
• Every completion report must enumerate all obligations and prove zero required open items.

Outputs

• canonical JSON ledger;
• summary grouped by application layer and evidence authority;
• dependency/ownership graph;
• missing-owner and missing-verifier report;
• contradiction report;
• residual-unknown ledger;
• deterministic closure digest;
• portable Evidence v2/resource representation.

Acceptance criteria

• A versioned schema defines obligations, ownership, evidence, fixtures, verifier claims, dependencies, and residuals.
• A generator can derive conservative candidate obligations from JavaScript Application Graph and runtime/process Evidence.
• Users can add reviewed obligations without pretending they were automatically observed.
• Reconstruction manifests bind modules/symbols and fixture/verifier IDs to obligations.
• Closure verification fails on missing owner, parser/type, negative fixture, verifier result, or comparable authority.
• Static-only candidates remain static and cannot be upgraded to observed behavior implicitly.
• Duplicate and ambiguous ownership fails closed.
• Contradictory evidence reopens or fails the affected obligation.
• Results are deterministic, pageable, Evidence v2-backed, and exportable as MCP resources.
• CLI and MCP expose identical structured summaries and typed per-obligation diagnostics.
• Fixtures demonstrate that green unit tests cannot close an unexercised packaged-process obligation.
• Documentation gives complete examples for CLI, protocol, Electron, persistence, and native ABI reconstruction.

Relationship to existing work

• Builds on JavaScript Application Graph, JavaScript runtime semantic tracing in #404, and static/runtime reconciliation.
• Consumes Process Capture v4 and comparison Evidence.
• Complements verify_reconstruction; it supplies the finite specification and proves specification coverage rather than claiming global equivalence.
• Portable output should align with #336.

Non-goals

• Automatically claiming a whole application has been cloned.
• Inventing obligations for unavailable private server internals.
• Treating source-file or test counts as behavioral coverage.
• Allowing waivers to disappear from completion reports.

Originally created by @morluto on GitHub (Jul 22, 2026). Original GitHub issue: https://github.com/morluto/rea/issues/405 ## Problem REA can produce application graphs, Evidence v2 records, comparisons, process captures, and reconstruction verification for finite claims. What is missing is a machine-readable closure model that answers: > Which observed behaviors and boundaries have an owned reconstructed implementation and verifier, and which obligations remain open? Without this, a reconstruction can accumulate many green component tests while still lacking an executable owner for a command, parser, persistence format, runtime lifecycle, or negative path. ## Proposal Add a Reconstruction Obligation Ledger derived from authenticated static/runtime Evidence plus an explicitly supplied reconstruction manifest. Each obligation should represent one finite claim, not global application equivalence. ## Obligation record An obligation should include: - stable obligation ID and version; - authority Evidence IDs and exact locations; - target artifact/application-graph node; - boundary or behavior family; - observed positive, negative, malformed, cancellation, and teardown cases; - reconstructed owning module and symbol; - parser/schema/domain type where applicable; - fixture IDs and fixture authority; - verifier command/claim ID and latest result Evidence; - allowed nondeterminism/partial-order specification; - dependencies on other obligations; - status: unowned, characterized, implemented, verified, contradicted, blocked, out-of-scope, or unknown; - residual unknowns, unavailable authority, and required next evidence. ## Coverage generation Candidate obligations may be generated from: - CLI commands/options/errors; - REST/GraphQL/Phoenix/WebSocket/JSON-RPC/MCP endpoints and schemas; - IPC/contextBridge/preload/native-addon boundaries; - persisted paths/formats/migrations; - process roles, signals, children, and cleanup; - routes, operations, UI states, and desktop bridge calls; - native exports and ABI surfaces; - application-version deltas; - runtime capture events and negative outcomes. Generation must be conservative. A static literal establishes a candidate obligation, not runtime reachability. One-sided evidence cannot prove behavioral absence. ## Closure rules - `verified` requires comparable authority and reconstruction evidence for the declared finite claim. - A module existing is not proof it owns the behavior. - A unit test is insufficient when the obligation is process-, packaging-, renderer-, ABI-, or protocol-level. - Missing negative coverage remains open when malformed/error behavior is part of the boundary. - A broad verifier cannot silently satisfy obligations it does not enumerate. - Unknown, blocked, waived, and out-of-scope obligations remain visible and cannot count as verified. - Every completion report must enumerate all obligations and prove zero required open items. ## Outputs - canonical JSON ledger; - summary grouped by application layer and evidence authority; - dependency/ownership graph; - missing-owner and missing-verifier report; - contradiction report; - residual-unknown ledger; - deterministic closure digest; - portable Evidence v2/resource representation. ## Acceptance criteria - [ ] A versioned schema defines obligations, ownership, evidence, fixtures, verifier claims, dependencies, and residuals. - [ ] A generator can derive conservative candidate obligations from JavaScript Application Graph and runtime/process Evidence. - [ ] Users can add reviewed obligations without pretending they were automatically observed. - [ ] Reconstruction manifests bind modules/symbols and fixture/verifier IDs to obligations. - [ ] Closure verification fails on missing owner, parser/type, negative fixture, verifier result, or comparable authority. - [ ] Static-only candidates remain static and cannot be upgraded to observed behavior implicitly. - [ ] Duplicate and ambiguous ownership fails closed. - [ ] Contradictory evidence reopens or fails the affected obligation. - [ ] Results are deterministic, pageable, Evidence v2-backed, and exportable as MCP resources. - [ ] CLI and MCP expose identical structured summaries and typed per-obligation diagnostics. - [ ] Fixtures demonstrate that green unit tests cannot close an unexercised packaged-process obligation. - [ ] Documentation gives complete examples for CLI, protocol, Electron, persistence, and native ABI reconstruction. ## Relationship to existing work - Builds on JavaScript Application Graph, JavaScript runtime semantic tracing in #404, and static/runtime reconciliation. - Consumes Process Capture v4 and comparison Evidence. - Complements `verify_reconstruction`; it supplies the finite specification and proves specification coverage rather than claiming global equivalence. - Portable output should align with #336. ## Non-goals - Automatically claiming a whole application has been cloned. - Inventing obligations for unavailable private server internals. - Treating source-file or test counts as behavioral coverage. - Allowing waivers to disappear from completion reports.

bsakaguchi 2026-10-15 18:22:58 +00:00

• closed this issue
• added the
  P1: high
  enhancement
  labels

bsakaguchi referenced this issue 2026-10-15 18:28:29 +00:00

[GH-ISSUE #2383] [Tracker] Audit analysis and debugging coverage for the TIOBE top 100 languages (October 2026) #794

bsakaguchi referenced this issue 2026-10-16 21:12:18 +00:00

[PR #249] [MERGED] feat(artifact): reconstruct JavaScript application structure #1898

bsakaguchi added

enhancement

and removed

enhancement

labels 2026-10-31 00:28:54 +00:00

Sign in to join this conversation.

No Branch/Tag specified

Branches Tags

main

codex/procedure-reference-stacked

release-please--branches--main--components--rea-agents

release-please--branches--main--components--rea-agents--release-notes

codex/kuna-independent-retry

codex/byte-search-overlay-coverage

codex/open-failure-target-receipt

codex/kuna-xref-evidence

codex/ghidra-ambiguous-procedure-recovery

codex/function-source-bundle

codex/trace-function-integration-prototype

codex/snapshot-source-closure

codex/recorded-evidence-array-pages

codex/evidence-recovery-redesign

codex/trace-feature-address-scope

codex/call-discovery-scope

codex/ghidra-literal-candidate-evidence

codex/decompile-directory-independent-retry

codex/retry-provenance-base

codex/value-flow-capability-experiment

codex/ghidra-containing-instruction

cursor/readme-discord-button-ef9f

dependabot/github_actions/actions/setup-node-7.1.0

dependabot/github_actions/actions/upload-artifact-7.0.2

dependabot/npm_and_yarn/npm-minor-and-patch-d8d97ce6df

codex/kuna-1989

fix/8559-native-ui-fixture-ownership

fix/8555-go-verifier-mcp-ownership

codex/provider-capability-recovery

fix/8642-rizin-target-stdin

codex/ghidra-memory-effect-scope

codex/ghidra-annotation-entry-selector

codex/ghidra-readonly-recovery

codex/ghidra-regex-verifier-recovery

codex/evidence-discovery-view-guidance

fix/8545-bulk-append-overflow

fix/8428-navigation-refusal-alternatives

codex/address-context-recovery

codex/matching-member-limitations

codex/unknown-scope-contract

codex/evidence-view-guidance

feat/8373-native-trace-views

codex/ghidra-snapshot-verifier-binding

codex/elf-export-visibility

codex/evidence-view-recovery

codex/native-reference-cli-help

codex/provider-candidate-observation-scope

codex/kuna-session-verification

codex/ghidra-switch-lifetime-guidance

codex/pseudocode-paging-discovery

codex/clarify-evidence-view-support

codex/kuna-xrefs-selector-recovery

codex/context-capacity-recovery

codex/evidence-closure-large-links

codex/same-function-evidence-identity

codex/ghidra-verifier-inspected-jdk

codex/audit-guided-workflows

codex/crash-prompt-retained-dossiers

codex/analysis-view-error-recovery

codex/kuna-verifier-target-selection

codex/ghidra-selected-project-call-coverage

codex/docs-native-analysis-scope

codex/ghidra-java-socket-boundary

codex/ghidra-retained-snapshot-verifier

codex/ghidra-search-inventory-facts

fix/8284-zero-argument-parameter-bindings

fix/8198-ui-action-handler-offset

fix/8257-elf-entry-label-identity

fix/8304-deferred-output-schema-projection

fix/8277-call-path-computed-target-uncertainty

fix/pr-8089-conflicts

fix/ci-static-duplicate-export

dependabot/npm_and_yarn/lint-staged-17.6.0

dependabot/github_actions/actions/download-artifact-8.0.2

dependabot/npm_and_yarn/write-file-atomic-8.0.0

dependabot/npm_and_yarn/canonicalize-5.1.0

dependabot/github_actions/actions/cache/restore-6.1.0

dependabot/npm_and_yarn/toon-format/toon-4.4.0

dependabot/github_actions/actions/deploy-pages-5.0.1

codex/review-fixes-pr-2403

codex/review-fixes-pr-2400

codex/process-terminal-width

codex/test-brittleness-cleanup

verify/7167-browser-connect-macos

fix/7167-browser-connect

feat/native-matching-allowance-setting

feat/browser-scenario-dry-run

test/managed-caller-parameters-20261024

codex/parser-fortythird-boundaries

fix/6926-pinvoke-platform-decorations-20261023

fix/6889-har-body-encoding-20261023

fix/6888-sqlite-schema-budget-20261023

fix/dependency-security-gates-6708

cursor/evidence-overwrite-rebase-b4ac

feat/4057-verify-native-exports

fix/windows-acl-observer-overhead-20261022

cursor/erlang-beam-restack-4476

cursor/pe-certificate-review-bf32

fix/6116-javascript-application-fs-errors

fix/6061-unmapped-runtime-script-unknown

feat/browser-scenario-summary

fix/pe-certificates

codex/verify-3407

cursor/rebase-5699

cursor/rebase-5352

cursor/rebase-5600

cursor/fix-cli-schema-omission-10a8

codex/audit-hopper-shutdown-reasons-20261021

fix/demangle-swift-omitted-record

fix/nib-boolean-value-types

cursor/cancellation-partial-observation-a5ac

fix/ib-object-limit-reasons

fix/electron-fuse-limit-advice

fix/kuna-doctor-dangling-cache

fix/fixed-budget-refusal-advice

fix/js-ipc-listener-dedup

fix/js-return-member-provenance

fix/dmg-integrity-retry-advice

fix/ida-doctor-readiness

fix/kuna-version-probe-output-drain

fix/legacy-swift-runtime-name-matching

fix/dylib-lazy-load-commands

fix/browser-scenario-startup-cancel

fix/swift-nested-punycode-classification

fix/compare-unselected-scopes

fix/objc-method-budget-coverage

fix/dmg-mounted-root-observations

audit/ci-tests-20261019-round2

release/6.7.0

fix/wabt-cleanup-retry-resolution

fix/electron-fuse-elf-pe-architecture

fix/native-plist-descriptor-ownership

fix/kuna-caller-cleanup-ownership

experiment/atomic-codemode-20261016

review/first-contributor-3776

fix/call-resolution-full-read-cycles

fix/member-mutation-selection-repeat

experiment/atomic-re-tools-20261015

perf/member-mutation-lazy-origins

perf/static-network-mutation-index

fix/hopper-startup-lifecycle

audit/3050-windows-proof-20261015

feat/windows-window-capture-2183

audit/3049-windows-proof-20261015

audit/3735-macos-fixtures-20261015

fix/batch-decompile-null-pseudocode

fix/kuna-inventory-honors-jobs

experiment/browser-codemode-tool-design-20261015

fix/hopper-clean-runtime-argv

codex/review-2049-27f1b367

review-fixes/pr-2787-routing

fix/3360-scoped-this-emitters

fix/3367-replaced-global-effects

fix/3838-compact-any-value-items

test/hopper-download-probe-20261015

codex/windows-runtime-creation-red-green-20261015

codex/windows-readonly-root-red-green-20261015

codex/windows-root-share-red-green-20261015

codex/exp-1685-win-mcp-startup

codex/bug-sweep-20261015

investigate/2190-windows-package-phases

investigate/3543-macos-cli-deadline

perf/3281-reverse-tools-feedback-quality

fix/3406-hopper-doctor-fixture

fix/3341-wrapper-require-test-context

fix/3301-owned-uninstall-fixtures

fix/3164-compiler-input-ownership

fix/pcap-cleanup-stdout-newline-20261014

perf/interface-builder-summary

codex/review-fixes-pr-1977

fix/ghidra-effective-jvm-platform

fix/docs-turkish-rust-link-20261013

fix/main-maintenance-ci-20261010

fix/recover-binary-session-process-effects

codex/review-fixes-pr-2457

codex/ci-required-cancellation-gate

fix/main-format-baseline-20261013

fix/setup-preserve-entry-fields

cursor/restore-main-checks-1ffc

fix/ghidra-bridge-hashmap-import

codex/shared-ci-jadx-json-default-20261013

codex/shared-ci-ghidra-test-groups-20261013

codex/shared-ci-java-fixture-format-20261013

codex/fix-intrinsic-invocation-boundaries

test/release-preflight-reusable-jobs

test/js-parameter-provenance-expectation

fix/linux-hopper-verification-current

test/2419-ghidra-elf-probe-size

followup/pr-1544-native-ida

codex/fold-pr-2230-contribution

docs/readme-responsible-use

fix/issue-2064

fix/issue-2050

fix/issue-2053

fix/issue-1968

fix/issue-1945

experiment/codemode-bridge-20261011

fix/tool-effects-negative-wording-1904-20261012

fix/1842-electron-interop-provenance

feat/recover-javascript-multi-input

refactor/website-i18n-prep

fix/nativeaot-pe-virtual-extent

fix/browser-verifier-ci-hang

fix/pe-resources-input-selection

docs/beginner-friendly-guides

docs/beginner-setup-guide

fix/javascript-analysis-worker-1563

fix/1649-ghidra-duplicate-names

fix/javascript-export-keys-integration-1369

test/maintenance-boundary-contracts-20261011

review/javascript-export-keys-1369

review/process-live-progress-1483

test/javascript-1495-growth-ratio

fix/ci-escape-timing

docs/normalized-terminal-geometry-1450

release/6.3.0

archive/release-6.3.0-pr1381

release/6.2.0

fix/electron-preload-dynamic-override

fix/javascript-self-referential-bundler-edges

release/6.1.0

cursor/grok-client-cherry-pick-0b56

feat/signature-posture

feat/dyld-shared-cache

feat/artifact-integrity-policy

feat/pkg-inventory

release/6.0.0

chore/sync-release-5.0.0

release/5.0.0

cursor/cloud-agent-node-787e

fix/javascript-xhr-open-endpoints

review/pr-711-realpath-fallback-wording

cleanup/replay-confinement

codex/test-suite-performance

codex/issue-foundations

codex/address-open-issues-2026-07-20

agent/javascript-vite-rollup-esbuild-adapters

agent/process-cleanup

agent/triage-integration

agent/unknown-commands-registry

feat/mcp-identity-metadata

morlvps/issue_cleanup

codex/installer-redesign

morl/roadmap-investigation-core

morl/roadmap-investigation-docs

release-please--branches--main--components--rea

rea-agents-6.8.0

rea-agents-6.7.0

rea-agents-6.6.0

experiment/atomic-codemode-wait-runtime-20261016

rea-agents-6.5.0

rea-agents-6.4.0

rea-agents-6.3.0

rea-agents-6.2.0

rea-agents-6.1.0

rea-agents-6.0.0

rea-agents-5.0.0

rea-agents-4.1.0

rea-agents-4.0.1

rea-agents-4.0.0

rea-agents-3.2.1

rea-agents-3.2.0

rea-agents-3.1.0

rea-agents-3.0.0

rea-agents-2.7.0

rea-agents-2.6.0

rea-agents-2.5.1

rea-agents-2.5.0

rea-agents-2.4.0

rea-agents-2.3.0

rea-agents-2.2.0

rea-agents-2.1.0

rea-agents-2.0.0

rea-agents-1.7.0

rea-agents-1.6.0

rea-agents-1.5.0

rea-agents-1.4.0

rea-agents-1.3.0

rea-agents-1.2.0

rea-agents-1.1.0

rea-agents-1.0.0

rea-agents-0.5.0

rea-agents-0.4.0

rea-agents-0.3.0

rea-0.2.1

rea-0.2.0

Labels

Clear labels   

area: bridge

  

area: bridge

  

area: build

  

area: build

  

area: build

  

area: cli

  

area: domain

  

area: evidence

  

area: mcp

  

area: native

  

area: providers

  

area: runtime

  

area: server

  

area: setup

  

area: tests

  

bug

  

design

  

documentation

  

enhancement

  

enhancement

  

enhancement

  

experiment

  

help wanted

  

i18n

  

invalid

  

P0: critical

  

P1: high

  

P2: medium

  

P2: medium

  

P2: medium

  

P3: low

  

performance

  

provider-request

  

pull-request

Mirrored from GitHub Pull Request

  

question

  

roadmap

  

triage

No labels

area: bridge

area: bridge

area: build

area: build

area: build

area: cli

area: domain

area: evidence

area: mcp

area: native

area: providers

area: runtime

area: server

area: setup

area: tests

bug

design

documentation

enhancement

enhancement

enhancement

experiment

help wanted

i18n

invalid

P0: critical

P1: high

P2: medium

P2: medium

P2: medium

P3: low

performance

provider-request

pull-request

question

roadmap

triage

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

morluto/rea#249

No description provided.