[PR #1436] [MERGED] test(native): verify macOS provenance through real CLI and MCP #2885

Closed
opened 2026-10-17 21:11:25 +00:00 by bsakaguchi · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/morluto/rea/pull/1436
Author: @N0zoM1z0
Created: 10/10/2026
Status: ✅ Merged
Merged: 10/10/2026
Merged by: @N0zoM1z0

Base: main ← Head: test/native-macos-provenance-e2e


📝 Commits (3)

  • aac9404 perf(native): record macOS command provenance once in its Evidence
  • 1c40f63 test(native): verify provenance through real macOS CLI and MCP
  • 0568bd3 chore: integrate merged native provenance change for verification

📊 Changes

2 files changed (+74 additions, -0 deletions)

View changed files

📝 scripts/verify/apple/macos-bundle.mjs (+3 -0)
➕ scripts/verify/apple/native-provenance.mjs (+71 -0)

📄 Description

Add a real macOS CLI/stdin MCP verification workflow for the five native inspections whose repeated command provenance was removed in #1430. The existing source-owned compiled app fixture supplies the target, so no installed private apps or deep-analysis provider are required.

The workflow calls inspect_macho, inspect_signature, inspect_plist, list_architectures, and demangle_swift through both public adapters. It uses the advertised SDK tool definitions and named output contracts, checks complete normalized result/provenance parity, text/structured parity, the nullable raw representation, ping after every call, and unchanged executable bytes. The CI report records command counts and actual serialized CLI/MCP response sizes.

Validation is scoped explicitly: Linux checks cover the provider and production-boundary contracts; actual macOS execution is supplied by the existing Real Apple artifact CLI/MCP E2E job on this PR's final head. The pre-#1430 main regression failed because the duplicate provenance remained in raw_result. Full serial runtime build, typechecking and lint pass locally after integration with the merged main, with 36 focused tests passing. The earlier wider lane skipped 13 Darwin-only tests on Linux.

Refs #1430, #1065 and #723. No runtime or schema changes. Real macOS workflow results must pass before merge; no model-token or provider-startup improvement is claimed.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/morluto/rea/pull/1436 **Author:** [@N0zoM1z0](https://github.com/N0zoM1z0) **Created:** 10/10/2026 **Status:** ✅ Merged **Merged:** 10/10/2026 **Merged by:** [@N0zoM1z0](https://github.com/N0zoM1z0) **Base:** `main` ← **Head:** `test/native-macos-provenance-e2e` --- ### 📝 Commits (3) - [`aac9404`](https://github.com/morluto/rea/commit/aac9404eee39cac86869f979638d884a2ed62c91) perf(native): record macOS command provenance once in its Evidence - [`1c40f63`](https://github.com/morluto/rea/commit/1c40f639f5818fc7c0046dc24c98b43b9a89040b) test(native): verify provenance through real macOS CLI and MCP - [`0568bd3`](https://github.com/morluto/rea/commit/0568bd345fe4bef2f0717c9765085deb7594f549) chore: integrate merged native provenance change for verification ### 📊 Changes **2 files changed** (+74 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `scripts/verify/apple/macos-bundle.mjs` (+3 -0) ➕ `scripts/verify/apple/native-provenance.mjs` (+71 -0) </details> ### 📄 Description Add a real macOS CLI/stdin MCP verification workflow for the five native inspections whose repeated command provenance was removed in #1430. The existing source-owned compiled app fixture supplies the target, so no installed private apps or deep-analysis provider are required. The workflow calls `inspect_macho`, `inspect_signature`, `inspect_plist`, `list_architectures`, and `demangle_swift` through both public adapters. It uses the advertised SDK tool definitions and named output contracts, checks complete normalized result/provenance parity, text/structured parity, the nullable raw representation, ping after every call, and unchanged executable bytes. The CI report records command counts and actual serialized CLI/MCP response sizes. Validation is scoped explicitly: Linux checks cover the provider and production-boundary contracts; actual macOS execution is supplied by the existing Real Apple artifact CLI/MCP E2E job on this PR's final head. The pre-#1430 main regression failed because the duplicate provenance remained in `raw_result`. Full serial runtime build, typechecking and lint pass locally after integration with the merged main, with 36 focused tests passing. The earlier wider lane skipped 13 Darwin-only tests on Linux. Refs #1430, #1065 and #723. No runtime or schema changes. Real macOS workflow results must pass before merge; no model-token or provider-startup improvement is claimed. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
bsakaguchi 2026-10-17 21:11:25 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
morluto/rea#2885
No description provided.