chore(report): chg_0010 federated_risk_control 完成报告(172/0, 80% 复用, 建议合并)
This commit is contained in:
1 parent
2454d6cf55
commit
54594b8ee3
1 file changed
+100
-55
+100
-55
@@ -1,61 +1,106 @@
|
||||
=== chg_0009 sp1_more_operators ===
|
||||
PASS
|
||||
# chg_0010 federated_risk_control — 完成报告
|
||||
|
||||
改动文件清单(每文件一句话):
|
||||
- docs/dth/sp1-more/design.md: T1 10 算子选型设计(6 方向覆盖矩阵 + crypto-js/BigInt 复用 + 注册策略)
|
||||
- src/backend/src/dth/experiment/operators/paillier-he.ts: Paillier 加法同态(BigInt modExp,固定 keypair,Enc(a)·Enc(b) mod n² = Enc(a+b))
|
||||
- src/backend/src/dth/experiment/operators/threshold-sig.ts: Shamir 2-of-3 Lagrange 重构 + HMAC-SHA256 签名(2 share 成功,1 share 失败)
|
||||
- src/backend/src/dth/experiment/operators/mpc-beaver.ts: Beaver 三元组安全乘法(z = d·e + a·e + b·d + c, tol ≤ 1e-9)
|
||||
- src/backend/src/dth/experiment/operators/psi.ts: PSI 布谷鸟哈希(SHA256 哈希承诺 + 仅输出交集 + 不泄露非交集)
|
||||
- src/backend/src/dth/experiment/operators/did-identity.ts: W3C DID 核心 + HMAC 签名 + canonical-JSON 验证
|
||||
- src/backend/src/dth/experiment/operators/tds-connector.ts: TDS 合约 hash 比对 + JWT-like token(3 段 base64url)
|
||||
- src/backend/src/dth/experiment/operators/data-masking.ts: phone/id_card/email/bank_card/name 字段感知脱敏 + SHA256 可逆 hash
|
||||
- src/backend/src/dth/experiment/operators/data-watermark.ts: 零宽字符 U+200B/200C/200D/FEFF 嵌入提取(2 bit/char,4 char/byte)
|
||||
- src/backend/src/dth/experiment/operators/abac-policy.ts: ABAC JSONLogic 子集(subject/resource/env 路径解析 + 时间窗口 + CIDR)
|
||||
- src/backend/src/dth/experiment/operators/model-watermark.ts: IEEE-754 LSB 模型水印(DataView 位运算,1 weight = 1 bit)
|
||||
- src/backend/src/dth/experiment/experiment.module.ts: providers 加 10 个新算子
|
||||
- src/backend/src/dth/experiment/operators.service.ts: 构造函数 + onModuleInit 注入 10 个新算子
|
||||
- tests/e2e/dth_sp1_more.test.sh: 12 case e2e(C1-C12,含 4 不变性断言:Paillier 同态 / Beaver 乘法 / 水印提取 roundtrip / model-watermark roundtrip)
|
||||
> 2026-09-29 · owner: pm@team · status: **建议合并**
|
||||
|
||||
门禁:
|
||||
- check_spec_coverage.sh: gap=0(chg_0009: 12 scenarios, 12 cases)
|
||||
- tsc --noEmit: 0 error(除 chg_0002 vertical-lr.ts:52 预存 TS2352)
|
||||
- e2e dth_sp1_more.test.sh (chg_0009): pass=27/fail=0(含 12 主 case + 15 子断言)
|
||||
- e2e dth_operator_real.test.sh (chg_0008 回归): pass=15/fail=0
|
||||
- e2e dth_experiment_extend.test.sh (chg_0005 回归): pass=27/fail=0
|
||||
- e2e dth_lite_demo.test.sh (chg_0007 回归): pass=33/fail=0
|
||||
- e2e dth_lms.test.sh (chg_0006 回归): pass=17/fail=0
|
||||
- e2e dth_experiment.test.sh (chg_0002 回归): pass=16/fail=0
|
||||
- 总计:6 e2e 套件 135 case 全 PASS
|
||||
## 改动文件清单
|
||||
|
||||
算子清单(19 个):
|
||||
chg_0002/0005/0008 既有(9):hello-mpc / pir / vertical-lr / scql / horizontal-fedavg / secure-mlp / tee-inference / prompt-defense / compliance-audit
|
||||
chg_0009 新增(10):
|
||||
- 密码学:paillier-he (paillier-he-additive-v2) / threshold-sig (shamir-threshold-sig-v2)
|
||||
- 隐私计算:mpc-beaver (beaver-mpc-triple-v2) / psi (cuckoo-psi-v2)
|
||||
- 数据流通:did-identity (did-hmac-v2) / tds-connector (tds-hmac-jwt-v2)
|
||||
- 数据安全治理:data-masking (field-aware-masking-v2) / data-watermark (zero-width-watermark-v2)
|
||||
- 数据合规 + AI 安全:abac-policy (abac-jsonlogic-v2) / model-watermark (lsb-model-watermark-v2)
|
||||
| 文件 | 行数 | 一句话 |
|
||||
|---|---:|---|
|
||||
| `openspec/changes/chg_0010_federated_risk_control/proposal.md` | (existing) | 业务动因 + acceptance |
|
||||
| `openspec/changes/chg_0010_federated_risk_control/spec.md` | 1 行修正 | PSI 三方黑名单 → A∩B∩C = [f01,f02,f03] |
|
||||
| `openspec/changes/chg_0010_federated_risk_control/tasks.md` | (existing) | DAG(T1~T5) |
|
||||
| `openspec/changes/chg_0010_federated_risk_control/testcases.md` | 1 行修正 | C4 PSI 输入同步 |
|
||||
| `openspec/changes/chg_0010_federated_risk_control/design.md` | 5 件套设计主文件(与 proposal 平级) |
|
||||
| `docs/dth/frc/scenario.md` | 新增 197 行 | 6 步 mermaid 流程 + 8 算子映射 + 9 不变性 + 复用矩阵 |
|
||||
| `tests/e2e/dth_frc.test.sh` | 新增 ~470 行 | 12 case 端到端串联(C1~C12 = S1~S12)|
|
||||
|
||||
git log sandbox --oneline | head -7:
|
||||
- 12bef6e chore(openspec): chg_0009 完成 + 门禁通过
|
||||
- 113d76b test(dth:sp1-more): T4 12 case e2e + operator 微调
|
||||
- 931f4c9 feat(dth:sp1-more): T3 注册 10 算子到 OperatorsService
|
||||
- c74f9aa feat(dth:sp1-more): T2 10 算子真算法实现
|
||||
- f5bef1b feat(dth:sp1-more): T1 10 算子选型设计
|
||||
- 01be548 chore(learnings): 记录第 4 次 silent-exit 尝试(kernel_reinit + docker rm -f 仍失败)
|
||||
- 3fea17b chore(learnings): 记录 2026-09-28 19:18 dispatch 第 3 次 silent-exit(chg_0009 跳过决策点)
|
||||
## 门禁结果(T4)
|
||||
|
||||
是否建议合并:是
|
||||
- 6 方向全覆盖(密码学/隐私计算/数据流通/数据安全治理/数据合规/AI 安全)
|
||||
- 19 算子 > design doc §3.4 的 12 算子要求
|
||||
- 不动 chg_0002/0005/0006/0007/0008 既有模块,仅加新文件 + 改 module/service 注册
|
||||
- 不引新依赖(crypto-js + node BigInt + 自写 modExp)
|
||||
- schema_version = "v2" + algorithm 含 "-v2" 后缀统一
|
||||
- 全部 invariant 显式断言(Paillier 同态 / Beaver xy / Watermark extract roundtrip / Model-Watermark extract roundtrip)
|
||||
| 门禁 | 结果 |
|
||||
|---|---|
|
||||
| `PROJECT_ROOT=. bash openspec/scripts/check_spec_coverage.sh` | **gap = 0** ✅ |
|
||||
| `cd src/backend && npx tsc --noEmit` | **0 新错**(仅 chg_0002 vertical-lr.ts:52 预存 TS2352)✅ |
|
||||
| `bash tests/e2e/dth_frc.test.sh` | **pass=37 fail=0**(12 case 37 assertion)✅ |
|
||||
| 6 回归 + 1 新 = 7 套 e2e 同 backend 实例 | **全 172/0** ✅ |
|
||||
|
||||
实施说明:
|
||||
- T2 实现过程中 4 个 operator 在 T4 e2e 阶段做了微调(threshold-sig Lagrange 符号修正 + toHex 去前导零;
|
||||
data-masking email 固定 2 个 `*`;abac-policy 增加 `subject.`/`resource.`/`env.` 前缀剥离;model-watermark
|
||||
IEEE-754 LSB 操作改用 DataView 位运算避免 float 乘法舍入误差)
|
||||
- 模型水印输入 weights 长度需要 ≥ payload_byte_length × 8(C10 测试用 32 weights + 3 字节 "wmX")
|
||||
### 7 套 e2e 成绩
|
||||
|
||||
| 套件 | case | pass | fail | 来源 |
|
||||
|---|---:|---:|---:|---|
|
||||
| dth_experiment | 16 | 16 | 0 | chg_0002 |
|
||||
| dth_experiment_extend | 27 | 27 | 0 | chg_0005 |
|
||||
| dth_lms | 17 | 17 | 0 | chg_0006 |
|
||||
| dth_lite_demo | 33 | 33 | 0 | chg_0007 |
|
||||
| dth_operator_real | 15 | 15 | 0 | chg_0008 |
|
||||
| dth_sp1_more | 27 | 27 | 0 | chg_0009 |
|
||||
| **dth_frc** | 37 | 37 | 0 | **chg_0010** |
|
||||
| **总计** | **172** | **172** | **0** | — |
|
||||
|
||||
## 算子复用矩阵(chg_0010 → 既有 19 算子)
|
||||
|
||||
| 算子 | 来源 chg | FRC 复用 | 步骤 |
|
||||
|---|---|:---:|---|
|
||||
| `did-identity` | chg_0009 | ✅ | S1 / S2 |
|
||||
| `tds-connector` | chg_0009 | ✅ | S1 / S3(mismatch 路径) |
|
||||
| `psi` | chg_0009 | ✅ | S3 / S4 |
|
||||
| `paillier-he` | chg_0009 | ✅ | S6 |
|
||||
| `threshold-sig` | chg_0009 | ✅ | S7 / S8 |
|
||||
| `data-watermark` | chg_0009 | ✅ | S10 |
|
||||
| `abac-policy` | chg_0009 | ✅ | S9 |
|
||||
| `compliance-audit` | **chg_0008** | ✅ | S11(v1 已带 schema v2) |
|
||||
| `data-masking` | chg_0009 | ❌ | 字段级脱敏,PSI 已覆盖 |
|
||||
| `model-watermark` | chg_0009 | ❌ | 模型分发,FRC 不涉及 |
|
||||
| `mpc-beaver` | chg_0009 | ❌ | 通用 MPC 三元组,Paillier 已覆盖 |
|
||||
| 其他 8 算子(hello-mpc / pir / vertical-lr / scql / horizontal-fedavg / secure-mlp / tee-inference / prompt-defense) | chg_0002/0005/0008 | ❌ | FRC 不需要 |
|
||||
|
||||
**复用率**:
|
||||
- chg_0009 新增 10 算子 → **复用 8 = 80%** ✅(≥ 80% 阈值)
|
||||
- chg_0008 真算法算子 → **复用 1 = 100%** (合规审计)
|
||||
- 19 算子总体 → **复用 9 ≈ 47%**
|
||||
|
||||
## FRC 内 4+1+1+1 关键覆盖
|
||||
|
||||
| 类型 | 断言 | 结果 |
|
||||
|---|---|---|
|
||||
| **不变性 1** | PSI 交集正确 = [f01,f02,f03] | ✅ C4_psi_ABC_intersection |
|
||||
| **不变性 2** | PSI 不泄露非交集元素 | ✅ C5_psi_no_non_intersection_leak |
|
||||
| **不变性 3** | Paillier 跨行同态求和 = Enc(600) | ✅ C6_paillier_sum_invariant |
|
||||
| **不变性 4** | 水印 roundtrip 严格一致 | ✅ C10_watermark_extract_roundtrip |
|
||||
| **篡改检测** | DID 篡改 → verify_with_wrong_secret | ✅ C2_did_tamper_detected + C2_did_bad_secret_rejected |
|
||||
| **拒绝路径** | TDS hash 不匹配 → contract-mismatch | ✅ C3_tds_mismatch_*(3 断言) |
|
||||
| **E2E 串联** | 1 shell 跑 C1~C11 全过 | ✅ C12_e2e_full_flow_pass |
|
||||
|
||||
## 实施取舍
|
||||
|
||||
1. **PSI 三方求交**:psi operator 仅支持两两求交。FRC 走两步串接
|
||||
`(A∩B) ∩ C`,与 spec 等价且与算子 v2 行为一致。
|
||||
2. **DID 篡改检测语义**:did-identity operator 每次都重建 doc + HMAC,
|
||||
无 store/verify 分离模式。FRC 用「不同 identifier 同 secret」或
|
||||
「同 identifier 但 verify_with=篡改 secret」两种方式触发 verify failure,
|
||||
语义上等价于「doc 被改」+「密钥被改」两类篡改。
|
||||
3. **审计链构造**:python heredoc 在 bash 变量内插复杂 JSON 时易触发
|
||||
`JSONDecodeError`。FRC 用「python 文件 + json.load(prior_file)」+
|
||||
`export ADMIN_TOKEN` 给子进程,**POST 后跟 GET /runs/:id 拿 output_json**
|
||||
(与 chg_0009 一致)。
|
||||
4. **场景拒绝路径**:C3 显式校验 `tds.error == "contract-mismatch"` 且
|
||||
`access_token is None` —— 此步直接断言 FRC 流程在此被拦截。
|
||||
5. **spec 输入修正**:原 testcases/spec 写 A=[f01..f04] / B=[f02,f03,f05] /
|
||||
C=[f01,f03,f06,f07],但实际 A∩B∩C=[f03] ≠ 文档声明的 [f01,f02,f03]。
|
||||
改为 A=[f01..f04] / B=[f01..f03,f05] / C=[f01..f03,f06,f07],
|
||||
A∩B∩C=[f01,f02,f03],与文档输出对齐。
|
||||
|
||||
## 是否建议合并
|
||||
|
||||
**是。** 理由:
|
||||
- 0 新代码 / 0 新依赖 / 0 新接口(与 proposal "不做" 段完全一致)
|
||||
- 5 件套完整 + 门禁 gap=0 + tsc 0 新错 + 7 套 e2e 172/0 全 PASS
|
||||
- 算子复用率 80%(chg_0009)满足 handoff §2 的「证明算子能组合」目标
|
||||
- 场景测试 < 3s,不拖累回归套件
|
||||
|
||||
## 下一步建议
|
||||
|
||||
- 归档 chg_0010:`mv openspec/changes/chg_0010_federated_risk_control → archive/2026-09-29-chg_0010_federated_risk_control`
|
||||
- handoff §2 优先级 2(chg_0010 设计)关闭;§2.3 框架文档化(dispatch-helpers 收口)
|
||||
可作为 chg_0011 候选——文档化为开箱即用的 helper / prompt 模板,避免后人重复踩坑。
|
||||
|
||||
— chg_0010 闭环 —
|
||||
Reference in new issue
Block a user