skills/codestable__codestable
1
0
Fork 0
mirror of https://github.com/codestable/CodeStable.git synced 2026-09-19 09:03:09 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
v1.0.4
codestable__codestable/experiments/cs-issue-e2e-001
T
History
Wyatt Fang 30fecaae5e release(codestable): ship skill workflow v1.0.2 (#41) 
收敛 CodeStable 主入口、runtime preflight、goal driver 与 skill 工程化评测闭环。

- 根 cs 对行动请求同轮直转，咨询与介绍保持非执行
- feature/issue/refactor/epic/docs 按仓库事实恢复，旧 stage skill 保留兼容薄壳
- repo-local runtime 支持版本检测、安全自动同步和显式 refresh-runtime
- 完成 Codex/Claude marketplace 1.0.2、升级文档和回归/评测证据

验证：215 tests passed；package/runtime/diff checks passed；独立 review 与 QA 无 unresolved blocking/important findings。
2026-07-10 15:23:56 +08:00
..
bugs
release(codestable): ship skill workflow v1.0.2 (#41)
2026-07-10 15:23:56 +08:00
fixtures/e2e
release(codestable): ship skill workflow v1.0.2 (#41)
2026-07-10 15:23:56 +08:00
hidden
release(codestable): ship skill workflow v1.0.2 (#41)
2026-07-10 15:23:56 +08:00
variants
release(codestable): ship skill workflow v1.0.2 (#41)
2026-07-10 15:23:56 +08:00
config.json
release(codestable): ship skill workflow v1.0.2 (#41)
2026-07-10 15:23:56 +08:00
hypotheses.md
release(codestable): ship skill workflow v1.0.2 (#41)
2026-07-10 15:23:56 +08:00
README.md
release(codestable): ship skill workflow v1.0.2 (#41)
2026-07-10 15:23:56 +08:00
results.md
release(codestable): ship skill workflow v1.0.2 (#41)
2026-07-10 15:23:56 +08:00

README.md

cs-issue-e2e-001

这是 cs-issue 的 e2e outcome 冒烟评测实验，基于 experiments/seeds/task-api 构建出的 taskhub seed。

每个场景包含：

  • bugs/<id>/inject.py：对好版本 seed 做精准字符串替换，注入一个用户可见 bug。
  • hidden/<id>/test_*.py：hidden pytest，从 issue 症状视角验证正确行为。
  • fixtures/e2e/<id>.json：runner 可读取的 e2e fixture 描述。

验证约定：

  1. 好版本 + hidden tests 必须绿，证明题目可解。
  2. 注入 bug 后 hidden tests 必须红，证明 bug 生效。
  3. 注入 bug 后 seed 自带 tests 必须仍绿，证明注入点处于自带测试暗角。
Reference in New Issue View Git Blame Copy Permalink