mirror of
https://github.com/CopilotKit/CopilotKit.git
synced 2026-09-14 16:26:20 +08:00
Austin Merrick
e3c6f2a3b6
npx copilotkit skills install runs the skills CLI against skills/, which copies each skill directory into user projects wholesale (its only excludes are metadata.json, .git, __pycache__). That would ship eval.yaml and the vite-react fixture to every user, and the fixture's package.json would get indexed by GitHub's dependency graph in their repos. The harness now lives in skill-evals/copilotkit-setup/, pointed back at the skill under test via skillgrade's skill: field; skills/copilotkit-setup/ contains only shippable content. Also instructs eval agents not to start dev servers: a live trial timed out at 600s because codex booted vite and the Express backend to verify its (complete) solution, and codex exec never returned. Verified end-to-end from the new location: PASS 1.00 (8/8 deterministic + rubric, 324s).