mirror of
https://github.com/CopilotKit/CopilotKit.git
synced 2026-09-14 16:26:20 +08:00
Jordan Ritter
b1f19bdc80
The previous 'weather in Tokyo' rename (388c69e68) was a substring of the
main tool-rendering chain pill prompt 'Chain a few tools in this single
turn: get the weather in Tokyo, search flights from SFO to Tokyo, and roll
a d20.' Because aimock loads fixtures alphabetically per integration dir
and uses substring match with first-match-wins, the catchall fixture
(loaded before tool-rendering.json) was intercepting chain pill matches
across 16 integrations.
Rename catchall fixture userMessage to 'forecast for Tokyo' — a phrase
not contained in any other pill prompt. Update the corresponding D5
catchall probe inputs in d5-tool-rendering-{default,custom}-catchall.ts
and the test assertions that pin those inputs.
Call-Site Enumeration: 'weather in Tokyo' remains intentionally in
page.tsx suggestions.ts pills (user-visible UX) and inside the chain
pill prompt itself — neither is in the substring-match path now.
38 lines
1.3 KiB
JSON
38 lines
1.3 KiB
JSON
{
|
|
"_meta": {
|
|
"description": "D6 fixtures for pydantic-ai / tool-rendering-default-catchall",
|
|
"sourceFile": "harness/src/probes/scripts/d5-tool-rendering-default-catchall.ts",
|
|
"created": "2026-05-22"
|
|
},
|
|
"fixtures": [
|
|
{
|
|
"_comment": "tool-rendering-default-catchall \u2014 weather in Tokyo follow-up after get_weather ran. Keyed on toolCallId so it fires after the tool result returns. Must come BEFORE the tool-emitting fixture.",
|
|
"match": {
|
|
"userMessage": "forecast for Tokyo",
|
|
"toolCallId": "call_d5_get_weather_001",
|
|
"context": "pydantic-ai"
|
|
},
|
|
"response": {
|
|
"content": "Tokyo is 22\u00b0C and partly cloudy."
|
|
}
|
|
},
|
|
{
|
|
"_comment": "tool-rendering-default-catchall \u2014 weather in Tokyo first leg: emit get_weather tool call. The probe sends 'weather in Tokyo' and asserts the built-in default catchall renderer fires.",
|
|
"match": {
|
|
"userMessage": "forecast for Tokyo",
|
|
"hasToolResult": false,
|
|
"context": "pydantic-ai"
|
|
},
|
|
"response": {
|
|
"toolCalls": [
|
|
{
|
|
"id": "call_d5_get_weather_001",
|
|
"name": "get_weather",
|
|
"arguments": "{\"location\":\"Tokyo\"}"
|
|
}
|
|
]
|
|
}
|
|
}
|
|
]
|
|
}
|