mirror of
https://github.com/CopilotKit/CopilotKit.git
synced 2026-09-14 16:26:20 +08:00
dd06dd89d1
The showcase framework directories better reflect their role as integration examples rather than distributable packages. Renames showcase/packages/ -> showcase/integrations/ and updates the test docker-compose file reference accordingly.
5.8 KiB
5.8 KiB
QA: Declarative Generative UI (A2UI — Fixed Schema) — LangGraph (Python)
Prerequisites
- Demo is deployed and accessible at
/demos/a2ui-fixed-schemaon the dashboard host - Agent backend is healthy;
OPENAI_API_KEYis set on Railway;LANGGRAPH_DEPLOYMENT_URLpoints at a LangGraph deployment exposing thea2ui_fixedgraph (registered as agent namea2ui-fixed-schema— seesrc/app/api/copilotkit-a2ui-fixed-schema/route.ts) - Note: the demo source contains no
data-testidattributes. Checks below rely on verbatim visible text, DOM structure, and the two JSON schemas undersrc/agents/a2ui_schemas/
Test Steps
1. Basic Functionality
- Navigate to
/demos/a2ui-fixed-schema; verify the page renders within 3s and a singleCopilotChatpane is centered (max-width ~896px, rounded-2xl, full-height) - Verify the chat is wired to
runtimeUrl="/api/copilotkit-a2ui-fixed-schema"andagent="a2ui-fixed-schema"(DevTools → Network: sending a message hits that endpoint) - Verify the single suggestion pill is visible with verbatim title "Find SFO → JFK" (message body: "Find me a flight from SFO to JFK on United for $289.")
- Send "Hello" and verify an assistant text response appears within 10s (no flight card for plain text)
2. Feature-Specific Checks
Schema Wiring (fixed catalog + includeBasicCatalog)
- DevTools → Network: after the first successful
display_flightcall, verify the response stream contains ana2ui_operationscontainer withcatalogId: "copilotkit://flight-fixed-catalog"(matchesCATALOG_IDinsrc/agents/a2ui_fixed.pyandsrc/app/demos/a2ui-fixed-schema/a2ui/catalog.ts) - Verify the same container carries the full
FLIGHT_SCHEMAcomponent tree (12 nodes fromsrc/agents/a2ui_schemas/flight_schema.json:root,content,title,route,from,arrow,to,meta,airline,price,bookButton,bookButtonLabel)
Search-Flights Prompt (display_flight tool → flight_schema.json)
- Click the "Find SFO → JFK" suggestion; within 20s verify a single flight card renders in-transcript assembled per
flight_schema.json:- outer
Cardwith aColumnof children in this order: title row, route row, meta row, book button Titlenode renders the literal text "Flight Details" (1.15rem / 600 weight, color#010507)routerow showsAirport"SFO" →Arrow(→, color#AFAFB7) →Airport"JFK" (both monospaced, 1.5rem, 600 weight, 0.05em letter-spacing)metarow showsAirlineBadge"UNITED" (uppercase pill, lilac#BEC2FFborder, 0.08em tracking) on the left andPriceTag"$289" (monospaced, color#189370, 1.1rem / 600 weight) on the rightButtonrenders full-width with label "Book flight" (black#010507background, white text, 12px radius)
- outer
- Verify all four data-model fields resolved correctly (origin=
SFO, destination=JFK, airline=United, price=$289) — each is a{ path: "/..." }binding in the schema and must reach the DOM as a plain string via theGenericBinder(no literal{path}leak and no React error #31)
Book-Flight Interaction (stateful Button override)
- Click the "Book flight" button inside the rendered card; verify it transitions to the confirmed state WITHOUT re-rendering the surface:
- button background becomes the mint tint
rgba(133, 236, 206, 0.15)with border#85ECCE4D - label text changes to "Booked" (color
#189370) - a green check SVG (
polyline 20 6 9 17 4 12, stroke#189370) appears to the left of the label - button is disabled; further clicks are no-ops
- button background becomes the mint tint
- Note: the agent-side action handler for
book_flightis intentionally not wired (see comment insrc/agents/a2ui_fixed.py— SDK doesn't yet acceptaction_handlers=). So thebooked_schema.jsonswap is NOT expected to occur. Verify only the local optimistic button state change.
Booked Schema Readiness (booked_schema.json — wired-but-inert)
- Verify
src/agents/a2ui_schemas/booked_schema.jsonexists and declares a 3-node tree (rootColumn with childrentitle+detail, bothTextwith path bindings/titleand/detail). No runtime check — the schema is kept so the handoff is ready once the SDK supportsaction_handlers. Log a test note if this file is ever removed.
Follow-up Prompt (data-model refresh)
- Send "Find me a flight from LAX to ORD on Delta for $412."; within 20s verify the card updates in place with origin=
LAX, destination=ORD, airline=DELTA, price=$412(same schema, new data model — proves the fixed-schema pattern: schema once, data streams)
3. Error Handling
- Send an empty message; verify it is a no-op (no user bubble, no assistant response)
- Send "What is the capital of France?"; verify the agent replies in plain text without invoking
display_flight(no flight card rendered, noa2ui_operationsin the response) - DevTools → Console: walk through all flows above; verify no uncaught errors and specifically no React error #31 ("objects are not valid as a React child, found: object with keys {path}") — the
DynStringunion ina2ui/definitions.tsis what prevents this, so a single occurrence is a regression
Expected Results
- Chat loads within 3s; plain-text response within 10s; flight card renders within 20s of the search prompt
display_flightis called exactly once per search prompt; result contains ana2ui_operationscontainer withcatalogId: "copilotkit://flight-fixed-catalog"and the full 12-node flight schema- All five custom renderers in
a2ui/renderers.tsx(Title,Airport,Arrow,AirlineBadge,PriceTag, plus the statefulButtonoverride) render at least once per search-flights run - Clicking "Book flight" produces a local optimistic confirmation (mint background + check icon + disabled state)
- No UI layout breaks, no
{path}leak into the DOM, no uncaught console errors