Files
copilotkit__copilotkit/packages/react-core/package.json
Alem Tuzlak 4b11b995a2 feat: multimodal attachments — images, audio, video, documents in CopilotChat (#3604)
## Summary

Adds full multimodal attachment support to CopilotKit's v2 chat
components. Users can send images, audio, video, and documents alongside
text messages to any AG-UI-compatible agent.

### Frontend
- **`attachments` prop** on `CopilotChat` — `{ enabled, accept, maxSize,
onUpload, onUploadFailed }`
- **`useAttachments` hook** — reusable, referentially stable hook for
custom chat UIs (all callbacks memoized, zero unnecessary re-renders)
- **Attachment queue** with lightbox previews (View Transition API),
video player, PDF/text document viewer
- **Drag-and-drop**, **clipboard paste**, and **file picker** upload
flows
- **Drop zone overlay** with visual indicator
- **Filename preservation** via `InputContent` metadata
- **`onUploadFailed` callback** with typed error reasons
(`file-too-large`, `invalid-type`, `upload-failed`)
- **`AttachmentUploadResult` discriminated union** for type-safe
`onUpload` returns
- Memoized attachment renderer components (v1 and v2)

### Backend
- `BuiltInAgent` properly converts multimodal `InputContent[]` to Vercel
AI SDK format
- Handles image, audio, video, document, and legacy binary content parts

### Deprecation lifecycle
- `@deprecated` JSDoc on all legacy image upload APIs (9 symbols) with
`@since 1.56.0`
- **Codemod** at `codemods/migrate-attachments.ts` — transforms props +
imports (18 tests)
- Migration guide moved to new **Migration Guides** docs section

### Docs
- New guide: `docs/(root)/multimodal-attachments.mdx`
- Updated migration guide with codemod instructions, new `onUpload`
type, metadata
- Cross-links from prebuilt-components page
- New **Migration Guides** section (moved from troubleshooting)

### AG-UI
- Bumped `@ag-ui/client`, `@ag-ui/core`, `@ag-ui/encoder`,
`@ag-ui/proto` to 0.0.51

### Example
- React Router example with dual agent setup (BuiltInAgent + TanStack
AI)
- Multimodal content properly forwarded to TanStack AI `chat()`

## Test plan

- [x] `useAttachments` hook stability tests — 9 tests (referential
stability, re-render counting, state defaults)
- [x] `CopilotChat.attachments` tests — 5 tests (onUploadFailed for
invalid-type, file-too-large, upload-failed, multiple rejections, valid
files)
- [x] Codemod tests — 18 tests (prop transforms, import renames,
idempotency, edge cases)
- [x] Full react-core suite — 966 tests passing
- [x] Tool call streaming tests pass (messagesMemoKey fingerprint fix)
2026-04-07 14:26:03 +02:00

126 lines
3.4 KiB
JSON

{
"name": "@copilotkit/react-core",
"version": "1.55.0-next.8",
"private": false,
"keywords": [
"ai",
"assistant",
"automation",
"copilot",
"copilotkit",
"javascript",
"nextjs",
"nodejs",
"react",
"textarea"
],
"homepage": "https://github.com/CopilotKit/CopilotKit",
"license": "MIT",
"repository": {
"type": "git",
"url": "https://github.com/CopilotKit/CopilotKit.git"
},
"type": "module",
"sideEffects": [
"**/*.css"
],
"main": "./dist/index.cjs",
"module": "./dist/index.mjs",
"types": "./dist/index.d.cts",
"typesVersions": {
"*": {
"v2": [
"./dist/v2/index.d.cts"
]
}
},
"unpkg": "./dist/index.umd.js",
"jsdelivr": "./dist/index.umd.js",
"exports": {
".": {
"import": "./dist/index.mjs",
"require": "./dist/index.cjs"
},
"./v2": {
"import": "./dist/v2/index.mjs",
"require": "./dist/v2/index.cjs"
},
"./package.json": "./package.json",
"./v2/styles.css": "./dist/v2/index.css"
},
"publishConfig": {
"access": "public"
},
"scripts": {
"build:css": "tailwindcss -i ./src/v2/styles/globals.css -o ./dist/v2/index.css -m && node scripts/scope-preflight.mjs ./dist/v2/index.css",
"build": "tsdown && pnpm run build:css",
"dev": "tsdown --watch",
"test": "vitest run",
"test:watch": "vitest",
"check-types": "tsc --noEmit",
"link:global": "pnpm link --global",
"unlink:global": "pnpm unlink --global",
"publint": "publint .",
"attw": "attw --pack . --profile node16 --ignore-rules internal-resolution-error"
},
"dependencies": {
"@ag-ui/client": "0.0.51",
"@ag-ui/core": "0.0.51",
"@copilotkit/a2ui-renderer": "workspace:*",
"@copilotkit/core": "workspace:*",
"@copilotkit/runtime-client-gql": "workspace:*",
"@copilotkit/shared": "workspace:*",
"@copilotkit/web-inspector": "workspace:*",
"@lit-labs/react": "^2.0.2",
"@radix-ui/react-dropdown-menu": "^2.1.15",
"@radix-ui/react-slot": "^1.2.3",
"@radix-ui/react-tooltip": "^1.2.7",
"@scarf/scarf": "^1.3.0",
"class-variance-authority": "^0.7.1",
"clsx": "^2.1.1",
"katex": "^0.16.22",
"lucide-react": "^0.525.0",
"react-markdown": "^8.0.7",
"rxjs": "7.8.1",
"streamdown": "^1.3.0",
"tailwind-merge": "^3.3.1",
"ts-deepmerge": "^7.0.3",
"tw-animate-css": "^1.3.5",
"untruncate-json": "^0.0.1",
"use-stick-to-bottom": "^1.1.1"
},
"devDependencies": {
"@tailwindcss/cli": "^4.1.11",
"@tailwindcss/postcss": "^4.1.11",
"@tailwindcss/typography": "^0.5.16",
"@testing-library/jest-dom": "^6.0.0",
"@testing-library/react": "^16.3.0",
"@testing-library/react-hooks": "^8.0.1",
"@testing-library/user-event": "^14.0.0",
"@types/react": "^19.1.0",
"@types/react-dom": "^19.0.2",
"@valibot/to-json-schema": "^1.5.0",
"arktype": "^2.1.29",
"autoprefixer": "^10.4.20",
"concurrently": "^9.1.0",
"eslint": "^8.56.0",
"jsdom": "^26.1.0",
"phoenix": "^1.8.4",
"postcss": "^8.5.6",
"react": "^19.1.0",
"react-dom": "^19.2.0",
"tailwindcss": "^4.0.8",
"tsconfig": "workspace:*",
"tsdown": "^0.20.3",
"typescript": "^5.2.3",
"valibot": "^1.2.0",
"vitest": "^3.2.4",
"zod": ">=3.0.0"
},
"peerDependencies": {
"react": "^18 || ^19 || ^19.0.0-rc",
"react-dom": "^18 || ^19 || ^19.0.0-rc",
"zod": ">=3.0.0"
}
}