mirror of
https://github.com/CopilotKit/CopilotKit.git
synced 2026-09-14 16:26:20 +08:00
Austin Merrick
4ba201b5c4
Repairs TypeScript check-types across the monorepo and adds a CI gate so regressions are caught going forward: - core: bundler module resolution and strict-mode fixes - sdk-js: bundler module resolution; keep codegen, formatter, packaging working - react-core: fixes across components, hooks, and tests - react-native: restore catch binding referenced by TypeError cause - runtime: repair check-types and bound AI SDK schema inference - web-inspector: nodenext import extensions, export Anchor - remaining packages and node example: assorted check-types repairs - deps: add missing type-only devDependencies - license context driven from /info licenseStatus - ci: run check-types in the static quality workflow Squashed from 12 commits for a single, easily-revertable change.
@copilotkit/voice
Audio transcription providers for CopilotKit.
Setup
pnpm add @copilotkit/voice openai
import { CopilotRuntime, createCopilotEndpoint } from "@copilotkit/runtime";
import { TranscriptionServiceOpenAI } from "@copilotkit/voice";
import OpenAI from "openai";
const runtime = new CopilotRuntime({
agents: { default: yourAgent },
transcriptionService: new TranscriptionServiceOpenAI({
openai: new OpenAI({ apiKey: process.env.OPENAI_API_KEY }),
}),
});
Once configured, the chat UI shows a microphone button. Users can record audio, which gets transcribed and inserted into the input field as text.
TranscriptionServiceOpenAI
Uses OpenAI Whisper for transcription.
new TranscriptionServiceOpenAI({
openai: new OpenAI({ apiKey: "..." }), // required
model: "whisper-1", // default
language: "en", // optional, ISO-639-1 code
prompt: "Technical discussion context", // optional, helps with domain terms
temperature: 0, // optional, 0 = deterministic
});
Custom providers
Extend TranscriptionService from runtime:
import {
TranscriptionService,
TranscribeFileOptions,
} from "@copilotkit/runtime";
class MyTranscriptionService extends TranscriptionService {
async transcribeFile(options: TranscribeFileOptions): Promise<string> {
// options.audioFile, options.mimeType, options.size
return "transcribed text";
}
}