mirror of
https://github.com/CopilotKit/CopilotKit.git
synced 2026-09-14 16:26:20 +08:00
8a8e52d9e9
Closes OSS-646. Split out of OSS-641 as the unambiguous half. This PR does **not** change when activation happens — whether the long-running wrappers should auto-connect stays open on OSS-641. ## Why `createCopilotRuntimeHandler` builds the `ChannelManager` but opens no connection; activation is lazy, triggered by the first `channels.ready()`. That is deliberate (`fbf35ac59`, OSS-473) — Cloudflare/Next isolates freeze and recycle per request, so cold starts would mint conflicting listeners. Two things were left inconsistent with it: 1. `endpoints/node.ts` still documented the pre-`fbf35ac59` world — "the same `ChannelsControl` surface the underlying fetch handler **activates at creation time**" — and labelled the one required call as `// Optional:`. That's the TSDoc developers and coding agents see in-editor, and it contradicted every channel-package README. Same failure class as OSS-634. 2. `68349bc1f` gave the fetch handler a branded overload so `handler.channels.ready()` type-checks without `?.`, but the node wrapper never got it — so every call site, including our own example and all nine showcase docs pages, was written defensively. ### A live consequence, found en route `examples/slack/app/managed.ts` never called `ready()`. It built the runtime, mounted the listener, logged `[channel] started managed Channel "…"`, and only ever called `stop()` — so since activation went lazy it has connected nothing while reporting success. It was written against exactly the creation-time model the TSDoc described. Fixed here, with a regression assertion. ## What changed - **Types** — `createCopilotNodeListener` gets the branded overload pair mirroring `createCopilotRuntimeHandler`: a runtime with at least one declared Channel yields non-optional `.channels`; `activateChannels: false` and channel-less runtimes keep the optional shape. Adds `NodeCopilotListenerWithChannels`; both listener types are now exported from `@copilotkit/runtime/v2/node`. - **Docs** — node/express/hono TSDoc corrected: creation opens no connection, `ready()` is what activates, and it is required on a long-running host. Same stale claim fixed in the three example comments and `examples/slack/README.md` that repeated it. - **Call sites** — `?.` dropped from `examples/slack`, `examples/teams`, both READMEs, and the nine `showcase/shell-docs` channel pages. ## Deliberate scope choices, called out - **Express/Hono keep an optional `.channels`.** Only their TSDoc is corrected here. Their own type docs name Node as the lifecycle-owning surface and attach `.channels` best-effort, so the branded overload is Node-only for now; `endpoints-channels.test.ts` still uses `!` for those two. Say the word if the overload should extend to them. - **The non-optional shape requires a literal `channels` tuple** (`readonly [Channel, ...Channel[]]`). A runtime built from a dynamically-assembled `Channel[]` is unbranded and still needs `?.`. Now stated in the node TSDoc. - **`examples/slack/app/managed.ts` now exits nonzero if activation fails**, where before it stayed up serving HTTP with nothing connected. Intentional — fail loud, and it matches `index.ts`. Note that `ready()` resolves for `setup_required`, so a declared-but-unprovisioned channel still logs as started. - **Signal handlers are registered before awaiting activation** in `managed.ts`, so a Ctrl-C inside the 30s activation window still tears the Channel down instead of hitting Node's default handler. ## Verification - **Type contract, red → green:** the new `KeyIsRequired<typeof listener, "channels">` assertion in `handler-channels-types.test.ts` failed to compile before the overload (`error TS2344: Type 'false' does not satisfy the constraint 'true'`) and passes after. - **Example bug, red → green:** stashing only `managed.ts` fails the new guard with `expected "vi.fn()" to be called once, but got 0 times`. - **Strict-null proof:** `slack-example` and `teams-example` both `tsc --noEmit` clean under `strict: true` with the `?.` removed. This matters because the runtime package compiles with `strict: false`, so its own type test can only probe the optionality modifier structurally. - Runtime channel suites 54/54; slack example 63/63. - **Coverage limit:** the `managed.ts` guard is mocked — it proves the example *calls* `ready()` with a bound, not that a Channel connects. Nothing in CI exercises a real gateway connect for these examples. 🤖 Generated with [Claude Code](https://claude.com/claude-code)
215 lines
8.6 KiB
TypeScript
215 lines
8.6 KiB
TypeScript
/**
|
|
* Intelligence (managed Channel) entrypoint for the same Slack bot as
|
|
* `app/index.ts`.
|
|
*
|
|
* `index.ts` is the SELF-HOSTED variant: it holds the Slack bot/app tokens and
|
|
* talks to Slack directly via the native `slack()` adapter. This file is the
|
|
* MANAGED variant: it holds no Slack credentials and no public Slack endpoint —
|
|
* Intelligence owns the Slack edge (signed ingress → app-api, egress via the
|
|
* Connector Outbox) and delivers turns to this process over its realtime
|
|
* transport.
|
|
*
|
|
* The bot itself — the agent, tools, context, commands, and turn handlers — is
|
|
* IDENTICAL to the native bot; only the transport changes. Instead of a
|
|
* launcher, the managed path now goes through the NORMAL runtime handler: you
|
|
* hand your `createChannel(...)` to `new CopilotRuntime({ …, channels })` and
|
|
* mount it with `createCopilotNodeListener`, then `await
|
|
* listener.channels.ready()` to activate the managed Channel (the runtime
|
|
* derives every infra id — project, adapter, channel — from the Intelligence
|
|
* config + the channel `name`, so the developer supplies NONE of them):
|
|
*
|
|
* native: createChannel({ adapters: [slack({ botToken, appToken }) ] }) // index.ts
|
|
* managed: new CopilotRuntime({ intelligence, identifyUser, channels }) // this file
|
|
* + createCopilotNodeListener({ runtime })
|
|
*
|
|
* Run: `pnpm --filter slack-example channel` with the intelligence config env
|
|
* set (see `.env.example`).
|
|
*/
|
|
import "dotenv/config";
|
|
import { createServer } from "node:http";
|
|
import { createChannel } from "@copilotkit/channels";
|
|
import {
|
|
defaultSlackTools,
|
|
defaultSlackContext,
|
|
SanitizingHttpAgent,
|
|
} from "@copilotkit/channels/slack";
|
|
import { CopilotRuntime, CopilotKitIntelligence } from "@copilotkit/runtime/v2";
|
|
import { createCopilotNodeListener } from "@copilotkit/runtime/v2/node";
|
|
import { appTools } from "./tools/index.js";
|
|
import { appContext } from "./context/app-context.js";
|
|
import { appCommands } from "./commands/index.js";
|
|
import { senderContext } from "./sender-context.js";
|
|
import { fileIssueSubmit, FILE_ISSUE_CALLBACK } from "./modals/file-issue.js";
|
|
import { closeBrowser } from "./render/browser.js";
|
|
|
|
const required = (name: string): string => {
|
|
const v = process.env[name];
|
|
if (!v) {
|
|
console.error(`Missing required env var: ${name}`);
|
|
process.exit(1);
|
|
}
|
|
return v;
|
|
};
|
|
|
|
/**
|
|
* The managed Channel `name` is chosen HERE, in code — it is the project-unique
|
|
* identifier the runtime uses to derive the managed Channel's activation config
|
|
* (there is no launcher and no `INTELLIGENCE_CHANNEL_*` env to supply).
|
|
*/
|
|
const channelName = "triage";
|
|
|
|
async function main() {
|
|
const agentUrl = required("AGENT_URL");
|
|
const agentHeaders = process.env.AGENT_AUTH_HEADER
|
|
? { Authorization: process.env.AGENT_AUTH_HEADER }
|
|
: undefined;
|
|
|
|
// Same Slack Bot as the native example, minus the adapter: the managed
|
|
// transport is attached by the runtime when the handler activates the
|
|
// Channel. Slack is the only managed provider here, so it always ships the
|
|
// Slack tools/context (the native example adds these conditionally per active
|
|
// adapter).
|
|
const support = createChannel({
|
|
name: channelName,
|
|
agent: (threadId) => {
|
|
const a = new SanitizingHttpAgent({
|
|
url: agentUrl,
|
|
headers: agentHeaders,
|
|
});
|
|
a.threadId = threadId;
|
|
return a;
|
|
},
|
|
tools: [...appTools, ...defaultSlackTools],
|
|
context: [...appContext, ...defaultSlackContext],
|
|
commands: appCommands,
|
|
});
|
|
|
|
// Turn + feature handlers — identical to the native example (app/index.ts).
|
|
support.onMention(async ({ thread, message }) => {
|
|
try {
|
|
// Channel history (app-api /api/channels/history) does NOT include the
|
|
// in-flight turn (unlike native adapters whose getHistory rebuilds the
|
|
// live thread), so pass the current message explicitly as `prompt` —
|
|
// otherwise runAgent runs with zero messages. Prefer multimodal parts.
|
|
await thread.runAgent({
|
|
prompt: message.contentParts?.length
|
|
? message.contentParts
|
|
: message.text,
|
|
context: senderContext(message.user, thread.platform),
|
|
});
|
|
} catch (err) {
|
|
console.error("[channel] agent run failed", err);
|
|
await thread
|
|
.post("Sorry — I hit an error handling that. Please try again.")
|
|
.catch((postErr: unknown) =>
|
|
console.error("[channel] failed to post agent error", postErr),
|
|
);
|
|
}
|
|
});
|
|
support.onModalSubmit(FILE_ISSUE_CALLBACK, fileIssueSubmit);
|
|
support.onThreadStarted(async ({ thread, user }) => {
|
|
if (!user?.name) return;
|
|
await thread.setSuggestedPrompts([
|
|
{
|
|
title: `Triage ${user.name}'s issues`,
|
|
message: "Triage my open issues",
|
|
},
|
|
{
|
|
title: "What shipped this week?",
|
|
message: "Summarize what shipped this week",
|
|
},
|
|
]);
|
|
});
|
|
|
|
// The Intelligence client. It holds the managed edge credentials; from these
|
|
// (plus the channel `name`) the runtime derives the managed Channel's
|
|
// activation config — project id, adapter, socket URL/auth — with no infra
|
|
// ids supplied by the developer.
|
|
// apiUrl/wsUrl default to CopilotKit's managed Intelligence platform; the env
|
|
// overrides target a self-hosted or dev deployment. Set both or neither: the
|
|
// API and realtime planes are separate hosts (api.… vs realtime.…), so
|
|
// neither can be derived from the other.
|
|
const intelligence = new CopilotKitIntelligence({
|
|
apiUrl: process.env.COPILOTKIT_INTELLIGENCE_URL,
|
|
wsUrl: process.env.COPILOTKIT_INTELLIGENCE_WS_URL,
|
|
apiKey: required("COPILOTKIT_API_KEY"),
|
|
});
|
|
|
|
const runtime = new CopilotRuntime({
|
|
// The Channel supplies its own agent (the SanitizingHttpAgent above), so no
|
|
// additional runtime-hosted agents are needed here.
|
|
agents: {},
|
|
intelligence,
|
|
// Demo stub — replace with your own auth-derived user identity (e.g. OIDC)
|
|
// before any multi-user deployment, or all users share one thread history.
|
|
identifyUser: () => ({ id: "demo-user", name: "Demo User" }),
|
|
channels: [support],
|
|
});
|
|
|
|
// The NORMAL handler is what runs the managed Channel: the Node listener
|
|
// creates the runtime handler and exposes `.channels` for activation +
|
|
// shutdown. Mounting it opens NO connection — `ready()` below activates the
|
|
// Channel over the Intelligence transport. There is no public Slack ingress on
|
|
// this port — Intelligence owns the Slack edge — but the server keeps the
|
|
// lifecycle-owning process alive.
|
|
const listener = createCopilotNodeListener({
|
|
runtime,
|
|
basePath: "/api/copilotkit",
|
|
});
|
|
const port = Number(process.env.PORT ?? 8300);
|
|
createServer(listener).listen(port, () => {
|
|
console.log(`[channel] listener on :${port}`);
|
|
});
|
|
|
|
const shutdown = async (signal: string) => {
|
|
console.log(`\n[channel] received ${signal}, stopping…`);
|
|
let exitCode = 0;
|
|
try {
|
|
await listener.channels.stop();
|
|
} catch (err) {
|
|
console.error("[channel] error stopping managed Channel", err);
|
|
exitCode = 1;
|
|
}
|
|
// Browser teardown is best-effort, but still surface a failure rather than
|
|
// swallow it silently.
|
|
await closeBrowser().catch((err: unknown) =>
|
|
console.error(
|
|
"[channel] browser cleanup failed (continuing shutdown)",
|
|
err,
|
|
),
|
|
);
|
|
process.exit(exitCode);
|
|
};
|
|
// A failed shutdown must not vanish — log it and exit nonzero.
|
|
const runShutdown = (signal: string): void => {
|
|
shutdown(signal).catch((err: unknown) => {
|
|
console.error(`[channel] fatal during ${signal} shutdown`, err);
|
|
process.exit(1);
|
|
});
|
|
};
|
|
// Registered BEFORE activation on purpose: `ready()` below can take up to its
|
|
// timeout, and a Ctrl-C inside that window must still tear the Channel down
|
|
// rather than hit Node's default handler and skip teardown.
|
|
process.on("SIGINT", () => runShutdown("SIGINT"));
|
|
process.on("SIGTERM", () => runShutdown("SIGTERM"));
|
|
|
|
// Required: this is the call that connects the managed Channel to the Realtime
|
|
// Gateway. Bound it so a wedged connect can't hang startup forever.
|
|
await listener.channels.ready({ timeoutMs: 30_000 });
|
|
console.log(`[channel] started managed Channel "${channelName}"`);
|
|
}
|
|
|
|
// Fail loud, not silent: surface any stray async error instead of letting it
|
|
// kill the process with no log (mirrors the native entrypoint).
|
|
process.on("unhandledRejection", (reason) => {
|
|
console.error("[channel] unhandledRejection:", reason);
|
|
});
|
|
process.on("uncaughtException", (err) => {
|
|
console.error("[channel] uncaughtException:", err);
|
|
});
|
|
|
|
main().catch((err: unknown) => {
|
|
console.error("[channel] fatal: failed to start managed Channel", err);
|
|
process.exit(1);
|
|
});
|