Daksh ac9c7edda6 perf(cli): list connected accounts once per execute (#4475)
## Summary

`composio execute` made eight backend requests. Two of them were the
same list of the user's connected accounts, fetched by two code paths
that cannot see each other. It is fetched once now. Interleaved A/B
against #4469, compiled binaries, 15 runs each on a small response:
1735ms to 1636ms best, 1934ms to 1845ms median. That is one round trip
(~140ms) off the critical path.

Results are identical to before in every case. The picker derives its
toolkit subset from the shared list with the exact semantics of its old
query, and falls back to that query when the shared list is truncated.

Fifth PR in the stack. Stacked on #4469; review #4463, #4464, #4468 and
#4469 first. #4483 builds on this one.

## Changes

1. `src/utils/memoize-in-process.ts` (new). Memoizes an Effect per key
for the process lifetime, shares one run between concurrent callers, and
drops a failure, defect or interruption so the next caller retries.
2. `listActiveConnectedAccounts` in `connected-account-selection.ts`:
the unfiltered `GET /connected_accounts` for a user, memoized by client
identity and user id. It fails with the raw rejection, and each caller
wraps that in its own error. `resolveToolRouterSessionConnections` reads
from it when it has no toolkit filter, which is the execute path. With a
filter it keeps its own request.
3. `resolveConnectedAccountForToolkit` used to issue its own request,
toolkit-filtered, `limit: 100`. It now derives that from the shared
list: same slug match, server order preserved, first 100. If the shared
list has a `next_cursor` or `total_items` above what it holds, the
toolkit's accounts may sit past the cut, so the original filtered
request runs instead.
4. `get_latest_version` goes through the same memo. The definition
refresh fetched it twice with identical headers on the stale path; that
is one request now. The executor's own version lookup sends no org or
project headers and stays a separate request. Scoping it would change
which definition it resolves under, which is a semantics decision, not a
perf one.

What does not change: the request list on a normal execute is now
`project/resolve`, `connected_accounts`, `get_latest_version` twice,
`consumer/config`, `session`, `execute`. Error messages are unchanged;
the fallback passes the raw rejection through so the picker's message
reads as before.

## Type of change
- [ ] Bug fix
- [ ] New feature
- [x] Refactor/Chore
- [ ] Documentation
- [ ] Breaking change

## How Has This Been Tested?

Bun 1.4.1+4661e494f, Node 24.20.0, pnpm 11.8.0, linux-x64.

1. `cd ts/packages/cli && pnpm run typecheck && pnpm run
validate:boundaries`
2. `pnpm exec vitest run`: 131 files, 1341 passed, 1 skipped (whole
stack). New tests cover the memo sharing one run per key and retrying
after a failure or a defect. The execute suite already covers account
selection with and without a selector and passes unchanged. The test
layer builds a fresh client per test, so the client-keyed memo does not
bleed between tests.
3. Request count: hooked `fetch` while running `execute
HACKERNEWS_GET_ITEM_WITH_ID` from source. `connected_accounts` appears
once, the rest of the list as before.
4. Timing: `pnpm build:binary`, then the interleaved A/B above against
#4469's binary. A second round of 12 gave 1788 to 1621ms best, 2045 to
1963ms median.

## Screenshots (if applicable)

Not applicable.

## Checklist
- [x] I have read the Code of Conduct and this PR adheres to it
- [x] I ran linters/tests locally and they passed
- [ ] I updated documentation as needed
- [x] I added tests or explain why not applicable
- [ ] I added a changeset if this change affects published packages

No docs describe the request sequence. `@composio/cli` is private, so no
changeset.

## Additional context

The rest of an execute, from the same trace: `project/resolve` 140 to
640ms with no cache, `tool_router/session` 385 to 655ms created per
invocation, and the execute call itself 500 to 730ms. The
connected-account cache in `consumer-short-term-cache.ts` would take
`connected_accounts` off the path entirely, but
`DISABLE_CONNECTED_ACCOUNT_CACHE` defaults to on, and enabling it fails
no-auth toolkits with "not connected" because the cached list does not
include them. Both are separate changes.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

https://claude.ai/code/session_01Wx9gEjuiHux2weiHjdNcDs
2026-09-15 00:10:23 +02:00
2025-09-28 04:02:01 +05:30
2025-06-16 19:52:20 +05:30
2025-11-13 21:18:45 +05:30

Composio logo

composio.dev • Documentation • Quickstart • Changelog

GitHub stars npm PyPI Discord HVTrust

Composio

Composio gives your AI agents 1000+ pre-authenticated toolkits, per-user sessions, authentication, triggers, and a sandbox, so you can ship agents that turn intent into action.

This is the Composio SDK monorepo. It contains:

  • @composio/core: TypeScript SDK
  • composio: Python SDK
  • composio CLI: search, execute, and script tools from your shell
  • Provider adapters for OpenAI Agents, Claude Agent SDK, Vercel AI SDK, LangChain, and more

Quickstart

Create a session for a user, hand its tools to your agent, and let the agent take action across 1000+ apps. Grab a COMPOSIO_API_KEY from the dashboard first.

TypeScript

npm install @composio/core @composio/openai-agents @openai/agents

@composio/core intentionally packages its TypeScript source and SDK docs so the installed package is inspectable to coding agents. If you want a smaller install with the same API, use @composio/slim.

import { Composio } from "@composio/core";
import { OpenAIAgentsProvider } from "@composio/openai-agents";
import { Agent, run } from "@openai/agents";

const composio = new Composio({ provider: new OpenAIAgentsProvider() });

// Each session is scoped to one of your users
const session = await composio.create("user_123");
const tools = await session.tools();

const agent = new Agent({
  name: "Personal Assistant",
  instructions: "You are a helpful assistant. Use Composio tools to take action.",
  tools,
});

const result = await run(agent, "Summarize my emails from today");
console.log(result.finalOutput);

Python

pip install composio composio-openai-agents openai-agents
from composio import Composio
from composio_openai_agents import OpenAIAgentsProvider
from agents import Agent, Runner

composio = Composio(provider=OpenAIAgentsProvider())

# Each session is scoped to one of your users
session = composio.create(user_id="user_123")
tools = session.tools()

agent = Agent(
    name="Personal Assistant",
    instructions="You are a helpful assistant. Use Composio tools to take action.",
    tools=tools,
)

result = Runner.run_sync(starting_agent=agent, input="Summarize my emails from today")
print(result.final_output)

By default a session gets meta tools that discover, authenticate, and execute app tools at runtime, so you don't load hundreds of tool definitions into context. Store session.session_id and reuse it with composio.use() across turns. See what a session is and configuring sessions for restricting toolkits, auth configs, and connected accounts.

Prefer MCP? Every session also exposes a hosted MCP endpoint. Pass mcp: true to composio.create() and point Claude, Cursor, or any MCP client at session.mcp.url. See sessions via MCP.

CLI

The composio CLI runs Composio from your shell and gives coding agents like Claude Code a local tool surface.

curl -fsSL https://composio.dev/install | sh

The installer puts composio on your PATH for future terminals. Open a new terminal, then run composio login. See INSTALL.md for shell setup overrides, including COMPOSIO_INSTALL_SHELL=none for install-only runs.

Use composio search to find tools, composio execute to run them, composio link to connect accounts, and composio run to script workflows in TypeScript. See the CLI docs.

Providers

A provider adapts Composio tools to your agent framework's native tool format:

Provider TypeScript Python
OpenAI @composio/openai composio-openai
OpenAI Agents @composio/openai-agents composio-openai-agents
Anthropic @composio/anthropic composio-anthropic
Claude Agent SDK @composio/claude-agent-sdk composio-claude-agent-sdk
Vercel AI SDK @composio/vercel —
Google GenAI @composio/google composio-gemini, composio-google
Google ADK — composio-google-adk
LangChain @composio/langchain composio-langchain
LangGraph via @composio/langchain composio-langgraph
LlamaIndex @composio/llamaindex composio-llamaindex
Mastra @composio/mastra —
Pi @composio/experimental* —
Cloudflare Workers AI @composio/cloudflare —
CrewAI — composio-crewai
AutoGen — composio-autogen

* The Pi provider is experimental and ships from @composio/experimental.

Don't see your framework? Build a custom provider, or skip providers entirely and connect over MCP.

All packages

Everything published from this repo:

Package Description
@composio/core TypeScript SDK
@composio/slim @composio/core without packaged source or docs; same API, smaller install
composio CLI Standalone CLI binary: curl -fsSL https://composio.dev/install | sh
@composio/experimental Experimental integrations, including the Pi provider
@composio/json-schema-to-zod JSON Schema to Zod conversion
@composio/* provider adapters OpenAI, OpenAI Agents, Anthropic, Claude Agent SDK, Vercel, Google, LangChain, LlamaIndex, Mastra, Cloudflare
composio Python SDK
composio-* provider adapters OpenAI, OpenAI Agents, Anthropic, Claude Agent SDK, Gemini, Google, Google ADK, LangChain, LangGraph, LlamaIndex, CrewAI, AutoGen

Repository layout

ts/                TypeScript SDK workspace
  packages/core/       @composio/core
  packages/providers/  Provider adapters
  packages/cli/        Composio CLI
python/            Python SDK and provider packages
docs/              Documentation site (docs.composio.dev)

The TypeScript SDK is tested against Node 22+; the Python SDK supports Python 3.10+.

Development

mise install    # pinned toolchain (Node, Python, pnpm)
pnpm install
pnpm build
pnpm test

Python commands run from python/; see python/README.md. We welcome contributions to both SDKs; read the contribution guidelines before submitting pull requests.

Support

License

MIT. See LICENSE.

S
Description
Route and complete Composio work across Composio For You and Composio Platform. Use when the user mentions Composio; wants an agent to use apps such as Gmail,…
Readme 1.3 GiB
Languages
TypeScript 72.2%
Python 23.3%
Shell 2.1%
JavaScript 2%
Swift 0.4%