Commit Graph

338 Commits

Author SHA1 Message Date
Developers Digest 5f94d2fe47 show spinner immediately when starting a new turn
no more dead cursor after typing a follow-up — the working
spinner with rotating messages starts instantly on every turn,
including the first one and after resume.
2026-03-26 19:14:40 -04:00
Developers Digest 6d4d082cc7 rename agent picker label to harness 2026-03-26 19:03:02 -04:00
Developers Digest d1ecbc4ae7 add rotating status messages to working spinner 2026-03-26 18:59:32 -04:00
Developers Digest 8a3975efab move banner to top of interactive flow, before all prompts 2026-03-26 18:58:46 -04:00
Developers Digest 5d39266efa expand ascii banner to firecrawl agent 2026-03-26 18:54:35 -04:00
Developers Digest 5e1f2cb1b1 add orange ascii AGENT banner on interactive mode 2026-03-26 18:51:07 -04:00
Developers Digest a7d52300b3 show ctrl+c hint, detect raw CLIs and suggest ACP adapters 2026-03-26 18:38:07 -04:00
Developers Digest d08933892b fix resume: add conversation loop, error handling, and ctrl+c support 2026-03-26 18:30:15 -04:00
Developers Digest 4f75aaf42d suggest html visualization in follow-ups when data suits it 2026-03-26 18:14:55 -04:00
Developers Digest 41b67725b0 fix resume: look up ACP binary from registry, not raw provider name 2026-03-26 18:06:55 -04:00
Developers Digest 98134524d7 fix headless worker: use spawn with execArgv instead of fork
fork() doesn't survive tsx exit. use spawn() with process.execPath
and process.execArgv to preserve the tsx loader. pass args via temp
file (system prompts are too large for argv).
2026-03-26 17:44:23 -04:00
Developers Digest f4b3b193cb add firecrawl agent --list to browse past sessions
shows all sessions sorted by date with prompt, agent, format,
and age. select one to resume, open the output, or open the
session folder.
2026-03-26 17:42:10 -04:00
Developers Digest 468f937201 default to follow-up text input, open file menu only on done 2026-03-26 17:02:41 -04:00
Developers Digest 3412ecb7af clean up session end menu: only show output file + session folder 2026-03-26 16:59:16 -04:00
Developers Digest 050a3f6617 remove start line for tool calls, only show on completion
spinner provides feedback while running, ✓ line on completion.
no more doubled · start / ✓ done lines.
2026-03-26 16:53:25 -04:00
Developers Digest 5f8f895d7e always show agent picker, detect MCP/web tools, enforce CLI usage
- always show agent selection (no auto-skip), default to last-used
- detect firecrawl MCP tools and WebSearch/WebFetch in TUI display
- stronger system prompt: must use firecrawl CLI via Bash only,
  no MCP tools, no WebSearch, no WebFetch, no curl
2026-03-26 16:50:30 -04:00
Developers Digest 1706fe1696 detect firecrawl MCP tools and built-in web tools, not just CLI
categorize tool calls by title in addition to rawInput.command.
catches mcp__firecrawl__firecrawl_scrape, WebSearch, WebFetch,
and all other tool invocation patterns the agent might use.
2026-03-26 16:49:36 -04:00
Developers Digest c6b885c8fd save scraped pages to session dir in sites/<hostname>/<path>/ convention
agent now saves raw scraped markdown alongside the output file,
organized by hostname/path like firecrawl download does. session
folder becomes a self-contained package of output + sources.
2026-03-26 16:46:57 -04:00
Developers Digest c702b890a6 show firecrawl operations when they start, not just on completion
tool calls now show · label... when starting and ✓ label when
done. background work still shows animated spinner. deduped so
each operation only shows start/done once.
2026-03-26 16:45:31 -04:00
Developers Digest f493d92cf7 enforce firecrawl for all web access, no alternatives 2026-03-26 16:43:39 -04:00
Developers Digest f7cbd218aa expand firecrawl CLI instructions in system prompt
tell the agent to run firecrawl --help first, show practical
command examples with useful flags (--only-main-content,
--wait-for, --limit, -o), and save to temp files for parsing.
2026-03-26 16:42:36 -04:00
Developers Digest add03108ed write agent.log during headless sessions
logs agent text, tool calls, and completions to the session
directory so callers can tail -f for live progress.
2026-03-26 16:41:07 -04:00
Developers Digest 80b0c82da6 run headless agent in background, return immediately
fork a detached child process for the ACP session so the CLI
exits immediately. caller gets session path to poll for results.
2026-03-26 16:38:17 -04:00
Developers Digest 8b9c4574c0 natural language output for headless mode instead of json 2026-03-26 16:36:11 -04:00
Developers Digest 52d8d7bb37 add headless ACP mode for non-interactive agent calls
firecrawl agent "prompt" now uses ACP locally instead of the
firecrawl API. prints session path as JSON so other agents can
poll for results. use --api flag to opt into the old API path.

output: { sessionId, sessionDir, output, agent, status }
2026-03-26 16:33:45 -04:00
Developers Digest 74464fa1b4 remember last-used agent in ~/.firecrawl/preferences.json
first run shows agent picker, saves selection. subsequent runs
skip the prompt and use the saved default. --provider flag
always overrides.
2026-03-26 16:30:26 -04:00
Developers Digest 2068011b1d stop agent from narrating internal steps and reading workspace configs 2026-03-26 16:26:30 -04:00
Developers Digest 5a39cd8d02 add animated spinner while agent is working in background 2026-03-26 16:14:33 -04:00
Developers Digest 4399fb72f3 fix line overwrite by ensuring newline before stderr output
track whether last stdout text ended with \n. if not, write a
newline before any tool call results, phase headers, or status
lines to prevent them from overwriting partial agent text.
2026-03-26 16:12:06 -04:00
Developers Digest 7392a49e86 always show agent selection as first step 2026-03-26 16:03:08 -04:00
Developers Digest a740756942 remove dead provider detection from utils/acp.ts
ACPProvider, detectProviders, and PROVIDERS are replaced by
src/acp/registry.ts. utils/acp.ts now only handles sessions.
2026-03-26 15:58:21 -04:00
Developers Digest 2948cca7c8 trim agent registry to claude code and codex only 2026-03-26 15:56:51 -04:00
Developers Digest 5bdbe7680b skip planning phase for simple single-source requests
simple requests (pricing from one site) go straight to scrape +
output without asking "shall I proceed?" — just do it. only stop
for confirmation on multi-source research tasks.
2026-03-26 15:46:47 -04:00
Developers Digest 26a8b67ce8 Update agent-interactive.ts 2026-03-26 15:45:56 -04:00
Developers Digest c93a301168 revert tsconfig to original module/resolution settings
the module:"preserve" and moduleResolution:"bundler" changes were
for ink which was removed. reverted to commonjs + node.
2026-03-26 15:41:56 -04:00
Developers Digest bd9053860e rename extracting phase to gathering data 2026-03-26 15:40:24 -04:00
Developers Digest 9cc778d617 frame follow-up suggestions as questions, not actions 2026-03-26 15:39:24 -04:00
Developers Digest 28d797aa8d default to free text input, show examples on empty enter 2026-03-26 15:28:46 -04:00
Developers Digest a398dde45f default to claude code when available, skip agent selection 2026-03-26 15:25:36 -04:00
Developers Digest 9a769c28f9 give agent awareness of session directory for incremental writes
system prompt now tells the agent its session directory path and
output file path. agent can write intermediate files, build data
incrementally, and preserve progress if interrupted.
2026-03-26 15:24:26 -04:00
Developers Digest 22d4618527 show output path at prompt + follow-up suggestions
- display output file path (dimmed) above each → prompt
- add "follow-up suggestions" instruction to system prompt:
  agent proposes 2-3 specific next steps after completing output,
  like perplexity's suggested questions
2026-03-26 15:22:05 -04:00
Developers Digest 7d38fc5ea0 restrict agent to search + scrape only, no browser
replace FIRECRAWL_TOOLS_BLOCK with explicit command list that
excludes browser/interact tools. agent should use scrape with
--wait-for for JS-rendered pages instead of browser sessions.
2026-03-26 15:19:17 -04:00
Developers Digest 83bf30239a show working indicator during background operations
when the agent is doing non-firecrawl work (reading files,
running scripts, spawning subagents), show a dim "..." on the
current line. clears when agent text arrives or a firecrawl
operation completes. prevents the dead cursor stare.
2026-03-26 15:17:29 -04:00
Developers Digest 026ea95180 remove cost display, only show tokens + credits + time
ACP agents handle their own billing — don't show dollar amounts.
status line now shows: "25k tokens · 12 credits · 47s"
also stop printing status before every → prompt — only at session end.
2026-03-26 15:16:46 -04:00
Developers Digest 0f59f2f49b rewrite TUI with phase sections, usage tracking, and clean layout
complete TUI rewrite:
- auto-detected phase sections (Planning → Discovering → Extracting → Output)
  with ━━━ header lines based on tool call patterns
- wire ACP usage_update events for token count + cost tracking
- status line shows tokens used + cost + elapsed time
- summary footer at session end
- remove pipe mode (commit to ACP)
- remove old buildCallbacks/describeToolCall (moved to tui.ts)
- clean header: "🔥 Firecrawl Agent / Claude Code · CSV · Session xyz"
2026-03-26 15:10:09 -04:00
Developers Digest 2b58bb87b8 only show tool calls on completion, not on start
removes the doubled-up · start / ✓ done lines. now each
operation prints once when it finishes — clean single line.
the agent's own text provides context for what's in progress.
2026-03-26 14:58:32 -04:00
Developers Digest 7354d8f3a5 instruct agent to use subagents for scraping
the main agent thread should only orchestrate — all heavy
scraping and parsing is delegated to subagents that return
just structured JSON records. keeps the main context window
clean for planning and consolidation.
2026-03-26 14:43:55 -04:00
Developers Digest 1654f11860 add open file/folder prompt at session end
after the conversation ends, show a menu with all session output
files (with sizes) plus the session folder. selecting one opens
it with the system default handler (open/xdg-open/start).
2026-03-26 14:42:08 -04:00
Developers Digest cf9c8d5097 add pipe mode + rewrite system prompt for better UX
two modes for running the agent:
- ACP: structured protocol with progress tracking and session mgmt
- Pipe: inject directly into Claude Code/Codex (full terminal, interactive)

user picks mode after selecting the agent. pipe mode falls back
to the original launchAgent() subprocess approach.

also rewrites system prompt to:
- work in clear phases (plan → discover → extract → write)
- stop after plan phase and wait for user confirmation
- report progress with numbers (found 4 sources, extracted 50 records)
- use bullet points not tables (renders better in terminals)
- keep user informed at every step
2026-03-26 14:40:33 -04:00
Developers Digest b9dc3fc9d4 deduplicate tool calls and clean up display
- deduplicate by URL: scraping the same URL 5x shows one start
  line and one done line, not ten
- hide background operations entirely (agent text provides context)
- visual spacing between agent text and tool call blocks
- reset dedup between conversation turns
- status line at each turn boundary with credits + elapsed
2026-03-26 14:25:09 -04:00