84 Commits

Author SHA1 Message Date
calesthio
9e43f90e2b Merge remote-tracking branch 'origin/main' into codex/add-gemini-seedance-minimax-models
# Conflicts:
#	docs/PROVIDERS.md
2026-08-13 12:48:49 -07:00
calesthio
8cdd37f523 feat: add Gemini Omni, Seedance 2.5, and MiniMax H3 routes 2026-08-13 12:48:24 -07:00
Calesthio
494a95e62a Merge pull request #501 from calesthio/codex/atlas-media-model-expansion
Add Atlas Cloud media model gateway
2026-08-13 12:20:20 -07:00
calesthio
1267066bc4 Merge commit 'f72efb53d3cea7cce0943d5dc4e55e33e4e59af3' into codex/repair-pr-353
# Conflicts:
#	AGENT_GUIDE.md
#	docs/PROVIDERS.md
2026-08-13 11:40:09 -07:00
calesthio
97fcd3c025 Merge commit '1c7047fd1fa6ac63ff2ade67db886344fdebd8c7' into codex/repair-pr-353
# Conflicts:
#	docs/PROVIDERS.md
2026-08-13 11:29:26 -07:00
calesthio
9dc8e379ba Merge commit '1c7047fd1fa6ac63ff2ade67db886344fdebd8c7' into codex/repair-pr-371
# Conflicts:
#	docs/PROVIDERS.md
2026-08-13 11:29:26 -07:00
calesthio
dceea45387 Merge remote-tracking branch 'origin/main' into codex/repair-pr-353
# Conflicts:
#	docs/PROVIDERS.md
2026-08-13 11:20:19 -07:00
calesthio
00e4902348 Merge remote-tracking branch 'origin/main' into codex/repair-pr-371
# Conflicts:
#	docs/PROVIDERS.md
2026-08-13 11:20:19 -07:00
calesthio
ecfdbe5173 Merge remote-tracking branch 'origin/main' into codex/repair-pr-448
# Conflicts:
#	docs/PROVIDERS.md
2026-08-13 11:20:19 -07:00
calesthio
9f50874656 Merge remote-tracking branch 'origin/main' into codex/repair-pr-353
# Conflicts:
#	tests/contracts/test_phase3_contracts.py
2026-08-13 11:11:48 -07:00
calesthio
5f48d9afb7 Merge remote-tracking branch 'origin/main' into codex/repair-pr-448
# Conflicts:
#	.env.example
2026-08-13 11:11:48 -07:00
calesthio
329628a22b Merge remote-tracking branch 'origin/main' into codex/repair-pr-371 2026-08-13 11:11:02 -07:00
calesthio
e2a9e35c40 Merge remote-tracking branch 'origin/main' into codex/repair-pr-442 2026-08-13 11:11:02 -07:00
calesthio
ae9a74f1a2 feat: add Atlas Cloud media model gateway 2026-08-13 10:40:29 -07:00
calesthio
6b722ab56e Merge remote-tracking branch 'origin/main' into codex/repair-pr-458
# Conflicts:
#	tools/graphics/image_selector.py
2026-08-13 10:38:22 -07:00
Calesthio
0adcc23f44 Merge pull request #457 from wulongshe/feat/gemini-flash-image
feat: add gemini-2.5-flash-image backend to google_imagen
2026-08-13 10:36:12 -07:00
calesthio
a5c9d789be Merge remote-tracking branch 'origin/main' into codex/repair-pr-458
# Conflicts:
#	tools/graphics/image_selector.py
2026-08-13 10:17:12 -07:00
calesthio
700046d33c Merge remote-tracking branch 'origin/main' into codex/repair-pr-482
# Conflicts:
#	docs/PROVIDERS.md
2026-08-13 10:17:12 -07:00
calesthio
4e5bd8d5fa Merge remote-tracking branch 'origin/main' into codex/repair-pr-457
# Conflicts:
#	tools/graphics/image_selector.py
2026-08-13 10:17:11 -07:00
calesthio
3b966b06cf Merge remote-tracking branch 'origin/main' into codex/repair-pr-353 2026-08-13 10:15:44 -07:00
calesthio
be8cf96861 Merge remote-tracking branch 'origin/main' into codex/repair-pr-371 2026-08-13 10:15:43 -07:00
calesthio
91bd277a73 Merge remote-tracking branch 'origin/main' into codex/repair-pr-448 2026-08-13 10:15:41 -07:00
calesthio
0bb4c266d7 Merge remote-tracking branch 'origin/main' into codex/repair-pr-442 2026-08-13 10:15:35 -07:00
Calesthio
6e957f2378 Merge pull request #475 from nbsumbana-pixel/fix/comfyui-video-timeout-resume
fix: ComfyUI timeout/resume + websocket wait + multi-server + music tool
2026-08-13 10:13:11 -07:00
Calesthio
5fcea90d71 Merge pull request #483 from ikohu-66/add_seedream_tools
Add seedream tools
2026-08-13 10:08:25 -07:00
calesthio
6b75448a0f Merge remote-tracking branch 'origin/main' into codex/repair-pr-483 2026-08-13 09:44:57 -07:00
calesthio
85dce1147a Merge remote-tracking branch 'origin/main' into codex/repair-pr-475 2026-08-13 09:33:40 -07:00
calesthio
7f43667dfd fix: refresh Fish Audio promotion and schema 2026-08-13 09:32:54 -07:00
calesthio
7052f3999b Merge remote-tracking branch 'origin/main' into codex/repair-pr-353
# Conflicts:
#	.env.example
2026-08-13 09:28:52 -07:00
calesthio
a3c45aa3bf Merge remote-tracking branch 'origin/main' into codex/repair-pr-371
# Conflicts:
#	.env.example
2026-08-13 09:23:46 -07:00
calesthio
cffc18308f fix: scope fal providers and Google TTS networking 2026-08-13 09:22:11 -07:00
calesthio
8143266ead fix: complete Hunyuan image provider integration 2026-08-13 09:18:49 -07:00
calesthio
190d165d8b fix: enforce Hunyuan provider contracts 2026-08-13 09:16:22 -07:00
calesthio
171866dbbf fix: complete Seedream provider integration 2026-08-13 09:12:00 -07:00
calesthio
b1aefb364a fix: complete MiniMax image provider contracts 2026-08-13 09:02:22 -07:00
calesthio
579bf053e7 fix: route Gemini image models through selector 2026-08-13 08:58:27 -07:00
Ntsako
cf1a13a722 feat: bundle a native-node ACE-Step v1 workflow for comfyui_music
ACE-Step v1's node-pack fragmentation turns out to be moot: ComfyUI ships
TextEncodeAceStepAudio/EmptyAceStepLatentAudio as native core nodes
(comfy_extras/nodes_ace.py), not a third-party pack, and Comfy-Org's own
workflow_templates repo has an official ACE-Step-v1 template built from
those plus long-stable core nodes. tools/_comfyui/workflows/ace-step-1-t2a.json
was built by cross-checking every node's class_type and input names against
ComfyUI's own source (nodes_ace.py, nodes_audio.py, nodes_latent.py,
nodes.py) rather than trusting the UI-format export directly.

comfyui_music now defaults to this bundled workflow: prompt maps to
ACE-Step's tags field (matching suno_music's "prompt = music description"
convention), lyrics/duration_seconds/steps/cfg/lyrics_strength/seed are all
patchable, and missing ace_step_v1_3.5b.safetensors surfaces through the
same missing_models contract as image/video. workflow_json/workflow_path +
output_node remains available for ACE-Step 1.5, other node packs, or
different audio models entirely.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-08-06 15:10:48 +02:00
Ntsako
172acca6ea feat: ship comfyui_music as a custom-workflow-only ACE-Step tool
Resolves the "music generation" open question from the adapter plan.
Unlike comfyui_image/comfyui_video there is no bundled workflow: ACE-Step's
ComfyUI node interface isn't standardized across custom node packs
(AceStepModelLoader vs native TextEncodeAceStepAudio, etc.), so instead of
picking one pack and breaking for everyone else, comfyui_music always
requires a caller-supplied workflow_json/workflow_path + output_node --
the same override contract image/video offer as an alternative, just
mandatory here. prompt is provenance-only, never injected into the graph.

Routed through the existing registry.get_by_capability("music_generation")
path alongside suno_music/music_gen -- no dedicated selector needed.
ComfyUIClient.generate() now also reads the "audio" output key (what
ComfyUI's native SaveAudio node writes), and gets timeout/resume/websocket-
wait/multi-server support for free via the shared client. Duration is a
best-effort ffprobe probe of the downloaded file since a custom workflow
gives no other way to know it ahead of time.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-08-06 14:19:05 +02:00
Ntsako
2f114682e8 feat: support per-capability ComfyUI server URLs for image/video
Resolves the "multi-server" open question from the adapter plan.
ComfyUIClient(capability="image"|"video") now resolves its server URL
from COMFYUI_IMAGE_SERVER_URL / COMFYUI_VIDEO_SERVER_URL first, falling
back to the shared COMFYUI_SERVER_URL and then the localhost default —
so comfyui_image and comfyui_video can point at separate ComfyUI
instances (different GPUs, different model sets) with zero extra config
for single-server setups. is_default_url/unavailable_reason() and the
setup_offer metadata account for the override.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-08-06 12:49:57 +02:00
Ntsako
ca203e49b7 feat: wait on ComfyUI websocket feed instead of polling for completion
Resolves the "async generation" open question from the adapter plan.
generate() now watches ComfyUI's websocket events (executing/progress/
execution_error) and reacts immediately instead of sleeping between REST
polls, with an optional on_progress callback that comfyui_video uses to
print step progress on long renders. websocket-client is an optional
import; _wait() falls back to the original poll() loop (with the
remaining time budget, not a fresh one) when it's unavailable or the
connection drops, so resume_prompt_id recovery is unaffected either way.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-08-06 12:31:24 +02:00
Ntsako
ceee7c7d56 fix: raise ComfyUI video timeout default and add job resume support
Non-accelerated local-GPU workflows (e.g. Wan 1.3B at 832x480/81-97
frames) routinely took ~1360-1630s, so the old 900s default false-failed
real renders that were still completing server-side. Timeout is now a
configurable timeout_seconds input (default 3600s), and ComfyUIError
carries the prompt_id on error/timeout so a timed-out-but-still-running
job can be resumed via resume_prompt_id instead of resubmitted.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-08-06 10:55:56 +02:00
clarkh
287c77fa64 feat: add Tencent Hunyuan cloud video provider via TokenHub API
Introduce a new video generation provider backed by the Tencent TokenHub
API (tokenhub.tencentmaas.com), an OpenAI-compatible gateway for Tencent
Hunyuan video models with simple Bearer-token auth.

- Add hunyuan_cloud_video tool (submit → poll → download) supporting
  both text-to-video (hy-video-1.5) and image-to-video (yt-video-2.0)
- Add env vars: TENCENT_TOKENHUB_API_KEY, TENCENT_TOKENHUB_MODEL
- Add contract tests for the new tool
- Document setup, API flow, model pricing, and schema constraints in
  PROVIDERS.md
- Update provider tables and capability matrix throughout docs
2026-07-28 16:48:06 +08:00
zzzxtnt
b71f9b1f3e feat(video): add direct Volcengine Ark Seedance 2.0 provider 2026-07-27 11:24:07 +08:00
Calesthio
0af32ce5e1 Merge pull request #341 from yiyabo/feat/jimeng-video
Add Volcengine Jimeng (即梦 AI) video provider with V4 signing
2026-07-23 07:59:05 -07:00
Tomofumi Yagi
990d7f9a2c fix: address selector contract, promo pricing, idempotency, and registry metadata review
- Require 'model' in the input schema and accept 'model_id' as a
  selector-compatible alias (tts_selector exposes model_id); add a
  selector-routing regression test
- Document s2.1-pro-free as promotional (free through end of July 2026,
  Fair Use, no SLA, possible request retention, commercial-use
  restrictions) in PROVIDERS.md and the Layer 3 skill; estimate_cost()
  falls back to the paid s2.1-pro rate after the promo window
- Normalize voice_id/reference_id and model_id/model aliases before
  computing the idempotency key, and include all output-affecting inputs
  (bitrate, sample_rate, temperature, top_p, repetition_penalty, latency,
  prosody, normalize, chunk_length) with API defaults applied
- Declare env:FISH_AUDIO_API_KEY in dependencies so registry metadata
  reports the requirement
- Add fish_audio to the TTS provider set in the phase3 registry contract
  test
2026-07-22 19:00:46 +09:00
Tomofumi Yagi
b29e238e8e docs: add fish.audio to provider docs and fix stale speech-1.x reference
- .env.example: replace removed speech-1.x mention with the actual
  supported backends (s1 / s2-pro / s2.1-pro)
- docs/PROVIDERS.md: add fish.audio section (setup, backend models,
  per-byte pricing incl. free s2.1-pro-free tier) plus entries in the
  env var summary, Provider-to-Tool Mapping, and Capability Coverage
- skills/INDEX.md: list fish-audio-tts in the TTS & Audio Layer 3 row
2026-07-22 18:52:33 +09:00
Yiyabo
53773cd5fc fix: tighten input_schema per Volcengine Jimeng 3.0 Pro contract
- frames: enum [121, 241] (was minimum 1)
- prompt: maxLength 800 (was 2000)
- seed: minimum -1 (was unbounded)
- Add 9 schema validation rejection tests
- Add authoritative API reference link to PROVIDERS.md
- Document CVSync2Async* route choice and schema constraints

Fixes calesthio's second review feedback on PR #341.
2026-07-19 21:47:06 +08:00
amartya-dev
888d7b1e72 feat(tts): add Azure AI Speech as an optional cloud text-to-speech provider
Neural TTS via the synchronous REST v1 endpoint (SSML body, no token
exchange or job polling). Shares one Speech resource with azure_stt —
AZURE_SPEECH_KEY + AZURE_SPEECH_REGION unlock both directions; optional
AZURE_TTS_ENDPOINT overrides the TTS host (a different subdomain than
the STT endpoint). piper_tts remains the default offline path.

- tools/audio/azure_tts.py: azure_tts tool (capability=tts), voice
  shortlist aliases, SSML prosody/style, mp3/wav output, cost tracking
- tests/tools/test_azure_tts.py: contract, discovery, status, SSML,
  and mocked execute tests (21 tests, no live network)
- .agents/.claude skills: azure-text-to-speech Layer-3 skill
- docs: PROVIDERS.md section + tables, ARCHITECTURE.md inventories,
  AGENT_GUIDE.md + skills/INDEX.md rows, asset-director TTS cheatsheet,
  .env.example
2026-07-13 20:04:28 +05:30
Calesthio
f8d94632ea Merge pull request #354 from amartya-dev/feat/azure-speech-to-text
feat(stt): add Azure AI Speech as an optional cloud speech-to-text provider
2026-07-12 10:48:36 -07:00
Calesthio
df3801a6b9 Merge pull request #323 from xucailiang/codex/kling-official-phase-1
Add official Kling API providers
2026-07-12 10:45:02 -07:00