Initial release — OpenMontage: the first open-source agentic video production system
11 production pipelines, 47 tools, 124 agent skills.
Supports cloud APIs (fal.ai, OpenAI, ElevenLabs, Suno, HeyGen, Runway) and
free local providers (diffusers, Piper TTS, WAN 2.1, Hunyuan, CogVideo).
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-29 08:25:17 -07:00
|
|
|
# OpenMontage - Environment Variables
|
|
|
|
|
# Copy this to .env and fill in your keys
|
|
|
|
|
|
2026-04-08 13:04:32 -07:00
|
|
|
# --- Image + video gateway ---
|
2026-08-03 02:14:01 -07:00
|
|
|
# FLUX images, Google Veo video, Kling video, MiniMax video, Recraft images.
|
|
|
|
|
# Get one at https://fal.ai/dashboard/keys
|
|
|
|
|
FAL_KEY=
|
|
|
|
|
# Alias for FAL_KEY (some SDKs/docs use this name); either one is read.
|
|
|
|
|
FAL_AI_API_KEY=
|
2026-07-07 07:29:28 +08:00
|
|
|
|
2026-08-13 09:02:22 -07:00
|
|
|
# --- MiniMax official direct API ---
|
|
|
|
|
# First-party image generation (image-01 / image-01-live).
|
|
|
|
|
# Get one at https://platform.minimax.io/user-center/basic-information/interface-key
|
|
|
|
|
MINIMAX_API_KEY=
|
|
|
|
|
# Optional: global (default) or cn.
|
|
|
|
|
MINIMAX_REGION=global
|
|
|
|
|
|
2026-07-07 07:29:28 +08:00
|
|
|
# --- Replicate ---
|
2026-08-03 02:14:01 -07:00
|
|
|
# Replicate-hosted video gen (seedance_replicate). Needed to make the
|
|
|
|
|
# Replicate-backed Seedance path selectable alongside the fal.ai one.
|
|
|
|
|
# Get one at https://replicate.com/account/api-tokens
|
|
|
|
|
REPLICATE_API_TOKEN=
|
2026-07-07 07:29:28 +08:00
|
|
|
|
|
|
|
|
# --- Higgsfield ---
|
2026-08-03 02:14:01 -07:00
|
|
|
# Higgsfield Cloud key (higgsfield_video). Pair with the secret below,
|
|
|
|
|
# or use the combined HIGGSFIELD_KEY="<key>:<secret>" form instead.
|
|
|
|
|
HIGGSFIELD_API_KEY=
|
|
|
|
|
HIGGSFIELD_API_SECRET=
|
2026-07-07 07:29:28 +08:00
|
|
|
# HIGGSFIELD_KEY= # Combined key:secret — set this INSTEAD of the _KEY/_SECRET pair if you prefer.
|
Initial release — OpenMontage: the first open-source agentic video production system
11 production pipelines, 47 tools, 124 agent skills.
Supports cloud APIs (fal.ai, OpenAI, ElevenLabs, Suno, HeyGen, Runway) and
free local providers (diffusers, Piper TTS, WAN 2.1, Hunyuan, CogVideo).
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-29 08:25:17 -07:00
|
|
|
|
2026-07-07 14:56:40 +08:00
|
|
|
# --- Kling official direct API ---
|
2026-08-03 02:14:01 -07:00
|
|
|
# Official Kling API key; enables video, image, TTS, avatar, lip sync.
|
|
|
|
|
KLING_API_KEY=
|
|
|
|
|
# Optional endpoint override; leave blank for default https://api-singapore.klingai.com
|
|
|
|
|
# Mainland China accounts can use https://api-beijing.klingai.com
|
|
|
|
|
KLING_API_BASE_URL=
|
2026-07-07 14:56:40 +08:00
|
|
|
|
feat(video): add Gemini Omni Flash provider with conversational editing
Add gemini_omni_video, a native Gemini API provider wrapping
gemini-omni-flash-preview via the Interactions API. Text-to-video,
image/reference-to-video with <FIRST_FRAME>/<IMAGE_REF_N> prompt tags,
and stateful edit_video turns via previous_interaction_id — the only
provider in the fleet that can refine a clip without regenerating it.
Reuses the existing GOOGLE_API_KEY / GEMINI_API_KEY, so one Google key
now unlocks images, TTS, and video.
- New Layer 3 skill .agents/skills/gemini-omni (prompting, edit-loop
rules, tag/timecode syntax, preview limits) sourced from official
Google docs; linked via agent_skills and the AGENT_GUIDE Layer 3 map
- ai-video-gen gains the Gemini API gateway row + editing pointer
- veo_video/sora_video fallback lists and video_selector agent_skills
reference the new provider; quality_score 0.85 with rationale
- Contract tests: registry discovery, selector routing, status from
env keys, uri + inline delivery, edit turns, typed image parts,
store=false editability, cost clamp
2026-07-08 11:00:57 -07:00
|
|
|
# --- Google (one key unlocks image gen + TTS + video) ---
|
2026-08-03 02:14:01 -07:00
|
|
|
# Google Imagen images, Google Cloud TTS (700+ voices, 50+ languages),
|
|
|
|
|
# Gemini Omni video (generation + conversational editing, paid tier).
|
|
|
|
|
# Get one at https://aistudio.google.com/apikey
|
|
|
|
|
GOOGLE_API_KEY=
|
feat(video): add Gemini Omni Flash provider with conversational editing
Add gemini_omni_video, a native Gemini API provider wrapping
gemini-omni-flash-preview via the Interactions API. Text-to-video,
image/reference-to-video with <FIRST_FRAME>/<IMAGE_REF_N> prompt tags,
and stateful edit_video turns via previous_interaction_id — the only
provider in the fleet that can refine a clip without regenerating it.
Reuses the existing GOOGLE_API_KEY / GEMINI_API_KEY, so one Google key
now unlocks images, TTS, and video.
- New Layer 3 skill .agents/skills/gemini-omni (prompting, edit-loop
rules, tag/timecode syntax, preview limits) sourced from official
Google docs; linked via agent_skills and the AGENT_GUIDE Layer 3 map
- ai-video-gen gains the Gemini API gateway row + editing pointer
- veo_video/sora_video fallback lists and video_selector agent_skills
reference the new provider; quality_score 0.85 with rationale
- Contract tests: registry discovery, selector routing, status from
env keys, uri + inline delivery, edit turns, typed image parts,
store=false editability, cost clamp
2026-07-08 11:00:57 -07:00
|
|
|
# GEMINI_API_KEY= # Alias for GOOGLE_API_KEY (takes precedence when both are set)
|
2026-06-22 17:53:10 +05:30
|
|
|
# Alternative to the API key: service-account JSON auth.
|
|
|
|
|
# TTS uses Cloud Text-to-Speech; Imagen routes to Vertex AI.
|
2026-08-03 02:14:01 -07:00
|
|
|
# Path to a service-account JSON key file.
|
|
|
|
|
GOOGLE_APPLICATION_CREDENTIALS=
|
|
|
|
|
# GCP project id (required for Imagen via Vertex AI).
|
|
|
|
|
GOOGLE_CLOUD_PROJECT=
|
|
|
|
|
# Vertex AI region, default us-central1.
|
|
|
|
|
GOOGLE_CLOUD_LOCATION=
|
2026-03-29 09:06:26 -07:00
|
|
|
|
Initial release — OpenMontage: the first open-source agentic video production system
11 production pipelines, 47 tools, 124 agent skills.
Supports cloud APIs (fal.ai, OpenAI, ElevenLabs, Suno, HeyGen, Runway) and
free local providers (diffusers, Piper TTS, WAN 2.1, Hunyuan, CogVideo).
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-29 08:25:17 -07:00
|
|
|
# --- Voice ---
|
2026-08-03 02:14:01 -07:00
|
|
|
# TTS narration, music generation, sound effects.
|
|
|
|
|
ELEVENLABS_API_KEY=
|
|
|
|
|
# OpenAI TTS fallback and GPT Image 2 image generation.
|
|
|
|
|
OPENAI_API_KEY=
|
|
|
|
|
# Grok image generation/editing and Grok video generation.
|
|
|
|
|
XAI_API_KEY=
|
|
|
|
|
# Volcengine Doubao Speech TTS (new console API Key).
|
|
|
|
|
DOUBAO_SPEECH_API_KEY=
|
|
|
|
|
# Default Doubao speaker/voice type, e.g. zh_female_vv_uranus_bigtts.
|
|
|
|
|
DOUBAO_SPEECH_VOICE_TYPE=
|
2026-08-13 09:28:52 -07:00
|
|
|
# fish.audio TTS (s1 / s2-pro / s2.1-pro, reference_id voice cloning).
|
|
|
|
|
FISH_AUDIO_API_KEY=
|
Initial release — OpenMontage: the first open-source agentic video production system
11 production pipelines, 47 tools, 124 agent skills.
Supports cloud APIs (fal.ai, OpenAI, ElevenLabs, Suno, HeyGen, Runway) and
free local providers (diffusers, Piper TTS, WAN 2.1, Hunyuan, CogVideo).
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-29 08:25:17 -07:00
|
|
|
# Piper local voices do not require env vars; install `piper-tts` via pip
|
|
|
|
|
|
2026-06-30 14:35:33 +08:00
|
|
|
# --- DashScope (Alibaba Cloud Bailian) ---
|
2026-08-03 02:14:01 -07:00
|
|
|
# Qwen image gen (qwen-image-2.0-pro), TTS (qwen3-tts-flash), ASR with word timestamps (qwen3-asr-flash-filetrans).
|
|
|
|
|
# Get one at https://dashscope.aliyun.com/
|
|
|
|
|
DASHSCOPE_API_KEY=
|
2026-06-30 14:35:33 +08:00
|
|
|
|
2026-07-30 10:53:33 +08:00
|
|
|
# --- Tencent Hunyuan TokenHub API ---
|
2026-08-13 11:11:48 -07:00
|
|
|
# Tencent Hunyuan (腾讯混元) image and cloud video generation via TokenHub
|
|
|
|
|
# (Bearer token).
|
2026-08-13 09:50:12 -07:00
|
|
|
# Get it at https://console.cloud.tencent.com/tokenhub.
|
2026-08-13 09:50:14 -07:00
|
|
|
TENCENT_TOKENHUB_API_KEY=
|
2026-08-13 09:18:49 -07:00
|
|
|
|
Initial release — OpenMontage: the first open-source agentic video production system
11 production pipelines, 47 tools, 124 agent skills.
Supports cloud APIs (fal.ai, OpenAI, ElevenLabs, Suno, HeyGen, Runway) and
free local providers (diffusers, Piper TTS, WAN 2.1, Hunyuan, CogVideo).
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-29 08:25:17 -07:00
|
|
|
# --- Music ---
|
2026-08-03 02:14:01 -07:00
|
|
|
# Suno AI music generation (full songs, instrumentals, any genre).
|
|
|
|
|
SUNO_API_KEY=
|
Initial release — OpenMontage: the first open-source agentic video production system
11 production pipelines, 47 tools, 124 agent skills.
Supports cloud APIs (fal.ai, OpenAI, ElevenLabs, Suno, HeyGen, Runway) and
free local providers (diffusers, Piper TTS, WAN 2.1, Hunyuan, CogVideo).
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-29 08:25:17 -07:00
|
|
|
|
|
|
|
|
# --- Video Generation ---
|
2026-07-27 11:24:07 +08:00
|
|
|
# Volcengine Ark direct Seedance 2.0 API key body (without the "Bearer " prefix).
|
|
|
|
|
# Get one at https://console.volcengine.com/ark/region:cn-beijing/apiKey
|
|
|
|
|
ARK_API_KEY=
|
|
|
|
|
# Optional overrides; uncomment only when needed.
|
|
|
|
|
# ARK_SEEDANCE_MODEL=doubao-seedance-2-0-260128
|
|
|
|
|
# ARK_BASE_URL=https://ark.cn-beijing.volces.com/api/v3
|
|
|
|
|
# ARK_CNY_PER_USD=7.2
|
2026-08-03 02:14:01 -07:00
|
|
|
# HeyGen API (VEO, Sora, Runway, Kling, Seedance via single key).
|
|
|
|
|
HEYGEN_API_KEY=
|
|
|
|
|
# Runway Gen-4 (direct API, alternative to fal.ai routing).
|
|
|
|
|
RUNWAY_API_KEY=
|
|
|
|
|
# Volcengine Jimeng (即梦 AI) video generation via official API (HMAC-SHA256 V4 signing).
|
|
|
|
|
VOLC_ACCESSKEY=
|
|
|
|
|
# Secret Access Key paired with VOLC_ACCESSKEY. Get both at https://console.volcengine.com/iam/keymanage
|
|
|
|
|
VOLC_SECRETKEY=
|
|
|
|
|
# Set to "true" for local video gen (needs GPU + diffusers).
|
|
|
|
|
VIDEO_GEN_LOCAL_ENABLED=
|
|
|
|
|
# Local model: wan2.1-1.3b, wan2.1-14b, hunyuan-1.5, ltx2-local, cogvideo-5b.
|
|
|
|
|
VIDEO_GEN_LOCAL_MODEL=
|
|
|
|
|
# Modal self-hosted LTX-2 endpoint (optional).
|
|
|
|
|
MODAL_LTX2_ENDPOINT_URL=
|
Initial release — OpenMontage: the first open-source agentic video production system
11 production pipelines, 47 tools, 124 agent skills.
Supports cloud APIs (fal.ai, OpenAI, ElevenLabs, Suno, HeyGen, Runway) and
free local providers (diffusers, Piper TTS, WAN 2.1, Hunyuan, CogVideo).
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-29 08:25:17 -07:00
|
|
|
|
|
|
|
|
# --- Stock Media ---
|
2026-08-03 02:14:01 -07:00
|
|
|
# Pexels stock footage/images (free).
|
|
|
|
|
PEXELS_API_KEY=
|
|
|
|
|
# Pixabay stock footage/images (free).
|
|
|
|
|
PIXABAY_API_KEY=
|
|
|
|
|
# Unsplash stock images (free developer key).
|
|
|
|
|
UNSPLASH_ACCESS_KEY=
|
Initial release — OpenMontage: the first open-source agentic video production system
11 production pipelines, 47 tools, 124 agent skills.
Supports cloud APIs (fal.ai, OpenAI, ElevenLabs, Suno, HeyGen, Runway) and
free local providers (diffusers, Piper TTS, WAN 2.1, Hunyuan, CogVideo).
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-29 08:25:17 -07:00
|
|
|
|
|
|
|
|
# --- Analysis ---
|
2026-08-03 02:14:01 -07:00
|
|
|
# HuggingFace token — enables speaker diarization in transcriber.
|
|
|
|
|
HF_TOKEN=
|
feat(tts): add Azure AI Speech as an optional cloud text-to-speech provider
Neural TTS via the synchronous REST v1 endpoint (SSML body, no token
exchange or job polling). Shares one Speech resource with azure_stt —
AZURE_SPEECH_KEY + AZURE_SPEECH_REGION unlock both directions; optional
AZURE_TTS_ENDPOINT overrides the TTS host (a different subdomain than
the STT endpoint). piper_tts remains the default offline path.
- tools/audio/azure_tts.py: azure_tts tool (capability=tts), voice
shortlist aliases, SSML prosody/style, mp3/wav output, cost tracking
- tests/tools/test_azure_tts.py: contract, discovery, status, SSML,
and mocked execute tests (21 tests, no live network)
- .agents/.claude skills: azure-text-to-speech Layer-3 skill
- docs: PROVIDERS.md section + tables, ARCHITECTURE.md inventories,
AGENT_GUIDE.md + skills/INDEX.md rows, asset-director TTS cheatsheet,
.env.example
2026-07-13 20:04:28 +05:30
|
|
|
# Speech: optional Azure AI Speech. One key/region unlocks both directions —
|
|
|
|
|
# azure_stt (Fast Transcription cloud STT) and azure_tts (neural cloud TTS).
|
|
|
|
|
# The local faster-whisper transcriber / piper_tts remain the default offline paths.
|
2026-08-03 02:14:01 -07:00
|
|
|
AZURE_SPEECH_KEY=
|
|
|
|
|
AZURE_SPEECH_REGION=
|
feat(tts): add Azure AI Speech as an optional cloud text-to-speech provider
Neural TTS via the synchronous REST v1 endpoint (SSML body, no token
exchange or job polling). Shares one Speech resource with azure_stt —
AZURE_SPEECH_KEY + AZURE_SPEECH_REGION unlock both directions; optional
AZURE_TTS_ENDPOINT overrides the TTS host (a different subdomain than
the STT endpoint). piper_tts remains the default offline path.
- tools/audio/azure_tts.py: azure_tts tool (capability=tts), voice
shortlist aliases, SSML prosody/style, mp3/wav output, cost tracking
- tests/tools/test_azure_tts.py: contract, discovery, status, SSML,
and mocked execute tests (21 tests, no live network)
- .agents/.claude skills: azure-text-to-speech Layer-3 skill
- docs: PROVIDERS.md section + tables, ARCHITECTURE.md inventories,
AGENT_GUIDE.md + skills/INDEX.md rows, asset-director TTS cheatsheet,
.env.example
2026-07-13 20:04:28 +05:30
|
|
|
# AZURE_SPEECH_ENDPOINT= # Optional: full custom STT endpoint URL (overrides region)
|
|
|
|
|
# AZURE_TTS_ENDPOINT= # Optional: full custom TTS host (e.g. https://<region>.tts.speech.microsoft.com)
|
Initial release — OpenMontage: the first open-source agentic video production system
11 production pipelines, 47 tools, 124 agent skills.
Supports cloud APIs (fal.ai, OpenAI, ElevenLabs, Suno, HeyGen, Runway) and
free local providers (diffusers, Piper TTS, WAN 2.1, Hunyuan, CogVideo).
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-29 08:25:17 -07:00
|
|
|
|
|
|
|
|
# --- Avatar (local installs) ---
|
|
|
|
|
# WAV2LIP_PATH= # Path to cloned Wav2Lip repo (for lip sync)
|
|
|
|
|
# SADTALKER_PATH= # Path to cloned SadTalker repo (for talking head avatars)
|