mirror of
https://github.com/calesthio/OpenMontage.git
synced 2026-09-08 20:46:27 +08:00
Add official Kling API providers
This commit is contained in:
xucailiang
+57
-9
@@ -17,11 +17,12 @@ Everything you need to know about every provider in OpenMontage — setup instru
|
||||
| 5 | **~$0.03/image** | fal.ai | FLUX images + Kling/Veo/MiniMax video + Recraft — broad single-key image + video coverage |
|
||||
| 6 | **~$0.05/image** | OpenAI | GPT Image 2 images + OpenAI TTS |
|
||||
| 7 | **~$0.04/image** | Google Imagen | Imagen 4 images (shares the Google API key) |
|
||||
| 8 | **$12/month** | Runway | Gen-4 video — highest quality AI video |
|
||||
| 9 | **pay-as-you-go** | HeyGen | Avatar videos, multi-model video gateway |
|
||||
| 10 | **pay-as-you-go** | Suno | Full song generation with vocals and lyrics |
|
||||
| 11 | **$0 + GPU** | Local video gen | WAN 2.1, Hunyuan, CogVideo, LTX — free, offline |
|
||||
| 12 | **$0 + GPU** | Local Diffusion | Stable Diffusion images — free, offline |
|
||||
| 8 | **pay-as-you-go** | Kling Official | Official direct Kling video, image, TTS, avatar, and lip-sync API, separate from fal.ai Kling |
|
||||
| 9 | **$12/month** | Runway | Gen-4 video — highest quality AI video |
|
||||
| 10 | **pay-as-you-go** | HeyGen | Avatar videos, multi-model video gateway |
|
||||
| 11 | **pay-as-you-go** | Suno | Full song generation with vocals and lyrics |
|
||||
| 12 | **$0 + GPU** | Local video gen | WAN 2.1, Hunyuan, CogVideo, LTX — free, offline |
|
||||
| 13 | **$0 + GPU** | Local Diffusion | Stable Diffusion images — free, offline |
|
||||
|
||||
### Environment Variable Summary
|
||||
|
||||
@@ -45,6 +46,10 @@ DOUBAO_SPEECH_VOICE_TYPE= # Default Doubao speaker/voice type
|
||||
# MULTI-MODEL GATEWAY (one key, 6+ tools)
|
||||
FAL_KEY= # FLUX, Recraft, Kling, Veo, MiniMax video
|
||||
|
||||
# KLING OFFICIAL DIRECT API
|
||||
KLING_API_KEY= # Official Kling video, image, TTS, avatar, lip sync
|
||||
KLING_API_BASE_URL= # Optional; default https://api-singapore.klingai.com
|
||||
|
||||
# VIDEO
|
||||
HEYGEN_API_KEY= # HeyGen avatar video gateway
|
||||
RUNWAY_API_KEY= # Runway Gen-4 video (direct)
|
||||
@@ -133,6 +138,48 @@ No subscription — pure pay-as-you-go, no minimum spend.
|
||||
|
||||
---
|
||||
|
||||
### Kling Official — Direct API
|
||||
|
||||
> **Official Kling path.** This is separate from `kling_video` via fal.ai: it uses Kling's official `Authorization: Bearer <KLING_API_KEY>` API, provider name `kling_official`, and direct Classic/Turbo/Omni task protocols.
|
||||
|
||||
**Tools unlocked:** `kling_official_video`, `kling_official_image`, `kling_tts`, `kling_avatar`, `kling_lip_sync`
|
||||
**Env vars:** `KLING_API_KEY`, optional `KLING_API_BASE_URL`
|
||||
|
||||
#### Setup
|
||||
|
||||
1. Create or open a Kling AI Open Platform account.
|
||||
2. Generate an official API key in the Kling API console.
|
||||
3. Add to `.env`:
|
||||
```bash
|
||||
KLING_API_KEY=your-key-here
|
||||
# Optional, defaults to Singapore:
|
||||
KLING_API_BASE_URL=https://api-singapore.klingai.com
|
||||
```
|
||||
|
||||
#### What It Is Best For
|
||||
|
||||
- Direct official Kling API provenance rather than fal.ai gateway routing
|
||||
- Text-to-video, image-to-video, and deep Video Omni reference workflows via `kling_official_video`
|
||||
- Text-to-image, image edit/reference, and Image Omni multi-reference or series workflows via `kling_official_image`
|
||||
- Text-to-speech via `kling_tts` when you already know the official Kling `voice_id`
|
||||
- Cloud avatar presenter clips via `kling_avatar`, without replacing local `talking_head`
|
||||
- Cloud lip-sync via `kling_lip_sync`, with explicit face selection for multi-person videos
|
||||
- Accounts that need to use official Kling model permissions, resource packs, or regional endpoints
|
||||
|
||||
#### Notes
|
||||
|
||||
- `provider="kling_official"` is intentionally different from fal.ai's `provider="kling"`.
|
||||
- Official Kling is a paid remote API. OpenMontage uses conservative cost estimates and includes high-cost factors such as Omni references, series output, 4k mode, and native sound.
|
||||
- Local image paths are sent as raw base64 for supported Classic/image-generation fields. Turbo image-to-video requires a URL and will not silently upload through fal.ai.
|
||||
- Video Omni and Image Omni can pass official `element_id` references through `element_list`; Elements remain an internal Kling Official helper, not a standalone OpenMontage capability.
|
||||
- Account Usage is available as a low-frequency diagnostic helper under `tools/_kling/account.py`; it is not a selector or pipeline tool.
|
||||
- `callback_url` is passed through and recorded when supplied, but OpenMontage still polls tasks by default.
|
||||
- `kling_tts` requires an explicit `voice_id`; OpenMontage does not guess a default official voice.
|
||||
- `kling_avatar` and `kling_lip_sync` register under the existing `avatar` capability and coexist with local SadTalker/Wav2Lip tools. Current avatar pipelines must opt into them explicitly; registry discovery alone does not replace local tools.
|
||||
- Official Kling audio effects and video effects are documented but intentionally not registered as OpenMontage tools yet, because current pipelines do not have a stable sound-effects or video-effects capability slot for them.
|
||||
|
||||
---
|
||||
|
||||
### ElevenLabs — Voice, Music, Sound Effects
|
||||
|
||||
> **Premium voice quality.** Best TTS for narration-heavy videos. Also generates music and sound effects.
|
||||
@@ -729,6 +776,7 @@ These tools require only FFmpeg or Python packages — no GPU, no API key.
|
||||
| **Google** | `GOOGLE_API_KEY` | `google_tts`, `google_imagen` | Free tier + paid |
|
||||
| **ElevenLabs** | `ELEVENLABS_API_KEY` | `elevenlabs_tts`, `music_gen` | Free tier + paid |
|
||||
| **fal.ai** | `FAL_KEY` | `flux_image`, `recraft_image`, `kling_video`, `veo_video`, `minimax_video` | Pay-as-you-go |
|
||||
| **Kling Official** | `KLING_API_KEY` | `kling_official_video`, `kling_official_image`, `kling_tts`, `kling_avatar`, `kling_lip_sync` | Pay-as-you-go |
|
||||
| **OpenAI** | `OPENAI_API_KEY` | `openai_tts`, `openai_image` | Paid only |
|
||||
| **xAI** | `XAI_API_KEY` | `grok_image`, `grok_video` | Paid only |
|
||||
| **Runway** | `RUNWAY_API_KEY` | `runway_video` | Free trial + paid |
|
||||
@@ -747,14 +795,14 @@ How many providers cover each capability:
|
||||
|
||||
| Capability | Cloud Providers | Local Providers | Free Options |
|
||||
|-----------|----------------|-----------------|--------------|
|
||||
| **Image Generation** | FLUX, Grok, Google Imagen, GPT Image 2, Recraft | Local Diffusion | Pexels, Pixabay (stock) |
|
||||
| **Video Generation** | Grok, Kling, Runway, Veo, Higgsfield, MiniMax, HeyGen | WAN, Hunyuan, CogVideo, LTX | Pexels, Pixabay (stock) |
|
||||
| **Text-to-Speech** | ElevenLabs, Google TTS, OpenAI | Piper | Piper, Google free tier, ElevenLabs free tier |
|
||||
| **Image Generation** | FLUX, Kling Official, Grok, Google Imagen, GPT Image 2, Recraft | Local Diffusion | Pexels, Pixabay (stock) |
|
||||
| **Video Generation** | Grok, Kling Official, Kling via fal.ai, Runway, Veo, Higgsfield, MiniMax, HeyGen | WAN, Hunyuan, CogVideo, LTX | Pexels, Pixabay (stock) |
|
||||
| **Text-to-Speech** | ElevenLabs, Google TTS, Kling Official, OpenAI | Piper | Piper, Google free tier, ElevenLabs free tier |
|
||||
| **Music Generation** | ElevenLabs, Suno | — | ElevenLabs free tier |
|
||||
| **Post-Production** | — | FFmpeg (compose, stitch, trim, mix, enhance, grade) | All free |
|
||||
| **Analysis** | — | WhisperX, Scene Detect, Frame Sampler, CLIP/BLIP-2 | All free |
|
||||
| **Enhancement** | — | Upscale, BG Remove, Face Enhance, Face Restore | All free |
|
||||
| **Avatar** | — | SadTalker, Wav2Lip | All free |
|
||||
| **Avatar** | Kling Official | SadTalker, Wav2Lip | Local tools are free |
|
||||
|
||||
---
|
||||
|
||||
|
||||
Reference in New Issue
Block a user