mirror of
https://github.com/digitalsamba/claude-code-video-toolkit.git
synced 2026-09-18 19:41:13 +08:00
Conal Mullan
6db40e9299
* Add concept-explainer-short template: 9:16 TikTok/Reels explainer shorts (Python/moviepy) First non-Remotion template. The whole video derives from scenes.json (per-scene narration text + visual asset); a three-script pipeline turns it into a finished vertical short: - gen_vo.py — per-scene TTS via tools/voiceover.py (clone or built-in speaker, batch mode, --max-wpm pacing clamp), writes the vo_durations.json timeline anchor; warns past the 3-minute Shorts/Reels ceiling - gen_captions.py — burned karaoke caption timing: whisper word timestamps force-aligned to the ground-truth script text via difflib (never burns whisper's own transcription, which mishears TTS) - build.py — audio-anchored moviepy composite: Ken Burns on stills, boomerang-looped clips (asset extension decides), caption pills with width cap and platform-safe positioning, ducked looped music; renders at every stage (gradient placeholder cards before assets exist, word-count timing estimates before VO, silent before audio) Pattern proven on a 3:41 hallucinations explainer; tested end-to-end (out-of-box placeholder render + full Modal clone pipeline with three takes auto-clamped 181-188→165 wpm). Registered in the toolkit registry, CLAUDE.md, and /video (with Python-flow notes); openai-whisper documented as an optional dependency. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * Add sky-blue-short showcase example + fix Modal qwen3-tts batch custom_voice examples/sky-blue-short: complete worked example of the concept-explainer-short template — a 52s vertical "Why is the sky blue?" short with Qwen3 VO (built-in Ryan, warm tone), two Ideogram diagram/CTA cards, two LTX sky clips, ACE-Step music bed, and burned aligned captions (~$0.80 total generation cost). All source assets committed; re-renders in place with python3 build.py. Building it surfaced two real bugs, fixed here: - Modal qwen3-tts handler: batch custom_voice hit the same qwen-tts tensor-aliasing crash the clone path already works around — now iterates per text with the shared speaker (redeployed and verified) - gen_vo.py: failed batch scenes crashed with KeyError instead of reporting which scenes failed and why Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * Add hallucinations-short and sky-blue-short demo videos to README showcase Both produced with the concept-explainer-short pipeline: sky-blue-short uses the stock Qwen3-TTS Ryan voice; hallucinations-short uses a Qwen3 voice clone from a Pixabay voice-over sample. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> --------- Co-authored-by: Claude Fable 5 <noreply@anthropic.com>