为什么值得关注

它结合了 GPT Image 2 进行字体设计、Gemini Omni Flash 进行动画生成，并加入确定性质量控制和精确文本校验，同时保留原始主音频。

适合谁使用

音乐视频制作人与编辑
希望自动生成歌词视频的内容创作者与艺术家
探索多模型管线的 AI/ML 开发者
需要低成本歌词视频制作的音乐人

典型使用场景

为单曲或专辑创作专业歌词视频
生成具有语义词-物编排的动态字体动画
制作带因果转换的无词器乐叙事片段
通过局部回退修复自动进行质量控制

项目优势

生产级管线，将歌词作为主角
集成了图像生成、视频动画和确定性质量控制
开源 MIT 许可，附带可直接使用的脚本和模板
以原始主音频作为唯一最终配乐

使用前须知

需要访问付费 API（GPT Image 2、Gemini Omni Flash）
依赖于 Hermes Agent 生态系统及其设置
需要 Python 3、ffmpeg 及可选的 songsee 工具
局限于参考-视频动画风格和以字体设计为主导的创作

README 快速开始

Lyric Video Director

A production-grade Hermes Agent skill for directing stylized lyric videos from a song, exact lyrics, and rough line timings.

It treats the lyric as the protagonist: GPT Image 2 designs typography-led compositions, Gemini Omni Flash animates them through reference-to-video, and deterministic QC preserves exact text and the untouched master audio.

What it covers

Audio inspection, structure analysis, and coverage-complete timelines
Visual bibles and tracer sequences before expensive bulk generation
Kinetic typography and semantic word-object choreography
Wordless instrumental narratives with causal transitions
Exact-text verification and localized fallback repairs
FFmpeg assembly against the original master song
Technical, textual, musical, and creative-parity QC

Install

Copy or clone this repository into your Hermes profile's skills directory:

mkdir -p ~/.hermes/profiles//skills/creative
git clone https://github.com/ShadoW-Shinigami/lyric-video-director.git \
  ~/.hermes/profiles//skills/creative/lyric-video-director

Replace `` with your active profile, such as telegram.

The main skill definition is SKILL.md. Hermes discovers its linked references, scripts, and templates from the repository layout.

Repository layout

.
├── SKILL.md
├── references/
│   ├── art-direction-and-prompts.md
│   ├── audio-and-timeline.md
│   ├── full-song-production-qc.md
│   ├── instrumental-narrative-direction.md
│   ├── kinetic-typography-reference-video.md
│   ├── non-lyric-retrofit-workflow.md
│   ├── typography-and-qc.md
│   └── worked-examples.md
├── scripts/
│   ├── inspect_audio.py
│   └── validate_timeline.py
└── templates/
    ├── project.yaml
    └── timeline.example.json

Requirements

The skill expects access to:

Python 3
ffmpeg and ffprobe
GPT Image 2 image generation
FAL Gemini Omni Flash reference-to-video tools
Optional: songsee for visual audio analysis

Run the helper checks:

python3 scripts/inspect_audio.py --help
python3 scripts/validate_timeline.py --help

Core rule

The supplied song is sacred. Generated video audio is discarded, and the original master remains the sole final soundtrack.

License

MIT — see LICENSE.

项目描述

Hermes Agent skill for typography-led lyric videos using GPT Image 2, Gemini Omni Flash, and exact-text QC

lyric-video-director