abanoub-ashraf/fal-lip-sync

fal-lip-sync

Create talking head videos, sync lips to audio, and animate portraits using fal.ai models.

Scripts

| Script | Purpose | |--------|---------| | talking-head.sh | Generate a talking head video from an image + audio/text | | lip-sync.sh | Sync lips in an existing video to new audio |

Usage

Talking Head (Image + Audio → Video)

./scripts/talking-head.sh --image-url "https://example.com/portrait.jpg" --audio-url "https://example.com/speech.mp3" --model veed/fabric-1.0

Talking Head (Image + Text → Video with auto TTS)

./scripts/talking-head.sh --image-url "https://example.com/portrait.jpg" --text "Hello, welcome to our presentation" --model fal-ai/creatify/aurora

Lip Sync (Video + Audio → Synced Video)

./scripts/lip-sync.sh --video-url "https://example.com/video.mp4" --audio-url "https://example.com/new-speech.mp3"

Arguments

talking-head.sh

| Argument | Description | Required | |----------|-------------|----------| | --image-url | URL of portrait/face image | Yes | | --audio-url | URL of audio to sync | Yes (or --text) | | --text | Text to speak (auto TTS) | Yes (or --audio-url) | | --model / -m | Model endpoint | No (default: veed/fabric-1.0) | | --tts-model | TTS model for --text mode | No (default: fal-ai/minimax/speech-2.6-turbo) | | --wait / -w | Wait for completion | No (default: true) | | --async / -a | Return request ID immediately | No |

lip-sync.sh

| Argument | Description | Required | |----------|-------------|----------| | --video-url | URL of video to lip sync | Yes | | --audio-url | URL of audio to sync to | Yes | | --model / -m | Model endpoint | No (default: fal-ai/sync-lipsync/v2) |

Finding Models

To discover the best and latest lip sync and talking head models, use the search API:

# Search for talking head models
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "talking head"

# Search for lip sync models
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "lip sync"

# Search for live portrait / expression transfer
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "live portrait"

Or use the search_models MCP tool with relevant keywords like "lip sync", "talking head", "avatar".

Output Format

{
  "video": {
    "url": "https://fal.media/files/...",
    "content_type": "video/mp4"
  }
}

Present the video URL directly to the user.