sync-3

Adapt lip movement to new audio while preserving the performance

Website

Meet sync-3

sync-3 is a lip-sync model for adapting existing video to new speech. It analyzes the visual context of a scene while changing mouth movement, aiming to retain the expression and performance of the original footage. The model is designed for material that includes changing angles, close-ups, multiple speakers, or difficult lighting.

Creators can use the technology for translated content, revised dialogue, and other projects where an existing performance needs different audio. Access through sync’s product and API supports both interactive work and integration into a larger media pipeline. Editing and localization teams can use it alongside their normal review process to prepare versions for different audiences.

Discussion

Tried it? Share a useful thought or ask a question.

Product details

Website
sync.so
Status
Launched
Listed

Explore related topics