🎙️ AutoLipSync Pro – Advanced Lip Sync Addon for Blender

AutoLipSync Pro is a powerful Blender addon that automatically generates lip sync animations from speech audio—completely offline, with no internet required! 🚀

It uses advanced  voice recognition to analyze audio, convert speech to text, and map phonemes to viseme shape keys or pose actions, allowing for realistic and expressive character lip movements. 🎭

🔹 Minimal Setup: This addon requires only 13 Shape Keys or Pose Actions to generate smooth lip sync animations. It also includes reference guides to help you create the necessary shape keys or actions with ease. 📖✅

Current Version AutoLipSync Pro v1.3

🔹 System Requirements 🔹

✅ Supported Platforms: Windows & Linux (Tested on Debian) 🖥️
The addon has been fully tested on Windows and Debian-based Linux systems. Other Linux distributions may also work, but have not been officially tested yet.

• Tested and confirmed to work on Windows 10 & Windows 11

✅ Blender Compatibility: 🔄

• Tested on Blender 3.6, 4.0, 4.1, 4.2, 4.3, 4.4, 5.0 And 5.1

• Fully functional on these versions without issues.

How To Use AutoLipSync Pro Addon New Features

🌍✨ Multilingual Lip Sync Test 🎙️🎭

This is a demonstration of AutoLipSync Pro handling different languages! 🌐 No additional tweaks, refinements, or manual rework—what you see is the raw output straight from the addon. 🚀🔥

Customer showcase
This amazing lip-sync animation was created by one of our users using AutoLipSync Pro.
Big thanks for allowing me to share this result

How To Create Viseme Shape Keys For AutoLipSync Pro

How To Create Viseme Pose Action For AutoLipSync Pro

🆕 NEW in v1.3

🎬 Audio to Video Sequencer Integration

You can now:

• Send audio directly into Blender’s Video Sequence Editor (VSE)

• Preview and manage audio instantly inside timeline

• Easily align speech with animation timing

✂️ Audio Start & End Frame Control

Now you can:

• Define exactly where audio starts and ends in timeline

• Cut or trim audio timing for precise lip sync control

• Control when the character begins and stops speaking
  

🧠 Keep Existing Lip Sync (NEW!)

A powerful animation layering system:

Old behavior:

• New lip sync would overwrite previous animation or always start from frame 0

Now:

• You can KEEP existing lip sync animation

• Add new audio starting at any frame (example: frame 150 → 300)

• Combine multiple dialogue clips in one timeline

• Build complex multi-scene conversations easily

• Old animation stays intact, new one appends correctly

⚡ Performance Upgrade

• Faster lip sync generation

• Improved stability

• Optimized processing pipeline

🔧 Blender 5.1 Support

Fully updated and compatible with the latest Blender versions (including 5.1)

👁️ Improved Auto Eye Blink System

Now smoother, more natural, and better synced with facial motion.

✨ Key Features

✅ Generate Lip Sync with Shape Keys or Pose Actions

• Supports both Shape Key-based animation and Rig Control-based animation (Pose Actions).

• Works similarly to iClone AccuLips, but you can use either Shape Keys Or Pose Actions.

✅ Works 100% Offline 🚀

• No internet connection is needed—everything runs locally on your computer!

✅ Prebuilt Reference Guide for Better Shape Keys & Pose Actions

• Provides a set of reference visemes and phoneme actions.

• Requires only 13 Shape Keys or Pose Actions to generate highly realistic mouth movements.

✅ Automatic Eye Blinking 👀

• Adds natural blinking to characters for a more lifelike appearance.

✅ Built-in Audio Converter 🎵

• Converts audio into the required format for optimal processing.

✅ Real-Time Audio-to-Text Processing 📝

• When you provide an audio file, the addon transcribes the speech to text in real-time instead of freezing Blender until the process is complete.

• You can see the text being generated live as the audio is processed.

• The UI remains responsive, allowing you to navigate and continue working in Blender while transcription happens in the background—no freezing or waiting for completion

✅ Multi-Language Support with Phoneme Matching 🌍🔠

• The addon primarily transcribes English, but it can process many languages by finding the closest matching English words.

• Since it works with phonemes to visemes, it intelligently maps sounds to the best-fitting English equivalents, ensuring accurate lip sync even for non-English speech.

🧑‍🎤 Included Test Character for Instant Lip Sync Testing!
The addon comes with a pre-made test character equipped with both shape keys and pose actions, allowing you to quickly test and preview lip sync animations using your audio.

🔥 Get Started Today!

This is Version 1.3, and I’m always active and open to feedback! If you encounter any issues or have feature suggestions, I’d love to hear from you. Let’s make this the best lip sync tool for Blender together! 🎤🎬