Six Lip Sync Animation Tips for Cartoon Animator (That Really Apply to Any Auto Lip Syncing Application)
Animating a character's mouth talking in any form of animation is one of the more time consuming jobs of character animation. Particularly if your project is dialogue heavy or your character has the urge to sing.
Fortunately auto lip syncing in many animation software studios is becoming more common and is helping to speed up the lip syncing process. Reallusion's Cartoon Animator is no exception with a fairly good auto lip sync feature. I made a tutorial video demonstrating how to auto and manual lip sync in Cartoon Animator here.
However auto lip sync is not perfect (yet) so you'll definitely find yourself manually lip syncing a character at some point. Or maybe you just prefer to manually lip sync yourself because you like that level of control.
Whatever the reason here are Six tips to help improve your lip sync and to stop you getting bogged down into really small details that literally do not matter for the amount of screen time they'll get.
1. Auto Lip Sync is NOT as Bad as You Think
Auto lip sync is not as bad as you think. If you give it clean audio it'll usually work pretty good. If you're feeding in a voice track that includes background noises or music that's on you, it's not the auto lip sync's fault.
Even with clean audio it's never perfect by any means, but you really only need to fix the obvious mouth shapes that jump out at you as being incorrect.
Cartoon Animator's Automatic/Manual lip sync tools are pretty straight forward and easy to edit.
2. You Do Not Need to Animate Every Syllable of Every Word
You should make the title of this second tip a mantra. You do not need to animate every syllable of every word with the correct mouth shape.
When we speak our mouths do not form the shape of every single syllable in a word. If you change the mouth shape for every syllable the lips will move too fast and look unrealistic - especially if your character is talking at a casual pace.
Start a mouth shape one or two frames before you hear the sound (sometimes even more as a character anticipates their speech before making a sound) for more realism. Because the sound is being made by the mouth we usually see the mouth move a split second before we hear the voice coming from it.
4. Pay Attention to the Closed Mouth Shapes
Lip syncing is as much about timing when the mouth is closed as when it is open. The closed mouth shapes can often be more important than the open shapes because you really notice if a character is making a B, F, or P sound and the actual mouth is open. It just looks wrong.
5. Be Your Own Reference
This is a really obvious tip but if you're not sure of a particular mouth shape for some dialogue, grab a mirror and watch yourself form the mouth shapes. Speak normally, don't emphasize the syllables (unless your character is doing this). If you have a phone camera handy you may even like to record yourself so you can replay your mouth over and over as you work.
6. Exaggerate the Mouth Movement
Once you have the general lip sync done and it's looking pretty good, take another look at it and see if you can make it more dynamic.
If a character is showing emotion that is partly expressed through the mouth, maybe they're angry and shouting, open the mouth a little wider, show more teeth.
If, like Cartoon Animator, your animation software uses a standard set of mouth sprites, and you don't always have access to variations on those sprites, try using Free Form Deformations (FFD) to make the mouth and jaw line more flexible and expressive.
This article was inspired by an old Plural Sight article from 2013 titled, Proven Tips for Animating Believable Lip Sync, as well as my own knowledge from reading countless animation books. If there is one takeaway you should remember about lip syncing it's:
You do not need to animate every syllable.
Lip syncing is time consuming enough. Animating every syllable is a rookie mistake. Honestly I've seen long time animators make that mistake and, watching their characters talk feels like you've run a small marathon.
But don't take my word for it. Here's a video of former Disney Animator, Aaron Blaise giving you his tips on lip syncing (fast forward the video a few minutes - after all his promotional waffle - it's an old video from nine years ago, before people knew to get straight to the point).
Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D
T his post was inspired by an Amateur Animators Facebook Group , public conversation between two professional animators working at entirely different places in their careers but both with at least a decade plus of experience. Indy Animator Versus Studio Animator The conversation centered around an original post by an amateur animator asking if USD$115 payment for a four to five minute, frame by frame animation, was a good deal? Anyone who has done even one second of frame by frame animation should at least have some concept of how long it would take to make four to five minutes and know that $115 is definitely not a good deal for most people. However, professional animator one, who I would describe as an independent animator, running a successful content and training business, while not suggesting the deal was good, made the point that there are many factors that go into pricing and that ultimately it is for the individual to set their prices based on what they're happy to work
Wonder Unit Storyboarder. As an independent and solo animator I'm always tempted to try and skip storyboarding my animated shorts because they're usually only single scene sketch comedy type jokes. As a result I have many unfinished projects that kind of petered out due to having no clear finishing line. Storyboarding your productions, no matter how small, gives you a step by step guide of every shot that needs to be completed (no planning shots as you animate). It also allows you to create an animatic that gives you a rough preview of the finished production. In short, you shouldn't skip storyboards as they, generally, increase the chance of the project being completed. Disclaimer - I'm Not a Fan of Storyboarder Upfront, Wonder Unit's Storyboarder is not my preferred storyboarding software. However it's completely free, has a number of very compelling featu
Even though I should be further away from the camera Dollars Mocap MONO still does a good job of tracking my arms, hands and fingers. Ever since I wrote my series on becoming a VTuber , discovering it was possible to do full body motion capture, including hands and fingers, with just software and a webcam, I've been on the look out for any motion capture software that can bring that functionality to Cartoon Animator. Dollars Mocap is a low cost motion capture application with a free trial that I learned about through the YouTube Channel Digital Puppets and their test video . It can record full body, upper body, arms and hands, and facial mocap from a live video source or pre-recorded video. Investigating further, I discovered not only does Dollars Mocap have a free iClone7, iClone8 character profile file download (look for it at the bottom of the main program download page), so you can use the saved motions with iClone8, they've also got a demo video for how to convert your
The Emo Girl Character created by Start Animating. A I generative video isn't new but it is the next big thing in the visual imaging space as various development teams work to perfect the generated output. Just like generating still images AI video sometimes struggles with physics, arm and hand movement, and the general structure of things. However it is getting better and, as is the catch cry of all AI development, this is the worst it will ever be, because it's improving fast. If you're an animator one current potential use of generative AI video is to animate your key frames, as opposed to generating something entirely from a text prompt. Starting with an image helps to keep your characters and art style consistent across AI generations. With that in mind I tried five, free image to video AI generators to see what their potential might be and whether they can handle cartoon style characters well. Note all but the last entry on the list do not create any sound with the
Animation Paper V5.0 Alpha 2 Pre-release. Animation Paper strives to be the best tool for digital hand drawn animation by not only recreating the traditional animator's table in a modern user interface, but also automating many of the more tedious processes so you can focus almost entirely on drawing. At the time of writing Animation Paper V5.0 is only available as an Alpha 2 Pre-release, and still does not have all of its features implemented, such as the ability to add audio (due to be part of the Alpha 3 release scheduled for the end of May 2020). Animation Paper has been completely redesigned and updated from th hand drawn animation app that was formerly known as Plastic Animation Paper (PAP) which, at the time, was easily one of the best apps for the sole purpose of creating hand drawn digital animation roughs. You can still download PAP completely free from the Animation Paper website . If you look past the extremely dated 90's interface it's still a great tool. I wr
Comments
Post a Comment
This blog is monitored by a real human. Generic or unrelated spam comments with links to sites of dubious relativity may be DELETED.
I welcome, read, and respond to genuine comments relating to each post. If your comment isn't that save me some time by not posting it.