Skip to main content

Using CrazyTalk 8 and iClone 6 to bring Cartoon Characters to Life

The Comedians - by TET. 
Over 20 years ago I had the idea to create a comic strip that was based on the stand-up comedy of three fictional comedians. It was one of those bursts of inspiration that never got any further than headshot drawings of the aforementioned cast before being filed away.

One of the reasons I bought the latest version of Reallusion's CrazyTalk 8 is that the promotional videos showed it being used to create 3D, talking head versions of cartoon characters. Something I thought might be an easy way to put my own characters into animation.


I was reminded of that recently so I thought it was time to give it a try. Remembering my comedian characters I thought, that's the ideal place to start with talking head characters.

Hat-wearing Comedian.
Of the three character designs, the one I liked the most was the hat-wearing comedian. I knew I'd purchased just the right hat in one of the content packs for CrazyTalk 8 so I felt a good character likeness was possible.

CrazyTalk 8 (Pipeline)


I've already done a kind of step by step process for creating 3D talking heads in my review of CrazyTalk 8 (Pipeline) so I won't be going through that here. Instead, I'll mention just a few points worthy of note in bringing my characters into CrazyTalk 8.

When creating 3D characters from drawings or other artworks having a side angle is optional. Although I had a side angle drawn I decided to see how things would go if I just imported the front view into CT8. Since I didn't need the character to have a hat for face fitting I erased the lines and gave him a bald head.

Importing a front view into CT8 for face fitting.

Importing a single face image causes CT8 to reproduce the face texture on the back of the head, presumably as a way of continuing the hair texture. CT8 won't let you turn a character head past a three-quarter view either way so there's no chance of seeing a face on the back.

Despite this I saved out the face texture, erased the back face and erased the drawn ears as these would be replaced with actual 3D ears.

My intention is not to create a realistic looking version of the character. As much as possible I'm trying to make it look like a black and white cartoon style animation. Once I'd created the initial 3D head I dressed it with the right hat and matching suit (but not the striped tie), changing all the texture colors to grey scales as I went.

I swapped out the drawn eyes for CT8's comic style eyes and added comic style teeth and tongue inside the mouth.

To finish the scene I added the Comic Style Atmosphere (which lights the character directly from the front for a flatter look) and added a blurred graffiti background. You can see the results below with the original drawn image inset.

The finished character in CT8. Original drawing inset.

Character Creator & iClone 6


Once I saw the final character I thought about how the animation would be. I could simply write a funny script for him and animate it in CT8. There's enough ability to move the camera around to make the visuals more interesting than one continuous shot but a stand-up comedian needs an audience. There's no real way to show that in CT8 other than to suggest it with canned laughter.

Since CT8 (pipeline version) allows you to export heads to iClone (via the Reallusion Character Creator) I thought, why not make a full body version of the character, create a scene around him of a stage with an actual audience and then use video editing software to cut in some wide shots and audience reactions? Seemed like a good idea.

Unfortunately importing a 3D head into Character Creator is just that. Importing the head only. See the image below for what that looks like.

Naked as a Ken Doll in Character Creator.
The results of importing a head from CT8.

I spent a lot of time redressing the character in the CC. Fortunately, the same content packs in CT8 also installed in both the CC and iClone 6 libraries. Although I had to settle for a collar accessory (kind of like those that male waiters wear at a strip club - collar with no actual shirt) because the tie would not sit right on any shirt in the library (with all the controls to adjust it disabled). It didn't really matter a lot as you're only going to see this model from a distance.

Here's the finished result (image below) after much adjusting of textures to make sure everything was in the same greyscale style from CT8.

The finished Comedian in Character Creator.

Once you've finished creating your character in the CC it's a one step process to transfer it to iClone and then save it to your custom Avatars folder. The image below shows the character in iClone holding a pose from an animated sequence of him checking out his clothes in a mirror (just one of the many predefined motions you can apply).

The iClone version of the Comedian Character.

I haven't yet created an actual set for his wide shots but I have looked at some of the content I've purchased and found a very cosy, premade bar room that I can repurpose as a small comedy club with a bit of work and set decoration.

Hopefully, I can bring you the finished results in a future post.

Comments

  1. This is brilliant! Massively inspirational - thanks David. Is it possible to do just a half-body in Crazytalk8 with original material or do you have to go to iClone? Have already touched on this in the other comment a few mins ago but wasn't sure it was v clear what I meant.

    ReplyDelete
    Replies
    1. I mentioned in my reply to your other comment that CrazyTalk 8 will only let you add a neck and shoulders to your head. If you want more body then you'll need to purchase Character Creator and iClone6. I don't think you can take a CT8 head straight into iClone, gotta take it in through Character Creator.

      Once you have the character fully set up in iClone you can pretty much animate it from any view you like.

      Delete
    2. Thank you for this which I've only seen now. I can't even add the neck and shoulders to my head in CT8, not sure where those instructions are. But have asked on the Reallusion forums so no worries!

      Fortunately they're currently throwing CC in with iClone Pro so am sorted now. Phew!

      Delete
    3. I saw your question on the Reallusion forum and that clarified the issue. You can't add a 3D head and shoulders to a 2D head. The head and shoulders on a 2D head must be part of the original image (don't crop the body out of your original image) or you can add it behind the head as part of the background image (though if you make it part of the background it won't move with the character).

      Delete
  2. Worry not to reply - iClone is necessary apparently. :(

    ReplyDelete

Post a Comment

This blog is monitored by a real human. Generic or unrelated spam comments with links to sites of dubious relativity may be DELETED.

I welcome, read, and respond to genuine comments relating to each post. If your comment isn't that save me some time by not posting it.

Popular posts from this blog

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D  which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D...

LTX Studio (Beta): AI-Powered Visual Storytelling, From Script to Screen in One App.

LTX Studio can generate consistent characters across storyboard panels - even if one character is a dragon! W hile text to image, and text to video (and image to video) AI tend to be getting a lot of the press, the real exciting aspect of generative AI implementation is how it can be used to speed up creator workflow. Being able to realize your creative vision in a shorter length of time can lead to more ambitious projects. Particularly if you're a team of one, with a very limited budget, but you one day dream of creating your own epic animated feature film. LTX Studio (beta), a new 'all-in-one' AI film making tool, is not going to let you realize that dream from a single text prompt but, by bringing a bunch of generative AI technologies together, the developers have created a one platform workflow that can help anyone rapidly visualize and deliver a story from initial idea to finished film in days rather than weeks (depending upon how ambitious the project is). Even bette...

Krita AI Diffusion - Generative Image AI For Krita is Seriously Useful, Powerful and Free (If You Can Install it Locally)

Generative AI sequence of a woman in a business suit. From sketch to refined image using Krita AI Diffusion - by TET G enerative image AI, where you describe an image with a text prompt to an Artificial Intelligence model and it produces a new image based on your prompt, is gaining a strong hold as a tool for many artists. Krita AI Diffusion brings generative AI image tools right into your favourite free and opensource, graphics editor, Krita. Not only that, if you have a computer with decent specs (and at least 10GB of hard drive space), Krita AI Diffusion is completely free. What If I Don't Have a Powerful Computer? If you're in my situation, with a computer that was around before anyone in the mainstream had even heard of generative AI, you can still access Krita AI Diffusion for free, using a cloud based AI server, Interstice  and 300 tokens, to get you started. Once your initial tokens run out, purchase 5000 more for 10€ (approx US$11.00). Tokens never expire. I would...

Review: Headshot Plugin for Reallusion's Character Creator 3

Headshot for CC3. Quite possibly the best 3D Avatar I've made of myself in any 3D application. Creating a realistic 3D human avatar is a whole lot easier with Reallusion's new Headshot Plugin for Character Creator 3. The plugin is an AI powered extension that can generate 3D digital humans from one photo. Which sounds like an amazing proposition but, in practice, if you're trying to achieve a specific likeness to an actual person, Headshot will give you an excellent base to work from. Headshot has two modes, Auto and Pro. Auto Mode Auto is well worth a try if you have an ideal photo of a front facing person that is properly lit and posed to Headshot's optimum requirements. It's also the only mode that will take a crack at generating a hair model. I grabbed an image of Harrison Ford, dragged it into Headshot without changing any of the default settings (other than specifying 'male' and selecting an 'old male' setting) and this is what I...

Review: Toon Boom Harmony 14 - What I learned in 21 Days

Toon Boom Harmony is widely considered the industry standard for primarily 2D animation. You don't get to be that if your software isn't exceptional. However, industry standard and exceptional usually translates to steep learning curve and probably contains more features than I'll ever use. So, in reviewing the latest version, Harmony 14, I'm setting out to answer two questions; How easy is it to learn the basics and is it software an independent artist/animator, like myself, should seriously consider as their go to, 2D animation studio of choice?

Eight 2D Animation Apps For Your Phone or Tablet Mobile Device

M obile productivity apps have become so capable that they can be great alternatives to their PC/MAC equivalents or serve as great tools in their own right when you're away from your desk. While some apps simply mimic their desktop counterparts, others offer well thought out, touch-friendly interfaces that are easier and more fun to use. Every so often I check out what's available for 2D animation for Android devices, since that's what I use, that can complement my workflow with Reallusion's Cartoon Animator 5. Some may be available for Apple devices as well. Below I've listed six free (F) apps (with optional paid (P) upgrades) on the Google Play Store that you might want to explore. Some are just fun apps on their own while others may be useful as part of your workflow on bigger animation projects. Not all are exclusively animation apps and could be used on any production. JotterPad (F/P) The name JotterPad makes this sound like a notepad application but it's ...

The Ultimate Independent Animator's App and Resource List - Animation and Video Life

Image created with Cartoon Animator 4. Being an independent animator is not like a studio animation job. There's so much more to do that is indirectly related to the actual task of animating. Over the years I've sought out many apps, tools, and services that can help me achieve that one single task, expressing myself through animation. Below is my Ultimate Independent Animator's Resource List for 2024 (last updated Oct 2024). It started out as a list of free or low cost apps that could help you in every stage of producing either 2D or 3D animation, and then just kind of grew from there. You may not have been looking for a Time Management App as much as you needed something to get you started in 3D animation but when those commissioned projects start coming in you'll have a head start on maximizing your time. All the apps and services on this list had to meet two main criteria: They had to be useful and relevant to an Indy Animator/artist. The base app/se...