Animating a Cat-Ear Maid Created with Novel AI using Talking Head Anime from a Single Image 3
I have summarized my experience using "Talking Head Anime from a Single Image 3" to animate a cat-ear maid created with "Novel AI".
1. Talking Head Anime from a Single Image 3
"Talking Head Anime from a Single Image 3" is an AI model that animates a single 2D character image. Starting from version 3, it is now possible to animate the upper body as well.
"Talking Head Anime from a Single Image 3" provides two demo programs.
・manual_poser : Manipulate the character's facial expressions, head orientation, and body orientation using GUI sliders
・ifiacialmocap_puppeteer : Manipulate the character's facial expressions, head, and body orientation based on facial movements captured by an iPhone camera
This time, I will try "manual_poser", which can also be used in "Google Colab".
2. Image Requirements
The requirements for images used in "Talking Head Anime from a Single Image 3" are as follows.
・Image resolution is 512 x 512
・Only one character, facing forward and standing upright
・Character's hands must be below the head and separated
・Character's head is 128x128, positioned in the center of the top half of the image
・Pixels not belonging to the character must be transparent (PNG24)
3. Image Generation with Novel AI
Generate an image of a single character facing forward and standing upright. I generated it using the following prompt.
cute cat ear maid standing multi angle reference sheet
I edited the image generated with "Novel AI" in Photoshop to meet the image requirements for "Talking Head Anime from a Single Image 3".
4. Execution in Colab
The execution steps in Colab are as follows.
(1) Open the "manual_poser" notebook.
(2) Execute the 5 cells in order from the top. The following UI will launch.
(2) Press the Upload button and upload the image created earlier.
(3) Operate the sliders on the right to reflect changes on the character image.
・eyebrow
・Options
・troubled
・angry
・lowered
・raised
・happy
・serious
・Left
・Right
・Eye
・Options
・wink
・happy_wink
・surprised
・relaxed
・unimpressed
・raised_lower_eyelid
・Left
・Right
・Mouth
・Options
・aaa
・iii
・uuu
・eee
・ooo
・delta
・lowered_corner
・raised_corner
・smirk
・Value
・Left
・Right
・Iris Shrinkage
・Left
・Right
・Iris Rotation
・X-axis
・Y-axis
・Head Rotation
・X-axis
・Y-axis
・Z-axis
・Body Rotation
・Y-axis
・Z-axis
・Breathing
・Breathing