[For Pollo AI Beginners] Avoid Garbled Japanese: The Key is Short Prompts

Currently, there are two video contest events in collaboration with Pollo AI.

Naoyuki's Favorite Video Contest - Ends 6/11!

PolloAI x Shironen Contest - Ends 6/10!

I've already finished my entries, so I'm feeling relaxed and carefree lol

In that mood, I was looking at other people's work and noticed something.

1️⃣ Realization

Hmm, I see, everyone is having a lot of garbled text when creating videos. This often happens when generating images with AI, right? Especially with Japanese.

I thought, 'When I created mine, the Japanese got garbled, so I used short English phrases instead,' but then something caught my attention and I started questioning myself.
*Click here for the article from when I created the video ⬇️

🍤 Brainstorming Meeting

In other words, I hypothesize that the AI is overwhelmed by too much information, causing the text to garble.
🐟 When I checked with Sakana Chat, it said there are other factors as well.

モデル：日本語対応やテキスト描画に強いモデルかどうかで、文字の安定性が大きく変わります。

プロンプト：英語で書く・テキスト表示を明確に指示する・過剰な指示を避けることで、崩れにくくなります。

言語特性：英語は比較的安定、日本語（特に漢字）は崩れやすいという学習データの偏りがあります。

So, I'm starting a verification process by trimming the prompts.
Huh? Wasting credits??
It's okay, I still have over 500 credits left.
It's my favorite kind of verification, you know?
Verification has to come first, obviously lol!

2️⃣ Verification

🍤 Creating a video from a character sheet and storyboard

First, I'll try the basic procedure.
Creating from a character sheet and storyboard. The prompt also includes the message for the last cut: 'Welcome to my note page. You are welcome.'

Terina jumps out from the character sheet, and there's mysterious language lol
Don't be fooled just because it's cute!

🍤 Keep the prompt as is, change the image to only the starting cut

I'll strip away the storyboard input information and try specifying the final message '...welcome' in the prompt.

Why is the dialogue in the last cut so short lol?

🍤 Keep prompts short

🐟 Sakana Chat created a long English prompt for me, but I cut it down drastically lol.
I made it a short prompt, about 1.5 lines in Japanese.

A mix of Chinese and Japanese?
Did it get a little closer??

🍤 Trim the Japanese in the final cut

Since it has trouble processing Japanese, specify short phrases.
How about just "Welcome"?

So close!
What do you mean "Yorikoso" lol?
And the dance is a Bon Odori dance lol

🍤 Use images to instruct the final cut

Use "Create video from reference" and register the first and last cuts as images.
Treat them as images so the AI doesn't try to recognize them as text and crash. We're tricking the AI by treating it purely as a design lol.

Super close!
The text in the first cut disappeared!!
We're one step away, so let's recreate it ⬇️

KITA core!!
We did it, everyone!
This is enough to make the whole country cry 😭

📌 Summary

If you want to include Japanese in AI videos, paying attention to the following points seems to reduce the likelihood of the text getting garbled.

• Do not have the AI perform complex movements or processing at the same time as displaying messages. Combine them later using separate processing.

• Treat Japanese as part of the design. Do not let the AI recognize it as text.

• Add Japanese later using different software.

Even though it's Pollo AI, it's still an AI, so I should have just used the same mindset as with ✨Gemini.

🍤 Recipe for Japanese that didn't get garbled

1. Prepare the first cut imageandthe last cut imageas well.

2. In Pollo AI, select "Video from Reference," choose your preferred AI model, and set the two images from step 1.

3. Enter the prompt below.

How was it?
See, creating videos looks fun, right?
Don't you want to try it yourself?
There's still time, so why not give it a shot now?
You can even get credits.
Your note articles will level up too!!

*I verified this and wrote the article in a huge rush while commuting to and from work, so it might be a bit rough💦
I did my best, didn't I? Someone please praise me lol