Reiji Kuga's Monologue Act 5: Streamlined Production Methods and New Challenges

*This article is protected by copyright, and unauthorized AI training or reuse is prohibited.

Hello, this is Reiji Kuga.

In this "Monologue," I will talk about the behind-the-scenes of the metaverse drama "Crossroad" that we at PROJECT ALIVE are producing, as well as our new recording methods.

The most difficult part of the video production process was the task of syncing the voice actor's audio with the lip movements in the video. However, after much trial and error, we finally found an efficient way to do it!

This method has significantly reduced editing time and led to an improvement in quality.

Furthermore, I will also share the latest information on the "New Crossroad" starting in the spring of 2025. Please stay with me until the end.

You can read the previous Act 4 here 💁

The production site of "Crossroad" and the challenge of new recording methods

Video production challenge: The difficulty of syncing audio and lip movements

At the "Crossroad" production site, video editing was our biggest challenge. In particular, the task of syncing the voice actor's audio with the lip movements in the video was time-consuming and labor-intensive, and it was one of our biggest headaches.

Previously, Juria Aozuki, who serves as both cameraman and actor, would read the script, and I (Reiji Kuga) would record my voice afterward to match those movements.

However, with this method, it was difficult to perfectly match the pauses and timing, which was the cause of the massive amount of editing work.

New recording method/Playing audio data within cluster

After repeated trial and error, we introduced a new recording method. That is, playing the voice actor's audio data in advance within cluster and acting along with that audio.

Specific steps
1. Record the audio data from the voice actor first. 2. Upload that audio data to a file within cluster and play it as BGM. 3. I speak my lines in real-time to match the audio.

This allowed me to act while naturally sensing the voice actor's tempo and pauses. Since the audio and video are almost perfectly synced during editing, the work time has been significantly reduced.

Practice in Episode 6: Significant reduction in editing time

As a result of recording Episode 6 with the new method, editing progressed many times faster than before.

Specifically,
• syncing audio and video has become much easier.
• Editing time has been significantly reduced, allowing me to dedicate time to other tasks (such as improving acting quality).

Thanks to these improvements, the workload for myself (Reiji Kuga) and Juria Aotsuki has decreased, enabling a shorter release schedule.

Two Years of Challenges and Gratitude for Crossroads

"Crossroads" began with smartphone filming, moved on to the introduction of VR goggles, and went through trial and error in video editing to reach where it is today.

A total of over 50 voice actors, artists, and world creators have been involved, and over 40 worlds within cluster served as the stage. Once again, I am grateful to everyone.

Winter 2025: The "New Crossroads" Begins

Changes
1. Fully original avatars
We are creating new avatars to clear up copyright and rights issues.

2. Renewal of the theme song
We are welcoming new lyricists, composers, and singers to further enhance the world of the work.

3. Introduction of full-body tracking
Evolving from conventional 3-point tracking to full-body. Being able to move the entire body allows for natural movement and acting expression.

Summary / Toward the Future of Crossroads

The "New Crossroads" will restart in the winter of 2025 with even higher quality. Leveraging the trial and error in cluster and experience gained so far, we will deliver the best work to our viewers.

I hope that "Crossroads" will become a catalyst for someone's dreams or opportunities. Thank you for your continued support.

Click here for Reiji Kuga's Monologue Acts 1 through 4