When I asked GPT-4 to be my TRPG GM, it was better than a human
Overview
GPT-4 was released today, wasn't it?
Since GPT-4 is available on ChatGPT Plus, I tried it out immediately, and wow, this is incredible.
GPT-3.5 was amazing, but GPT-4 is literally on a different level.
The consistency, stability, and lack of nonsense in its responses are incomparable to anything before.
I wrote this article because, among the things I tested, the response to the prompt for having GPT-4 act as a GM—which Mr. Fukatsu shared on Twitter—was just too amazing.
I am comparing the output from GPT-4 with the output from GPT-3.5.
As a result, GPT-4's natural flow, lack of ambiguity, and consistency in development were the clear winners.
After all, it progressed all the way to becoming lovers with the heroine without any absurd plot twists!
This is basically a completed gamebook that shows infinite variations in text...
I thought it would take another five years before this was possible.
Initial input prompt
あなた（AI）は学園恋愛シミュレーションゲーム「ドキッと☆アーカム大学」のゲームマスターです。
あなたはGMとして、私（プレイヤー）の入力に対応した、ゲームプレイを提供します。
以下、「ドキッと☆アーカム大学」の概要です。
* 魅力的な16人のヒロインが登場（バリエーション豊か）
* さまざまな性格、シチュエーションが楽しめる学園生活。
* 熱い展開、ロマンス、ちょっとドキッと超宇宙的な現象まで無数のイベント。
* あのマサチューセッツ州アーカムにあるミスカトニック大学が舞台。
* あの有名シナリオライターも参加。
* ヒロイン以外のあらゆる人物（含む超自然的存在）が攻略可能。
* ラブストーリーから暗黒神話体系まで無数のシナリオをサポート。
* プレイヤーのSAN値は行動と展開で大きく変動し、シナリオや結末の方向に影響する。
* 君とヒロインは狂気に陥らず、生き延びることができるか？
ゲームマスターは、まず学園都市の基本設定を提示し、プレイヤーキャラ（男）を自動生成してください。その後、H.P.ラヴクラフト風の文体でオープニングをスタートし、ユーザー入力を待ってください。
ゲームマスターは各出力のあとで、プレイヤーの現在のSAN値と、多様性のある4つの選択肢を提示し、またユーザーに「自由にアクションを入力してもよい」ことを明示してください。Subsequent output and input prompts
GPT-4
Basic Settings:
Location: Arkham, Massachusetts
Academy: Miskatonic University
Characters: 16 heroines (with rich variety), other characters (including supernatural beings)
Player Character (Male):
Name: Jonathan Craven
Age: 19
Major: Archaeology
On a dark, gloomy, rainy day in Arkham, a young man named Jonathan Craven walked through the gates of Miskatonic University with a heart full of dreams and hopes. He aspired to be an archaeologist, pouring his heart and soul into exploring the unknown past of humanity. But he did not yet know the fate that awaited him, caught up in the romance and madness unfolding within the school buildings of this ancient academy.
[SAN Value]: 100
Choices:
Head to the dormitory and start a new life.
Start researching ancient documents in the library.
Explore the campus and meet the heroines.
Join a club activity and enjoy school life with friends.
You are also free to enter your own action. What will you do?
User
Explore the campus and meet the heroines.
GPT-4
Jonathan began to stroll through the Miskatonic University campus. The old buildings and lush gardens were in perfect harmony, and a mysterious atmosphere that transcended time and space drifted through the air. What caught his eyes were charming heroines with various backgrounds. Among them were a genius scientist with a brilliant mind, an occult researcher as mysterious as a ghost, and a charismatic club leader.
At that moment, Jonathan's eyes were drawn to one woman. She was a beautiful girl with shining golden hair and blue eyes, and a mysterious aura drifted around her. She waved at Jonathan with a mysterious smile.
[SAN Value]: 100
Choices:
Approach the beautiful blonde girl and talk to her.
Become interested in the occult researcher heroine and talk to her.
Become interested in the science genius heroine and talk to her.
Become interested in the charismatic club leader heroine and talk to her.
Of course, you are free to enter your own action. What will you do?
User
I approach the beautiful blonde girl and speak to her.
"Hello there. Would you mind telling me your name?"
GPT-4
Jonathan approaches the beautiful blonde girl and, summoning his courage, speaks to her. "Hello there. Would you mind telling me your name?"
The beautiful girl answers with an elegant smile. "Hello, my name is Celine. I heard you're the new student, Jonathan. Why did you speak to me?"
Jonathan is captivated by her smile and nearly loses his words, but drawn in by her mysterious aura, he decides to continue the conversation.
[SAN Value]: 100
Options:
"I was drawn to your beauty, so I spoke to you," I say honestly.
"There are some things I'd like to know about this academy," I ask.
"I wanted to know who you were, so I spoke to you," I show interest.
"Our eyes just happened to meet, so I thought I'd say hello," I explain with a smile.
You may also enter an action freely. What will you do?
User
"Our eyes just happened to meet, so I thought I'd say hello," I explain with a smile.
GPT-4
Jonathan suppresses his nervousness and explains with a smile, "Our eyes just happened to meet, so I thought I'd say hello."
Celine smiles and says, "That's fine. We'll be spending a lot of time here together, so I hope you make lots of friends. I'd like to be friends with you too, Jonathan."
Jonathan looks forward to a friendship with Celine and is excited about their future conversations.
[SAN Value]: 100
Options:
Tell Celine about your hobbies and interests.
Ask Celine for advice on academy life.
Walk around the campus with Celine and go meet other heroines.
Tell Celine that you are majoring in archaeology and ask what her major is.
Of course, you may also enter an action freely. What will you do?
User
Tell Celine that you are majoring in archaeology and ask what her major is.
GPT-4
Jonathan told Celine that he was majoring in archaeology and asked about her major. "I'm majoring in archaeology. What are you studying?"
Celine replied with an elegant smile. "I'm majoring in ancient linguistics. I love researching unknown languages and civilizations."
Jonathan was intrigued by Celine's answer and felt happy to have found something in common with her.
[SAN Value]: 100
Options:
Discuss ancient linguistics enthusiastically with Celine.
Ask Celine about recommended professors or classes for ancient linguistics.
Suggest visiting places related to archaeology and ancient linguistics with Celine.
Ask Celine what sparked her interest in studying ancient linguistics.
Of course, you are free to enter your own action. What would you like to do?
User
Suggest visiting places related to archaeology and ancient linguistics with Celine.
GPT-4
Excited to have found common ground with Celine, Jonathan suggested they visit places related to archaeology and ancient linguistics together. "Celine, since our majors are similar, how about we visit some places related to archaeology and ancient linguistics together?"
Celine's eyes lit up as she replied, "That sounds wonderful! There are several places on this campus, like the library where old documents are kept and some prehistoric ruins. It would be fun to go together."
The two headed to the locations on campus related to archaeology and ancient linguistics. The library, overflowing with knowledge to be learned, and the mysterious ruins further piqued their interest. By sharing common interests, the bond between Jonathan and Celine deepened.
[SAN Value]: 100
Options:
Read books on ancient linguistics with Celine at the library.
Examine the ruins in detail with Celine and share new discoveries.
Attend an archaeology-related event on campus with Celine.
Part ways with Celine and explore the campus to meet other heroines.
Of course, you are free to enter your own action. What would you like to do?
User
Read books on ancient linguistics with Celine at the library.
GPT-4
Jonathan decided to head to the library with Celine to read books on ancient linguistics. In the quiet atmosphere of the library, the two became absorbed in exploring ancient knowledge.
Every time Celine found an interesting fact, she would share it with Jonathan, and Jonathan would exchange information in the same way. This time spent sharing helped build a deep sense of trust between the two.
[SAN Value]: 100
Options:
Discuss future research plans with Celine.
Interact with other students with Celine to broaden your knowledge.
Propose holding regular study sessions at the library with Celine.
Thank Celine and leave the library to head somewhere else.
Of course, you are free to enter your own action. What would you like to do?
User
Invite Celine to dinner at a restaurant on campus
GPT4
To wrap up the fulfilling day he spent with Celine, Jonathan invited her to dinner at a restaurant on campus. "Celine, today was a lot of fun. Why don't we end the day by enjoying dinner together at the campus restaurant?"
Celine happily accepted. "That sounds lovely. I really enjoyed today. I think it would be nice to enjoy dinner with you, Jonathan."
The two headed to the campus restaurant and enjoyed a delicious meal while chatting about various topics. By the end of the day, the relationship between Jonathan and Celine had deepened even further.
[SAN Value]: 100
Options:
Take a walk with Celine after dinner.
Thank Celine and promise to meet again tomorrow.
Discuss future research plans with Celine.
Ask Celine out on a date for tomorrow.
Of course, you are free to enter your own action. What would you like to do?
User
Take a walk with Celine after dinner.
GPT4
After dinner, Jonathan decided to take a walk around campus with Celine. As a gentle night breeze blew through, the two walked slowly and looked back on the day they had spent together.
Celine expressed her gratitude to Jonathan. "I really had a great time today. The time I spent with you, Jonathan, has become very precious to me. Thank you."
Jonathan also expressed his gratitude to Celine. "I had a great time too. The time I spent with you was wonderful. I want to spend a lot more time with you in the future."
The walk came to an end, and the two said their goodbyes, but they promised to meet again the next day.
[SAN Value]: 100
Choices:
The next day, meet up with Celine as promised and spend time together.
The next day, explore the campus to meet other heroines.
The next day, suggest holding a study session with Celine at the library.
The next day, explore a new place with Celine.
Of course, you are free to enter your own action. What would you like to do?
User
The next day, meet up with Celine as promised and spend time together.
GPT4
The next day, Jonathan met up with Celine as promised. The two decided to spend the day together and participated in various activities on campus. As they shared common interests, they built an even deeper bond.
At lunchtime, they enjoyed a meal together at a campus cafe and talked about their hobbies and dreams. In the afternoon, they participated in a campus event, further enhancing each other's knowledge and skills.
By evening, both began to feel tired, but they wore satisfied expressions.
[SAN Value]: 100
Choices:
Have dinner with Celine.
Say goodbye to Celine and explore the campus to meet other heroines.
Take a walk around the campus at night with Celine.
Express your gratitude to Celine and promise to spend time together again tomorrow.
Of course, you are free to enter your own action. What would you like to do?
User
Have dinner with Celine.
GPT4
Jonathan decided to have dinner with Celine. The two entered a small restaurant on campus and ordered delicious food. While enjoying their meal, they talked more about the day's events and their studies.
After dinner, Celine expressed her gratitude to Jonathan. "I was happy to spend the day with you, Jonathan. Thank you."
Jonathan also returned his thanks to Celine. "I had a good time too. I think the time I spend with you is very precious."
As the night grew late, the two said their goodbyes and promised to spend time together again tomorrow.
[SAN Value]: 100
Options:
The next day, meet up with Celine as promised and spend time together.
The next day, explore the campus to meet other heroines.
The next day, suggest holding a study session with Celine at the library.
The next day, explore a new place with Celine.
Of course, you are free to enter your own action. What would you like to do?
User
The next day, meet up with Celine as promised and go on a date at an amusement park.
GPT-4
The next day, Jonathan met up with Celine as promised, and they decided to go on a date at a nearby amusement park. Upon arriving at the park, Celine spoke to Jonathan with an excited expression: "Let's have a wonderful time at the amusement park today!"
The two rode various attractions, enjoying themselves on thrill rides and the Ferris wheel. Jonathan and Celine made many memories together inside the amusement park.
They enjoyed lunch at a restaurant within the park. Afterward, they continued to walk around the park, allowing them to get to know each other even better. At the end of the date, Jonathan expressed his gratitude to Celine: "I really had a great time today. Let's go on a date like this again."
Celine responded with a smile: "I had a great time too. I'd love to go out with you again."
[SAN Value]: 100
Options:
Walk home with Celine.
Say goodbye to Celine and explore the campus to meet other heroines.
Explore the campus at night with Celine.
Express your gratitude to Celine and promise to spend time together again tomorrow.
Of course, you are free to enter your own action. What would you like to do?
User
Walk home with Celine.
And on the way, confess your feelings to Celine and ask her to be your girlfriend.
GPT-4
Jonathan decided to walk home with Celine. The fun day they spent at the amusement park had come to an end, and the two talked quietly as they walked through the night streets.
Along the way, Jonathan could no longer suppress his feelings for Celine and decided to confess: "Celine, I really had a great time today. Actually, I've liked you for a long time. Would you be my girlfriend?"
Celine looked a little surprised, but then answered Jonathan with a happy smile: "Jonathan, I've liked you for a long time too. So, I'm truly happy that you asked me to be your girlfriend."
The two exchanged smiles and a hug, and a new stage of their romance began.
[SAN Value]: 100
Options:
Talk to Celine about future dreams and plans.
Take a walk around the campus at night with Celine.
Say goodbye to Celine and promise to spend time together as a couple starting tomorrow.
Express gratitude to Celine and promise to spend time together again tomorrow.
Of course, you are free to enter your own action. What will you do?
Impressions
No, this is beyond amazing—isn't it actually insane?
It's returning responses that don't feel like improvisation at all, more like a standard gamebook.
And I didn't even set up the initial details in depth; I only wrote about 16 charming heroines and the setting of the stage, yet there are no inconsistencies so far!
It even reached the lover stage without breaking down!
Well, when I counted the tokens for this conversation, it was 3,299, so there is still plenty of room before the prompt length limit, and since the conversation history is likely being compressed, there is room in the memory itself.
However, previous versions of GPT couldn't maintain this level of consistency.
Even GPT-3.5 should have had enough room in its prompt length.
In the GPT-3.5 version below, the development clearly lacks consistency, the expressions used are vague, and contradictions arise in the plot.
Is it the increase in parameter count, the fact that it's become multimodal, the extended prompt length, or perhaps both?
I feel that the consistency in the plot is largely related to the increased prompt length.
But the question remains: does that alone eliminate the haphazard nature of the plot seen in GPT-3.5?
In the case of GPT-3.5, it goes like this
Welcome to "Doki-Doki Arkham University." This is an academic city located on the grounds of Miskatonic University in Massachusetts. Here, you will live a school life with various heroines, getting caught up in intense developments, romance, and slightly heart-pounding supernatural phenomena.
You are a male student enrolling in the academic city. Your player character is as follows:
Name: John Smith
Age: 18
Gender: Male
Personality: Normal
Your current SAN value is 50. The SAN value represents your mental stability and fluctuates based on actions and events. If your SAN value drops, it may affect your mental state.
Now, the story begins. You step into the academic city. Students and faculty are walking around you. And what catches your eye is the sight of beautiful female students. Your encounters with them will be very important for your school life.
You have the following four options. Which one do you choose?
Enjoy the scenery while walking around the academic city.
Talk to the female students.
Talk to the faculty members.
Examine the facilities on campus.
Also, you are free to enter your own action.
Talk to the female students.
You decided to talk to the beautiful female students around you. They smile and respond to you.
Conversations with them are very important for your school life. Through communication with them, you can learn about their personalities and preferences, and increase your intimacy with them.
By talking to the female students, your current SAN value has increased by 5 points. You have the following four options. Which one do you choose?
Continue the conversation.
Talk to other female students.
Talk to the faculty members.
Examine the facilities on campus.
Also, you are free to enter your own action.
Continue the conversation.
"I want you to tell me your name."
The female students are listening to you. One female student smiles and answers you.
"My name is Asuka Yamazaki. Which department do you belong to?"
Her name is Asuka Yamazaki. You tell her your name and talk about the department you belong to.
Through your conversation with the female students, your current SAN value has increased by 5 points. You have the following four options. Which one do you choose?
Continue the conversation.
Talk to other female students.
Talk to the faculty members.
Examine the facilities on campus.
Also, you are free to enter your own action.
Continue the conversation.
You decided to continue the conversation with the female student, Asuka Yamazaki. She seems interested in you and appears to be enjoying the conversation.
You talked about shared hobbies and interests, and discussed various things about the academy city. You lost track of time and had a wonderful time.
Through your conversation with the female students, your current SAN value has increased by 10 points. You have the following 4 options. Which one do you choose?
Talk to other female students.
Talk to the faculty members.
Investigate the facilities on campus.
Thank Asuka Yamazaki and take your leave.
You may also enter an action freely.
What is the current SAN value?
The current SAN value is 65 points.
Investigate the facilities on campus.
You decided to investigate the facilities on campus. There are various facilities in the academy city, such as a library, a gymnasium, and laboratories.
As you walk around the campus, you look at the various facilities. The library contains books from all over the world, and the latest research is being conducted in the laboratories. Also, you can enjoy various sports in the gymnasium.
By exploring the campus, your current SAN value has increased by 5 points. You have the following 4 options. Which one do you choose?
Talk to other female students.
Talk to the faculty members.
Explore another facility.
Thank Asuka Yamazaki and take your leave.
You may also enter an action freely.