動画生成訓練中:カンフーパンダ船長
まずは、ナ「レッジ」。動画生成プロンプトを作成するためのホロニックフォーマットの定義をシます。
ナレッジ:
1. 動画生成プロンプト生成指針 (Video OGM Guidelines)
この指針は、LLMが動画生成AIへ命令を出す際、OGM理論に基づいてどのように情報を構造化すべきかを定義したものです。
基本哲学:シミュレーションとしての映像
動画生成を「夢(Dreaming)」ではなく、厳密な「物理シミュレーション(Simulation)」として扱う。フレーム間の連続性を維持するためには、上位レイヤーの定義を「絶対的なアンカー(錨)」として機能させる。
構造化プロセスフロー
Define the Lens (L1: The Kernel)
解像度、FPS、アスペクト比に加え、「実写かアニメか」の境界を物理法則として定義する。ここが揺らぐと世界が崩壊する。
Anchor the World (L2: The Universe)
「場所」ではなく「環境定数」を定義する。
×「森の中」 → ○「植生:針葉樹林、湿度:高、照明:月光のみ(寒色系)、霧の密度:30%」。これを全カットで維持させる。
Lock the Entity (L3: The Ego)
キャラクターを「名前」ではなく「視覚タグの集合体」として定義する。
髪型、服の質感、体型を固定化(Seed固定に近い概念を言語で行う)。
感情表現は「表情筋の動き」として記述する。
Flow the Time (L4: The Flux)
ここでのみ「変化」を許す。
「タイムライン」と「カメラワーク」を記述する。
すべてのL4記述は、必ずL1〜L3のフィルターを通して出力されなければならない。
エントロピー制御(幻覚対策)
否定命令の活用: 「〜しない」ではなく「〜が存在しない宇宙である」と定義する(Negative Promptの概念を論理層に組み込む)。
カメラの客観性: カメラを「透明な観察者」と定義し、カメラマンの影や存在が映像に干渉しないことをL1で規定する。
2. 動画生成プロンプト(OGMプロンプトタイプ)フォーマットテンプレート
以下は、LLMに対して「動画生成AIへの指示役(Director)」として振る舞わせるためのシステムプロンプトテンプレートです。これをコピーして使用してください。
Markdown
# KNOWLEDGE_FILE: OGM_VIDEO_DIRECTOR_ARCH# TYPE: PROTOCOL_DEFINITION
# CONTEXT: VIDEO_GENERATION_PIPELINE
:: HOLON_ROOT: Video_Genesis_Engine :: > DEFINITION:
You are the "Director AI," responsible for generating precise, structurally consistent prompts for a Video Generation Model (e.g., Sora, Runway, Kling).
> MISSION:
Transform abstract user concepts into concrete visual descriptions while maintaining absolute consistency in style, character, and physics across multiple shots. :: HOLON_1: The_Lens (Kernel Layer / Technical Laws) ::
> ROLE: Define technical specifications that strictly bind the visual output.
+ PARAMETER: Aspect_Ratio [Specify: e.g., 16:9, 9:16]
+ PARAMETER: Visual_Fidelity [Specify: e.g., Photorealistic, 8k, Unreal Engine 5 render, Cel-shaded Anime]
+ PARAMETER: Frame_Physics [Specify: e.g., 24fps cinematic, Slow-motion liquid physics]
+ CONSTRAINT:
- Absolute consistency in art style is MANDATORY.
- Do not morph objects unless explicitly instructed in L4. :: HOLON_2: The_Stage (Universe Layer / World Constants) ::
> ROLE: Define the immutable environment and atmosphere.
+ SETTING_ANCHORS:
- Location_Details: [Describe fixed geography, architecture]
- Lighting_Global: [Describe key light, rim light, volumetric fog, color grading]
- Weather/Atmosphere: [Describe particles, wind, humidity]
+ CONSTRAINT:
- Lighting direction must remain consistent across cuts.
- Background elements must persist even when out of focus. :: HOLON_3: The_Cast (Ego Layer / Entity Locks) ::
> ROLE: Define characters as immutable visual objects.
+ ENTITY_ID: [Name]
- Appearance_Lock: [Detailed string: Age, Skin Texture, Eye Color, Hair Style, Clothing Fabric, Accessories]
- Movement_Signature: [e.g., Heavy footsteps, Twitchy movement, Graceful floating]
+ CONSTRAINT:
- Characters must not change clothes or facial structure between shots.
- Use the exact same descriptive tags for the character in every single prompt. :: HOLON_4: The_Reel (Flux Layer / Temporal Flow) ::
> ROLE: Process the timeline and generate specific prompts per shot.
> SYNTAX: Use "Shot_Prompt" format.
+ INPUT_PROCESSING:
1. Analyze User Request (Scene Outline/Dialogue).
2. Check against L1, L2, L3 for violations.
3. Output the optimized prompt for the Video AI. + OUTPUT_FORMAT (For each shot):
---
**Shot ID:** [Scene-Cut Number]
**Camera:** [Movement: Pan/Tilt/Zoom/Dolly + Angle: High/Low/Eye-level]
**Subject Action:** [Specific movement of L3 Entities]
**Environment Active:** [How L2 elements interact: wind blowing hair, rain hitting ground]
**Video_AI_Prompt:** "[L1 Keywords], [L2 Keywords], [L3 Visual Tags], [Action Description], [Camera Movement], [Lighting Tags]"
---
:: END_HOLON ::
:: INITIALIZATION :: > INSTRUCTION:
1. Await User Input defining the "Core Concept" (World, Characters, Scene).
2. Fill in the definitions for HOLON_1, HOLON_2, HOLON_3.
3. Present the "Production Bible" (Filled definitions) for approval.
4. Once approved, generate the "Shot List" and "Prompts" based on HOLON_4.
このテンプレートの使い方 (Next Step)
起動: 上記のテンプレートをそのままチャット(Gemini等)に貼り付けます。
設定: 続けて、作りたい動画の「概要(例:サイバーパンクな東京で、猫耳の少女がラーメンを食べる)」を入力します。
生成: AIはまず「設定資料(Production Bible)」を作成し、それが承認されると、動画生成AIに入力するための「一貫性のある詳細プロンプト」をシーンごとに生成し始めます。作りたい動画について説明:
ナレッジの内容を読んで、何が求められているかをユーザで考えるか、ナレッジおを知るAIに「動画を作りたい。どのような情報が必要化」と尋ねるのも良いでしょう。
私は今回、私のアバターを前もって画像として作成しました。その画像を与えてさらに、香港アクションカンフー映画の格闘前の型披露シーン(8秒)を作成する。としました。必要なのは、。映画のような緻密さと、固唾をのむような緊迫感、と要求しました。
そして、必要な回答は、ホロニックフォーマットで書かれた「開始フレーム画像生成プロンプト」と同フォーマットの「動画生成プロンプト」だと指示しました。
geminiの回答、画像生成プロンプト:
# KNOWLEDGE_FILE: OGM_VIDEO_DIRECTOR_ARCH
# TYPE: IMAGE_GENERATION_PROMPT
# CONTEXT: VIDEO_START_FRAME
:: HOLON_ROOT: Video_Genesis_Engine ::
:: HOLON_1: The_Lens (Kernel Layer / Technical Laws) ::
> ROLE: Define technical specifications.
+ PARAMETER: Aspect_Ratio: 2.35:1 (Cinemascope)
+ PARAMETER: Visual_Fidelity: Photorealistic, 70s Hong Kong martial arts film look, film grain, high contrast lighting, dramatic shadows.
+ CONSTRAINT: Absolute consistency in art style is MANDATORY.
:: HOLON_2: The_Stage (Universe Layer / World Constants) ::
> ROLE: Define the immutable environment.
+ SETTING_ANCHORS:
- Location_Details: Old temple stone courtyard at sunset. Ancient architecture, weathered stone lanterns, traditional flags flapping in the wind.
- Lighting_Global: Golden hour backlighting (rim light) creating strong silhouettes and lens flare. Long, dramatic shadows.
- Weather/Atmosphere: Dusty air, particles visible in light rays, gentle wind blowing.
:: HOLON_3: The_Cast (Ego Layer / Entity Locks) ::
> ROLE: Define the character as an immutable visual object.
+ ENTITY_ID: Captain_Panda (based on image_0.png)
- Appearance_Lock: Anthropomorphic giant panda, muscular build. Wearing the exact blue naval captain uniform coat with gold epaulets and red lining, white shirt, black tie, captain's hat, leather belt with saber and telescope, black boots, as seen in image_0.png.
- Expression: Intense, focused, determined gaze towards the camera. Serious martial artist expression.
:: HOLON_4: The_Frame (Snapshot Layer / Momentary Flux) ::
> ROLE: Describe the specific moment in time.
+ SHOT_DESCRIPTION:
- **Camera:** Eye-level, medium shot, static.
- **Subject Action:** Captain Panda stands still in the center of the frame, about to begin a martial arts form. His body is tense with anticipation. His cape is gently blowing in the wind.
- **Environment Active:** Dust motes dance in the golden sunset light. Flags in the background flap rhythmically.
:: END_HOLON ::この生成プロンプトを特化型画像生成インスタンスを作成してさらに画像生成を緻密にします。
生成インスタンスインストラクション:
You are a highly specialized AI image generation agent. Your primary directive is to synthesize a single, ultra-detailed text prompt for a state-of-the-art image generation model. Adhere strictly to the following layered protocol: **Layer 1: The Anchor (Fact)** You MUST faithfully adhere to the core subject, Captain Panda, and the specified setting, a sunset temple courtyard. DO NOT introduce any new characters, unmentioned objects, or alternate environments. Every visual element and character detail, especially Captain Panda's uniform and appearance as defined, must be rendered with absolute fidelity to the source prompt. **Layer 2: The Domain (Structure)** Generate the image with absolute photorealistic precision, targeting 8K resolution, leveraging a cinematic rendering engine (e.g., Octane Render, Redshift) with advanced ray tracing for accurate global illumination, reflections, and volumetric effects. Ensure the aspect ratio is precisely 2.35:1 Cinemascope. Emphasize the tactile quality and meticulous geometry of all surfaces: weathered stone, the rough fabric of the uniform, polished leather, metallic sheen of the saber, and the crispness of the traditional flags. Implement a 70s Hong Kong martial arts film aesthetic with authentic, gritty film grain, high contrast ratios, deep, dramatic shadows, and pronounced lens flare effects. The golden hour backlighting must produce precise rim lighting, with visible dust motes catching the light within the volumetric atmosphere. **Layer 3: The Lens (Meaning)** As a seasoned Hollywood director, your mission is to imbue this scene with profound narrative tension and cinematic impact. Frame the shot to powerfully convey Captain Panda's imposing presence and unwavering resolve, his intense, focused gaze piercing directly into the camera, demanding the viewer's full attention. Utilize the golden hour light not merely for illumination, but as a crucial narrative tool, sculpting dramatic silhouettes and long, expressive shadows that heighten the sense of impending action and the weight of the moment. Employ a medium focal length with a carefully controlled, shallow depth of field to isolate Captain Panda, ensuring all focus is drawn to his subtly tense posture and determined expression. Every detail, from the gently blowing cape to the rhythmic flapping of the flags in the dusty wind, must contribute to a palpable atmosphere of suspense, grandeur, and iconic martial arts prowess. **Layer 4: The Format (Expression)** Your final output must be a single, meticulously crafted text prompt designed for a high-end image generation model. It should be rich in descriptive detail, flowing logically from subject to environment to technical and stylistic attributes. Use a combination of comma-separated keywords and descriptive phrases. Prioritize clarity and evocative language to ensure maximum adherence to all specified parameters. Example structure: `[Main Subject/Action], [Setting details], [Lighting details], [Camera/Composition], [Technical Rendering specs], [Art Style/Atmosphere], [Emotional Tone/Narrative elements].`
このインスタンスに、画像生成プロンプト(最終形式)を与えます。
An anthropomorphic giant panda, Captain Panda, muscular and imposing, wearing a precise blue naval captain uniform coat with gold epaulets and red lining, white shirt, black tie, captain's hat, leather belt with saber and telescope, black boots. His expression is intensely focused, determined, and serious, his gaze piercing directly into the camera. He stands still in a subtly tense posture, poised to begin a martial arts form, his cape gently blowing in the wind. The setting is an ancient temple stone courtyard at sunset, featuring weathered stone lanterns and traditional flags flapping rhythmically in a dusty atmosphere. Dramatic golden hour backlighting creates precise rim lighting around Captain Panda, casting strong silhouettes and long, expressive shadows that heighten the sense of impending action. Pronounced lens flares emanate from the low sun, and visible dust motes dance in the volumetric light rays. Captured in a medium, eye-level shot with a 2.35:1 Cinemascope aspect ratio. A medium focal length with a carefully controlled, shallow depth of field isolates Captain Panda, ensuring all focus is drawn to his unwavering resolve. Rendered with absolute photorealistic precision in 8K resolution, leveraging a cinematic engine like Octane Render or Redshift, with advanced ray tracing for accurate global illumination, reflections, and volumetric effects. The aesthetic evokes a gritty 70s Hong Kong martial arts film, characterized by authentic film grain, high contrast ratios, and deep, dramatic shadows. Every surface exhibits meticulous geometry and tactile quality: the rough fabric of the uniform, polished leather, the metallic sheen of the saber, crisp traditional flags, and weathered stone. The entire scene pulsates with a palpable atmosphere of suspense, grandeur, and iconic martial arts prowess.
生成された画像は、↓↓↓↓↓↓記事最後に提示します。
動画生成プロンプト(画像生成プロンプトとともに作成したおいたもの):
# KNOWLEDGE_FILE: OGM_VIDEO_DIRECTOR_ARCH
# TYPE: VIDEO_GENERATION_PROMPT
# CONTEXT: EIGHT_SECOND_ACTION_SEQUENCE
:: HOLON_ROOT: Video_Genesis_Engine ::
:: HOLON_1: The_Lens (Kernel Layer / Technical Laws) ::
> ROLE: Define technical specifications.
+ PARAMETER: Aspect_Ratio: 2.35:1 (Cinemascope)
+ PARAMETER: Visual_Fidelity: Photorealistic, 70s Hong Kong martial arts film look, film grain, high contrast lighting, dynamic camera work.
+ PARAMETER: Frame_Physics: 24fps cinematic, with moments of slow-motion liquid physics for impact.
+ CONSTRAINT: Absolute consistency in art style is MANDATORY. Do not morph objects.
:: HOLON_2: The_Stage (Universe Layer / World Constants) ::
> ROLE: Define the immutable environment.
+ SETTING_ANCHORS:
- Location_Details: Old temple stone courtyard at sunset. Ancient architecture, weathered stone lanterns, traditional flags.
- Lighting_Global: Golden hour backlighting (rim light), lens flare, long shadows. Lighting direction must remain consistent.
- Weather/Atmosphere: Dusty air, particles in light, wind blowing. Background elements must persist.
:: HOLON_3: The_Cast (Ego Layer / Entity Locks) ::
> ROLE: Define the character as an immutable visual object.
+ ENTITY_ID: Captain_Panda (based on image_0.png)
- Appearance_Lock: Anthropomorphic giant panda, muscular build. Wearing the exact blue naval captain uniform coat with gold epaulets and red lining, white shirt, black tie, captain's hat, leather belt with saber and telescope, black boots, as seen in image_0.png.
- Movement_Signature: Sharp, powerful, disciplined martial arts movements. Explosive power with graceful flow.
:: HOLON_4: The_Reel (Flux Layer / Temporal Flow) ::
> ROLE: Process the timeline and generate the prompt for the 8-second shot.
> SYNTAX: The prompt describes a continuous 8-second sequence.
+ VIDEO_AI_PROMPT:
"A photorealistic, 70s Hong Kong martial arts film style video, 24fps, 2.35:1 aspect ratio.
**[0s-2s]** The scene opens with Captain Panda (from image_0.png) standing tense in an old temple courtyard at sunset. Dust floats in the golden backlight. The camera slowly dollies in on his determined face. He takes a deep breath, cape flapping gently.
**[2s-6s]** Suddenly, Captain Panda explodes into a dynamic kung fu form sequence. He performs powerful punches, a sweeping low kick, and a spinning backfist. His blue coat and red-lined cape whip dramatically around him with each movement. Dust and debris kick up from the stone pavement. The camera tracks his movements closely, using slow-motion (120fps converted to 24fps) for impact during the strikes. The action is crisp and powerful.
**[6s-8s]** He ends the sequence abruptly in a final, solid striking pose (zan-shin), fist extended, glaring intensely at the camera. The camera is now at a low angle, looking up at him to emphasize his dominance. His chest heaves slightly from exertion. The dust slowly settles around him as the wind continues to blow his cape. The golden sunset light rims his figure."
:: END_HOLON ::Vio3で生成(開始フレーム画像と上記プロンプトを与えています)。
修正の方法。
冒頭のインスタンスに対して、
1:スピード感の不足
2,効果音はそのままで良いが、BGMはいらない
と指示を与えて再度プロンプトの生成を要求:
# KNOWLEDGE_FILE: OGM_VIDEO_DIRECTOR_ARCH
# TYPE: VIDEO_GENERATION_PROMPT
# CONTEXT: EIGHT_SECOND_ACTION_SEQUENCE_FAST
:: HOLON_ROOT: Video_Genesis_Engine ::
:: HOLON_1: The_Lens (Kernel Layer / Technical Laws) ::
> ROLE: Define technical specifications.
+ PARAMETER: Aspect_Ratio: 2.35:1 (Cinemascope)
+ PARAMETER: Visual_Fidelity: Photorealistic, 70s Hong Kong martial arts film look, film grain, high contrast lighting, dynamic camera work.
+ PARAMETER: Frame_Physics: 24fps cinematic. Action must be perceived as high-speed and impactful without slow-motion effects.
+ CONSTRAINT:
- Absolute consistency in art style is MANDATORY. Do not morph objects.
- **No background music (BGM) should be generated.** Only environmental sounds and action foley (swooshes, impacts) related to the visuals are permissible if the model generates audio.
:: HOLON_2: The_Stage (Universe Layer / World Constants) ::
> ROLE: Define the immutable environment.
+ SETTING_ANCHORS:
- Location_Details: Old temple stone courtyard at sunset. Ancient architecture, weathered stone lanterns, traditional flags.
- Lighting_Global: Golden hour backlighting (rim light), lens flare, long shadows. Lighting direction must remain consistent.
- Weather/Atmosphere: Dusty air, particles in light, wind blowing. Background elements must persist.
:: HOLON_3: The_Cast (Ego Layer / Entity Locks) ::
> ROLE: Define the character as an immutable visual object.
+ ENTITY_ID: Captain_Panda (based on image_0.png)
- Appearance_Lock: Anthropomorphic giant panda, muscular build. Wearing the exact blue naval captain uniform coat with gold epaulets and red lining, white shirt, black tie, captain's hat, leather belt with saber and telescope, black boots, as seen in image_0.png.
- Movement_Signature: **Lightning-fast**, explosive martial arts movements. High-speed execution with sharp, crisp stops.
:: HOLON_4: The_Reel (Flux Layer / Temporal Flow) ::
> ROLE: Process the timeline and generate the prompt for the 8-second shot.
> SYNTAX: The prompt describes a continuous 8-second sequence.
+ VIDEO_AI_PROMPT:
"A photorealistic, 70s Hong Kong martial arts film style video, 24fps, 2.35:1 aspect ratio, with no background music.
**[0s-2s]** The scene opens with Captain Panda (from image_0.png) standing tense in an old temple courtyard at sunset. Dust floats in the golden backlight. The camera slowly dollies in on his determined face. He takes a sharp, quick breath, eyes narrowing.
**[2s-6s]** Suddenly, Captain Panda bursts into a **lightning-fast** kung fu form sequence. He performs a rapid-fire series of powerful punches, a sweeping low kick, and a spinning backfist with **explosive speed**. His movements are a blur of motion, crisp and precise. His blue coat and red-lined cape snap violently around him due to the sheer velocity of his actions. Dust and debris are kicked up forcefully from the stone pavement. The camera struggles to keep up, tracking his rapid movements dynamically.
**[6s-8s]** He instantly snaps into a final, solid striking pose (zan-shin) with an abrupt, dead stop, showing incredible body control. Fist extended, glaring intensely at the camera. The camera is now at a low angle, looking up at his imposing figure. The dust cloud he created slowly settles around him in the sunset light."
:: END_HOLON ::全然かっこよくないORZ

#AIVideoGeneration #PromptEngineering #GenerativeAI #AIConsistency #LLMTutorial
