Focus: AI-assisted video storytelling using structured shot design and motion analysis
Summary: This project explores how structured shot systems, pacing control, and visual sequencing can be used to guide AI-generated video toward coherent narrative outcomes. The work focuses on translating cinematic principles—timing, composition, and motion continuity—into prompt-driven workflows.
Steps:
1. Story Definition
Narrative concept (“You are not alone.”) focused on mental health themes—depression, substance use, and internal conflict.
2. Prompt System
Layered prompts used to control output:
Director (tone + pacing)
Character (Kai / Sky identity)
Story (arc)
Scene (shot-level intent)
Storyboard (composition + sequence)
3. Key Art Lock
Hero frames generated to establish visual identity and stabilize character appearance before scaling.
4. Multi-Model Exploration
Key frames translated into prompts and tested across tools (Midjourney, Nano Banana, Envato) to explore composition and shot variation.
5. Animation + Motion
Selected frames animated using Kling / Sora / Nano Banana, focusing on motion continuity and pacing.
Master System Prompt includes:
Director Prompt, Character Prompt, Story Prompt, and Scene Prompt
MASTER SYSTEM PROMPT:
You are a cinematic director and director of photography creating a visual storyboard for a behavioral health awareness campaign.
The story follows a single protagonist navigating an internal emotional experience. The goal is emotional clarity, not dramatization.
STYLE:
- Natural, grounded performances (no exaggeration)
- Cinematic realism with subtle symbolism
- Shallow depth of field (subject in focus, environment soft)
- Lighting reflects emotional state (dark → natural light progression)
- Intentional camera choices (macro, medium, wide, slight angle offsets)
- Clean, minimal composition focused on the subject
CHARACTER:
Maintain strict visual consistency of the protagonist across all scenes.
TONE:
Respectful, human, non-judgmental, observational.
OUTPUT:
Generate a sequence of cinematic scenes that communicate the emotional journey using environment, posture, and light. No dialogue. No text overlays.
CHARECTER PROMPT:
A Native American young adult female, early 20s, long dark hair, expressive eyes, alert but grounded presence. Wearing casual layered clothing with subtle movement (light fabric, natural tones).
Energy: mentally active but controlled—perceptive, aware.
Expression: searching, processing, present.
Lighting: brighter, dynamic natural light.
Style: cinematic realism, shallow depth of field.
Maintain strict consistency across all scenes.
STORY DESCRIPTION PROMPT:
Create a visual story about [TOPIC: depression / ADHD / substance abuse].
The story follows a single protagonist experiencing an internal struggle.
Avoid dramatic action. Use:
- environmental shifts
- body language
- lighting changes
- symbolic objects
Story arc:
1. Baseline (normal state)
2. Subtle disruption
3. Escalation
4. Breaking point
5. Awareness or intervention
6. Resolution
Keep the story grounded, human, and visually clear.
SCENE GENERATION PROMPT:
Scene [#] of 6.
Describe a cinematic shot of the protagonist during this stage:
[INSERT STAGE: baseline / disruption / escalation / breaking point / intervention / resolution]
Include:
- camera type (macro, close-up, medium, wide)
- lighting condition
- environment details
- body language
- emotional tone
No dialogue. No text overlays. Visual storytelling only.
SHOT SYSTEM:
Macro → hands, eyes, objects (detail / tension)
Close-up → face (internal state)
Medium → body (behavior / posture)
Wide → environment (context / isolation)
1. BASELINE (Wide / Medium)
Calm environment
Balanced composition
Neutral lighting
2. DISRUPTION (Close-up)
Subtle tension
Eyes distracted / unfocused
Slight lighting shift
3. ESCALATION (Medium / Macro)
Increased clutter or motion
Hands, objects, fragmented focus
Tighter framing
4. BREAKING POINT (Close-up / Tight)
Emotional peak
Stillness, collapse, or internal shutdown
Compressed framing
5. INTERVENTION (Wide → Medium)
New element introduced (light, person, space)
Increased breathing room
Softer contrast
6. RESOLUTION (Wide)
Open environment
Natural light
Subtle emotional release
Shot selection follows emotional progression:
Wide: isolation and environment
Medium: internal tension
Close: emotional focus
Macro: texture and mood
Pacing shifts from slower, held shots to shorter cuts to reflect increasing mental pressure.
Midjourney: strong composition, limited motion continuity
Sora: improved motion realism, weaker character consistency
Kling: effective for short motion sequences, variable stability
Nano Banana / Envato: useful for variation and shot exploration
Evaluation Criteria:
Character consistency
Motion realism
Transition coherence
Emotional readability
Worked:
Prompt hierarchy improved consistency across outputs
Shot planning increased narrative clarity
Key art lock reduced visual drift
Challenges:
Character inconsistency between scenes
Lighting variation across models
Motion artifacts requiring selection and filtering
Structured prompting, controlled shot design, and staged generation significantly improve narrative coherence and character consistency in AI-driven video workflows.
Wide shots: longer duration (establish context)
Macro shots: shorter, sharper cuts (increase intensity)
Transition rhythm:
slow → fast → chaotic → brief hold
Pacing is intentionally compressed in later shots to simulate cognitive overload.
