AI Captures the Essence, But Misses the Shot: Exploring the 'Dramatic' Aesthetic with Imagen-v3-fast
- 10 minutes read - 1921 words
Table of Contents
The ‘Dramatic’ aesthetic, characterized by stark contrasts, dramatic lighting, and evocative compositions, is a powerful tool in visual storytelling. It’s often used to create a sense of suspense, mystery, or grandeur. In this blog post, we explore the capabilities of AI in capturing this aesthetic through a case study. We analyze the results of an experiment where an AI model was tasked with generating images based on specific scene descriptions, all aiming for the ‘Dramatic’ aesthetic. While the model demonstrated a strong understanding of the desired mood and style, it struggled with accurately translating camera angles and shot types. This analysis provides valuable insights into the current limitations and potential of AI in visual storytelling, particularly in its ability to understand and replicate complex artistic concepts.
Created with: imagen-v3-fast
Solitude at Sunrise: A Moment of Reflection
A lone figure stands on a rooftop, bathed in the golden light of sunrise, contemplating the vast cityscape below. The scene evokes a sense of melancholy, introspection, and a glimmer of hope.
Prompt
style-aesthetic Neo-realist: Melancholy, yet hopeful ; A lone figure, silhouetted against the setting sun, standing atop a crumbling building; long shot; Heroism; A cityscape with smoke rising from factories in the distance; cinematic
Characteristic
Shot : A lone figure stands on the rooftop of a derelict building overlooking a cityscape at sunrise.
Aesthetic Score : 0.75
Mood : melancholy, contemplative, hopeful
Quality
Entropy : 6.84
Noise : 60
Prompt Clip Score : 0.34
AI Evaluation
Likelihood of AI : 0.20
Image errors : No noticeable errors.
Whispers of Adventure: A Candlelit Map Unfolds
A weathered map, illuminated by the flickering glow of a candle, evokes a sense of mystery and adventure. The soft light casts long shadows, hinting at forgotten journeys and hidden secrets. This scene whispers of a past filled with exploration and a future brimming with possibilities.
Prompt
style-aesthetic Neo-realist: Intriguing, mysterious ; A weathered map, spread out on a rickety wooden table, with a worn compass resting on it; close-up; Adventure; A dimly lit room with flickering candlelight; cinematic
Characteristic
Shot : A compass lies on an old, unfolded map. A candle in a brass candlestick illuminates the scene, casting warm shadows.
Aesthetic Score : 0.8
Mood : mysterious, adventurous, nostalgic
Quality
Entropy : 6.30
Noise : 45
Prompt Clip Score : 0.32
AI Evaluation
Likelihood of AI : 0.10
Image errors : No visible image errors.
The Controller in Their Hands: A Moment of Focus and Intensity
A close-up shot captures the hands of a gamer gripping a black controller, their focus unwavering. The dimly lit background adds a sense of mystery and anticipation, hinting at a crucial moment in the game. The pizza box and can suggest a casual setting, but the intensity in their grip tells a different story.
Prompt
style-aesthetic Neo-realist: Intense, focused ; A pair of hands, gripping a joystick, sweat dripping onto the buttons; close-up; Gaming; A dimly lit room with flickering monitor light, surrounded by empty pizza boxes and soda cans; cinematic
Characteristic
Shot : A person’s hands holding a video game controller. The controller is black and has a cord attached. The person is wearing a blue shirt and their hands are in focus. There is a pizza box on the table to the left of the controller. The background is dark and blurry. There is a can to the right of the controller.
Aesthetic Score : 0.5
Mood : focused, intense, casual
Quality
Entropy : 6.24
Noise : 35
Prompt Clip Score : 0.31
AI Evaluation
Likelihood of AI : 0.20
Image errors : There are no noticeable artifacts or errors in the image.
Awe-Inspiring Tower Beckons in Mysterious Marketplace
A group of people stand amidst the bustling energy of a marketplace, their faces filled with a mix of curiosity and anticipation. A towering structure dominates the background, its imposing presence casting a sense of wonder and mystery. The scene evokes a feeling of adventure and hope, promising a journey into the unknown.
Prompt
style-aesthetic Neo-realist: Awe-inspiring, curious ; A group of tourists, huddled together, looking up at a towering ancient monument; medium shot; Tourism; A bustling marketplace with vendors selling souvenirs and local crafts; cinematic
Characteristic
Shot : A group of people standing in a marketplace with a large tower in the background
Aesthetic Score : 0.7
Mood : mysterious, adventurous, hopeful
Quality
Entropy : 6.83
Noise : 87
Prompt Clip Score : 0.30
AI Evaluation
Likelihood of AI : 0.90
Image errors : The image has some minor artifacts, such as the repeating pattern in the tower.
A Suitcase’s Silent Journey: Nostalgia and Anticipation on the Platform
A vintage suitcase rests on a bustling train station platform, its weathered leather whispering tales of past journeys. The train in the background promises new adventures, while the suitcase’s solitude evokes a sense of nostalgic longing and the anticipation of a journey yet to be taken.
Prompt
style-aesthetic Neo-realist: Nostalgic, bittersweet ; A worn suitcase, sitting on a train platform, with a single ticket protruding from it; medium shot; Travel; A bustling train station with people rushing to and fro; cinematic
Characteristic
Shot : A vintage suitcase lying on a train station platform, with a train in the background. The suitcase is in the foreground, and the train is in the background. The station is bustling with activity.
Aesthetic Score : 0.7
Mood : nostalgic, travel, journey
Quality
Entropy : 6.81
Noise : 82
Prompt Clip Score : 0.31
AI Evaluation
Likelihood of AI : 0.20
Image errors : Slight blur in the background and some noise in the leather texture of the suitcase.
Secrets in the Shadows: A Man’s Solitary Pursuit
A single candle casts flickering shadows on a man hunched over a table in a dimly lit room. His silhouette, shrouded in mystery, suggests a moment of intense focus, perhaps writing, reading, or contemplating a secret. The atmosphere is heavy with suspense, inviting the viewer to wonder what secrets lie hidden in the darkness.
Prompt
style-aesthetic Neo-realist: Solitary, melancholic ; A lone figure sits hunched over a weathered table in a dimly lit room, the flickering candlelight casting long shadows on the cracked plaster walls.; cinematic
Characteristic
Shot : A man is sitting at a table in a dimly lit room, illuminated only by candlelight. He is leaning over, seemingly writing or reading something.
Aesthetic Score : 0.6
Mood : mysterious, suspenseful, introspective
Quality
Entropy : 6.14
Noise : 54
Prompt Clip Score : 0.31
AI Evaluation
Likelihood of AI : 0.10
Image errors : There is some noise and graininess in the image, particularly in the darker areas.
Lost in Motion: A Moment of Contemplation
A solitary figure sits on a train, their gaze fixed on the fleeting landscape outside. The blurred scenery, a testament to the train’s relentless journey, mirrors the man’s own internal reflection. The silhouette against the window adds a layer of mystery, inviting viewers to ponder the thoughts swirling within.
Prompt
style-aesthetic Neo-realist: Melancholy, introspective ; A lone figure, silhouetted against the train window, watches the world blur by. Fields and forests flash past in a kaleidoscope of green and brown.; cinematic
Characteristic
Shot : A man sitting in a train, looking out the window at the passing scenery, blurred by the motion of the train
Aesthetic Score : 0.6
Mood : reflective, melancholic, contemplative
Quality
Entropy : 5.60
Noise : 42
Prompt Clip Score : 0.35
AI Evaluation
Likelihood of AI : 0.20
Image errors : Slight noise and compression artifacts, especially visible in the blurred background
A Moment Captured, A Memory Rekindled
A hand gently cradles an old black and white photograph, its faded image whispering tales of a bygone era. The warm glow of a nearby lamp casts a nostalgic light, inviting us to share in the sentimental journey of remembering loved ones and cherished moments.
Prompt
style-aesthetic Neo-realist: Nostalgic, sentimental ; A weathered hand, holding a worn photograph, with a faded smile on the face in the picture; close-up; Family; A dimly lit room with a single lamp casting a warm glow; cinematic
Characteristic
Shot : A hand holds an old black and white photograph of two women in front of a lamp with a warm glow.
Aesthetic Score : 0.7
Mood : nostalgic, sentimental, warm
Quality
Entropy : 6.70
Noise : 35
Prompt Clip Score : 0.27
AI Evaluation
Likelihood of AI : 0.10
Image errors : The image has a slight graininess and a slight blurriness.
Campfire Tales: Friends, Forest, and a Touch of Mystery
Four friends huddle around a crackling campfire, sharing stories and laughter under the starlit sky. The warm glow of the fire creates a cozy atmosphere, while the surrounding darkness adds a touch of adventure and intrigue. This scene captures the essence of friendship, exploration, and the magic of a night spent in the wilderness.
Prompt
style-aesthetic Neo-realist: Joyful, camaraderie ; A group of friends, huddled together around a campfire, sharing stories and laughter; medium shot; Adventure; A campsite under a starry night sky with a crackling fire; cinematic
Characteristic
Shot : Four friends gathered around a campfire in a forest at night.
Aesthetic Score : 0.7
Mood : cozy, adventurous, friendly
Quality
Entropy : 6.58
Noise : 76
Prompt Clip Score : 0.33
AI Evaluation
Likelihood of AI : 0.20
Image errors : Slight blurring of the background, suggesting a wide aperture and shallow depth of field was used
Lost in the Shadows: A Man’s Solitary Journey
A lone figure walks down a deserted street, his suitcase casting a long shadow in the dim glow of streetlights. The atmosphere is heavy with loneliness and mystery, leaving viewers to wonder about his destination and the secrets he carries.
Prompt
style-aesthetic Neo-realist: Lonely, introspective ; A lone figure, walking down a deserted street, with a suitcase in hand; long shot; Travel; A city street at night with flickering streetlights and empty sidewalks; cinematic
Characteristic
Shot : A man walks down a dark, empty street with a suitcase. The street is lined with buildings on both sides, and the only light comes from streetlamps.
Aesthetic Score : 0.7
Mood : lonely, mysterious, melancholic
Quality
Entropy : 5.90
Noise : 60
Prompt Clip Score : 0.31
AI Evaluation
Likelihood of AI : 0.20
Image errors : The image is slightly overexposed, and the details in the buildings are lost in the darkness.
Conclusion
The results indicate that the generative AI model performed well in terms of understanding the scene and camera position, but struggled with achieving the desired aesthetic. Here’s a breakdown:
- Camera Position: The model scored 0.4, which is considered below average. This suggests that the generated image didn’t accurately reflect the camera position described in the prompt.
- Shot Analysis: The model scored 0.52, which is considered average. This means the generated image somewhat reflected the shot described in the prompt, but there were some discrepancies.
- Aesthetic Analysis: The model scored 0.105, which is considered very good. This indicates that the generated image closely matched the expected aesthetic, despite the issues with camera position and shot analysis.
Overall, the model seems to be capable of understanding the scene and achieving the desired aesthetic, but it struggles with accurately translating the camera position into the generated image.
Sources:
- https://heartofnoir.com/knowing-noir/aesthetic-of-noir/
- https://www.yellowbrick.co/blog/film/maximizing-the-visual-impact-unveiling-the-art-of-film-aesthetics
- https://www.questjournals.org/jrhss/papers/vol10-issue8/1008255260.pdf
- https://www.jstor.org/stable/3331672
- https://www.cinepoetics.fu-berlin.de/activities/workshops/2020-12-ws/index.html
- https://resource.download.wjec.co.uk/vtc/2016-17/16-17_1-22/eng/Part%201%20What%20is%20Aesthetics.pdf
- https://deepmind.google/technologies/imagen-3/