Capturing the Essence: AI's Struggle with Cinematic Aesthetics with Flux-dev
- 9 minutes read - 1899 wordsTable of Contents
The world of AI-generated imagery is constantly evolving, with models becoming increasingly adept at understanding and replicating various artistic styles. One particularly intriguing area of exploration is the ability of AI to capture cinematic aesthetics. This style, characterized by dramatic lighting, evocative camera angles, and carefully composed shots, is often used to create immersive and emotionally resonant visuals. In this blog post, we’ll delve into a case study that showcases both the successes and challenges of AI in replicating cinematic aesthetics.
Created with: flux-dev
Immersed in Focus: Blue and Red Light Illuminate a Determined Mind
A young person, bathed in the contrasting glow of blue and red light, is deeply engrossed in their work. The dramatic lighting emphasizes their focused concentration, highlighting the intensity of their dedication.
Prompt
style-aesthetic Impressionist: Engrossed, focused ; A close-up of a player’s face, illuminated by the screen, with a mix of excitement and concentration; close-up; Gaming; A dimly lit room with a computer screen glowing brightly; cinematic
Characteristic
Shot : A young person is sitting at a computer wearing a headset and focusing on the screen, the room is dimly lit with blue and red hues.
Aesthetic Score : 0.6
Mood : focused, intense, determined
Quality
Entropy : 6.41
Noise : 62
Prompt Clip Score : 0.22
AI Evaluation
Likelihood of AI : 0.30
Image errors : There is slight blurriness in the background, and the lighting is slightly uneven.
Lost in the Game: A Moment of Intense Focus
A dimly lit room, a player’s hands gripping the controller, and a screen filled with action. This image captures the raw intensity of gaming, where every move matters and the line between reality and the virtual world blurs.
Prompt
style-aesthetic Impressionist: Intense, focused ; A player’s hand, gripping a joystick, with the screen reflecting the vibrant colors of a virtual world; close-up; Gaming; A dimly lit room with a computer screen glowing brightly; cinematic
Characteristic
Shot : A person is playing video games at night. The screen is lit up with a colorful nebula-like pattern and the person’s hands are holding a controller. There is a mouse on the desk, which is illuminated by the screen. The scene is dark and the only light is coming from the screen and the desk lamp.
Aesthetic Score : 0.5
Mood : focused, immersive, playful
Quality
Entropy : 6.67
Noise : 53
Prompt Clip Score : 0.23
AI Evaluation
Likelihood of AI : 0.80
Image errors : The image has some minor artifacts, particularly in the screen’s image and in the hand holding the controller, hinting that it might be AI-generated. The image also suffers from dark areas in the background that detract from the overall composition.
A Vibrant Tapestry of Colors and Culture: Exploring a Bustling Middle Eastern Market
Immerse yourself in the lively atmosphere of a bustling Middle Eastern street market. Colorful awnings and overflowing stalls create a vibrant scene, while the perspective draws you deeper into the heart of the market, inviting you to explore its exotic treasures.
Prompt
style-aesthetic Impressionist: Exuberant, curious ; A bustling marketplace, filled with vibrant colors and exotic goods, with a lone traveler gazing in wonder; wide shot; Tourism; A bustling marketplace with vibrant colors and exotic goods; cinematic
Characteristic
Shot : A narrow street in a bustling market, crowded with people and lined with stalls selling various goods.
Aesthetic Score : 0.6
Mood : busy, crowded, vibrant
Quality
Entropy : 6.64
Noise : 111
Prompt Clip Score : 0.25
AI Evaluation
Likelihood of AI : 0.20
Image errors : No visible artifacts or errors.
Tranquil Journey Through a Sun-Kissed Valley
Experience the serenity of a train ride through a picturesque valley. The sun bathes the landscape in golden light, while rolling green hills and a distant town create a sense of peace and adventure. This image evokes a feeling of tranquility and hope, inviting you to escape into the beauty of the journey.
Prompt
style-aesthetic Impressionist: Nostalgic, romantic ; A train speeding through a picturesque countryside, with blurred landscapes and fleeting glimpses of towns and villages; long shot; Travel; A picturesque countryside with rolling hills and lush greenery; cinematic
Characteristic
Shot : A train traveling through a picturesque valley with a small village and rolling hills in the background. The sun is shining, casting long shadows across the landscape.
Aesthetic Score : 0.7
Mood : tranquil, scenic, nostalgic
Quality
Entropy : 6.84
Noise : 102
Prompt Clip Score : 0.25
AI Evaluation
Likelihood of AI : 0.10
Image errors : There is a slight blurriness to the image, possibly due to camera shake. The colors are a little muted, and the contrast could be improved.
Silhouetted Solitude at Sunset
A solitary figure stands on a cliff edge, bathed in the warm glow of a setting sun. The vast ocean stretches out before them, creating a sense of tranquility and contemplation. The dramatic silhouette against the fiery sky evokes feelings of isolation and awe.
Prompt
style-aesthetic Impressionist: Solitary, contemplative ; A lone figure, standing on a cliff overlooking a vast ocean, with the sun setting in the distance; medium shot; Heroism; A vast ocean with a dramatic sunset; cinematic
Characteristic
Shot : A single person stands on a cliff edge overlooking a vast ocean at sunset. The sky is ablaze with orange and yellow hues, creating a dramatic and captivating backdrop.
Aesthetic Score : 0.7
Mood : tranquil, awe, solitude
Quality
Entropy : 6.76
Noise : 75
Prompt Clip Score : 0.23
AI Evaluation
Likelihood of AI : 0.20
Image errors : No significant artifacts or errors
Silhouettes of Friendship: A Cozy Campfire Under the Stars
Four friends gather around a crackling campfire, their silhouettes cast against the dancing flames. The scene evokes a sense of cozy warmth, mysterious adventure, and the enduring power of friendship.
Prompt
style-aesthetic Impressionist: Warm, camaraderie ; A group of adventurers, silhouetted against a blazing campfire, sharing stories and laughter; medium shot; Adventure; A dark forest with a flickering campfire; cinematic
Characteristic
Shot : A group of four friends are sitting around a campfire in a forest setting, talking and enjoying each other’s company.
Aesthetic Score : 0.6
Mood : cozy, intimate, peaceful
Quality
Entropy : 6.21
Noise : 68
Prompt Clip Score : 0.25
AI Evaluation
Likelihood of AI : 0.10
Image errors : No significant errors; some noise is present.
Lost in Time: A Compass Points to Adventure
A vintage map unfolds, revealing a compass at its heart. The soft glow of a candle in the background adds a touch of mystery, inviting you to explore the unknown. This image captures the essence of adventure, nostalgia, and the thrill of discovery.
Prompt
style-aesthetic Impressionist: Mysterious, adventurous ; A weathered map, partially obscured by shadows, with a compass needle pointing towards a distant, unknown land; close-up; Adventure; A dimly lit room with flickering candlelight; cinematic
Characteristic
Shot : A compass lying on a vintage map, with a candle out of focus in the background.
Aesthetic Score : 0.7
Mood : nostalgic, adventurous, mysterious
Quality
Entropy : 6.91
Noise : 57
Prompt Clip Score : 0.23
AI Evaluation
Likelihood of AI : 0.10
Image errors : Slight blurriness in the background, some noise in the shadows
A Moment of Solitude in a Bustling City
A lone figure walks down a vibrant European street, bathed in the warm glow of the setting sun. The scene captures a moment of quiet contemplation amidst the bustling energy of city life, evoking a sense of calm and hope.
Prompt
style-aesthetic Impressionist: Energetic, vibrant ; A panoramic view of a bustling city, with vibrant colors and a sense of movement, with a lone traveler walking through the streets; wide shot; Tourism; A bustling city with vibrant colors and a sense of movement; cinematic
Characteristic
Shot : A street scene with colorful buildings and a lone figure walking towards the horizon under a beautiful sunset sky
Aesthetic Score : 0.75
Mood : romantic, nostalgic, peaceful
Quality
Entropy : 6.87
Noise : 104
Prompt Clip Score : 0.27
AI Evaluation
Likelihood of AI : 0.80
Image errors : Some slight blurriness, particularly in the background, likely due to post-processing. Colors are slightly oversaturated, leading to a slightly artificial look.
Silhouetted Against the Fiery Sunset
A solitary figure stands in stark contrast against a breathtaking sunset, their silhouette a testament to the vastness of the mountain range behind them. The scene evokes a sense of serenity, contemplation, and a touch of drama, leaving the viewer to ponder the figure’s story and the mysteries of the landscape.
Prompt
style-aesthetic Impressionist: Epic, hopeful ; A lone figure, silhouetted against the setting sun; wide shot; Heroism; A vast, desolate landscape with a lone mountain in the distance; cinematic
Characteristic
Shot : Silhouette of a person standing in front of a mountain range at sunset. The sun is setting behind the mountain range and casting a warm glow on the scene.
Aesthetic Score : 0.7
Mood : serene, contemplative, hopeful
Quality
Entropy : 6.46
Noise : 36
Prompt Clip Score : 0.28
AI Evaluation
Likelihood of AI : 0.10
Image errors : No visible artifacts or errors.
Intimate Family Dinner Under Candlelight
A heartwarming scene of a family of four gathered around a dimly lit dining table, enjoying a meal together. The warm colors and candlelight create a cozy and intimate atmosphere, highlighting the bonds of family and love.
Prompt
style-aesthetic Impressionist: Intimate, heartwarming ; A family gathered around a table, sharing a meal, with warm, golden light illuminating their faces; medium shot; Family; A cozy kitchen with a warm, inviting atmosphere; cinematic
Characteristic
Shot : A family of five is gathered around a table, enjoying a meal. There are four people sitting at the table: a woman, a man, a boy, and a girl. The fifth person is a little girl, who is standing. The scene is warm and inviting, with a warm, golden glow emanating from the lights. There are glasses and plates on the table.
Aesthetic Score : 0.7
Mood : warm, cozy, intimate
Quality
Entropy : 6.56
Noise : 72
Prompt Clip Score : 0.29
AI Evaluation
Likelihood of AI : 0.10
Image errors : There is some noise in the image, particularly in the shadows. The edges of the image are a little bit blurry.
Conclusion
The generative AI model performed well in terms of understanding the scene and camera position, but struggled with the aesthetic. Here’s a breakdown:
- Camera Position: The model scored 0.43, which is slightly below average. This suggests that the model didn’t perfectly capture the intended camera position described in the prompt.
- Shot Analysis: The model scored 0.47, also slightly below average. This indicates that the model didn’t fully understand the scene described in the prompt and didn’t create the expected shot composition.
- Aesthetic Analysis: The model scored 0.1, which is considered very good. This means the generated image closely matched the desired aesthetic, despite the issues with camera position and shot composition.
Overall, the model shows promise in understanding the aesthetic of the prompt, but needs improvement in accurately interpreting camera position and scene composition.
Sources:
- https://heartofnoir.com/knowing-noir/aesthetic-of-noir/
- https://www.yellowbrick.co/blog/film/maximizing-the-visual-impact-unveiling-the-art-of-film-aesthetics
- https://www.questjournals.org/jrhss/papers/vol10-issue8/1008255260.pdf
- https://www.jstor.org/stable/3331672
- https://www.cinepoetics.fu-berlin.de/activities/workshops/2020-12-ws/index.html
- https://resource.download.wjec.co.uk/vtc/2016-17/16-17_1-22/eng/Part%201%20What%20is%20Aesthetics.pdf
- https://fal.ai/models/fal-ai/flux/dev/api