AI's Artistic Struggle: Capturing the Essence of Style with Flux-dev
- 9 minutes read - 1888 wordsTable of Contents
The world of artificial intelligence is rapidly evolving, with generative AI models capable of creating stunning images based on text prompts. However, capturing the essence of an aesthetic style remains a significant challenge. This blog post delves into the results of a recent experiment, where a generative AI model was tasked with creating images based on specific aesthetic styles. While the model demonstrated proficiency in understanding camera angles and shot types, it struggled to replicate the intended aesthetic, highlighting the ongoing challenges in AI’s artistic capabilities. We’ll explore the model’s strengths and weaknesses, analyzing its performance in terms of camera position, shot analysis, and aesthetic analysis. Through this analysis, we’ll gain insights into the current state of AI’s artistic abilities and the potential for future advancements.
Created with: flux-dev
Vibrant Energy: A Playful Portrait in Colorful Light
This captivating image captures a young woman radiating energy, bathed in a symphony of colorful lights. The dramatic lighting highlights her features, creating a playful and vibrant mood.
Prompt
style-aesthetic Romantic: Thrilling and triumphant ; A gamer’s eyes lit up with excitement as they achieve a victory; close-up; gaming; a dimly lit room with neon lights reflecting on the screen; cinematic
Characteristic
Shot : A woman wearing headphones with blue and red lighting
Aesthetic Score : 0.7
Mood : energetic, playful, youthful
Quality
Entropy : 6.73
Noise : 52
Prompt Clip Score : 0.24
AI Evaluation
Likelihood of AI : 0.10
Image errors : The image has a slight graininess, but this is probably from the lighting and not an error.
Campfire Serenity Under a Starry Sky
A group of friends gather around a crackling campfire, bathed in the warm glow of the flames. The night sky above is a canvas of twinkling stars, creating a sense of peace and wonder. The scene evokes a feeling of cozy comfort and the beauty of nature’s simple pleasures.
Prompt
style-aesthetic Romantic: Warm and nostalgic ; A family gathered around a campfire, sharing stories and laughter; wide shot; travel; a serene forest clearing with a crackling fire and a starry sky; cinematic
Characteristic
Shot : A group of four people are gathered around a campfire in a forest, under a starry sky.
Aesthetic Score : 0.7
Mood : cozy, serene, peaceful
Quality
Entropy : 6.18
Noise : 92
Prompt Clip Score : 0.27
AI Evaluation
Likelihood of AI : 0.20
Image errors : There is some noise in the image, particularly in the darker areas. The details of the trees and the sky are not as crisp as they could be.
Lost in the Game: A Moment of Intense Focus
A player is completely engrossed in their game, the city lights blurring into a backdrop of their intense concentration. The image captures the thrill and excitement of the moment, showcasing the playful intensity of gaming.
Prompt
style-aesthetic Romantic: Intense and focused ; A gamer’s hands deftly navigating a controller; close-up; gaming; a vibrant, futuristic cityscape projected on a screen; cinematic
Characteristic
Shot : A person’s hands holding a game controller, with a blurred out television screen in the background showing a colorful, futuristic scene.
Aesthetic Score : 0.6
Mood : futuristic, playful, tech
Quality
Entropy : 6.67
Noise : 52
Prompt Clip Score : 0.25
AI Evaluation
Likelihood of AI : 0.20
Image errors : There is slight blurriness around the edges of the controller and the hand, suggesting some post-processing.
Golden Hour Romance: A Timeless Moment on the Hillside
In this peaceful and nostalgic scene, a couple stands together on a hillside, bathed in the warm, golden light of a setting sun. With a prominent church in the distance and the city blurred below, they are the focal point of the image, creating a romantic and intimate atmosphere.
Prompt
style-aesthetic Romantic: Awe-inspiring and romantic ; A couple gazing out at a breathtaking vista; medium shot; tourism; a sprawling, ancient city with cobblestone streets and colorful buildings; cinematic
Characteristic
Shot : A couple standing on a hilltop overlooking a picturesque cityscape with a church dome visible in the background. The cityscape is bathed in golden light, suggesting it is either sunset or sunrise.
Aesthetic Score : 0.7
Mood : romantic, nostalgic, dreamy
Quality
Entropy : 6.81
Noise : 79
Prompt Clip Score : 0.28
AI Evaluation
Likelihood of AI : 0.20
Image errors : No significant errors detected, except for a slight softness in the image’s focus.
Sunset Soaring: A Hot Air Balloon Ride Filled with Joy and Adventure
Capture the magic of a hot air balloon ride as the sun dips below the horizon. This breathtaking scene evokes feelings of joy, adventure, and romance, with warm colors painting the sky and the silhouette of the balloon creating a striking image.
Prompt
style-aesthetic Romantic: Joyful and carefree ; A family laughing together as they ride a hot air balloon; wide shot; travel; a picturesque countryside with rolling hills and fields of wildflowers; cinematic
Characteristic
Shot : A group of people are in a hot air balloon, looking out over a landscape of hills and fields. The sun is setting in the background, casting a warm glow on the scene.
Aesthetic Score : 0.7
Mood : happy, adventurous, romantic
Quality
Entropy : 6.57
Noise : 78
Prompt Clip Score : 0.30
AI Evaluation
Likelihood of AI : 0.10
Image errors : No noticeable artifacts or errors
Sunset Serenity: A Moment of Hope by the Sea
A woman finds solace in the golden hues of a sunset, gazing out at the vast ocean. The scene evokes a sense of peace, contemplation, and hope, captured in the warm light that bathes the moment.
Prompt
style-aesthetic Romantic: Nostalgic and reflective ; A young woman gazing out at the ocean, her hair flowing in the wind; medium shot; family; a cozy beach house with a warm, inviting interior; cinematic
Characteristic
Shot : A woman with long hair is standing by a window looking out at the ocean, with a bright sunset in the background.
Aesthetic Score : 0.7
Mood : calm, serene, contemplative
Quality
Entropy : 6.59
Noise : 64
Prompt Clip Score : 0.27
AI Evaluation
Likelihood of AI : 0.20
Image errors : The image appears to have been slightly overexposed, resulting in some loss of detail in the highlights.
Silhouetted Hope at Dawn’s Embrace
A solitary figure stands on a hilltop, their form a stark silhouette against the golden sunrise. A distant castle, bathed in the same ethereal light, hints at a story waiting to unfold. The scene is shrouded in a gentle mist, adding to the mystery and drama of this hopeful moment.
Prompt
style-aesthetic Romantic: Epic and hopeful ; A lone knight; wide shot; heroism; a majestic castle bathed in the golden light of sunset; cinematic
Characteristic
Shot : A solitary figure stands in front of a majestic castle silhouetted against a fiery sunset. The scene is bathed in a warm, ethereal glow, with a thick layer of fog adding an air of mystery and intrigue.
Aesthetic Score : 0.7
Mood : epic, mysterious, melancholic
Quality
Entropy : 6.25
Noise : 52
Prompt Clip Score : 0.29
AI Evaluation
Likelihood of AI : 0.90
Image errors : The image exhibits some slight blurriness, particularly in the foreground. The lighting appears a bit flat.
Silhouettes of Love Against a Fiery Sunset
A couple stands hand-in-hand, their silhouettes stark against a breathtaking sunset over a mountainous landscape. The scene evokes a sense of romance, serenity, and hope, with the dramatic contrast between the figures and the glowing sky adding to the emotional impact.
Prompt
style-aesthetic Romantic: Intimate and adventurous ; A couple holding hands, silhouetted against the setting sun; medium shot; adventure; a vast, rugged mountain range; cinematic
Characteristic
Shot : A couple silhouetted against a sunset in a mountainous landscape.
Aesthetic Score : 0.7
Mood : romantic, peaceful, serene
Quality
Entropy : 6.56
Noise : 34
Prompt Clip Score : 0.31
AI Evaluation
Likelihood of AI : 0.20
Image errors : no noticeable errors
Knight’s Grand Proposal in a Red Rose Ballroom
In a grand ballroom filled with elegance and romance, a man in a knight’s costume kneels down to propose to his beloved, dressed in a stunning red dress. With a single red rose and a dramatic low angle shot, this proposal is sure to be remembered as a dramatic and unforgettable moment.
Prompt
style-aesthetic Romantic: Grand and passionate ; A knight kneeling before his beloved, offering her a single rose; close-up; heroism; a grand ballroom with chandeliers and elegant guests; cinematic
Characteristic
Shot : A man in a medieval costume is kneeling and presenting a red rose to a woman in a red gown in a grand ballroom. The scene is lit with soft, warm light and has a fairytale-like atmosphere.
Aesthetic Score : 0.8
Mood : romantic, elegant, whimsical
Quality
Entropy : 6.70
Noise : 72
Prompt Clip Score : 0.33
AI Evaluation
Likelihood of AI : 0.30
Image errors : The background figures appear somewhat blurry and lack detail. Some slight graininess is present.
Silhouettes of Love Under a Starry Desert Sky
A couple walks hand-in-hand through a moonlit desert, their silhouettes a testament to their love against the vast expanse of the starry sky. The Milky Way stretches across the heavens, adding a touch of magic to this romantic and serene scene.
Prompt
style-aesthetic Romantic: Mystical and intimate ; A couple sharing under a starry sky; medium shot; adventure; a vast desert landscape with towering sand dunes; cinematic
Characteristic
Shot : Two figures are walking hand-in-hand across a sandy desert, silhouetted against a starry sky with a milky way.
Aesthetic Score : 0.8
Mood : romantic, peaceful, adventurous
Quality
Entropy : 6.09
Noise : 62
Prompt Clip Score : 0.31
AI Evaluation
Likelihood of AI : 0.20
Image errors : No noticeable errors
Conclusion
The results show that the generative AI model performed well in terms of camera position and shot analysis, but struggled with aesthetic analysis.
Here’s a breakdown:
- Camera Position: The model scored 0.41, which is slightly below the “good” range of 0.5 to 0.75. This suggests that the model’s ability to accurately interpret and reproduce camera positions in the generated images is decent, but could be improved.
- Shot Analysis: The model scored 0.52, which falls within the “good” range. This indicates that the model is generally able to understand and translate the scene descriptions from the prompt into the generated image.
- Aesthetic Analysis: The model scored 0.11, which is significantly higher than the “very good” range of -0.2 to 0.1. This suggests that the generated image’s aesthetic deviated significantly from the expected aesthetic based on the prompt.
Overall, the model shows promise in understanding and implementing camera positions and shot descriptions, but needs improvement in generating images that match the desired aesthetic.
Sources:
- https://heartofnoir.com/knowing-noir/aesthetic-of-noir/
- https://www.yellowbrick.co/blog/film/maximizing-the-visual-impact-unveiling-the-art-of-film-aesthetics
- https://www.questjournals.org/jrhss/papers/vol10-issue8/1008255260.pdf
- https://www.jstor.org/stable/3331672
- https://www.cinepoetics.fu-berlin.de/activities/workshops/2020-12-ws/index.html
- https://resource.download.wjec.co.uk/vtc/2016-17/16-17_1-22/eng/Part%201%20What%20is%20Aesthetics.pdf
- https://fal.ai/models/fal-ai/flux/dev/api