AI's Artistic Struggle: Capturing the Essence of Poses with Imagen-v3
- 10 minutes read - 1978 words
Table of Contents
Generative AI is revolutionizing the way we create visual content. By analyzing textual prompts, these models can generate images that capture a wide range of scenes and styles. However, the ability to accurately translate the nuances of visual storytelling, particularly in terms of aesthetic style, remains a challenge. This blog post explores the strengths and weaknesses of generative AI in capturing the essence of a scene, focusing on its performance in understanding camera angles, shot composition, and aesthetic style. We’ll use examples to illustrate how AI can be used to enhance visual storytelling and discuss the potential of this technology in the future.
Created with: imagen-v3
Silhouetted Against the Sunset: A Hiker’s Moment of Awe
A lone hiker stands on a mountain peak, silhouetted against a breathtaking sunset. The fiery hues of the sky and the vastness of the landscape create a serene and awe-inspiring scene, emphasizing the individual’s smallness in the face of nature’s grandeur.
Prompt
poses high-angle: epic, triumphant ; A lone figure standing on a mountain peak, silhouetted against the setting sun; wide shot; heroism; vast, rugged mountain range; cinematic
Characteristic
Shot : A lone hiker stands on a mountain peak, gazing out at a breathtaking sunset over a range of mountains. The sky is ablaze with fiery hues of orange, pink, and purple, while the distant peaks are silhouetted against the luminous horizon.
Aesthetic Score : 0.8
Mood : serene, awe-inspiring, contemplative
Quality
Entropy : 6.73
Noise : 84
Prompt Clip Score : 0.31
AI Evaluation
Likelihood of AI : 0.30
Image errors : The image has minimal noise, possibly some digital artifacts or slight oversharpening
Into the Unknown: Explorers Venture Deep into the Jungle
A group of intrepid explorers disappears into the dense foliage, their path illuminated by a dramatic shaft of light. The air is thick with mystery and anticipation as they journey deeper into the unknown, leaving behind the familiar world for the thrill of adventure.
Prompt
poses high-angle: adventurous, suspenseful ; A group of explorers navigating a dense jungle, their path illuminated by the sun filtering through the canopy; medium shot; adventure; lush, green jungle; cinematic
Characteristic
Shot : A group of four explorers are walking through a dense jungle. The image is shot from behind them, and they are walking away from the camera. There is a lot of foliage in the image, and the light is coming from the right side of the frame.
Aesthetic Score : 0.7
Mood : mysterious, adventurous, suspenseful
Quality
Entropy : 6.68
Noise : 118
Prompt Clip Score : 0.32
AI Evaluation
Likelihood of AI : 0.40
Image errors : Some artifacts and errors are present in the foliage, especially near the light source.
Lost in the Neon Glow: A Gamer’s Focus in a Futuristic World
This image captures the intensity of a gamer immersed in a sci-fi world. The vibrant lighting and close-up on the player’s hands create a dramatic scene, highlighting the focus and dedication required to conquer the virtual landscape.
Prompt
poses high-angle: intense, focused ; A gamer’s hands manipulating a controller, the screen displaying a vibrant, futuristic cityscape; close-up; gaming; a dimly lit room with gaming peripherals; cinematic
Characteristic
Shot : A person is playing a video game on a computer. The game is a sci-fi game with a futuristic cityscape in the background. The person is sitting at a desk and has a keyboard and mouse in front of them. The room is lit with colorful lights.
Aesthetic Score : 0.7
Mood : futuristic, intense, focused
Quality
Entropy : 6.37
Noise : 71
Prompt Clip Score : 0.32
AI Evaluation
Likelihood of AI : 0.10
Image errors : There is a slight glow around the screen edges.
Prague Romance: A Couple’s Playful Pose in Front of the Týn Church
A couple embraces the touristy charm of Prague, striking a playful pose in front of the iconic Church of Our Lady Before Týn. The happy mood and relaxed atmosphere are palpable, making this a delightful snapshot of their European adventure.
Prompt
poses high-angle: lively, energetic ; A bustling city square filled with tourists, capturing the iconic landmarks and vibrant street life; wide shot; tourism; a vibrant, bustling city with historical architecture; cinematic
Characteristic
Shot : A couple is posing in the middle of a square in Prague. They are in front of the Church of Our Lady Before Týn.
Aesthetic Score : 0.6
Mood : happy, touristy, relaxed
Quality
Entropy : 6.86
Noise : 103
Prompt Clip Score : 0.30
AI Evaluation
Likelihood of AI : 0.20
Image errors : The image is slightly blurry. Some artifacts are visible in the sky.
Solitude and Sunrise in the Desert
A lone hiker stands on a sand dune, silhouetted against the vast desert landscape as the sun rises over distant mountains. The scene evokes a sense of tranquility and contemplation, highlighting the immense scale of the natural world.
Prompt
poses high-angle: reflective, contemplative ; A lone traveler gazing out at a vast desert landscape, the setting sun casting long shadows; medium shot; travel; a vast, desolate desert with sand dunes; cinematic
Characteristic
Shot : A lone hiker stands on a sand dune in a desert landscape, looking out at the sunrise over the distant mountains. The sand dunes are a warm reddish-brown color, and the sky is a soft blue.
Aesthetic Score : 0.75
Mood : tranquil, serene, vast
Quality
Entropy : 6.73
Noise : 93
Prompt Clip Score : 0.34
AI Evaluation
Likelihood of AI : 0.10
Image errors : The image appears to be slightly overexposed, particularly in the sky. Some noise is visible in the darker areas, potentially due to compression.
Campfire Tales Under a Starry Sky
A group of friends gather around a crackling campfire, sharing stories and laughter under a breathtaking starry sky. The warm glow of the fire illuminates their faces, creating a sense of intimacy and camaraderie. Two tents stand nearby, promising a cozy night in the wilderness. This scene captures the essence of adventure, friendship, and the beauty of nature.
Prompt
poses high-angle: warm, intimate ; A group of friends gathered around a campfire, sharing stories and laughter under a starry night sky; medium shot; groups; a serene campsite with a campfire and a starry sky; cinematic
Characteristic
Shot : A group of friends gathered around a campfire in the wilderness under a starry sky. There are two tents set up, one on each side of the campfire.
Aesthetic Score : 0.7
Mood : cozy, adventurous, friendly
Quality
Entropy : 5.90
Noise : 100
Prompt Clip Score : 0.36
AI Evaluation
Likelihood of AI : 0.10
Image errors : The image has some noise and grain, which is likely due to the low light conditions. The focus is slightly off in some areas, particularly in the background. The white balance is slightly off, making the image look a bit too warm.
Superman Soars Above the City at Sunset
A powerful image of Superman flying over a city skyline, silhouetted against the setting sun. The scene evokes a sense of heroism, power, and hope.
Prompt
poses high-angle: powerful, awe-inspiring ; A superhero soaring through the air, the city sprawling beneath them; wide shot; heroism; a sprawling cityscape with towering buildings; cinematic
Characteristic
Shot : Superman is flying over a city skyline, possibly New York City. The sun is setting in the background, and the city is silhouetted against the orange sky.
Aesthetic Score : 0.6
Mood : heroic, powerful, hopeful
Quality
Entropy : 6.87
Noise : 96
Prompt Clip Score : 0.31
AI Evaluation
Likelihood of AI : 0.70
Image errors : The city skyline appears to be somewhat blurry and lacks detail. The Superman figure appears to be photorealistic but the suit has some unnatural folds. The lighting looks artificial, particularly on the figure and the sky.
Scaling the Heights: Rock Climbers Defy Gravity on a Majestic Cliff
Witness the breathtaking spectacle of three rock climbers ascending a sheer cliff face, with a sprawling canyon serving as a dramatic backdrop. The climbers’ precarious position and the vastness of the landscape evoke a sense of adventure, daring, and awe-inspiring beauty.
Prompt
poses high-angle: thrilling, dangerous ; A group of adventurers rappelling down a steep cliff face, their ropes dangling against the rock; medium shot; adventure; a dramatic cliff face with a breathtaking view; cinematic
Characteristic
Shot : Three rock climbers ascending a steep cliff face with a deep canyon visible in the background.
Aesthetic Score : 0.7
Mood : adventurous, daring, awe-inspiring
Quality
Entropy : 6.66
Noise : 115
Prompt Clip Score : 0.31
AI Evaluation
Likelihood of AI : 0.10
Image errors : The image appears to be slightly overexposed and the colors are a little washed out.
Lost in the Digital World
A young man, bathed in the blue glow of his computer screen, stares intently at something unseen. The close-up shot and shadowy surroundings create a sense of mystery and intensity, leaving the viewer to wonder what captivating his attention.
Prompt
poses high-angle: immersive, captivating ; A gamer’s face illuminated by the screen, their eyes focused on the intense action unfolding in the virtual world; close-up; gaming; a dimly lit room with a gaming setup; cinematic
Characteristic
Shot : A young man with headphones is looking intently at a computer screen, lit by the glow of the monitor in a darkened room. The composition is tight, focusing on his face and the screen, with the rest of the scene obscured by shadow.
Aesthetic Score : 0.6
Mood : intense, focused, contemplative
Quality
Entropy : 5.96
Noise : 63
Prompt Clip Score : 0.31
AI Evaluation
Likelihood of AI : 0.20
Image errors : No noticeable errors.
Silhouettes of Awe: Witnessing Sunrise on a Mountaintop
Four figures stand in silhouette against a breathtaking sunrise, capturing the tranquility and awe of a mountaintop vista. The dramatic effect of their forms against the golden light evokes a sense of scale and wonder.
Prompt
poses high-angle: inspiring, hopeful ; A group of travelers standing on a mountaintop, their faces lit by the sunrise, gazing out at the breathtaking panorama; medium shot; travel; a majestic mountain range with a panoramic view; cinematic
Characteristic
Shot : Four people are standing on a mountain top, looking out at a sunrise over a valley.
Aesthetic Score : 0.7
Mood : tranquil, awe, serene
Quality
Entropy : 6.93
Noise : 88
Prompt Clip Score : 0.33
AI Evaluation
Likelihood of AI : 0.10
Image errors : No visible errors
Conclusion
The results show that the generative AI model performed well in terms of camera position and shot analysis, but struggled with aesthetic analysis. Here’s a breakdown:
Camera Position:
- Score: 0.48
- Interpretation: This score falls below the “good” range of 0.5 to 0.75. It suggests that the model didn’t perfectly capture the intended camera position described in the prompt.
Shot Analysis:
- Score: 0.585
- Interpretation: This score falls within the “good” range of 0.5 to 0.75. It indicates that the model was able to understand the scene described in the prompt and create an image with a shot composition that aligns well with the prompt’s intent.
Aesthetic Analysis:
- Score: 0.315
- Interpretation: This score is significantly higher than the “very good” range of -0.2 to 0.1. It suggests that the generated image’s aesthetic deviated considerably from the expected aesthetic described in the prompt.
Overall:
The model demonstrates a good understanding of camera position and shot composition, but struggles to accurately capture the desired aesthetic. This suggests that the model might need further training to better understand and translate aesthetic concepts into visual outputs.
Sources:
- https://www.writerswrite.co.za/cheat-sheets-for-writing-body-language/
- https://mads3df.wordpress.com/2013/09/04/storytelling-poses/
- https://www.pinterest.com/pegasister890/character-poses/
- https://www.youtube.com/watch?v=udky6ANxWws
- https://maven.com/articles/storytelling-techniques
- https://deepmind.google/technologies/imagen-3/