Control of lighting in Stable Diffusion

Control of lighting in Stable Diffusion

Jun 11, 2024

Lighting plays a crucial role in photography and has a significant impact on the overall quality of the image and the mood of a picture. You can use lighting to emphasize the subject, create depth and dimension, convey emotion and highlight important details.

image

Image 1: AI generated image of a photo studio in orange light

I will subsequently list up some keywords which can be found in different references to control the lighting.

In my current working local installation it is hard to find out, how good all these keywords work. But one can show, that one word in a Prompt change the behaviour of the image a little bit. It can be called change of emotional impression of a photograph.

I did not check the keywords on Midjourney and Dall-E. But I think they will work there as described in the references. In Stable Diffusion, at least in my installation, the effect has to be tested on a case-by-case basis.

First set of keywords:

  • Continuous Lighting

  • Cozy Indoor Lighting

  • Cozy Outdoor Lighting

  • Back Lighting

  • Bisexual Lighting

  • Broad Lighting

  • Butterfly Lighting

  • Chiaroscuro Lighting

  • Cinematic Lighting

  • Diffused Lighting

  • Dramatic Lighting

  • Flat Lighting

  • Front Lighting

  • Hard Lighting

  • High Contrast Lighting

  • High Key Lighting

  • Indirect Lighting

  • Indoor Photography Lighting

  • Loop Lighting

  • Low Key Lighting

  • Motivated Lighting

  • Natural Lighting

  • Neon Lighting

  • Noir Lighting

  • Outdoor Photography Lighting

  • Rembrandt Lighting

  • Rim Lighting

  • Side Lighting

  • Shimmering Lighting

  • Short Lighting

  • Soft Lighting

  • Specular Lighting

  • Split Lighting

  • Studio Lighting

  • Three Point Lighting

  • Volumetric Lighting

  • Warm Lighting

  • Backlighting

Second set of keywords:

  • Ambient Light

  • Backlight

  • Back Light

  • Bounce Light

  • Broad Light

  • Butterfly Light

  • Flat Light

  • Hard Light

  • Loop Light

  • Natural Light

  • Practical Light

  • Rim Light

  • Ring Light

  • Short Light

  • Soft Light

  • Speedlight

  • Split Light

  • Striplight

  • Strip Light

  • Strobe Light

Additional set of keywords:

  • Sunlight

  • Daylight

  • Dimly Lit

  • Crepuscular Rays

Further set of keywords to control lighting:

  • Bioluminescence

  • Bioluminescent details

  • Bright

  • Bloom

  • Blue moon light effect

  • Caustics

  • Chiaroscuro

  • Clean background

  • Flashgun

  • Global illumination

  • Glowing

  • God rays

  • Halo

  • Hard shadows

  • Iridescent

  • Luminescence

  • Ektachrome

  • Radiant light rays

  • Rays of shimmering light

  • Sun lens light effect

  • Soft lights

  • Soft illumination

  • Subsurface scattering

  • Tindar light effect

  • Translucency

It can be shown that the above keywords work for academic examples. I will show this in another post. For my real world examples, setting the keywords in this way failed most of the time.

And the following should change the image temperature

  • Golden Hour

  • Blue Hour

Terms like the last ones were modifying the color of my image but did not effect the mood of the image.

The following 5 example show, that the keywords for lighting change the image a bit, but the lighting itself is not affected. I thing in further versions of Stable Diffusion this will work better than now.

I tested the keywords from above with no good result. So I modified the one I used up to now to study the effect of the wording.

This is my main problem at the moment when I have the idea to produce a special result. Each word changes everything sometimes surprisingly.

Example 1

medium shot, photograph of a friendly looking beautiful sexy Japanese woman, wearing black chiffon jacket bustier slip, Background Japanese garden, sharp focus, photo realistic, ultra detailed, studio lighting, friendly colors, colorful, 8K

image

Example 2

medium shot, photograph of a friendly looking beautiful sexy Japanese woman, wearing black chiffon jacket bustier slip, Background Japanese garden, sharp focus, photo realistic, ultra detailed, outdoor lighting, friendly colors, colorful, 8K

image

Example 3

medium shot, photograph of a friendly looking beautiful sexy Japanese woman, wearing black chiffon jacket bustier slip, Background Japanese garden, sharp focus, photo realistic, ultra detailed, adorable lighting, friendly colors, colorful, 8K

image

Example 4

medium shot, photograph of a friendly looking beautiful sexy Japanese woman, wearing black chiffon jacket bustier slip, Background Japanese garden, sharp focus, photo realistic, ultra detailed, magic lighting, friendly colors, colorful, 8K

image

Example 5

 medium shot, photograph of a friendly looking beautiful sexy Japanese woman, wearing black chiffon jacket bustier slip, Background Japanese garden, sharp focus, photo realistic, ultra detailed, indirect lighting, friendly colors, colorful, 8K

image

I tested a lot of other expressions. The result was a slightly different image like the one above.

Keep my results in mind I will check if this behaviour will change in the future.

Have a nice day! See you soon back!

Enjoy this post?

Buy zentrocdot a coffee

More from zentrocdot