Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
Condimentalist
Jun 13, 2007
I don’t have any images to share (yet…?) but this thread convinced me to download stable diffusion and start messing around - it’s incredible that these images can be generated in “real time” on my modest home computer!

Adbot
ADBOT LOVES YOU

KwegiboHB
Feb 2, 2004

nonconformist art brut
Negative prompt: amenable, compliant, docile, law-abiding, lawful, legal, legitimate, obedient, orderly, submissive, tractable
Steps: 32, Sampler: DPM++ 2M Karras, CFG scale: 11, Seed: 520244594, Size: 512x512, Model hash: 99fd5c4b6f, Model: seekArtMEGA_mega20

Lord of the rivets posted:

I found that using terms like tattered, broken, torn about clothes can be very good for making post-apocalyptic images in stable diffusion.

There is an entire postapocalypse model out and it's pretty awesome https://civitai.com/models/1136/postapocalypse it might be right up your alley.


postapocalypse armored dog
Negative prompt: soft, cuddly
Steps: 48, Sampler: DPM++ 2M Karras, CFG scale: 7.5, Seed: 3720845338, Size: 768x768, Model hash: 4ef65125


Condimentalist posted:

I don’t have any images to share (yet…?) but this thread convinced me to download stable diffusion and start messing around - it’s incredible that these images can be generated in “real time” on my modest home computer!
Welcome! So begins your wild and weird journey through latent space! You will have questions, feel free to ask them here and we'll do our best to answer them. Can't wait to see what you come up with!

busalover
Sep 12, 2020

KakerMix posted:

:hmmyes:








The power of img2img.
Protogen Infinity model (lol at their attempt at licensing lol) , prompt a variation of:

(subject and what they are doing if anything) post-apocalypse survivor in a burned/bombed-out dead forest/meadow/small town/city, serious expression, tattered, broken, torn about clothes, dirty skin, unhappy, kodachrome photo 1975

Negative prompts of your choosing, see what works. I used:

watermark, cropped, makeup, cartoon, 3d, (disfigured), (bad art), (deformed), (poorly drawn), (extra limbs)


wow I thought these are the originals the other images are based on. Confusing times.

LifeSunDeath
Jan 4, 2007

still gay rights and smoke weed every day

busalover posted:

wow I thought these are the originals the other images are based on. Confusing times.

Mischievous Mink
May 29, 2012





pixaal
Jan 8, 2004

All ice cream is now for all beings, no matter how many legs.


I'm really liking home made for costume design right now. Leaning into the topic of apocalypse and clowns

Danny Devito Joker, apocalyptic, worn down, exhausted, torn clothing, used, home made, old




Fitzy Fitz
May 14, 2005




Doing some forests in the style of old Rankin Bass animation. Prompt is variations of "1970s. Topcraft animation. Magical forest. Highly detailed. Focused. Intricate." with the "cheesedaddy" landscape model. I would be interested to see how these could be improved.

deep dish peat moss
Jul 27, 2006





I don't know what exactly it is but I'm really digging this style :allears: I tried to accomplish the same thing in SD but it's not going so well, mostly due to me not being well versed in SD use.


Some keywords for MJ to evoke the same style: "Dreamglitch", "Cosmic Circuitry", "divine glyphs", "dreary", "surreal ASCII", "Astral". Just be extremely pretentious about your prompts! Write prompts about surreal ASCII liminal dreamglitch astral sunrises over the forbidden city under a rain of divine glyphs and cosmic circuitry or whatever

Literal example prompt:
Ominous comet over dreary suburb. Liminal DreamGlitch. Surreal but beautiful cosmic circuitry. Made by surreal ascii art style with divine glyphs instead of letters.

e: I'm actually pretty curious to see how well it works for others, I've been "training" the phrase "dreamglitch" by using it a lot and rating images I generate with it, and as far as I can tell from searching the community feed it's a phrase no one else is using (at least publicly) so it should in theory be skewed heavily towards this kind of art, but I haven't had a chance to really test it and see if that's really having an effect as opposed to the rest of my promptwriting overall. For example, the prompt "dreamglitch cityscape" will give you something vaguely like this, and throwing in the ascii bit does a lot of the rest of the heavy lifting:
(dreamglitch cityscape)
(dreamglitch ascii cityscape)
But back when I started this project, I don't remember it being so distinct.

e2: But I am pretty sure this "training" is style/model specific and will require --style 4a to get the effects of my "training" (if there are any). Using --4b (or no style tag) will most likely include lots of human faces built into the landscape (possibly because I used the same prompt format on 4b to generate a ton of portraits :v: ) and --niji can do some neat things with this prompt format but it will rarely style match the others.

My earliest use of the same phrasing was giving me stuff like this, which is still extremely cool IMO but distinctly different:


And from there it's morphed more into "full scene" kind of things, with more patterns in the dots/lines. :shrug: Maybe just confirmation bias.

deep dish peat moss fucked around with this message at 22:04 on Jan 31, 2023

Fuzz
Jun 2, 2003

Avatar brought to you by the TG Sanity fund

deep dish peat moss posted:





I don't know what exactly it is but I'm really digging this style :allears: I tried to accomplish the same thing in SD but it's not going so well, mostly due to me not being well versed in SD use.


Some keywords for MJ to evoke the same style: "Dreamglitch", "Cosmic Circuitry", "divine glyphs", "dreary", "surreal ASCII"

Holy poo poo these are awesome.

KwegiboHB
Feb 2, 2004

nonconformist art brut
Negative prompt: amenable, compliant, docile, law-abiding, lawful, legal, legitimate, obedient, orderly, submissive, tractable
Steps: 32, Sampler: DPM++ 2M Karras, CFG scale: 11, Seed: 520244594, Size: 512x512, Model hash: 99fd5c4b6f, Model: seekArtMEGA_mega20

Fitzy Fitz posted:

Doing some forests in the style of old Rankin Bass animation. Prompt is variations of "1970s. Topcraft animation. Magical forest. Highly detailed. Focused. Intricate." with the "cheesedaddy" landscape model. I would be interested to see how these could be improved.
I'm not sure if they would actually be improved, these are pretty cool as they are right now, but there are some textual embeddings that might change things up a bit.
https://civitai.com/models/1998/autumn-style
https://civitai.com/models/2623/winter-style
https://civitai.com/models/4843/floral-style
Maybe worth a shot.

Fitzy Fitz
May 14, 2005




KwegiboHB posted:

I'm not sure if they would actually be improved, these are pretty cool as they are right now, but there are some textual embeddings that might change things up a bit.
https://civitai.com/models/1998/autumn-style
https://civitai.com/models/2623/winter-style
https://civitai.com/models/4843/floral-style
Maybe worth a shot.

I'll need to learn how to use these. I don't think they work with this NMKD version I've been using.

KwegiboHB
Feb 2, 2004

nonconformist art brut
Negative prompt: amenable, compliant, docile, law-abiding, lawful, legal, legitimate, obedient, orderly, submissive, tractable
Steps: 32, Sampler: DPM++ 2M Karras, CFG scale: 11, Seed: 520244594, Size: 512x512, Model hash: 99fd5c4b6f, Model: seekArtMEGA_mega20
It looks like they go in baseinstall/ExampleConcepts and are loaded with the Load Concept button on the UI. Let me know if you get it to work, I'm not used to NMKD.

Mr Luxury Yacht
Apr 16, 2012


So in my efforts to recreate a bunch of the characters and environments from my current D&D campaign, I'm running into a few consistent issues I'm not sure if I can solve with different prompts or models or sampling methods or something.

1. If I want a character with a more novel skin color (red/blue tiefling, grey goliath, green half orc/gith, etc...), it's hard to find a prompt that doesn't make everything the same colour as the skin. It'll make a green skinned orc or goblin but even when I try to add prompts explicitly describing the environment it'll make that also green, or heavily lit with green light, that sort of thing.

2. Gnomes seem pretty much impossible unless you want them to look like garden gnomes with the red hat and beard. Tried different variations to generate a pic for our group's gnome ranger and the results always looks like a disgruntled David the Gnome. It's also tricky to get it to make gnomes or halflings actually short.


For a lot of other stuff it's great though. Dungeon scenes, monsters, human/elf/dwarf character portraits, etc... A lot of the newer models are way better than standard SD 1.4/1.5 at those things with the caveats above.

Mr Luxury Yacht fucked around with this message at 01:30 on Feb 1, 2023

KakerMix
Apr 8, 2004

8.2 M.P.G.
:byetankie:

Mr Luxury Yacht posted:

So in my efforts to recreate a bunch of the characters and environments from my current D&D campaign, I'm running into a few consistent issues I'm not sure if I can solve with different prompts or models or sampling methods or something.

1. If I want a character with a more novel skin color (red/blue tiefling, grey goliath, green half orc/gith, etc...), it's hard to find a prompt that doesn't make everything the same colour as the skin. It'll make a green skinned orc or goblin but even when I try to add prompts explicitly describing the environment it'll make that also green, or heavily lit with green light, that sort of thing.

2. Gnomes seem pretty much impossible unless you want them to look like garden gnomes with the red hat and beard. Tried different variations to generate a pic for our group's gnome ranger and the results always looks like a disgruntled David the Gnome. It's also tricky to get it to make gnomes or halflings actually short.


For a lot of other stuff it's great though. Dungeon scenes, monsters, human/elf/dwarf character portraits, etc... A lot of the newer models are way better than standard SD 1.4/1.5 at those things with the caveats above.

I mean I know it isn't what most people want to hear, but inpainting can solve most of this. Just attempt to generate the person you want, then inpaint their skin, then change the prompt to 'blue skin' or whatever at the front and leave the rest, see what comes out.
Likewise with the gnomes I'd just do 'dwarf' or unfortunately insensitive language like 'midget' and see what comes up. You're slaved to whatever the images are tagged as, which might include other words for dwarves.

Megazver
Jan 13, 2006
https://www.reddit.com/r/StableDiffusion/comments/10gfwaq/dungeons_and_diffusion_final_version_beautiful/ has gnomes

Elotana
Dec 12, 2003

and i'm putting it all on the goddamn expense account

stringless
Dec 28, 2005

keyboard ⌨️​ :clint: cowboy

At some point recently, Civitai started putting the text prompts for example images directly in the viewer, if they're available. Pretty handy.

Doctor Zero
Sep 21, 2002

Would you like a jelly baby?
It's been in my pocket through 4 regenerations,
but it's still good.

Mr Luxury Yacht posted:

So in my efforts to recreate a bunch of the characters and environments from my current D&D campaign, I'm running into a few consistent issues I'm not sure if I can solve with different prompts or models or sampling methods or something.

1. If I want a character with a more novel skin color (red/blue tiefling, grey goliath, green half orc/gith, etc...), it's hard to find a prompt that doesn't make everything the same colour as the skin. It'll make a green skinned orc or goblin but even when I try to add prompts explicitly describing the environment it'll make that also green, or heavily lit with green light, that sort of thing.

2. Gnomes seem pretty much impossible unless you want them to look like garden gnomes with the red hat and beard. Tried different variations to generate a pic for our group's gnome ranger and the results always looks like a disgruntled David the Gnome. It's also tricky to get it to make gnomes or halflings actually short.


For a lot of other stuff it's great though. Dungeon scenes, monsters, human/elf/dwarf character portraits, etc... A lot of the newer models are way better than standard SD 1.4/1.5 at those things with the caveats above.

Look into and start playing around with prompt weighting. You can make various aspects of the prompt more important than others. Also negative prompts. Unfortunately there’s no magic formula, so you will need to mess around and see what works best for what you are after.

Like maybe MJ-style “dungeons and dragons gnome bard” —no garden

ymgve
Jan 2, 2004


:dukedog:
Offensive Clock
Google has a new text-to-music thing with some examples: https://google-research.github.io/seanet/musiclm/examples/

Vlaphor
Dec 18, 2005

Lipstick Apathy
https://www.twitch.tv/watchmeforever

A chatgpt made version of an eternal animated Seinfeld episode that is always running. It's kind of addicting to watch, but it also shows that writers jobs are safe.

Watching it for a long time makes me feel like my brain is going to melt.

Vlaphor fucked around with this message at 12:14 on Feb 1, 2023

Rotacixe
Oct 21, 2008

Vlaphor posted:

https://www.twitch.tv/watchmeforever

A chatgpt made version of an eternal animated Seinfeld episode that is always running. It's kind of addicting to watch, but it also shows that writers jobs are safe.

Watching it for a long time makes me feel like my brain is going to melt.

It says OpenAI's GPT-3 in the description. The quality of the output would suggest that they are using one of the faster and cheaper models, or maybe the good GPT-3 version is not that great either. I don't think ChatGPT is available as an API yet.

mobby_6kl
Aug 9, 2009

by Fluffdaddy
There's a pretty good article summarizing all the generative AI progress recently. Probably not entirely new information for the regulars ITT: https://arstechnica.com/gadgets/2023/01/the-generative-ai-revolution-has-begun-how-did-we-get-here/?comments=1&comments-page=1

Sedgr
Sep 16, 2007

Neat!

AI Birthday Cake came out a little more dystopian than intended.

LifeSunDeath
Jan 4, 2007

still gay rights and smoke weed every day

Sedgr posted:

AI Birthday Cake came out a little more dystopian than intended.



I got these:


someone else made this LOL:


"she wasn't lying, that rear end can fart."

Fitzy Fitz
May 14, 2005




Added "Hiro Isono" to my previous prompt to get these.

busalover
Sep 12, 2020
Looks p chill. Like doom metal cover art.

busalover
Sep 12, 2020
https://i.imgur.com/UcG2Du5.mp4

FutonForensic
Nov 11, 2012


You haven't watched The Godfather until you've watched the Dialogue Removal cut

Fitzy Fitz
May 14, 2005





Somewhat excited for the potential of dubbing foreign media. Probably really expensive and won't be used for anything I watch though.

pixaal
Jan 8, 2004

All ice cream is now for all beings, no matter how many legs.


Fitzy Fitz posted:

Somewhat excited for the potential of dubbing foreign media. Probably really expensive and won't be used for anything I watch though.

Like everything AI this will keep coming down until you can do it at home. Right now that clip probably took a ton of processing time. Are there any stats on this?

ymgve
Jan 2, 2004


:dukedog:
Offensive Clock

Fitzy Fitz posted:

Somewhat excited for the potential of dubbing foreign media. Probably really expensive and won't be used for anything I watch though.

They're gonna use the state of the art AI to resync lips but still have every character voiced by the same monotone guy

hydroceramics
Jan 8, 2014
The Mona Lisa cheeseburger horrors got me thinking about what she would look like painted by different artists.

Andy Warhol:


Bob Ross:


Banksy:


Frida Kahlo:


Salvador Dali:


Frank Frazetta:


And finally, Lisa Frank:

mobby_6kl
Aug 9, 2009

by Fluffdaddy
Ok another interesting article on reconstructing training images.





https://arstechnica.com/information-technology/2023/02/researchers-extract-training-images-from-stable-diffusion-but-its-difficult/

From a quick look, it seems that only a small percentage of images that had duplicates in the training set were sufficiently memorized by the model. We've seen that over-trained images like the Mona Lisa can be reproduced pretty well so under some conditions more obscure stuff works too. Not that shocking.

deep dish peat moss
Jul 27, 2006

ymgve posted:

They're gonna use the state of the art AI to resync lips but still have every character voiced by the same monotone guy

I love how you can tell when a movie is dubbed these days without even looking at it, because that guy that has all the inflection of Microsoft Sam voices them all

TIP
Mar 21, 2006

Your move, creep.



ymgve posted:

They're gonna use the state of the art AI to resync lips but still have every character voiced by the same monotone guy

one of the cool things with voice cloning AI is you can take the original dialog and replace it with the same actor's voice speaking in a different language while maintaining the performance

once they put all the pieces together it's gonna be really cool and "dubbed" might actually be the better way to watch foreign films

deep dish peat moss
Jul 27, 2006

Applying my recent style experiments with MJ to img2img generations based on my own drawings:




These were all made from combining the prompt structure I've been using with this old drawing as an image prompt:



If anyone's interested there are some old posts I made ITT about my experiments/findings with using your own drawings (even if it's bad/childish lineart mspaint kind of stuff) to guide MJ, they can be found here, here, and here. MJ v4 is extremely powerful when used this way!

deep dish peat moss fucked around with this message at 23:03 on Feb 1, 2023

Elotana
Dec 12, 2003

and i'm putting it all on the goddamn expense account

mobby_6kl posted:

Ok another interesting article on reconstructing training images.





https://arstechnica.com/information-technology/2023/02/researchers-extract-training-images-from-stable-diffusion-but-its-difficult/

From a quick look, it seems that only a small percentage of images that had duplicates in the training set were sufficiently memorized by the model. We've seen that over-trained images like the Mona Lisa can be reproduced pretty well so under some conditions more obscure stuff works too. Not that shocking.
To me this paper wasn't so much interesting for the content as the *way* it was written and sold. Overfitting off multiple images is known, but they got less than one-in-a-million duplicates to overfit from StableDiffusion despite targeting them specifically, and the single-image overfits only happened with Google's Imagen. But the paper was written in a broad and maximally inflammatory way for copyright hawks (adopting the bespoke term "memorization" instead of "overfit" to talk about the same phenomenon), and the summary Tweets are another step up from that, so now the QTs are full of people hollering that it proves that the models were just lookup tables or collage machines all along.

Google has the red-rear end over getting beaten to the punch on all this AI stuff, and I expect instead of polishing some of the dozens of AI models in their internal vaults, and releasing them, they're instead going to start making GBS threads on OpenAI and all these startups for being "unsafe" because they did only a 99.9999% good job de-duping their image data.

Elotana fucked around with this message at 00:19 on Feb 2, 2023

KakerMix
Apr 8, 2004

8.2 M.P.G.
:byetankie:

TIP posted:

one of the cool things with voice cloning AI is you can take the original dialog and replace it with the same actor's voice speaking in a different language while maintaining the performance

once they put all the pieces together it's gonna be really cool and "dubbed" might actually be the better way to watch foreign films

Speaking of the whole voice thing, don't think it's been posted in this thread yet, examples of right-now AI tech:

https://vocaroo.com/13IHEGRtZdRC

https://vocaroo.com/1cFrjVcWRRJt

https://vocaroo.com/18SiPVf5Y4cP

https://vocaroo.com/16Eg6fcMrc00

https://vocaroo.com/1hyWO1Av1yav

https://vocaroo.com/15GFeddYbT1K

It can be messed with right now:
https://beta.elevenlabs.io/speech-synthesis

:pcgaming:

LifeSunDeath
Jan 4, 2007

still gay rights and smoke weed every day

WOW

Adbot
ADBOT LOVES YOU

deep dish peat moss
Jul 27, 2006


This is very impressive, I stuck some random notes I have about game design/stories/whatever into it and it nailed the pronunciation and inflection even with a complete lack of punctuation and using completely made-up words. Also, what a great way to proofread text, having a voice read it back to you in an unmistakably literal way.

Also lol at your examples.

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply