cragsand, (edited )

I learned how to train LoRa AI models using open source StableDiffusion...

For the purpose of recreating the appearance of my 3D VR roleplaying character the results I got were amazingly good... almost frighteningly so.

I'll go through the process, results and some thoughts.

🧵 part 1of4

cragsand, (edited )

So much of the majority of AI art I see is terrible, bad looking and deformed. But with the right instruction's it doesn't have to be.

To accurately create fictional characters, this is probably the best method I've seen so far. There's work involved for training a model like this and not something you can just give a bunch of prompts and expect good results.

I started by gathering 64 screenshots of my 3D VRChat model from Blender in various positions and angles in different lighting while wearing select clothing of choice. Then I added proper tags describing each image in a respective text file.

Based on the training data and they keywords I specified, you can input various clothing alternatives including:

  • armor
  • jacket
  • shirt
  • barechest
    Training took about 30 minutes using an RTX2080Ti GPU.

cragsand, (edited )

These guides were really useful for explaining complex concepts without having the understanding of the mathematics involved. It tends to get really complicated the deeper you delve into it.
https://rentry.org/lora_train
https://rentry.org/59xed3

The GUI for stable diffusion I'm using is completely open source written in Python for everyone to use https://github.com/AUTOMATIC1111/stable-diffusion-webui

I posted the LoRa AI training model publicly for download here for anyone curious: https://civitai.com/models/70408/cragsand-character-lora-sten-berglund

Since I really liked the results I ended retouching some parts manually. Things like eye color, fingers and random clutter where there were details that looked weird.

The end results are available in this gallery here: https://www.deviantart.com/cragsand/gallery/87722291/sten-berglund-character-artwork

cragsand, (edited )

End thoughts...

With this technology gaining traction I certainly sympathize with artists concerned about their profession being in danger. It's a topic worth discussing and what it's societal effects will be. I can certainly see it ending up being bad and requiring proper regulation.

One thought on my mind would be that these are "tools" for us to use, and as with any tools if they're good or bad ends up being determined by how they're used. It's not the technology itself that is the danger, but rather how corporations and bad interests may exploit it to the detriment of everyone else.

Curious to hear other's thoughts about this and how we can approach it in a way that is beneficial for everyone.

Thank you for reading the thread ! 💙

cragsand,

Amazing...

I put my roleplaying character lora through a photorealistic model named "AmIRealV3".

Even though it was just trained on screenshots in various lighting conditions from VRChat, Unity and Blender it still works great with photorealism.

https://civitai.com/models/49463/am-i-real

  • All
  • Subscribed
  • Moderated
  • Favorites
  • ai
  • Durango
  • DreamBathrooms
  • thenastyranch
  • magazineikmin
  • tacticalgear
  • khanakhh
  • Youngstown
  • mdbf
  • slotface
  • rosin
  • everett
  • ngwrru68w68
  • kavyap
  • InstantRegret
  • JUstTest
  • cubers
  • GTA5RPClips
  • cisconetworking
  • ethstaker
  • osvaldo12
  • modclub
  • normalnudes
  • provamag3
  • tester
  • anitta
  • Leos
  • megavids
  • lostlight
  • All magazines