File:Demonstration of DreamBooth AI model fine-tuning for Stable Diffusion using Jimmy Wales training data from Wikimedia Commons.png
Original file (2,304 × 2,048 pixels, file size: 5.14 MB, MIME type: image/png)
Captions
Summary[edit]
DescriptionDemonstration of DreamBooth AI model fine-tuning for Stable Diffusion using Jimmy Wales training data from Wikimedia Commons.png |
Demonstration of the use of DreamBooth to fine-tune a text-to-image diffusion model (in this particular case, Stable Diffusion) so that it can algorithmically generate highly specialised and customised image outputs. This demonstration features six output images of Jimmy Wales, founder of Wikipedia, performing bench press exercises at a fitness gym.
The model checkpoint was fine-tuned in DreamBooth using 38 different free-licence images of Jimmy Wales obtained from Category:Jimmy Wales on Wikimedia Commons, using Stable Diffusion V1-5 as the base model checkpoint to be trained. Specifically, the following images were used as training data:
Using d8ahazard's DreamBooth_V2 fork of Stable Diffusion web UI created by AUTOMATIC1111, a new model based on Stable Diffusion V1-5 (sd-v1-5-pruned-emaonly.ckpt) was created with "pndm" selected as the scheduler, and the following options were chosen:
The model was then subsequently trained using the 38 images listed earlier. The DreamBooth training process, along with the image generation process outlined later below, was performed using an NVIDIA RTX 4090; since Ada Lovelace chipsets (using compute capability 8.9, which requires CUDA 11.8) are not fully supported by the pyTorch dependency libraries currently used by Stable Diffusion, I've used a custom build of xformers, along with pyTorch cu116 and cuDNN v8.6, as a temporary workaround. After completion of the training of the new model, a batch of 768x1024 images were generated with txt2img in Stable Diffusion, using the model checkpoint taken at 1000 training steps, and with the following prompts:
|
Date | |
Source | Own work |
Author | Benlisquare |
Permission (Reusing this file) |
As the creator of the output images, I release this image under the licence displayed within the template below.
The Stable Diffusion AI model is released under the CreativeML OpenRAIL-M License, which "does not impose any restrictions on reuse, distribution, commercialization, adaptation" as long as the model is not being intentionally used to cause harm to individuals, for instance, to deliberately mislead or deceive, and the authors of the AI models claim no rights over any image outputs generated, as stipulated by the license.
The Stable Diffusion implementation of DreamBooth by XavierXiao, of which d8ahazard's DreamBooth_V2 fork of the Stable Diffusion web UI is based on, is licenced under the MIT License.
|
Licensing[edit]
- You are free:
- to share – to copy, distribute and transmit the work
- to remix – to adapt the work
- Under the following conditions:
- attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in the section entitled GNU Free Documentation License.http://www.gnu.org/copyleft/fdl.htmlGFDLGNU Free Documentation Licensetruetrue |
File history
Click on a date/time to view the file as it appeared at that time.
Date/Time | Thumbnail | Dimensions | User | Comment | |
---|---|---|---|---|---|
current | 10:35, 8 August 2023 | 2,304 × 2,048 (5.14 MB) | Obscure2020 (talk | contribs) | Optimized with OxiPNG and ZopfliPNG. | |
18:47, 4 November 2022 | 2,304 × 2,048 (6.04 MB) | Benlisquare (talk | contribs) | {{Information |Description=Demonstration of the use of DreamBooth to fine-tune a text-to-image diffusion model (in this particular case, Stable Diffusion) so that it can algorithmically generate highly specialised and customised image outputs. This demonstration features six output images of Jimmy Wales, founder of Wikipedia, performing bench press exercises... |
You cannot overwrite this file.
File usage on Commons
The following 3 pages use this file:
File usage on other wikis
The following other wikis use this file:
- Usage on ca.wikipedia.org
- Usage on en.wikipedia.org
- Usage on en.wikibooks.org
- Usage on es.wikipedia.org
- Usage on fr.wikipedia.org
- Usage on zh.wikipedia.org