Skip to content
This repository has been archived by the owner on Mar 12, 2023. It is now read-only.

beothorn/DuckLibrary

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

47 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Discontinued

When I created this repository, there where only a few models and it made sense to understand how different inputs changed the image.
This may still make sense for closed models like dalle or midjourney, but anyone who wants to have better control over the output sould be using the open stable diffusion.
A few months later, the amount of new models, new ways to generate and control the output are so many and so flexible that creating an image from prompt alone with the vanilla models don't make any sense anymore. I encourage you to visit r/StableDiffusion and look for things like Dreambooth, Lora, Controlnet or whathever new thing is being used right now.

DuckLibrary

A collection of prompt effects for image generation AIs applied to ducks

logo created by dalle

What is this?

There has been a surge of services that transform prompts into images, such as Dalle, Craiyon, Midjourney, Imagen, Stable diffusion and many others.

With time users have realized that some prompt patterns can be used to achieve similar results with different subjects.

Knowing those patterns is important to optimize the resulting images, with as little generations as possible.

This is being called "prompt engineering" and this an ongoing effort to catalog such patterns and their effects.

These patterns are referenced here as "prompt effects"

The database

This is a collection of prompt templates (prompt effects) and the resulting images from applying them to a duck.

Each prompt effect entry is a JSON file inside the folder duckbase.

The json structure looks like this:

{
  
  "template": "[subject], dramatic backlighting", // A template containg at least the token [subject]
  "name": "DramaticBacklighting", // Unique name
  "effect": "Adds a background light to the image, the subject front has low light", // Description of effect. This is intended to be used by a search so it needs to be a direct description what it does to the output
  "tags": ["light", "photography"], // Tags that fit the prompt effect
  "prompt": "A duck, dramatic backlighting", // A string with the prompt used to create the generations
  "generations": [ // An array of generated images using "A duck" as subject
    {
      "service": "dalle", // Service name
      "date": "2022-04-23", // Date of generation, this helps track model changes
      "images": [ // Array with the urls pointing to the generated images
        "https://raw.githubusercontent.com/beothorn/DuckLibrary/main/images/dalle/DALL%C2%B7E%202022-08-12%2021.19.41%20-%20A%20duck%2C%20dramatic%20backlighting.png",
      ]
    },
    {
      "service": "craiyon",
      "date": "2022-08-12",
      "images": [
        "https://github.com/beothorn/DuckLibrary/raw/main/images/craiyon/cr_DramaticBackgroundLight1.jpeg", 
      ]
    }
  ]
}

Tokens

  • subject - What will be rendered, on the generations provided here this is always "A duck"
  • color - A color name

Services

  • dalle
  • craiyon
  • midjourney
  • imagen
  • stable_diffusion

Tags

  • light - Modifies the lighting of the scene.
  • photography - Either converts to a photography or affects it
  • style - Applies some style, check the description
  • illustration - Either converts to an illustration or affects it
  • 3d - Render something that looks like a 3d render

Contributing

You can:

  • Open an issue with all required fields.
  • Open a Pull Request with the entry.
  • Generate an existing prompt effect with a duck and submit it as an issue.

Important

The prompt subject needs to be "A duck" unless the effect only works on a different subject. This way it is easier to see the effect being applied.

About

A collection of prompt effects for image generation AIs

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages