prithivMLmods's picture
Update README.md
df10f60 verified
metadata
tags:
  - text-to-image
  - lora
  - diffusers
  - template:diffusion-lora
widget:
  - text: >-
      Sketch Sized, A medium-sized painting of Wall-E, painted in shades of
      yellow and black. His eyes, large and round, are painted in a glossy
      silver, giving a curious and endearing expression. His body is detailed
      with scratches and rust, hinting at years of service. The small, claw-like
      hands are slightly raised, as if reaching for something. The background is
      a soft sandy beige, with faint hints of scattered stars and dust.
    output:
      url: images/8.png
  - text: >-
      Sketch Sized, A painting of a Christmas tree, painted in vibrant shades of
      green and gold. The tree is adorned with shimmering red and silver
      ornaments, with strings of golden lights winding gracefully around the
      branches. A bright golden star sits atop the tree, glowing softly. Beneath
      the tree are a few brightly wrapped presents in red, blue, and green. The
      background is a warm beige with subtle snowflake patterns, adding a
      festive touch.
    output:
      url: images/9.png
  - text: >-
      Sketch Sized, A painting of Elon Musks face, painted in shades of silver
      and white. His eyes are a piercing ice blue, and his expression is one of
      quiet determination. His short hair is textured with metallic silver
      highlights, giving it a futuristic sheen. A faint circuit board pattern is
      embedded subtly into his skin. The background is a gradient of light gray,
      fading into deep space black.
    output:
      url: images/10.png
  - text: >-
      Sketch Sized, A painting of a mans face, painted in a vibrant shade of
      green. The mans eyes are a deep red, and his head is adorned with a spiky
      black headband. His eyebrows are a darker shade of red, adding a pop of
      color to the painting. The background of the painting is a light beige,
      creating a stark contrast to the green face.
    output:
      url: images/1.png
  - text: >-
      Sketch Sized, A medium-sized painting of a womans face, painted in blue
      and yellow. The womans head is tilted slightly to the left, with her right
      side facing the viewer. Her eyes are squinted and her lips are slightly
      parted. Her hair is pulled back in a ponytail, with the top of her head
      turned to the right. She is wearing a blue scarf around her neck, and a
      blue shirt with a collar around the neck. The background of the painting
      is a light beige color.
    output:
      url: images/2.png
  - text: >-
      Sketch Sized, A medium-sized painting of a womans face, painted in blue
      and black. Her eyes are squinted and her mouth is slightly open. Her hair
      is pulled back and cascades over her shoulders. She is wearing a blue
      shirt with a collar around her neck. The background is a light beige
      color. The painting is done in a simple, hand-drawn style.
    output:
      url: images/3.png
  - text: >-
      Sketch Sized, A medium-sized painting of a womans face, painted in a
      vibrant shade of green. The womans eyes are wide open, and her mouth is
      slightly open. Her eyebrows are a darker shade of brown, while her hair is
      a lighter shade of a darker green. Her hair is pulled back in a ponytail,
      adding a touch of texture to the painting. The background of the painting
      is a light beige, and there is a small black dot at the bottom of the
      image.
    output:
      url: images/4.png
  - text: >-
      Sketch Sized, A painting of a mans face, painted in earthy tones of brown
      and green. His eyes are a striking shade of emerald green, and his thick
      eyebrows match the dark brown of his short, tousled hair. He has a faint
      green tattoo resembling vines curling along his neck. The background is a
      soft, sandy beige, evoking a natural, earthy vibe.
    output:
      url: images/5.png
  - text: >-
      Sketch Sized, A medium-sized painting of a cats face, painted in shades of
      teal and white. The cat has striking amber eyes with a mischievous
      sparkle. Its fur is short and patterned with teal stripes on a white base.
      A small, pink nose and long whiskers add a touch of detail. The background
      is a soft pastel peach, which contrasts with the vibrant teal fur.
    output:
      url: images/6.png
  - text: >-
      Sketch Sized, A painting of Iron Mans helmet, painted in metallic red and
      gold. The glowing blue eyes stand out against the smooth, polished armor.
      The red and gold plating reflects streaks of light, giving a dynamic,
      futuristic look. The edges of the helmet are detailed with fine lines and
      grooves. The background is a dark charcoal gray, with faint streaks of
      blue energy radiating outward.
    output:
      url: images/7.png
base_model: black-forest-labs/FLUX.1-dev
instance_prompt: Sketch Sized
license: creativeml-openrail-m

zzzzzzzzz.png

Prompt
Sketch Sized, A medium-sized painting of Wall-E, painted in shades of yellow and black. His eyes, large and round, are painted in a glossy silver, giving a curious and endearing expression. His body is detailed with scratches and rust, hinting at years of service. The small, claw-like hands are slightly raised, as if reaching for something. The background is a soft sandy beige, with faint hints of scattered stars and dust.
Prompt
Sketch Sized, A painting of a Christmas tree, painted in vibrant shades of green and gold. The tree is adorned with shimmering red and silver ornaments, with strings of golden lights winding gracefully around the branches. A bright golden star sits atop the tree, glowing softly. Beneath the tree are a few brightly wrapped presents in red, blue, and green. The background is a warm beige with subtle snowflake patterns, adding a festive touch.
Prompt
Sketch Sized, A painting of Elon Musks face, painted in shades of silver and white. His eyes are a piercing ice blue, and his expression is one of quiet determination. His short hair is textured with metallic silver highlights, giving it a futuristic sheen. A faint circuit board pattern is embedded subtly into his skin. The background is a gradient of light gray, fading into deep space black.
Prompt
Sketch Sized, A painting of a mans face, painted in a vibrant shade of green. The mans eyes are a deep red, and his head is adorned with a spiky black headband. His eyebrows are a darker shade of red, adding a pop of color to the painting. The background of the painting is a light beige, creating a stark contrast to the green face.
Prompt
Sketch Sized, A medium-sized painting of a womans face, painted in blue and yellow. The womans head is tilted slightly to the left, with her right side facing the viewer. Her eyes are squinted and her lips are slightly parted. Her hair is pulled back in a ponytail, with the top of her head turned to the right. She is wearing a blue scarf around her neck, and a blue shirt with a collar around the neck. The background of the painting is a light beige color.
Prompt
Sketch Sized, A medium-sized painting of a womans face, painted in blue and black. Her eyes are squinted and her mouth is slightly open. Her hair is pulled back and cascades over her shoulders. She is wearing a blue shirt with a collar around her neck. The background is a light beige color. The painting is done in a simple, hand-drawn style.
Prompt
Sketch Sized, A medium-sized painting of a womans face, painted in a vibrant shade of green. The womans eyes are wide open, and her mouth is slightly open. Her eyebrows are a darker shade of brown, while her hair is a lighter shade of a darker green. Her hair is pulled back in a ponytail, adding a touch of texture to the painting. The background of the painting is a light beige, and there is a small black dot at the bottom of the image.
Prompt
Sketch Sized, A painting of a mans face, painted in earthy tones of brown and green. His eyes are a striking shade of emerald green, and his thick eyebrows match the dark brown of his short, tousled hair. He has a faint green tattoo resembling vines curling along his neck. The background is a soft, sandy beige, evoking a natural, earthy vibe.
Prompt
Sketch Sized, A medium-sized painting of a cats face, painted in shades of teal and white. The cat has striking amber eyes with a mischievous sparkle. Its fur is short and patterned with teal stripes on a white base. A small, pink nose and long whiskers add a touch of detail. The background is a soft pastel peach, which contrasts with the vibrant teal fur.
Prompt
Sketch Sized, A painting of Iron Mans helmet, painted in metallic red and gold. The glowing blue eyes stand out against the smooth, polished armor. The red and gold plating reflects streaks of light, giving a dynamic, futuristic look. The edges of the helmet are detailed with fine lines and grooves. The background is a dark charcoal gray, with faint streaks of blue energy radiating outward.

Model description for Flux-Sketch-Sized-LoRA

Image Processing Parameters

Parameter Value Parameter Value
LR Scheduler constant Noise Offset 0.03
Optimizer AdamW Multires Noise Discount 0.1
Network Dim 64 Multires Noise Iterations 10
Network Alpha 32 Repeat & Steps 27 & 3490
Epoch 20 Save Every N Epochs 1
Labeling: florence2-en(natural language & English)

Total Images Used for Training : 30 [ 14 bit raw ]

Best Dimensions & Inference

Dimensions Aspect Ratio Recommendation
1280 x 832 3:2 Best
1024 x 1024 1:1 Default

Inference Range

  • Recommended Inference Steps: 30–35

Setting Up

import torch
from pipelines import DiffusionPipeline

base_model = "black-forest-labs/FLUX.1-dev"
pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16)

lora_repo = "strangerzonehf/Flux-Sketch-Sized-LoRA"
trigger_word = "Sketch Sized"  
pipe.load_lora_weights(lora_repo)

device = torch.device("cuda")
pipe.to(device)

Trigger words

You should use Sketch Sized to trigger the image generation.

Download model

Weights for this model are available in Safetensors format.

Download them in the Files & versions tab.