NerdyRodent

ComfyUI's New Look

Updated ComfyUI recently? Notice anything... different? Want to make it even more different? Open Settings via the little cog...

... and you should see the [Beta] Use new menu and workflow management:

<...

Train Your Own Flux.1 LoRA

Video - https://youtu.be/7AhQcdqnwfs

Flux is a great model with loads of potential, but when it comes to generating images with almost any art style it can struggle a bit. You may also wish to add your own face, a pet or indeed anything you have some images of!

Woodblock art style withou...

Flux.1 + Lora + Controlnet!

Even more Flux.1 updates - workflow attached as usual :)

If you've not updated ComfyUI in the last 16 hours, then you won't yet have the new ControlNet support, so be sure to update now :)

Loads of other updates top the workflows:

• Optimised node placement so that bypassing IMG2IMG i...

  2024-08-13 20:20:28 +0000 UTC View Post

Bonus: Flux "Negative Prompt" at CFG 1.0

Many of us have become used to using a negative prompt when generating images using Stable Diffusion, so going back to CFG 1.0 and not using a negative prompt can feel a bit like losing a favourite tool of some sort

There is a newer version out which I haven't actually tried as yet, but hopefully it (or others) can do much the same thing!

Anyway, the thing I've been testing is with ...

AI Enhanced Flux

Flux Updates!

Things are moving along nicely in the Flux.1 world and soon we'll have things like controlnets, loras! But, for now at least, we've got image-to-image and LLM assistants. These ComfyUI workflows are similar to the previous ones, but updated to use the standard "KSampler" and "Loa...

Flux is awesome! :)

AuraFlow 0.2, AuraSR v2 and Flux? So many new things!

Flux is most certainly worth a try, but both models will benefit from fairly beefy systems with at least 24GB VRAM and 32GB RAM, so beware to go slow if you don't meet the specs.

4 steps, amazing quality... what will we see in a few mon...

Bonus: AuraFlow 0.2 testing :)

As with the previous AuraFlow 0.1, the latest release is very good at following prompts! This time around the image quality is also better, and there are some limited styles in there too. The main thing seems to be fairly decent text, so long as it's short.

2024-07-28 21:13:55 +0000 UTC View Post

LivePortrait - Image, Video & Webcam

Now you can ditch InsightFace and go fully open source with LivePortrait in ComfyUI! We've got a few model options available for the face cropper to provide image animation, video-to-video animation, and even live via your webcam :)

When recording your driving videos, try not to move around too ...

Bonus: Pixart 900M "Mixture of Experts" Edition!

Even more PixArt! Things seem to be dropping every day, and now we've got a 2-stage pixart. While you can use each model individually, it's better to go with the "refiner" style workflow and let the first stage do it's job with composition and colours, with the second stage adding more clarity and det...

ControlNet Union ProMax and More!

So many new things, so little time!

PixArt Sigma 900M, more playing with the new samplers & schedulers, a better version of rembg and of course the new ControlNet Union ProMax model!

As you've probably seen in the previous bonus workflows, I do like the new Euler cfg++ :) While I origi...

Bonus: Aura + SD3 Refiner

Just for giggles, here is a quick workflow I'm playing with at the moment using SD3 as the refiner for Aura Flow. Now you can do complex prompts AND have the image quality come out a little better. Shame it can't do people well, but hey!

On the bright side, you can now more easily create hybrid ...

AuraFlow - A Truly Open Source Diffusion Model!

https://huggingface.co/fal/AuraFlow

Could an unseen benefit of Stability Ai's license gaff be that we finally get a deluge of truly open source models? Let's hope so, as the AuraFlow is here!

It's only been out for...

SD3 Licence / Refiner / HiRes Fix

Looks like we can finally use SD3 for commercial purposes - subject to various limitations. Full details available at https://stability.ai/news/license-update

The workflow attached below is the one used in the video...

Bonus ComfyUI Workflow: Refacer - Weird Edition

Given all the new samplers and stuff, I figured why not see how well they do with highres fix as well. Not too bad, it turns out!

Anyway, this Pixart Sigma + SDXL workflow is designed to put your selected face where it sees fit in your generation. It starts of with Pixart and then refines using SDXL. I'm also doing some upscaling too, so it does have a fairly high VRAM requirement there.<...

New Samplers in ComfyUI!

There are loads of new samplers in ComfyUI, so I figured I'd try them all - along with the new GITS scheduler as well!

To cut a long story short, I like DEIS and both of the CFG++ ones, but there is loads of scope to play with all of them!

* DEIS, GITS, iPNDM - 2024-06-29 18:41:01 +0000 UTC View Post

Lumina Vs Hunyuan 1.1 Vs Pixart Sigma

It's the battle of models with reasonable licenses - Lumina Vs Hunyuan Vs Pixart!

Video link - https://youtu.be/aV_Feh8768M

Which follows prompts best whilst also having a decent style and composition? Well... personally ...

Prompt Showdown! Ideal for SD3 ;)

It can be difficult deciding which model is best for your task, so I've created a set prompt to test your model's creativity! Using a wide variety of subjects and styles, you'll soon be able to tell what your model can and can't handle. Try giving these a go with Stable Diffusion 3, for example!

HunYuan-DiT - Better Than SD3?

Main repo

https://github.com/Tencent/HunyuanDiT/tree/main/comfyui-hydit

This is their official set of custom nodes for ComfyUI, and while it currently needs >11GB VRAM, it looks like ...

Your Image is Omost There!

https://youtu.be/RKxrXkVpPoE

https://github.com/lllyasviel/Omost

Want an LLM to generate prompts for you? Maybe it'll get it Omost right! Yes, th...

Khoj - Your Second Brain

Video notes

Khoj is touted as being your "AI second brain". Get answers to your questions, whether they be from online sources or your own notes. Use hosted or local LLMs. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.

Overall, it's not too bad and the install was pretty pain...

ComfyUI Refacer - 18th May Edition

While various things keep coming out which use the research-only "insightface" models, I figured why not combine two insightface-free options together? On top of that, maybe see how quickly I can make that cartoon or painted face into a more realistic one? We've had a load of new nodes come out recently, so now is as good a time as any to slap a load into a single workflow.

Below y...

SDXL Inpainting + PowerPaint V2 in ComfyUI

Inpainting can be fun, and thanks to some of the latest BrushNet SDXL and PowerPaint V2 models, you can can use any typical SD1.5 or SDXL model for inpainting - no special inpainting version required!

You'll find all the example workflows I used in my latest video as attachments to this post, and for the downloads see the links below.

Enjoy!

Links:

ComfyUI custom node: <...

GlaDOS - Your Personal, Unhinged AI Assistant

https://github.com/dnhkng/GlaDOS

"This is the Personality Core for GLaDOS, the first steps towards a real-life implementation of the AI from the Portal series by Valve."

The main thing about this one, is how fast it can generate responses :) You can actually have a (nearly) normal conversation!

The attach...

Hyper-SD in ComfyUI!

Model options

You get 3 options, basically:

1. Their 1-step SDXL UNET

2. Any SD1.5 model, but with their LORA

3. Any SDXL model, but with their LORA

Install

https://huggingface.co/ByteDance/Hyper-SD

1. Download ComfyUI-HyperSDXL1StepUnetScheduler to ComfyUI/cust...

Pixart Sigma 2k!

https://huggingface.co/PixArt-alpha/PixArt-Sigma/blob/main/PixArt-Sigma-XL-2-2K-MS.pth

There's a NEW Pixart Sigma model! This one pumps out 2K images - all in less than ...

Pixart Sigma - ComfyUI

Pixart Sigma - https://pixart-alpha.github.io/PixArt-sigma-project/

We're seeing more T5 conditioning over CLIP, often with much better prompt adherence. This time, it's the recent release "Pixart Sigma"...

Instant Mesh - ComfyUI

Just a quick Text-to-3d image workflow for you, in case you've not seen Instant Mesh as yet!

This one attaches my previous "Layer Diffuse" workflow to create suitable images, which instant mesh then turns into textured OBJ files :)

Workflow Instructions

• Install ComfyUI-layerdiffus...

  2024-04-20 11:21:12 +0000 UTC View Post

SDXL Reposer Basic (Apr 24 update)

So many workflows, so many IP adapter nodes to change ;) Old IP Adapter Apply now IP Adapter Advanced!

Creative Interpolation + Sparse RGB (Apr 2024)

Just a quick update to the previous Batch Image Animation workflow as various nodes have changed.

Enjoy! :)

ELLA - Making prompts better!

"The horizon shimmered with a kaleidoscope of hues, a huge towering, iridescent crystal structure erupts from the ground, their facets refracting the vibrant pink and indigo sky. Amidst this otherworldly landscape, a lone figure with his back to us stands wearing an old, tattered, black cloak and a sense of...