Getting Started With ComfyUI

Getting Started with ComfyUI

1. Introduction to ComfyUI

ComfyUI is a flexible and extensible tool designed for AI-driven image generation workflows. It is a node based interface that provides users with a variety of ways to control and customize image creation, especially useful in image and texture generation workflows like those supported by Texturaizer.

2. Installation Methods

For more information and help installing ComfyUI please see this official page.

Method 1: Installing ComfyUI from the Official GitHub

1. Download from GitHub

To install ComfyUI directly from the official repository:

NOTE: For more detailed instructions see the README on the official GitHub page.

Method 2: Installing ComfyUI via Stability Matrix (Packaged Application)

https://lykos.ai

What is Stability Matrix?

Stability Matrix is an all-in-one tool that simplifies setting up ComfyUI for generating AI images with Texturaizer. This guide will help you quickly install and configure Stability Matrix, ComfyUI, and the required models. It handles all dependencies, ensuring your local AI server is ready for use with Texturaizer.

Advantages of Using Stability Matrix

• Pre-packaged installation with all dependencies included.

• Frequent updates and easy management of various AI tools.

Stability Matrix System Requirements

Installation Steps

Step 1: Download and Install Stability Matrix
  1. Download Stability Matrix:
    • Go to the official Stability Matrix site, which will lead you to a page with a download link for the appropriate OS.
  2. Extract and Run:
    • Extract the downloaded ZIP file to a location of your choice.
    • Navigate to the extracted folder.
    • Run the StabilityMatrix.exe file. This will guide you through the installation process and set up the necessary dependencies.
Step 2: Install ComfyUI

Once Stability Matrix is installed, use it to install ComfyUI.

  1. Launch Stability Matrix:
    • Run stability_matrix_launcher.exe to start the application.
  2. Install ComfyUI:
    • In the Stability Matrix interface, click Install ComfyUI.
    • This will automatically download ComfyUI and install the necessary dependencies, such as Python packages and model handling tools.
    • you will also be prompted to install Stable Diffusion models (either SD1.5 or SDXL). You can do so there or install recommended models latter.
    • Be patient, grab a snack, this can take some time.
Step 3: Install Models
  1. Download Models:
    • In the Stability Matrix interface, navigate to the Model Browser tab.
    • Click on Hugging Face. This will have the base Stable Diffusion Models and ControlNet Models.
    • Navigate to the CivitAI tab to download from a much larger selection of community models.
    • To see more on recommended models see the recommended models page.
  2. Verify Model Installation:
    • Ensure the downloaded models are correctly placed in the appropriate folders, as specified by ComfyUI, to be used effectively by Texturaizer. Stability Matrix should handle this for you.
Step 4: Configure Texturaizer to Use ComfyUI
  • After setting up ComfyUI, you need to connect it with Texturaizer for local AI processing.
  • Take note of the installation location of ComfyUI. In order for Texturaizer to start the ComfyUI server from within Blender, this directory must be the one containing the “main.py” file.

If Installing through Stability Matrix, this will be StabilityMatrix Install Location > Data > Packages > ComfyUI.

3. Downloading Models for ComfyUI

To get started with ComfyUI, you will need to download and install appropriate models for generating high-quality images. Here’s how to do that:

Texturaizer can do this for you! Just go to the addon preferences and look for RECOMMENDED MODELS!

1. Download Models

  • Visit popular model repositories such as CivitAI or Hugging Face to browse and download models for ComfyUI. Look for models optimized for texture generation.
  • Once downloaded, place the model files in the appropriate folder within your ComfyUI installation models directory (/models/).

Here are some starter models for SDXL: (for better organization place each in a sdxl sub-folder)

⚠ Clicking on these links will directly download the models which are large files.

Juggernaut XL – Place this model in your ComfyUI/models/checkpoints folder (model site link)

SDXL Promax ControlNet – Place this model in your ComfyUI/models/controlnet folder (site link)

SDXL Pixel Art LoRA – Place this model in your ComfyUI/models/loras folder (site link)

Here are some SD1.5 Models: (for better organization place each in a sd1 sub-folder)

⚠ Clicking on these links will directly download the models which are large files.

Realistic Vision V6.0 – Place this model in your ComfyUI/models/checkpoints folder (site link)

SD1.5 Depth ControlNet – Place this model in your ComfyUI/models/controlnet folder (site link)

SD1.5 Segment ControlNet – Place this model in your ComfyUI/models/controlnet folder (site link)

Illustration Style LoRA – Place this mode in your ComfyUI/models/loras folder (site link)

4. Setting up Comfy Manager for More Control (not required for Texturaizer)

Comfy Manager is a helpful extension for managing models, workflows, and outputs in ComfyUI. Here’s how to set it up:

https://github.com/ltdrdata/ComfyUI-Manager

1. Install Comfy Manager

  • Download the Comfy Manager extension from the official GitHub page.
  • Place the extension files in the extensions/ folder inside your ComfyUI directory.

2. Using Comfy Manager

  • Once installed, you can access the Comfy Manager interface within ComfyUI.
  • This will allow you to manage multiple workflows, track your outputs, and switch between different model configurations quickly.

Conclusion

By following these two installation methods and downloading the necessary models, you can quickly get started with ComfyUI for AI-driven image and texture generation with Texturaizer.