Coloring on Pony & IL on A1111

On July 7, 2025, I added a description regarding the IL version.

Previously, I created an automatic line art coloring program on ComfyUI by combining Anytest ControlNet with Lineart,

but although it requires individual settings, the same thing can be done on A1111-based WebUIs. In fact, if you are using an IL-based model, the fidelity to the original drawing is higher than in ComfyUI. ComfyUI has the potential for arrangement, which can be considered a merit in its own right.

I will describe that method here.

The following explanation assumes the use of Pony-based and Illustrations-based models as base models. Also, while ControlNet and the WD14-tagger extension are essential, I will not explain their installation here.

For ControlNet, use the Anytest for Pony mentioned in the article above, and the following XL Union for using Lineart with SDXL. Note that for IL, please use the Anytest model for am (Animagine XL).

Open the tagger tab, load the image you want to color, and click "Interrogate Image"; the prompt will be displayed on the right.

It is recommended to download the latest model for WD14-tagger. It is not automatically installed in A1111-based WebUIs by default.

Next, as shown in the figure below, open the Txt2img tab and paste the prompt extracted by the tagger.

Also, at this time, add quality-related prompts to the beginning, and do not copy prompts that hinder colorization, such as "greyscale, monochrome". The example in the figure above is for the IL series, but since quality prompts are completely different between Pony and IL, please use them accordingly.

In the Negative Prompt field, enter "greyscale, monochrome" as shown in the figure above. As mentioned earlier, use other prompts differently for Pony and IL. It is also recommended to use Embeddings for SDXL together.

Next, as shown in the figure below, set the various parameters, ensuring the image size matches the aspect ratio of the original image.

Next, as shown in the figure below, open ControlNet Unit0, load the original image, and check "Enable" and "Pixel Perfect".

Next, as shown in the figure below, check "All", and for the Model, select "CN-anytest_v4-marged_pn_dim256" for Pony, or "CN-anytest_v4-marged_am_dim256" for IL.

Next, as shown in the figure below, open ControlNet Unit1, load the original image, and check "Enable" and "Pixel Perfect".

Next, as shown in the figure below, check "Lineart". Set the Control Weight to about 0.5 and adjust it as appropriate while checking the finish.

Once you have configured these settings and generate an image, a colored image will be produced as shown in the figure below, but ideal coloring is not necessarily achieved from the start. While a certain degree of restriction is possible with prompts, this process inevitably involves a certain element of luck.

It is recommended to generate images continuously and choose the one with the most optimal coloring.