Flux Union Pro ControlNet by InstantX & Shakker Revised Edition

03.31.2026, updated to fix ComfyUI nodes 2.0 and HSWQ fp8e4m3.

I have correctly rebuilt it by referring to the video below. VRAM consumption has been drastically reduced to less than half, and even with Flux-dev-16fp, it generally ran on less than 12GB.

In the first workflow I built for Union, VRAM consumption was nearly 30GB, which is why I gave up on running it with dev and built it with Schnell instead.

These are the newly rebuilt nodes.

The following is the Nunchaku version.

For the LoRA Loader section, the node I developed below is also required.

There was a groundbreaking ControlNet model format called "Union" developed for SDXL and SD3. It is an integrated model that achieves multiple ControlNet functions with just a single safetensors file.

Furthermore, since a lighter fp8 version 2.0 has been developed, I have created this on the premise of using that. It runs significantly faster compared to the full-size version.

I knew in advance that the AI development group "InstantX," which developed Union for SD3, was developing it for Flux1, but the nodes for ComfyUI have now been released and are ready to use.

The key to the revised edition is this: "AIO Aux Preprocessor." I didn't notice this last time.

For the Sampler, I am using ControlAltAI, which I am also involved in supporting.

After that, as I always mention, the AI development group "ControlAltAI," of which I am a support member, developed nodes for Union, and I was able to significantly simplify the workflow itself.

The file above reflects those changes.

...

Today's BGM is... my favorite song among Linkin Park's tracks. It is a song that even Mike, the close friend of the late Chester Bennington, described as "too sad."

I believe in the words of people who know despair for humanity itself.

There was a period after Chester's death when Mike often sang this song live.

'Cause I’m only a crack in this castle of glass... This phrase could only have been created by Chester, who knew despair for humanity itself.