For loading Florence2 on Flash-Attention
現時点、敢えて「これ」をやる意味って多分、ほとんどないんですが。
何故かと言えば、現行のPytorchはFlash-Attention機能にほぼ近い機能を内装しているらしいので。故に、わざわざ「これ」をやっているユーザーはほと
んどいないと思います。
Florence2をFlash-Attentionを使用する形でロードする、事をです。
ちなみに、ライブラリーをインストールしていない状態で「これ」をやると、以下のエラーを起こします...滅茶苦茶長いですが。
# ComfyUI Error Report
## Error Details
- **Node ID:** 95
- **Node Type:** DownloadAndLoadFlorence2ModelMultiGPU
- **Exception Type:** ImportError
- **Exception Message:** FlashAttention2 has been toggled on, but it cannot be used due to the following error: the package flash_attn seems to be not installed. Please refer to the documentation of https://huggingface.co/docs/transformers/perf_infer_gpu_one#flashattention-2 to install Flash Attention 2.
## Stack Trace
```
File "D:\USERFILES\ComfyUI\ComfyUI\execution.py", line 327, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\ComfyUI\execution.py", line 202, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\ComfyUI\execution.py", line 174, in _map_node_over_list
process_inputs(input_dict, i)
File "D:\USERFILES\ComfyUI\ComfyUI\execution.py", line 163, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-MultiGPU\__init__.py", line 532, in override
out = fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-MultiGPU\nodes.py", line 225, in loadmodel
return original_loader.loadmodel(model, precision, attention, lora)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Florence2\nodes.py", line 126, in loadmodel
model = AutoModelForCausalLM.from_pretrained(model_path, attn_implementation=attention, device_map=device, torch_dtype=dtype,trust_remote_code=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\python_embeded\Lib\site-packages\transformers\models\auto\auto_factory.py", line 559, in from_pretrained
return model_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\python_embeded\Lib\site-packages\transformers\modeling_utils.py", line 262, in _wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\python_embeded\Lib\site-packages\transformers\modeling_utils.py", line 4179, in from_pretrained
config = cls._autoset_attn_implementation(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\python_embeded\Lib\site-packages\transformers\modeling_utils.py", line 1575, in _autoset_attn_implementation
cls._check_and_enable_flash_attn_2(
File "D:\USERFILES\ComfyUI\python_embeded\Lib\site-packages\transformers\modeling_utils.py", line 1710, in _check_and_enable_flash_attn_2
raise ImportError(f"{preface} the package flash_attn seems to be not installed. {install_message}")
```
## System Information
- **ComfyUI Version:** 0.3.19
- **Arguments:** ComfyUI\main.py --use-pytorch-cross-attention --windows-standalone-build --output-directory C:\Users\ussoe\A1111\stable-diffusion-webui\outputs\ComfyUI
- **OS:** nt
- **Python Version:** 3.12.7 (tags/v3.12.7:0b05ead, Oct 1 2024, 03:06:41) [MSC v.1941 64 bit (AMD64)]
- **Embedded Python:** true
- **PyTorch Version:** 2.6.0+cu126
## Devices
- **Name:** cuda:0 NVIDIA GeForce RTX 4070 : cudaMallocAsync
- **Type:** cuda
- **VRAM Total:** 12878086144
- **VRAM Free:** 34815272
- **Torch VRAM Total:** 10200547328
- **Torch VRAM Free:** 34815272
## Logs
```
2025-03-05T20:18:08.247981 -
2025-03-05T20:18:09.812711 - D:\USERFILES\ComfyUI\python_embeded\Lib\site-packages\timm\models\layers\__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning)
2025-03-05T20:18:09.812711 - D:\USERFILES\ComfyUI\python_embeded\Lib\site-packages\timm\models\registry.py:4: FutureWarning: Importing from timm.models.registry is deprecated, please import via timm.models
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.models", FutureWarning)
2025-03-05T20:18:10.789644 - [Crystools [0;32mINFO[0m] Crystools version: 1.22.0
2025-03-05T20:18:10.812931 - [Crystools [0;32mINFO[0m] CPU: AMD Ryzen 9 7900 12-Core Processor - Arch: AMD64 - OS: Windows 11
2025-03-05T20:18:10.824615 - [Crystools [0;32mINFO[0m] Pynvml (Nvidia) initialized.
2025-03-05T20:18:10.824615 - [Crystools [0;32mINFO[0m] GPU/s:
2025-03-05T20:18:10.830593 - [Crystools [0;32mINFO[0m] 0) NVIDIA GeForce RTX 4070
2025-03-05T20:18:10.830593 - [Crystools [0;32mINFO[0m] NVIDIA Driver: 572.60
2025-03-05T20:18:12.467240 - [34m[ComfyUI-Easy-Use] server: [0mv1.2.8 [92mLoaded[0m2025-03-05T20:18:12.467240 -
2025-03-05T20:18:12.467240 - [34m[ComfyUI-Easy-Use] web root: [0mD:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Easy-Use\web_version/v2 [92mLoaded[0m2025-03-05T20:18:12.467761 -
2025-03-05T20:18:13.055420 - Total VRAM 12282 MB, total RAM 64629 MB
2025-03-05T20:18:13.055420 - pytorch version: 2.6.0+cu126
2025-03-05T20:18:13.055420 - xformers version: 0.0.29.post3
2025-03-05T20:18:13.055420 - Set vram state to: NORMAL_VRAM
2025-03-05T20:18:13.056419 - Device: cuda:0 NVIDIA GeForce RTX 4070 : cudaMallocAsync
2025-03-05T20:18:13.084957 - ### Loading: ComfyUI-Impact-Pack (V8.8.2)2025-03-05T20:18:13.084957 -
2025-03-05T20:18:13.085957 - [Impact Pack] Wildcards loading done.2025-03-05T20:18:13.085957 -
2025-03-05T20:18:13.087958 - ### Loading: ComfyUI-Impact-Subpack (V1.2.9)
2025-03-05T20:18:13.265151 - [Impact Subpack] ultralytics_bbox: D:\USERFILES\ComfyUI\ComfyUI\models\ultralytics\bbox
2025-03-05T20:18:13.265151 - [Impact Subpack] ultralytics_segm: D:\USERFILES\ComfyUI\ComfyUI\models\ultralytics\segm
2025-03-05T20:18:13.280861 - ### Loading: ComfyUI-Inspire-Pack (V1.14.1)
2025-03-05T20:18:13.745715 - D:\USERFILES\ComfyUI\python_embeded\Lib\site-packages\albumentations\__init__.py:28: UserWarning: A new version of Albumentations is available: '2.0.5' (you have '2.0.3'). Upgrade using: pip install -U albumentations. To disable automatic update checks, set the environment variable NO_ALBUMENTATIONS_UPDATE to 1.
check_for_updates()
2025-03-05T20:18:14.383041 - [94mtheUpsiders Logic Nodes: [92mLoaded[0m2025-03-05T20:18:14.383041 -
2025-03-05T20:18:14.477804 - ### Loading: ComfyUI-Manager (V3.27.6)
2025-03-05T20:18:14.477804 - [ComfyUI-Manager] network_mode: public
2025-03-05T20:18:14.635429 - ### ComfyUI Version: v0.3.19-5-g93fedd92 | Released on '2025-03-05'
2025-03-05T20:18:15.403504 - MultiGPU: Checking for module at D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-LTXVideo
2025-03-05T20:18:15.403504 - MultiGPU: Module ComfyUI-LTXVideo not found - skipping
2025-03-05T20:18:15.403504 - MultiGPU: Checking for module at D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-ltxvideo
2025-03-05T20:18:15.403504 - MultiGPU: Module comfyui-ltxvideo not found - skipping
2025-03-05T20:18:15.403504 - MultiGPU: Checking for module at D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Florence2
2025-03-05T20:18:15.403504 - MultiGPU: Found ComfyUI-Florence2, creating compatible MultiGPU nodes
2025-03-05T20:18:15.403504 - MultiGPU: Checking for module at D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_bitsandbytes_NF4
2025-03-05T20:18:15.404498 - MultiGPU: Module ComfyUI_bitsandbytes_NF4 not found - skipping
2025-03-05T20:18:15.404498 - MultiGPU: Checking for module at D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui_bitsandbytes_nf4
2025-03-05T20:18:15.404498 - MultiGPU: Module comfyui_bitsandbytes_nf4 not found - skipping
2025-03-05T20:18:15.404498 - MultiGPU: Checking for module at D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\x-flux-comfyui
2025-03-05T20:18:15.404498 - MultiGPU: Module x-flux-comfyui not found - skipping
2025-03-05T20:18:15.404498 - MultiGPU: Checking for module at D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\x-flux-comfyui
2025-03-05T20:18:15.404498 - MultiGPU: Module x-flux-comfyui not found - skipping
2025-03-05T20:18:15.404498 - MultiGPU: Checking for module at D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-MMAudio
2025-03-05T20:18:15.404498 - MultiGPU: Module ComfyUI-MMAudio not found - skipping
2025-03-05T20:18:15.405500 - MultiGPU: Checking for module at D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-mmaudio
2025-03-05T20:18:15.405500 - MultiGPU: Module comfyui-mmaudio not found - skipping
2025-03-05T20:18:15.405500 - MultiGPU: Checking for module at D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-GGUF
2025-03-05T20:18:15.405500 - MultiGPU: Found ComfyUI-GGUF, creating compatible MultiGPU nodes
2025-03-05T20:18:15.405500 - MultiGPU: Checking for module at D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\PuLID_ComfyUI
2025-03-05T20:18:15.405500 - MultiGPU: Module PuLID_ComfyUI not found - skipping
2025-03-05T20:18:15.405500 - MultiGPU: Checking for module at D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\pulid_comfyui
2025-03-05T20:18:15.405500 - MultiGPU: Module pulid_comfyui not found - skipping
2025-03-05T20:18:15.405500 - MultiGPU: Checking for module at D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-HunyuanVideoWrapper
2025-03-05T20:18:15.405500 - MultiGPU: Found ComfyUI-HunyuanVideoWrapper, creating compatible MultiGPU nodes
2025-03-05T20:18:15.405500 - MultiGPU: Registration complete. Final mappings: DeviceSelectorMultiGPU, HunyuanVideoEmbeddingsAdapter, MergeFluxLoRAsQuantizeAndLoaddMultiGPU, UNETLoaderMultiGPU, VAELoaderMultiGPU, CLIPLoaderMultiGPU, DualCLIPLoaderMultiGPU, TripleCLIPLoaderMultiGPU, CheckpointLoaderSimpleMultiGPU, ControlNetLoaderMultiGPU, Florence2ModelLoaderMultiGPU, DownloadAndLoadFlorence2ModelMultiGPU, UnetLoaderGGUFMultiGPU, UnetLoaderGGUFDisTorchMultiGPU, UnetLoaderGGUFAdvancedMultiGPU, UnetLoaderGGUFAdvancedDisTorchMultiGPU, CLIPLoaderGGUFMultiGPU, CLIPLoaderGGUFDisTorchMultiGPU, DualCLIPLoaderGGUFMultiGPU, DualCLIPLoaderGGUFDisTorchMultiGPU, TripleCLIPLoaderGGUFMultiGPU, TripleCLIPLoaderGGUFDisTorchMultiGPU, HyVideoModelLoaderMultiGPU, HyVideoVAELoaderMultiGPU, DownloadAndLoadHyVideoTextEncoderMultiGPU
2025-03-05T20:18:15.459159 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json
2025-03-05T20:18:15.467963 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json
2025-03-05T20:18:15.477636 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json
2025-03-05T20:18:15.505528 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json
2025-03-05T20:18:15.526546 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json
2025-03-05T20:18:15.637634 - [34mOpenPose Editor: [92mLoaded[0m2025-03-05T20:18:15.637634 -
2025-03-05T20:18:15.692260 - [0m[1;34m[SD Prompt Reader] [36mNode version: 1.3.4[0m2025-03-05T20:18:15.692260 -
2025-03-05T20:18:15.692260 - [0m[1;34m[SD Prompt Reader] [36mCore version: 1.3.5[0m2025-03-05T20:18:15.692260 -
2025-03-05T20:18:15.710259 - Nvidia APEX normalization not installed, using PyTorch LayerNorm2025-03-05T20:18:15.710259 -
2025-03-05T20:18:15.783899 - Failed to auto update `Quality of Life Suit` 2025-03-05T20:18:15.783899 -
2025-03-05T20:18:15.785898 - [33mQualityOfLifeSuit_Omar92_DIR:[0m D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-QualityOfLifeSuit_Omar922025-03-05T20:18:15.785898 -
2025-03-05T20:18:15.796897 - [0;33m[ReActor][0m - [38;5;173mSTATUS[0m - [0;32mRunning v0.5.2-b1 in ComfyUI[0m2025-03-05T20:18:15.796897 -
2025-03-05T20:18:15.909597 - Torch version: 2.6.0+cu1262025-03-05T20:18:15.909597 -
2025-03-05T20:18:16.122053 - here: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-tbox2025-03-05T20:18:16.122053 -
2025-03-05T20:18:16.123052 - Using ckpts path: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-tbox\..\..\models\annotator2025-03-05T20:18:16.124051 -
2025-03-05T20:18:16.124051 - Using symlinks: False2025-03-05T20:18:16.124051 -
2025-03-05T20:18:16.124051 - Using ort providers: ['CUDAExecutionProvider', 'DirectMLExecutionProvider', 'OpenVINOExecutionProvider', 'ROCMExecutionProvider', 'CPUExecutionProvider']2025-03-05T20:18:16.124051 -
2025-03-05T20:18:16.426856 - (pysssss:WD14Tagger) [DEBUG] Available ORT providers: AzureExecutionProvider, CPUExecutionProvider2025-03-05T20:18:16.426856 -
2025-03-05T20:18:16.426856 - (pysssss:WD14Tagger) [DEBUG] Using ORT providers: CUDAExecutionProvider, CPUExecutionProvider2025-03-05T20:18:16.426856 -
2025-03-05T20:18:16.526107 - ------------------------------------------2025-03-05T20:18:16.526107 -
2025-03-05T20:18:16.526107 - [34mComfyroll Studio v1.76 : [92m 175 Nodes Loaded[0m2025-03-05T20:18:16.526107 -
2025-03-05T20:18:16.526107 - ------------------------------------------2025-03-05T20:18:16.526107 -
2025-03-05T20:18:16.526107 - ** For changes, please see patch notes at https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes/blob/main/Patch_Notes.md2025-03-05T20:18:16.526107 -
2025-03-05T20:18:16.526107 - ** For help, please see the wiki at https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes/wiki2025-03-05T20:18:16.526107 -
2025-03-05T20:18:16.526107 - ------------------------------------------2025-03-05T20:18:16.526107 -
2025-03-05T20:18:17.354742 - Nvidia APEX normalization not installed, using PyTorch LayerNorm2025-03-05T20:18:17.354742 -
2025-03-05T20:18:17.433611 - [92m[tinyterraNodes] [32mLoaded[0m2025-03-05T20:18:17.433611 -
2025-03-05T20:18:17.602926 - [36;20m[comfy_mtb] | INFO -> loaded [96m100[0m nodes successfuly[0m
2025-03-05T20:18:17.605926 -
[32mInitializing ControlAltAI Nodes[0m2025-03-05T20:18:17.605926 -
2025-03-05T20:18:17.681531 - Unable to import PanavisionLensV1. This node will not be available.2025-03-05T20:18:17.681531 -
2025-03-05T20:18:17.874297 -
2025-03-05T20:18:17.874297 - [92m[rgthree-comfy] Loaded 42 magnificent nodes. 🎉[00m2025-03-05T20:18:17.874297 -
2025-03-05T20:18:17.874297 -
2025-03-05T20:18:18.821789 - FETCH ComfyRegistry Data: 5/362025-03-05T20:18:18.822790 -
2025-03-05T20:18:20.700365 - Searge-SDXL v4.3.1 in D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\SeargeSDXL2025-03-05T20:18:20.700365 -
2025-03-05T20:18:20.775368 - [34mWAS Node Suite: [0mBlenderNeko's Advanced CLIP Text Encode found, attempting to enable `CLIPTextEncode` support.[0m2025-03-05T20:18:20.775368 -
2025-03-05T20:18:20.775368 - [34mWAS Node Suite: [0m`CLIPTextEncode (BlenderNeko Advanced + NSP)` node enabled under `WAS Suite/Conditioning` menu.[0m2025-03-05T20:18:20.775368 -
2025-03-05T20:18:21.472832 - [34mWAS Node Suite: [0mOpenCV Python FFMPEG support is enabled[0m2025-03-05T20:18:21.472832 -
2025-03-05T20:18:21.472832 - [34mWAS Node Suite: [0m`ffmpeg_bin_path` is set to: C:/Program Files/ffmpeg[0m2025-03-05T20:18:21.472832 -
2025-03-05T20:18:22.169020 - [34mWAS Node Suite: [0mFinished.[0m [32mLoaded[0m [0m221[0m [32mnodes successfully.[0m2025-03-05T20:18:22.169020 -
2025-03-05T20:18:22.169020 -
[3m[93m"The future belongs to those who believe in the beauty of their dreams."[0m[3m - Eleanor Roosevelt[0m
2025-03-05T20:18:22.169020 -
2025-03-05T20:18:22.175021 -
Import times for custom nodes:
2025-03-05T20:18:22.175021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_ADV_CLIP_emb
2025-03-05T20:18:22.175021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\global_config.py
2025-03-05T20:18:22.176021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus
2025-03-05T20:18:22.176021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\efficiency-nodes-comfyui
2025-03-05T20:18:22.176021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-NAI-styler
2025-03-05T20:18:22.176021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\websocket_image_save.py
2025-03-05T20:18:22.176021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-VideoHelperSuite
2025-03-05T20:18:22.176021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\image-resize-comfyui
2025-03-05T20:18:22.176021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Adaptive-Guidance
2025-03-05T20:18:22.176021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-mxToolkit
2025-03-05T20:18:22.176021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui_controlnet_aux
2025-03-05T20:18:22.176021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Universal-Styler
2025-03-05T20:18:22.176021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Logic
2025-03-05T20:18:22.176021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Detail-Daemon
2025-03-05T20:18:22.177021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui_prnodes
2025-03-05T20:18:22.177021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-HunyuanVideoMultiLora
2025-03-05T20:18:22.177021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-HunyuanVideoImagesGuider
2025-03-05T20:18:22.177021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_AdvancedRefluxControl
2025-03-05T20:18:22.177021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Molmo
2025-03-05T20:18:22.177021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-YOLO
2025-03-05T20:18:22.177021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-IC-Light-Native
2025-03-05T20:18:22.177021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\cg-use-everywhere
2025-03-05T20:18:22.177021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\masquerade-nodes-comfyui
2025-03-05T20:18:22.177021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-WD14-Tagger
2025-03-05T20:18:22.177021 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Impact-Pack
2025-03-05T20:18:22.178019 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-BRIA_AI-RMBG
2025-03-05T20:18:22.178019 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\wlsh_nodes
2025-03-05T20:18:22.178019 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_JPS-Nodes
2025-03-05T20:18:22.178019 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\stability-ComfyUI-nodes
2025-03-05T20:18:22.178019 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\Comfyui-In-Context-Lora-Utils
2025-03-05T20:18:22.178019 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyLiterals
2025-03-05T20:18:22.178019 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-inpaint-cropandstitch
2025-03-05T20:18:22.178019 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_HF_Servelress_Inference
2025-03-05T20:18:22.178019 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui_face_parsing
2025-03-05T20:18:22.178019 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-ResAdapter
2025-03-05T20:18:22.179020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui_ttp_toolset
2025-03-05T20:18:22.179020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Florence2
2025-03-05T20:18:22.179020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-AutomaticCFG
2025-03-05T20:18:22.179020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_experiments
2025-03-05T20:18:22.179020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_ZenID
2025-03-05T20:18:22.179020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\MistoControlNet-Flux-dev
2025-03-05T20:18:22.179020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_InstantID
2025-03-05T20:18:22.179020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-MultiGPU
2025-03-05T20:18:22.179020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-TiledDiffusion
2025-03-05T20:18:22.180020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-QualityOfLifeSuit_Omar92
2025-03-05T20:18:22.180020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-IPAdapter-Flux
2025-03-05T20:18:22.180020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-GGUF
2025-03-05T20:18:22.180020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-inpaint-nodes
2025-03-05T20:18:22.180020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\Comfy-WaveSpeed
2025-03-05T20:18:22.180020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_essentials
2025-03-05T20:18:22.180020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-prompt-composer
2025-03-05T20:18:22.180020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-RMBG
2025-03-05T20:18:22.180020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfy-image-saver
2025-03-05T20:18:22.180020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-layerdiffuse
2025-03-05T20:18:22.180020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyMath
2025-03-05T20:18:22.180020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-tooling-nodes
2025-03-05T20:18:22.180020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-AutoCropFaces
2025-03-05T20:18:22.181020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-animatediff
2025-03-05T20:18:22.181020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\Comfyui_CXH_joy_caption
2025-03-05T20:18:22.181020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui_patches_ll
2025-03-05T20:18:22.181020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-various
2025-03-05T20:18:22.181020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\OneButtonPrompt
2025-03-05T20:18:22.181020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\Derfuu_ComfyUI_ModdedNodes
2025-03-05T20:18:22.181020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ControlAltAI-Nodes
2025-03-05T20:18:22.181020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_UltimateSDUpscale
2025-03-05T20:18:22.181020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-OpenPose-Editor
2025-03-05T20:18:22.181020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Chibi-Nodes
2025-03-05T20:18:22.181020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Frame-Interpolation
2025-03-05T20:18:22.181020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-prompt-reader-node
2025-03-05T20:18:22.182020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-KJNodes
2025-03-05T20:18:22.182020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\rgthree-comfy
2025-03-05T20:18:22.182020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Custom-Scripts
2025-03-05T20:18:22.182020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-ppm
2025-03-05T20:18:22.182020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet
2025-03-05T20:18:22.182020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Inspire-Pack
2025-03-05T20:18:22.182020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-IC-Light
2025-03-05T20:18:22.182020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_BiRefNet_ll
2025-03-05T20:18:22.182020 - 0.0 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-hunyuanvideowrapper
2025-03-05T20:18:22.182020 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-segment-anything-2
2025-03-05T20:18:22.182020 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_Comfyroll_CustomNodes
2025-03-05T20:18:22.183021 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\facerestore_cf
2025-03-05T20:18:22.183021 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_tinyterraNodes
2025-03-05T20:18:22.183021 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-dream-project
2025-03-05T20:18:22.183021 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui_pulid_flux_ll
2025-03-05T20:18:22.183021 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Long-CLIP
2025-03-05T20:18:22.183021 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Crystools
2025-03-05T20:18:22.183021 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-PuLID-Flux-Enhanced
2025-03-05T20:18:22.183021 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfy_mtb
2025-03-05T20:18:22.183021 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-instantId-faceswap
2025-03-05T20:18:22.183021 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\CharacterFaceSwap
2025-03-05T20:18:22.183021 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_LayerStyle
2025-03-05T20:18:22.183021 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-tbox
2025-03-05T20:18:22.183021 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-SUPIR
2025-03-05T20:18:22.184019 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-reactor-node
2025-03-05T20:18:22.184019 - 0.1 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\djz-nodes
2025-03-05T20:18:22.184019 - 0.2 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-tensorops
2025-03-05T20:18:22.184019 - 0.2 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-dynamicprompts
2025-03-05T20:18:22.184019 - 0.2 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-FluxTrainer
2025-03-05T20:18:22.184019 - 0.2 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Impact-Subpack
2025-03-05T20:18:22.184019 - 0.2 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_MileHighStyler
2025-03-05T20:18:22.184019 - 0.2 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-ollama
2025-03-05T20:18:22.184019 - 0.3 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\sd-ppp
2025-03-05T20:18:22.184019 - 0.3 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Gemini
2025-03-05T20:18:22.185021 - 0.5 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI_LayerStyle_Advance
2025-03-05T20:18:22.185021 - 0.8 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\comfyui-art-venture
2025-03-05T20:18:22.185021 - 0.9 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-CCSR
2025-03-05T20:18:22.185021 - 0.9 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Inspyrenet-Rembg
2025-03-05T20:18:22.185021 - 0.9 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Manager
2025-03-05T20:18:22.185021 - 1.3 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-BiRefNet-ZHO
2025-03-05T20:18:22.185021 - 1.4 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Easy-Use
2025-03-05T20:18:22.185021 - 1.4 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\was-node-suite-comfyui
2025-03-05T20:18:22.185021 - 1.5 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Allor
2025-03-05T20:18:22.185021 - 2.6 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\SeargeSDXL
2025-03-05T20:18:22.185021 - 6.5 seconds: D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\clipseg.py
2025-03-05T20:18:22.185021 -
2025-03-05T20:18:22.211650 - Starting server
2025-03-05T20:18:22.211650 - To see the GUI go to: http://127.0.0.1:8188
2025-03-05T20:18:23.096196 - FETCH ComfyRegistry Data: 10/362025-03-05T20:18:23.096196 -
2025-03-05T20:18:24.292418 - [33mQualityOfLifeSuit_Omar92:[0m:NSP ready2025-03-05T20:18:24.292418 -
2025-03-05T20:18:24.295118 - YOUR FOLDER: D:\USERFILES\ComfyUI\ComfyUI2025-03-05T20:18:24.295118 -
2025-03-05T20:18:24.295118 - YOUR FOLDER: D:\USERFILES\ComfyUI\ComfyUI2025-03-05T20:18:24.295118 -
2025-03-05T20:18:24.511799 - [36;20m[comfy_mtb] | INFO -> Found multiple match, we will pick the last D:\USERFILES\ComfyUI\ComfyUI\path\to\stable-diffusion-webui\models\SwinIR
['D:\\USERFILES\\ComfyUI\\ComfyUI\\models\\upscale_models', 'D:\\USERFILES\\ComfyUI\\ComfyUI\\path\\to\\stable-diffusion-webui\\models\\ESRGAN', 'D:\\USERFILES\\ComfyUI\\ComfyUI\\path\\to\\stable-diffusion-webui\\models\\RealESRGAN', 'D:\\USERFILES\\ComfyUI\\ComfyUI\\path\\to\\stable-diffusion-webui\\models\\SwinIR'][0m
2025-03-05T20:18:24.511799 - [33;20m[comfy_mtb] | WARNING -> Face restoration models not found.[0m
2025-03-05T20:18:27.128583 - FETCH ComfyRegistry Data: 15/362025-03-05T20:18:27.128583 -
2025-03-05T20:18:31.011919 - FETCH ComfyRegistry Data: 20/362025-03-05T20:18:31.011919 -
2025-03-05T20:18:32.251350 - got prompt
2025-03-05T20:18:32.846027 - Using pytorch attention in VAE
2025-03-05T20:18:32.846027 - Using pytorch attention in VAE
2025-03-05T20:18:33.983276 - VAE load device: cuda:0, offload device: cpu, dtype: torch.bfloat16
2025-03-05T20:18:34.579545 - CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16
2025-03-05T20:18:34.929664 - FETCH ComfyRegistry Data: 25/362025-03-05T20:18:34.929664 -
2025-03-05T20:18:38.546902 - FETCH ComfyRegistry Data: 30/362025-03-05T20:18:38.546902 -
2025-03-05T20:18:42.103502 - FETCH ComfyRegistry Data: 35/362025-03-05T20:18:42.103502 -
2025-03-05T20:18:43.303793 - FETCH ComfyRegistry Data [DONE]2025-03-05T20:18:43.303793 -
2025-03-05T20:18:43.346683 - [ComfyUI-Manager] default cache updated: https://api.comfy.org/nodes
2025-03-05T20:18:43.530896 - nightly_channel: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/remote
2025-03-05T20:18:43.531425 - FETCH DATA from: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json2025-03-05T20:18:43.531425 - 2025-03-05T20:18:43.630507 - [DONE]2025-03-05T20:18:43.630507 -
2025-03-05T20:18:43.681236 - [ComfyUI-Manager] All startup tasks have been completed.
2025-03-05T20:19:10.685852 - long_hair, looking_at_viewer, smile, multiple_girls, brown_hair, black_hair, bow, closed_mouth, 2girls, jewelry, brown_eyes, collarbone, swimsuit, ponytail, heart, hair_bow, teeth, necklace, grin, lips, one-piece_swimsuit, v, tattoo, portrait, blue_one-piece_swimsuit, double_v, realistic, orange_bow, facial_tattoo, locker, heart_tattoo, star_facial_mark, voice_actor, asian2025-03-05T20:19:10.685852 -
2025-03-05T20:19:12.127373 - Loads SAM model: D:\USERFILES\ComfyUI\ComfyUI\models\sams\sam_vit_b_01ec64.pth (device:Prefer GPU)2025-03-05T20:19:12.127373 -
2025-03-05T20:19:12.313843 - Requested to load FluxClipModel_
2025-03-05T20:19:13.846600 - loaded partially 9305.226551818847 9305.22412109375 0
2025-03-05T20:19:25.693853 - 0 models unloaded.
2025-03-05T20:19:25.701343 - loaded partially 9305.224121189118 9305.22412109375 0
2025-03-05T20:19:37.940884 - Florence2 using flash_attention_2 for attention2025-03-05T20:19:37.940884 -
2025-03-05T20:19:38.114126 - No flash_attn import to remove2025-03-05T20:19:38.114126 -
2025-03-05T20:19:38.364808 - !!! Exception during processing !!! FlashAttention2 has been toggled on, but it cannot be used due to the following error: the package flash_attn seems to be not installed. Please refer to the documentation of https://huggingface.co/docs/transformers/perf_infer_gpu_one#flashattention-2 to install Flash Attention 2.
2025-03-05T20:19:38.396511 - Traceback (most recent call last):
File "D:\USERFILES\ComfyUI\ComfyUI\execution.py", line 327, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\ComfyUI\execution.py", line 202, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\ComfyUI\execution.py", line 174, in _map_node_over_list
process_inputs(input_dict, i)
File "D:\USERFILES\ComfyUI\ComfyUI\execution.py", line 163, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-MultiGPU\__init__.py", line 532, in override
out = fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-MultiGPU\nodes.py", line 225, in loadmodel
return original_loader.loadmodel(model, precision, attention, lora)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\ComfyUI\custom_nodes\ComfyUI-Florence2\nodes.py", line 126, in loadmodel
model = AutoModelForCausalLM.from_pretrained(model_path, attn_implementation=attention, device_map=device, torch_dtype=dtype,trust_remote_code=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\python_embeded\Lib\site-packages\transformers\models\auto\auto_factory.py", line 559, in from_pretrained
return model_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\python_embeded\Lib\site-packages\transformers\modeling_utils.py", line 262, in _wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\python_embeded\Lib\site-packages\transformers\modeling_utils.py", line 4179, in from_pretrained
config = cls._autoset_attn_implementation(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\USERFILES\ComfyUI\python_embeded\Lib\site-packages\transformers\modeling_utils.py", line 1575, in _autoset_attn_implementation
cls._check_and_enable_flash_attn_2(
File "D:\USERFILES\ComfyUI\python_embeded\Lib\site-packages\transformers\modeling_utils.py", line 1710, in _check_and_enable_flash_attn_2
raise ImportError(f"{preface} the package flash_attn seems to be not installed. {install_message}")
ImportError: FlashAttention2 has been toggled on, but it cannot be used due to the following error: the package flash_attn seems to be not installed. Please refer to the documentation of https://huggingface.co/docs/transformers/perf_infer_gpu_one#flashattention-2 to install Flash Attention 2.
2025-03-05T20:19:38.398338 - Prompt executed in 66.13 seconds
```
## Attached Workflow
Please make sure that workflow does not contain any sensitive information such as API keys or passwords.
```
Workflow too large. Please manually upload the workflow from local file system.
```
## Additional Context
(Please add any additional context or steps to reproduce the error here)
単純に、Falsh-Attention用のライブラリーが足りないだけです。これもtritonと同じで、どうも公式のWindows用whlがないらしいのですが(以前はあった)、以下サイトで入手できます。
以下のようにインストールします。
インストール後、以下のコマンドを実行して、trueが返ってくれば、正常にインストールが完了しています。
python_embeded\python.exe -c "import torch; from flash_attn.flash_attn_interface import flash_attn_func; print('Flash Attention is available:', hasattr(torch.nn.functional, 'scaled_dot_product_attention'))"これで冒頭のノードのように、Florence2をFalsh-Attention上で使用できますが、pytorchのみでも十分高速なので、現時点「これ」をやる意味が、多分ほとんどないです。
ComfyUIのノードで今現在、Flash-Attentionをガチに使うノードがほとんどないからです。
(以前、一度入れて消した何かのノードであった気もしますが)
じゃ、何故にわざわざ今「これ」をやり、しかも記事にするかと言えば、tritonの例があるからです。
あれも、私は以前から注目はしてたんですよ、下マガジンのように。
だけど、ぶっちゃけxformersをインストールし、かつtritonをインストールしていない状態(そもそも公式がWindows非対応)の時に、Lama-Cleanerで出る警告が気に食わないってだけの理由だったんですよ、最初は。
だから一回、上マガジン内で「tritonがインストールされていません的な警告を消す」為だけのコードも、作ったことがあるのです。
だけど、これがWaveSpeed...というかtorch.compileで必須になって、いやホント、人間何処で何が役に立つかわからんなと思いましたさ。
以前からtritonに注目してなかったら、「何ソレ?」からスタートする羽目になってましたからね。
予備知識があって、Windows用whlがどこで手に入るかは調べていたので、WaveSpeedにも早く対応していけた訳です。
それと同じで、このFlash-Attentionてライブラリーは、VRAM消費削減に役立つプログラムなので、今後誰かが…特に高速化チューニングに関しては世界一の技術レベルと言っても良い中国系エンジニア殿の誰かが、これを活かした何かを発明しないとも限らないので。
今は主にFlorence2でしか用途がなく、しかもほとんど意味がないとしても後日、何の役に立つか…わかりませんからね、tritonのように。