stable-diffusion 3 体验部署流程(ComfyUI)

2024-06-14 02:44

本文主要是介绍stable-diffusion 3 体验部署流程(ComfyUI),希望对大家解决编程问题提供一定的参考价值,需要的开发者们随着小编来一起学习吧!

环境准备

下载及简介

git clone https://huggingface.co/stabilityai/stable-diffusion-3-medium
SD3 checkpoints:

  1. sd3_medium_incl_clips.safetensors (5.5GB)
  2. sd3_medium_incl_clips_t5xxlfp8.safetensors (10.1GB)
  3. sd3_medium.safetensors (4.3GB)

前两个可以像 ComfyUI 中的任何常规checkpoints一样使用。这两个checkpoints之间的区别在于,第一个仅包含 2 个文本编码器:CLIP-L 和 CLIP-G,第二个包含 3 个:CLIP-L、CLIP-G 和 T5XXL。第三个模型不包含文本编码器,必须单独加载它们才能使用该文件。

模型保存

把如下三个模型放在 ComfyUI/models/checkpoints/ 目录中(可以选择其中一个模型体验)

  • sd3_medium_incl_clips.safetensors
  • sd3_medium_incl_clips_t5xxlfp8.safetensors
  • sd3_medium.safetensors
文本编码器保存

从text_encoders目录下载文本编码器,选择其中的一个文件保存到ComfyUI/models/clip/目录中:

  • clip_g.safetensors
  • clip_l.safetensors
  • t5xxl_fp8_e4m3fn.safetensors
  • t5xxl_fp16.safetensors

ComfyUI 测试体验

打开comfyui 界面 导入脚本并执行:

{"last_node_id": 272,"last_link_id": 599,"nodes": [{"id": 11,"type": "TripleCLIPLoader","pos": [-1885,-49],"size": {"0": 315,"1": 106},"flags": {},"order": 0,"mode": 0,"outputs": [{"name": "CLIP","type": "CLIP","links": [5,94],"shape": 3,"slot_index": 0}],"properties": {"Node name for S&R": "TripleCLIPLoader"},"widgets_values": ["clip_g.safetensors","clip_l.safetensors","t5xxl_fp8_e4m3fn.safetensors"]},{"id": 71,"type": "CLIPTextEncode","pos": [-1869.2871546875003,560.071803930664],"size": {"0": 380.4615783691406,"1": 102.07693481445312},"flags": {},"order": 6,"mode": 0,"inputs": [{"name": "clip","type": "CLIP","link": 94}],"outputs": [{"name": "CONDITIONING","type": "CONDITIONING","links": [93,580],"shape": 3,"slot_index": 0}],"title": "CLIP Text Encode (Negative Prompt)","properties": {"Node name for S&R": "CLIPTextEncode"},"widgets_values": ["bad quality, poor quality, doll, disfigured, jpg, toy, bad anatomy, missing limbs, missing fingers, 3d, cgi"],"color": "#322","bgcolor": "#533"},{"id": 68,"type": "ConditioningSetTimestepRange","pos": [-1010,167],"size": {"0": 317.4000244140625,"1": 82},"flags": {},"order": 10,"mode": 0,"inputs": [{"name": "conditioning","type": "CONDITIONING","link": 90}],"outputs": [{"name": "CONDITIONING","type": "CONDITIONING","links": [91],"shape": 3,"slot_index": 0}],"properties": {"Node name for S&R": "ConditioningSetTimestepRange"},"widgets_values": [0.1,1]},{"id": 70,"type": "ConditioningSetTimestepRange","pos": [-1006,314],"size": {"0": 317.4000244140625,"1": 82},"flags": {},"order": 8,"mode": 0,"inputs": [{"name": "conditioning","type": "CONDITIONING","link": 93,"slot_index": 0}],"outputs": [{"name": "CONDITIONING","type": "CONDITIONING","links": [92],"shape": 3,"slot_index": 0}],"properties": {"Node name for S&R": "ConditioningSetTimestepRange"},"widgets_values": [0,0.1]},{"id": 67,"type": "ConditioningZeroOut","pos": [-1370,337],"size": {"0": 211.60000610351562,"1": 26},"flags": {},"order": 9,"mode": 0,"inputs": [{"name": "conditioning","type": "CONDITIONING","link": 580}],"outputs": [{"name": "CONDITIONING","type": "CONDITIONING","links": [90],"shape": 3,"slot_index": 0}],"properties": {"Node name for S&R": "ConditioningZeroOut"}},{"id": 266,"type": "Note","pos": [-2352,576],"size": {"0": 308.061279296875,"1": 102.86902618408203},"flags": {},"order": 1,"mode": 0,"properties": {"text": ""},"widgets_values": ["Resolution should be around 1 megapixel and width/height must be multiple of 64"],"color": "#432","bgcolor": "#653"},{"id": 13,"type": "ModelSamplingSD3","pos": [-974,-220],"size": {"0": 315,"1": 58},"flags": {"collapsed": false},"order": 7,"mode": 0,"inputs": [{"name": "model","type": "MODEL","link": 565}],"outputs": [{"name": "MODEL","type": "MODEL","links": [591],"shape": 3,"slot_index": 0}],"properties": {"Node name for S&R": "ModelSamplingSD3"},"widgets_values": [3]},{"id": 69,"type": "ConditioningCombine","pos": [-662,165],"size": {"0": 228.39999389648438,"1": 46},"flags": {},"order": 11,"mode": 0,"inputs": [{"name": "conditioning_1","type": "CONDITIONING","link": 91},{"name": "conditioning_2","type": "CONDITIONING","link": 92}],"outputs": [{"name": "CONDITIONING","type": "CONDITIONING","links": [592],"shape": 3,"slot_index": 0}],"properties": {"Node name for S&R": "ConditioningCombine"}},{"id": 233,"type": "PreviewImage","pos": [535.1143750722272,-147.92548481673106],"size": {"0": 604.7489624023438,"1": 592.15576171875},"flags": {},"order": 14,"mode": 0,"inputs": [{"name": "images","type": "IMAGE","link": 599}],"properties": {"Node name for S&R": "PreviewImage"}},{"id": 231,"type": "VAEDecode","pos": [141,-177],"size": {"0": 210,"1": 46},"flags": {},"order": 13,"mode": 0,"inputs": [{"name": "samples","type": "LATENT","link": 596},{"name": "vae","type": "VAE","link": 557}],"outputs": [{"name": "IMAGE","type": "IMAGE","links": [599],"shape": 3,"slot_index": 0}],"properties": {"Node name for S&R": "VAEDecode"}},{"id": 252,"type": "CheckpointLoaderSimple","pos": [-2314,-203],"size": {"0": 746.7357788085938,"1": 98},"flags": {},"order": 2,"mode": 0,"outputs": [{"name": "MODEL","type": "MODEL","links": [565],"shape": 3,"slot_index": 0},{"name": "CLIP","type": "CLIP","links": [],"shape": 3,"slot_index": 1},{"name": "VAE","type": "VAE","links": [557],"shape": 3,"slot_index": 2}],"properties": {"Node name for S&R": "CheckpointLoaderSimple"},"widgets_values": ["sdv3/2b_1024/sd3_medium.safetensors"]},{"id": 271,"type": "KSampler","pos": [-269,-179],"size": {"0": 315,"1": 446},"flags": {},"order": 12,"mode": 0,"inputs": [{"name": "model","type": "MODEL","link": 591},{"name": "positive","type": "CONDITIONING","link": 595},{"name": "negative","type": "CONDITIONING","link": 592},{"name": "latent_image","type": "LATENT","link": 593},{"name": "seed","type": "INT","link": 597,"widget": {"name": "seed"},"slot_index": 4}],"outputs": [{"name": "LATENT","type": "LATENT","links": [596],"shape": 3,"slot_index": 0}],"properties": {"Node name for S&R": "KSampler"},"widgets_values": [945512652412924,"fixed",28,4.5,"dpmpp_2m","sgm_uniform",1]},{"id": 135,"type": "EmptySD3LatentImage","pos": [-2352,438],"size": {"0": 315,"1": 106},"flags": {},"order": 3,"mode": 0,"inputs": [],"outputs": [{"name": "LATENT","type": "LATENT","links": [593],"shape": 3,"slot_index": 0}],"properties": {"Node name for S&R": "EmptySD3LatentImage"},"widgets_values": [1024,1024,1]},{"id": 6,"type": "CLIPTextEncode","pos": [-1876.2871546875003,284.0718039306641],"size": {"0": 389.06927490234375,"1": 207.84902954101562},"flags": {},"order": 5,"mode": 0,"inputs": [{"name": "clip","type": "CLIP","link": 5}],"outputs": [{"name": "CONDITIONING","type": "CONDITIONING","links": [595],"shape": 3,"slot_index": 0}],"properties": {"Node name for S&R": "CLIPTextEncode"},"widgets_values": ["a female character with long, flowing hair that appears to be made of ethereal, swirling patterns resembling the Northern Lights or Aurora Borealis. The background is dominated by deep blues and purples, creating a mysterious and dramatic atmosphere. The character's face is serene, with pale skin and striking features. She wears a dark-colored outfit with subtle patterns. The overall style of the artwork is reminiscent of fantasy or supernatural genres"],"color": "#232","bgcolor": "#353"},{"id": 272,"type": "PrimitiveNode","pos": [-2342,278],"size": {"0": 210,"1": 82},"flags": {},"order": 4,"mode": 0,"outputs": [{"name": "INT","type": "INT","links": [597],"slot_index": 0,"widget": {"name": "seed"}}],"title": "Seed","properties": {"Run widget replace on values": false},"widgets_values": [945512652412924,"fixed"]}],"links": [[5,11,0,6,0,"CLIP"],[90,67,0,68,0,"CONDITIONING"],[91,68,0,69,0,"CONDITIONING"],[92,70,0,69,1,"CONDITIONING"],[93,71,0,70,0,"CONDITIONING"],[94,11,0,71,0,"CLIP"],[557,252,2,231,1,"VAE"],[565,252,0,13,0,"MODEL"],[580,71,0,67,0,"CONDITIONING"],[591,13,0,271,0,"MODEL"],[592,69,0,271,2,"CONDITIONING"],[593,135,0,271,3,"LATENT"],[595,6,0,271,1,"CONDITIONING"],[596,271,0,231,0,"LATENT"],[597,272,0,271,4,"INT"],[599,231,0,233,0,"IMAGE"]],"groups": [{"title": "Load Models","bounding": [-2410,-339,969,488],"color": "#3f789e","font_size": 24},{"title": "Input","bounding": [-2409,181,972,523],"color": "#3f789e","font_size": 24},{"title": "Output","bounding": [464,-273,741,814],"color": "#3f789e","font_size": 24}],"config": {},"extra": {},"version": 0.4
}

测试结果展示
image.png
image.png
image.png
image.png
image.png
image.png


【Qinghub Studio 】更适合开发人员的低代码开源开发平台
QingHub企业级应用统一部署
QingHub企业级应用开发管理
QingHub演示
https://qingplus.cn

这篇关于stable-diffusion 3 体验部署流程(ComfyUI)的文章就介绍到这儿,希望我们推荐的文章对编程师们有所帮助!



http://www.chinasem.cn/article/1059154

相关文章

乐鑫 Matter 技术体验日|快速落地 Matter 产品,引领智能家居生态新发展

随着 Matter 协议的推广和普及,智能家居行业正迎来新的发展机遇,众多厂商纷纷投身于 Matter 产品的研发与验证。然而,开发者普遍面临技术门槛高、认证流程繁琐、生产管理复杂等诸多挑战。  乐鑫信息科技 (688018.SH) 凭借深厚的研发实力与行业洞察力,推出了全面的 Matter 解决方案,包含基于乐鑫 SoC 的 Matter 硬件平台、基于开源 ESP-Matter SDK 的一

UnrealScriptIDE调试环境部署

先安装vs2010   再安装VSIsoShell.exe, 下载地址 https://pan.baidu.com/s/10kPNUuDGTbWXbz7Nos-1WA       fd3t   最后安装unside,下载地址 https://archive.codeplex.com/?p=uside  安装中间有一步选择Binary文件夹要选对路径。   安装好以后,启动 UDKDe

工作流Activiti初体验—流程撤回【二】

已经玩工作流了,打算还是研究一下撤回的功能。但是流程图里面并不带撤回的组件,所以需要自己动态改造一下,还是延续上一个流程继续试验撤回功能。《工作流Activiti初体验【一】》 完整流程图 我们研究一下分发任务撤回到发起任务,其他环节的撤回类似 撤回的原理大概如下: 将分发任务后面的方向清空,把发起任务拼接到原来的判断网关,然后结束分发任务,这样流程就到发起任务了 此时的流程如上图,

ROS话题通信流程自定义数据格式

ROS话题通信流程自定义数据格式 需求流程实现步骤定义msg文件编辑配置文件编译 在 ROS 通信协议中,数据载体是一个较为重要组成部分,ROS 中通过 std_msgs 封装了一些原生的数据类型,比如:String、Int32、Int64、Char、Bool、Empty… 但是,这些数据一般只包含一个 data 字段,结构的单一意味着功能上的局限性,当传输一些复杂的数据,比如:

青龙面板部署通用教程,含服务器、路由器、X86等部署方法

1. 拉取镜像/更新镜像 docker pull whyour/qinglong:latest 2. 删除镜像 docker rmi whyour/qinglong:latest 3. 启动容器 普通服务器 docker run -dit \-v $PWD/ql/config:/ql/config \-v $PWD/ql/log:/ql/log \-v $PWD/ql/db:

宝塔面板部署青龙面板教程【简单易上手】

首先,你得有一台部署了宝塔面板的服务器(自己用本地电脑也可以)。 宝塔面板部署自行百度一下,很简单,这里就不走流程了,官网版本就可以,无需开心版。 首先,打开宝塔面板的软件商店,找到下图这个软件(Docker管理器)安装,青龙面板还是安装在docker里,这里依赖宝塔面板安装和管理docker。 安装完成后,进入SSH终端管理,输入代码安装青龙面板。ssh可以直接宝塔里操作,也可以安装ssh连接

手把手教你入门vue+springboot开发(五)--docker部署

文章目录 前言一、前端打包二、后端打包三、docker运行总结 前言 前面我们重点介绍了vue+springboot前后端分离开发的过程,本篇我们结合docker容器来研究一下打包部署过程。 一、前端打包 在VSCode的命令行中输入npm run build可以打包前端代码,出现下图提示表示打包完成。 打包成功后会在前端工程目录生成dist目录,如下图所示: 把

[Centos7] 部署Zabbix5.0

目录 0 卸载 Zabbix1 准备工作1.1 关闭防火墙1.2 关闭SELinux1.3 重启服务器1.4 安装MySQL 2 配置 Zabbix yum 源2.1 安装zabbix的软件仓库配置包2.2 安装 Software Collections 仓库2.3 修改 Zabbix 仓库配置文件 3 安装 Zabbix3.1 遇到报错Requires: libmysqlclient.so

完整的申请邓白氏编码的流程(手把手教你申请邓白氏编码

完整的申请邓白氏编码的流程(手把手教你申请邓白氏编码)  标签: 编码邓白氏编码申请流程苹果开发者账号申请 2016-07-08 16:13  2274人阅读  评论(2)  收藏  举报   分类: 技术  苹果开发  邓白氏编码申请 版权声明:本文为博主原创文章,未经博主允许不得转载。     申请公司的苹果开发者账号和企业级的苹

办理河南建筑工程乙级设计资质的流程与要点

办理河南建筑工程乙级设计资质的流程与要点 办理河南建筑工程乙级设计资质的流程与要点主要包括以下几个方面: 流程: 工商注册与资质规划:确保企业具有独立法人资格,完成工商注册,并明确乙级设计资质的具体要求,包括注册资本、人员配置、技术条件等。 专业技术人员配置: 雇佣或签约符合资质要求的专业技术人员,包括但不限于:一级注册结构工程师2名、一级注册建筑师2名、注册暖通工程师1名、注册供配电工