Derek Wang
Only support Windows Operating System. Linux and MacOS are not supported. 不支持中文操作系统.
Need to install stable-diffusion-webui at first! URL:https://github.com/AUTOMATIC1111/stable-diffusion-webui
Also need to install ControlNet in stable-diffusion-webui!
Supports 3 ControlNet units/Lora/Interrogate/ADetailer in Blender
Combined with ADE20K: ADE20K is a dataset for scene parsing, containing various annotations for objects in the scenes, including house interiors.
Load Stable Diffusion Model: To load the Stable Diffusion and lora models inside Blender.
Preprocess the ADE20K Dataset: Segment the ADE20K dataset images to focus on interior design elements.
Run Stable Diffusion on Segmented Images: Use the segmented masks to guide the generation of new images for interior design by using Stable Diffusion.
Using ADE20K as an input for Stable Diffusion's segmentation ControlNet to render a house interior involves several steps. Prepare the ADE20K segmentation map, configure ControlNet, and then render the scene using Stable Diffusion are all implemented inside Blender by several clicks.
