Baslines about prompt-driven controllable generation

[wusonghexiaohongmao]

Baselines about prompt-driven controllable generation in Appendix C(especially in table 5) , except for ControlNet [44] and T2I-Adapter [25] on SD v1.5 ,all of other methods use SDXL1.0, is that right?

[kuanhenglin]

For prompt-driven controllable generation, the model details are as follows:

• Ctrl-X, FreeControl, and SDEdit: SDXL v1.0
• ControlNet, T2I-Adapter: SD v1.5, because at the time us writing the paper (~May 2024) the community-trained SDXL v1.0 ControlNets and T2I-Adapters were not great, though they have improved a lot since
• Prompt-to-Prompt, Plug-and-Play: SD v1.5, because they only have official code supporting SD v1.5, and the change in architecture to SDXL v1.0 is nontrivial enough that we couldn't just transfer the methods over to SDXL
• InfEdit: LCM Dreamshaper v7, same reason as Prompt-to-Prompt and Plug-and-Play

Let me know if you have any other questions :D