Convert `diffusers` model weights to the `original CompVis` ckpt format

[apolinario]

There is a conversion script that converts the CompVis ckpt to diffusers available here, but the other way around does not exist yet.

As some Stable Diffusion UIs and utilities are built on top of the CompVis codebase, it would be useful to be able to use diffusers tools back on those. It would be great to have a community contribution on this!

[rashmimarganiatgithub]

@patrickvonplaten, can I take this or is someone working on this?

[apolinario]

Hi @rashmimarganiatgithub , feel free to take this! Currently there is no one working on this as far as we are aware of!

[devilismyfriend]

@patrickvonplaten, can I take this or is someone working on this?

Please do :) a lot of folks want to do this due to dreambooth working better on diffusers but the various existing webuis don't use diffusers

[kabachuha]

Just reminding for any aspiring devs that there is already .ckpt -> diffusers .bin script in this repo https://github.com/huggingface/diffusers/blob/main/scripts/convert_original_stable_diffusion_to_diffusers.py

Someone will just have to reverse all the operations

Upd2: ooops, I was tired and missed the initial comments, sorry

Upd: Reference for another huggingface model .bin -> .ckpt converter
https://github.com/jsksxs360/bin2ckpt/blob/main/convert.py

[AmericanPresidentJimmyCarter]

Upd: Reference for another huggingface model .bin -> .ckpt converter

That looks like it is for a tensorflow checkpoint, not pytorch?

[jachiam]

https://gist.github.com/jachiam/8a5c0b607e38fcc585168b90c686eb05

I think this works

I got it to do a conversion on my machine and then generated a reasonable image with the converted weights

[jachiam]

I have now opened a PR to incorporate the conversion script into Diffusers

[Magicalore]

https://gist.github.com/jachiam/8a5c0b607e38fcc585168b90c686eb05

I think this works

I got it to do a conversion on my machine and then generated a reasonable image with the converted weights

Hey can you actually use this on your PC?

[jachiam]

https://gist.github.com/jachiam/8a5c0b607e38fcc585168b90c686eb05
I think this works
I got it to do a conversion on my machine and then generated a reasonable image with the converted weights

Hey can you actually use this on your PC?

Yes.