Hardware Requirements

[thehappydinoa]

Hi there,

Love this work, super appreciative of a PyTorch port. I was wondering what the intended/recommended hardware specs are for running this model.

Thanks,
Aidan

[lucidrains]

@thehappydinoa Hi Aidan! Thanks for the kind words

No one really knows for sure, as OpenAI is usually tight-lipped, but in one interview they revealed the model size was smaller than DALLE1, which is good news. It means that the hardware requirements should be no worse than https://github.com/ai-forever/ru-dalle

[LifeIsStrange]

see also:
openai/dalle-2-preview#6

Also I believe we can do much better than openAI by leveraging the state of the art ZERO3 https://github.com/microsoft/DeepSpeed