For text-to-image synthesis, the Disco Diffusion notebook is pretty popular right now. Like other notebooks that use CLIP, it produces results that aren’t very coherent, but which are interesting in the sense that they will reliably combine all of the elements described in a prompt in surprising and semi-sensible ways, even when those elements never occurred together in the models’ training sets.
The Glide notebook from OpenAI is also worth looking at. It produces results that are much more coherent but also much less interesting than the CLIP notebooks. Currently, only the smallest version of the model is publicly available, so the results are unfortunately less impressive than those in the paper.
Also of note are the Chinese and Russian efforts to replicate DALL-E. Like Glide, the results from those are coherent but not very interesting. They can produce some very believable results for certain prompts, but struggle to generalize much outside of their training sets.
DALL-E itself still isn’t available to the public, though I’m personally still holding out hope that OpenAI will offer a paid API at some point.
For text-to-image synthesis, the Disco Diffusion notebook is pretty popular right now. Like other notebooks that use CLIP, it produces results that aren’t very coherent, but which are interesting in the sense that they will reliably combine all of the elements described in a prompt in surprising and semi-sensible ways, even when those elements never occurred together in the models’ training sets.
The Glide notebook from OpenAI is also worth looking at. It produces results that are much more coherent but also much less interesting than the CLIP notebooks. Currently, only the smallest version of the model is publicly available, so the results are unfortunately less impressive than those in the paper.
Also of note are the Chinese and Russian efforts to replicate DALL-E. Like Glide, the results from those are coherent but not very interesting. They can produce some very believable results for certain prompts, but struggle to generalize much outside of their training sets.
DALL-E itself still isn’t available to the public, though I’m personally still holding out hope that OpenAI will offer a paid API at some point.