Autoregressive transformers can generate coherent images from arbitrary text descriptions — the first major demonstration that language models can create visual content.
Introduces DALL-E, a 12B parameter transformer that generates images from text descriptions by modeling text and image tokens autoregressively. Demonstrates creative composition and concept blending from natural language.