By sharing a spatial prototype across layers and using one compact vector per layer, ProtoDiffusion achieves efficient multi-layer image generation that's 19× faster than decomposing flat images, while maintaining high reconstruction quality.
ProtoDiffusion generates multi-layer graphic designs (like Photoshop files) by representing each layer compactly as a single vector, rather than full spatial grids. This reduces memory from N×H×W tokens to H×W+N tokens. The model can generate designs from images or text, automatically determining layer count and layout without requiring them as input.