Projects

ChatGPT × Stable Diffusion

Generate images directly from ChatGPT. Back when GPT-4 just launched and image generation was not available in ChatGPT.

Built
April 2023, at an OpenAI hackathon
Link
View source ↗

Why I made it

Image generators could produce remarkable results, but using them still meant translating an idea into model-specific prompts and repeatedly starting the interaction over. I wanted ChatGPT to carry the intent and context across the creative process.

What it became

I built a ChatGPT plugin with a FastAPI service, an OpenAPI specification and Replicate's Stable Diffusion model. ChatGPT turned the conversation into an image prompt, called the generator and used subsequent requests to revise the prompt and generate another image without making the person operate the underlying model directly.

What happened

I built the plugin at an OpenAI hackathon before ChatGPT plugins were generally available, then released it publicly in April 2023. It did not anticipate DALL·E 3's model quality or perform local pixel editing; it anticipated the product experience: ChatGPT expanding an ordinary request into an image prompt, generating the result and carrying the context through conversational revisions.