Back in early 2023, the image generation models were quite capable, but they required the user to type paragraph long prompts filled with obscure artistic styles, resolutions, references in order to leverage its capability.
I wanted to remove this barrier, so I decided to fine-tune a model that could take a prompt in simple words and turn it into a prompt suitable for the image generation models.
To achieve that, I used Claude 2 (yes, Claude's first public model) to construct instruction-and-prompt pairs from a collection of roughly 15,000 high-quality image prompts, then fine-tuned Llama 2 13B on Replicate to translate a simple human description into a model-ready prompt for Stable Diffusion, Midjourney or DALL·E.