Someone has already concluded that ChatGPT can be used as a template for Midjourney image generation. In this article, we show how to create these hints according to individual use cases, which can make the hints generated by ChatGPT more controllable.
Choose a Prompt Template
Midjourney's template is very structured, so we use the following structure here:
Let ChatGPT work for us
In order for ChatGPT to work, we also need to create ChatGPT hints so that it can generate Midjourney hints for us.
What ChatGPT's hints do is let ChatGPT iterate over our thoughts and create image hints related to them. We only put our ideas and requests to ChatGPT and let ChatGPT work for us.
A reliable and effective ChatGPT prompt has two main components: instructions and context
First we start with context: we can simply turn our requirements into prefixes, scenarios and suffixes:
#这是Midjourney的命令
/imagine prompt: PREFIX, SCENE, SUFFIX
PREFIX defines the image's medium and style
SCENE defines the content
SUFFIX modulates PREFIX and SCENE
The next step is to combine our context with instructions on how ChatGPT processes the information:
This is the basic prompt anatomy for image generation with Midjourney:
/imagine prompt: PREFIX, SCENE, SUFFIX
PREFIX defines the image's medium and style
SCENE defines the content
SUFFIX modulates PREFIX and SCENE
Create 10 prompts that illustrate the theme "father-son relationship"
The above and below restrictions are our requirements for ChatGPT, and ChatGPT will return the results according to our requirements, which is probably like this:
1. /imagine prompt: Vintage sepia photograph, A father teaching his son how to ride a bicycle in a park, With a sense of warmth and nostalgia.
2. /imagine prompt: Renaissance oil painting, A king passing his crown to his son in a lavish throne room, With an atmosphere of grandeur and responsibility.
3. /imagine prompt: Animated family movie style, A dad and son building a rocket ship in their backyard, Infused with a sense of adventure and bonding.
4. /imagine prompt: Watercolor sketch, A father and son fishing on a quiet lake as the sun sets, With a serene and tranquil atmosphere.
5. /imagine prompt: Comic book art, A superhero father with his sidekick son saving the day, With dynamic action and a sense of camaraderie.
6. /imagine prompt: Traditional Japanese Ukiyo-e style, A samurai father and his young son practicing martial arts under a cherry blossom tree, With a sense of discipline and tradition.
7. /imagine prompt: 90s sitcom illustration, A dad and son laughing together while attempting to fix a car in a garage, With a vibe of humor and togetherness.
8. /imagine prompt: Modern abstract art, An interpretation of the emotional bond between a father and son, With swirling colors that convey deep connection and love.
9. /imagine prompt: Children’s book illustration, A boy on his father’s shoulders, looking up at the stars, With a sense of wonder and shared curiosity.
10. /imagine prompt: Sci-fi concept art, A father and son in futuristic gear exploring an alien planet, With a sense of discovery and shared adventure.
We can simply copy/paste these tips into Midjourney. Here are some of those results:
The above are the simplest ChatGPT usage skills, and we can also perform more advanced applications below
Expand ideas
Because ChatGPT uses a large corpus for training, we can let it help us expand our ideas, such as the following tips:
keep theme, set prefix to "modern abstract art",
scene should contain metaphors (without explanations),
use suffix to implement lens and camera types. list 5 prompts
The result is as follows:
/imagine prompt: Modern abstract art, An anchor and a soaring kite entwined, With a fisheye lens capturing the circular interplay of stability and freedom.
/imagine prompt: Modern abstract art, A torch casting shadows of successive taller figures, With a tilt-shift lens emphasizing the central flame as the source of growth.
/imagine prompt: Modern abstract art, Rivers of color weaving from a storm to a calm sea, With a wide-angle lens to envelop the viewer in the journey.
/imagine prompt: Modern abstract art, A lighthouse beam morphing into a tapestry of music notes, With a telephoto lens bringing focus to the distant harmony.
/imagine prompt: Modern abstract art, Clock gears turning into an unfolding map, With a macro lens capturing the intricacies of time and adventure's intertwinement.
The result is as follows:
Optimize ChatGPT output
Midjourney has a function called permutation, which we have also introduced in previous articles, so you can use the following method to let ChatGPT generate results in the corresponding format:
This is the basic prompt anatomy for image generation with Midjourney:
/imagine prompt: PREFIX, SCENE, SUFFIX
PREFIX defines the image's medium and style
SCENE defines the content
SUFFIX modulates PREFIX and SCENE
You can group variations in comma-separated lists like this:
{PREFIX 1, PREFIX 2, PREFIX 3} or {SCENE 1, SCENE 2} or {SUFFIX 1, SUFFIX 2}
Important: when using variations, each item in the list has to be a single word or a phrase without comma (otherwise we'd break the syntax)
###
Create a prompt that illustrate the theme "father-son relationship".
Use 2 variations for prefix and 3 variations for suffix
Then ChatGPT will return the following results:
/imagine prompt: {oil painting, watercolor}, a father teaching his son how to
ride a bike in a park, {with a touch of nostalgia, under a warm sunset,
captured in a moment of laughter}
Thus, when copying this prompt to Midjourney, you get the following results:
In other words, 6 pictures can be generated directly, the following is an example of the result:
Summarize
ChatGPT is a large language model trained through a large corpus, while Midjourney can generate high-quality images, and achieve more comprehensive and rich content creation by combining the advantages of the two. This comprehensive content generation method can obtain more information and inspiration through words and images at the same time.
https://avoid.overfit.cn/post/60d45f154b7943258f86f8bc7150e79b
By Tristan Wolff