The Hidden Curriculum of ChatGPT
I spent the first three months talking to ChatGPT like I was ordering a coffee. Polite. Vague. Hoping for the best.
The AI responded accordingly. It gave me generic paragraphs, cautious answers, and the kind of prose that reads like a committee of bureaucrats wrote it. I blamed the model. I thought it was stupid.
Then I watched a colleague do something different. She didn't ask. She commanded. She provided constraints, formats, and examples. She told the AI exactly who it was supposed to be and what rules it had to follow. Her outputs were sharp. Mine were mush.
The difference wasn't intelligence. It was instruction.
That difference now has a name: prompt engineering. And according to a 2023 paper by Jules White and colleagues at Vanderbilt University, it is a genuine skill that can be learned, cataloged, and reused like software design patterns (White et al., 2023). The authors studied how people interact with large language models and found that the quality of the output depends almost entirely on the structure of the input. Not the model. Not the compute. The prompt.
This is not a trivial observation. It means that the most powerful AI in the world is only as good as the person typing at the keyboard. And most of us, myself included, have been typing terribly.
Why Your First Prompt Is Probably Wrong

When you open ChatGPT for the first time, you do what humans have done for millennia: you ask a question. "What is quantum computing?" "Write a poem about my cat." "Explain the French Revolution."
White and his team argue that this instinct is fundamentally flawed. A question is not a prompt. A prompt is a specification. It is a set of rules, constraints, and goals that the model must follow (White et al., 2023). Asking a question gives the model too much freedom. It defaults to the safest, most generic version of an answer.
The authors analyzed hundreds of real-world prompts and found that effective ones share a structure. They include a persona, a format, a constraint, and a goal. They do not assume the model knows anything about the context. They spell everything out.
For example, instead of asking "Write a marketing email," an engineered prompt might say: "You are a senior marketing director at a B2B SaaS company. Write a 150 word email to a CFO. Use short sentences. Include a specific ROI statistic. End with a single question."
The difference is dramatic. The first prompt produces a paragraph that sounds like every other email. The second produces something that sounds like a person who knows their job.
White et al. (2023) call this the "persona pattern." It is one of sixteen patterns they cataloged in their study. And it works because large language models are fundamentally role playing machines. They do not have a default identity. They adopt whatever identity you give them. If you do not give them one, they default to "helpful assistant," which is the most boring character in the universe.
The Pattern Catalog: A New Kind of Programming

The core contribution of White et al. (2023) is not just that prompt engineering works. It is that prompt engineering can be systematized. The authors identified sixteen reusable patterns, each designed to solve a specific problem. They are not tricks. They are techniques.
Here are the patterns that surprised me most:
The Persona Pattern
This is the simplest and most powerful pattern. You tell the model who it is. "You are a skeptical scientist reviewing a paper." "You are a 10 year old who loves dinosaurs." "You are a lawyer defending a controversial case."
White et al. (2023) found that the persona pattern dramatically changes the tone, vocabulary, and assumptions of the output. The model does not just pretend. It genuinely shifts its behavior. A model told to be a scientist uses more hedging language. A model told to be a lawyer uses more persuasive framing. The persona becomes the lens through which all information is filtered.
The Flipped Interaction Pattern
This one changed how I use ChatGPT entirely. Instead of asking the model a question, you tell the model to ask you questions. "You are a hiring manager. Ask me ten questions to evaluate my suitability for a data science role."
White et al. (2023) describe this as a way to reverse the power dynamic. The model becomes the expert. You become the subject. The result is a structured interview that surfaces information you would not have thought to provide.
The Cognitive Verifier Pattern
This is the pattern that makes ChatGPT sound smarter than it actually is. You instruct the model to break down a complex question into smaller subquestions and answer each one before giving a final answer.
For example: "When I ask you a question, first list the subquestions you need to answer to give a complete response. Then answer each one. Then combine them into a final answer."
White et al. (2023) noted that this pattern reduces hallucinations and improves accuracy. The model is forced to think sequentially rather than jumping to a conclusion. It is the closest thing to "chain of thought" reasoning that a non programmer can use.
The Recipe Pattern
This is the pattern for generating procedures. You provide a known sequence of steps and ask the model to fill in the details. "I am baking a cake. I have flour, eggs, sugar, and butter. Give me a recipe that uses these ingredients in this order: mix dry, mix wet, combine, bake."
White et al. (2023) found that the recipe pattern works because it constrains the output to a known structure. The model cannot invent a new procedure. It has to follow the skeleton you provide.
The Template Pattern
This is the pattern for maintaining consistent formatting. You provide a template with placeholders and ask the model to fill them in.
For example: "Generate a product description using this template: '[Product Name] is a [adjective] [noun] that helps [target audience] achieve [benefit]. It features [feature 1], [feature 2], and [feature 3].'"
White et al. (2023) emphasized that the template pattern is essential for anyone who needs consistent output across multiple generations. It turns the model into a fill in the blank machine rather than a free form writer.
How They Built the Catalog

The methodology behind White et al. (2023) is worth understanding. It was not a controlled experiment with thousands of participants. It was a systematic analysis of prompt engineering techniques used by experts.
The authors collected prompts from forums, internal experiments, and published work. They identified recurring structures. They tested each pattern against ChatGPT and documented whether it reliably produced better outputs. They then organized the patterns into a catalog with a consistent format: name, intent, motivation, structure, example, and consequences.
This is the same methodology used to create software design patterns in the 1990s. The "Gang of Four" book on design patterns transformed software engineering by giving developers a shared vocabulary for solving common problems. White et al. (2023) are attempting the same thing for prompt engineering.
The catalog is not exhaustive. The authors explicitly state that new patterns emerge constantly as the models change. But the framework is durable. If you understand the structure of a pattern, you can adapt it to new models and new tasks.
What the Research Does Not Prove
I want to be honest about the limitations of this work. The paper by White et al. (2023) is not a randomized controlled trial. It does not measure effect sizes. It does not compare prompt engineering to other methods of improving AI output, such as fine tuning or retrieval augmented generation.
The patterns were tested on ChatGPT, which is a specific model from a specific company. The same patterns may not work as well on other models. Claude, Gemini, and Llama have different training data and different guardrails. A pattern that works on one may fail on another.
There is also a question of generalizability. The authors are computer scientists. Their examples are heavily skewed toward software development, data analysis, and technical writing. The patterns may be less useful for creative writing, therapy, or other domains where ambiguity is desirable.
And finally, there is the open question of whether prompt engineering is a lasting skill or a temporary workaround. As models improve, they may become better at understanding vague prompts. They may not need the structure that White et al. (2023) prescribe. The patterns may become obsolete.
I think this is unlikely. The models are getting better, but the fundamental problem remains: a language model has no context unless you give it context. Even a perfect model benefits from clear instructions. The patterns are not crutches. They are protocols.
The Real Reason Prompt Engineering Matters
There is a deeper argument in White et al. (2023) that is easy to miss. The authors frame prompts as a form of programming. Not code. Not syntax. But programming in the broadest sense: giving a machine a set of instructions that produce a desired output.
This is a radical claim. It means that anyone who can write a good prompt is a programmer. You do not need to know Python. You do not need to understand machine learning. You need to be able to specify what you want with enough precision that a machine can follow it.
That is a skill. And it is a skill that has been undervalued because it looks easy. Typing words into a box does not feel like engineering. But it is. The difference between a bad prompt and a good prompt is the same as the difference between a buggy program and a working one.
White et al. (2023) provide the vocabulary to talk about this skill. Instead of saying "I wrote a good prompt," you can say "I used the persona pattern combined with the template pattern to constrain the output." That is not jargon. It is precision. It allows you to debug your prompts the same way you debug code.
What This Actually Means
Here is the practical takeaway. Not the philosophy. The actionable steps.
- ▸Always assign a persona. Before you type anything, decide who the model is. A skeptical reviewer. A patient teacher. A ruthless editor. Write it at the top of your prompt. The output will be dramatically different.
- ▸Use the flipped interaction for discovery. If you do not know what to ask, tell the model to ask you. "Ask me five questions to diagnose my problem." This works for troubleshooting, brainstorming, and learning.
- ▸Break complex requests into subquestions. Do not ask for a final answer immediately. Instruct the model to list the subquestions first, answer each one, and then synthesize. This reduces errors by forcing sequential reasoning.
- ▸Provide templates for consistency. If you need the same format across multiple outputs, provide a template with placeholders. The model will fill it in reliably. This is essential for emails, reports, and product descriptions.
- ▸Combine patterns deliberately. The real power comes from stacking patterns. Persona plus template plus recipe. Each pattern constrains a different dimension of the output. The more constraints you provide, the more control you have.
I have been using these patterns for months now. My outputs are not just better. They are different. They sound like they were written by someone who knows what they are doing. Because now, I do.
References
- [1]Jules White, Quchen Fu, Sam Hays, Michael Sandborn (2023). A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT. arXiv (Cornell University)DOI· 786 citations
