Let’s look at the foliage season example above. Once AI generates the response tailored to the kindergarten audience, you can simply add a follow-up. For example, instruct it to “make it funnier,” or “explain it to college students who are English majors using analogies they will understand.” There is no need to repeat the context and other parameters. Additionally, most AI systems will allow you to generate a new response if you’d like to see a different version without entering another prompt.
You can continue to build upon AI’s responses just by adding other prompts. New models continue to improve the ability to carry context across interactions as context windows grow larger (OpenAI, 2023). This iterative process unlocks more potential from AI (Neil, 2023). This continuity can also become a hindrance if you want to work on a new topic, at which point it’s best to start a new chat.
Limitations
While prompt engineering can improve the outputs from AI, there are some limitations to bear in mind.
Focus More on Problems, Less on Prompts
AI platforms and the models they are based upon are rapidly evolving and becoming more sophisticated. For that reason, some experts doubt whether the importance of prompt engineering will be long lasting. Smith (2023) predicts that AI models may soon be able to write prompts themselves.
Acar (2023) foresees a future where advanced AI systems will be able to intuit our intentions without deliberate prompts. He calls for our attention the difference between problems and prompts. “Prompt engineering focuses on crafting the optimal textual input by selecting the appropriate words, phrases, sentence structures, and punctuation. In contrast, problem formulation emphasizes defining the problem by delineating its focus, scope, and boundaries.” (Acar, 2023). In the long run, it may be more important to develop skills in crafting descriptions of problems as compared to mastering prompt engineering (Acar, 2023).
Entering a prompt and receiving output is much like the process of having a conversation with another person. But just like a conversation between two humans, interacting with AI can sometimes be complicated and AI may forget where it was in the conversation. This is another reason focusing more on the problem may be a more helpful approach than repeated attempts at crafting perfect prompts.
Be Aware of AI’s Flaws
Despite rapid advancements, AI isn’t flawless. Concerns around factual accuracy persist, as highlighted by a CNET incident in 2023 where AI-generated content was found factually incorrect (Thorbecke, 2023). Similar cases where AI generated factually false information can easily be found in many different settings, too, including academia. AI tools can produce content that is inaccurate, misleading, and even completely made up (even if it may seem perfectly coherent and believable on the surface). This problem is so common that it’s referred to as an AI hallucination (Weise & Metz, 2023). It is important to keep in mind AI’s limitations when formulating your prompts and always look at results with a critical eye.
Avoid AI’s Potential Harms
AI can perpetuate harmful biases. Many at MIT may be familiar with a controversy where an MIT student of Asian heritage asked AI to turn her photo into a professional looking headshot (Buell, 2023) only to find that it generated an image of her with bright blue eyes and a lighter skin tone. Sam Altman, CEO of ChatGPT, recognizes that AI falls short of removing biases and producing non-inclusive language, and advocates for iterative development that solicits broader public feedback to counter such challenges (Yu, 2023).
Conclusion
As users seek to harness the power of AI, crafting the right prompt becomes an essential skill, guiding AI towards desired outcomes and ensuring optimal results. The promise of AI systems like ChatGPT, Claude, and others lies in their ability to adapt and learn from your carefully crafted inputs, mimicking human conversation and generating pertinent outputs. Yet, we must remain vigilant about potential flaws, biases, and the implications of over-relying on these systems without critical scrutiny.
References
Acar, O. A. (2023, June 8). AI prompt engineering isn’t the future. Harvard Business Review. https://hbr.org/2023/06/ai-prompt-engineering-isnt-the-future
Buell, S. (2023, August 24). Do AI generated images have racial blind spots? See an example. The Boston Globe. https://www.bostonglobe.com/2023/07/19/business/an-mit-student-asked-ai-make-her-headshot-more-professional-it-gave-her-lighter-skin-blue-eyes
Cook, J. (2023, June 26). How to write effective prompts for ChatGPT: 7 Essential steps for best results. Forbes. https://www.forbes.com/sites/jodiecook/2023/06/26/how-to-write-effective-prompts-for-chatgpt-7-essential-steps-for-best-results/?sh=5a76b51e2a18
Johnmaeda. (2023, May 23). Prompt engineering overview. Microsoft Learn. https://learn.microsoft.com/en-us/semantic-kernel/prompt-engineering
Liu, D. (2023, June 8). Prompt engineering for educators: Making generative AI work for you. LinkedIn. https://www.linkedin.com/pulse/prompt-engineering-educators-making-generative-ai-work-danny-liu
Mollick, E. (2023, January 10). How to. . . use ChatGPT to boost your writing. One Useful Thing. https://www.oneusefulthing.org/p/how-to-use-chatgpt-to-boost-your
Mollick, E. (2023, March 29). How to use AI to do practical stuff: A new guide. One Useful Thing. https://www.oneusefulthing.org/p/how-to-use-ai-to-do-practical-stuff
OpenAI. (2023). GPT-4 technical report. OpenAI. https://openai.com/research/gpt-4
Smith, C. S. (2023, April 5). Mom, Dad, I want to be a prompt engineer. Forbes. https://www.forbes.com/sites/craigsmith/2023/04/05/mom-dad-i-want-to-be-a-prompt-engineer/?sh=206f254359c8
Thorbecke, C. (2023, January 25). Plagued with errors: A news outlet’s decision to write stories with AI backfires. CNN Business. https://www.cnn.com/2023/01/25/tech/cnet-ai-tool-news-stories/index.html
Urban, E. (2023, July 18). What is intent recognition? Microsoft Learn. https://learn.microsoft.com/en-us/azure/ai-services/speech-service/intent-recognition
Weise, K., & Metz, C. (2023, May 9). When AI chatbots hallucinate. The New York Times. https://www.nytimes.com/2023/05/01/business/ai-chatbots-hallucination.html
Yu, E. (2023, June 19). Generative AI should be more inclusive as it evolves, according to OpenAI’s CEO. ZDNET. https://www.zdnet.com/article/generative-ai-should-be-more-inclusive-as-it-evolves