Prompt Engineering — Evaluating and Refining Your Prompt

Lean how to evaluate and refine prompt

Tony
5 min readMay 31, 2023

--

Note, full “Prompt Engineering” mind map is available at: “Prompt Engineering Mind Map

What is Prompt Evaluation and Refining?

Evaluating and refining prompts involve assessing the quality and effectiveness of prompts you provide to an AI model and making necessary improvements to achieve desired outputs.

Evaluating Prompts

This refers to the process of testing and assessing how well a given prompt works in instructing an AI model to generate desired responses. This typically involves:

  • Implementing the prompt and observing the output
  • Assessing the accuracy and relevance of the response
  • Evaluating if the AI model adhered to the prompt’s intent
  • Comparing the output to your expected or desired result

Refining Prompts

Based on the evaluation, you might find that a prompt needs to be improved or refined. This could mean:

  • Making instructions more explicit
  • Adding more context or detail
  • Changing the phrasing or…

--

--