Here is a prompt that that analyzes the sentiment of some text and returns a JSON object containing that sentiment. Here’s what a basic set of tests could look like:
Test 1 - Positive Sentiment
Case: “I am happy.”
Assertion: An equals assertion with the value {"sentiment": "positive"}
Test 2 - Positive Sentiment
Case: “I am sad.”
Assertion: An equals assertion with the value {"sentiment": "negative"}
Test 3 - Is Valid JSON
Case: “I saw a blue car.”
Assertion: A javascript assertion with the following code:
There’s a lot more that could be tested, but having even a basic test suite for each of your prompts can be a great way to safeguard against typos (like misspelling “positive”) or parameter changes (like turning off JSON mode).
For more comprehensive testing scenarios and advanced configurations, explore our in-depth guide on advanced testing techniques.
If you have any questions regarding tests or best practices for your project, get in touch with us.