In this guide, we'll show you how to easily compare two chatbots by testing different system messages side by side in PromptHub.
Steps:
Create a New Project:
Go to the "Projects" section and click Create New Project.
Select "Chat" type
Add a System Message:
In the project, add a System Message in the Template section
Choose Your Model:
Select the model you want to use
Commit the Version:
Click Commit to save this version of your chatbot (system message) for future comparisons.
Select the Compare Version:
In the Compare With drop-down, select a previous version to compare against. If it's your first comparison, you’ll only see one option.
Create a New System Message:
In the uncommitted (working) version, write a new system message, or maybe test the same system message just across a different model.
Test the chatbot by interacting with it.
Test and Compare:
Quickly test both versions side by side to see how they respond to similar situations.
This process allows you to compare how different system messages impact the chatbot's behavior, helping you optimize your prompts effectively.