A/B testing helps you compare different campaign variations to determine which performs best. This guide walks you through how to view, analyze, and finalize your A/B test results in Alia.
Step 1: Access A/B Test Results
Navigate to your campaign dashboard in Alia.
Click on "View A/B Test Results" to open the test results page.
Step 2: Review Test Timeline
The test results will display the start and end dates automatically.
If the test is still running, you'll see data up to the current time period.
Step 3: Compare Control vs. Test Group
Identify the original popup (which has the label Control) and the other one would be the test version.
Observe how the two versions compare in terms of key metrics.
Step 4: Analyze Key Performance Metrics
Scroll through all major statistics displayed on the dashboard.
Pay close attention to Sign up rates, conversion rates, and revenue impact.
💡 The percentage difference between the control and test groups will help determine which performs better.
Step 5: Check the Statistical Significance
Each metric includes a statistical significance indicator:
✅ Check mark = Results are statistically significant.
⏳ Clock symbol = Not enough data to determine a winner yet.
💡 If statistical significance isn’t reached, allow the test to run longer for more reliable results.
Step 6: Toggle Between Performance Stats
Switch between different stats, including:
✅ Attributed Sales – Revenue generated from the campaign.
✅ Attributed Sales Purchase Rate – Conversion rate after sign-up.
Step 7: Identify the Winning Variation
At the bottom of the results page, select the test group that performed best.
Alia will automatically:
Set the losing variation to draft mode.
Keep only the winning variation live.
What’s Next?
Now that you’ve identified the winning variation, use these insights to:
🚀 Optimize future campaigns.
📊 Test new variables like messaging, design, or audience targeting.