Setting Up Smart Testing in Alia
Smart Testing eliminates the hassle of manual A/B testing by using AI to automatically generate, run, and optimize high-converting popup tests. It continuously picks winners once they reach statistical significance and sets up new tests for you.
Trained on over 500 million popup views from our 2,000+ merchants, Smart Testing ensures your campaigns improve without constant manual input.
Getting Started
Click “Create Smart Test”
In your popup campaign dashboard, locate the Create Smart Test button in the bottom-right corner.
Choose a Test Pack
After clicking, you’ll see a selection of automated Smart Tests. We recommend starting with the Optimization Essentials pack, which includes multiple proven high-converting tests.
Selecting & Editing Tests
Once you’ve chosen Optimization Essentials, you’ll see proposed tests such as:
AI Smart Triggering – Shows the popup at the optimal time for each visitor.
Copy Variants – Tests different heading and button text.
Remove Image on Mobile – Optimizes mobile experience by hiding heavy visuals.
Automatic Time Delay Refinement – Adjusts popup delay for engagement.
You can accept, reject, or edit each test. This ensures:
Mistakes from AI suggestions can be corrected.
Your team can customize the look and feel.
Adding Your Own Tests
In addition to AI-proposed tests, you can add your own:
Create new variants of copy or design.
Add logic-based triggers.
Stack multiple experiments.
Smart Testing will manage these alongside AI-generated ones.
Final Setup
Rearrange Test Order – Drag and reorder tests to run in your preferred sequence.
Share With Team – Copy the test link and share it with collaborators.
Click “Start Test” – Once ready, launch your Smart Testing campaign.
Monitoring Results
Access live results anytime by clicking Smart Test info at the bottom-right of your campaign.
AI automatically ends tests once significance is reached.
You can hide low-converting variants at any time to accelerate learnings.
Important Notes
While a Smart Test is live, you can only edit popups by restarting the current test phase.
AI continuously generates new tests as winners are found, keeping optimization ongoing within the schedule you generated.
You remain in control—hide, edit, or re-order tests anytime.
✅ With Smart Testing, your popups continuously improve—hands-free and powered by AI.