Setting Up Smart Testing in Alia
Smart Testing eliminates the hassle of manual A/B testing by using AI to automatically generate, run, and optimize high-converting popup tests. It continuously picks winners once they reach statistical significance and sets up new tests for you. Additionally, Smart Testing is included as a core feature in all Alia plans, requiring no extra setup or installation.
Is Smart Testing included in my Alia plan, and does it need separate installation?
Smart Testing is an integrated feature of the Alia application, ensuring enhanced user capabilities without the need for additional setup or installation.
Trained on over 500 million popup views from our 2,000+ merchants, Smart Testing ensures your campaigns improve without constant manual input.
Getting Started
Click “Create Smart Test”
In your popup campaign dashboard, locate the Create Smart Test button in the bottom-right corner.
Choose a Test Pack
After clicking, you’ll see a selection of automated Smart Tests. We recommend starting with the Optimization Essentials pack, which includes multiple proven high-converting tests.
Selecting & Editing Tests
Once you’ve chosen Optimization Essentials, you’ll see proposed tests such as:
Smart Trigger – Re-triggers the popup within the same session for visitors who dismissed it but are predicted to convert.
Copy Variants – Tests different heading and button text.
Remove Mobile Images – Tests the impact of removing non-essential images on mobile devices.
Remove 'No Thanks' Option – Hides the explicit opt-out button while keeping the close (X) button.
X Button Position – Compares left vs. right placement of the close button on mobile.
X Button Delay – Tests different delay timings before the close button appears on mobile and desktop.
Trigger Delay – Evaluates alternative timing (e.g., 5 seconds) before showing the popup.
You can accept, reject, or edit each test. This ensures:
Mistakes from AI suggestions can be corrected.
Your team can customize the look and feel.
Adding Your Own Tests
In addition to AI-proposed tests, you can add your own:
Create new variants of copy or design.
Add logic-based triggers.
Stack multiple experiments.
Smart Testing will manage these alongside AI-generated ones.
Final Setup
Rearrange Test Order – Drag and reorder tests to run in your preferred sequence.
Share With Team – Copy the test link and share it with collaborators.
Click “Start Test” – Once ready, launch your Smart Testing campaign.
Monitoring Results
Access live results anytime by clicking Smart Test info at the bottom-right of your campaign.
AI automatically ends tests once significance is reached.
You can hide low-converting variants at any time to accelerate learnings.- Smart Tests automatically hide severely underperforming variants in the early stages of testing to focus resources on promising configurations.
Important Notes
While a Smart Test is live, any modification to the control popup, such as disabling a gradient or changing the layout, will automatically restart the test schedule.
AI continuously generates new tests as winners are found, keeping optimization ongoing within the schedule you generated.
You remain in control—hide, edit, or re-order tests anytime.
Best Practices for Updating Popup Variants
To maintain the integrity of Smart Testing while updating popup variants, follow these steps:
End the current test.
Launch a new test comparing the desired variants (e.g., fullscreen vs. non-fullscreen).
Continue the Smart Testing schedule with the winning variant.
✅ With Smart Testing, your popups continuously improve—hands-free and powered by AI.