Why Smart Testing + Optimization Essentials:
High-converting tests generated for you - no need to design A/B tests from scratch
Winners automatically selected once results reach statistical significance
Up to 9 tests and over 40 variants run in sequence, so your popup keeps improving over time
This article explains what each test does and how it works.
How To Get To Optimization Essentials
Follow these steps to access the Optimization Essentials schedule when setting up a Smart Test.
1. Open the campaign you want to run tests on
Navigate to the campaign in Alia and select the “Create a Smart Test” tab.
2. Select Optimization Essentials
On the Smart Test setup page, you’ll see the available test schedules. Select “Optimization Essentials” to load the full test schedule covered in this article.
Smart Trigger:
What it does: Smart Triggering triggers the popup a second time in a session for a select group of customers who x'd out of the first popup and are now shown to be more likely to convert using our predictive analytics model.
It usually adds 20% - 40% more signups, on average, with no negative impact on site CVR or bounce rate.
It also has a machine learning layer built on top of it, which improves performance at the individual merchant level as it collects more data.
Why it matters: Adds an expected life of 20–40% more signups with no negative impact on site conversion rate or bounce rate.
Copy Variants:
What it does: Tests different headline and button copy combinations on your popup. Instead of leading with the discount upfront (e.g. "15% off"), variants use curiosity-based language - the actual offer is only revealed after the visitor submits their email.
Variants tested include:
Offer descriptor: Mystery, Exclusive, Special
Headline copy: You've Got, Unlock, Claim, Want
Button copy: Continue, Claim % Off, Activate
Why it matters: Works especially well for offers under 20%, where the upfront number alone may not feel compelling enough to act on. Curiosity drives more initial engagement with the popup.
First Step Variants:
What it does: Tests a different first screen on your popup. Instead of showing a standard offer screen, visitors see an interactive format — such as a gamified element or a simple question — before reaching the email input step.
Common first step variants include:
Scratch-off card
Plinko
Spin to Win
Pick to Win
Mystery Box
Yes/No Micro-Commitment Question
Why it matters: First step changes are typically the highest-impact tests. Interactive formats create engagement before asking for an email, which increases the likelihood of completion.
Countdown Timer
What it does: Adds a visible countdown timer to the popup, creating a time-limited feel around the offer.
Why it matters: Urgency is one of the most reliable drivers of conversion. A countdown timer encourages visitors to act immediately rather than intending to sign up later.
Remove Mobile Images:
What it does: Tests a version of the popup with images removed on mobile devices, replacing them with a cleaner, more minimal layout.
Why it matters: On smaller screens, images can crowd the layout and distract from the offer. A minimal design often performs better on mobile by keeping focus on the CTA.
Remove “No Thanks” Button:
What it does: Removes the “No thanks” text link as a dismiss option. The X button to close the popup remains.
Why it matters: Having two ways to dismiss the popup draws attention to the exit rather than the offer. Removing one reduces friction around the decision and keeps more visitors focused on signing up.
X Button Position:
What it does: Moves the close button to the opposite side.
Why it matters: We typically see performance do well when moving the close button from the right side to the left side on mobile, in particular. Most people hold their phone with their right hand and rest their thumb on the screen. Moving the X to the left reduces accidental dismissals, keeping more visitors in the flow.
X Button Delay:
What it does: Tests different delay times before the X button becomes visible after the popup opens.
Why it matters: A short delay gives visitors a moment to read the offer before they can close the popup. The goal is to find the right window — long enough to engage, short enough not to frustrate.
Trigger Delay:
What it does: Tests different timings for when the popup first appears after a visitor lands on the site.
Why it matters: Finding the right trigger timing for your brand can meaningfully improve opt-in rates without increasing friction.
Reviewing and Starting Your Tests:
Once you’ve selected the tests you want to run from the Optimization Essentials schedule, you’ll be taken to a review screen before anything goes live.
From here you can confirm the order the tests will run in and start the schedule when you’re ready.
Prefer a video? Here's a quick Loom walking through the setup step by step:
