Skip to main content

Optimization Essentials in Smart Testing

Get a complete overview of how Smart Testing works, setting up Optimization Essentials, and maximizing your popup performance.

Written by Sonam Desai

Why Smart Testing + Optimization Essentials:

  • High-converting tests generated for you - no need to design A/B tests from scratch

  • Winners automatically selected once results reach statistical significance

  • Up to 9 tests and over 40 variants run in sequence, so your popup keeps improving over time

This article explains what each test does and how it works.

How To Get To Optimization Essentials

Follow these steps to access the Optimization Essentials schedule when setting up a Smart Test.

1. Open the campaign you want to run tests on

Navigate to the campaign in Alia and select the “Create a Smart Test” tab.

2. Select Optimization Essentials

On the Smart Test setup page, you’ll see the available test schedules. Select “Optimization Essentials” to load the full test schedule covered in this article.


Smart Trigger:

What it does: Smart Triggering triggers the popup a second time in a session for a select group of customers who x'd out of the first popup and are now shown to be more likely to convert using our predictive analytics model.

It usually adds 20% - 40% more signups, on average, with no negative impact on site CVR or bounce rate.

It also has a machine learning layer built on top of it, which improves performance at the individual merchant level as it collects more data.

Why it matters: Adds an expected life of 20–40% more signups with no negative impact on site conversion rate or bounce rate.

Copy Variants:

What it does: Tests different headline and button copy combinations on your popup. Instead of leading with the discount upfront (e.g. "15% off"), variants use curiosity-based language - the actual offer is only revealed after the visitor submits their email.

Variants tested include:

  • Offer descriptor: Mystery, Exclusive, Special

  • Headline copy: You've Got, Unlock, Claim, Want

Button copy: Continue, Claim % Off, Activate

Why it matters: Works especially well for offers under 20%, where the upfront number alone may not feel compelling enough to act on. Curiosity drives more initial engagement with the popup.

First Step Variants:

What it does: Tests a different first screen on your popup. Instead of showing a standard offer screen, visitors see an interactive format — such as a gamified element or a simple question — before reaching the email input step.

Common first step variants include:

  • Scratch-off card

  • Plinko

  • Spin to Win

  • Pick to Win

  • Mystery Box

  • Yes/No Micro-Commitment Question

Why it matters: First step changes are typically the highest-impact tests. Interactive formats create engagement before asking for an email, which increases the likelihood of completion.

Countdown Timer

What it does: Adds a visible countdown timer to the popup, creating a time-limited feel around the offer.

Why it matters: Urgency is one of the most reliable drivers of conversion. A countdown timer encourages visitors to act immediately rather than intending to sign up later.

Remove Mobile Images:

What it does: Tests a version of the popup with images removed on mobile devices, replacing them with a cleaner, more minimal layout.

Why it matters: On smaller screens, images can crowd the layout and distract from the offer. A minimal design often performs better on mobile by keeping focus on the CTA.

Remove “No Thanks” Button:

What it does: Removes the “No thanks” text link as a dismiss option. The X button to close the popup remains.

Why it matters: Having two ways to dismiss the popup draws attention to the exit rather than the offer. Removing one reduces friction around the decision and keeps more visitors focused on signing up.

X Button Position:

What it does: Moves the close button to the opposite side.

Why it matters: We typically see performance do well when moving the close button from the right side to the left side on mobile, in particular. Most people hold their phone with their right hand and rest their thumb on the screen. Moving the X to the left reduces accidental dismissals, keeping more visitors in the flow.

X Button Delay:

What it does: Tests different delay times before the X button becomes visible after the popup opens.

Why it matters: A short delay gives visitors a moment to read the offer before they can close the popup. The goal is to find the right window — long enough to engage, short enough not to frustrate.

Trigger Delay:

What it does: Tests different timings for when the popup first appears after a visitor lands on the site.

Why it matters: Finding the right trigger timing for your brand can meaningfully improve opt-in rates without increasing friction.

Reviewing and Starting Your Tests:

Once you’ve selected the tests you want to run from the Optimization Essentials schedule, you’ll be taken to a review screen before anything goes live.

From here you can confirm the order the tests will run in and start the schedule when you’re ready.


Prefer a video? Here's a quick Loom walking through the setup step by step:


Did this answer your question?