Understanding the Importance of This A/B Test
This specific test is conducted by comparing the performance of showing a popup on your website against a version where no popup is shown at all. This is a common practice for brands concerned about how popups might influence their overall site experience.
Since no sign-ups can occur on the "no popup" version of the test, the primary metrics to monitor are:
Site Conversion Rate: Does the presence of a popup distract users from completing a purchase?
Bounce Rate: Does the popup cause users to leave the site prematurely?
Step-by-Step: Setting Up The Test
Follow these simple steps to configure a "No Popup" control group for your campaign:
Log in to the Alia Dashboard: Access your Alia dashboard directly from your Shopify admin panel.
Navigate to Campaigns: From the left-hand navigation menu, click on the Campaigns section. This displays all your active and paused campaigns.
Locate Your Target Popup: Find the specific campaign you wish to optimize. This is typically your primary welcome discount or a high-traffic popup.
Duplicate the Popup: Click the dropdown arrow next to the "Preview" button on your campaign and select Duplicate as Draft.
Remove the Triggers: In the editor for the duplicated popup, navigate to the triggers section on the right side and delete all existing triggers. By having no triggers, this version of the campaign will never actually appear to the user.
Important - Remember to remove the smart trigger if it has been enabled.
Save and Ready: Your changes will save automatically. Once you are satisfied, click on Mark as Ready.
Start the Test: Return to the Campaigns section and click Start new A/B test, selecting your original popup and the new "triggerless" version as the variants.
Note: When you remove all triggers from a duplicated campaign, Alia treats it as a "blank" variant. This allows the system to split your traffic while ensuring the control group sees no popup content.
Monitoring Your Results
Once the test is live, Alia will continuously gather data and compare the performance of both versions. You can monitor the progress, statistical significance, and final results directly within the A/B Tests section of your dashboard.