Skip to main content

How to Set Up an A/B Test with No Mobile Images on Your Popup

In this article you will learn how to optimize your mobile conversion rates by comparing the performance of image-heavy popups against clean, text-only versions.

Pallavi Joshi avatar
Written by Pallavi Joshi
Updated over 2 weeks ago

Why Test Mobile Images?

While showing product images on your popup is generally a great way to drive engagement, mobile screens offer limited real estate. Sometimes, high-resolution visuals can make a mobile popup look cluttered or distracting, potentially annoying visitors and leading to lower conversion rates.
Finding the right balance between visual appeal and a streamlined user experience is crucial. By testing a version of your popup without mobile images, you can determine:

  • If a minimalist design improves the User Experience (UX) on smaller devices.

  • Whether text-only popups lead to faster interactions and higher sign-up rates.

  • What visual style best resonates with your specific brand audience.

Step-by-Step: Setting Up The Test


Follow these steps to configure an A/B test that removes images specifically for your mobile audience:

  1. Log in to the Alia Dashboard: Access your Alia dashboard directly from your Shopify admin panel.

  2. Navigate to Campaigns: From the left-hand navigation menu, click on the Campaigns section to view all your active and paused popup campaigns.

  3. Locate Your Target Popup: Find the specific campaign you wish to optimize. This is usually your highest-performing popup or your primary welcome discount.

  4. Duplicate the Popup: Click the dropdown button next to the "Preview" button on your campaign and select Duplicate as Draft.

  5. Remove the Mobile Image: Click into the duplicated popup editor. Ensure you are viewing the Mobile section. Click on the image you wish to remove; it will be highlighted in the left-side editor panel. Click the three dots (options menu) on the image section and select Delete.

  6. Save and Prepare: Adjust any remaining elements (like text alignment or button size) to fill the space. Alia automatically saves changes. Once satisfied, click Mark as Ready.

  7. Start the Test: Return to the Campaigns section, find your original campaign, and click Start new A/B test, selecting your newly prepared draft as the variant.

💡 Pro Tip: When removing images, ensure your Call to Action (CTA) remains prominent. A text-only popup relies heavily on compelling copy and clear buttons to drive results.

Setting Up via Alia Smart Testing


If you prefer an automated approach, you can set this A/B test using Alia Smart Testing. Simply click on Create Smart Test within your campaign settings. This feature allows Alia to use intelligent algorithms to distribute traffic and determine the winner more efficiently.
To learn more about the benefits of smart testing, click here to read our guide on Smart Testing.
Once your test is live, Alia will continuously gather data and compare the performance of both versions. You can monitor conversion rates, click-through rates, and overall revenue impact directly within the A/B Tests section of your dashboard.

Did this answer your question?