Running an A/B test with two different Attentive journeys requires a bit of setup across both Alia and Attentive, but once it's in place, you'll be able to test different offers, messaging, or flows end-to-end. Here's how to get it done:
Step 1: Request a New API Unit from Attentive support
Each Attentive journey requires its own dedicated API unit. To get started, reach out to the Attentive support team and request a new API unit for your second popup.
💡 Make sure you have your new journey on Attentive ready for the test that you want to run.
Step 2: Override the API Unit on the Test Popup in Alia
By default, your Alia account is configured with a single API unit that you have connected on the integrations tab. For your A/B test to work correctly, you'll need to override the API unit on the second popup so it points to the new one you just set up.
To override the API unit:
Go to your Alia dashboard and open the test popup.
Navigate to the popup's integration settings section.
Locate the Attentive API unit field and replace the default API unit with the new one provided by Attentive support.
Save your changes.
💡 Leave the original popup untouched, it will continue using the default API unit and journey. Only override the API unit on your new B-variant popup.
Step 3: Launch the A/B Test in Alia
Once both popups are configured and the correct API units are in place, you're ready to kick off the A/B test directly in Alia. The Control (your original popup) will appear under Active popup, and your new variant will appear under Drafts with a Ready status. Click Start new A/B test to proceed.
A New A/B test dialog will appear. Fill in the following:
Title: Enter a descriptive name for your A/B test so you can easily identify it later (e.g., " Offer Test - Feb 2025").
Control: This is pre-set to your active popup. All variants will be measured against it.
Traffic weight: By default, traffic is split equally (50/50) between the Control and Test B. Toggle off Equal traffic split if you want to assign a custom percentage to each variant (e.g., 70/30).
That's it!
Your two popups are now each connected to separate Attentive journeys. As visitors are shown different popup variants, they'll be enrolled into the correct journey automatically.
Best Practices:
Test each popup in preview mode to verify the correct offer and journey are triggered.
Keep offers and journeys clearly named in Attentive so it's easy to tell them apart when reviewing results.
Run the A/B test for a statistically meaningful period before drawing conclusions, typically at least 1–2 weeks depending on your traffic volume.
Monitor subscriber enrolment in both Attentive journeys to catch any misconfigurations early.