Should I be A/B testing having Prism AI vs. not having Prism AI?
We strongly recommend not running an A/B test comparing Prism AI vs. no Prism AI.
Here’s why:
It needs data to learn: Prism AI improves as it sees more traffic. Splitting traffic early slows down learning.
Performance improves over time: The system continuously optimizes, so early results won’t reflect its full impact.
Built-in control already exists: Prism AI naturally shifts traffic between your variants based on performance, meaning weaker versions get less exposure over time.
If you’d still like to test it, the best approach is to:
Let Prism AI fully train and optimize first
Then run a test comparing optimized Prism AI vs. your standard popup
Does the AI change the popup on its own and create new variants (design, copy, etc.)?
No — your team creates/selects the variants.
Prism AI does not generate new designs or copy automatically.
Instead:
You define the different versions (copy, imagery, offers, etc.)
Prism AI determines which variants to show, and to whom, based on performance across your decided targeting dimensions
This gives you:
Full control over your creative
Automated optimization of how those creatives are delivered
Can I tell Prism AI to show a specific variant on a specific page instead of optimizing on its own?
No — Prism AI is built to optimize automatically across your targeting based on ongoing performance.
If you want full manual control (e.g., assigning specific variants to specific pages):
You can use the standard Prism element (non-AI)
This allows fixed rules, but does not include ongoing optimization
Do I need to provide Prism AI with all my page URLs or UTMs?
No — nothing needs to be manually provided.
Prism AI automatically pulls all of your targeting dimension data that it can optimize across.
It uses this data to continuously optimize performance without any additional setup.
Can I run a normal A/B test when a Prism AI element is on my popup?
Yes! There are no issues with running normal A/B tests when you have a Prism AI element on your popup.
We recommend leaving your Prism AI element untouched on your test variants, and simply setting up your split test as normal.
How does it know which popup variant works best for a shopper? Does it know information about the shopper before they land on the site?
Prism AI doesn’t rely on pre-known identity or personal data about a shopper before they land on your site.
Instead, it continuously learns from real performance data. As visitors interact with your popup, Prism AI measures which variants drive more opt-ins and revenue across the targeting dimensions you’ve defined (like page, UTM, or traffic source).
Over time, it automatically shifts more traffic toward the top-performing variants within each of those dimensions. If one version is clearly outperforming others in a specific context, it will be shown more often in that context.
You can think of it as a dynamic, continuously optimizing A/B test—running across all your variants at once, and getting smarter with every interaction.