What is Causal Lift?
Causal Lift is our geo-based incrementality testing solution that helps marketers measure the true impact of their campaigns by comparing treated and control regions. Instead of relying on clicks or attribution models, Causal Lift isolates what actually drove conversions or sales. To learn more, check out this article.
What insights can I get from a Geo Lift experiment?
A Geo Lift experiment reveals the true incremental impact of your advertising campaigns on outcomes like conversions, customer acquisition, or traffic. We typically translate that into actionable metrics such as:
iCAC: Incremental Cost per Acquired Customer
iCPConv: Incremental Cost per Conversion
iCPSes: Incremental Cost per Session
These metrics help you understand how much you're truly paying for incremental results—filtering out what would have happened anyway.
At a high level, a causal lift experiment can uncover opportunities to reallocate budget – for instance, you might discover a campaign isn’t actually driving incremental sales, allowing you to invest it elsewhere or discover the incremental value is undervalued compared to traditional attribution allowing you to increase budget for that channel.
On which platforms can I run Causal Lift?
Google Ads: Available globally
Meta Ads: Available globally
TikTok: Currently available in the US only
At what level can I run a Geo Lift test (channel, ad, campaign)?
Causal Lift operates at the campaign level. You can test a single campaign or a group of campaigns together. However, if multiple campaigns are grouped into one test, the results will be aggregated, and we won’t be able to isolate performance by individual campaign.
Can I test a PMax or Advantage+ campaign?
Performance Max (PMax): ✅ Yes, it can be tested.
Advantage+ Shopping Campaigns: ❌ No, these are not eligible for testing due to limited control over targeting.
Regular campaigns using Advantage+ features (like CBO, Advantage+ Placements, Audience, or Creative): ✅ Yes, these are eligible.
Can it measure impact on sales beyond Shopify?
Because the attribution is based on location and not cookies, we can measure sales from all channels as long as we can track the location of a sale. We can measure conversions from Amazon Seller Central natively and even physical retail if you provide us with the data.
How granular are the geographic regions tested?
We rely on standardized geographic partitions with sufficient independence to minimize spillover:
US: Nielsen DMAs (210 regions)
Europe: NUTS3, for example
France: Departments (101 regions)
Germany: Districs (400 regions)
Denmark: Provinces (11 regions)
etc.
How do you choose test and control geographies?
We use a stratified randomization approach. Regions are grouped into “bins” based on historical performance (e.g., past sales or conversions). Within each bin, regions are randomly assigned to either the test or control group. This ensures a balanced design—test and control groups are similar in size, business importance, and historical behavior. To learn more about the approach behind causal lift, check out this article.
How do you ensure test and control regions are comparable?
Before the campaign begins, we verify that test and control regions are statistically similar in terms of volume and trend using historical data. During the analysis, we also use synthetic controls to account for any remaining differences, creating a reliable counterfactual to compare against.
How do I know the lift isn’t just due to chance?
We calculate confidence intervals around the estimated lift to quantify uncertainty. These intervals show the range where the true lift likely falls. If the confidence interval includes zero (or is too wide), it suggests the result may not be statistically significant.
Additionally, we use simulation and sampling-based error estimation before and after the test to ensure the findings are robust—not just a result of random variation.
How much volume do I need to run a Geo Lift test?
Geo Lift relies on detecting outcome differences across regions. For tests focused on new customer acquisition, we recommend a baseline volume of at least 100 acquisitions per day.
Additionally, the campaign or set of campaigns being tested should be impactful enough to generate a detectable signal above the noise. If the expected lift is too small relative to natural geographic variability, results may be inconclusive.
In some cases, we will recommend focusing on the traffic outcome (Sessions) to measure impact, in this case, volume is typically large enough to run an experiment.
Why would I run a Geo Lift experiment on a traffic outcome instead of conversions?
There are cases where measuring incremental traffic is both strategic and more practical than measuring conversions.
A common example is testing SEM brand campaigns. The core question is:
“What’s the true added value of bidding on our own brand name in search results?”
By measuring sessions, we can determine whether users still reach your site organically when paid ads are turned off. Traffic reacts faster than conversions, so this type of test can deliver directional insights in as little as 2 weeks.
You might also choose to optimize for traffic in cases where:
Conversion volume is too low to power a reliable test.
You’re testing upper-funnel awareness campaigns (e.g., YouTube or Meta TOFU) where the primary goal is driving site visits, not immediate purchases.
When appropriate, we can estimate incremental conversions by applying your historical conversion rate to the observed lift in sessions—giving you a directional sense of performance while keeping testing efficient.
How does the process of running a Causal Lift test with Polar work?
Running a Causal Lift test with Polar is designed to be collaborative, low-risk, and insight-driven. Here's what the process looks like:
Kickoff & Test Scoping
We start with a discovery call to understand your marketing goals and performance questions. Together, we assess which experiments are feasible and valuable. We’ll also discuss testing risk—e.g., we won’t recommend pausing a high-performing campaign if it could meaningfully hurt your sales or brand performance.Test Design & Approval
Based on your goals and historical data, we’ll propose a tailored test design—including region selection, duration, and estimated measurement precision. You’ll review and approve the setup before anything goes live.Implementation & Live Tracking
We handle the geo-targeting setup and coordinate with your media team to ensure accurate campaign delivery. As long as your data sources are connected via our integrations, you’ll get access to a live experiment dashboard, showing in-flight metrics, forecasted impact, and final lift results with confidence intervals.Review results and help you with decision-making at the end of the test
From start to finish, we manage the technical heavy lifting—so you can focus on learning what truly drives incremental results.
What kind of setup do I need to run a Causal Lift test?
The setup is simple and lightweight. You just need to have:
Your Polar connector set up with Shopify (to track conversions or sales outcomes)
Your ad platform connected (Google Ads, Meta, or TikTok)
If the experiment is focused on traffic outcomes, we’ll also need the Polar Pixel installed on your site to accurately measure sessions by region.
Once these are in place, everything else—from geo-targeting to test tracking—is handled on our side.
How long should a Geo Lift test run?
Test duration depends on the type of campaign and the volume of data available.
For high-volume campaigns or tests focused on traffic outcomes (like SEM brand), a test can be as short as 2 weeks and still yield meaningful results.
For lower-volume or conversion-based tests (e.g., new customer acquisition), a longer duration—4 to 12 weeks—may be required to achieve statistical precision.
We simulate your expected results upfront and recommend the shortest duration that will deliver a reliable confidence interval based on your goals.
We have a specific experiment in mind that needs a customized approach, can you help?
We are opened to discussing any options for Geo-lift experimentation. For example, if you want to assess incremental impact on physical sales, or test a TV campaign, we can assist you in the design, implementation and evaluation.