Skip to main content

A/B Test Filters: Visually Integration

Updated over 2 weeks ago

Heatmap <> Visually Integration Guide

We're excited to announce that heatmap now fully integrates with Visually, allowing you to analyze heatmap data for each of your A/B test variants. This powerful combination helps you understand not just which variant performs better, but why it performs better through visual behavior analysis.
​

Getting Started with heatmap + Visually

What does this integration do?

When you run A/B tests using Visually, heatmap automatically detects and tracks which variant each visitor sees. This enables you to:

  • View separate heatmaps for each variant

  • See exactly how users interact with different designs

  • Make data-driven decisions based on actual user behavior

  • Understand the "why" behind your test results

Do I need to add any code?

No additional code required! If you already have both heatmap and Visually installed on your website, the integration works automatically. We detect your Visually experiments and start tracking variant data immediately.


​

How to View Your Visually Test Data

Step-by-Step Guide:

  1. Log into your Heatmap.com account

  2. Navigate to your heatmap view

  3. Click the "Filter" button

  4. Select "A/B Tests" from the filter options

  5. Choose "Visually" from the platform dropdown

  6. Select your Visually experiment from the list

  7. Choose the specific variant you want to analyze

  8. Click "Apply" to view the filtered heatmap data

What you'll see:

  • A screenshot of your selected variant

  • A heatmap of the click data from visitors who saw that variant

  • Scroll and movement data specific to that variant

  • The variant name as configured in Visually

  • Total visitor count for that variant(by device type)

Comparing Your Visually Variants

Want to see how user behavior differs between your control and variant? Use our Compare feature:

  1. Select your first variant (following steps above)

  2. Instead of clicking "Apply", click "Compare"

  3. Select your second variant

  4. View side-by-side behavioral differences

This is perfect for understanding which design elements drive engagement and why certain variants outperform others.

​

Troubleshooting Common Issues

→ "I don't see Visually in my filter options"

  • First, verify:

    • Your Visually experiment is actively running

    • You have traffic flowing to your variants

    • Both heatmap and Visually scripts are properly installed

  • Then:

    • Wait 1-2 hours after starting your experiment

    • Ensure you have sufficient traffic (at least 50+ visitors per variant)

    • Check that your Visually experiment status is "Active"

→ "My variant preview doesn't look right"

This can happen with dynamic content or personalized elements.

  • ​Solutions:

    • Verify the variant displays correctly on your live site

    • Clear your browser cache and refresh

    • Check if you're using any dynamic elements that might not render in previews

    • Contact our support team with your experiment details

→ "I see variant IDs instead of friendly names"

We pull variant names directly from Visually.

  • To fix this:

    • Ensure your variants have descriptive names in Visually

    • Allow 1-2 hours for name updates to sync

    • Refresh your heatmap.com dashboard

→ "No data available for my variant"

This typically means insufficient traffic to that variant.

  • Check:

    • Your traffic split in Visually (e.g., 50/50, 80/20)

    • That the variant is actively receiving visitors

    • Your experiment has been running long enough to collect data

    • Date range in heatmap matches your experiment timeline

Best Practices for Visually Users

Maximize your insights:

  • Run experiments for adequate duration

    • We recommend at least 1,000 visitors per variant for meaningful heatmaps

    • Allow tests to run for complete business cycles (include weekends)
      ​

  • Use descriptive variant names in Visually

    • Instead of "Variant A", use "Blue CTA Button"

    • This makes analysis much easier in Heatmap.com
      ​

  • Focus on one major change per test

    • This makes it easier to identify what drives behavioral changes

    • Multiple changes can muddy your heatmap insights
      ​

  • Document your hypotheses

    • Know what behavior changes you expect to see

    • Use heatmaps to validate or challenge these assumptions

When to use heatmap data:

  • During tests: Monitor for unexpected user behavior

  • After tests: Understand why winners won and losers lost

  • For iteration: Identify new test opportunities based on user behavior

Understanding the Data

What we track for each Visually variant:

  • All standard heatmap interactions (clicks, moves, scrolls)

  • Time spent on page

  • Rage clicks and dead clicks

  • Scroll depth

  • Hover patterns

Data timing:

  • Collection begins immediately when experiment starts

  • Variant data appears in filters within 1-2 hours

  • Meaningful patterns emerge after 500+ visitors per variant

Important notes:

  • Historical data before integration cannot be filtered by variant

  • Each visitor is tracked with their assigned variant for their entire session

  • Data is real-time (no delay once initial setup is complete)

Advanced Tips

Analyzing test results:

  1. Look for unexpected click patterns between variants

  2. Compare scroll depth to understand content engagement

  3. Identify "dead zones" where no interaction occurs

  4. Watch for rage clicks indicating user frustration

Presenting findings:

  • Use Compare mode for stakeholder presentations

  • Export heatmap images for reports

  • Combine with Visually's conversion data for complete picture

Getting Help

Need assistance? For integration issues:

  1. Verify both platforms are properly installed

  2. Check your Visually experiment is active

  3. Ensure adequate traffic to variants

When contacting support:
​

  • Email: support@heatmap.com

  • ​Subject: "Visually Integration Support"

  • Please include:

    • Your website URL

    • Visually experiment name and ID

    • Variant names

    • When you started the experiment

    • Screenshots of the variants

    • Approximate traffic levels

We're here to help! Our support team is familiar with Visually and can help troubleshoot any integration issues. Most issues are resolved within 24 hours.

​

What's Next?

Coming soon:

  • Compare filtered variants to overall traffic

  • Enhanced preview capabilities

  • Additional filtering options

  • Export capabilities for variant comparisons

The heatmap + Visually integration represents a powerful combination for understanding not just what works, but why it works. We're excited to be part of your optimization journey!
​

Questions? Reach out to support@heatmap.com - we're here to help you succeed.

Did this answer your question?