Skip to main content

Getting Your A/B Test Results via Email

Updated over 2 months ago

Ever changed your listing description, title, or policy—and then completely forgot about it a week later?

Yeah, us too.

That’s why we built A/B Test Result Emails into Rankbreeze. They're designed to give you clear, actionable feedback about how your listing changes are affecting your visibility.

RankBreeze (UX) – Figma - Google Chrome 2025-06-25 at 11.28.42 PM

🧠 What’s an A/B Test Again?

In Rankbreeze, when you make a change to your listing (like tweaking your title or adjusting amenities), it gets logged in your A/B Testing Section. From there, Rankbreeze automatically starts tracking how that change performs over time.

Once the test is done, we’ll send you an email summary with the results—so you can see whether the change was a winner... or not-so-much.


💬 Why Are We Sending These?

As a short term rental operator, you’re consistently making changes to improve your listing's performance. We want to make sure you’re not left wondering if they made a difference.

These emails help you:

  • Stay in the loop without constantly checking dashboards

  • Make smarter, faster decisions based on real performance data

  • Easily show your team and clients what’s working (and what’s not)

  • Stop second-guessing your optimization efforts


💌 What’s in the Email?

Each email includes:

  • A quick summary of the test

  • A clear result: positive or negative

  • Multiple metrics showing performance changes (for integrated listings)

  • Recommendations based on the results

The goal is to keep you informed and help you understand how changes impact your visibility.


⏰ When Will I Receive These Emails?

We’ll only send an A/B Test Result Email when 4 out of 6 key metrics show a clear trend—either positive (overperforming) or negative (underperforming) compared to similar listings. This ensures the result emails are meaningful and backed by data.

  • Positive Result: 4 or more metrics performed better than similar listings

  • Negative Result: 4 or more metrics didn’t perform as well as similar listings

  • ⚖️ Inconclusive Results: 3 performed better, 3 underperformed—too mixed to call, so no email is sent.

Without an Airbnb integration, results will only show ranking changes.
👉 Tip: Complete your Airbnb integration for full visibility insights.

  • Each email covers one completed test per listing

  • You’ll receive emails for both Auto-tracked changes (like edits to photos or policies) and Manually added tests.


🎉 If the Result is Positive...

Cue the confetti! 🎊 Your change boosted visibility—and possibly bookings.

Now’s the time to:

  • Share the win with your team or clients

  • Apply similar strategies to other listings

  • Keep testing to refine your formula for success


😬 When the Test Is Negative...

No stress—not every change hits the mark, and that’s totally normal.

You’ll see exactly what was tested, and you can:

  • Revert to the previous version

  • Try a different approach

  • Or start a fresh test with new ideas

Knowledge = power 💡


⚙️ Can I Turn These Emails Off?

Absolutely. If you'd prefer not to receive these emails:

  1. Go to your account settings

  2. Disable A/B Test Results Emails

Screen Recording 2025-06-30 at 12.27.02.24 PM

Changed your mind? You can re-enable A/B Test Result Emails anytime in your settings.


💡 Pro Tips for Testing Success

  • One change at a time: Keep tests clean for clearest results

  • Let it run: Allow tests to run their full duration when possible

  • Consider seasonality: Beach house changes hit different in winter

  • Use "Track a change": Log changes Rankbreeze doesn’t auto-detect—like marketing campaigns or pricing strategy shifts


🤔 FAQs

Why didn't I receive results for my change?

  • Test is still running (needs full duration)

  • Results are inconclusive (3 positive - 3 negative results)

  • Email notifications are disabled in your settings

How long do tests run?

By default, auto-tracked tests run for 14 days (2 weeks). You can update this in your account settings.


❓ Need Support?

If you have any questions about a specific test result or need help managing your email preferences, our support team is here to help.

Did this answer your question?