A Quick introduction to A/B Testing

Get compliant today in the European Union, United States, Canada, United Kingdom, Australia, Brazil & South Africa with the only Privacy Suite for WordPress that offers a fully-featured plugin for Worldwide Compliance.

This will be a quick introduction to enable and configure A/B testing, as well as understanding the statistics and what might be some follow-up actions. Before we start:

Enable A/B Testing

  1. Enable A/B testing under Settings.
  2. Enter the duration of the testing period. We suggest a minimum of 30 days to make sure significance can be calculated.

Configure A/B Testing

  1. Go to Cookie banner
  2. Under Cookie banner settings choose “Add Banner”.
  3. Edit your new Cookie banner as variation on your default banner. Make sure you name your cookie banner so you can recognize it easily.
  4. Save and it will start automatically

Checking A/B Testing results

We will explain the 4 points in below graph showing the statistics of your A/B testing.

  1. Countdown of your current A/B test
  2. Dropdown of the available consent types. 
  3. The two banners shown in two different colors. You can hover over the bars for more information. More about this and how you might interpret this below.

Interpreting A/B Testing results

We will explain the 4 points in below graph showing the statistics of your A/B testing.

  1. For this we use the Opt-in banner to identify results.
  2. This axis shows the conversions.
  3. This axis shows the following possible user interactions:

Do Not Track: Privacy settings in the browser overruled consent management on your website. The banner was not shown.
No choice: The banner was shown, but the user has not interacted with banner.
No warning: With GEO IP enabled, the banner will not be shown in not support regions. For example; if you target the USA & Canada and someone from Mexico enters your website. A “No Warning” is registered.
Functional, Statistics and Marketing are the registered consent categories.

In theory, one consent registration can cause 3 hits, one per each category.

4. Who is the winner?

In the example you will see the right column edges out the left column on every category. If optimising conversions is the goal. Right would be the banner. Maybe you know why by looking at the banners below!


Recent articles

The Privacy Suite for WordPress
Get compliant today with the only Privacy Suite made for WordPress


Popular articles

Join our mailing list - 8 Tips & Tricks in your inbox over the next 8 weeks!