Close this search box.


In this article

Category: ,


Recent articles

A Quick introduction to A/B Testing

This will be a quick introduction to enable and configure A/B testing, as well as understanding the statistics and what might be some follow-up actions. Before we start:

Enable A/B Testing

  1. Enable A/B testing under Settings.
  2. Enter the duration of the testing period. We suggest a minimum of 30 days to make sure significance can be calculated.

Configure A/B Testing

  1. Go to Cookie banner
  2. Under Cookie banner settings choose “Add Banner”.
  3. Edit your new Cookie banner as variation on your default banner. Make sure you name your cookie banner so you can recognize it easily.
  4. Save and it will start automatically

Checking A/B Testing results

We will explain the 4 points in below graph showing the statistics of your A/B testing.

  1. Countdown of your current A/B test
  2. Dropdown of the available consent types. 
  3. The two banners shown in two different colors. You can hover over the bars for more information. More about this and how you might interpret this below.

Interpreting A/B Testing results

We will explain the 4 points in below graph showing the statistics of your A/B testing.

  1. For this we use the Opt-in banner to identify results.
  2. This axis shows the conversions.
  3. This axis shows the following possible user interactions:

Do Not Track: Privacy settings in the browser overruled consent management on your website. The banner was not shown.
No choice: The banner was shown, but the user has not interacted with banner.
No warning: With GEO IP enabled, the banner will not be shown in not support regions. For example; if you target the USA & Canada and someone from Mexico enters your website. A “No Warning” is registered.
Functional, Statistics and Marketing are the registered consent categories.

In theory, one consent registration can cause 3 hits, one per each category.

4. Who is the winner?

In the example you will see the right column edges out the left column on every category. If optimising conversions is the goal. Right would be the banner. Maybe you know why by looking at the banners below!


Join 900.000 users and install The Privacy Suite for WordPress locally, automated or fully customized, and access our awesome support if you need any help!

Complianz has received its Google CMP Certification to conform to requirements for publishers using Google advertising products.