A/B Testing

General testing
General A/B testing is in BETA. Contact us for personal guidance and setup.
Engage provides the means of tracking any variation to a page or store and present key metrics and statistical analysis of the variations to these metrics in a conducted test. In general, the user is required to setup their split test by controlling when to show the various variations of the content being tested. To track the variations in Engage, we require the following code snippet to be added to each variation, with a unique variant id. 
<body>
...
zlt.track('Variant', {"id":"variant-id", "test_id":"ab test name"})
...
</body>
That's it! adding this snippet allow us to track the variant being displayed and you can use the variants as dimensions in reporting. We are adding more functionality to reporting and aim to cover variants in all relevant reports.
​
A/B testing with Google Analytics
Engage can set a 1stparty1^{st} party1stparty
 variant cookie that can be picked up by Google Analytics to analyse the test outcome further. Note that this cookie cannot be made sticky when Engage isn't determining which content to display. Hence, it is recommended to split traffic on browsing session when using Engage and Google Analytics this way to ensure valid test results.
Step 1: Adding the cookie
Add the following code snippet to activate the cookies. 
<body>
...
zlt.track('Variant', {
    "test_id":"ab test name",
    "id":"variant-id",
    "set_cookie":true
})
...
</body>
Step 2: Setup GTM
In GTM, create a 1stparty1^{st} party1stparty
cookie User-Defined Variable that reads the value from zlt_variant_testing. 
1.In the GTM Workspace, click on Variables, then new in the User-Defined Variable section
2.Then select 1stparty1^{st} party1stparty
cookie and set cookie name to  zlt_variant_testing 
3.Save as zlt variant (you may set any name, but remember it for the next step)
Step 3
Head over to Tags to assign it to the Google Analytics page view tag. Create a new, or edit an existing tag according to below. Define your Google Analytics settings and your tracking ID. Then add zlt variant as a custom dimension.
All set! Now you can measure the result from your A/B test in Google Analytics 
Testing product recommendations
A/B testing of product recommendations is crucial to determine the best performing model. Engage provides A/B testing out-of-the-box and it is very easy to setup. 
<div class="zlt" data-id="clustered-similarity,similarity" data-key="[KEY]"></div>	
Constraints
Due to the nature of A/B testing it is not possible to run more than one test simultaneously
A/B test of product recommendations split visitors in 50/50 by default

Features - Previous

Identities

Next - Features

Actions

Last modified 3mo ago

Export as PDF

Copy link

Outline

General testing

A/B testing with Google Analytics

Testing product recommendations

Constraints