The Offer Variants Tab within an Access Control Rule showing the example Multivariate Test setup.
The Results Tab within an Access Control Rule showing Multivariate Test results.
The Offer setup showing the example Multivariate Test setup.
How to set up Multivariate Testing
Introduction
Ever felt like you're playing darts in the dark when it comes to optimizing your BLOX Audience+ paywall offers? You're not alone. Introducing our latest game-changer:
✨ Multivariate Testing for BLOX Audience+ ✨ !
Multivariate Testing lets you test multiple variations of your BLOX Audience+ offers simultaneously. Think of it as having a bunch of different keys to unlock the same door, and you're trying to find the one that fits best. It's like having a secret formula for maximizing your revenue and engagement without all the guesswork.
With Multivariate Testing, you can make data-driven decisions that drive real results. You can experiment with different paywall offer groups to see which performs better, and the system will automatically choose the winner based on results
Maximizing the effectiveness of any audience platform relies on continual refinement and optimization. A/B or Multivariate Testing in BLOX Audience+ elevates the profitability of your subscription business by allowing you to fine-tuning paywall conversions.
In a nutshell, Multivariate Testing is your ticket to unlocking the full potential of your BLOX Audience+ strategy – smarter decisions, happier readers, and a healthier bottom line. Get ready for an exciting journey ahead!
Prerequisites
This feature is available exclusively to BLOX partners with Audience+ installed. Subscriptions Pro and BLOX Audience sites will need to upgrade to utilize this feature. For more information about BLOX Audience+, reach out to your sales rep or submit a support ticket.
How to
To setup a Multivariate Test, we’ll first want to identify test parameters, then we’ll create variate Offer Groups, and finally, we’ll setup the Multivariate Test. Once the test has started, you’ll be able to see the results to keep tabs on how you’re Multivariate Test is going.
Identify test parameters
Identify the audience you’d like to test with and jot down an objective and hypothesis for yourself.
Example Objective: Determine how different descriptions of a $2 offer affect conversion rates for Anonymous users.
Example Hypothesis: We expect that altering the way the offer is described on the paywall will influence Anonymous user conversions. This experiment aims to identify the most effective wording to enhance conversion outcomes.
Decide what elements you’d like to test. You can create variants of paywall headline, price/rate, how you describe the price (“$1 for a week for 1 year” or “$52 for a year”), call-to-action buttons, use of Featured, or even the presence of an image. Prioritize elements that are critical to achieving your objectives and have the potential to influence user behavior.
For the above example, you may experiment with the Rate field on 3 different offer groups: “$2 per month” vs. “$0.50 a week” vs. “50¢ a week.”
Create variant Offer Groups
Note, if the objective is testing different rates, make sure you create those first in Subscription.
The Offer setup showing the example Multivariate Test setup.
In BLOX Access Control, click the gear on the upper right to open Application Settings
Click Access Offer Groups
Identify the Offer group for the control of your test
Click Dupe to duplicate it
Double click to open the duplicated Offer Group
Edit the duplicated Offer Group settings for your test ⚠️ For optimal results, it's best to keep tests straightforward by making only one change per variant Offer Group. Introducing multiple changes per variant can complicate the process of pinpointing which change resonated most with your users. ⚠️
Repeat the above steps making additional copies the selected Offer Group for your test. Remember, you can run up to 3 variations against your control offer group.
Setup the Multivariate Test
The Offer Variants Tab within an Access Control Rule showing the example Multivariate Test setup.
In BLOX Access Control, identify the Rule you are going to test
Double click to open the Rule
Click on the ‘Offer Variants’ tab
Check the ‘Enable Multivariate’ option
Select the variant Offer Groups you created in the ‘Access offer group B’, ‘Access offer group C’, and Access offer group D’ fields
Enter the email address that you’d like to receive test results in the ‘Notification Email’ field
Select the ‘Start Test’ and ‘End Test’ dates for your Multivariate Test ⚠️ When selecting the dates, consider factors such as the size of the audience of the rule you’re testing. Running a Multivariate test on Anonymous will yield more results faster, since it is the largest group of users in the funnel. If you run a test on Former subscribers, the audience group is smaller to begin with, and may need a month or more to provide results of any significance. For best results, run tests for at least 2 weeks. ⚠️
Click Save
See the Results
The Results Tab within an Access Control Rule showing Multivariate Test results.
BLOX Audience+ automatically updates the data on the Results tab hourly. When you open the Results tab, you'll see a timestamp indicating how long ago it was updated. On larger sites with a high amount of traffic, the updates may take longer than a few hours.
At the conclusion of the test, the results will be emailed to the address you specified.
