- Nicole Freeman
- On March 24, 2016
A/B Testing (available on all Feedback Genius paid plans) refers to what is called “split testing,” and it is a feature within Feedback Genius that allows you to compare and analyze your message’s conversion rates by creating two comparison messages. A/B Testing works alongside the Message Analytics to help you determine which message configuration works best for your given message goal.
This is a great feature if you have been using Feedback Genius for a while, but want to further optimize your account. With A/B testing you can improve both your messages and your business by using data to determine what message configuration is yielding better conversion rates.
Why would I use this feature?
A/B Testing helps you determine how well your messages are doing and is a great way to run a performance check. Say you haven’t been getting great seller feedback conversions lately and you have a message sequence that requests seller feedback from your customers. You could change the subject line or edit the message directly and change how you request for feedback, or you could create a counterpart message using A/B Testing so that you can “test” which message yields the highest conversion rate. This is an easy way to use your message analytics to determine which feedback request receives more open rates and click-thru rates by targeting certain orders with each message.
How do I access and use it?
Before setting up A/B Testing, you will want to create an “A” Message and a “B” message. Essentially two counterpart messages that you want to compare. These messages can have different message content, different subject lines, and even be sent at different times. You could create two copies of a message and simply change one thing between the two messages. However you decide to test your messages, be sure that you have two created for later comparison.
After creating your two counterpart messages, you can set up A/B Testing from the Filters section within your message. You can find A/B Testing under “Show Advanced Filters.” From here, you will work in the section titled “Only Include Orders Ending in These Digits” field. This is where you will set up your A/B Test.
What you will do next is divide up your orders based off the numbers contained in your customer’s Order IDs. For example, in Message A you would enter in 12345 and that message would only be sent to orders ending those digits. Conversely, in Message B you would enter in the remaining numbers which would be would be orders ending in 67890. You can also divide up your orders by even or odd numbers. For example, Message A would be sent to orders ending in even numbers 24680 and Message B would be sent to orders ending in 13579.
After dividing up your messages and orders, you can check on your Message Analytics for both messages to see which message yielded high conversion rates. You can check as frequently as every week, or allow the A/B to continue for at least a month to get a clearer idea of your message’s performance.
A/B Testing is a powerful tool that can help you optimize your Feedback Genius account to yield higher conversion rates for product reviews, seller feedback, or even just to know that your messages are getting noticed by your customers.