Using an A/B testing tool like Visual Website Optimizer is one of the easiest ways to discover which variations of your website increase your website sales and leads the most.
To help you understand the different tool options available to you, I have created a guide that compares the three leading tool choices: Visual Website Optimizer, Optimizely, and the newly launched Google Optimize.
All of them have their advantages and disadvantages, so I have created a grid comparing Visual Website Optimizer (VWO) with its major rivals, including pricing and functionality. I’ve included some ratings for each feature, and a total score too.
Let’s get started with the ratings (which I officially updated February 14th 2018):
||10/10 Free (with premium 360 version also available).||9/10 Plans start at $49 per month for ‘startup’ level (10,000 visitors).||5/10 Costly custom pricing plans, aimed at the enterprise market.|
|Test creation options and ease of use
||8/10 Good visual editing options but only using Chrome browser plugin.||9/10 Great easy to use visual editing options, plus CSS and code editing options.||9/10 The best visual editing options, plus CSS and code editing options.|
|Ease to add test code||9/10 Very easy. Just one extra line of Google Analytics code needed.||9/10 Very simple – only one tag needed.||9/10 Very simple – only one tag needed.|
|Testing types available
||8/10 A/B tests, MVT and redirect tests included. Multi-page and mobile tests only in premium version.||8/10 A/B tests, MVT and redirect tests included. Multi-page and mobile tests only in premium version.||9/10 A/B tests, MVT redirect, multi-page and mobile tests included in all plans.|
|Targeting ability for tests (new visitors etc)
||8/10 Google Analytics segments used for targeting, and very simple to use.||8/10 Good targeting behavioral options for all levels, with basic ability to build custom target segments.||9/10 Great targeting options in the standard level, with advanced targeting at higher account levels.|
|Conversion goals & success metrics||7/10 Google Analytics goals are used only, no customized goals.||9/10 Great – good selection of goals and metrics, including revenue.||9/10 Great – good selection of goals and metrics, including revenue.|
||6/10 Fairly good reporting but no dashboard overview.||8/10 Great reporting options with a useful dashboard overview.||9/10 Excellent results reporting and dashboard overview.|
|Overall comments||Great for free, and ideal for beginners or those with limited budget.||A very good tool for intermediate users, with great other tools included like heatmaps.||Definitely more of the ‘expert’ tool, but costs considerably more.|
|Overall rating||7/10 Good for beginners but lacks advanced features and support options.||9/10 Highly recommended for all types of users, with reasonable costs.||8/10 Better features for testing pros – although much more expensive.|
|Free trial?||Try Google Optimize – free||Get a 30-day free trial of VWO||Get a 30-day free trial of Optimizely|
Now let’s get more detailed, with an overview of each of these tools, including their pros and cons.
Google Optimize Overview
Google Optimize was only just launched in 2017 and is a major improvement over their previous A/B testing tool which was built into Google Analytics (called Google Content Experiments). It has limitations but is improving. Here are the notable pros and cons of the tool:
- Very good tool for free, much better than Google Content Experiments.
- Excellent integration with Google Analytics makes A/B testing very easy.
- Easy to analyze reports in greater depth using Google Analytics.
- Can be upgraded to their premium 360 version to unlock more features.
- Only 3 tests can be run at the same time (unlimited when upgrading to 360 version).
- Multi-page and mobile testing not included (only in 360 version).
- No support included, only through forums or paid 3rd party consultants or agencies.
Try it for yourself: Sign up to Google Optimize for free
Visual Website Optimizer Overview
There are now two versions of VWO. One is their classic A/B testing tool, and the other is their new premium CRO tool which offers A/B testing plus other essential tools like visitor recordings, survey tools and form analysis. Here are the pros and cons of the classic A/B testing version:
- Includes other A/B testing related tools like visitor click heat maps.
- Intuitive new user interface with great A/B test design wizard to help you.
- Excellent ‘idea factory’ helps you create better test ideas (by type/element etc).
- Can be upgraded to an excellent set of CRO tools like visitor recordings and surveys.
- No built-in multi-page testing functionality (across navigation/check-out etc).
- Sometimes it’s hard to create tests across pages with complicated URLs.
- Offer fewer real-time support options in comparison to Optimizely.
Try the tool for yourself: Get a free 30 day trial of Visual Website Optimizer
Optimizely has also grown leaps and bounds recently as an outstanding A/B testing tool. Here are the notable pros and cons of the tool:
- Has the best A/B testing options for experts.
- Competes well with Adobe Target and other enterprise level testing tools.
- New Optimizely X features ability to optimize mobile apps and other platforms.
- Offers extensive community and academy for getting the most from the tool.
- Very expensive, which limits this to mainly companies with big budgets.
- Sometimes it is difficult to preview A/B test variations easily and quickly.
Try it for yourself: Get a free 30 day trial of Optimizely
Which is better? VWO, Google Optimize, or Optimizely?
To help you make up your mind, here are my expert two-cents about these tools:
- Google Optimize is the best choice for beginners or those with no budget for A/B testing yet, but has limitations.
- VWO is a great tool for those looking for more A/B testing features, with affordable plans to suit different budgets.
- Optimizely is best for advanced users with excellent features, but high costs limit this to companies with very big budgets.
Ultimately I suggest you sign up for Google Optimize to see if that meets your needs, and also try a free trial of VWO to see the benefits of their more advanced A/B testing features. If your company can afford Optimizely and you want expert features, then use that tool instead.
Extra reading: If you want to get much better results from using these A/B testing tools, then don’t forget to read my essential user guide for A/B testing tool success!
That’s my expert two cents. Now over to you the readers – what is your favorite A/B testing tool, and why? Please comment below!