Give us Feedback
Compare MVT Tools

Here's what to do: Discover how multivariate testing can increase your profits...then compare software tools using the comparison chart below. Be warned, though: this chart doesn't tell the whole story. Find out the reality of what the software is like, by reading the descriptions and user reviews of it.

And, once you've used the software yourself, please come back to submit a review of it.

Get Smart Content read reviews stars initial set-up cost ongoing costs technology compatibility Hover over the text below to see whether the software will be technologically compatible with your website. a/b or mvt? In an A/B test, your visitor sees Version A of a page or Version B of it. (Note, a test with three page versions would be called an A/B/C test. “A/B/n” is often used as shorthand for a test that has n different page versions.) Multivariate (MVT) tests are simply ones in which you carry out A/B tests (or A/B/n ones) on several independent page elements simultaneously. type of mvt There are many different ways of carrying out multivariate (MVT) tests: You can show every single possible combination of page elements. This is called “full factorial”. Or you can show only a fraction of them. This is called “fractional factorial”. There are loads of types of fractional factorial test, and they all have complicated-sounding names. (Taguchi is one of them). You can also choose to display losing combinations less frequently. The data can be analyzed by the software in different ways too. can it be self hosted You may be happy for the software vendor to host the software themselves, or you may have reasons why you’d prefer to host it yourself—perhaps for privacy reasons or technological reasons. can multiple goals be set ? Sometimes you may want to track more than one goal. For example… (i) You may want to know the effect that your experiment has not only on orders, but also on leads submitted. (ii) You may be concerned that you’re increasing the sale of one product at the expense of the sales of others. In this case, you’d want to track the effect that the experiment has on the sales of each product. (iii) You may wish to count conversions at several stages down the conversion funnel. That way, if you’re aiming to increase, say, the number of orders, but your test doesn’t reach statistical significance, you may instead choose to consider an intermediate goal such as click-throughs (such as add-to-cart actions), and make the assumption that the number of orders would be proportional to the number of click-throughs. can traffic be segmented ? You may discover that different types of traffic prefer different versions of your page. For example, new prospects and existing customers may prefer different versions of a webpage. Some software vendors recommend that their software can act as a “traffic cop”, forever directing different types of visitor to different optimal versions of the webpage long after the test has concluded. Though this feature may have great benefits for you, be aware that a vendor benefits greatly from being able to “lock you in” in this manner, so they may be tempted to over-enthusiastically sell the benefits of this feature. used on email campaignsHTML emails can be tested in the same way as webpages. Because an email campaign happens within a short space of time, you probably want the software to automatically promote the winner as soon as enough data has been collected. has a platform for creating webpages Some of the software tools have in-built platforms for creating and editing webpages — a bit like having their own WordPress interface. They can be useful if the thought of involving your company’s web development team gives you the shudders. customer support by phone self service or full service “Self service” means you just get the software (and maybe some support). “Full service” usually involves * technical support * assistance in deciding “what to test” * designing the experimental plans * interpreting the data
Accenture Digital Optimization See details and customer reviews ~$33,000 $160,000-$320,000 Client-side Both Several
(see details)		 tick tick tick tick
(see details)		 cross tick
(see details)		 Both
Adobe Test&Target See details and customer reviews Contact Adobe Usually a four-figure monthly fee Client-side Both Taguchi tick
(see details)		 tick tick tick cross tick Both
Amadesa See details and customer reviews None Depends on monthly page views Client-side Both Full factorial tick tick tick tick cross tick Both
(see details)
Optimost See details and customer reviews Contact Optimost Usually a four-figure monthly fee Client-side Both Optimal design cross tick tick tick cross tick Both
avenseo See details and customer reviews Free trial From €300 Client-side Both Full factorial tick tick tick tick cross tick Both
Conversion Multiplier See details and customer reviews None $2,500-$7,500 /month Client-side Both Modified Taguchi
(see details)		 cross tick tick
(see details)		 tick cross tick Self service
(see details)
Divolution See details and customer reviews None Usually a four-figure monthly fee Client and Server-side Both Full factorial
(see details)		 tick
(see details)		 tick (unlimited) tick tick cross tick Both
Get Smart Content See details and customer reviews None From $500 per month Client-side A/B N/A cross tick tick cross cross tick Both
GlobalMaxer See details and customer reviews From £2,000 Usually a four-figure monthly fee Client-side Both Proprietary adaptive full factorial tick tick tick cross tick tick Both
Google Website Optimiser See details and customer reviews None None Client-side Both Full factorial cross tick
(see details)		 tick
(see details)		 cross cross ?
(see details)		 Both
(see details)
HiConversion See details and customer reviews None From $99 per month Client-side Both Proprietary adaptive fractional factorial cross tick cross cross cross tick Both
Ion Interactive's Liveball See details and customer reviews None From $1295 per month Client-side Both Full factorial cross tick (unlimited) tick tick tick tick Both
Maxymiser See details and customer reviews None Usually a four-figure monthly fee Client-side Both Several
(see details)		 tick tick tick tick cross tick Both
Monetate See details and customer reviews Contact Monetate Flat monthly fee based on previous 12 months’ traffic Client-side Both Several
(see details)		 cross tick tick tick cross tick Both
mPath See details and customer reviews Contact mPath for details. Monthly fee
(Contact mPath for details.)		 Client and Server-side Both Full factorial
(see details)		 Contact mPath for details. tick
(see details)		 tick tick cross tick Self service
OnDialog See details and customer reviews None $7.5k+/year Server-side Both Non-parametric MVT
(see details)		 cross cross tick
(see details)		 cross tick tick Both
Optimizely See details and customer reviews Free trial $19-$399 /month Client-side Both Full factorial cross tick tick cross cross tick Self service
ReEdge See details and customer reviews None $29 per month Client-side Both Full factorial cross tick tick tick cross tick Self service
SiteSpect See details and customer reviews See details See details Proxy server method Both Full and fractional factorial. tick tick tick tick cross tick Both
SiteTuners See details and customer reviews None $1k-$2.5k per test Client-side Both Proprietary non-parametric technology cross tick
(see details)		 tick ? cross tick Both
Split Test Accelerator See details and customer reviews $297 Two additional payments of $297 Server-side PHP and MySQL Both Taguchi tick tick cross
(see details)		 cross cross cross Self service
Unbounce See details and customer reviews Free Free or $29-$999/month, depending on traffic Server-side A/B N/A cross tick cross tick tick tick Self service
Vertster See details and customer reviews Contact Vertster Monthly fee Client-side Both Full factorial, Taguchi and Treadmill MVT cross tick tick cross cross tick Both
Visual Website Optimizer See details and customer reviews None $49-$729/month Client-side Both Full factorial tick tick tick tick tick tick Self service
Webtrends See details and customer reviews Contact Webtrends Usually a four-figure monthly fee Client-side Both
(see details)		 Several cross tick tick tick cross tick Both

What next? If you still don't know how multivariate testing can increase your profits, click here.

Full disclosure: we are authorized consultants for Google Website Optimizer, though we don't receive any remuneration for recommending it. In fact, we don't receive payment for recommending any software. We're a consultancy, and we make our money from showing companies how to maximize their profits using split testing and multivariate testing software.

Give us your feedback

Get your free profit-exploding Super Converters newsletter!

Close