Multivariate Website Testing Beneficial, but Adoption Remains Low, Says JupiterResearch
Thursday, 29 November 2007
JupiterResearch, a leading authority on the impact of the Internet and emerging consumer technologies on business, has found that despite compelling benefits resulting from multivariate testing, implementation remains low. Outlined in a new report published by JupiterResearch "Multivariate Testing Agenda: Overcoming Challenges and Building Strategies for Success," only 31 percent of website decision makers have deployed multivariate or A/B testing programs. Among this group, however, 79 percent have increased registrations per visit, 74 percent have improved customers' satisfaction, and 68 percent have increased conversion rates.
Although the majority of multivariate testing programs so far have been implemented by companies with annual revenues of less than $1 billion, larger companies are taking notice of testing benefits and will represent the fastest growing segment to adopt testing programs; some 53 percent of budget decision makers planning to deploy testing within the next 12 months come from companies with annual revenue of $1 billion or more.
"Multivariate website testing can be a complex and challenging endeavor, but sites can minimize the confusion by starting small and taking a tactical approach," said John Lovett, lead analyst on the report. "Testing can help illuminate issues, resolve disputes, and reveal amazing discoveries about your website visitors, enabling incremental site improvements to unfold dramatically."
As evidenced by the recent acquisitions of two prominent vendors in the marketplace, the testing and optimization market is experiencing major consolidation. As a result, JupiterResearch anticipates flexibility and integration will become essential differentiators among testing technology providers. Before a program is implemented by any company regardless of size, clearly defined goals and processes should be established to aid in gaining measurable results. Determining elements to test and areas in which to derive value from a testing strategy is critical.
"Automated site testing makes analytics actionable," said David Schatsky, President of JupiterResearch. "Any company concerned about maximizing the return on its online marketing and site operations spending should look at incorporating testing as standard operating procedure."