FAQ – About This Guide

How We Choose Agencies for Inclusion
How to Get Your Agency Included
How We Collected Information
Definitions of Terms Used in Agency Profiles

How We Choose Agencies for Inclusion

We focus on agencies that we know do a lot of A/B and/or multivariate testing for their clients, including agencies whose work we’ve profiled in our Case Studies and annual Awards. Any agency or consultancy with active clients for whom they conduct A/B and/or multivariate testing is welcomed.  See below to get your agency included (free.)

How to Get Your Agency Included

Please fill out this form if you’d like your agency to be included in this guide.

How We Collected Information

Information was collected by thorough analysis of each agency’s site, in addition to follow-up phone interviews with our contacts at the agencies when necessary.  Plus, we email every agency and consultancy a link to their profile so they can take a look and suggest updates or corrections.

Definitions of Terms Used in Agency Profiles

Types of Testing & Optimization Offered:

A/B/n Testing: (also known as A/B or split testing) The agency devises a strategy around testing different versions of a web page against each other at the same time to see which page gets more conversions. Many agencies will also set up and perform the test for you.

Multivariate Testing: The agency devises a strategy around testing different page elements (buttons, images, copy) against each other at the same time to see which combination of elements gets the highest conversion rate. Many agencies will also set up and perform the test for you.

Usability testing: Many agencies will conduct usability testing to help them devise strategies for actual A/B or multivariate tests for your site. Usability testing is an important form of qualitative testing to determine if and why typical visitors may have problems actually using your site.

Behavioral targeting: The agency devises a strategy around how you should optimize your site based on visitor behavior.

Conversion path optimization: This is when an agency devises a strategy on how to optimize your site’s conversion rate across several pages or a specific “path” such as getting visitors from a landing page to an actual purchase.

Conversion rate optimization: The science of testing changes on your page and site to improve your conversion rate. Many agencies will advise you based on their own proprietary methodology of how to improve conversion rates. They will develop and execute a tailored conversion rate optimization strategy for your site.

Email optimization: The agency devises and executes a strategy on how to improve open rates, clickthroughs, and conversions rates of your email campaigns.

Landing page optimization: A lot of agencies specialize in the optimization of PPC, online display ad, and email landing pages for your site. They often also offer Google AdWords optimization, and optimization of other search engine ad serving systems.

Mobile optimization: The agency takes any regular Web page and optimizes it for mobile users based on best practices in mobile web design. They may also devise and execute strategies for improving mobile Web page conversions through A/B and multivariate testing.

Online display ad optimization: The agency optimizes your online display ads through A/B and multivariate testing.

Segment optimization: The agency devises a strategy around how to optimize your site for specific segments such as people who’ve never purchased a product from you or filled our a lead gen form.

Video optimization: The agency optimizes your online videos through behavioral targeting and/or A/B or multivariate testing.

How Central is Testing & Optimization (CRO) to this Agency’s Services?

Sole focus: Testing and/or CRO is the agency’s main focus, meaning 100% of their business revolves around testing and/or CRO strategy for clients.

Significant part of business: The agency may offer one or two other services, but testing and/or CRO is its main offering.

Separate division of broader agency: These are medium to large agencies that have several divisions or departments. Testing and/or CRO fall under one of the divisions.

One of the services offered: Testing or CRO is just one of many services offered and may not be the most central service offered.

Testing & Analytics Tech this Agency Works with: A list of the testing and analytics tools the agency has experience working with. Many agencies are technology agnostic, meaning they can work with any testing tool that you currently use on your site.

Verticals/Industries Served: A list of the industries and verticals in which the agency has clients.

Vendors Click for info to add or upgrade your listing