How to Setup a GWO MVT Test and A/B Test on the Same Page

The Problem

I was recently asked if it was technically possible to setup a A/B Test and Multivariate Test on the same page with Google Website Optimizer. I had to think about it for a moment, I knew that one could run multiple tests on the same site with GWO already, so I knew the utmx cookie must be able to remember multiple tests. So I thought it must work as long as one is careful about the way that he applies the code to the page, so I let the person know I was pretty sure it would work. Soon after I had whipped up a sample to give it a whirl and it worked perfectly, so I had my proof.

The Solution

I am going to describe how to setup a A/B test and MVT test on the same page at the same time, but they don't have to be implemented at the same time, and the steps really aren't much different.

  1. Setup your A/B test normally. So now you will have a Page A and and Page B.
  2. Create your MVT test.
    1. Use the Page A url for the test as you normally would.
    2. Put the control script for the MVT test under the control script for the A/B test, and tag the rest of the Page A normally. Then put the code in the corresponding places on Page B.
    3. Create a dummy/copy page of Page A without the A/B test markup (it should now only have the MVT test markup on it).
    4. Hit the validate button in the image below, it will fail, the warning messages don't matter.
      Screen shot of Google Website Optimizer's MVT validation step
      There should be a link beside the validate button now named "Test page not accessible? Try offline validation >>", press it and upload a copy of the conversion page and your dummy page of Page A. This will pass validation if you did it right.
    5. Create your variations for the MVT normally. Save and continue when your done.
    6. Preview if you would like, then launch and your done!

The Example

I have setup some sample pages if you would like to review my code. This is my Page A, this is my Page B, this is my Converison Page, and this was my Dummy Page A. I will be leaving the tests running for the time being, so for a short time you may want to disable javascript in order to view the source code.

The Conclusion

So to conclude it seems that it is possible to have multiple tests on the same page, but it takes some careful thought. Although this example of a MVT test running on a A/B test is relatively simple to setup, I hope this post helps you if you ever want to give multiple tests on the same page a try.

Some of you may be thinking at this point "I knew that I could run multiple tests on the same site, but I thought I read/heard some place or other that you could not run two tests on the same page.." and I understand that What scarce little I have been able to find on the subject seems to be far less specific about the limitations on running multiple tests on the same page then I would like to see.

For instance the first example I found was the book "Always Be Testing the Complete Guide to Google Website Optimizer", which says on page 294: "Is it possible to have more than one test going on a given test page? No, that's not something Website Optimizer currently allows, at least not without some major hacking.". Now would you call the above solution major hacking? I wouldn't.

Another example is in the GWO Help Forum, someone asked the question "Is there a way to run multiple optimizer tests on a single page?" and Trevor Claiborne responded with this interesting contradiction "You cannot have two experiments running on the same page at the same time. Your site using a tabbed interface may allow for you to pull this off however.".

I suspect the reasoning behind these people saying that multiple tests on the same page is not possible, is that some situations are not possible without some real code hacking, but it is possible, I have just proved that, and like I will show below so has Eric Vasilik long before me.

The Bonus (Multiple Conversions)

Eric Vasilik has written a post at gwotricks.com on how to track multiple goals for a single test which is using the fact that multiple tests can be run on the same site or page to create a shadow test which achieves the goal of having multiple conversions. I read this before I was asked the A/B+MVT question by the client I mentioned and it gave me the insight I needed I feel to try this out, because it is basically the same idea, running two tests on the same page. In Eric's multiple goal solution though, he wrote custom code to modify the utmx cookie which is what allows one test to shadow another.

© Erik Vold 2007-2012. Contact Erik Vold. Top ^