Comments on: Real Estate Lead Gen Box Test Results http://whichtestwon.com Fri, 03 Sep 2010 20:04:39 +0000 hourly 1 http://wordpress.org/?v=3.0.1 By: Natalie Myers http://whichtestwon.com/real-estate-lead-gen-box-test-results/comment-page-1#comment-419 Natalie Myers Tue, 08 Sep 2009 14:28:45 +0000 http://whichtestwon.com/?page_id=1686#comment-419 Hi Simon - great suggestion! To answer some of your questions: Yes, it was a truly random test. Equal traffic was sent to six versions of this lead gen box. I will have to check with my contact at Microsoft's Experimentation Platform to find out the exact sample size, confidence level, and margin of error, but I have already been assured that the sample size was large enough for statistical significance. Thanks, again, for your input! Natalie, Senior Reporter, WhichTestWon.com Hi Simon – great suggestion! To answer some of your questions: Yes, it was a truly random test. Equal traffic was sent to six versions of this lead gen box. I will have to check with my contact at Microsoft’s Experimentation Platform to find out the exact sample size, confidence level, and margin of error, but I have already been assured that the sample size was large enough for statistical significance. Thanks, again, for your input!
Natalie, Senior Reporter, WhichTestWon.com

]]> By: Simon Baier http://whichtestwon.com/real-estate-lead-gen-box-test-results/comment-page-1#comment-417 Simon Baier Mon, 07 Sep 2009 18:33:27 +0000 http://whichtestwon.com/?page_id=1686#comment-417 I didn't see any mention of testing procedure. Was it a truly random test? What was the sample size? Was it large enough for statistical significance? If so, what is the confidence level and the margin of error? A footnote with this info might be a good way to give the interpretation more credibility. I didn’t see any mention of testing procedure. Was it a truly random test? What was the sample size? Was it large enough for statistical significance? If so, what is the confidence level and the margin of error? A footnote with this info might be a good way to give the interpretation more credibility.

]]> By: Lars http://whichtestwon.com/real-estate-lead-gen-box-test-results/comment-page-1#comment-413 Lars Sun, 06 Sep 2009 20:15:35 +0000 http://whichtestwon.com/?page_id=1686#comment-413 I agree with Amy. That would be an interesting test to follow up with. I agree with Amy. That would be an interesting test to follow up with.

]]> By: Dan Poynor http://whichtestwon.com/real-estate-lead-gen-box-test-results/comment-page-1#comment-410 Dan Poynor Sun, 06 Sep 2009 17:14:31 +0000 http://whichtestwon.com/?page_id=1686#comment-410 The reversed out headline helps catch the eye in B I think. B also looks more like a simple search utility and less promotional. Version A would require 4 clicks to search foreclosures it looks like where B would require only 3, perhaps 1 less if the focus is on the form field when the page loads. The reversed out headline helps catch the eye in B I think. B also looks more like a simple search utility and less promotional. Version A would require 4 clicks to search foreclosures it looks like where B would require only 3, perhaps 1 less if the focus is on the form field when the page loads.

]]> By: Amy http://whichtestwon.com/real-estate-lead-gen-box-test-results/comment-page-1#comment-394 Amy Thu, 03 Sep 2009 03:13:45 +0000 http://whichtestwon.com/?page_id=1686#comment-394 Version A seemed like the winner to me (for the same reasons as Richard mentioned), but the single-line form in Version B seems a lot easier to use than the cityANDstateORzip form in A. I wonder how A's layout with B's form would perform. Version A seemed like the winner to me (for the same reasons as Richard mentioned), but the single-line form in Version B seems a lot easier to use than the cityANDstateORzip form in A. I wonder how A’s layout with B’s form would perform.

]]> By: Anne Holland http://whichtestwon.com/real-estate-lead-gen-box-test-results/comment-page-1#comment-392 Anne Holland Wed, 02 Sep 2009 20:31:57 +0000 http://whichtestwon.com/?page_id=1686#comment-392 Jason - definitely a good idea. I'll see if it can be added to our next site upgrade. Anne Jason – definitely a good idea. I’ll see if it can be added to our next site upgrade. Anne

]]> By: Richard http://whichtestwon.com/real-estate-lead-gen-box-test-results/comment-page-1#comment-389 Richard Wed, 02 Sep 2009 16:48:27 +0000 http://whichtestwon.com/?page_id=1686#comment-389 I'm wondering how many users were experienced internet users/real estate seekers as opposed to less experienced users? I liked Version B because it is much faster with no tabs to mess with, but I picked Version A for this test because it does a better job of "hand holding". I’m wondering how many users were experienced internet users/real estate seekers as opposed to less experienced users?

I liked Version B because it is much faster with no tabs to mess with, but I picked Version A for this test because it does a better job of “hand holding”.

]]> By: Jason http://whichtestwon.com/real-estate-lead-gen-box-test-results/comment-page-1#comment-387 Jason Wed, 02 Sep 2009 15:23:41 +0000 http://whichtestwon.com/?page_id=1686#comment-387 Also, could you guys leave a shot of the losing image in the follow-up article so we can further analyze it without leaving this page? Thanks. Also, could you guys leave a shot of the losing image in the follow-up article so we can further analyze it without leaving this page?
Thanks.

]]>