Testing News Blog

July 2010

New A/B Test for Your Vote: Email Newsletter Subject Line – Single vs Multiple Topics Mentioned?

In this week’s test you get to vote on email newsletter subject lines. Both the subject lines were for the exact same email newsletter… but one resulted in 21% more opens and 45% more unique clicks than the other.  Click to see if you can guess which version won.

If you publish an email newsletter that contains multiple articles, or other content items, this test completely applies to you.  The whole single-topic vs multiple-topic newsletter subject line issue is one that I personally have wrestled with for years, so it makes me very happy to see another marketer’s test results.

Take a look at the test, vote for the one you think won, and then please do post a comment about your own experiences and insights into this one: http://whichtestwon.com/archives/4579

P.S. Thanks to the *boatload* of people who linked to us and helped get the word out about WhichTestWon.com this past week, including Oli Gardner, SEOmoz Blog, Linda Bustos, Get Elastic Ecommerce Blog, Melissa Cooper, USiT Blog, CopyClips Blog, Business Marketing and Marketing in Business Blog, Laura Mitchell, Susan Shaffer, Dave Fisher, Stacy Taylor, Nathan Potter, Nicole Skuba, Guillermo Pareja, Lynn Koves, Dianna Huff, Brenna Holmes, Carrie Hill, Blizzard Internet, Landing Page Tips, Marketing Filter, Paul Gailey, Christine Johnston, Adam Zais, Phelan Riessen, Grapevine Consulting, Rebekah E. Donaldson, Martine Hunter, B2B Launch Pad, Parallel Path, Naomi Niles, Geetanjali Dighe, userfirst, Escapia, VRMA, Joanna Pineda, Charlie Southwell, Malinea Conseil, Alain Guinot, Slow Food Kitchen, Gary Fenn, Carol Ford, Brian Cray, Benin Brown, Henrique Garcia, Luis Rocha, Iris Ferrera, Bill Sheridan, David Wells, David Travis, Alexis Brion, Ian R. Waugh, Philip Hodgson, UXBooth, Niels Koopmans, Mel Cassio, Cartucho, Arlene Hall, Cyndi Tetro, Clearwebstats.com, Brandon Hubbard, Will Scully-Power, Alastair Simpson, UXfeeds, Egbert Oostburg, PrairieWeb Internet, Greg Goodson, Martin Weinberg, and Mainsail Web Development!

Click here to comment

Category: B2B Marketing Tests, Email TestsTags: ,

Why Doesn’t a Handy Marketing Terms Dictionary Exist?

Every now and then — but more often than I’d like — I’ll talk to a marketer about a testing case study and find out for the past 5 minutes the A/B test we’ve been discussing is not an A/B test. It’s actually a before and after Web page analysis.

This brings me back to my MarketingSherpa days. I remember several instances like this. Once, I was interviewing a source about what I thought was a multi-channel marketing campaign only to find out the “channels” were actually audience segments.

This got me thinking… Why don’t marketers have some sort of master dictionary of marketing terms? (Sort of like the AP Style book for journalists.) That would make communicating so much easier because everyone would be on the same page. Of course, who would do this? I don’t know. And would there be some tug of war over the definitions? Most certainly.

It’s a confusing thing – marketing terms. Even in the testing industry, vendors have varying definitions on what they consider a conclusive result. Some say you must run a test for at least a week, others say you must run a test for at least two weeks. Here’s our definition of conclusive results.

We’ve even got our own version of a marketing term dictionary, but it’s only for testing related terms. Check out our WhichTestWon glossary here. And please let us know if we’ve forgotten any terms.

Also, there may be a marketing terms dictionary out there that I’m not aware of. If one exists, please let me know.

Click here to comment

Category: Testing Tools, Useful Testing AdviceTags: , ,

New A/B Test for Your Vote: Do Happy, Smiling People Photos Help Conversions?

I love this A/B test. I’ve always wondered if those happy, smiling people stock-photo images that designers like to put on landing pages really help conversions. Vote for which version you think won, and then see the real-life results here.

This was a PPC ad landing page test for an ecommerce site offering business cards. But I can think of *a lot* of other types of sites that could run the same test. Got insights, your own testing stories, or feedback about this one? Be sure to post a comment on the results page after you vote at: http://whichtestwon.com/archives/4520

P.S. Thanks to everyone who linked to us and helped get the word out about WhichTestWon this past week, especially ReveNews, Beth Kirsch, Candi Harrison, ion interactive, John Wall, Marketing Over Coffee blog, Trevor Young, PR Warrior Blog, Digital Solid Marketing Technology ROI blog, Email Marketing in India blog, optivo Email Marketing Blog, Susan Shaffer, Douglas Karr, Jen Horton, Landing Page Tips, Jose Uzcategui, Brenna Holmes, Jeff Doan, Thinkdesign, Tracy Terry, Lee Kellett, eROI, Greg Payette, D. Stuart White, Malinea Conseil, Justin Chick, Dan Ross, Kraig Guffey, Response Mine, Otimo LLC, Travers Tool, Ricky Juarez, Sarah DeAtley, D. James Bethesda, Mark Copeman, Tom Wentworth, Nathalie Ramonda, Allison Najman, Greg Ord, Jon Rognerud, Dan Larkin, Charles Pal, Randy Nargi, Domain7 Solutions, and Ryan Rotz.

Click here to comment

Category: eCommerce Tests, Landing Page Tests, Page Element Tests (Buttons, Images, Overlay, etc.)Tags: