Your Testing Program: Smart Ways to Get Your Team On Board


On the face of it, the idea of a rigorously testing and optimizing your ecommerce web site seems like a no-brainer.

After all, who would object to gathering hard data on exactly how customers move through your site, what happens on specific visits, and what unseen speed bumps and sticking points are hurting sales? Who wouldn’t want definitive answers to such questions?

Fact is, though, in many online marketing organizations, there is often surprisingly sharp resistance to technologies such as multivariate testing.

Sometimes, it’s simply because there’s some confusion about how multivariate testing actually works and what the benefits are. (“You’re going through all this to test the color of the ‘Buy Now” button? Really?”)

But the real problem usually is buried a little deeper. With hard testing comes the threat of upsetting or overturning some cherished beliefs, or disproving what people ‘know’ to be true. Marketing and creative teams have traditionally crafted websites around ‘established principles’ and ‘gut feel’ for what works. (What if that isn’t so? What if we’ve been dead wrong all this time?)

The IT people build the site a certain way because it’s simple and robust makes perfect sense in terms of data flow. (But what if that actually turns customers off? What if that makes shoppers bail out before buying?)  The notion of actually testing ingrained practices is a bit scary.  Who wants to have their worldview changed?

In other cases, there’s some reluctance to admitting there’s even a problem.  “We’re getting X% conversions. That’s the industry norm.  Nobody is complaining. Why bother?”

The best approach to getting buy-in for a testing strategy is to position it as less of a of a threat, and more of a way to ‘refine’ and direct the efforts of your creative, marketing and IT teams.  It’s a way to out-smart, out-maneuver, out-think your competitors; it’s not a way to beat up on what we’ve been doing.

Detail the pain, document the bad

First step:  point out the pain points on your site. Are visitors fleeing as soon as they arrive? Are they actually buying or just poking around?  Do they buy once, and disappear forever?

To make your case, use strong graphics, charts, video clips, whatever it takes. But make sure the visuals are backed up by solid data that will speak to your audience: You bounce rate, cart abandonment rate, search engagement and average order value. Make the pain and problems clear, and the idea of a testing program will be much easier to sell.

Add up the losses

Find a way to dramatize and quantify how much money you’re losing in the current situation.  Then show how much more money the company could be making if you could get hard data on exactly what’s working and what’s not working.

Bring up smart competitors, industry darlings

Peer pressure is another go-to tactic for getting reluctant executives to embrace change. Explain how other respected, successful organizations are leaping ahead by definitively testing what they’re doing. For examples, check business publications, LinkedIn, public case studies, blogs and so forth.

Nobody likes to be left behind — if stakeholders see other businesses are implementing test programs to their benefit, it’s more likely they’ll want to do the same. And if competition’s already ahead of the game, even better for you. (Although the alternative is that they’re not and you can beat them to the chase.)

Speak to IT on their terms

Your development teams may feel that site testing is unnecessary, especially if they’ve already evaluated usability and other qualitative factors. They may consider testing their domain, and not appreciate any input from the marketing department.

Address these concerns by speaking their language and giving them concrete information they can actually use in making development decisions. Don’t just have a verbal discussion — provide all those statistical facts in writing, in terminology they know and use. Point out that shifting the responsibility of site testing to marketing frees up IT time and manpower to work on other projects.

Relate it all to the brand

In a critical way, the e-commerce site is the final touch point, the ultimate ‘proof’ of the brand concept. Does the experience on the website match the brand promise? Does it reinforce and capitalize on all the branding efforts so far?  Is there something we can do better? Something in our web experience that is somehow compromising our brand?  Multivariate testing can quantify this very accurately.

“Just try it”

Finally, propose a trial run — a limited test, shown to a small percentage of page traffic. Be sure to track key data points like visitor stats, cost per conversion, and abandonment rates. Once the results are gathered, share them with various departments throughout the company. As more co-workers find out what’s going on, your potential support base will become even larger.

Written by Paul Dunay
Paul Dunay is an award-winning B2B marketing expert with more than 20 years’ success in generating demand and creating awareness for leading technology, consumer products, financial services and professional services organizations. Paul is the global vice president of marketing for Maxymiser a leading web optimization firm, and author of four “Dummies” books: Facebook Marketing for Dummies (Wiley 2009), Social Media and the Contact Center for Dummies (Wiley Custom Publishing 2010), Facebook Advertising for Dummies (Wiley 2010) and Facebook Marketing for Dummies 2nd Edition (Wiley 2011). His unique approach to marketing has led to recognition of Paul as a BtoB Magazine Top 25 B2B Marketer of the Year for 2010 and 2009 and winner of the DemandGen Award for Utilizing Marketing Automation to Fuel Corporate Growth in 2008. He is also a finalist for the last six years in a row in the Marketing Excellence Awards competition of the Information Technology Services Marketing Association (ITSMA), and is a 2010 and 2005 gold award winner in Driving Demand. Buzz Marketing for Technology, Paul’s blog, has been recognized as a Top 20 Marketing Blog for 2009 and 2008, a Top Blog to Watch for 2009 and 2008, and an Advertising Age Power 150 blog in the “Daily Ranking of Marketing Blogs.” Paul has shared his marketing thought leadership as a featured speaker for the American Marketing Association, BtoB Magazine, CMO Club, MarketingProfs, Marketing Sherpa, Marketing Executives Networking Group (MENG), and ITSMA. He has appeared on Fox News, and his articles have been featured in BusinessWeek, The New York Times, BtoB Magazine, MarketingProfs and MarketingSherpa. Paul holds an Executive Certificate in Strategy and Innovation from MIT’s Sloan School of Management and a bachelor’s degree in Marketing and Computer Science from Ithaca College.