Email marketing metrics 101: Conversion rate

During one of our recent webinars, more than a few people expressed surprise about how email marketing metrics are calculated, so it’s a good time to step back and review. Today we’re looking at email conversion rate.

Email conversion rate is probably both the most valuable and difficult metric to even get a hold of, much less be able to manage well. The primary reason that it’s so hard to get a hold of is that many email service providers don’t offer tracking capability for conversion or have any way to capture email’s impact on conversion.

There’s a valid reason for this: most email conversion tracking done today is last-touch attribution only, which paints a woefully incomplete picture of email marketing’s total impact on your digital marketing efforts. Email marketing can do far more than just sell things to people in unfocused blasts. As a marketing tool, it can drive and focus attention to activities which lead to conversion two, three, or more steps downstream from the actual email.

Luckily, regardless of which email service provider you use, you have access to a powerful, more inclusive conversion tracking tool: Google Analytics.

First, you’ll need to establish what a conversion is. What action or actions on your site generate value, and what is that value worth? For example, if you’re building your list, what is the value of an email subscriber to you? If you’re selling stuff, what’s the median* value of a shopping cart? Once you know what activity on your website generates value, you can assign that as a goal with a goal value in Google Analytics. More details on how to set that up are located here.

Second, you’ll want to make sure that your email service provider supports Google Analytics. If they don’t, you will have to manually tag all of the links in your email using the Google Analytics URL builder. WhatCounts customers should contact their account managers to have it enabled in their respective platforms. (both Publicaster and Professional editions have GA support built in)

Third, fire up Google Analytics after a send and scroll down to the Conversions section:

Visitors Overview - Google Analytics

You’ll find your way to the Assisted Conversions section. From here, click on the Other menu and create a new channel grouping:

Assisted Conversions - Google Analytics

Inside the setup screen that follows, create a filter for Source with a RegExp that matches the following text: Publicaster|WhatCountsEmail (obviously, if you’re not a WhatCounts customer, you’ll have to substitute your own email service provider’s tracking codes in this box instead)

Assisted Conversions - Google Analytics

You’ve now got a custom grouping that shows you the total conversion impact of your email marketing:

Assisted Conversions - Google Analytics

Here we can see our email marketing program’s effects on all of our digital marketing efforts. Our email marketing closed 186 conversions in its last interaction, meaning someone went straight from the email to the activity of value. We also see that email added an additional 112 conversions where the subscriber did not immediately convert but did eventually, for an extra 40% impact on our business. Ask yourself this: if you’re doing last-touch only conversion tracking, how much more impact is your email marketing program having that you’re not aware of?

There’s one more area of conversion tracking that we need to address. To interpret total conversion tracking properly, you need to add together the last touch and assisted conversions together and track them over time. One important calculation to make is the ratio of assisted to last touch conversions, as shown here over the last 8 issues of our newsletter:

Untitled spreadsheet

Tracking this ratio will let you know if your content is more action-focused (more last touch than assist) or more value-focused (more assist than last touch). Neither is better than the other as long as total conversions continues to increase. In the example above, there’s an interesting inverse relationship between last touch conversions and total conversions – the more action-focused the newsletter is, the better it converts overall. Thus, we can use this insight to alter the content of the newsletter to offer more action opportunities (while still providing value), but if we lean too much in value-focused content’s direction without providing as much action-focused content, our overall email marketing program’s performance suffers.

If you’d like help setting this sort of detailed analysis up, please feel free to contact our Strategic Service department.

Conversion tracking might seem to be the last word in email marketing metrics, but it’s not. Tomorrow, to conclude this series, we’ll look at the variety of deliverability metrics and what they mean.

Christopher S. Penn
Director of Inbound Marketing, WhatCounts

*Technical side note: for any set of statistics where you have an asymmetrical distribution, use median values rather than average values. It gives you a better picture of where the middle actually is.


18 Ways book cover
Audience to Evangelist
Learn 18 different ways to find and grow your email marketing and social media ROI! Promote email with social, social with email, learn how to set up a Facebook Page for email subscriptions, and much more. Download the free eBook now.
Lifecycle email marketing is one of the hottest buzzwords in digital marketing, but how can you make it work for you? Download our free eBook and learn 5 lifecycle frameworks plus practical applications to your email marketing program.

Share this page:


Email marketing metrics 101: Clickthrough rate

During one of our recent webinars, more than a few people expressed surprise about how email marketing metrics are calculated, so it’s a good time to step back and review. Today, we’re looking at clickthrough rate (CTR).

Mouse

Clickthrough rate would, on the surface, be the simplest of metrics to understand – how many people clicked on something in your email message? There are a few subtleties to it that are worth discussing, including two distinct versions of clickthrough rate, TCTR and UCTR.

TCTR is total clickthrough rate, or the total number of clicks that an email message’s links received as a percentage of subscribers. This tells you how popular the content in your email message is. TCTR is subject to a certain amount of noise, however. Things that can influence TCTR include:

  • People opening the email and clicking through on more than one device.
  • People sharing a link socially from your email
  • Search engines indexing the view-in-browser version of your email and auto-clicking through all the links
  • Firewalls (especially for B2B subscribers) that automatically follow each link to verify that the email contains no spyware or malware
  • People clicking on lots of links in your message repeatedly

UCTR is unique clickthrough rate, or the number of unique clicks an email message’s links as a percentage of subscribers. If you opened an email on your phone, clicked a link, then opened it later on your desktop and clicked the same link, your contribution to the TCTR would be 2 but to the UCTR would be 1 because you’re one unique individual. If you opened the email later and clicked on the same link 3 more times, your contribution to the TCTR would be 5 but to the UCTR would still be 1.

WhatCounts, Inc.: Campaign Details

Which one is most important? Neither. They both have their uses. TCTR can give you a sense of how popular the links are in your content – if TCTR matches UCTR 1:1 it can sometimes mean that no one is coming back to your newsletter later to re-click on things or sharing your content links with others. UCTR gives you a clean number of how many unique clicks were attained without all the noise and confusion of TCTR, which is why many ESPs including WhatCounts use UCTR to calculate click to open rates.

The final computation that matters when it comes to clickthrough rates is CTOR – Click to Open Rate. When we talk about clickthrough rates, we’re generally speaking about clicks as a percentage of all subscribers. This can be misleading, especially if there have been significant changes in the list’s composition since previous sends. CTOR gives us a rate of how many clicks there were as a percentage of opens. Let’s see how this helps us understand our content’s actionable items better.

Let’s say you have a list of 100,000 subscribers. You send them a message, and 10,000 subscribers open the message. Of that, 1,000 of the openers click on something. Your open rate is 10%. For simplicity’s sake, we’ll use UCTR for the clickthrough rate, which means that you have a UCTR of 1% (10% of 10%). Your CTOR is 10%. So far, so good.

Now let’s say you blow up your list. You run a massive Google Adwords campaign and attract 50,000 people to your list in a month, but they’re all barely-interested subscribers who were just subscribing for a coupon or a special offer or something. You send to your list and none of the new people bother opening your message, but your core of 10,000 from your original list keeps on opening. Your open rate now drops to 6.67%. Of those, the same 1,000 click on stuff in your message. Your UCTR is now an appallingly bad .667%. However, your CTOR remains the same – 10%.

If you just relied on open rate and UCTR, you might think your email marketing program is suddenly failing, losing 33% of its performance from one send to the next, when the reality is that the core of your list, your fans, are still behaving the same. Instead, you now know that your Adwords campaign was a colossal waste of money because those subscribers aren’t doing anything, but the heart and soul of your email marketing is still strong. That’s why it’s important to examine all of your clickthrough rate metrics in context, as part of the bigger picture of your email marketing program.

The final piece of advice I’ll leave you with is from our industry averages blog post: ignore industry averages. They’re worthless. Instead, focus on improving your clickthrough rates and click to open rates in very email you send, so that your email marketing program is constantly improving. That’s the only set of measurements that truly matter.

Tomorrow, we’ll tackle the tricky subject of email conversion rates.

Christopher S. Penn
Director of Inbound Marketing, WhatCounts


18 Ways book cover
Audience to Evangelist
Learn 18 different ways to find and grow your email marketing and social media ROI! Promote email with social, social with email, learn how to set up a Facebook Page for email subscriptions, and much more. Download the free eBook now.
Lifecycle email marketing is one of the hottest buzzwords in digital marketing, but how can you make it work for you? Download our free eBook and learn 5 lifecycle frameworks plus practical applications to your email marketing program.

Share this page:


Email marketing metrics 101: Open rate

During one of our recent webinars, more than a few people expressed surprise about how open rates are calculated, so it’s a good time to walk through the discussion of how email marketing metrics work. Today, we’re going to start with the open rate.

When an email is sent to a subscriber, it typically includes a 1×1 pixel image (usually white or clear) that is tracked by your email service provider. When images load in the email on the subscriber’s computer or device, it’s considered an opened email. This, for example, is opened:

GameChanger: Email Marketing News from @WhatCounts for 4/19/12 - cspenn@gmail.com - Gmail

This is considered not opened:

GameChanger: Email Marketing News from @WhatCounts for 4/19/12 - cspenn@gmail.com - Gmail

They’re exactly the same, but the latter email does not have images turned on. Even though we’re reading it right now, even if we read every line of text and scroll all the way to the bottom, until images are turned on, it’s not considered opened and will not be reported here:

WhatCounts, Inc.: Campaign Details

What percentage of subscribers to your newsletters are reading them without images turned on? There’s no way of knowing simply by looking at the metrics. In order to make this determination accurately, you’d need to survey your subscribers and ask them.

The good news is that there isn’t any email service provider that functions differently. No one has figured out how to track opens more accurately than with an image load, so if you’re switching from one email service provider to another, how they track opens should be the same as your previous vendor. That in turn means you can still do apples-to-apples comparisons of your list’s open rates.

This also means that if you force an email service provider’s software to send pure text only emails, there’s no image sent along with it, and it will always show an open rate of zero.

The logical followup question is, can you improve your open rate reporting? The answer is yes. In order to get more accurate open rates, you have to give people a reason to turn images on. In our newsletters, we make use of the alt tag for images to tell people to turn images on. Here’s an example:

GameChanger: Email Marketing News from @WhatCounts for 4/19/12 - cspenn@gmail.com - Gmail

Depending on how much your subscribers trust you, you can also encourage them to whitelist you and allow images to be turned on all the time. Remind them in the text of the email to do so. Here’s what the image whitelist option looks like in GMail; other email clients will have similar options:

GameChanger: Email Marketing News from @WhatCounts for 4/19/12 - cspenn@gmail.com - Gmail

If you want to get creative, you can always use creative images that encourage people to turn on images for the sake of seeing them. If you’ve got a photographer on staff or you’re willing/able to use Creative Commons licensed photos, adding photography to your newsletters is another way to get people to turn images on.

As another example, in my weekly personal newsletter, I recycle popular Internet memes as unsubscribe buttons. I’ve gotten feedback from subscribers that they turn images on each week just to see what the button looks like that week. Here are a few recent examples:

I don't always unsubscribe from newsletters but when I do I click here - I Dont Always | Meme Generator

Newsletter 4/29

Unsub

Obviously, if you want to use this concept, make it fit your professional theme and brand. While fun, these images would be out of place in our corporate newsletter.

In our subsequent posts in this series, we’ll look at click through rate, action rate, and other common email metrics so that you better understand the numbers you see every time you push the Send button. Stay tuned!

Christopher S. Penn
Director of Inbound Marketing, WhatCounts


18 Ways book cover
Audience to Evangelist
Learn 18 different ways to find and grow your email marketing and social media ROI! Promote email with social, social with email, learn how to set up a Facebook Page for email subscriptions, and much more. Download the free eBook now.
Lifecycle email marketing is one of the hottest buzzwords in digital marketing, but how can you make it work for you? Download our free eBook and learn 5 lifecycle frameworks plus practical applications to your email marketing program.

Share this page:


When is the best time to send email? (part 3)

We’ve covered when the best time to send email is via testing and looking at open rate decay in previous blog posts. Let’s now look at a third way of making a determination about when the best time to send email is, based on your business drivers and need for ROI.

Let’s say you know that there are problem spots in your sales and marketing that keep recurring. Maybe there’s a cyclical weakness that shows up seasonally. Pop open your Google Analytics. If you have it, take a look at the last two years of data by setting the date to be a full year and turning on Compare to Past. Look for swings and inflections in the graphs that might indicate some level of weakness at certain times. Here’s one example from my personal blog:

Visitors Overview - Google Analytics

Look at the four red arrows on that chart. Those are weeks of the year, over the past two years, where there’s been a downturn, where traffic to my website declines for at least 3 weeks in a row. Those weeks and the subsequent ones after those key dates are lean. That’s the perfect time to add an extra email campaign or two. I should consider, for example, releasing another eBook or maybe doing some extra interviews so that I have content I can promote and share during those times to stay in front of the audience when history suggests I lose their attention.

This tactic can become even more powerful if you integrate it as part of a holistic digital marketing strategy. Find the lean periods during the year when our businesses take a hit. Again, I’ll use my blog’s analytics as an example. Those are the periods when we should hit the gas.

Visitors Overview - Google Analytics

You may not have the budget to run pay per click ads all year long, but what if you picked 4 periods of 3 weeks each corresponding to those lean periods? You might run a very community-oriented social media presence throughout most of the year. What if during those lean periods you did a bit more asking of your audience? What would hitting the gas a little harder look like? A recipe for boosting business during those periods might look something like this:

The Four Week Business Booster

Week 1:

  • Email drops at beginning of week (Sunday or Monday, depending on B2C
    or B2B)
  • Spend $10/day on PPC ads
  • Increase blog posts to daily
  • Increase shares on social media from 1x/day to 2x/day and end day with
    an “ask” (buy, try, donate, etc.)

Week 2:

  • Email drops at beginning of week (Sunday or Monday, depending on B2C
    or B2B)
  • Spend $15/day on PPC ads
  • Maintain daily blog posts
  • Maintain social activity

Week 3:

  • Email drops at beginning of week (Sunday or Monday, depending on B2C
    or B2B)
  • Mid-week email advertising a special you’re running
  • Spend $15/day on PPC ads
  • Maintain daily blog posts, add a mid-week advertising post on the
    special offer
  • Add special offer ask at the beginning and end of the day in addition
    to regular social postings

Week 4:

  • Email drops at beginning of week (Sunday or Monday, depending on B2C
    or B2B)
  • Mid-week email advertising a special you’re running and that it’s the
    final week
  • End of week email advertising that there are 24 hours left to take
    advantage of the special and then it’s gone for months (until the next
    weak area in your analytics)
  • Spend $20/day on PPC ads
  • Maintain daily blog posts, add a mid-week advertising post on the
    special offer, and a post near the end of the week reminding people that
    the offer is coming to an end
  • Add special offer ask at the beginning and end of the day in addition
    to regular social postings
  • Add 3 reminders during the last 3 days that the offer is coming to an
    end in social channels

Week 5:

  • Return all activity to normal
  • Send a thank you email to everyone for participating in the campaign
  • Turn off PPC ads
  • Write a thank you blog post
  • Post thank you messages in social channels

Is this a guaranteed recipe? No. It’s an example of the kind of thinking you’ll need to craft your own customized campaigns to make up for weak spots in your business as determined by your analytics. Pick and choose the tactics and tools that you can reliably use, combine them with effective email marketing, and fill the gaps when times are lean based on historical data.

What if you don’t have two years’ worth of data?

That’s okay. Someone else does: Google. Let’s say you’re in charge of marketing for the folks that make my morning coffee, Green Mountain Coffee Roasters. We’ll head over to Google Insights for Search and type in Green Mountain Coffee and set the time period to two years.

Google Insights for Search - Web Search Interest: green mountain coffee - 2011, 2010 - United States

You can clearly see that there are periods of downward trends in search volume for the company’s brand beginning in the springtime and persisting until September. People look for Green Mountain Coffee online less during those months, perhaps because of weather, and I’d be willing to bet their internal analytics and sales data mirrors this overall trend. (if you work there, feel free to tell me I’m right or wrong)

Perhaps some email campaigns advertising how to make iced coffee using Green Mountain’s brand would be effective. No matter what, sending more email to consumers during that time who are on the Green Mountain list would be part of a recipe to keep traffic, interest, and sales up during cyclical downturns.

Summary

We’ve talked about when to send email from the subscriber’s perspective, and now we’ve reviewed when to send email for maximum impact to your business. Both are important, and balanced correctly (business needs and subscriber needs) can make a world of difference to the health and strength of your business. Give these methods a try for your company and learn when you might need to be sending more email to patch up the weak spots in your digital marketing strategy.

And of course, if you’d like help doing this, please feel free to contact us. (clients, please contact your Account Managers!)

Christopher S. Penn
Director of Inbound Marketing, WhatCounts


18 Ways book cover
Audience to Evangelist
Learn 18 different ways to find and grow your email marketing and social media ROI! Promote email with social, social with email, learn how to set up a Facebook Page for email subscriptions, and much more. Download the free eBook now.
Lifecycle email marketing is one of the hottest buzzwords in digital marketing, but how can you make it work for you? Download our free eBook and learn 5 lifecycle frameworks plus practical applications to your email marketing program.

Share this page:


Email marketing blog retrospective: Q1 2012

Casey KasemAs many businesses do, we take a moment at the end of each quarter to examine how we did. What worked? What didn’t work? What things were the most and least appealing to you? In that analysis we also look at our content. What was valuable? What caught your attention?

Let’s see what you thought were the most important articles that we created in the first quarter of 2012:

  1. GMail spam warnings and their meanings for email marketers
  2. The 30 second email sales pitch
  3. Email Analytics 101: identifying email-driven website traffic
  4. What vintage ads can teach you about email marketing design
  5. How to set up Facebook pages for email signups
  6. Top 5 email marketing programs you should be doing
  7. How Pinterest can benefit email marketers
  8. 5 ideas for subject line testing
  9. How to know if your A/B split test really worked
  10. 5 things all email marketers need to know

What do you think? Does this reflect what you enjoyed most? Did something not make the top 10 that you thought should have?

For those interested, this is a relatively simple report to pull from Google Analytics. Just look in your Site Content report, set the date for the quarter, and see what content ranked highest.

Also, as a point of trivia, if you don’t know who the gentleman is in the photo, that’s Casey Kasem, who once hosted a very popular radio show called the American Top 40. As influencers go, Casey was one of the original tastemakers and pop culture influencers.

Christopher S. Penn
Director of Inbound Marketing, WhatCounts


18 Ways book cover
Audience to Evangelist
Learn 18 different ways to find and grow your email marketing and social media ROI! Promote email with social, social with email, learn how to set up a Facebook Page for email subscriptions, and much more. Download the free eBook now.
Lifecycle email marketing is one of the hottest buzzwords in digital marketing, but how can you make it work for you? Download our free eBook and learn 5 lifecycle frameworks plus practical applications to your email marketing program.

Share this page:


Analyzing your newsletter with flow visualization

One of the most powerful but overlooked tools for examining your newsletter is Google Analytics’ flow visualization. Flow visualization allows you to see how people behaved in a very visual way. Here’s an example:

Visitors Flow - Google Analytics

Out of the box, flow visualization in Google Analytics is interesting, but not especially insightful. Let’s tune it up to make it a lot more impactful. First, make sure you’re using an email service provider that supports Google Analytics integration. If you’re a WhatCounts customer, ask your account manager about making sure it’s turned on.

Next, set up your Google Analytics account to identify your email traffic. Instructions on how to do so are in this post.

Go to the Audience menu in Google Analytics. Select Visitors Flow. Then at the top of the interface, choose your custom traffic segment. Drop down the first filter and choose Campaign from Traffic Sources in the green box.

Visitors Flow - Google Analytics

As long as you’ve been naming your newsletters something obvious, you’ll be able to see each newsletter and where the traffic goes from each newsletter. Take a look at each newsletter you’ve sent recently and see where the traffic from that newsletter has gone. Is it going where you intended people to go?

Visitors Flow - Google Analytics

Are people doing what you want them to do? Is there a clear and logical progression from your newsletter to the goals that are valuable to you?

For example, if people are visiting the WhatCounts website from our newsletter, we obviously want them to either download something or schedule a demo with one of our business development managers. Looking in this flow visualization, if we didn’t see any of those targeted landing pages, we’d know there was a problem with our newsletter, that the call to action wasn’t obvious enough or valuable enough to get subscribers to convert. (thankfully, some of our landing pages are in there)

If you want to see any one newsletter in greater contrast, simply click on that issue and choose Highlight Traffic Through Here. Now you’ll see just that newsletter. You can even step through the different newsletters to see how visitor patterns change from one newsletter to the next.

Visitors Flow - Google Analytics

Try Flow Visualization today and see if your newsletter subscribers are performing valuable actions and going where you want them to go. If they’re not, tighten up your content so that the value is so compelling and the calls to action are so obvious that they have no choice but to go where you intend them to go.

Christopher S. Penn
Director of Inbound Marketing, WhatCounts


18 Ways book cover
Audience to Evangelist
Learn 18 different ways to find and grow your email marketing and social media ROI! Promote email with social, social with email, learn how to set up a Facebook Page for email subscriptions, and much more. Download the free eBook now.
Lifecycle email marketing is one of the hottest buzzwords in digital marketing, but how can you make it work for you? Download our free eBook and learn 5 lifecycle frameworks plus practical applications to your email marketing program.

Share this page:


3 web analytics tips for subject line testing

Why don’t more email marketers use testing in their campaigns? It isn’t lack of availability – every major email service provider has testing tools of some kind available in their repertoire. I suspect the problem is more in overcoming the mental hurdle of what to test. I say this with some confidence because you, dear reader, made the previous blog post about subject lines the most popular one ever. Rather than test and experiment, especially in times when resources are tight, most marketers default to what they know without testing simply because it’s either easier or less risky. In failing to test, however, you’re leaving significant money on the table.

Let’s take a look at another area ripe for harvesting when it comes to creating subject lines. Effective subject lines are hard to come by, and as writers we struggle with what to put in subject lines in order to test them. Last time we looked at the general Google index as a way of determining what subject lines to test. This time, let’s dig into your site’s specific analytics. I’ll be working with Google Analytics, but any reasonably good analytics package should work.

Start by looking at your top content over the period of time of your choice. What are the top 10 pages on your web site? These are the topics that generally and broadly, your audience is interested in. Depending on how well written your web site is, if you haven’t sent this content to your list, you could package up just that page (including its title as a subject line) and an excerpt to your list.

Top Content - Google Analytics

If you maintain a corporate blog with different analytics than your corporate web site, you’ll want to do this simple test for both sites. You’ll find which blog posts generated the most raw interest and pull subject lines and creative messages from those statistics. This, by the way, is another argument for blogging frequently on a corporate level – you never know what will pique your audience’s attention, but when you get a hit, you can leverage that knowledge in all your marketing.

How do people find your site? In your analytics, you’ll find search engine keywords that have led visitors to your site. No surprise here – the phrases that people use to find your site (indicating interest and intent) also may be good fodder for subject lines.

Keywords - Google Analytics

Let’s kick this up a notch. If you’ve correctly implemented Google’s free Webmaster Tools service, you should have access to statistics from Google about the way their visitors see your site. You’ll see how your site appears in search and the relevant search queries that got viewed and clicked in Google.

Webmaster Tools - Search queries

What’s new in the more recent releases of Webmaster Tools is the ability to check clickthrough rate. It takes a very tiny leap of imagination to realize that a highly clicked search result (which is effectively a subject line for a web page) is likely to perform well as subject line material for an email. Try to rework the query as little as possible, because the way users type in their search indicates the language they’re using. Use their language as much as possible and you’ll get better results.

The power of web analytics is that we have more data than ever before to tell us what’s capturing the attention of our audiences and making them click on things. The goal, of course, is to boost open rates by having subject lines that catch attention, and these three tips should help give you some additional tools for crafting the subject lines you need for maximum action.

Christopher S. Penn
Director of Inbound Marketing, WhatCounts


18 Ways book cover
Audience to Evangelist
Learn 18 different ways to find and grow your email marketing and social media ROI! Promote email with social, social with email, learn how to set up a Facebook Page for email subscriptions, and much more. Download the free eBook now.
Lifecycle email marketing is one of the hottest buzzwords in digital marketing, but how can you make it work for you? Download our free eBook and learn 5 lifecycle frameworks plus practical applications to your email marketing program.

Share this page:


Email Analytics 101: Identifying Email-Driven Website Traffic

One of the most powerful free tools available to us as Internet marketers is Google Analytics. Most people don’t think of Google Analytics as an email marketing analytics tool, but it’s exceptionally powerful for that purpose. Let’s look at how to get Google Analytics set up for the most basic traffic analysis on your website.

First, inside GA, you’ll create an advanced segment. Go to any section like Visitors, then click on the Advanced Segments button in the grey navigation bar, then click New Custom Segment.

Visitors Overview - Google Analytics

Name the segment something obvious, like Email Marketing Traffic. Begin adding OR statements that include the source name of your email marketing service provider. For WhatCounts customers, your sources will be WhatCountsEmail for users of the WhatCounts Professional Edition and Publicaster for users of the WhatCounts Publicaster Edition. You’ll also want to include the generic medium of Email. Save this new segment.

Visitors Overview - Google Analytics

Go back to the Advanced Segments menu and now ensure that All Visits is checked, along with your new segment.

Visitors Overview - Google Analytics

What you should now see on every page and in every tab in Google Analytics is your overall site audience, plus the audience driven by your email marketing. You can see, for example, the peaks and valleys that correspond to newsletters being sent here:

Visitors Overview - Google Analytics

If you have set up Goals for your website, you will also be able to see how email marketing is impacting those goals:

Overview - Google Analytics

In this case, email marketing accounts for 18.38% of all goal completions, which is a testament to its ability to gather and direct the attention of your audience.

Setting up this email marketing segment radically transforms Google Analytics from a simple “who visited the website” tool into a powerful, comprehensive dashboard that lets you see your website and email marketing programs working together.

Christopher S. Penn
Director of Inbound Marketing, WhatCounts


18 Ways book cover
Audience to Evangelist
Learn 18 different ways to find and grow your email marketing and social media ROI! Promote email with social, social with email, learn how to set up a Facebook Page for email subscriptions, and much more. Download the free eBook now.
Lifecycle email marketing is one of the hottest buzzwords in digital marketing, but how can you make it work for you? Download our free eBook and learn 5 lifecycle frameworks plus practical applications to your email marketing program.

Share this page:


What’s your most profitable subject line?

We talk frequently about testing subject lines in email marketing to determine which is the best performing. We talk about doing multivariate testing to determine which creative is the best performing.

We rarely talk about what best performing means.

For most discussions about email marketing, best performing is usually who opens or clicks on a desired call to action the most. However, if you want to judge the ultimate effectiveness of your marketing, you need to track all the way to conversion, to purchase, to an action taken.

Let’s assume you have your goals and funnels defined and completed in Google Analytics. If you don’t, I recommend watching this webinar on determining marketing ROI, which includes steps on how to configure Analytics to make these determinations. I’ll also work on the assumption that you’re using Google Analytics tags in your email marketing. WhatCounts customers should enable this in the Administration tab for future campaigns if you’re not already using these tags.

Configure a Google Analytics custom report to show goal starts, goal completions, and goal value as your metrics, with Medium, Source, and Campaign as your dimensions. This will tell you how many people got to the landing page from your email, how many people found value in the landing page and completed whatever the goal is (buy, donate, volunteer, whatever), and whatever dollar value you’ve assigned to your goals.

End goal effectiveness

Run the custom report, and you’ll see immediately a breakdown of your marketing sources – referral traffic, organic SEO, and email marketing are shown as the top 3 tracked sources below.

Custom Report - Google Analytics

We also see that even though email marketing is the third highest driver of traffic to the web property, it delivers value comparable to the top tracked source, referral traffic – above and beyond organic SEO. That insight alone is useful, especially if you’re defending your email marketing campaigns to your accounting department.

Click on email and you’ll dig into the sources. If you use more than one email service provider, you’ll likely see their products listed in the sources page. Obviously, WhatCounts customers will see WhatCountsEmail or Publicaster here.

Custom Report - Google Analytics

Click through and you get to the real gold: the value of each subject line that you’ve used in your email marketing, listed by subject lines.

Custom Report - Google Analytics

For example, we can see that all but one of the subject lines got people to the landing page and through it, all except #4, which indicates that what was promised in the email wasn’t delivered in the landing page. We can also see the actual dollar value of any subject line, which goes way beyond open and click rates.

If you do A/B testing, you’ll be able to see which subject line converted into the highest value. Rather than do the traditional 80/20 split subject test, you may wish to evenly divide your audience in half and send two separate campaigns to see which campaign actually converts better. The message that receives the most opens and clicks may not actually drive real business and end goal conversions!

Testing to the end goal of real business done or real action taken is a vital part of diving deep into your marketing analytics. If you’re sending enough email to use an email service provider, you’re sending enough email to warrant this kind of testing and analysis to maximize the effectiveness of what you’re doing. The best part? This level of analytical detail and assessment is completely free to set up.

Christopher S. Penn
Director of Inbound Marketing, WhatCounts


18 Ways book cover
Audience to Evangelist
Learn 18 different ways to find and grow your email marketing and social media ROI! Promote email with social, social with email, learn how to set up a Facebook Page for email subscriptions, and much more. Download the free eBook now.
Lifecycle email marketing is one of the hottest buzzwords in digital marketing, but how can you make it work for you? Download our free eBook and learn 5 lifecycle frameworks plus practical applications to your email marketing program.

Share this page:


How to know if your A/B Split Test really worked

One of the unique features of the WhatCounts A/B testing suite is the ability to test 100% of your list. On the surface, this seems counterintuitive. After all, the point of A/B testing is to find out which combinations of content, sender, and subject work best with a sample of your list and then use the most winning combination to send to the rest of the list.

However, there are cases where taking a small sample of your audience may not prove to be helpful for drawing an effective conclusion about your data. For example, one of our Business Development Managers asked recently whether animated calls to action are less or more effective than static ones. Initially, we did a standard 10/10/80 split, with 10% of the list receiving one version of content with a static image call to action and one version of content with an animated call to action.

WhatCounts, Inc.: Admin

Let’s take a look at those results:

Sample A: 4,892 people. Response rate for non-animated image: 24 clicks.
Sample B: 4,892 people. Response rate for animated image: 16 clicks.

Now, you might be tempted to make the mistake of declaring Sample A the winner in the test. That would be a critical error. If you know anything about statistics, you are familiar with Pearson’s Chi-Squared Test. Applying this test against our A/B split above reveals an important fact: the difference between Samples A and B is statistically insignificant. That is, random noise, random variations are just as likely to be responsible for the difference in results as the actual test itself.

When we saw these statistically insignificant results in our initial A/B split test, we knew that we had to retest with a much larger sample size. This is one of the reasons why the WhatCounts platform allows you to choose a winner of an A/B test manually – there was no actual winner!

WhatCounts, Inc.: Admin

Don’t just let your email marketing software automatically “pick a winner” when there may not be a clear winner!

To retest, we used the testing suite to divide our list evenly in half to use the entire list rather than just 20% of it.

WhatCounts, Inc.: Admin

How did the much larger sample size turn out?

Sample A: 24,463 people. Response rate for non-animated image: 75 clicks.
Sample B: 24,463 people. Response rate for animated image: 87 clicks.

Ah ha! Animated images work, right?

Nope. Again, if you apply the chi-squared test, there is no statistical significance here. Animated and non-animated images behave largely the same – there’s no statistical difference that clearly declares one approach to be better than another. We can now reasonably conclude that for our list, for our audience, there is no statistical difference between animated and non-animated calls to action.

Here’s where data turns into action: by running two tests and validating that there is no statistical significance between animated and non-animated calls to action, we can now make the business and marketing decision that the time it takes to produce an animated graphic is likely not worth it. We’re better off focusing our efforts to improve our email marketing in other ways.

To do your own chi-squared test, use this handy Google Doc, based on the work of Rags Srinivasan.

Christopher S. Penn
Director of Inbound Marketing, WhatCounts


18 Ways book cover
Audience to Evangelist
Learn 18 different ways to find and grow your email marketing and social media ROI! Promote email with social, social with email, learn how to set up a Facebook Page for email subscriptions, and much more. Download the free eBook now.
Lifecycle email marketing is one of the hottest buzzwords in digital marketing, but how can you make it work for you? Download our free eBook and learn 5 lifecycle frameworks plus practical applications to your email marketing program.

Share this page: