<?xml version="1.0" encoding="UTF-8"?> <rss version="2.0" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:wfw="http://wellformedweb.org/CommentAPI/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:sy="http://purl.org/rss/1.0/modules/syndication/" xmlns:slash="http://purl.org/rss/1.0/modules/slash/" ><channel><title>MailChimp Email Marketing Blog &#187; Stats</title> <atom:link href="http://blog.mailchimp.com/category/stats/feed/" rel="self" type="application/rss+xml" /><link>http://blog.mailchimp.com</link> <description>MailChimp, email marketing, and monkeys!</description> <lastBuildDate>Wed, 08 Feb 2012 23:04:08 +0000</lastBuildDate> <language>en</language> <sy:updatePeriod>hourly</sy:updatePeriod> <sy:updateFrequency>1</sy:updateFrequency> <generator>http://wordpress.org/?v=3.3.1</generator> <item><title>Keeping Our Eyes on Video</title><link>http://blog.mailchimp.com/keeping-our-eyes-on-video/</link> <comments>http://blog.mailchimp.com/keeping-our-eyes-on-video/#comments</comments> <pubDate>Wed, 01 Feb 2012 19:20:52 +0000</pubDate> <dc:creator>Joshua</dc:creator> <category><![CDATA[Add-ons & Integrations]]></category> <category><![CDATA[API]]></category> <category><![CDATA[Email Design]]></category> <category><![CDATA[Emarketing, Business]]></category> <category><![CDATA[IMHO]]></category> <category><![CDATA[Inside MailChimp]]></category> <category><![CDATA[MailChimp API]]></category> <category><![CDATA[MailChimp News]]></category> <category><![CDATA[Stats]]></category> <category><![CDATA[Technology]]></category> <category><![CDATA[Tips, Tricks, Best Practices]]></category><guid isPermaLink="false">http://blog.mailchimp.com/?p=24201</guid> <description><![CDATA[A few years ago MailChimp decided to take video seriously. Well, in the beginning, the videos themselves were never very serious, in fact, quite the opposite. But they have always served a very serious purpose, which is to help our customers learn how to use MailChimp, learn about new features and learn about our awesome [...]]]></description> <content:encoded><![CDATA[<p class=" wp-image-24445" title="Heat maps">A few years ago MailChimp decided to take video seriously. Well, in the beginning, the videos themselves were never very serious, in fact, <a href="http://youtu.be/ouADPnMNAXU" target="_blank">quite the opposite</a>. But they have always served a very serious purpose, which is to help our customers learn how to use MailChimp, learn about new features and <a href="http://mailchimp.com/about/customer-stories/" target="_blank">learn about our awesome customers</a>.</p><p>But how do we know if these videos are doing their job? I get asked that a lot. Well, it&#8217;s all about the stats.</p><p>&nbsp;</p><div id="attachment_24313" class="wp-caption aligncenter" style="width: 490px"><a href="http://blog.mailchimp.com/wp-content/uploads/2012/01/Screen-Shot-2012-01-31-at-4.28.55-PM.png"><img class=" wp-image-24313 " title="Viewership" src="http://blog.mailchimp.com/wp-content/uploads/2012/01/Screen-Shot-2012-01-31-at-4.28.55-PM-440x300.png" alt="" width="480" height="327" /></a><p class="wp-caption-text">Graph of viewership, spiking the day we emailed the Wavelength video.</p></div><p><span id="more-24201"></span><br /> A big part of the using-video-on-your-website mix is the video hosting service that you use. We&#8217;re a long way from 2005 when there was either YouTube, or an .flv or .mov embedded in your webpage. Today&#8217;s video hosting landscape is more like a food court at the airport; Do I want some cheap fast food? Or some cheap fast food posing as cheap healthy food because its on flatbread? Or do I want to spring for that place that looks all dark and leathery with lots of TVs and the $18 hamburger? There are plenty of choices out there, but making the choice of who to go with is not always so cut and dry.</p><p>We&#8217;ve tried out more than our share of hosts these past few years. All have had their pros and cons, their sweet spots and their misgivings. But this year we&#8217;ve moved our content to a new home that looks finally like a place to set down some roots. And that place is <a href="http://www.wistia.com" target="_blank">Wistia</a>.</p><p>Along with a long list of the necessary fundamentals, such as solid service and performance, good support, and an easy workflow, Wistia provides some fun and helpful performance metrics that help us know how our videos are performing, and where there may be room for improvement.</p><p>One of the minor miracles of the internet and the video hosting revolution is that you have access to an abundance of statistics that can show you, down to the second, what your viewing audience is reacting to, and how. If you aren&#8217;t convinced that this is truly miraculous just do a little reading about the complexity and cost of the Nielson rating system for TV shows (<a href="http://en.wikipedia.org/wiki/Nielsen_ratings" target="_blank">viewer diaries, &#8220;Home Units&#8221; and &#8220;people meters&#8221;!</a>), then realize that with the internets we get at least the same amount of information as they do for a minute fraction of what that system cost in terms of time, money, and effort.</p><p>Recently we sent an email campaign to 1.2 million users that announced a new service called Wavelength. In that email, we linked to a video hosted on Wistia, which meant we could go in after the fact to see how it performed. With Wistia&#8217;s metrics, not only can we see the normal stuff like total loads, total views, and average engagement,</p><div id="attachment_24209" class="wp-caption aligncenter" style="width: 510px"><a href="http://blog.mailchimp.com/wp-content/uploads/2012/01/Screen-Shot-2012-01-30-at-5.00.58-PM.png"><img class=" wp-image-24209  " title="wistia stats" src="http://blog.mailchimp.com/wp-content/uploads/2012/01/Screen-Shot-2012-01-30-at-5.00.58-PM-500x297.png" alt="" width="500" height="297" /></a><p class="wp-caption-text">The basic video statistic summary.</p></div><p>but we also get to see these nifty little &#8220;heat maps&#8221; that show each viewers engagement in a neat new way. They also show where in the world the view is from, which is always pretty cool.</p><div id="attachment_24445" class="wp-caption aligncenter" style="width: 490px"><a href="http://blog.mailchimp.com/wp-content/uploads/2012/02/Screen-Shot-2012-01-30-at-5.01.22-PM.png"><img class=" wp-image-24445" title="Heat maps" src="http://blog.mailchimp.com/wp-content/uploads/2012/02/Screen-Shot-2012-01-30-at-5.01.22-PM-500x267.png" alt="" width="480" height="256" /></a><p class="wp-caption-text">Some Wistia heat maps.</p></div><p>The heat maps display a hotter color within the timeline of your video as people scrub or rewind to rewatch any portion of the video. So in a loose sense, we can look for patterns that may tell us what particular points in the video people needed, or wanted to see again. We can also see gaps in the timeline if they skipped sections. Of course interpreting these graphs is a fuzzy science, but if there are similar spots across the viewing audience that see more heat on the map, we can look at that point in the video and consider what was either extra attention grabbing, or maybe extra confusing, our maybe something so incredibly cute that people just couldn&#8217;t help but to watch it over and over again.</p><p>In this case, there wasn&#8217;t a strong pattern of viewing a particular point over and over again, but there was a telltale pattern of fall-off around the 20 second mark. After watching the video again I can see that in the first 20 seconds or so we define what Wavelength does in general terms. After that we launch into more detail. So, many people watched the first twenty seconds and got the gist of it, then switched off.</p><p>Statistics showed that 82% of the video was watched on average, which is actually pretty darn good for a web video that is 1:30 in length. If that number was significantly lower, I would be more concerned about that dropoff pattern 20 seconds in. I would be inclined to go back and rework the script or the treatment to encourage viewers not to leave. How would I do it? Maybe have the narration hint at something coming up later in the video, or possibly add a surprising or entertaining moment which may rekindle interest and buy us a little more time with our viewer. As more people are used to seeing and watching video on the web, convincing them to click the play button is getting easier. Convincing them to stick with the video, however, is actually getting harder imho.</p><p>All these cool metrics can really help us do just that. It&#8217;s simple enough these days to go back into the video and retool it as needed, then export a new version and swap out the last one. This way we can continue to iterate, update, and improve our content as needed. And in my experience, it&#8217;s rare that something that is ultimately a subjective piece of creativity, such as a video, gets so much direct objective feedback from a broad audience. So I&#8217;ve really found these stats to be a huge help as I&#8217;ve continued to create and shape the videos we produce. They&#8217;ve also thickened my skin a good bit.</p><p>Another nice thing about Wistia is how we also get a lot of control over the <a href="http://wistia.com/blog/superembeds-viva-la-revolucion/" target="_blank">look and features of the player.</a></p><div id="attachment_24441" class="wp-caption aligncenter" style="width: 317px"><a href="http://blog.mailchimp.com/wp-content/uploads/2012/02/Screen-Shot-2012-01-31-at-2.04.51-PM.png"><img class="size-full wp-image-24441" title="Custom player controls" src="http://blog.mailchimp.com/wp-content/uploads/2012/02/Screen-Shot-2012-01-31-at-2.04.51-PM.png" alt="" width="307" height="602" /></a><p class="wp-caption-text">Simple player customization tools.</p></div><p>Many hosts allow you only limited control over what color your frame and buttons are, and what controls you can include. It&#8217;s nice to finally have an easy way to make the player look as minimal as we want it to and to be able to color it to match the palette of the page it will live in. It would have been a big bummer to have a bunch of big, off-color controls covering up the eyes and our pretty new logo in the poster frame of the Wavelength video.</p><p>As it so happens, we first learned about Wistia because they contacted us a few years ago when developing their own API thingy between MailChimp and Wistia. It allows you to <a href="http://wistia.com/doc/mailchimp" target="_blank">integrate your video with your email campaign</a>, which is pretty cool . And MailChimp has a Wistia merge tag which allows you to integrate a Wistia video of your own into your email newsletter and take advantage of the awesome statistics. <a href="http://blog.mailchimp.com/updated-wistia-video-integration/#more-12631" target="_blank">Read about it here.</a>  Ben also just wrote a blogpost about how we allow you to <a href="http://blog.mailchimp.com/new-customize-and-automate-video-merge-tags/">customize and automate your video merge tags.</a>  Pretty simple stuff to do, but as you can see below, it may make waves if you actually use it:</p><div id="attachment_24437" class="wp-caption aligncenter" style="width: 490px"><a href="http://blog.mailchimp.com/wp-content/uploads/2012/02/ariana.jpg"><img class=" wp-image-24437" title="Clickmap" src="http://blog.mailchimp.com/wp-content/uploads/2012/02/ariana.jpg" alt="" width="480" height="688" /></a><p class="wp-caption-text">Clickmap of an email newsletter.</p></div><p>This is a MailChimp <a href="http://blog.mailchimp.com/clickmap-email-overlay-reports-in-mailchimp/" target="_blank">click map</a> of the email Ben sent out announcing Wavelength. As you can see, click rates on the text links averaged around 4-8 %, but that video staring atcha there got a whopping 62.8% of all the clicks. Maybe it&#8217;s that hypnotic eye power getting people to watch (I have a proprietary &#8220;hypnotic eye power&#8221; filter; merge tag coming soon!), or maybe it&#8217;s people&#8217;s inclination these days to prefer watching a quick video instead of, or in addition to, reading about something. Whatever it is, it&#8217;s these insightful statistics that help prove this video thing is worth keeping our eyes on.</p> ]]></content:encoded> <wfw:commentRss>http://blog.mailchimp.com/keeping-our-eyes-on-video/feed/</wfw:commentRss> <slash:comments>0</slash:comments> </item> <item><title>Comacast and Gmai: all your typo email are belong to us</title><link>http://blog.mailchimp.com/comacast-and-gmai-all-your-typo-email-are-belong-to-us/</link> <comments>http://blog.mailchimp.com/comacast-and-gmai-all-your-typo-email-are-belong-to-us/#comments</comments> <pubDate>Tue, 20 Dec 2011 17:39:49 +0000</pubDate> <dc:creator>John</dc:creator> <category><![CDATA[MailChimp Labs]]></category> <category><![CDATA[MailChimp News]]></category> <category><![CDATA[Stats]]></category> <category><![CDATA[Tips, Tricks, Best Practices]]></category> <category><![CDATA[big data]]></category> <category><![CDATA[data science]]></category> <category><![CDATA[email typo squatters]]></category> <category><![CDATA[research]]></category> <category><![CDATA[typos]]></category><guid isPermaLink="false">http://blog.mailchimp.com/?p=22145</guid> <description><![CDATA[I’ve put my business cards in quite a few fish-bowl drawings, because the amount of personal information I’ll give away for a free chili-cheese burrito is astounding. At some point, the proprietor of such a card-collecting eatery might pay her angsty nephew to hand jam those email addresses into a spreadsheet. Odds are that one [...]]]></description> <content:encoded><![CDATA[<p>I’ve put my business cards in quite a few fish-bowl drawings, because the amount of personal information I’ll give away for a free chili-cheese burrito is astounding.</p><p>At some point, the proprietor of such a card-collecting eatery might pay her angsty nephew to hand jam those email addresses into a spreadsheet. Odds are that one of those addresses is going into that list with a typo. The same thing happens with a single opt-in webform (<a href="http://kb.mailchimp.com/article/how-does-confirmed-optin-or-double-optin-work/">huzzah for double opt-in</a>).</p><p>You might think most of these typo addresses are going to bounce when you send to them, so no big deal—typos are merely a minor annoyance and occasional source of <a href="http://damnyouautocorrect.com/images/applesauce.jpg">hilariousness</a>. And when they bounce, you’ll just clean them up then.</p><p><span id="more-22145"></span></p><p>You’d be <em>mostly</em> right to think that. If you fat-finger the top-level domain, you’re going to get a bounce. If you mess up anything to the left of the @ symbol, chances are you’re going to get a bounce there, too.</p><p>But what if you fat-finger the domain? This past month, I was doing some big data wrangling for our <a href="http://blog.mailchimp.com/mailchimps-email-genome-project/">Email Genome Project</a>, and I saw something funky going on with fat-fingered domains of large ISPs and freemail providers—specifically, email to these typos wasn&#8217;t bouncing. We actually had great delivery to these domains, which was unnerving.</p><p>Typosquatting domains sit around sites like Gmail, Yahoo!, Hotmail, Comcast, etc., and many of them love to accept all the mail they can get. For example, just in November, MailChimp users <em>successfully</em> sent 100,000 emails to addresses at Gmai.com, Gmial.com, Gmil.com, and 15 other Gmail imposters.</p><p>I’m not saying that my doppelganger doesn’t have a gmai.com address, but I’d be willing to bet that while these sites accept all the email sent to them, they deserve slim to none of it.</p><p>In November alone, our users sent approximately one million emails to typosquatting domains.</p><p>Don’t navigate to these sites, please. I’ve done it for you. The creepy stylins of gmai.com:</p><div id="attachment_22153" class="wp-caption aligncenter" style="width: 596px"><a href="http://blog.mailchimp.com/comacast-and-gmai-all-your-typo-email-are-belong-to-us/gmai/" rel="attachment wp-att-22153"><img class="size-full wp-image-22153   " src="http://blog.mailchimp.com/wp-content/uploads/2011/12/gmai.png" alt="Every time someone takes one of these surveys, a fairy dies" width="586" height="324" /></a><p class="wp-caption-text">It’s mighty good of them to thank you for your typo.</p></div><p>Who owns these sites? Darned if I know. Many of them have anonymized their WHOIS information. What if your doctor fat-fingers the email address your blood work results are going to? The hard-working folks at Gmai.com will know all about your iron deficiency.</p><p>Perhaps these sites are collecting email addresses, correcting the typos, and creating lists to sell. That’s bad.</p><p>Now that they have your content, they could copy it, correct the typo address, and send a customized phishing attack to one of your subscribers. That’s worse.</p><p>Why don’t we correct these typos for you? Even if we could identify all these domains and pass judgment on whether or not a particular email address is intentional, correcting the address gets into permission issues. On a single opt-in list, someone might have intentionally given a bad email address. From a data-science perspective, these typos are an excellent signal of list quality—and they&#8217;re useful in &#8220;scoring&#8221; campaigns before they go out the door (hint, hint).</p><p>So look out for typos, and seriously consider going double opt-in. After all, if you’re not careful, you may end up in a coma&#8230;cast. *rimshot*</p> ]]></content:encoded> <wfw:commentRss>http://blog.mailchimp.com/comacast-and-gmai-all-your-typo-email-are-belong-to-us/feed/</wfw:commentRss> <slash:comments>7</slash:comments> </item> <item><title>Major Email Provider Trends Update: Gmail Pretty Much Caught Up</title><link>http://blog.mailchimp.com/major-email-provider-trends-update-gmail-pretty-much-caught-up/</link> <comments>http://blog.mailchimp.com/major-email-provider-trends-update-gmail-pretty-much-caught-up/#comments</comments> <pubDate>Mon, 01 Aug 2011 19:59:53 +0000</pubDate> <dc:creator>Ben</dc:creator> <category><![CDATA[Stats]]></category> <category><![CDATA[charts]]></category><guid isPermaLink="false">http://blog.mailchimp.com/?p=14539</guid> <description><![CDATA[Over 5 billion emails studied: Hotmail, Yahoo and Gmail are tops]]></description> <content:encoded><![CDATA[<p>Someone in the email marketing industry (who is known, among other things, for sending out really good chocolates every Christmas) asked me if we had an update to this old blog post from 2009: <a href="http://blog.mailchimp.com/major-email-provider-trends-yahoo-and-hotmail-tops-gmail-catching/" target="_blank">Major Email Provider Trends: Yahoo and Hotmail Tops, Gmail Catching</a>. I like it when he sends me chocolate, so I thought we better provide an update:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2011/08/webmail-trends.jpg"><img class="size-medium wp-image-14540 alignnone" title="webmail-trends" src="http://blog.mailchimp.com/wp-content/uploads/2011/08/webmail-trends-500x264.jpg" alt="" width="500" height="264" /></a></p><p>Back in 2009, Gmail was a distant 3rd, but trending up. Now, Gmail&#8217;s right there with Hotmail and Yahoo. Sorry, but there are a few months there where we kinda had an oopsie and forgot to track Gmail for this study. But you still get a good picture of how far gmail has come. C&#8217;mon, it&#8217;s at least good enough to earn my chocolates, Mr.Brownlow.</p><p><span id="more-14539"></span></p><p>For those of you who prefer data in table format:</p><table border="1" cellspacing="0" cellpadding="6"><tbody><tr><td class="xl25" width="69" height="12">month</td><td class="xl26" width="69">aol.com</td><td class="xl26" width="69">comcast.net</td><td class="xl26" width="69">gmail.com</td><td class="xl26" width="69">hotmail.com</td><td class="xl26" width="69">yahoo.com</td></tr><tr><td class="xl27" align="right" width="69" height="12">10/01/10</td><td class="xl26" width="69">34,405,902</td><td class="xl26" width="69">12,021,698</td><td class="xl26" width="69">N/A</td><td class="xl26" width="69">108,936,564</td><td class="xl26" width="69">97,049,812</td></tr><tr><td class="xl27" align="right" width="69" height="12">11/01/10</td><td class="xl26" width="69">42,714,047</td><td class="xl26" width="69">14,824,531</td><td class="xl26" width="69">N/A</td><td class="xl26" width="69">135,558,433</td><td class="xl26" width="69">121,705,469</td></tr><tr><td class="xl27" align="right" width="69" height="12">12/01/10</td><td class="xl26" width="69">46,863,742</td><td class="xl26" width="69">16,240,985</td><td class="xl26" width="69">N/A</td><td class="xl26" width="69">151,263,034</td><td class="xl26" width="69">136,168,289</td></tr><tr><td class="xl27" align="right" width="69" height="12">01/01/11</td><td class="xl26" width="69">40,369,729</td><td class="xl26" width="69">14,110,332</td><td class="xl26" width="69">N/A</td><td class="xl26" width="69">138,908,566</td><td class="xl26" width="69">128,182,859</td></tr><tr><td class="xl27" align="right" width="69" height="12">02/01/11</td><td class="xl26" width="69">41,395,605</td><td class="xl26" width="69">14,562,288</td><td class="xl26" width="69">N/A</td><td class="xl26" width="69">148,440,912</td><td class="xl26" width="69">137,340,143</td></tr><tr><td class="xl27" align="right" width="69" height="12">03/01/11</td><td class="xl26" width="69">51,137,268</td><td class="xl26" width="69">18,088,971</td><td class="xl26" width="69">183,464,335</td><td class="xl26" width="69">181,109,737</td><td class="xl26" width="69">172,499,322</td></tr><tr><td class="xl27" align="right" width="69" height="12">04/01/11</td><td class="xl26" width="69">52,277,331</td><td class="xl26" width="69">18,287,080</td><td class="xl26" width="69">196,894,151</td><td class="xl26" width="69">190,469,251</td><td class="xl26" width="69">182,697,979</td></tr><tr><td class="xl27" align="right" width="69" height="12">05/01/11</td><td class="xl26" width="69">55,657,059</td><td class="xl26" width="69">19,440,357</td><td class="xl26" width="69">217,716,403</td><td class="xl26" width="69">223,951,543</td><td class="xl26" width="69">205,835,434</td></tr><tr><td class="xl27" align="right" width="69" height="12">06/01/11</td><td class="xl26" width="69">59,218,272</td><td class="xl26" width="69">20,573,197</td><td class="xl26" width="69">236,351,334</td><td class="xl26" width="69">237,811,895</td><td class="xl26" width="69">231,766,109</td></tr><tr><td class="xl27" align="right" width="69" height="12">07/01/11</td><td class="xl26" width="69">59,124,900</td><td class="xl26" width="69">20,966,657</td><td class="xl26" width="69">249,286,991</td><td class="xl26" width="69">250,853,114</td><td class="xl26" width="69">238,816,082</td></tr></tbody></table><p>&nbsp;</p><p>Each month, you see how many emails are sent through MailChimp to the webmail domains above. Kind of gives you an idea of how much email MailChimp is sending these days (about 2 billion per month).</p><p>Somewhat related:</p><ul><li>Track <a href="http://blog.mailchimp.com/domain-performance-report/" target="_blank">domain performance stats</a></li><li>User agent stats <a href="http://blog.mailchimp.com/inbox-inspections-now-include-user-agent-data/" target="_blank">inside MailChimp&#8217;s Inbox Inspector</a></li></ul><p>&nbsp;</p> ]]></content:encoded> <wfw:commentRss>http://blog.mailchimp.com/major-email-provider-trends-update-gmail-pretty-much-caught-up/feed/</wfw:commentRss> <slash:comments>11</slash:comments> </item> <item><title>Delivery Speed, Part 1</title><link>http://blog.mailchimp.com/delivery-speed-part-1/</link> <comments>http://blog.mailchimp.com/delivery-speed-part-1/#comments</comments> <pubDate>Mon, 25 Jul 2011 14:47:40 +0000</pubDate> <dc:creator>Matthew</dc:creator> <category><![CDATA[Deliverability]]></category> <category><![CDATA[Stats]]></category> <category><![CDATA[isp]]></category> <category><![CDATA[speed]]></category><guid isPermaLink="false">http://blog.mailchimp.com/?p=14216</guid> <description><![CDATA[Over the past year, I’ve seen MailChimp grow and grow. Along with all our new users, it seems like we see bigger and bigger lists every month.  In terms of email volume, our current daily average is now higher than our daily peak was one year ago.  To keep up with this explosion, we’re warming [...]]]></description> <content:encoded><![CDATA[<p>Over the past year, I’ve seen MailChimp grow and grow. Along with all our new users, it seems like we see bigger and bigger lists every month.  In terms of email volume, our current daily average is now higher than our daily peak was one year ago.  To keep up with this explosion, we’re warming up new IPs which means more queues and more connections for our users.  Instead of asking everyone to deal with longer wait times, we’re actually trying to speed things up.</p><p>That leads to a very interesting question… How are we doing?  After sifting through 500 or so IPs and crunching the numbers on over a quarter of a billion emails, I might have an answer.  There are graphs with colored lines and all kinds of explanations below, but within my data set one thing is true.  75% of the emails we receive are delivered within 5 minutes or less.  That’s pretty cool.</p><p><span id="more-14216"></span></p><h3>Begin Technical Babble</h3><p>Before I throw the charts at you, it might help if we went over a few basics of how MailChimp delivery works.  When you send a campaign, your list is divided up and distributed amongst our shared IP pool.  Each IP has a FIFO queue for outbound emails, and the size of these queues directly affects your delivery time.</p><p>Clearly, we should divide your list evenly amongst all our IPs.  That would give us the fastest delivery time for sure.  Yep, it sure would.  It’d be really fast.  Are you getting the feeling we don’t do that?  Good, now let me explain why it isn’t the best solution.</p><p>At this stage, your campaign looks a lot like a highway.  One of the things we like to do is match your subscriber&#8217;s activity rating with the reputation of our IP.  We&#8217;re putting your best subscribers in the fast lane so they have the best possible chance for a successful delivery.  Of course, this means we can’t divide your list evenly.</p><p>If you&#8217;re wondering why we don&#8217;t send your campaign over all of our IPs, I have a simple answer.  “Hell is other people.”  I’m pretty sure Sartre would approve of me borrowing that phrase.</p><p>You see, every now and then we get a bad apple.  Sometimes it’s accidental and sometimes it’s malicious, but these rogue apples can get our IPs <a href="http://kb.mailchimp.com/article/what-are-blacklists/" target="_blank">blocked</a>.  By optimizing the number of IPs that any one campaign touches, we protect all of our users from the odd mushy apple.</p><h3>More Complicated</h3><p>This is where the highway analogy starts to get out of control.  Not only is your list divided among several IPs, but each IP has a separate connection for every receiving domain in its queue.  The receiving domain is the ISP your subscriber uses, like @gmail.com or @hotmail.com.  <a href="http://mailchimp.com/features/segmentation/" target="_blank">It’s worth taking a look at your list and noting which domains you send to the most</a>.</p><p>The good news is that these connections can all send concurrently.  Of course, the ISPs themselves often throttle incoming email to their own preference.  You’ll notice in the charts below that one ISP in particular throttles heavily.</p><p>So it&#8217;s like there are different highways, but the lanes are kind of… No, it&#8217;s like each ISP is a different car manufacturer, and the speed limit is…  Okay, maybe if we all had flying cars and the toll booth was like a filter … Ugh, I honestly can&#8217;t think of a good way to picture this.  Feel free to make suggestions.</p><p>On top of all that mess, you&#8217;re not the only one sending a campaign.  Your emails are being queued along with everyone else who just hit the send button.  We do everything we can to minimize the queues, but there are certain times of day when our volume is off the chain.  It’ll make you think twice about the <a href="http://kb.mailchimp.com/article/can-i-schedule-a-campaign/" target="_blank">&#8220;schedule delivery&#8221;</a> feature.</p><h3>Actual Data</h3><p>I took two weeks of data from our pool of shared IPs and added them up by hour.  The first chart shows the volume of emails we sent.  You can see our heaviest hours are between 9am and noon (EST), but from experience, that range shifts back an hour depending on the time of year.</p><p>The next few charts measure the time interval between when an email was queued and when it was accepted for delivery by the email provider.  Keep that last part in mind.  It takes two to deliver.  We send the email to the ISP, and they deliver it to your subscriber.  The first part I can measure.  The second part is anyone’s guess.</p><p>You can see that 85% of the emails queued between 10:00am and 10:59am were sent within 5 minutes of being queued.  For Yahoo, it took 45 minutes to deliver the next 10% (looking at the 95% graph).  To send the next 4.5% (looking at the 95.5% graph) of Yahoo emails took a whopping 285 minutes.  Yikes!</p><p><a href="http://blog.mailchimp.com/delivery-speed-part-1/delivery-delta-volume/" rel="attachment wp-att-14217"><img class="size-medium wp-image-14217" title="Email Volume per Hour" src="http://blog.mailchimp.com/wp-content/uploads/2011/07/Delivery-Delta-Volume-477x300.png" alt="MailChimp Email Volume per Hour" width="477" height="300" /></a></p><p><a href="http://blog.mailchimp.com/delivery-speed-part-1/delivery-delta-75/" rel="attachment wp-att-14218"><img class="size-medium wp-image-14218" title="Time to Send 75% of Emails Received (per Hour)" src="http://blog.mailchimp.com/wp-content/uploads/2011/07/Delivery-Delta-75-477x300.png" alt="Time to Send 75% of Emails Received (per Hour)" width="477" height="300" /></a></p><p><a href="http://blog.mailchimp.com/delivery-speed-part-1/delivery-delta-85/" rel="attachment wp-att-14219"><img class="size-medium wp-image-14219" title="Time to Send 85% of Emails Received (per Hour)" src="http://blog.mailchimp.com/wp-content/uploads/2011/07/Delivery-Delta-85-489x300.png" alt="Time to Send 85% of Emails Received (per Hour)" width="489" height="300" /></a></p><p><a href="http://blog.mailchimp.com/delivery-speed-part-1/delivery-delta-95/" rel="attachment wp-att-14220"><img class="size-medium wp-image-14220" title="Time to Send 95% of Emails Received (per Hour)" src="http://blog.mailchimp.com/wp-content/uploads/2011/07/Delivery-Delta-95-477x300.png" alt="Time to Send 95% of Emails Received (per Hour)" width="477" height="300" /></a></p><p><a href="http://blog.mailchimp.com/delivery-speed-part-1/delivery-delta-99-5/" rel="attachment wp-att-14221"><img class="size-medium wp-image-14221" title="Time to Send 99.5% of Emails Received (per Hour)" src="http://blog.mailchimp.com/wp-content/uploads/2011/07/Delivery-Delta-99.5-477x300.png" alt="Time to Send 99.5% of Emails Received (per Hour)" width="477" height="300" /></a></p><h3>Notes</h3><p>Why don’t you see a graph for 100%?  Well, it turns out that a lot of lists contain one or two addresses that don’t exist or can’t receive email anymore.  The way we figure it, there’s always a chance.  We’ll try to get the ISP to accept the email for up to three days, and sometimes it actually works.  It makes my charts look horrifying though, so I cut the numbers off at 99.5%.  Problem solved.</p><p>You may have noticed that Yahoo loves to throttle email.  If your list has a lot of Yahoo addresses, you&#8217;ll want to take this into account.  For those looking at the “All” line, it’s simply the sum of all the emails together.  As the percent completion goes up, the last few thousand emails tend to be heavily weighted with Yahoo addresses.  The “All” line reflects this by inching up as well.</p><p>I&#8217;m pretty happy with these delivery times. For most ISPs, 95% of the emails in our queues are sent out in 5 minutes or less. It says we&#8217;ve done a good job at balancing reputation and speed. In the second part of this series, I&#8217;ll go over all the stuff that happens to your campaign before it ever hits the queue. It&#8217;ll be a lot like going behind the scenes at Universal Studios. There will be flames shooting up out of nowhere and you&#8217;ll see that Freddie is an awesome robot.</p><p>Go to <a href="http://blog.mailchimp.com/delivery-speed-part-2/">Delivery Speed, Part 2</a></p> ]]></content:encoded> <wfw:commentRss>http://blog.mailchimp.com/delivery-speed-part-1/feed/</wfw:commentRss> <slash:comments>6</slash:comments> </item> <item><title>Know Your Top Fives?</title><link>http://blog.mailchimp.com/know-your-top-fives/</link> <comments>http://blog.mailchimp.com/know-your-top-fives/#comments</comments> <pubDate>Fri, 13 May 2011 20:48:36 +0000</pubDate> <dc:creator>Ben</dc:creator> <category><![CDATA[Stats]]></category> <category><![CDATA[Using MailChimp]]></category><guid isPermaLink="false">http://blog.mailchimp.com/?p=13119</guid> <description><![CDATA[MailChimp's "Top Fives" show you some quick stats from your all time best campaigns.]]></description> <content:encoded><![CDATA[<p>Quick tip. Have you noticed, down in the bottom left corner of your MailChimp Dashboard, there&#8217;s a new(ish) module called &#8220;<strong>Top Fives</strong>&#8220;?  We launched this back when we <a href="http://blog.mailchimp.com/redesigning-the-mailchimp-app/" target="_blank">revamped the app</a>, but we never really talked about it:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2011/05/top-fives.jpg"><img class="alignnone size-full wp-image-13120" title="top-fives" src="http://blog.mailchimp.com/wp-content/uploads/2011/05/top-fives.jpg" alt="" width="434" height="395" /></a></p><p>It&#8217;s a quick way to see, across all the campaigns you&#8217;ve ever sent, which ones:</p><ul><li>Had the highest open rate of all time</li><li>Had the highest click rate of all time</li><li>Your most clicked links of all time (my personal favorite, because it helps me see what my readers are most interested in)</li></ul><p>&nbsp;</p> ]]></content:encoded> <wfw:commentRss>http://blog.mailchimp.com/know-your-top-fives/feed/</wfw:commentRss> <slash:comments>1</slash:comments> </item> <item><title>Effect of Social Networks on Email Engagement</title><link>http://blog.mailchimp.com/effect-of-social-networks-on-email-engagement/</link> <comments>http://blog.mailchimp.com/effect-of-social-networks-on-email-engagement/#comments</comments> <pubDate>Tue, 22 Feb 2011 16:15:25 +0000</pubDate> <dc:creator>Ben</dc:creator> <category><![CDATA[Emarketing, Business]]></category> <category><![CDATA[MailChimp Labs]]></category> <category><![CDATA[MailChimp News]]></category> <category><![CDATA[Stats]]></category> <category><![CDATA[Tips, Tricks, Best Practices]]></category><guid isPermaLink="false">http://blog.mailchimp.com/?p=11944</guid> <description><![CDATA[The link between social networks and email engagement.]]></description> <content:encoded><![CDATA[<p>We all know you shouldn&#8217;t <em>over</em> email your subscribers. But we also know that <a href="http://blog.mailchimp.com/subscriber-engagement-half-life/">within 4 months, your subscribers quit caring</a> (don&#8217;t take it personally &#8212; you&#8217;re just competing with everything else in the world for their attention). So how can you keep customers <strong><em>engaged</em></strong> with your brand, so that when you <strong><em>do</em></strong> send them emails, they actually open and click?</p><p>At MailChimp, we think the answer is <a href="http://twitter.com/mailchimp" target="_blank">Twitter</a>. Oh, and <a href="http://facebook.com/mailchimp" target="_blank">Facebook</a>. And <a href="http://mailchimp.posterous.com" target="_blank">Posterous</a>. And <a href="http://marketinglab.tumblr.com/" target="_blank">Tumblr</a>. And your <a href="http://blog.mailchimp.com">blog</a>(<a href="http://designlab.mailchimp.com" target="_blank">s</a>). And <a href="http://flickr.com/freddievonchimp" target="_blank">Flickr</a>. And <a href="http://youtube.com/mailchimp">YouTube</a>. And <a href="http://dribbble.com/designlab" target="_blank">dribbble</a>. And <a href="http://blog.mailchimp.com/use-flickr-and-dribbble-to-send-automatic-rss-emails/">RSS-to-email</a>.</p><p>You get the point. Try to create content that&#8217;s interesting and publish it everywhere, so customers can get to it (and share it) however they want. That way, when you actually send an email, your customers will still be engaged (maybe they remembered that funny video you shared on Facebook, or that really useful tool you linked to on Twitter).</p><p>Or <em>will</em> they still be engaged? Is there any data that can actually back that claim up? Why yes there is. So convenient of <span style="text-decoration: line-through;">me</span> you to ask&#8230;</p><p><span id="more-11944"></span></p><p>Ahem, can you tell we&#8217;re having fun with our shiny new <a href="http://blog.mailchimp.com/mailchimps-email-genome-project/">Email Genome Project</a>?</p><h3>Effect of Social Content on Subscriber Engagement</h3><p>In our latest research, we used the same query that generated the chart <a href="http://www.hubspot.com/thanks-for-registering-the-science-of-email-marketing" target="_blank">Dan Zarrella used in his Science of Email Marketing</a> report:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2011/02/no-social-content.jpg"><img class="alignnone size-medium wp-image-11945" title="all-engagement" src="http://blog.mailchimp.com/wp-content/uploads/2011/02/no-social-content-300x176.jpg" alt="" width="300" height="176" /></a></p><p>but this time, we only ran it on campaigns with social content in them (this would include the use of MailChimp&#8217;s social features like <a href="http://mailchimp.com/social">sharing links, Facebook like buttons, comments, tweet buttons</a>).</p><p>What we found was encouraging:</p><p><a rel="attachment wp-att-11946" href="http://blog.mailchimp.com/effect-of-social-networks-on-email-engagement/social-content/"><img class="alignnone size-medium wp-image-11946" title="social-content" src="http://blog.mailchimp.com/wp-content/uploads/2011/02/social-content-300x190.jpg" alt="" width="300" height="190" /></a></p><p>It seems that sending emails with social content helps people keep their subscribers engaged longer. Instead of a <em>drop</em> in average click rates, we actually see an <em>increase</em>.</p><p><em>Caveat: the sample size is much smaller in this study, because we&#8217;re only looking at data from one of our data centers (hundreds of thousands of emails, not billions). We&#8217;ll crunch more data soon!</em></p><p>Before analyzing this data, we wondered if this &#8220;social emails&#8221; graph might come out flatter than the previous one, but to see it move <em>upwards</em> is kind of encouraging. I wouldn&#8217;t dare suggest this means that adding &#8220;Tweet this&#8221; and &#8220;Like&#8221; buttons are going to jack up your email ROI. I think this means that marketers who are combining their email and social efforts are generally trying harder to engage. And that things aren&#8217;t as dismal as the &#8220;<a href="http://blog.mailchimp.com/subscriber-engagement-half-life/">Engagement Half-Life</a>&#8221; research seems, because you don&#8217;t have to choose between over-emailing and under-emailing. You just need to use different tools in different ways to talk to your different customers.</p> ]]></content:encoded> <wfw:commentRss>http://blog.mailchimp.com/effect-of-social-networks-on-email-engagement/feed/</wfw:commentRss> <slash:comments>3</slash:comments> </item> <item><title>Subscriber Engagement Half-Life</title><link>http://blog.mailchimp.com/subscriber-engagement-half-life/</link> <comments>http://blog.mailchimp.com/subscriber-engagement-half-life/#comments</comments> <pubDate>Fri, 18 Feb 2011 21:31:37 +0000</pubDate> <dc:creator>Ben</dc:creator> <category><![CDATA[Emarketing, Business]]></category> <category><![CDATA[MailChimp News]]></category> <category><![CDATA[Stats]]></category><guid isPermaLink="false">http://blog.mailchimp.com/?p=11924</guid> <description><![CDATA[After about 4 months, your average click rate for your average email subscriber drops to less than 1%.]]></description> <content:encoded><![CDATA[<p>If you weren&#8217;t able to attend Dan Zarrella&#8217;s Science of Email Marketing webinar, he <a href="http://www.hubspot.com/thanks-for-registering-the-science-of-email-marketing" target="_blank">posted his slides and video here</a>. There are some really interesting findings in that presentation, generated by analyzing over <em>9.5 billion</em> emails in our <a href="http://blog.mailchimp.com/mailchimps-email-genome-project/">Email Genome Project</a>. There&#8217;s stuff I never would&#8217;ve thought to ask, like &#8220;effect of time-of-day on unsubscribe rate&#8221; (slide 17).</p><p>But <strong><em>this</em></strong> is the stat I found most interesting (slide 45):</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2011/02/subscriber-recency.jpg"><img class="alignnone size-large wp-image-11925" title="subscriber-recency" src="http://blog.mailchimp.com/wp-content/uploads/2011/02/subscriber-recency-1024x742.jpg" alt="" width="553" height="401" /></a></p><p>After about 4 months, your average click rate for your average email subscriber drops to less than 1%.</p><p>We could talk about ways to keep people engaged longer, like sending more frequently (I think Mr. Zarrella recommends this in his presentation), sending less frequently, engaging with people on alternate channels (like Twitter and Facebook), and on and on. But 9.5 billion emails tell you something. You&#8217;ve basically got 4 months to entertain, delight, sell, and make your point to subscribers. More importantly, you need to do something awesome enough to keep feeding in new subscribers, because the churn might be faster than you think.</p> ]]></content:encoded> <wfw:commentRss>http://blog.mailchimp.com/subscriber-engagement-half-life/feed/</wfw:commentRss> <slash:comments>22</slash:comments> </item> <item><title>Measuring Deliverability</title><link>http://blog.mailchimp.com/measuring-deliverability/</link> <comments>http://blog.mailchimp.com/measuring-deliverability/#comments</comments> <pubDate>Thu, 03 Feb 2011 17:55:11 +0000</pubDate> <dc:creator>Chad</dc:creator> <category><![CDATA[Deliverability]]></category> <category><![CDATA[MailChimp News]]></category> <category><![CDATA[Stats]]></category><guid isPermaLink="false">http://blog.mailchimp.com/?p=11566</guid> <description><![CDATA[[Update from Ben: 02/08/2011] We wrote this blog post to show that current self-reported &#8220;deliverability scores&#8221; and &#8220;inbox rates&#8221; are hard to believe. You have to take the ESP&#8217;s word for it that they get &#8220;99% to the inbox&#8221;. What we need is a truly independent scoring system that anybody can use to verify ESP [...]]]></description> <content:encoded><![CDATA[<p><strong>[Update from Ben: 02/08/2011]</strong> We wrote this blog post to show that current self-reported &#8220;deliverability scores&#8221; and &#8220;inbox rates&#8221; are hard to believe. You have to take the ESP&#8217;s word for it that they get &#8220;99% to the inbox&#8221;. What we need is a truly independent scoring system that anybody can use to verify <em>ESP</em> deliverability claims. We thought we found that (or got pretty darn close) in ReturnPath&#8217;s SenderScore.</p><p>The first few comments we got were understandably furious. But eventually, the conversation changed. We think we were on the way to a very constructive discussion. I really enjoyed the dialogue I had with people offline as a result of all this, and I want to thank all the email companies who commented here &#8212; CritSend, CampaignMonitor, PostMarkApp, and Al Iverson&#8217;s A-1 Super Awesome Home DSL Email Service. <img src='http://blog.mailchimp.com/wp-includes/images/smilies/icon_smile.gif' alt=':-)' class='wp-smiley' />   I mean, don&#8217;t get me wrong. We&#8217;re competitors. We&#8217;re not going to be singing Kumbaya around the campfire with each other any time soon. It&#8217;s just nice talking to people who know their stuff. I wish the discussion could continue.</p><p>But my patience has been worn down. ReturnPath is naggi&#8212;asking me politely to take this post down, because they &#8220;don&#8217;t want to arbitrate arguments between their partners.&#8221; [I didn't realize we were asking them to arbitrate] I suggested that, as an independent, unbiased scoring system, they should just do what I do: ignore the bastards. Actually, I suggested the complainers needed to &#8220;grow some&#8221; and that ReturnPath ought to tell them so. But that&#8217;s not how ReturnPath rolls (thankfully, I guess).</p><p>Anyway, some of the arguments we heard about our posted methodology seemed to go like this: &#8220;Your methodology is flawed, because SenderScore penalizes IP addresses that send very low volumes, and that don&#8217;t have a high reputation. For example, I have an IP address that has GREAT inbox rates (um, trust me) but that have a low SenderScore.&#8221;</p><p>Well, yes. We know that low-volume, low-reputation IPs can get great deliverability.</p><p>Buuuut we happen to think that an ESP&#8217;s very job is to send high volumes of email while simultaneously maintaining a good IP reputation. We send out tons of email through our infrastructure, 24/7. If it were a race car engine, SenderScore&#8217;s our tachometer. Does it show actual vehicle speed? No. But it&#8217;s extremely indicative of engine performance. If we see our SenderScore drop from 94 to 70, there&#8217;s a problem with the engine. It&#8217;s time to pull over and get that deliverability fixed.</p><p>So to people who say &#8220;SenderScore is a bogus number&#8221; we respectfully disagree. It may not work for all senders, but it works for ESPs. The ones who send high volume. And want to measure their reputation.</p><p>Obviously, I am not concerned with what other ESPs think, or how they respond. But personally, I think that ReturnPath&#8217;s naggi &#8212; um, polite requests for me to pull this blog post is actually going to work against them. I think they&#8217;re defending the very people who are disputing the validity of SenderScore. On the one hand, that concerns me. On the other hand, I&#8217;ve always appreciated irony. And I absolutely hate the blinking red voicemail light on my office phone.</p><p>So this awesome blog post, which attempted to highlight the usefulness of ReturnPath&#8217;s SenderScore, is now officially yanked &#8212; at the request of ReturnPath.</p> ]]></content:encoded> <wfw:commentRss>http://blog.mailchimp.com/measuring-deliverability/feed/</wfw:commentRss> <slash:comments>38</slash:comments> </item> <item><title>Research: Spammy Email Design Mistakes</title><link>http://blog.mailchimp.com/research-spammy-email-design-mistakes/</link> <comments>http://blog.mailchimp.com/research-spammy-email-design-mistakes/#comments</comments> <pubDate>Wed, 13 Oct 2010 18:11:34 +0000</pubDate> <dc:creator>Ben</dc:creator> <category><![CDATA[Abuse Desk Stories]]></category> <category><![CDATA[Deliverability]]></category> <category><![CDATA[Email Design]]></category> <category><![CDATA[Spam Topics]]></category> <category><![CDATA[Stats]]></category> <category><![CDATA[Tips, Tricks, Best Practices]]></category> <category><![CDATA[spam]]></category><guid isPermaLink="false">http://blog.mailchimp.com/?p=10421</guid> <description><![CDATA[We've been experimenting with crowdsourcing the review of outgoing campaigns from MailChimp's servers.  Within the first 3 days, after sending roughly 7,000 email campaigns over to be reviewed, we ended up with some unexpected, yet fascinating results.]]></description> <content:encoded><![CDATA[<p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/dark-side-of-the-can.png"><img class="alignright size-full wp-image-10431" style="border: 0pt none; margin: 5px;" title="dark-side-of-the-can" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/dark-side-of-the-can.png" alt="dark-side-of-the-can" width="169" height="167" /></a>We recently experimented with <a title="Define in Wikipedia" href="http://en.wikipedia.org/wiki/Crowdsourcing" target="_blank">crowdsourcing</a> the review of outgoing campaigns from MailChimp&#8217;s servers. Normally, if our <a href="http://blog.mailchimp.com/omnivore">Omnivore</a> algorithms detect something suspicious about a campaign, we&#8217;ll automatically suspend the account and follow up with a review by our internal Compliance Team. But we&#8217;ve been testing the idea of <em>also</em> sending the campaign to Amazon&#8217;s <a href="https://www.mturk.com/mturk/welcome" target="_blank">Mechanical Turk</a> service for manual review by humans. We simply showed the email to a &#8220;turker&#8221; and asked them, &#8220;Is this spam?&#8221;</p><p>The experiment only involved sending roughly 7,000 email campaigns over to be reviewed. But within the first 2 days, we started getting back some unexpected, yet fascinating results.</p><p>In particular, there were certain email templates that kept getting repeatedly flagged as spam by these human reviewers, <em><strong>even though they weren&#8217;t spam at all</strong></em>.</p><p>All these &#8220;false positives&#8221; had some common design traits, so we thought we should share our findings&#8230;</p><p><span id="more-10421"></span></p><h2>How Did The Experiment Work?</h2><p>When Omnivore detected an email that had traits of potential abuse, we sent it to Mechanical Turk. A copy of the email (sans private data, like recipient information) was displayed inside of an interface that looked something like this:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/crowdsourced-review-ui-experiment.jpg"><img class="alignnone size-medium wp-image-10435" title="crowdsourced-review-ui-experiment" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/crowdsourced-review-ui-experiment-209x300.jpg" alt="crowdsourced-review-ui-experiment" width="209" height="300" /></a></p><p>In general, we listed some rules at the top, then presented the campaign below it, then asked the reviewer to tell us if the email violated any of the listed rules, back at the top of the page. User Interface snobs will notice that in general, this interface looks like it was QWERTY-fied (designed to slow users down a little). We could&#8217;ve used very simple &#8220;Is this spam? Yes/No&#8221; buttons, but you don&#8217;t want people judging <em>too </em>fast.</p><h3>How Effective Was The Experiment?</h3><p>The experiment went as well as you&#8217;d expect, using people who weren&#8217;t  heavily trained on the intricacies of permission-based email marketing.  Generally speaking, Turkers like to work fast, so they&#8217;re best for picking  out the most egregious offenders (think along the lines of porno or  pharma spam). To that end, they&#8217;re great at catching the really evil spammers who try to penetrate into our system and send extremely bad stuff that would jeopardize our deliverability.</p><p>But when it came to reviewing an email from, say, a  reputable business that purchased a not-so-reputable list from a local  chamber of commerce, the reviewers experienced some difficulty. So crowdsourcing is good, but not a silver bullet with respect to abuse prevention (we are still crowdsourcing, but the experiment has changed significantly).</p><p>Though we weren&#8217;t thrilled with the initial results, this exercise revealed a lot about how people look at email design.</p><h2>21 Seconds To Decide</h2><p>Mechanical Turk measures how much time people spend performing each review, so we can tell when people are just clicking random stuff and moving on to their next task. On average, the human reviewers spent only <strong>21 seconds</strong> reviewing these &#8220;false positive&#8221; emails. Now, we can&#8217;t read their minds, so there&#8217;s no reliable way of telling if they bothered to check for &#8220;permission reminders&#8221; or &#8220;CAN-SPAM compliance&#8221; in the footers. But it&#8217;s safe to say they weren&#8217;t doing a very thorough analysis. I&#8217;d wager that most of that 21 seconds was spent reading the criteria at the top of the interface, and <em>not</em> the email itself. They definitely weren&#8217;t visiting the senders&#8217; websites to see if there was a proper signup form, and testing to see if they used opt-in best practices. They were making relatively quick, gut-level decisions on whether or not an email &#8220;looked spammy.&#8221;</p><h2>The False Positives</h2><p>Below are some email designs that kept getting marked as spam by Mechanical Turk reviewers. Keep in mind that at the time of this experiment, none of the senders of these emails were determined to be abusive. Their email stats suggested they were sending permission-based emails. Their <em>recipients</em> probably knew the emails were legit &#8212; but our independent reviewers did not.</p><h3>1. Want to learn Photoshop?</h3><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/learn-chinese.png"></a><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/learn-chinese_spammed.jpg"><img class="alignnone size-medium wp-image-10423" title="learn-chinese_spammed" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/learn-chinese_spammed-300x278.jpg" alt="learn-chinese_spammed" width="300" height="278" /></a></p><p>In general, I think the above email has got some layout issues that make it look a bit sloppy. Their images are breaking the template. At the top, where people are accustomed to seeing a logo, the sender only used text. In fact, the text isn&#8217;t even the company&#8217;s name, but a bright red &#8220;salesy&#8221; kind of question: &#8220;<span style="color: #ff0000;"><strong>Want to learn Japanese or Chinese?</strong></span>&#8221; Doesn&#8217;t exactly inspire confidence that you know your recipient, or what he&#8217;s interested in. Unfortunately, the Chinese characters don&#8217;t help their reputation much either. We&#8217;ve all received a bit too much of this in our inbox:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/chinese-spam.jpg"><img class="alignnone size-medium wp-image-10451" title="chinese-spam" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/chinese-spam-300x164.jpg" alt="chinese-spam" width="300" height="164" /></a></p><h3></h3><h3>2. The Red Flyer</h3><p>I&#8217;m sure that loyal customers of this local pizzeria were happy to get an offer for a free t-shirt:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/pizza-deals_spammed.gif"><img class="alignnone size-medium wp-image-10424" title="pizza-deals_spammed" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/pizza-deals_spammed-210x300.gif" alt="pizza-deals_spammed" width="210" height="300" /></a></p><p>But I don&#8217;t think our human reviewers liked the &#8220;hyperlink blue&#8221; verdana font, then the giant red &#8220;FREE&#8221; text below that (then the green text below that, then the blue text below that, then the gray text below that). Something about this email made it look more like a stock template for a flyer, not an email newsletter to loyal customers. I couldn&#8217;t help but think that the scrunched up airplane logo looked like those images that spammers try to skew, in order to get around anti-spam filters who scan the content of images:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/skewed-image-spam1.jpg"><img class="alignnone size-medium wp-image-10461" title="skewed-image-spam" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/skewed-image-spam1-300x278.jpg" alt="skewed-image-spam" width="300" height="278" /></a></p><p>Aside from the image quality issues, some extra copy could&#8217;ve been added to demonstrate that this email was being sent to their customers. Don&#8217;t get me wrong. T-shirt giveaways can be  extremely effective (here are <a href="http://blog.mailchimp.com/twitter-for-promos-without-being-a-dbag/">some stats to prove it</a>), but you should probably do more than just yell &#8220;FREE T-SHIRT!&#8221;</p><p>At the very least, an image of the actual t-shirt seems in order.</p><p>Here&#8217;s <a href="http://us1.forward-to-friend.com/forward/preview?u=fdb31f79c140bd0e11d1f8aa0&amp;id=871120fcfa" target="_blank">a nice example from ScoutMob</a>:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/scoutmob-shirts.jpg"><img class="alignnone size-medium wp-image-10466" title="scoutmob-shirts" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/scoutmob-shirts-273x300.jpg" alt="scoutmob-shirts" width="273" height="300" /></a></p><h3>3. Not Plain Enough Text</h3><p>This email repeatedly got marked as spam by our reviewers:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/event-spammed.gif"><img class="alignnone size-medium wp-image-10425" title="event-spammed" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/event-spammed-221x300.gif" alt="event-spammed" width="221" height="300" /></a></p><p>You&#8217;ll notice it has no images. No branding, no logos, no photos.</p><p>Yes, one could make the case that plain, old-fashioned, text-only emails can be more personal, and therefore more effective under some circumstances.</p><p>But if you&#8217;re gonna go all-text, you need to go all the way, baby. Centered text, colored backgrounds, and colored borders look like you&#8217;re going for an HTML email look. But when you fail to include any logos or images, it looks half-baked. Like a spammer, getting all &#8220;Rich Text:&#8221;</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/not-alltext-spam1.jpg"><img class="alignnone size-medium wp-image-10462" title="not-alltext-spam" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/not-alltext-spam1-300x174.jpg" alt="not-alltext-spam" width="300" height="174" /></a></p><p>Even if you don&#8217;t have a logo, one way of showing your brand is to include your website&#8217;s domain. But this sender used the bit.ly URL shortener instead:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/bitly-zoom.jpg"><img class="alignnone size-full wp-image-10473" style="border: 1px solid black; margin: 5px;" title="bitly-zoom" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/bitly-zoom.jpg" alt="bitly-zoom" width="272" height="205" /></a></p><p>In their defense, that&#8217;s probably because the link to the event they&#8217;re promoting was really long or something (webinar links get that way sometimes). The problem is that spammers are known to hide malicious links behind reputable URL shorteners (see: <a href="http://blog.mailchimp.com/url-shorteners-and-blacklists/">URL Shorteners and Blacklists</a>), so that helpful little link just ends up hurting them.</p><h3>4. Read it and Weep</h3><p>This one was actually surprising to me, because I thought it was well designed:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/tracey_spammed.gif"><img class="alignnone size-medium wp-image-10426" style="border: 1px solid black; margin: 5px;" title="tracey_spammed" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/tracey_spammed-168x300.gif" alt="tracey_spammed" width="168" height="300" /></a></p><p>The title font even looks customized (it&#8217;s not arial, it&#8217;s not verdana, and it&#8217;s <a href="http://blog.mailchimp.com/scientific-proof-comic-sans-sucks-for-email/">certainly not comic sans</a>). It&#8217;s laid out pretty nicely. The pink is a custom color, too. The only possible problem that I can see is that it&#8217;s extremely text-heavy, with zero images. To the untrained eye, it <em>almost</em> falls into that &#8220;not plain-enough text&#8221; category above, but this doesn&#8217;t look half-baked or sloppy at all to me. This email shows signs of actual craftsmanship and skill with typography (<a href="http://www.informationarchitects.jp/en/the-web-is-all-about-typography-period/" target="_blank">web design <em>is</em> 95% typography, right</a>?). This sender&#8217;s subscribers are probably fine with all this text (the sender is an author, after all). But to our independent reviewers, this email apparently looked pretty spammy. In this case, I personally wouldn&#8217;t change my design or behavior. If I<em> had</em> to make recommendations, I&#8217;d consider adding elements that made it look more &#8220;newslettery.&#8221; Perhaps a small avatar of the author could be worked into the template&#8217;s footer, or some &#8220;share this on social sites&#8221; icons. If this is all about the written word, and images are forbidden, <a href="http://bibliodyssey.blogspot.com/2008/02/ornamental-typography.html" target="_blank">text can be ornamental too</a>.</p><h3>5. Set it and Forgot it</h3><p>Senders that used one of our stock RSS-to-email templates seemed to get flagged the most:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/terry-spammed.gif"><img class="alignnone size-medium wp-image-10427" style="border: 1px solid black; margin: 5px;" title="terry-spammed" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/terry-spammed-242x300.gif" alt="terry-spammed" width="242" height="300" /></a></p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/conservation-spammed.jpg"><img class="alignnone size-medium wp-image-10428" style="border: 1px solid black; margin: 5px;" title="conservation-spammed" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/conservation-spammed-198x300.jpg" alt="conservation-spammed" width="198" height="300" /></a></p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/ideation-spammed.gif"><img class="alignnone size-medium wp-image-10429" style="border: 1px solid black; margin: 5px;" title="ideation-spammed" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/ideation-spammed-205x300.gif" alt="ideation-spammed" width="205" height="300" /></a></p><p>As I write this article, we&#8217;re actually working on tweaking this template so that the header is more customizable (forcing the title to be ALL CAPS, in retrospect, was <a href="http://blog.mailchimp.com/kb/article/how-spam-filters-think/">not a great idea</a>).</p><p>But many of the bloggers who used this template didn&#8217;t bother customizing the RSS merge tags any further to include images from their posts. They didn&#8217;t customize the fonts, link colors, or anything at all, it seems.</p><p>I also wonder if, in some cases, the Table of Contents was so large, our independent reviewers didn&#8217;t bother scrolling down to look for real content. All they saw was a bunch of nonsensical looking TOC links. This happens if you update your blog frequently, but you schedule your RSS-to-email campaign to go out in weekly or monthly batches. Not that I&#8217;d change my behavior just for random Mechanical Turk reviewers. What your subscribers want is more important.</p><p>But there&#8217;s a broader lesson here on image vs. text balance. A similar example plucked from my spam folder in Gmail:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/10/thermal-africa-society.gif"><img class="alignnone size-medium wp-image-10468" title="thermal-africa-society" src="http://blog.mailchimp.com/wp-content/uploads/2010/10/thermal-africa-society-291x300.gif" alt="thermal-africa-society" width="291" height="300" /></a></p><h3>Why this is important to email marketers</h3><p>When you send a lot  of email marketing,  even to a totally permission-based double opt-in  list, you&#8217;re <em>going</em> to  get some spam complaints from your recipients. It&#8217;s inevitable. Sometimes,  it&#8217;s because they&#8217;re too  lazy to click your unsub link, they think the &#8220;spam&#8221; button <em>is</em> the unsub link, or sometimes  it&#8217;s because they forgot  signing up to your list (maybe because you  send infrequently, like me).</p><p>And sometimes, when your email is marked  as spam, a human from  an ISP, or a human from an anti-spam  organization, will  actually do a manual review of your email (See: <a href="../whos-secretly-reading-your-emails/">&#8220;Who&#8217;s secretly reading your emails?&#8221;</a>). Some anti-spam organizations use <em>volunteers</em>, who are driven  by passion more than pay (nothing wrong with that, but you have to wonder how detailed their training is). We&#8217;ve experienced enough <em>&#8220;your  client&#8217;s email has been reviewed by our team, and determined to be spam,  so we&#8217;re blocking your IP range&#8221;</em> situations to know that those reviewers don&#8217;t  always do a thorough analysis of your list management practices (not part of their job description anyway). This  is partly why our own terms of use seem so strict to some. ISPs get  complaints, they look at your email, and they make a split-second  decision to &#8220;blacklist or not.&#8221;</p><p>So even if you do your list  management right, and you design everything perfectly around your  subscribers&#8217; expectations, we always recommend that you give some consideration to this  &#8220;secret&#8221; audience that also reads your email (See: <a href="../what-makes-a-good-permission-reminder/">&#8220;What makes a good permission reminder?&#8221;</a>). Don&#8217;t bend over backwards for them, or anything.</p><p>It&#8217;s kind of like how your mother always told you to <a href="http://www.youtube.com/watch?v=LVHXkqW8qKk" target="_blank">wear clean underwear</a>, &#8220;in case you&#8217;re in an accident.&#8221; Take a good look at your email templates, and ask yourself, &#8220;If my email got reported as spam, and some <a href="http://www.spamcop.net/" target="_blank">spamcop</a> laid his eyes on it, what would they think? Would mom be proud?&#8221;</p><p><strong>Related:</strong></p><ul><li><a href="http://blog.mailchimp.com/how-your-email-design-can-get-you-blacklisted/">How your email design can get you blacklisted</a></li><li><a href="http://blog.mailchimp.com/articles/stupid-html-email-design-mistakes/">Stupid Email Design Mistakes</a></li><li><a href="http://resources.mailchimp.com/how-to-avoid-spam-filters">How to avoid spam filters</a> (the non-human kind)</li><li><a href="http://blog.mailchimp.com/want-700000-html-email-templates/">Want 700,000 HTML email templates?</a> (more fun w/Mechanical Turk)</li><li><a href="http://blog.mailchimp.com/is-your-email-marketing-human/">Is your email marketing human?</a></li></ul> ]]></content:encoded> <wfw:commentRss>http://blog.mailchimp.com/research-spammy-email-design-mistakes/feed/</wfw:commentRss> <slash:comments>33</slash:comments> </item> <item><title>New EepURL Sharing Activity Stats</title><link>http://blog.mailchimp.com/new-eepurl-activity-stats/</link> <comments>http://blog.mailchimp.com/new-eepurl-activity-stats/#comments</comments> <pubDate>Mon, 20 Sep 2010 11:01:38 +0000</pubDate> <dc:creator>Ben</dc:creator> <category><![CDATA[MailChimp News]]></category> <category><![CDATA[Social]]></category> <category><![CDATA[Stats]]></category> <category><![CDATA[Using MailChimp]]></category> <category><![CDATA[v5.3]]></category><guid isPermaLink="false">http://blog.mailchimp.com/?p=10055</guid> <description><![CDATA[New eepURL activity stats track sharing activity of your campaigns. Kinda like your own bit.ly, but for email marketing.]]></description> <content:encoded><![CDATA[<p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/09/magnifique.jpg"><img class="alignright size-thumbnail wp-image-10056" style="border: 1px solid black; margin: 5px;" title="magnifique" src="http://blog.mailchimp.com/wp-content/uploads/2010/09/magnifique-150x150.jpg" alt="magnifique" width="150" height="150" /></a>In February of 2009, we <a href="http://blog.mailchimp.com/eepurl-launched-in-mailchimp-labs/">launched eepURL</a>, a custom URL shortening service that would ultimately be integral to <em>all</em> of <a href="http://blog.mailchimp.com/social">MailChimp&#8217;s social tracking and measurement features</a>. A lot of people asked &#8220;why another URL shortening service?&#8221; especially  when there are so many others out there, like bit.ly, with even <em>more</em> tracking  functionality, and used more openly. Turns out having a closed,  proprietary system was a  good thing for deliverability (see: <a href="http://blog.mailchimp.com/url-shorteners-and-blacklists/">URL shorteners and blacklists</a>).</p><p>Besides, our plan all along was to  keep adding more email-specific tracking functionality and visualization to eepURL anyway&#8230;</p><p><span id="more-10055"></span></p><p>With <a href="http://blog.mailchimp.com/v5-3">MailChimp v5.3</a>, we added some nice visualization to your campaign&#8217;s eepURL sharing activity.</p><p>Whenever people share your campaign&#8217;s eepURL via twitter, Facebook, or their blog, or anywhere, we&#8217;ll show you where on the planet their friends clicked:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/09/magnifique-xlarge.jpg"><img class="size-medium wp-image-10057 alignnone" title="magnifique-xlarge" src="http://blog.mailchimp.com/wp-content/uploads/2010/09/magnifique-xlarge-300x161.jpg" alt="magnifique-xlarge" width="300" height="161" /></a></p><p>we&#8217;ll also show you the aggregate clicks on your eepurl:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/09/aggregate-eepurl-clicks.jpg"><img class="alignnone size-medium wp-image-10058" title="aggregate-eepurl-clicks" src="http://blog.mailchimp.com/wp-content/uploads/2010/09/aggregate-eepurl-clicks-300x223.jpg" alt="aggregate-eepurl-clicks" width="300" height="223" /></a></p><p>and the top 10 referrers:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/09/top-10-referrers.jpg"><img class="alignnone size-medium wp-image-10059" title="top-10-referrers" src="http://blog.mailchimp.com/wp-content/uploads/2010/09/top-10-referrers-300x141.jpg" alt="top-10-referrers" width="300" height="141" /></a></p><p>Think of the new stats as having your own little bit.ly, but for your email marketing campaigns.</p><p>You&#8217;ll find them under the social stats screen within your campaign reports:</p><p><a href="http://blog.mailchimp.com/wp-content/uploads/2010/09/social-sats.jpg"><img class="alignnone size-medium wp-image-10062" title="social-sats" src="http://blog.mailchimp.com/wp-content/uploads/2010/09/social-sats-300x94.jpg" alt="social-sats" width="300" height="94" /></a></p> ]]></content:encoded> <wfw:commentRss>http://blog.mailchimp.com/new-eepurl-activity-stats/feed/</wfw:commentRss> <slash:comments>8</slash:comments> </item> </channel> </rss>
<!-- Performance optimized by W3 Total Cache. Learn more: http://www.w3-edge.com/wordpress-plugins/

Minified using disk: basic
Page Caching using disk: enhanced
Object Caching 638/742 objects using disk: basic

Served from: blog.mailchimp.com @ 2012-02-09 01:05:35 -->
