We first launched our Inbox Inspector tool in May 2007. It was pretty revolutionary at the time (ahem, imho) to be offering a “one-click” testing service like this to the masses. Unfortunately, it also seemed fairly expensive to most people. $39 for three tests seemed high (still, much cheaper than an embarrassing email design mistake). Over the years, we kept reducing its price, eventually whittling it down to under $5 per test.
But we’re pretty excited to announce that we’re now making Inbox Inspections totally free…
In order to make this happen, we had to make some big changes. So if you’re a heavy user of this feature, you’ll want to read all the details below. Also, there’s a slight catch to all this, but dont’ worry: it’s only temporary (more on that below too).
10 Most Used Email Programs
In general, running an Inbox Inspection works the same as always. You build your campaign, then hit the “run inspection” button:
You’ll notice there’s no more “you have x number of inspections remaining” and there’s no upsell option to “buy more inspections.” That’s because they’re free now (duh).
The campaign previews are being processed by a new service provider, Litmus. Because of some differences to the way their API works, you’ll probably notice that everything feels a little zippier than before.
After you click the “Run Inbox Inspection” button, you get this:
That’s the first big change. Before, we just generated a ton of screenshots. It was cool to see how your email looks in all kinds of crazy email apps around the world, but if nobody on my list checks email from Japan’s “Goo” client, I really don’t want to deal with (or wait for) that particular screenshot. I really just want to know what my email looks like in the most popular email programs for my subscriber list. So now, MailChimp uses that cool user-agent report (launched last July) to determine what the 10 most used email programs are for your list.
And those are the 10 screens we show by default.
For one of my campaigns, the 10 most popular email programs in all the different variations provided by Litmus yielded 32 screenshots:
For example, you get all the different variations of Outlook 2003 you’d expect:
with images on, images off, plus what it looks like inside the preview pane (with images on/off).
Full Program Views
Previously, we showed you only the email portion, and had a dotted line where it was cut off on the screen. Now, you get a “full program” view of what it looks like inside the email app. In the case of Hotmail, which extracts Youtube clips and displays them separately from your email (um, at the top), this makes a huge difference:
Explorer vs. Firefox
For webmail apps, like Gmail, Hotmail, etc., we now display what it looks like in both Internet Explorer and Firefox:
Apple Mail (hallelujah)
Inbox Inspections now include Apple Mail, too:
Web-based Views
And you’ll notice a variant where we display how your email’s subject line looks within the inbox of different email programs:
Above, you can see where my subject gets cut off by Gmail.
Manual Override
If you have the need to see your email rendered in some other email program (let’s say I wanted to check Lotus Notes or the iPad), there’s a “manual client selection” checkbox:
which expands to reveal all your different options. Keep in mind that in any given inspection that you run, we’ll only do 10 at a time. If you want more reports, they’re still free, but you’ll have to run them manually again. I’ll be honest with you: this is solely to keep that delicate balance between freemium and moochium in check. This is free for you, but not free for us.
New Previews and Spam Filter Checks
Here’s a list of all the campaign previews available:
- Outlook 2007
- Outlook 2003
- Yahoo! Mail (Explorer)
- Yahoo! Mail (Firefox)
- Android 2.2Gmail (Firefox)
- Hotmail (Explorer)
- Apple Mail 4
- Hotmail (Firefox)
- iPhone
- Plain Text
- Symbian S60
- Thunderbird 2.0
- Thunderbird 3.0
- Outlook 2010
- Me.com (Firefox)
- Outlook 2000
- Outlook 2002/XP
- Windows Mobile 6.5
- Gmail (Explorer)
- BlackBerry Text
- BlackBerry HTML
- AOL Mail (Firefox)
- Apple Mail 3
- iPad
- Lotus Notes 7
- Lotus Notes 8
- Lotus Notes 8.5
- Lotus Notes 6.5
- AOL Mail (Explorer)
And here are all the spam filter checks available:
- Gmail
- Outlook
- Barracuda
- MessageLabs
- Postini
- Mail.com
- FastMail
- Hushmail
- Lycos
- Mobile Me
- GMX
- Yahoo! Mail
Smart Folder Under /Reports
Under the Reports section in your account, you’ll see a new smart folder, where we store all your Inbox Inspections in one convenient place:
And We’re Not Done Yet
For now, Inbox Inspections are free so long as you’re a customer on a monthly plan or if you’re a Creative Agency Partner. Yeah, we know. But we had to do it this way, because of time constraints (on our part). Long term, we want users to know that our plan is to bundle the Inbox Inspector with our free Delivery Doctor feature, and to make this a comprehensive testing suite that’s available as an a la carte feature for pay-as-you-go (PAYG) customers too. For now, any PAYG or monthly user that had Inbox Inspection credits in their account will see them converted to Monkey Rewards points, which can be used to buy email credits (or you can save the points to buy inspections when they’re available for you again).










Wait…so…those of us on PAYG plans won’t have any access to Inbox Inspections anymore, or will they just be the old version?
Until we create the a la carte option, PAYG users won’t have access to campaign previews. Sorry for the inconvenience. There are a bazillion different situations we have to program for (like what happens to inspections when a monthly user switches to PAYG, etc) that we have to figure out, so coding around pricing plans is often the most complex part of launching our new features. We’re working on it, though. This isn’t ideal, but it’s possible to get previews directly from Litmus for now: http://litmus.com/pricing
I’m also on a the PAYG option.
The agency I work for (understandably) prefers it that way as it’s easier to bill to our clients.
So it sounds like we’ll be losing our ability to test through Mail Chimp until you’ve devised an a la carte Inbox Inspection option. Am I understanding that right?
Is there a time line on how long that will be?
It feels a bit like the PAYG customers are getting the rug pulled out from under them.
The new features Litmus will offer do look nice however.
If you’re a creative agency, you should actually apply to become a partner. Inspections will still be available, even if you’re a PAYG customer, and you get a 15% discount. So that would be like a really really cool rug getting inserted back under you(?)
I did not know about that partnership. Thanks for the tip Ben!
I have applied for it today.
Is this not live yet?
All the features for our April release were launched today:
http://blog.mailchimp.com/new-features-going-live/
but might take up to 2 days to propagate to all 700k accounts across our different data centers.
Just tried to give the inbox inspection tool a try and it’s still asking me to buy credits. Our account is a (non-profit) monthly account if that matters.
The feature hasn’t gone live in your account yet. Check back in later (it could take till tomorrow afternoon).
You guys take such good care of us. :D
so. fast.
The Litmus thing is good news as I’ve been using them for a while now, do you think you’ll start introducing some of their other features eg. skim read / print etc.
http://litmus.com/email-analytics
I like the improvements I’m reading about. I’m just disappointed about the impact on PAYG customers. I thought the fee was reasonable before (I used it only on new templates, so it was infrequent. Wasn’t it like $13 per?), and it appears that it’s now $49 per test for PAYG customers.
Overall I still think MailChimp offers a great value, and am hopeful that the a la carte option brings the price back down to the level it was before.
Hi Brian, it was actually $14 for 3 tests. Depending on the size of your list, some people are actually making out better by switching to a $10/month plan, and getting all their inspections free. Still, we’re working on an a la carte option.
Amazing, thank you for this, inbox inspections were burning a hole in our budget!
You guys are one of the only sites that takes the user experience seriously–and remembers that it loves its users, selling us on what we love rather than what you wish we loved. Thank you so much for being awesome. Continually.
Something which is not mentioned at all:
European ISP campaign previews have disappeared (like e.g. belgacom skynet) from the new version
again mailchimp forgets about it’s international customers.
Hello! I’m sorry to hear MC no longer sells Inbox Inspections. Litmus is probably a great service but they have no pay-as-you-go plans! They charge $49/month for unlimited inspections which is pretty pricey if you are like me and only send one or two emails per month. I’m hoping MailChimp can somehow get a special deal for us MC customers where we can still buy 1 or 3 inspections at a time, even if we have to pay a little more for each inspection. Thanks!
That’s in the works. This was only a temporary situation to get the feature live.
[...] it’s enabled.$3 Inbox InspectionsIn case you missed it, we recently announced that we made Inbox Inspections feature free for all monthly users. Many thanks to Litmus for helping us make this possible. At the time though, the feature was [...]
Hi all, the Inbox Inspections are now available for PAYG users for $3 per inspection:
http://blog.mailchimp.com/may-release-socialpro-returns-payg-inbox-inspections-ui-improvements/
(note: one $3 inspection includes testing across something like 30+ email apps and spam filters)
thanks for your patience!
@laurakalbag @chriscomben right you are! the latest version of our Inbox Inspector is based on @Litmusapp - http://t.co/44YHi0R
I have reviewed more campaign systems then I care to in terms of ease of use, bells and whistles, effectiveness and value.
MailChimp.com in my opinion is the best monkey hands over monkey tails better then anyone I have seen. I am very happy with them, and it just gets better and better. Great Addition to the Chimp Arsenal!
Sincerely
RJ Suitor
I’d missed this from @mailchimp http://t.co/LxMIIdv What brilliant service!
MailChimp Inbox Inspections Now Free http://t.co/nr8UO7Z
MailChimp: Inbox Inspections Now Free http://bit.ly/oLCRkD Or $3 for Pay-as-you-go customers. That’s a nice price!
[...] Inbox Inspections zijn nu gratis [...]
Inbox Inspector (email rendering in various email clients) is now free in MailChimp…. http://fb.me/uj7pizw2
[...] phones to test on. So it’s a good thing we have the Inbox Inspector (even cooler that it’s free now). We thought it would make sense to bundle the Inbox Inspector into a new [...]
[...] our business objectives better than before.”Additional resources:Inbox Inspector feature pageBlog: Inbox Inspections Now FreeEmail on Mobile Devices: A MailChimp StudyMailChimp’s feature case studies No Comments [...]