We just added the ability to segment based on subscriber engagement:
So now you can send a special campaign to your most loyal customers. Or, send a “come-back” campaign to the inactive members on your list before you clean them out.
Here’s why this feature is so important.
The Move To Engagement Measuring
If you follow the email marketing industry, you know that engagement is quite the buzzword lately. We recently talked about how one of the major ISPs is measuring engagement and using it to decide who gets to the inbox, and who goes to the junk folder (See: Feedback Loops Being Replaced by Engagement?).
That ISP is basically looking at whether or not your subscribers open, click, and in general, “interact” with you. If you send an email that mistakenly goes to the junk folder, then the subscriber moves it back out, you scored some engagement points. If your subscriber hits “reply” to send you a message, you get some engagement points.
Cleaning Inactives Helps Deliverability
Returnpath’s George Bilbrey goes into more detail in this article on Mediapost: “Engagement: The New Frontier in Deliverability?” At one point, he advises that senders:
“Treat inactive subscribers differently: This is probably the biggest change that most marketers need to think about. Mailing to a lot of inactive accounts may actually make your reputation look worse at some ISPs. Segment out inactive users and run a win-back campaign. If you cannot win back these subscribers, you may simply want to stop mailing them altogether.”
Fascinating? Then you’ll also like this from ReturnPath: How Engagement Metrics Influence Deliverability
Over at Clickz, Jeanne Jennings had this to say about inactive members of your list:
“If these folks really aren’t that into you, they may take the next step and report you as spam. It’s like that shunned suitor who just won’t go away; eventually the victim will consider him a stalker and get a restraining order. Keeping inactive names on your list can open you up to blacklisting and deliverability issues.”
See: Really Simple E-mail Segmentation: Reengaging Inactives
More Sophisticated Than Open and Click Ratings
Some clued-in users have asked us for ways to “segment based on those who haven’t opened the last 6 months” or “those who haven’t clicked in my most recent 3 campaigns.”
It’s awesome that people want to follow best practices and clean out their lists. But the problem with this approach is: 1) open tracking isn’t totally accurate, and 2) “my most recent campaigns” can mean something very different if you send daily emails vs. monthly or quarterly emails.
And neither of these approaches take bounces, spam complaints, and un-then-re-subscribers into account.
So we take a more holistic approach to measuring engagement, by looking at the historical activity of all your subscribers, and taking into account even more variables that are indicative of engagement.
BTW, if you’re into complicated equations, there’s some talk about metrics one could measure in “Future Vision of Email Measurement” at Deliverability.com.
How and Why MailChimp Measures Engagment
We’ve actually been tracking engagement data across our entire system for quite some time now (Chart: Gmail users more engaged?).
Then in March of this year, we unveiled our “List Activity Score” to make sure your best recipients got rewarded with the best deliverability rates.
Note that I did NOT say that our “best senders got the best deliverability rates.”
That’s because we found that our best customers often had multiple lists. And some lists were not as well maintained as others. So we stopped putting our “best senders” on our best IPs, and started sending emails to our best subscribers from our best IPs.
This is meant to reward senders for proper list management. Hence the awesome laurels you’ll find for the best lists:
But if you’re good at reading between the lines, you’ve picked up on the fact that this also means you really, really, really should clean out inactive members from your list.
And with this new release, we’ve made each of your subscribers’ activity score (or level of engagement) visible to you, so you can clean your list appropriately.
Here’s what the stars mean:
1 Star – negative rating, this person has unsubscribe and resubscribed, or soft bounced in the past
2 Star – no activity, never opened or clicked, most likely a new member
3 Star – this recipient has started opening or clicking your campaigns, limited activity
4 Star – this recipient has started opening or clicking your campaigns, a little more activity
5 Star – this recipient has started opening or clicking your campaigns, lotsa activity
How To Segment by Engagement in MailChimp
Whenever you create a campaign, step 1. is to select your list.
Click on “send to segment:”
Next, choose to segment by “member rating:”
If you want to send a special “come-back” campaign to your inactive members, you might select subscribers with 1 or 2 stars.
If you want to send a special offer to your most loyal subscribers, you’d click 5 stars:
In both cases, be sure to hit the “refresh” button to see an updated count of the segment:
Alternatively, you can perform a search on your list under the Lists tab, then click “View All” members:
Note the handy “download spreadsheet” link.








OMG…how great is this?! I will most definitely use this when!
Thanks, most awesome MailChimp team.
(Please, no need to send me a super hip MailChimp XL t-shirt to me c/o Temple Israel, 1376 E. Massey Road, Memphis, TN 38120.)
[...] Segmenting your email campaign based on subscriber engagement | MailChimp Email Marketing Blog (tags: e-mail marketing segmentation engagement measurement metrics analytics) [...]
Hi there,
How are the A.I.M, reports in comparison to this new feature… is it possible with AIM to segment a list like.. “Send mail only to people who opened the last 3 mails”?
Michel – yes, A.I.M. reports let you do just that. Segmenting by engagement is a more comprehensive approach that goes back way beyond 3 campaigns, and takes into consideration bounces, resubs, clicks, and more.
Excellent feature, easy to use but very powerful. Amazing how you come up with all these ideas all the time.
This is fantastic news. Really excited to hear you can now segment by engagement. Shows again that MailChimp are at the forefront of e-marketing solutions
If I import a new list of contacts (that already exist in MailChimp) will my new list be automatically rated too?
Hi Bob, engagement is per-list, and clears out for each new set. So don’t think it’s going to do what you need.
Thanks for the post and links. This is really enlightening stuff. What I am wondering is if you have any information on the way engagement effects deliverability in corporate emails that use something like Message Labs versus your ISPs out there…
Thanks
Ande
Hey Mailchimp Team,
In regards to the 5 Star System,
Do you have the math/ratio’s used to go from
2star to 3star
3star to 4star
4star to 5star
and how a 5 star users rating will change when sent for example another 5 emails without any opens/clicks
Great system, Im telling everyone about mailchimp!
Is there a way to automatically clear out inactive subscribers?
In my opinion this article does not really reflect the situations where this feature can be used. From Mailchimp support I received the following information:
“To clarify how the member rating system works, the rating system is simply designed to give you a picture of how your subscribers have engaged with your campaigns. The member rating system is not designed to be a real time measure of engagment with your campaigns, it is a cumulative, historic measure of how your subscribers have enaged with your campaigns, so no, member ratings will not decrease if activity decreases. We do understand that in the more uncommon situations where a previously engaged subscriber does have a drop off in activity and can cause a slight margin for error because of the fact that it is not real time.”
Therefore this feature can not be used for segmenting my list according to engagement. If people had been active, but loose interest after some time, they remain at a 5 star rating, although no activity has been there for half a year, with a Mailing receiving them every 3 days. I hope Mailchimp will adjust the feature accordingly, so i can really target my “currently inactive users” and not only those that have “never been active at all”. Although this would result in everybodies “list quality” to decrease. But we have to face, that not 40% of our subscriber base can be highly active users constantly.
Hi Peter,
The point when someone gets automatically “demoted” from 5-star to 1-star, due to inactivity, would depend highly on your send frequency. If I send my emails every 3 months, I’d like 5-star members who open and click actively in January to remain 5-star when I send again in March. But if I send daily, my standards may be different. But then it would be difficult to tell if you’re a daily sender who just didn’t send anything for a few days (maybe you went on vacation). Maybe not technically difficult, but when supporting 400k users, all with different needs, not something we can do easily.
There’s another way, perhaps. One thing you can try instead is segment based on AIM reports, to find “those who did not click my last 3 campaigns.”
Hi Ben,
thx for your comment. I see your point, but by doing it the way it is currently done, only those are satisfied with the tool that send not very often.
Adjusting the feature in a way, that you take into account the number of mails a subscriber received, would make the feature helpful to all of mailchimps customers (especially those using the software a lot)
If i sent a mail only every 3 months it would of course have not such a big effekt on the rating if a user did not open that campaign. But if i sent to him 50 Mails an he did not open or click any, it would and SHOULD have an impact on his rating. I mean someone who hasnt opened my campaigns for such a long time does not deserve a 5 star rating, only because he did have some activity 1 year ago.
Hope such an adjustment will be implemented soon so all of your customers can reliably use the feature. Because from the rough idea, it is a wonderful feature. only not usabable for many or probably also used by some, not realizing that the feature does not reflect current but history activity, which is not made clear in your descriptions of the 1-5 star ratings.
This looks to be a fantastic tool – just got to try to find the time to put all your great ideas into operation!
I was thinking I might have to phone all my ‘two star’ people to see why they don’t open – but maybe I can try sending an offer to entice them?
Just to confirm – is two star likely to mean that my newsletter appears in their inbox but they don’t bother to open? I guess at least they see our companies name in their inbox that way? Or is it likely that it goes into junk?
thanks
If they don’t open, or it goes into junk, same result: 2 stars. They’re just not that engaged. Keep in mind that to track an “open,” their images must be turned on, and some people leave those turned off. So take it with a little grain of salt. Before you deem them “deadwood” and cut them from your list, you’d want to give them another chance or two with special offers or something.
Great – thanks for the advice. I’ll try a special offer or some other incentive and see what happens…
You guy are great! This is a FANTASTIC feature.
[...] If you’ve had a spat of complaints or hard bounces and omnivore had to send you a warning, list segmenting is the quickest way to rehabilitate your [...]
[...] If you’ve had a spat of complaints or hard bounces and omnivore had to send you a warning, list segmenting is the quickest way to rehabilitate your [...]
I have just sent out my first campaign and I am so impressed with Mail Chimp. Thanks guys for explaining it to me every step of the way (and in such a way that even a computer challenged person like me can understand!)
Many companies are setting up their mail service so that more and more emails are never making it past their firewall. I sent a campaign that included myself at my company email and it never went through, even to the junk or spam folders. For this reason, I may have to either send hard copies vis USPS or call each person on the list to ask them to have their company remove mailchimp from their black list.
That brings me to a question: Is it the mailchimp name that is possibly being black-listed or is it something else?
This is a good point. Was this ever answered?
Hi there, how can someone who opens an email multiple times only have a 2 star rating and why are there people with 2 stars on my open list? Why does stuff that goes into junk get 2 stars? Re having to turn on images in order for MC to collect info, good to know.
Hi Patty,
One possibility is someone opened and clicked, getting a goo star rating, but then they unsubscribed or reported as spam — which deducts stars. But for a more through investigation, you can contact our support team.
[...] week, Ben blogged about how MailChimp allows you to segment your mailing list by activity. He gave several good examples of how you can use the tool effectively, but I’d like to show you [...]
[...] then led to even more granular analysis: subscriber engagement tracking. We now treat email delivery differently, depending on the engagement level of your subscribers. [...]
As well as needing to have images turned on to count as an open, can you tell me what happens if someone reads the message in their reading pane. Is that able to be measured as an open?
I decided to call a couple of my subscribers, because they had hard bounced when I correctly suspected their addresses were still valid, and they assured me they were reading my newsletter. When I looked at their activity history they were both only 2 star subscribers and it was indicating they had not responded to anything they’d been sent.
If, in their preview pane, they turned images on, we can track the open (or if they click something). Many times though, people don’t bother viewing images in a preview pane. They just skim. Can you send those email addresses over to our support team? They can get it into the right hands here to see if we need to re-train any bounce processing algorithms. Thanks!
Well this feature maybe great for some but if we definitely want to send follow up emails for specific campaign that emails were opened, how would we do this?
for instance, i want to email to the users in my list that responded to campaign a, not campaign b and also responded to campaign c. Then email follow up to “only” users that opened but havent responded?
Just wondering about the star system. Was having a quick look through some 2 star people on my list, but when I went into their full profile they have opened emails 6 times and are rated as a 3 1/2 star on their profile page. Can you please explain? Thanks.
Sorry, just realised I was looking at the list star rating rather than the individual’s rating. But I have found that some people who have opened my campaigns many times ony have a 2 star rating – surely this is not correct?
Generally, it can take time for ratings to update, or star ratings can go down if their emails bounce or they report you as spam.
Cheers, thanks Ben
This is a great post, but one of the links has been moved. The “How Engagement Metrics Influence Deliverability” article is now located here:
http://www.returnpath.net/blog/intheknow/2009/10/how-engagement-metrics-influence-deliverability/