We just added a subscriber search box to the Dashboard:
Sounds kinda simple, but it was a pretty serious undertaking behind the scenes. See, before making search so easily accessible, we wanted to really beef up our underlying search service to make it faster. And that’s not an easy task when you consider the fact that we have a ton of small users with small subscriber lists (in the hundreds), and a bunch of large users with ginormous lists (in the millions). The fact that we built MailChimp to scale along with customers as they grow from startup to gigantic corporations has always been our most difficult challenge, but also our best differentiator. Would’ve been a lot easier to choose a database architecture if we just focused on small business or enterprise. Building the app to serve both (plus everything in between) makes things more–interesting. Anyway, in the end we had to build an entirely new search service, and then move 500GB of raw text data, 2 billion records, and 1TB of clustered, indexed search data.
So what can you do with all that power? Well let’s say I want to find all the people named “Ben” across all my lists, because I want to tell them about BenConf, a tech event for people named Ben (I’m serious).
I can just type “ben” in the Dashboard, and BAM:
* Previously, a search like the one above only worked on small lists, and only scanned 3 fields in your lists (fname, lname, and email).
Searches All Fields
But the new search tool doesn’t just scan names and email addresses, like the previous one did. It performs full text searching across all 30 fields in each member profile. So I can type something like “Germophobe“ and it finds that word in the Notes field of my profile:
New Notes Field
Oh, that reminds me: we added a NOTES field to all member profiles.
To add or edit notes for any member profile, just click the edit button:
Then type in your notes:
This is just a first pass. You’ll eventually see Notes available via the API, and popping up in our mobile apps (especially apps like Golden Monkeys or Chimpadeedoo), and ideally working in conjunction with our various CRM integrations out there.
Search Tip: If I search for Ben Chestnut like this:
It returns all entries with “ben” and all entries with “chestnut” in them.
So I get people named Bennet, or Benson or Benoit, and other people named “Angela” who work at companies like “National Benefit” or “Chestnut Inc.” Perfectly fine people, I’m sure.
But putting quotes around “ben chestnut” like this:
Only returns subscribers that have ben AND chestnut together. Where they belong.
Add Subscribers More Easily
On the Dashboard, you’ll also note that there’s a new “Add” button, so you can quickly add subscribers without having to go all the way to the Lists screen:
These tweaks are especially handy for those occasions when you need to do some quick manual entry of new subscribers, or when you need to just find someone on a list to edit their status. Log in to the Dashboard, get your work done, and log out.
Still Indexing
The new search tool is live, but is still indexing data from last Friday. So you might not have the most recent 3 days of subscriber data available in that search box yet. Just to give you an idea of the scale of this project, the last 3 days of data produced by our 2.5 million users amounts to roughly 30,000 separate files, each with 2,000 lines of code in it. This is because we’re not just indexing your subscriber records, but also campaign activity–so that we can make some of the research from our Email Genome Project actionable within your account (subscribe for EGP news here, if you’re interested in learning more). Exciting times. We anticipate those 3 days of data will be fully caught up and available tomorrow.








Faster, More Powerful List Searching http://t.co/5HFdBxmt
Just announced: Faster, More Powerful List Searching http://t.co/PRqWUbIX
Faster, More Powerful List Searching: Faster, more powerful list searching (plus a notes field) http://t.co/YUqv5Nwp
MailChimp News: Faster, More Powerful List Searching http://t.co/L3V8KJPq
@SBolck RT“@MailChimp: Just announced: Faster, More Powerful List Searching http://t.co/LDcUH4qg”
Enfin une recherche plus efficace dans Mailchimp… Obligé de connaitre l’e-mail n’était pas pratique ! http://t.co/aHQJgbkO via @mailchimp
RT @mailchimp: Just announced: Faster, More Powerful List Searching http://t.co/8qlK74ky <<this looks extremely useful. Thanks chimps!
“@MailChimp: Just announced: Faster, More Powerful List Searching http://t.co/egQB0hfF”. Love @mailchimp best newsletter product ever!
In case you missed it earlier, just announced: Faster, More Powerful List Searching http://t.co/PRqWUbIX
Faster, More Powerful List Searching | @MailChimp Email Marketing Blog http://t.co/jDm0kzwu
@diaris we’ve made some changes to our subscriber search function, and everything is working to finish indexing. more: http://t.co/PRqWUbIX
I know it will be better searching – but right now I’m frustrated that the indexing is taking so long!!! http://t.co/gfIS3Xch via @mailchimp
Guys, that is just perfect!!! All I ever wanted to make Mailchimp perfect was to be able to search someone’s subscriber history from the Dashboard, as soon as I log in… MT!
Thanks for the information! Now searching would be much more easier in my case!
Nice, but a message in the search box, while indexing was going on, for people who don’t read this blog every day would have been nice. Search didn’t work at all yesterday which was a big inconvenience.
The ‘Add’ button on the dashboard is nice, but if there is only one list (my guess is that the majority of your customers only have 1) don’t ask the user to select that one list from the drop down. Waste of time.
Ben – does it take a while even now to index new subscribers? If so, how long?
Hi Lucy, Based on volume it should be between a few minutes to thirty minutes after a new subscriber is brought in. If you’re still not seeing them show up would you be able to reach out via chat or email to our support chimps at: http://mailchimp.com/support so they could take a closer look for you?
Just announced: Faster, More Powerful List Searching http://t.co/60hgeZ63 #MailChimp
Thanks for this useful information, now searching would be much more easier! I love the new note field.
nice post man really impressive
Thank you for this improvement, should make my life a little easier :)
This is great, however, for list managers that do constant maintenance on our lists this makes life so much more difficult. We can no longer search for specific email addresses to check email receipt status and bounce or unsubscribe status.
This is causing our list manager HOURS more work to sift through the results she doesn’t want to find one particular account.
We’re beginning to look for alterative solutions for our campaign needs.
Look at this screen shot of what the new enhanced search engine gives us. FAIL.
http://screencast.com/t/NvLEfT0Lf
Hi Christy, I’ve been speaking to our Devs about this and they’ve made a few changes to help prioritize emails in the results when searching for emails. Also, they’re looking into some ways to potentially filter the results down a bit. If you could take another look and see how it’s functioning now, that’d be great. If the results are still not as expected would you be able to chat with one of our team at http://mailchimp.com/support so they can take a closer look and provide that info to our Devs?
My data has still not been indexed – this is ridiculous!
Hrrrmmmm, I checked with our Devs and it looks like everything should be caught up on the indexing part. Would you be able to reach out to our support chimps at http://mailchimp.com/support so they can take a closer look for you?
I don’t understand. I hope you fix this soon.
I can’t find anymore mails that I just added or updated, and that drives me crazy.
Please MC fix this.
Anyway, thanks for all the great work you are doing to improve things. I really appreciate it.
Just heard about new search upgrades. New nonprofit.Cant wait to try it. Thanks MailChimp!
Well worth the effort, it works very well and saves me a lot of time.
Thank you for such a great program.
There’s something amuck with the search. For example, when search for myself in my own database (yes, I tried in every way, name, email et cetera)… it comes up as nothing. No mention of me. I’m not subscribed (which, btw, I’m subscribed more than once with different emails).
This is creating a seriously problem because when I have subscribers tell me that they are not getting emails, I can’t find out why because I find find them in my subscription list to investigate!
Hmmmmm, something doesn’t quite sound right there. Would you be willing to contact our support chimps at: http://mailchimp.com/chat They’d be able to take a closer look at your account and sort out why you might not be getting the expected results.