@radekmie

On How Mailchimp Suspended Our Account

By Radosław Miernik · Published on · Updated on · Comment on Hacker News, Reddit

Table of contents

Intro

How is your week going? I just finished wrapping up an internal postmortem on how we lost 29 hours’ worth of emails (tens of thousands). It wasn’t the first (but hopefully the last) time a 3rd party wreaked such havoc on our product, but this time I decided to share it. It’s anonymized, but I hope you understand.

Below you can find our story, including (almost all) the emails we exchanged with the Mailchimp teams, as well as some comments on what we did wrong and what we could have done better. To some extent, I wanted to share it so the next company facing it would know what to do.

If you are in such a position, jump straight to What should I do!?

Update 14 March 2026: Case closed, it were fake emails. Some text below got redacted, some more got added. In any case, it still stings.

Overview

Our email provider stopped delivering our emails and locked us out of the account. Then, they didn’t reply for over 16 hours (or more, depending on what you consider a reply), and when they did, they suggested that our API key was leaked. When asked about why they think so, they mentioned that we sent two “fake shipping messages”… And yet, they cannot tell us which ones are these.

Overall, we exchanged roughly 30 emails, called them 6 times, and tried to get help from their automated chatbots… It still took us over a day to resolve the underlying issue. Well, technically it’s still unresolved, as we’re yet to hear back from them why some messages were considered “fake”. See the update below.

We’re now in a process of investigating a backup email provider1, organizing ourselves better to communicate such outages faster, and a kill switch that’d allow us to reduce the number of lost emails.

Timeline

What I thought really happened

Listen, I have a theory… Some automated spam filter triggered on one of our outbound emails. I don’t know why exactly, but let’s say one of our customers configured something weird in their email templates – it doesn’t matter.

The first thing that went wrong was that it somehow blocked us from logging in. Note that there was no notification, no email, no warning – just an instant ban.

Then, when we asked for details on which email it was, the second thing went wrong… Someone checked it manually and noticed that it was a mistake, so… They stopped replying.

I know that at our scale, we’re basically a rounding error in Mailchimp’s books, but it left a really bad impression. To some extent, I’d still recommend their services – we’ve been using Mandrill for over 11 years now, and except for occasional outages (it happens to everyone), it has been good.

What should I do!?

First of all, I’m sorry for you. If you’d like to share your story, please do send me an email. Now, full focus on resolving the issue. Good luck!

  1. Stop sending any requests to Mandrill. I assume you already have some queueing mechanism anyway (if not, you should!), so it should be as simple as stopping its consumers.
  2. Clear the email backlog. You will have to do it anyway, so go ahead and rip the band-aid even before you rotate the API keys.
  3. Rotate all of your API keys. Limit API scopes for all of them, and restrict IP access for all non-test ones. (Test ones seem to be fine.)
  4. Contact the Mailchimp Compliance Team as soon as possible. Make sure to use the same email address that you were notified from.

Closing thoughts

Such things happen. In today’s era of more and more autonomous content classification virtually everywhere, such false positives will happen. Of course, there’s still a chance that some of our emails were really “fake”, but given our track record, and the fact that so far the app is working, it’s rather unlikely. Yes, it turned out that it was a fake message, but the way MailChimp handled it was simply terrible. Since we reached out via Reddit the communication got much better, though. I guess the takeaway is… Don’t hesitate to write posts like this?

So… Any email provider recommendations?

1

A problem with having an alternative provider is that our customers would need to set up DKIM and DMARC for both. Of course, it only affects the ones who’d like to use a custom domain, but still.

2

Below, I gathered all emails to the relevant people, in case you need them. Keep in mind that while we were told to contact all of them (depending on who we asked), only the first one really helped us to solve the issue.

3

As the name of the service was misspelled (lowercased), it felt like a scam at first. If anyone from Mailchimp or Intuit is reading it: please, fix this template.

4

Yes, we’re using Mandrill, not Mailchimp. Technically speaking, it’s Mailchimp Transactional Email now, but I like the pre-merge name more.