We had a machine in Ashburn stop responding to DNS queries tonight. The DNS process kept running and our IGP kept running but the DNS server basically deadlocked. This was one server out of our 30 or so running in the network but it was heavily trafficked. Users should still have been online by redirecting to one of our other anycast addresses. None the less we will take measures tomorrow to ensure this doesn’t happen again.

While this wasn’t a catastrophe, this was our first real hiccup in resolving queries for our users and we take it very seriously.