1/28/10 System Outage

On 1/28/2010, the platform experienced an outage in our services. The outage lasted for 30 minutes and was due to a configuration issue with our load balancer. Specifically, the IPS (Intrusion Protection Service) process, which scans and updates the latest connection-based threats and protects the load balancer servers from common threat, had become unstable and stopped connections between the load balancer and our real servers. We have reconfigured this service to prevent this from happening in the future.