Depot - AWS us-east-1 outage – Incident details

All systems operational

AWS us-east-1 outage

Resolved
Major outage
Started almost 2 years agoLasted about 1 hour

Affected

Container builds

Major outage from 8:15 PM to 9:43 PM

us-east-1

Major outage from 8:15 PM to 9:43 PM

Updates
  • Resolved
    Resolved

    This incident has been resolved.

  • Monitoring
    Monitoring

    All builds are now using primary infrastructure, we are monitoring to ensure that all service is restored.

  • Update
    Update

    AWS is reporting that the us-east-1 outage has cleared, we are routing builds back to primary infrastructure.

  • Update
    Update

    AWS is experiencing an outage in us-east-1 (https://health.aws.amazon.com/health/status). We are attempting a failover to backup infrastructure in another region.

  • Update
    Update

    AWS is still experiencing issues in us-east-1, we are prepping to fail over to backup infra.

  • Identified
    Identified

    AWS us-east-1 is currently rate-limiting infrastructure updates, we are monitoring.

  • Investigating
    Investigating

    We are investigating lag in acquiring build machines, causing some build requests to time out.