Depot - Notice history

All systems operational

100% - uptime

us-east-1 - Operational

100% - uptime
Aug 2024 · 99.77%Sep · 99.96%Oct · 99.98%

Previous page

Next page

Aug 2024
Sep 2024
Oct 2024

eu-central-1 - Operational

100% - uptime
Aug 2024 · 99.77%Sep · 99.97%Oct · 99.98%

Previous page

Next page

Aug 2024
Sep 2024
Oct 2024
100% - uptime

Depot-managed Actions Runners - Operational

100% - uptime
Aug 2024 · 99.98%Sep · 99.98%Oct · 100.0%

Previous page

Next page

Aug 2024
Sep 2024
Oct 2024

Github.com - Actions - Operational

API - Operational

100% - uptime
Aug 2024 · 100.0%Sep · 100.0%Oct · 100.0%

Previous page

Next page

Aug 2024
Sep 2024
Oct 2024

Website - Operational

100% - uptime
Aug 2024 · 100.0%Sep · 100.0%Oct · 100.0%

Previous page

Next page

Aug 2024
Sep 2024
Oct 2024

Notice history

Oct 2024

Container builds unable to start
  • Resolved
    Resolved

    The deploy has completed, build service is restored.

  • Identified
    Identified

    We have identified an issue preventing container builds from starting, a fix is deploying now.

Increased GitHub job queue time
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    We are starting to see some recovery, still monitoring

  • Identified
    Identified

    GitHub has discovered the increased queue times and are investigating.

  • Investigating
    Investigating

    We are currently observing increased delays in GitHub distributing jobs to Actions runners.

    This may be related to their current outage:

    https://www.githubstatus.com/incidents/myvz2tsj2dh8

Some API requests failing
  • Resolved
    Resolved

    This appears to have been a brief network disruption for our database provider that has since recovered, all jobs and builds are processing normally again.

  • Investigating
    Investigating

    We are currently investigating reports of API request failing, preventing container builds from starting and increasing queue times for GitHub Actions jobs.

Increased GitHub job queue time
  • Resolved
    Resolved
    This incident has been resolved.
  • Identified
    Identified

    We are starting to see some recovery, still monitoring

  • Investigating
    Investigating

    We are currently observing increased delays in GitHub distributing jobs to Actions runners.

Slow downloading of container images with --load
  • Resolved
    Resolved

    This issue is resolved, --load is no longer slow. We will be releasing an upcoming CLI version with some additional --load performance optimizations we discovered during debugging.

  • Monitoring
    Monitoring

    We have deployed an initial fix and are monitoring rollout.

  • Investigating
    Update

    We are continuing to investigate the root cause of this issue.

  • Investigating
    Investigating

    We are investigating reports of slow downloads of container images with --load or load: true.

Sep 2024

Container builds failing to pull images from DockerHub
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    Docker has reported that a fix has been applied and that error rates are returning to normal. We'll continue monitoring the issue.

  • Investigating
    Investigating

    Docker has reported an outage with Docker Hub Registry with degraded performance pulling images. Some container builds may fail to pull images from Docker Hub. Track Docker's ongoing incident here: https://www.dockerstatus.com/

DockerHub is down undergoing maintenance
  • Resolved
    Resolved

    We are now seeing consistent success from DockerHub.

  • Monitoring
    Monitoring

    DockerHub seems stable at the moment. We'll continue to monitor.

  • Identified
    Identified

    We are seeing many builds fail when trying to pull container images from DockerHub.

    DockerHub is undergoing planned maintenance for the next several hours:

    https://www.dockerstatus.com/pages/maintenance/533c6539221ae15e3f000031/66f3458fa451070c6a8b47a6

Container builds are not starting
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    The fix has deployed and builds should be processing, we are monitoring.

  • Identified
    Identified

    We've identified the issue and are rolling out a fix.

  • Investigating
    Investigating

    We are currently investigating an issue that is causing container image builders to not launch in a timely manner.

Subset of GitHub Actions jobs queuing longer than usual
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    A fix has been deployed, and we are monitoring queue time recovery for the impacted customers.

  • Identified
    Identified

    We've identified the root cause of the issue and are implementing a fix.

  • Investigating
    Investigating

    We are currently investigating an issue that is impacting a small subset of customers where jobs appear to be queuing for longer than usual.

Increased queue times for GitHub Actions jobs
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    Queue times have returned to normal for the vast majority of jobs. We'll continue to monitor, as Github is still reporting an outage.

  • Identified
    Identified

    GitHub has opened an incident that we are monitoring: https://www.githubstatus.com/incidents/69sb0f8lydp4

  • Investigating
    Investigating

    We are currently investigating reports of longer queue times for GitHub Actions jobs

Aug 2024

Some GitHub Actions jobs failed to start
  • Resolved
    Resolved
    This incident has been resolved.
  • Identified
    Identified

    GitHub failed to deliver some notifications about GitHub Actions jobs that were started in the last hour. This seems to have resolved, but if you have any jobs that are currently queued, you may need to cancel and retry the job to re-trigger.

GitHub Actions experiencing an outage
  • Resolved
    Resolved

    GitHub says this outage is resolved.

  • Identified
    Identified

    GitHub is currently experiencing an outage where Actions jobs are not triggered: https://www.githubstatus.com/incidents/3vhw289ftnqp.

Container builders not starting
  • Resolved
    Resolved

    This has been fully resolved

  • Monitoring
    Monitoring

    We have completed failover and are monitoring recovery

  • Identified
    Identified

    This appears to be caused by an intermittent outage at our cloud provider, we are currently failing over to a backup provider to resolve.

  • Monitoring
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Investigating
    Investigating

    We are currently investigating an issue that is causing container image builders to not launch in a timely manner.

Increased GitHub Actions queue times
  • Resolved
    Resolved

    GitHub have released all jobs to runners, queue times have returned to normal.

  • Investigating
    Investigating

    We are investigating an increase in queue times for GitHub Actions jobs.

Degraded performance across GitHub Actions
  • Resolved
    Resolved
    This incident has been resolved.
  • Investigating
    Investigating

    We are currently monitoring degraded performance across GitHub Actions related to the GitHub outage here: https://www.githubstatus.com/incidents/mrpx4trfk45z

Aug 2024 to Oct 2024

Next