Depot - Notice history

GitHub are reporting that they have resolved the issue, and we are observing all jobs processing normally.

We have identified the issue impacting GitHub Actions jobs and are monitoring recovery.

Container builds are back online in both regions.

We are currently investigating two issues simultaneously. One is impacting container builds starting in a timely matter. The other is related to GitHub Actions jobs not starting. We are diagnosing both.

GitHub is also reporting an outage related to Actions: https://www.githubstatus.com/incidents/y0gqch2dhw5l

GitHub have reverted the bad deploy, jobs are running again.

Docker Hub issues appear to be resolved.

https://www.dockerstatus.com/pages/incident/533c6539221ae15e3f000031/6674ab18f483b5178cf6bdab

Docker has mitigated the issue. We still see some failures, but most builds are now succeeding. We will continue to monitor.

GitHub have marked the incident as resolved: https://www.githubstatus.com/incidents/lfrlwdg67fn8

Build service appears to be restored - we will continue to monitor GitHub's recovery. https://www.githubstatus.com/incidents/lfrlwdg67fn8

GitHub is reporting that they are in the process of applying a mitigation. We have not yet seen service restore. For more updates: https://www.githubstatus.com/incidents/lfrlwdg67fn8

GitHub have marked the incident as resolved.

We are observing all jobs able to successfully start. GitHub is still reporting that status updates are delayed for all Actions customers. https://www.githubstatus.com/incidents/nj47vccwm2zj

While GitHub are still investigating the incident, we are seeing some jobs able to complete, though their status is often not reflected correctly in the GitHub UI. https://www.githubstatus.com/incidents/nj47vccwm2zj

GitHub have identified the cause as network connectivity issues on their end, they are continuing to investigate: https://www.githubstatus.com/incidents/nj47vccwm2zj

GitHub have just opened an incident of their own for this outage: https://www.githubstatus.com/incidents/nj47vccwm2zj

This appears to be a GitHub Actions outage - both GitHub-hosted runners and Depot-hosted runners are currently experiencing issues starting jobs.

GitHub has opened an outage of its own that we are now monitoring https://www.githubstatus.com/incidents/2bglpcjvg7xb

We have identified the issue as being on GitHub's end. They are either not releasing jobs in a timely manner to online runners or not sending webhook events when jobs are in progress. We will continue to monitor queue times on our side.