Depot - Notice history

All systems operational

100% - uptime

us-east-1 - Operational

100% - uptime
May 2023 · 100.0%Jun · 99.78%Jul · 99.86%

Previous page

Next page

May 2023
Jun 2023
Jul 2023

eu-central-1 - Operational

100% - uptime
May 2023 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2023
Jun 2023
Jul 2023
100% - uptime

Depot-managed Actions Runners - Operational

100% - uptime
May 2023 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2023
Jun 2023
Jul 2023

Github.com - Actions - Operational

API - Operational

100% - uptime
May 2023 · 100.0%Jun · 99.96%Jul · 99.91%

Previous page

Next page

May 2023
Jun 2023
Jul 2023

Website - Operational

100% - uptime
May 2023 · 100.0%Jun · 100.0%Jul · 99.91%

Previous page

Next page

May 2023
Jun 2023
Jul 2023

Notice history

Jul 2023

Builds failing to start
  • Resolved
    Resolved

    Build service is restored.

  • Investigating
    Investigating

    We're currently investigating an issue causing builds to fail to start.

Database connectivity issue
  • Resolved
    Resolved

    Database service is restored, we are working with our database provider to understand the cause of the outage.

  • Investigating
    Investigating

    We are investigating reports of intermittent database connectivity issues.

Some builders unable to start
  • Resolved
    Resolved

    The fix has deployed, build service is restored.

  • Identified
    Identified

    We have identified the cause and are deploying a fix.

  • Investigating
    Investigating

    We are investigating an incident preventing some build machines from launching.

Google Cloud Network Instability
  • Resolved
    Resolved

    Build service is operational. We are continuing to work with Google Cloud to ensure they have resolved the issue.

  • Identified
    Identified

    Google Cloud started experiencing periodic load balancer failures about 5 hours ago. These failures are causing intermittent issues with build machines acquiring build information. We are monitoring the situation and are working with GCP support to resolve the issue.

Issue acquiring builders
  • Resolved
    Resolved

    Build service is restored, we will continue to monitor for any issues.

  • Monitoring
    Monitoring

    The fix has deployed, we are manually restarting any build machines that were affected to apply the fix.

  • Identified
    Identified

    We have identified the issue and are deploying a fix.

  • Investigating
    Investigating

    We are investigating reports of issues acquiring build machines.

Jun 2023

Builds failing to acquire build machines
  • Resolved
    Resolved

    This incident has been resolved.

  • Update
    Update

    We are rolling out an additional fix to our API to help mitigate this issue.

  • Monitoring
    Monitoring

    We have detected an issue acquiring new build machines. We have deployed a fix and are monitoring recovery.

Issues acquiring build machines
  • Resolved
    Resolved

    This incident has been resolved.

  • Monitoring
    Monitoring

    We have deployed a fix for machines failing to launch in eu-central. We are monitoring the fix.

  • Identified
    Identified

    We have identified the problem and are working on a fix. This is only impacting builds trying to acquire machines in the eu-central region at the moment.

  • Investigating
    Investigating

    We are investigating an issue with our API that is causing builds to not be able to acquire a machine.

Issue acquiring build machines
  • Resolved
    Resolved

    This incident has been resolved.

  • Monitoring
    Monitoring

    We have deployed a mitigation and build service is restored.

  • Investigating
    Investigating

    We are currently investigating an incident preventing build machines from being acquired.

Builds slow to start due to upstream network latency
  • Resolved
    Resolved

    The upstream issue has been resolved.

  • Identified
    Identified

    A network issue at an upstream service provider is causing API requests to start builds to respond slowly. Build service is still functional. We are monitoring the situation.

    https://status.posthog.com/incidents/q12bkzfnzlnr

Capacity issues acquiring builders
  • Resolved
    Resolved

    This incident has been resolved.

  • Monitoring
    Monitoring

    Capacity issues appear to be resolved, we will continue to monitor.

  • Identified
    Identified

    Some builds in us-east-1 are failing to start due to capacity issues. We are working with AWS to acquire additional capacity.

May 2023

No notices reported this month

May 2023 to Jul 2023

Next