Degraded services caused by host incident

Incident Report for CyberFOX

Resolved

This incident has been resolved.

Posted Feb 08, 2023 - 21:16 EST

Update

We are continuing to monitor the status of the recovering service (affecting newly installed agents) and will resolve this incident when 100% operational.

Posted Feb 08, 2023 - 17:11 EST

Identified

Our upstream provider had an incident today between 17:30 UTC (12:30pm EST) and 18:15 UTC (1:15pm EST). (https://status.heroku.com/incidents/2487) This impacted some of our services but not all. Some agents went offline during that time period.

One of our services is still recovering and causing some issues preventing newly installed agents from working properly. We expect the service to recover fully in about 3 hours at 01:00 UTC (8pm EST). After that point, newly installed agents should function properly.

Posted Feb 08, 2023 - 12:30 EST

This incident affected: Upstream Providers (Heroku Platform for AutoElevate) and AutoElevate (Agent Services).