Fix has been deployed.
The patch has been reviewed and now we'll deploy it.
The bug only affect access without NDA, we are working on a patch.
After login to the compliance page using magic link the NDA signature trigger a blank page.
All pending certificate renewals have been completed. The incident is now closed.
We're deploying a fix to resume ACME certificate renewing.
The newly deployed version have introduced a non backward compatible state change that causes the previous version to segfault during the certificate renewal process.
We rolled back the load balancer to the previous console version in the US region. The console is now operational. We are continuing to investigate the issue.
All requests to the console API returns timeout.
All traffic has recovered. Our deployment process was in a corrupted state and performed the wrong blue/green swap.
Load balancers sent traffic to outdated targets, which resulted in 5xx responses
Our monitoring detected an increase in 5xx errors across all HTTP responses.