There was an outage of the Keboola Connection platform in the US region from Dec 13, 2018, 23:19 CET to Dec 14, 2018, 02:28 CET. It was caused by an update of the Elasticsearch Service.
It was a self-service update of the managed Amazon Elasticsearch Service, and we decided to do it because updates were tested and all other clusters we're using were updated successfully - without any issues.
Updates like this usually go smoothly, but not this time. Unfortunately, the cluster froze and refused to accept any requests.
After detecting this, we decided to start a new service and restore from backup.
All services were fully restored to their normal state by Dec 14, 2018, at 02:28 CET.
We have already taken action to prevent this kind of failure from happening again, and we'll be testing all future updates on testing clusters (using snapshots from production clusters).
Any orchestrations in the US region that were scheduled to start during the outage were not started. Therefore you will need to run them manually or wait until their next scheduled run.
We want to sincerely apologize for the inconvenience caused by this outage.