Keboola Status

There is a problem with MFA registration in Safari for both, hardware keys like Yubikey and TouchID. The registration succeeds but it's not possible to verify the MFA upon login.

If you registered a hardware key in Safari, use other browser to log in (it will work). Then remove the registered device and re-register it using the other browser.

If you registered TouchID in Safari, please contact support to have your MFA disabled to allow you to login. After that please reregister your TouchID the using different browser.

2022-02-24 15:47 UTC - We are investigating failures of some jobs on new queue in https://connection.eu-central-1.keboola.com/ stack. Affected jobs are throwing error: Job "XYZ" terminated unexpectedly. We're currently working on mitigating the issue and will update when it gets resolved or in 60 minutes.

2022-02-24 16:05 UTC - The errors were occurring between 15:00 - 15:30. The issue is now resolved, we are monitoring the situation and investigating root cause of error.

2022-02-24 16:10 UTC - We have seen few reoccurrences of the issue. We're currently working on mitigating the issue and will update when it gets resolved or in 60 minutes.

2022-02-24 17:19 UTC - Issue is resolved, platform is stable. Last error at 16:30. Issue was caused by overload of one of the nodes, we've upgraded the nodes and we are working on better resources management to prevent similar issues. We apologize for the inconvenience. 

2022-02-21 13:30 UTC We discovered an issue that may cause it not possible to create new projects on Azure North Europe. So it is not possible to create new Pay as you go projects. 

We're currently working on mitigating the issue and will update when it gets resolved or in 60 minutes. 

Update 14:30 UTC The issue is now fixed.

Due to a misconfiguration, there was a brief error present in job processing in https://connection.keboola.com/ https://connection.eu-central-1.keboola.com/ stacks which caused some jobs to fail (14 jobs was affected). The error was present from 12:10:01 to 12:14:07 CET. We apologize for the inconvenience.

We see cases of orchestrations skipping their tasks in phases. The symptom is that orchestration finishes with success but in very short time with no tasks executed. We do not know yet what are the exact properties of an orchestration to trigger the issue.

We are rolling back todays changes in orchestration processing which should fix this issue. 

Update 16:15 UTC The issue is now fixed.

This applies only to Azure North Europe stack (https://connection.north-europe.azure.keboola.com).

Microsoft Azure will be performing maintenance on database services between 16:00 UTC on Feb 10 2022 and 08:00 UTC on 11 Feb 2022. This maintenance will last 60 to 120 seconds and may happen multiple times in this window. This may cause

• brief platform unavailability, 
• job retries, 
• job errors and
• very rarely also duplicate job execution

As we do not know when this will happen exactly we're unable to plan a maintenance window. If you encounter any issues due to this maintenance please contact our support. 

2022-02-09 11:00 UTC - We discovered an issue that may cause orchestrations that have more than 10 phases to fail with the error "there is already X waiting orchestrations". 

The first occurrence of this error was on 22-02-08 at 6:40 AM UTC. 

We're currently working on mitigating the issue and will update when it gets resolved or in 60 minutes.

2022-02-09 12:00 UTC We've prepared a fix. We will let you know as soon as the fix is deployed.

2022-02-09 15:24 UTC The issue has been fixed. We are sorry for any inconvenience.

On Thursday, February 10th, we will be updating our Telemetry to improve the data available from the Telemetry Data extractor. Please follow the post on our Community page for more details: https://community.keboola.com/post/new-telemetry-coming-on-thu-february-10th-6200cc1ed1d0cf25b64e9c68

If you have upgraded to Chrome 98 and you use U2F (e.g. Yubikey) as MFA, you will experience issues with login. U2F is being deprecated and Chrome 98 disables it by default. For time being you can enable it in Chrome settings (see chrome://flags/#u2f-security-key-api ) as a workaround. We are working on an upgrade and we will inform you.

2022-02-17 : Keboola platform supports now Webauthn API, which provides hardware security keys (FIDO devices, e.g. Yubikey) functionality. So there shouldn't be any issues with your login using this type of MFA.

2022-02-02 17:55 UTC We are experiencing delayed indexing of Events in our Storage. We are investigating the issue.

2022-02-02 19:23 UTC Problems with Storage Events delays were caused by increased load to our APIs. At the moment all of delayed events should be already processed and available in events feed. We are monitoring this situation, whether it will not happen again.