Due to a misconfiguration, there was a brief error present in job processing in https://connection.keboola.com/ https://connection.eu-central-1.keboola.com/ stacks which caused some jobs to fail (14 jobs was affected). The error was present from 12:10:01 to 12:14:07 CET. We apologize for the inconvenience.
We see cases of orchestrations skipping their tasks in phases. The symptom is that orchestration finishes with success but in very short time with no tasks executed. We do not know yet what are the exact properties of an orchestration to trigger the issue.
We are rolling back todays changes in orchestration processing which should fix this issue.
Update 16:15 UTC The issue is now fixed.
2022-02-09 11:00 UTC - We discovered an issue that may cause orchestrations that have more than 10 phases to fail with the error "there is already X waiting orchestrations".
The first occurrence of this error was on 22-02-08 at 6:40 AM UTC.
We're currently working on mitigating the issue and will update when it gets resolved or in 60 minutes.
2022-02-09 12:00 UTC We've prepared a fix. We will let you know as soon as the fix is deployed.
2022-02-09 15:24 UTC The issue has been fixed. We are sorry for any inconvenience.
On Thursday, February 10th, we will be updating our Telemetry to improve the data available from the Telemetry Data extractor. Please follow the post on our Community page for more details: https://community.keboola.com/post/new-telemetry-coming-on-thu-february-10th-6200cc1ed1d0cf25b64e9c68
If you have upgraded to Chrome 98 and you use U2F (e.g. Yubikey) as MFA, you will experience issues with login. U2F is being deprecated and Chrome 98 disables it by default. For time being you can enable it in Chrome settings (see chrome://flags/#u2f-security-key-api ) as a workaround. We are working on an upgrade and we will inform you.
2022-02-17 : Keboola platform supports now Webauthn API, which provides hardware security keys (FIDO devices, e.g. Yubikey) functionality. So there shouldn't be any issues with your login using this type of MFA.
There was an error in the platform causing failure during the creation of projects for pay-as-you-go customers since yesterday, 16 January 2022, 14:30 UTC. The problem was fixed a moment ago and we are investigating its cause.
January 19 2022, 10:00 UTC - all users which registered in pay-as-you-go (between Jan 15 22:00:00 UTC and January 16 2022, 14:30 UTC), should be now able to access their projects.
In case of redirect to last step of pay-as-you-go, cookies for domain https://connection.north-europe.azure.keboola.com/ must be cleared (closing browser application should be sufficient)
If closing browser did not help, clear cookies according instruction for you browser:
Chrome https://support.google.com/chrome/answer/95647?hl=en&co=GENIE.Platform%3DDesktop
Firefox https://support.mozilla.org/en-US/kb/clear-cookies-and-site-data-firefox
Safari https://support.apple.com/guide/safari/manage-cookies-sfri11471/mac
In order to keep our codebase clean, we occasionally have to make large changes to it. This time we have to migrate all projects on all stacks to use the new code.
This is an internal change only. Afterwards, you will not notice anything different.
The migration will take place between January 17 and January 21, 2022. During the migration, we will disable all projects for a few seconds to convert the data.
All your configurations will remain intact, and your usage of production and development branches will be unchanged.
2022-01-12 8:40 UTC We are experiencing number of jobs in waiting state more than usual. We are investigating the issue.
2022-01-12 9:05 UTC There is sudden increased traffic on our EU Snowflake warehouse so that we upgraded it to larger instance and the queued jobs were immediately processed. The delay should be fixed soon. We are still monitoring the warehouse until the traffic is settled down.
UPDATE 12:05 UTC - Previously announced maintenance of connection.eu-central-1.keboola.com will start in one hour at 13:00 UTC. During the maintenance, you can't access your data and projects. All network connections will be terminated by "HTTP 503 - down for maintenance" status message.
UPDATE 13:00 UTC - EU stack (connection.eu-central-1.keboola.com) maintenance started.
UPDATE 14:53 UTC - EU stack (connection.eu-central-1.keboola.com) is finished. Platform should be stable, we continue to monitor it.
UPDATE 06:54 UTC - Previously announced maintenance of connection.keboola.com will start in one hour. During the maintenance, you can't access your data and projects. All network connections will be terminated by "HTTP 503 - down for maintenance" status message.
UPDATE 08:00 UTC - US stack (connection.keboola.com) maintenance started.
UPDATE 10:43 UTC - US stack (connection.keboola.com) is finished. Platform should be stable we continue to monitor it.