2025-03-11 10:50 UTC - we are investigating failed jobs for component keboola.ex-telemetry-data
2025-03-11 11:30 UTC - We found invalid record in telemetry data which caused telemetry extractor to fail. Record was fixed and all telemetry extractors are working as expected.
We are sorry for caused inconvenience.
2025-03-11 10:00 UTC - we are investigation possible service degradation on https://connection.eu-central-1.keboola.com stack
2025-03-11 11:10 UTC - all services are operating normally now. Only marginal number of component job was affected with delayed processing.
2025-02-08 23:55 UTC We are experiencing issues with the Storage API on our stack. This may cause slower Queue jobs and occasional downtime for the Storage API and Connection administration. The next update will be in 30 minutes.
2025-02-09 0:35 UTC We identified an issue where some parts of our system were overloaded due to a high number of jobs running during the nightly peak after 11 PM. This caused slowdowns and occasional errors in our UI and Storage API and some Queue jobs may have been delayed or failed.
We have increased system capacity to prevent this issue in the future.The incident is now resolved.
We apologize for any inconvenience caused.
2025-03-05 16:10 UTC We are currently experiencing degraded performance with workspace creation, which may impact all jobs that rely on workspace creation as part of their lifecycle.
Our team is actively investigating the issue, and we will provide updates as we have more information.
We appreciate your patience and apologize for any inconvenience this may cause.
2025-03-05 17:15 UTC We've identified the core issue and deployed a fix. All Storage jobs associated with WorkspaceCreate should now be functioning properly.
2025-03-04 10:00 UTC - We are investigating import failures for the Stream service on connection.eu-central-1.keboola.com due to receiver errors. We will provide an update as soon as we have more information.
2025-03-04 10:10 UTC – We have identified the root cause and resolved the issue. The backlog of imports is now being processed, and we are continuing to monitor the situation.
2025-03-04 12:11 UTC – Some projects still have unprocessed Stream imports. We are continuing the investigation.
2025-03-04 13:21 UTC – The backlog has been cleared, and Stream services are stable and fully operational. However, a few customers' data was not imported during the incident window starting on February 28th. We will contact these customers directly.
The announced partial maintenance has just started. The platform has been scaled down and is no longer accepting new jobs. We expect a brief downtime in 30 minutes, around 12:00 UTC. We will update this post with the progress of the partial maintenance.
Update 12:00 UTC: The announced partial maintenance is ongoing, and we are expecting downtime to begin any minute now. We will continue to update this post as the maintenance progresses.
Update 12:13 UTC: The maintenance has been completed, and all services have been scaled back up. The platform is fully operational, and jobs are now being processed as usual. All delayed jobs will be processed shortly. Thank you for your patience.
Starting at 12:00 UTC, all jobs that were either processing or started at that time began failing due to an error introduced in the latest release. At 12:40 UTC, we reverted to the previous stable version, and we expect job processing to return to normal.
We are actively monitoring the situation and will provide updates as needed.
The deprecated jobs listing endpoint will be temporarily unavailable on the following dates and times:
Please be aware that this endpoint will be permanently shut down on March 1, 2025.
Ensure that your API integrations are migrated to the new endpoint by this date.
We would like to inform you about the planned maintenance of all Keboola stacks hosted on Azure.
During the database upgrades there will be a short service outage on all Azure stacks, including all single-tenant stacks and Azure North Europe multi-tenant stack (connection.north-europe.azure.keboola.com). This will take place on Saturday, March 1, 2025 between 11:30 and 12:30 UTC.
Effects of the Maintenance
During the above period, services will be scaled down and the processing of jobs may be delayed. For a very brief period (at around 12:00 UTC) the service will be unavailable for up to 10 minutes and APIs may respond with a 500 error code. After that, all services will scale up and start processing all jobs. No running jobs, data apps, or workspaces will be affected. Delayed scheduled flows and queued jobs will resume after the maintenance is completed.
Detailed Schedule
2025-02-13 11:01 UTC - We are currently investigating a potential column mismatch issue with the Salesforce extractor, which started occuring around February 12, 2025. The investigation is ongoing, and we will provide more information as soon as we have further details.
2025-02-13 11:48 UTC - We have reverted the affected extractor version to the previous one. Extracted objects with frozen columns that were not aligned with the current Salesforce API version may have had mismatched columns if they were processed using the affected extractor version, which was released on February 11, 2025, at 8:07 UTC. A full load using the reverted extractor is advised.