2025-02-08 11:13 UTC: We are investigating job execution delays at https://connection.us-east4.gcp.keboola.com/. We will provide updates as soon as we have more information.
2025-02-08 11:34 UTC: We have identified the root cause and resolved the issue. All jobs are now running normally, and the platform is fully operational.
The announced partial maintenance has just started. The platform has been scaled down and is no longer accepting new jobs. We expect a brief downtime in 30 minutes, around 8:00 UTC for GCP europe-west3 and us-east4. We will update this post with the progress of the partial maintenance.
2025-02-08 8:00 UTC: The announced partial maintenance of both GCP stacks is ongoing, and we are expecting downtime to begin any minute now. We will continue to update this post as the maintenance progresses.
2025-02-08 8:17 UTC: The maintenance of both stacks has been completed, and all services have been scaled back up. The platform is fully operational, and jobs are now being processed as usual. All delayed jobs will be processed shortly. Thank you for your patience.
This maintenance is necessary to ensure that our services remain secure and reliable. Please note the affected stacks and their maintenance schedules:
The maintenance is expected to last no longer than 15 minutes, during which jobs may be delayed. While you will be able to log into the Keboola platform, starting new jobs will not be possible during the maintenance. Jobs already running will not be canceled—only delayed. Running data apps or workspaces will not be affected. Scheduled jobs will automatically start after the maintenance is completed.
We apologize for the inconvenience and appreciate your understanding as we work to maintain and improve our service. If you have any questions or need further assistance, please contact our support team.
Thank you for your patience and cooperation.
As previously announced, we will be deprecating the old API endpoint for listing queue jobs (https://queue.[stack_id].keboola.com/jobs).
This endpoint has been replaced with a new, faster alternative: https://queue.[stack_id].keboola.com/search/jobs.
The old endpoint will be permanently shut down on March 1, 2025.
Please ensure that your API integrations are migrated to the new endpoint by this date.
If you have any questions, please contact our support team or your Keboola account manager.
We would like to inform you about the planned maintenance of Keboola stacks hosted on GCP.
This maintenance is necessary to keep our services running smoothly and securely. Please note the following schedules and the stacks affected.
During database upgrades there will be a short service disruption on both GCP multi-tenant stacks. Here is the schedule.
GCP europe-west3 (connection.europe-west3.gcp.keboola.com): Saturday, February 8, 2025, at 08:00 UTC.
GCP us-east4 (connection.us-east4.gcp.keboola.com): Saturday, February 8, 2025, at 08:00 UTC.
Effect of the Maintenance
During the above periods, services will be scaled down and the processing of jobs may be delayed. For very brief periods (at around 8:00 UTC) the service will be unavailable for up to five minutes and APIs may respond with a 500 error code. After that, all services will scale up and start processing all jobs. No running jobs, data apps, or workspaces will be affected. Delayed scheduled flows and queued jobs will resume after the maintenance is completed.
Detailed Schedule for europe-west3 and us-east4
7:30–8:00 UTC: processing of new jobs stops.
8:00–8:10 UTC: service disruption
8:15 UTC: processing of jobs starts.
Effect of the Maintenance
The maintenance is expected to last no longer than 15 minutes, during which jobs may be delayed. While you will be able to log into the Keboola platform, starting new jobs will not be possible during the maintenance. Jobs already running will not be canceled—only delayed. Running data apps or workspaces will not be affected. Scheduled jobs will automatically start after the maintenance is completed.
We are experiencing problem with jobs data replication on AWS EU stack (https://connection.eu-central-1.keboola.com). Jobs are being triggered and run properly but they don't appear in jobs list across whole UI.
Investigation is under way. We will post any updates available.
We are sorry for any inconvenience this may have caused and thank you for your patience.
2024-12-18 14:35 UTC: We have identified and fixed the issue with the component responsible for job data replication. New jobs are now displaying correctly in the lists, and all jobs that ran during the outage period have been successfully backfilled.
We are registering Buffer API outage on AWS US stack. The API is currently not receiving any requests which also affects other platform features, like AI suggestions.
Investigation is under way. We will post any updates available.
We are sorry for any inconvenience this may have caused and thank you for your patience.
2024-12-18 15:15 UTC: We have discovered that the data storage behind the Buffer API was corrupted. While the service is now fully operational, it had not been receiving any incoming requests since 2024-12-17 23:00 UTC. Additionally, Buffer endpoint configurations were lost due to the data corruption. All customers with configured Buffer API integrations will be contacted by their account executives to explain the situation in more detail.
We are investigating failing Storage jobs with the error: "Insufficient privileges to operate on account 'KEBOOLA'" on the AWS US East stack (connection.keboola.com).
Currently, it is not possible to create Snowflake workspaces.
We apologize for the inconvenience and will provide an update in 30 minutes.
UPDATE 2024-12-15 15:33 UTC
We have discovered the root cause and are working on a solution. The next update will be provided as soon as it is resolved or in 30 minutes.
UPDATE 2024-12-15 15:55 UTC
The issue has been identified and fixed. All projects are now operating normally.
We are sorry for any inconvenience this may have caused and thank you for your patience.
2024-11-20 08:00 UTC: Since 04:00 AM, we have been experiencing a high error rate on connection.us-east4.gcp.keboola.com affecting Snowflake operations. This includes Snowflake transformations, storage import/export jobs, and other processes, resulting in intermittent application errors.
2024-11-20 09:40 UTC: We're still waiting for confirmation from Snowflake.
2024-11-20 12:00 UTC: We're still waiting for confirmation from Snowflake.
2024-11-20 14:00 UTC: We're still waiting for confirmation from Snowflake.
2024-11-20 15:00 UTC: We haven't seen an error since 11:20 UTC and Snowflake have confirmed a fix on their side. All operations are back to normal. This is the last update.
We're sorry for the inconvenience and thanks for your patience.
The announced partial maintenance of connection.keboola.com and connection.eu-central-1.keboola.com will start in one hour at 07:00 UTC. We will update this post with the progress of the partial maintenance for each stack.
Update 07:00 UTC: The scheduled partial maintenance for connection.keboola.com has begun.
Update 07:15 UTC: The maintenance of connection.keboola.com has been completed, and all services have been scaled back up. The platform is fully operational, and jobs are now being processed as usual. All delayed jobs will be processed shortly. Thank you for your patience. Maintenance of connection.eu-central-1.keboola.com will start at 08:00 UTC.
Update 08:00 UTC: The scheduled partial maintenance for connection.eu-central-1.keboola.com has begun.
Update 08:15 UTC: The maintenance of connection.eu-central-1.keboola.com has been completed, and all services have been scaled back up. The platform is fully operational, and jobs are now being processed as usual. All delayed jobs will be processed shortly. Thank you for your patience.