Job termination issue

We are investigating job termination issues for some components. After termination request is accepted jobs remain in terminating state until finished. 

UPDATE Nov 22, 9:28 AM (UTC) - We have identified the root cause and prepared the fix which should be released in few hours. Only minority of jobs termination was affected by this issue.

UPDATE Nov 22, 10:49 AM (UTC) - The fix was deployed and job termination is fully functional again for all jobs.

AWS performance issues in EU region

Amazon Elastic Compute Cloud is facing increased network connectivity errors to instances, hence the performance of Keboola Connection in EU region is impacted. As a consequence connection to Snowflake and creation of Jupyter/R sanboxes fails, most of the jobs are slow or stalled.

UPDATE Nov 12, 8:39 AM (UTC) Amazon have identified the root cause and are working to resolve the issue.

UPDATE Nov 12, 9:10 AM (UTC) Amazon has restored most of the network connectivity to impacted instances and is completing recovery for the remaining connectivity errors. However the performance of Keboola Connection remains impacted.

UPDATE Nov 12, 9:36 AM (UTC) Keboola Connection is back to operational state, however some jobs might not start immediately due to queuing with the many recently triggered jobs.

Component failures

We are experiencing failures of few components e.g. Salesforce Extractor. It is caused by recent infrastructure changes that were deployed on November 8th.

We are rolling back these changes and we'll update this status with new information.

UPDATE Nov 11, 8:37 AM (UTC) - Changes was rolled back and affected components should be working again without issues.

UPDATE Nov 11, 8:50 AM (UTC) - We're investigating further issues with Salesforce Extractor. 

UPDATE Nov 11, 9:00 AM (UTC) - Salesforce Extractor is working again. 

We're sorry for the inconvenience. 


New UI Release Webinar

Come check out our new UI along with our new feature releases, including our new Dashboard overview, Data Catalog, and Scaffolds. Webinar will be held Nov 11, 2019 15:00 UTC and also recorded available upon request.

You can register here.

GoodData issues in US region

GoodData was experiencing issues that were preventing users of GoodData system to access the platform and the projects located on this datacenter. The issue started on 10/30 at 23:43 (UTC) and was resolved on 10/31 02:18 (UTC).

Affected jobs in Keboola Connection ended up in error Running 147946154733.dkr.ecr.us-east-1.amazonaws.com/developer-portal-v2/keboola.gooddata-writer:1.4.4 container exceeded the timeout of 18000 seconds.

Read the original GoodData service status.

Week in Review — October 23, 2019

Feature Sunsetting

  • Oauth-v2 and the old GoodData writer were completely shut down after the deprecation period.

Updated Components

Facebook Extraction

  • Data can be extracted from each account in a separate API call. That should prevent issues with the API refusing to reply due to too much data in the response.
    image

GoodData Writer

  • There is now a warning that running a single row will reset the state for all rows. It is a feature that was unexpected for some of our customers.

Changes in Keboola Connection

  • Good Data writer is no longer shown in the Storage Console graph and the Transformation overview.

New components

KDS team created two components. Application for refreshing dashboards and datasets in PowerBI and Pardot extractor.


Service disruption of Keboola Connection in EU region

  • 12:24:13 UTC: Keboola Connection in EU region is currently experiencing service disruption. We're investingating and will keep you posted. 
  • 12:34:04 UTC: EU region is currently up, but not stable yet. 
  • 12:42:21 UTC: Keboola Connection in EU region is now up and stable. 

We're very sorry for any problems this have caused. A post mortem post will follow when we examine the logs and find the root cause. 

Dockerhub service disruption

Since October 15, 2019 5:16PM UTC the Docker Hub container registry is experiencing a complete service disruption. Some of Keboola Connection 3rd party components' images are historically hosted on Docker Hub. Such components' jobs will fail during the outage. You can subscribe to the outage mitigation progress on Docker Hub status page. 

All the new components and Keboola-maintained components are using AWS ECR as a registry, so they are not affected by the outage. 

We're very sorry about any problems this may cause. 

Client Webinar (Q4/2019)

Keboola is hosting our Q4/2019 client webinar and we want you there!

Date: Tue, Oct 8, 2019
Time: 6:00 PM - 7:00 PM CET

If you haven't done so already, please register now.  

Learn about new features, functionalities, and components that we have built over the first half of the year.  

Additionally, see the exciting plans that we have for the product for the next 3-12 months.

We hope that you can join us, but if not the webinar will be available on video by request afterward as well.

Cheers,

Your Keboola Team