GoodData writer failures (US region)

We have encountered a small number of failed jobs in US region between 4:46 AM - 9:17 AM UTC.

Affected jobs finished with Application Error caused by invalid SSL connection to GoodData and we're investigating the issue.

UPDATE Nov 24, 1:42 PM (UTC) - Only projects having custom GoodData domains was affected by this issue. Problem was with validation of a renewed SSL certificate. The fix is deploying right now.

Job termination issue

We are investigating job termination issues for some components. After termination request is accepted jobs remain in terminating state until finished. 

UPDATE Nov 22, 9:28 AM (UTC) - We have identified the root cause and prepared the fix which should be released in few hours. Only minority of jobs termination was affected by this issue.

UPDATE Nov 22, 10:49 AM (UTC) - The fix was deployed and job termination is fully functional again for all jobs.

AWS performance issues in EU region

Amazon Elastic Compute Cloud is facing increased network connectivity errors to instances, hence the performance of Keboola Connection in EU region is impacted. As a consequence connection to Snowflake and creation of Jupyter/R sanboxes fails, most of the jobs are slow or stalled.

UPDATE Nov 12, 8:39 AM (UTC) Amazon have identified the root cause and are working to resolve the issue.

UPDATE Nov 12, 9:10 AM (UTC) Amazon has restored most of the network connectivity to impacted instances and is completing recovery for the remaining connectivity errors. However the performance of Keboola Connection remains impacted.

UPDATE Nov 12, 9:36 AM (UTC) Keboola Connection is back to operational state, however some jobs might not start immediately due to queuing with the many recently triggered jobs.

Component failures

We are experiencing failures of few components e.g. Salesforce Extractor. It is caused by recent infrastructure changes that were deployed on November 8th.

We are rolling back these changes and we'll update this status with new information.

UPDATE Nov 11, 8:37 AM (UTC) - Changes was rolled back and affected components should be working again without issues.

UPDATE Nov 11, 8:50 AM (UTC) - We're investigating further issues with Salesforce Extractor. 

UPDATE Nov 11, 9:00 AM (UTC) - Salesforce Extractor is working again. 

We're sorry for the inconvenience. 


New UI Release Webinar

Come check out our new UI along with our new feature releases, including our new Dashboard overview, Data Catalog, and Scaffolds. Webinar will be held Nov 11, 2019 15:00 UTC and also recorded available upon request.

You can register here.

New UI for Keboola Connection

We started redesigning Keboola Connection in June, 2019. The first pages we changed were the pages related to authentication, followed by moving and redesigning the navigation. Today, we're happy to announce that the 3rd part of Keboola Connection redesign is ready and deployed. The content itself hasn't changed that much, but we invested a lot of time and effort into making all parts look similar to bring you better user experience.

Let's summarize the biggest changes:

  • New project dashboard - shows what's happening in the project.
  • Scaffolds - predefined blocks of configurations for specific use cases
  • Data Catalog - a new way of sharing data in the organization
  • Option to share buckets for a specific project in the organization
  • Option to share individual tables from different buckets (buckets are created automatically)

Brand New Dashboard

The new dashboard is the entry point to your project and you should find the most important information on the project there. You can learn what users are active in your project, who created a configuration recently, which jobs are currently running, etc.

Extractors, Writers and Applications are Components

We grouped all components together in the main navigation.

Each section has two parts:

  • Directory - list of all components available for the selected type (extractor, writer, and application)
  • My components - list of all components you have configured (also for the selected type)

Scaffolds (New in Keboola Connection)

Scaffolds allow you to use a group of prepared configurations for a specific use case by filling in only a few details (e.g., credentials). No additional configuration is required.

Data Catalog (New in Keboola Connection)

This is a new way you can now see the data shared from/to your project:

  • Data which you can use in your project (the section Shared with you)
  • Data you shared from your project (the section Shared from this project)

Bucket Sharing

You can share a bucket directly from the Data Catalog section:

Simple sharing - when you already have a prepared bucket you want to share.

Advanced sharing - when you want to create a new bucket with specific tables.

Also, a new type of sharing has been added. From now on, you can share a bucket to a specific project in your organization.

Storage, Transformations, Orchestrations

These sections have been slightly redesigned, but you should be able to find everything in the same place.

There are a few things we want to mention:

  • In the orchestration detail, the configured token is more visible.
  • Jobs in the orchestration detail can be filtered by their status (successful vs. failed).
  • In the transformation detail, you can find the information about the backend you used and the phase on the right side.

Jobs

The Job detail page has also been redesigned.

Again, as with Transformations or Orchestrations, the content stays the same. We only reorganized it a bit. The event detail is shown in modal. Job parameters and Mapping (information about input/output tables) are shown in modal as well. Just click "Show all" in the particular section.

User and Project menus

These menus haven't changed much either. They were moved to the same line (as was Trash).

Anyway, we're going to continue to improve Keboola Connection for you, there are definitely more things to come. We hope you like our new UI and would love to hear your feedback!

GoodData issues in US region

GoodData was experiencing issues that were preventing users of GoodData system to access the platform and the projects located on this datacenter. The issue started on 10/30 at 23:43 (UTC) and was resolved on 10/31 02:18 (UTC).

Affected jobs in Keboola Connection ended up in error Running 147946154733.dkr.ecr.us-east-1.amazonaws.com/developer-portal-v2/keboola.gooddata-writer:1.4.4 container exceeded the timeout of 18000 seconds.

Read the original GoodData service status.

Snowflake's Behavior Change Pending: Changes to String-to-Date Conversion

On Dec 1st, 2019, Snowflake will turn on strict string-to-date conversion for all Keboola Connection projects.

By introducing this change, Snowflake wants to address issues such as invalid date strings rolling over. For example, 07-32 (July 32nd) has been interpreted as August 1st. Rollover will no longer be supported for dates, times, or timestamps.

A full description of affected cases and tips on what to do are provided in the Snowflake 3.45 Release Notes.

We have a list of affected queries in the Keboola Connection projects ready and will be contacting all users that may be affected by this change. You'll have plenty of time to check everything and fix any potential issue. 

Thanks a lot for your cooperation. 


Week in Review — October 23, 2019

Feature Sunsetting

  • Oauth-v2 and the old GoodData writer were completely shut down after the deprecation period.

Updated Components

Facebook Extraction

  • Data can be extracted from each account in a separate API call. That should prevent issues with the API refusing to reply due to too much data in the response.
    image

GoodData Writer

  • There is now a warning that running a single row will reset the state for all rows. It is a feature that was unexpected for some of our customers.

Changes in Keboola Connection

  • Good Data writer is no longer shown in the Storage Console graph and the Transformation overview.

New components

KDS team created two components. Application for refreshing dashboards and datasets in PowerBI and Pardot extractor.


Service disruption of Keboola Connection in EU region

  • 12:24:13 UTC: Keboola Connection in EU region is currently experiencing service disruption. We're investingating and will keep you posted. 
  • 12:34:04 UTC: EU region is currently up, but not stable yet. 
  • 12:42:21 UTC: Keboola Connection in EU region is now up and stable. 

We're very sorry for any problems this have caused. A post mortem post will follow when we examine the logs and find the root cause.