New Features and Improvements

• Geneea NLP app now supports relations - e.g. My pizza was completely burned. > burn(OBJECT:pizza)
• Redshift transformations input mapping now supports ZSTD compression.
• Improved handling of events search errors

New Applications

GeoIP

GeoIP is latest transformation component power by MaxMind. It helps you to obtain location data from your IP address inputs.

Data Health Application

Data Health Application is an app designed to aid users to produce a clean data file. For more details, please check out Keboola Blog.

Today, September 25, 2017, we experienced jobs failures between 15:11 - 16:15 PM CET. One of our worker servers went down and while launching a new one automatic job restart mechanism didn't seem to work properly and this led to the jobs failures. Everything is working properly now and we will further investigate the cause of the issue. However we recommend to review your orchestrations and take appropriate action if needed. 

We are sorry for any inconvenience.

We are investigating Snowflake partial outage. Queries are now queued.

We will inform about the progress.

UPDATE 11:21 AM PDT Snowflake warehouses are up and running. Queued queries are being processed. We will update the post when we'll have more information about incident cause from Snowflake engineering.

New Features

• Database writers UI  - Disabled tables no longer load the whole content into the container when run and only first row of the table is loaded instead. This saves storage credits and decrease time of jobs run process. It works only for newly disabled tables, so old tables have to be redisabled (enable export -> disable export).
• Python for transformations and custom science applications has been updated to version 3.6.2
  

New Features

• Ability to test component's image against live configurations (Read more in our documentation)
• Markdown descriptions for tables and buckets are now available (see the images bellow)

Fig. 1 Click "Describe the ..." to add description

Fig. 2 Markdown is supported when describing buckets or tables.

Description of buckets and tables can be added/edited in various places:

• In bucket detail (Storage section),
• in table detail (Storage section)
• and anywhere in application where table preview is available

Deprecation

• We finally turned off Legacy Routing (Original status here)
• EOL of the synchronous exports has been announced and we'll turn it off on August 21st, 2017

Tutorials

• Our colleague prepared a small tutorial how to connect to the Keboola provided Snowflake database from Mode Analytics

Fixes

• Due to recent outages of Quay we started migration of our components to AWS ECR
• We updated the Pigeon component to use the newer Storage API client and send files to File Uploads encrypted

We were notified from Snowflake support about problem that could potentially affect Keboola Connection Snowflake Backed projects.

The issue happened between 9:19pm UTC August 8th and 6:45pm August 9th UTC.

There is a full alert from Snowflake below. We are investingating with them if we can find out if there are some affected KBC projects.

We will keep you informed of any progress.

UPDATE 2017-08-12 We have received list of projects which might be affected by this issue. In these projects one or more queries which might return wrong results were executed. We have notified these projects in KBC. If you need any assistance please contact support@keboola.com.

Dear Snowflake Customer,

We have identified a problem that could produce incorrect results in some queries that perform memory intensive join operations. It is unlikely that this issue impacts you; however, we wanted to make sure you were aware of the problem. The issue was isolated to the US-West region between 2:19pm Pacific time on Tuesday, August 8th and 11:45am Pacific time on Wednesday, August 9th. Queries performed in other regions or outside that timeframe were not impacted.

Because of the nature of the issue, it is difficult for us to determine if any of your queries experienced the problem. However, we are able to perform further analysis on a query-by-query basis. If you have a question about whether a specific query was impacted, please submit a support request to Snowflake support via the Support Portal or via email to support@snowflake.net .

We are very sorry about this issue and will do everything possible to help you resolve any problems this may have caused you.

We observe components failures hosted on quay.io from 08:25  AM CET. Python Transformations, Facebook Extractor, Google Sheets Writer are between affected components.

Quay.io outage is not reported yet. To avoid this issue in future we are moving all components to Keboola provided AWS repository.

We will inform about the progress.

9:09 AM CET RESOLVED Last error was seen at 08:53 AM CET. Quay.io has confirmed and fixed the issue.

The deprecated table synchronous exports will be shut down on 21st Aug 2017. 

This API call was replaced by Asynchronous table export for full table unloads and Data Preview for small samples of table data.

All Keboola Connection components use the new methods. As there are only a few projects currently using the deprecated method directly, these projects will be notified individually. For all other projects there is no action required.

New Features

• RStudio and Jupyter Sandboxes now support (and enforce) HTTPS connections.

Updated Components

Qlik and Looker writers were updated:

• Improved and unified UI

• Optional provisioned Redshift database

Fixes

• Fixed freezing of columns in Google Sheets Writer
  

Last week's developments:

Storage API

• The API no longer trims leading or trailing white spaces from configuration descriptions or row names

• The deployment process for applications can now be fully automated.  
  Check out the documentation to see how: Sample Integration with Travis CI