Some data loads may end with similar error message: {"upload_status.json":"SLI CSV \"dataset.outcmaincalled_numbers.csv\" does not contain header line"}. It is caused by an error in GoodData WebDav and GoodData support is working on a fix. The occurence is rather sporadic and appears in one or two client projects a day and usually vanishes after few hours.

We have slightly updated some of the input fields in the Transformations UI. 

• Packages, Stored Files and Requires are editable straight away and save immediately after each change.
• Queries and Scripts are editable straight away too, but you can reset (to the previous state) or save the change with a button.

No more clicking to edit a field. If you delete or add something by accident, you can always revert to the previous version.

Let us know what you think!

On April 11 between 4:15pm and 4:31pm CEST our connection to quay.io was down. All Docker images stored there were inaccessible. That caused failures in running some components. If you encountered an application error during that period, this outage was likely the culprit. 

Unfortunately status.quay.io remains silent about this outage. 

We are sorry for this inconvenience and to mitigate similar issues in the future, we will move all used Docker images from public repositories (DockerHub and Quay.io) to our private repository in AWS ECR.

Improved table export from Storage console

• works uniformly regardless of the backend
• exports big tables up to 5 GB gzipped
• exported file contains name of the table

UI Improvements

• Fixed text overflow in table layouts
• Improved empty states in transformations

Updated Storage API client for R

Please upgrade to a new version, see its Github repository.

Improved Facebook extractor

Facebook extractor is able to correctly set required primary keys for insights data.

Google Sheets Writer is now available. It is meant to replace a portion of the current Google Drive Writer.

We have decided to split the current Google Drive Writer into two separate components to simplify their usage:

• Google Sheets Writer - as its name implies, is designed to upload tabular data from Storage to Google Sheets.

• (New) Google Drive Writer - will handle uploading general files to Google Drive. It will be released very soon.

Features

• Advanced Input Mapping
• choose which columns will be uploaded
• filter data by date or by column values

• Upload into existing or new Spreadsheet

• Update or append data in a Sheet
  
• you can write into existing Sheet within a Spreadsheet or create a new one
  

Migration

The existing Google Drive Writer will be deprecated soon and a migration tool will help you transfer your existing configurations to new Google Drive or Google Sheets Writer respectively.

Don't hesitate to give us feedback or ask a question, write to support@keboola.com.

New Component - Papertrail Extractor

Minor Improvements

• S3 extractor now displays how many files were downloaded in the specific job; it is very handy especially in case of wildcard rules
  

  

• MSSQL Writer now supports the BCP method - you can activate it in the table settings - it can write your data to desired MSSQL DB at supersonic speed, but take note that it doesn't handle weird UTF8 characters properly
  

  

• Transformations with Snowflake backend now support FLOAT data type in input mapping -> no hacking with NUMBER data type anymore
  

  

Snowflake data previews in Storage were returned in wrong encoding since this Friday which caused that some characters were missing.

This is fixed now. Stored, imported and exported data wasn't affected by this bug.

Sorry for any inconvenience.

We have updated the UI for the S3 Extractor and the CSV Import tool. We're keen on trying new things to improve your user experience with Keboola Connection and hope that these improvements offer a simpler and easier approach to editing your component configurations.

There is no difference between editing and non-editing state, everything is directly editable and the state of the Save button indicates if the configuration has been changed or not. 

If this approach proves useful and stands the test of time, we'll carry it on to other components as well.

Let us know what you think!

Between Mar 29 10:03 UTC and Mar 29 13:10 UTC all Snowflake Writer jobs had accidentally 15 seconds limit and potentially ended-up by error message:

Statement reached its statement or warehouse timeout of 15 second(s) and was canceled.

Trash for configurations

One of the most wanted features in Keboola Connection was the option to restore deleted configuration.

We are happy to announce this feature is now avalable for all users.

This feature allows you to:

If you use "Empty Trash" button, all configurations will be deleted permanently. There is no other way to restore them!

As always, you can use mentioned functionality by calling our Storage API: http://docs.keboola.apiary.io/#reference/component-configurations/configuration-restore/restore-deleted-configuration

Fixes and improvements

• added optional parameter to specify warehouse in Snowflake Database Writer
• fixed credentials editing in DB writers