Week in Review -- October 9th, 2017

The longstanding issue with slow SHOW DATABASES query executions on Snowflake has finally been resolved. We will now gradually enforce snowflake query execution limits where applicable by contract. Before turning the limits back on, we will check the query history and notify you if you may be affected.
(Query times in milliseconds)

New Features

Minor Improvements

We continue with cleaning up the KBC UI. So far, we have fixed many little annoying issues:

  • List of configurations now shows when the configuration was created (with exact date on hover) 
  • Cleaned up Job list (removed unused stuff).
  • Backend in Transformations is now preselected to default project backend.
  • CSV importer now supports .TSV and .GZ files too.
  • "Test Credentials" button and result polished.
  • Removed 'sticky' buttons when editing configurations.

Fixes

  • Fixed files input mapping not showing in certain configurations.
  • Fixed a couple of errors with the Save button when editing transformation queries.
  • Fixed bug in Redshift writer with mixed case table names.

Developers

  • The encryption API is simplified to a single endpoint. If you manually encrypt values for KBC, please follow the docs. We will be contacting you if you are using the deprecated API calls.


Job Failures [Not Resolved]

Today, October 4, 2017, we experienced several jobs failures between 12:07--14:40 PM CEST. One of our worker servers became unresponsive which led to the jobs failures. We have shut down the instance and launched a new one. Everything is working properly now and we will further investigate the root cause of the issue. 

UPDATE 09:00 PM CEST 
We're still encountering rare job failures. We're monitoring the issue closely and trying to find the root cause.

We are sorry for any inconvenience.

Week in Review -- September 26, 2017

New Features and Improvements

  • Geneea NLP app now supports relations - e.g. My pizza was completely burned. > burn(OBJECT:pizza)
  • Redshift transformations input mapping now supports ZSTD compression.
  • Improved handling of events search errors

New Applications

GeoIP

GeoIP is latest transformation component power by MaxMind. It helps you to obtain location data from your IP address inputs.

Screen Shot 2017-09-18 at 23221 PMpng

Please check out the BitBucket Documentation to get you started.
Screen Shot 2017-09-18 at 24213 PMpng


Data Health Application

Data Health Application is an app designed to aid users to produce a clean data file. For more details, please check out Keboola Blog.

Screen Shot 2017-09-20 at 120626 PMpng




Job Failures [Resolved]

Today, September 25, 2017, we experienced jobs failures between 15:11 - 16:15 PM CET. One of our worker servers went down and while launching a new one automatic job restart mechanism didn't seem to work properly and this led to the jobs failures. Everything is working properly now and we will further investigate the cause of the issue. However we recommend to review your orchestrations and take appropriate action if needed. 

We are sorry for any inconvenience.

Skipped Orchestrations at 0:00 UTC

A few Orchestrations which were scheduled to run at exactly midnight UTC may not have started due to an issue with the Orchestration Scheduler. The issue arose on the 15th of September and has now been resolved.

If you have orchestrations which are scheduled to run at 0:00 UTC, please check that these orchestrations have run correctly.


Sincere apologies for the inconvenience.

Snowflake Incident

We are investigating Snowflake partial outage. Queries are now queued.

We will inform about the progress.

UPDATE 11:21 AM PDT Snowflake warehouses are up and running. Queued queries are being processed. We will update the post when we'll have more information about incident cause from Snowflake engineering.

Week in Review -- September 11, 2017

New Features

  • Generic Extractor introduces some backward incompatible changes, but your current running configurations will remain unaffected. Learn more about Generic Extractor compatibility levels.
  • Generic Extractor supports stopping pagination using an attribute in the response, see more on the Limit Stop feature.

Minor Improvements

  • Processors configuration is now editable where eligible.
  • Transformation scrips and queries editors link to the documentation. 

Fixes

  • Transformations UI refreshes properly on transformation or bucket delete or revert/rollback.
  • Transformation copy or restore does not delete transformation name and description.

Week in Review -- September 5, 2017

We've spent a lot of time on squashing bugs in GoodData Writer, Google Drive Writer, Docker Sandbox and Gelf logger and on several new features which are not yet ready. Besides, there are two nice things we can tell you about.

UI of the KBC is being revised for a few weeks now and you can see the first results in the unification of buttons for creating new resources. 

Database Writers now allow triggering `nullable` values for all columns at once.