Keboola Status

New Features, Improvements and Minor Fixes

• From now on, you can use the U2F hardware device for multi-factor authentication. 

• Support for zlib was added to the Decompress processor. 
• Performance of saving orchestration tasks was improved.

New Components

• Compress processor — compresses files into a specified format.
• CleverMaps SpatialUtils app  from CleverAnalytics — provides basic spatial functions for processing CSV files with geometries.
  

Few orchestrator and transformation jobs were restarted on September 16, 06:36 UTC. 

This was caused by issue in zone rebalancing. We apologize for the inconvenience.

We are investigating job failures in EU region started at 1:32 UTC.

We will provide an update when we'll have more information. 

UPDATE 06:06 UTC - We have identified the issue and fixed the cause. Backlog is processing now.

UPDATE 07:54 UTC - There is still backlog of orchestration jobs. We have increased the processing capacity. It should be cleared in half an hour.

UPDATE 08:26 UTC - The backlog was cleared. All services are running.

We apologize for the inconvenience, we'll share more details in a post-mortem.

New Features, Improvements and Minor Fixes

• When checking events in the job detail, the Load More button tries to load up to 1,000 events at once.
• You can search in component configurations when adding a new task to an orchestration phase.

• MongoDB extractor supports an optional Authentication Database parameter.
  
  

• Refreshing your token no longer breaks access to your project.
• Remove Empty Files and Folders processor has a new option available to remove files with whitespace characters only: remove_files_with_whitespace
  

New Components

• Bitbucket extractor for getting data about commits to your team's repositories
• PowerBI writer
• Sendinblue application for relationship marketing 
• SurveyMonkey extractor
  
• MapboxUtils application by CleverAnalytics for manipulating vector tilesets on Mapbox

Support for deprecated GoodData Writer v2  is coming to its end, the writer will be shut down on September 30, 2019 .

If you are still using the old Writer you should see a deprecation notice in Keboola Connection. Please proceed to migration.

If you need any help migrating the writer, contact Keboola support.

This is a reminder that the Deprecated  OAuth broker will be shut down on September 30, 2019. 

Please start the migration if your projects aren't migrated yet. If you have any questions please contact Keboola support.

We are experiencing some jobs failures and timeouts in the US region due to a shortage in one availability zone in the Amazon Elastic Compute Cloud service. We are going to monitor the situation and keep you posted.

UPDATE 15:48 CEST: Apparently it has some overlap to other AWS services too because login to Developer Portal (which uses AWS Lambda and Cognito) timeouts intermittently.

UPDATE 15:54 CEST: AWS confirms that some EC2 instances are impaired and some EBS volumes are experiencing degraded performance within a single Availability Zone in the US-EAST-1 Region. Some EC2 APIs are also experiencing increased error rates and latencies. They are working to resolve the issue.

UPDATE 16:37 CEST: The works on resolving the issue are still in progress.

UPDATE 17:06 CEST: The impaired instances and EC2 APIs are being recovered. AWS support continues to work towards recovery for all affected EC2 instances.

UPDATE 18:04 CEST: Recovery is in progress for instance impairments and degraded EBS volume performance. On our side, it looks that the problems more or less disappeared an hour ago and the platform is back to normal.

Summary

On 2019-08-15 12:23 UTC, we deployed a broken version of Keboola Connection. It prevented some users from accessing their projects. The problem was fixed at 13:01 when we rolled back to a previous version. We sincerely apologize for interrupting your work and wasting your time.

What Happened?

There was an error in a permission check, and only users with the permission to create a project were allowed to enter a project. Such a scenario is not covered in the functional tests, and the situation was overlooked during peer review of the change. As soon as we identified the problem, we immediately deployed a previous version of Keboola Connection. That itself took about 15 minutes.

What Are We Doing About It?

We're extending the software tests to include more scenarios.

We're also updating monitoring alarms to make sure that we know about a problem before you tell us through our support channel.

New Features

• Tables in shared buckets and table aliases now contain metadata from the source tables. In practice, this means that when you create an input mapping for transformations using tables in shared buckets (or aliases), you see the source table data types.

• In the API response, the source table metadata are contained in the `sourceTable` node – so both the table and alias metadata are available.

New Components

A number of components by Revolt BI:

• Daktela Extractor (revolt-bi.app-daktela) – extracts and transforms data from the Daktela service using Daktela API V6.

• Divide CSV into Batches processor (revolt-bi.processor-batchify) – converts CSV files into several batches of CSV files with a header.

• Favi.cz Extractor (revolt-bi.ex-favi) – scraper for https://www.favi.cz/

• RTB House Extractor (revolt-bi.ex-rtbhouse) – extractor for RTB House Panel

Updated Components

GoodData Writer

• Supports reading the Logical Data Model (LDM) from a project.

Minor Improvements & Fixes

• Google Drive verification issue in the EU region has been resolved.

• In the input mapping of Snowflake transformations, the TIMESTAMP data type now defaults to TIMESTAMP_NTZ.

• Terminated job is colored in the same way as a terminated label.

There is an issue which causes a 404 error (Page not found) to be displayed after login. We're working on a fix, which should be ready shortly.

The issue affects only log-in of certain users on the UI. Jobs running inside projects are unaffected.

Update 13:01 UTC: The problem is fixed. We apologize for the inconvenience, we'll share more details in a post-mortem.