Week in Review -- March 13, 2017

New Components

Snowflake Extractor
  • Snowflake Extractor is now in private beta. For an early access please contact us at support@keboola.com.

Minor Improvements

  • Next Event application now estimates the date of the next event

Fixes

  • Fixed all dead links on status.keboola.com and help.keboola.com

  • Google Sign In correctly redirects after authorization

  • Keboola Connection cookies use the secure flag

  • Password reset does not leak information about (non)existing user

  • Orchestrator trims notification email addresses, no more whitespace mess

  • GoodData Writer properly propagates errors when creating a new writer

  • GoodData Writer does not remove our domain admin from a project which is shared among more writers


Failing GoodData Writer Jobs

We've noticed some write jobs to GoodData have been failing since their most recent maintenance period.  

We're investigating the issue and will update here as soon as possible.

Update 11:30AM March 12, 2017

The failures were due to a breaking change update to the GoodData date dimension API during their last maintenance period.   It should only affect projects which are using custom date dimensions.  We are currently assessing options to remedy the situation.

Update 20:30 CET March 12, 2017

For any orchestration that failed to write to GoodData this weekend, in order to have it run correctly, please edit the task and change the action from `upload-project` to `load-data`.  It should then work correctly if you re-run it. 

Please note however that new writers with custom time dimensions, or changes to old configurations which had them, may still fail.

Update 13:20 CET March 13, 2017

GoodData has fixed the issue. All existing configurations should work now. The switch from `upload-project` to `load-data` is no longer required, but we still recommend it as best practice to prevent possible future issues.

Update 07:00 CET March 14, 2007

In some cases the GoodData writer jobs are still failing. Switching to `load-data` is the correct remedy. Read what GoodData has to say.

Update 15:47 CET March 14, 2007

The issue seems to have been completely resolved as per GoodData Support.  

Week in Review -- March 6, 2017

Minor Improvements

  • We have upgraded the Google Sign-in to the latest most secure version.

Fixes

  • Dropping a empty primary key in Storage no longer causes an error.

  • Creating a Storage table with a missing S3 file now returns a proper error message.

  • Handle correctly a situation when a primary key is supplied as an array to a Storage table.


Week In Review -- February 13 and 20, 2017

Google BigQuery Writer in private beta

We've been working hard on a BigQuery writer for the Google Cloud Platform.  If you'd like to get early access for the beta release, please let us know at support@keboola.com.

Azor Extractor

There is a new third-party extractor for Azor.  Azor is a Czech service that allows you to monitor your competitor's products prices and availability.

Fixes

  • Trying to add a column with the same name as an existing column, but only different casing will result in an error message.  (ex: customerEmail and CustomerEmail)

  • Table ID was added to workspace loading errors to help determine the cause of the error.

  • Attempting to create an output table with column names beginning with "_" will result in an error.





AWS S3 Outage Resolved

Amazon services are almost restored. Our infrastructure recovered too, everything should be running now. Though the waiting times are expected to be longer. 

We're sorry for this inconvenience and thanks a lot for your understanding and patience.

AWS S3 Outage

Keboola Connection is suffering very hard from the ongoing AWS S3 outage. All workers are down, lots of functionality is broken. For more details please see https://status.aws.amazon.com/

Once the AWS team fixes the issue, Keboola Connection will be up and working again. 

We're sorry for this inconvenience and thanks a lot for your understanding and patience.

Failed jobs

On Sat, Feb 25, 04:05 AM UTC+1 one of our AWS RDS server was restarted. This lead to loss of connection between our lock server and job processes. The outcome may be following

  • Orchestrations, that have all tasks successfully finished, but the orchestration itself failed
  • Failed tasks within orchestrator; the task execution finished successfully, only the job status was not saved correctly
  • Job was scheduled to execute again while it was still running, and especially in transformation jobs this lead to simultaneous execution in the same database/workspace

We will resume all orchestrations, that have failed tasks due to this outage (starting at the task following the failure).

We're sorry for this inconvenience, we're working towards mitigating this bug in the future.

Week In Review -- February 6, 2017

Improvements

  • Description of transformation configuration shows up in a preview

  • Improved description of deprecated GoodData extractor migration 

  • Goodata user role Keboola Editor Plus has been extended by the following permissions:
    • canValidateProject
    • canCreateFolder
    • canManageAttribute
    • canManageAttributeLabel

Fixes

  • Fixed Storage Api bug caused by unlinking a shared bucket from a project containing more shared buckets.

Failed jobs

There were  jobs failures between 1:30 AM - 3:30 AM UTC caused by flooded disk on one of our servers. We are investigating the causes of the issue.

We're sorry for this inconvenience.

Week In Review -- February 2, 2017

New features

Bugfixes and minor improvements

  • Fixed setting of primary key on Redshift backed table when table contained column name row_number
  • Invalid data type errors are propagated to user when loading data into sandboxes or transformations
  • Access to snowflake sandbox https://keboola.snowflakecomputing.com/console sometimes didn't work. Fixed.
  • Fixed frozen table selector in writers
  • CSV import - gzipped files are supported
  • It is now possible to select server version in SQL Server Database Writer:

Developers