Delayed orchestrator in EU region

[13.07.2018 10:45 CET]

We're currently investigating delayed orchestrator launches in EU region. 

[13.07.2018 11:13 CET]

There was a problem with one of our nodes that delayed and in some cases even made it impossible to launch orchestrations. All affected customers are now moved to a new node and orchestrator operates normally. We're monitoring the performance of other nodes to make sure everything works. 

We also notices somewhat similar behavior in one of the nodes in US region. We retired the node as well as a preventive measure. So far we have no information of any customer impacted by this issue in US region. 

New version of Sklik Extractor

Our Sklik Extractor gets a new version updated to use Sklik API version Drak. It allows you to download data about any resource supporting methods createReport and readReport (see Seznam's blog post for more information). 

The new API uses different logic for structuring the data so unfortunately, we can't offer automatic migration. See extractor's documentation for more information about its configuration.

The old extractor is deprecated and will be shut down by the end of August.

Week In Review -- July 9, 2018

New Components

Updated Components

  • The GoodData Reports extractor now accepts an optional host parameter so it will work in the EU or any custom domain.
  • The Email Attachments extractor has been updated with the following improvements
    • It now strictly enforces the one text file attachment per email rule
    • It ignores any non-textual attachments (signature images etc...)
    • It can process multiple emails simultaneously
  • The Gmail Extractor no longer has a limit of 65k for fields (backend storage limits still apply)
  • The HTTP Extractor now accepts a "maxRedirects" parameter to tell it how many times to retry when it receives an http redirect status code. 

Minor Improvements

  • R has been updated to version 3.5.0 (for transformations and RStudio sandboxes)



Processing delays for GoodData Writer jobs in the EU region

[02.07.2018 8:06 CET]

We're experiencing some delays in the processing of GoodData Writer jobs in the EU region, and are currently investigating the cause of the issue.

UPDATE [02.07.2018 10:06 CET] 

The tasks are queued in GoodData EU platform. We are investigation this issue with GoodData support.

UPDATE [02.07.2018 15:27 CET] 

The issue has been resolved, and all GoodData Writer tasks in the EU region are working normally again.


Week in Review -- June 6, 2018

New Features

Orchestration Description
  • You can describe your Orchestrations now. This can be useful when you collaborate with your colleagues or want to quickly find what you need among dozens of Orchestrations.


Orchestration Versioning
  • Also, Orchestrations just got their internal versioning system (joining Extractors, Writers and Applications). At this stage, the versioning is read-only, so you can compare two versions. Rollbacks and revision copies will be added soon.


Minor Improvements

MySQL Writer
  • Improved performance of incremental load. Also, the writer now checks if the primary keys in its configuration match with those in the target database table.


Fixes

  • Google Calendar Extractor is now available also in the EU region.

GoodData Writer Issues

Today between 2:30 and 7:00 CEST we experienced issues with GoodData Writer. Ironically, it failed to connect to a third-party service for utilization monitoring. The problem was fixed so there should be no other job failure. We are going to inspect the extent of the damage.

Week in Review -- May 16, 2018

Core

Components

Bugfixes

  • Component configuration state is not updated in case of attached processor failure. e.g in case of AWS S3 extractor and New Files Only option in leaves files as unprocessed in case of processor failure so the files can be processed again until the whole pipeline of processors is executed successfully.
  • MSSQL Writer - fixed support of unicode characters
  • Google Sheets Writer - fixed writing of large tables without performance issues
  • When specifying transformation output mapping, the bucket name is automatically webalized as being typed

Developers

We are happy to introduce the first version of Keboola Storage API Javascript client.


SQL Server Extractor Connection Issues

Between 17:00 May 15, 2018 and 8:00 on May 16, 2018 CET we experienced issues with the SQL Server database extractor. We recommend to review your orchestrations and take appropriate actions if needed.

If you were affected by this, please accept our sincere apologies.

SQL Server writer failures

Between 9 May 2018, 10:53 CEST and 11 May 2018, 09:30 CEST there were job failures for SQL Server Writer configurations that had nullable data types. The issue was created by a new version of the writer so we have rolled it back to the  previous version while we investigate the root cause.

We're sorry for any inconvenience.