Week in Review - December 11th, 2020

New Components

Updated Components

  • Generic extractor – supports client certificates. This is needed if the server requires two-way SSL authentication, so in addition to the verification of the server, the server also verifies the client.

Week in Review - December 7th, 2020

General updates

  • New wishlist – the old wishlist was replaced with a new, more transparent one. You can find it at https://ideas.keboola.com or in the "Settings Menu" in your projects.
  • New Keboola Connection instance running on Azure is available in Europe – https://connection.north-europe.azure.keboola.com
  • SQLdep removed – we were forced to remove SQLdep from Keboola Connection as the service is shutting down.
  • New on-boarding experience - starting from November 16, 2020, new users will no longer get Guide Mode projects. They were replaced by a new interactive wizard inside each project.
  • Migration of projects to Azure stacks – it's now possible to migrate projects in AWS stacks to new Azure stacks [see the documentation].
  • Shared workspaces – this feature is available only to customers with new transformations.
If you share a workspace, all project users will be able to use/restore it. Only workspace creators/owners can delete workspaces. 
In the list of workspaces, there’s a new column indicating if a workspace is yours and if it is shared or not.

New Components

  • Google Ad Manager Report Service exctractor – downloads reports from the Google Ad Manager API. It uses ReportService.ReportQuery to download data.
  • Generic writer – sends data to REST-like APIs either as JSON or as a BINARY payload.
  • B!Q GoodData Telemetry extractor – uses the GoodData API to get info about users, projects, dashboards, reports, and uploaded datasets.
  • Klaviyo extractor – fetches customer profiles, lists, campaigns, and metrics from the Klaviyo email marketing platform.
  • Klaviyo writer – creates/updates customer profiles and manages a list of memberships and subscriptions on the Klaviyo email marketing platform.
  • Azure Blob Storage V2 extractor – extracts a single or multiple CSV files from a single or nested folders from an Azure Blob Container and stores them into Keboola Connection.
  • Looker Schedule Runner – forces a new cache on your dashboards by triggering a dashboard export, which will execute a query and refresh the cache of your dashboard.

Updated Components

  • FTP extractor – has a new option “Ignore passive address”. It solves the problem when a server offers a random port for communication but the port is blocked by firewall.

UI Improvements

  • Input Mapping – data types are available for the Snowflake transformation. This feature is available in new PAYG projects and for customers with new transformations only [see the documentation].
  • Option validate and SQLdep removed

  • Transformations have been split into Transformations and Workspaces (applies to new transformations only).

Component synchronization down in all regions

Since 2020-11-25 13:45 UTC we have noticed an unfunctional synchronization of components between Keboola Connection and the Developer portal. The problem concerns AWS in the US region. Working in Keboola Connection is not affected by this error. It has an impact on the release and synchronization of components. You also cannot log in to the Developer Portal.

We are going to monitor the situation and keep you posted.

Update Nov 25, 2020 16:11 UTC - We have identified a problem. The outage is on the AWS side.

Update Nov 25, 2020 16:19 UTC - We found that the problem affects both AWS and Azure in all regions. Next update in 30 minutes.

Update Nov 25, 2020 16:59 UTC - Outage on the AWS side persists, see the status page. We continue to monitor the situation. Next update in 1 hour.

Update Nov 25, 2020 18:10 UTC - Outage on the AWS side persists. We continue to monitor the situation. Next update in 2 hours.

Update Nov 25, 2020 20:15 UTC - Outage on the AWS side persists. We continue to monitor the situation. Next update in 2 hours.

Update Nov 25, 2020 22:17 UTC - Issues on the AWS side are reducing. Login to the Developer Portal is already working and we are monitoring successful component synchronizations across all regions. Next update on Nov 26, 2020 06:30 UTC 

Update Nov 26, 2020 07:05 UTC - Work on the AWS side to troubleshoot still continues, but the error rate is reduced. We are no longer experiencing any issues with component synchronizations or other Keboola Connection services. We continue to monitor the situation. Next update in 4 hours.

Update Nov 26, 2020 10:23 UTC - Issues on the AWS services are solved. The incident is now resolved.

Investigating Sandbox API issues in Azure regions

We're investigating an issue with Sandbox API in our Azure regions. Next update in 5 minutes. 

Update Nov 19, 2020 09:03 UTC - Configuration issue caused the release of Sandbox API today at 8:23 UTC that did not work properly. The problem was noticed and rollback began. At 8:58 UTC the release was rolled back. We're verifying that the issue is resolved. 

Update Nov 19, 2020 09:10 UTC - We verified that the rollback restored the API to a fully working condition. The incident is now resolved. 

Configuration editor broken across all regions

We're investigating problems with configuration editor. 

Update Nov 19, 2020 07:00 UTC - Configuration editor is broken across all regions. We're working on a fix that should be ready shortly. Sorry for inconvenience. Next update in 30 minutes. 

Update Nov 19, 2020 07:19 UTC - Change causing the issue has been rolled back and we're in a process of verification that the issue is resolved. Next update in 30 minutes. 

Update Nov 19, 2020 07:28 UTC - We verified that the change causing the issue is rolled back on all regions and the configuration editor is working normally. If you're still experiencing issues with the editor, please contact support individually using support button in your project. 

Azure EU Maintenance Announcement

A maintenance of Azure EU Keboola Connection (https://connection.north-europe.azure.keboola.com/) will take place on Sunday, Nov 15th, 2020 from 08:00 UTC  and should take less than two hours.

During the maintenance, you can't access your projects. Orchestrations and running component jobs should be generally delayed, but not interrupted.  However, feel free to re-schedule your sunday's orchestrations to avoid this maintenance window.

Update Nov 15, 2020 08:00 UTC  - The maintenance started.

Update Nov 15, 2020 08:36 UTC  - The maintenance is over. Azure EU Keboola Connection is up and fully operational.

Investigating Increased Snowflake Errors in the US Region

We are encountering increased error rates from Snowflake in the US Region and are currently investigating the cause.
We will update here again as soon as we have relevant information or if 60 minutes have passed.

Update Oct 27, 2020 17:17 UTC:  The error rate has returned to normal since 16:55 UTC.  We are continuing to investigate the root cause.

Update Oct 27, 2020 18:57 UTC: Snowflake has released a status report.  The errors continue to occur, but at a reduced rate.

Update Oct 27, 2020 19:29 UTC: Snowflake has reported the incident as resolved.

Investigating Snowflake Performance in the EU Region

We are experiencing a minor slow down of performance on Snowflake in the EU Region and are currently investigating.
There are no job failures or increased queue backlog but everything seems to run slightly slower.
The next update will be in 120 minutes or as new information becomes available.

Update October 26 2020, 12:50 UTC: Performance has for the most part recovered, the rate of long execution of some queries has dropped significantly, but hasn't quite completely disappeared.  We will update again if the issue re-surfaces.

Week in Review - October 20th, 2020

New Components

  • POP3 Attachment extractor – allows you to download email attachments from a POP3 mailbox. There is no restriction on attachment type, so you can also download XLS files or images.

Updated Components

  • MongoDB extractor – added an option to “Include parent in Primary Key” in Mapping mode. This will allow better PK generation and the behavior will be much more consistent with Generic Extractor.
  • Looker writer – added support for Google BigQuery as the underlying database.

UI Improvements

Selecting a whole bucket in Input Mapping is now possible even if there are collisions between table names, or if there’s already a table from the specific bucket:
  • If there's a name collision, a numeric suffix is added (for example, if there is an account table from another bucket and you add a new bucket which has a table with the same name, it will be named account_2).
  • If there are already tables from the bucket, only the remaining tables will be added.

Force Unlink

There’s a new option to “force unlink” a bucket from projects that have it linked. When you disable sharing, it will “force unlink” the bucket automatically.

Edit Bucket Sharing

From now on, if there are projects that have the bucket linked, you can only add more projects/users. Edit sharing is available from “shared from this projects” list and from “bucket detail in data catalog” pages (if you have sufficient privileges). Until the bucket is linked, sharing can be changed without limitations.

Investigating EU overload

We experienced overload in EU

Since 2020-10-15 10:02 UTC Start investigating overload in EU. Next update in 1 hour or as new information

UPDATE 2020-10-15 11:14 UTC: All operations are back to normal and everything is fully working. No jobs should be affected.