Due to a bug in AWS Redshift that we're unable to resolve without service interruption we're announcing system wide Redshift backend maintenance on September 24th.

The bug shows increased table sizes. If you're experiencing unexpected project size growth you might be affected by this bug.

During the maintenance all data on Redshift backend in affected projects will be unavailable and all Redshift transformations will not be able to execute. The maintenance will last around 3 hours. 

The schedule of the maintenance in different timezones is following:

PDT: Saturday, 24 September 2016, 05:00:00-08:00:00
UTC: Saturday, 24 September 2016, 12:00:00-15:00:00
CEST: Saturday, 24 September 2016, 14:00:00-17:00:00

If you're concerned about the maintenance or you need to schedule a different time please contact us at support@keboola.com.

Update September 16th: The maintenance is cancelled. We're working on an on the fly detect-and-fix solution. Release date unknown yet, so if your project shows any growing table size symptoms, contact us at support@keboola.com to help you fix the problem.

Our AdWords Extractor will be updated to use new version v201607 of AdWords API on Monday September 12. Please be sure to update your configuration to not use no longer supported metric names till then. Also do not use new metrics until the update, we will let you know about it. See release notes and migration guide for more information.

Snowflake is experiencing service outage which impacts projects with Snowflake backend.

Snowflake team is working to restore services as quickly as possible. 

https://support.snowflake.net/hc/en-us/articles/213508163-August-23-2016-Service-Disruption-Update

We are sorry for any inconvenience.

UPDATE 11:12am PST

Snowflake service is back up and running.

Since our last update here's what happened in Keboola Connection

• David Ešner updated the Mailkit Extractor to retrieve raw campaign data from the API
• We have reworked the Google Analytics Extractor and we'll start offering migration tool this week

Bugfixes, minor changes

• The UI loads configuration changes in the background, so it should stay up to date. This does not work when the configuration is open for editing.

Mailkit has extended its API with new functions allowing retrieval of RAW data about your campaigns. A new functionality has been added to the Mailkit Extractor as well to match the new API modifications. Now you can retrieve all data using the new three functions. They are designed to pull large volumes of data and the retrieval is much faster than with the original recursive functions. 

More information about the modification can be found in the documentation.

After last GoodData maintenance some uploads to GoodData using our writer are started failing with the following error:

Running the LoadData task again manually will be successful. If you're running more tasks in one job, you can disable the failing job to get all the other tasks through. We have discussed the error with GoodData support and this is what they have to say:

I have already confirmed by our R&D engineers, that we have introduced the issue during the R119. We have prepared the fix for the issue and the internal discussion about the fix delivery has already been triggered. The fix unfortunately requires short time (up to 10 minutes) GoodData upload subsystems outage, therefore the our responsible managers are trying to find the best window for its delivery.

I can also confirm, that temporal switching OFF of the gZip in the command would serve as workaround, but I do as well understand the concerns you are mentioning that keeping you away of using it.

I'll share further information w/ you as soon as I have them available.

Currently we cannot turn off gzipped transfers for all projects as it will slow down all uploads. Let's wait if GoodData can release the fix during the weekend and if not, we'll implement temporary gzip disabling for affected projects early next week. Please bear with us, feel free to drop us a line at support@keboola.com if you're concerned about your project.

UPDATE 4:08pm CEST: GoodData announced maintenance for August 20th 2016. During this maintenance this bug should be resolved.

UPDATE Monday August 22 7:30am CEST: We're still rarely experiencing this issue.

UPDATE Monday August 22 2:40pm CEST: We have deployed a workaround fix for the bug so GoodData data loads now should work as expected.

We're sorry for this inconvenience.

New version of Google Analytics Extractor is now available. The old one has been marked deprecated.

Features

Google Analytics Extractor now works with the newest Google Analytics API V4, providing these key features:

• Metrics expressions

  The API allows you to request not only built-in metrics but also combination of metrics expressed in mathematical operations. For example, you can use the expression ga:goal1completions/ga:sessions to request the goal completions per number of sessions.

• Multiple date ranges

  The API allows you to get data from 2 date ranges with a single request.

• Multiple segments

  The API enables you to get data from multiple segments with a single request.

Migration

Since our last update here's what happened in Keboola Connection

• Radek Tomasek from BlueSky Digital introduced his new IBM dashDB writer
• Sun Marketing introduced extractors for Heureka.sk, Pricemania.sk and Srovname.cz 
• We have introduced versioning and diffing   to the majority of our components
• We've introduced a replacement Storage API Importer
• Custom Science applications are finally public - it's your GitHub/Bitbucket code in R, Python or PHP executed in our infrastructure
• We have announced switching from VPNs to SSH tunnels
• There's a new Redshift DB extractor
• The JSON Parser public service now runs over HTTPS and has better error messages

Bugfixes, minor changes

• Facebook Ads extractor was updated to API v2.7

Since 2016-07-28 there were no updates in our currency tables. This was fixed today and all records were pushed into all projects that have Currency Extractor set up. 

We're sorry for this inconvenience, let us know, if you have any concerns about this at support@keboola.com.

It's my pleasure to introduce another component into the family of Keboola Connection ecosystem: IBM dashDB Writer.

IBM dashDB is a new generation analytical datawarehouse. Build on core of DB2, Powered by in-memory and columnar storage and enhanced by in-database analytical functions migrated from IBM Netezza. You will find more in the documentation.

The current version of the writer supports transfers of the objects from Keboola Storage into dashDB tables and at the moment just full loads are supported. But you should have no problem to transfer even bigger files in decent time.

This writer is developed independently by Radek Tomášek with huge support of IBM. For more information on how to use the writer, please refer to the documentation.