Deprecated Facebook Ads API v2.9

Facebook is deprecating Marketing API v2.9 on Monday, November 13, 2017 thus any api call to v2.9 will fail with error.

The latest version is now v2.10.

The migration should only require changing the api-version parameter in all existing configurations of our Facebook Ads Extractor. However, since there may be some breaking changes, we strongly recommend to change the api-version in your configurations manually, review any possible changes and take the appropriate actions.  For more details on the new version, please read Marketing API Changes in v2.10 in the Facebook API Changelog.

Possible breaking change might be renaming of action_link_click_destination breakdown types as follows:

  • app_store_clicks => click_to_app_store
  • deeplink_clicks => click_to_app_deeplink
  • website_clicks => click_to_website

In other Facebook news, they have announced version v2.11 of Facebook Graph API and Facebook Marketing API, for more info read changelog here.

Week in Review -- November 6, 2017

New Features

  • Finer granularity in all input mappings. The Days parameter was renamed to Changed in last and you can set the interval of changed data to as short as 10 minutes. Please note, that combining a legacy Days value with a new Changed in last is not allowed (eg. in a transformation chain, where the same table gets imported multiple times, all input mappings have to use the same filter type).

Minor Improvements

  • All new transformations come with a predefined boilerplate that will help you at the start. It is especially useful for Python and R transformations.
  • Sliced tables in Storage console (eg. exports from a Snowflake backend) are now merged when downloaded.
  • Database extractors display the name of the query that failed in their error messages.

Updated Components

  • Oracle DB Extractor and Writer are now available in the EU region.

Fixes

  • Input Mapping modal has autofocus in the Source field when opened.

End of life of Keboola Academy

All things have to come to an end and Keboola Academy’s GoodData training is no exception. But don’t mourn, we are working hard on a new education program. Its main focus will be Keboola Connection.

Keboola Academy courses will be available for purchase until December 31, 2017. After that, you won’t be able to purchase new courses, but you’ll still be able to access your already purchased courses for another two months. Courses will be shut down completely on February 28, 2018.

If you have any questions, please contact us via support@keboola.com.

Week in Review -- October 20 and 27, 2017

New Applications

Dark Sky Extractor

Dark Sky is the new name for the old Forecast.io service. So we have prepared a new extractor for it.  It allows you to look up the weather anywhere on the globe. You can use our migration tool to migrate your existing configurations from the deprecated Forecast.io extractor.

For more information, please see our documentation.

Currency Extractor in EU region

This extractor is now also available in the EU version of Keboola Connection.

Features

  • Dropbox Writer now allows you to specify a custom destination folder name for uploaded data.
  • We have added the ability to configure your own OAuth credentials.  We did this because we are still waiting for quota limits increase for the Google Analytics API for our Google Analytics Extractor.  So now your extractor can run under independent quotas.
  • Tableau Writer now uses the new version of Google Drive and Dropbox Writers to upload data to Tableau.
  • Removed 8 kB script size limit in Rstudio/Jupyter sandboxes
  • Improved handling errors in Rstudion/Jupyter sandboxes. Invalid package names will now throw an error with an explanation instead of an application error.
  • Read-only bucket credentials to your Redshift backend are now deprecated. See this more detailed post about accessing your data since April 18, 2018.

Fixes

  • Table import events in the Storage panel once again have a link to the imported file.

Failures

Unfortunately on Sunday we had some problems with our storage for KBC Events, which delayed execution of jobs.  We apologize for any inconvenience that may have caused.

Job Failures Sunday, October 22, 2017

We have been experiencing temporary technical difficulties today since this morning (~ 3:00 AM CET)

Some jobs may have failed as a result.

We're working on resolving the problem and will update here with further information when we have it.

Thank you for your understanding.

Update 14:00 CET, October 22, 2017:  All systems have returned to normal operations and all jobs are now being processed normally.

Deprecating Redshift Bucket Credentials

In November 2014, we were really happy to announce a new cool feature -- Read-only bucket credentials to your Redshift backend. Time has passed and we have decided to deprecate this feature.

Though accessing data in a bucket is very useful, with the current scenario it can lead to an assumption how data is stored and how it'll be stored in future. The latter is much worse, because any change in our backend can lead to breakage of the system, which was programmed to access the data in a bucket.

Thus, we recommend you to access your data in a more robust way:

  1. Create a new Redshift Writer
  2. Choose a database provided by Keboola or your own Redshift database
  3. Configure which tables you need to synchronize
  4. Run the newly configured writer
  5. Copy the credentials created in step 2 to the software which needs to access your data

The existing Bucket credentials continue to work until April 18, 2018. However, we strongly recommend to migrate to the Redshift Writer as soon as possible.

The creation of new credentials and credentials listing will be disabled in the Storage section with the publication of this post.

Also, the Bucket credentials have been marked as deprecated in our Storage API.

Week in Review -- October 9th, 2017

The longstanding issue with slow SHOW DATABASES query executions on Snowflake has finally been resolved. We will now gradually enforce snowflake query execution limits where applicable by contract. Before turning the limits back on, we will check the query history and notify you if you may be affected.
(Query times in milliseconds)

New Features

Minor Improvements

We continue with cleaning up the KBC UI. So far, we have fixed many little annoying issues:

  • List of configurations now shows when the configuration was created (with exact date on hover) 
  • Cleaned up Job list (removed unused stuff).
  • Backend in Transformations is now preselected to default project backend.
  • CSV importer now supports .TSV and .GZ files too.
  • "Test Credentials" button and result polished.
  • Removed 'sticky' buttons when editing configurations.

Fixes

  • Fixed files input mapping not showing in certain configurations.
  • Fixed a couple of errors with the Save button when editing transformation queries.
  • Fixed bug in Redshift writer with mixed case table names.

Developers

  • The encryption API is simplified to a single endpoint. If you manually encrypt values for KBC, please follow the docs. We will be contacting you if you are using the deprecated API calls.


Job Failures [Not Resolved]

Today, October 4, 2017, we experienced several jobs failures between 12:07--14:40 PM CEST. One of our worker servers became unresponsive which led to the jobs failures. We have shut down the instance and launched a new one. Everything is working properly now and we will further investigate the root cause of the issue. 

UPDATE 09:00 PM CEST 
We're still encountering rare job failures. We're monitoring the issue closely and trying to find the root cause.

We are sorry for any inconvenience.

Week in Review -- September 26, 2017

New Features and Improvements

  • Geneea NLP app now supports relations - e.g. My pizza was completely burned. > burn(OBJECT:pizza)
  • Redshift transformations input mapping now supports ZSTD compression.
  • Improved handling of events search errors

New Applications

GeoIP

GeoIP is latest transformation component power by MaxMind. It helps you to obtain location data from your IP address inputs.

Screen Shot 2017-09-18 at 23221 PMpng

Please check out the BitBucket Documentation to get you started.
Screen Shot 2017-09-18 at 24213 PMpng


Data Health Application

Data Health Application is an app designed to aid users to produce a clean data file. For more details, please check out Keboola Blog.

Screen Shot 2017-09-20 at 120626 PMpng




Job Failures [Resolved]

Today, September 25, 2017, we experienced jobs failures between 15:11 - 16:15 PM CET. One of our worker servers went down and while launching a new one automatic job restart mechanism didn't seem to work properly and this led to the jobs failures. Everything is working properly now and we will further investigate the cause of the issue. However we recommend to review your orchestrations and take appropriate action if needed. 

We are sorry for any inconvenience.