New components

• Leo Chan developed another component allowing users to download details and reviews of places from Google Maps. See more information in our Developer Portal.
  

  
• Revolt BI developed an extractor downloading data from Fingera - access control and attendance management system.
  

  

Bug fixes and smaller improvements

• Bug fix in Currency extractor - exchange rates for Danish Krone (DKK) and Icelandic Krona (ISK) were not updated for some time because of a bug in its configuration.
• Snowflake extractor now offers views in the tables list too.

Snowflake has a wonderful feature that they call Time Travel.  It allows you to replicate your table from its state in the past.  We're happy to announce initial support for this great feature in Keboola Connection. 

To begin with, every project with a Snowflake backend has been set to retain data history for 7days. That means that you can restore a table to how it existed at any point within the last week.  It is possible to increase the data history retention period, so if you're interested in doing that please let us know by using the support button in your project

Restoring a table is very simple, just use the calendar to pick the date and time, give the new table a name, and choose which bucket to put it in.

Happy travelling!

There were Google BigQuery Extractor  jobs failures between 10th  and 12th February. It was caused by internal platform changes, the issue is resolved now. We are sorry for inconvenience.

New Components

• Google Trends extractor: this component, developed by Leo Chan (cleojanten@hotmail.com), allows to extract search trends for given keywords in a specified region.

• Instagram extractor (Beta): this component allows to extract insights and media from an Instagram Business Account which is connected to a Facebook page. It's available as Beta and any feedback is welcome.

Deprecations 

The following attributes will be removed from manifest files by the end of March 2018:

• indexed_columns – with the deprecation of the MySQL backend, there is no need to define indexes.
• rows_count and data_size_bytes – these values are not (and never were) in sync with the input table data and are useless.
• attributes – table attributes are replaced by table metadata.
• is_alias – this is something that has nothing to do with the exported data.

Fixes

• The Developer portal is now available under a new URL: components.keboola.com (instead of apps.keboola.com). The main reason is that we used the word application in two meanings, and that was confusing. For example, there were applications of type Extractor but also applications of type Application. From now on, everything is a Component. Components are of four types: Extractors (loading data from somewhere), Writers (writing data somewhere), Applications (manipulating data), and Processors (data processing helpers).

Plantyst Extractor

You can automatically push data to Stories.bi and get automatic insights instead of crunching business data by hand.

Updated Components

• Sklik extractor has new variable accountID
• YouTube extractor has new version. It is based on Generic Extractor. Old extractor will be deprecated on March 1, 2018
  

  
• Snowflake extractor is now a bit faster and has better error handling
  

  
• Geneea NLP App is now available in EU region
• BingAds extractor is now available in EU region
  

  
• Facebook extractor with new Page Tokens can newly fetch Page Reviews
• Twitter extractor is now available in EU region
  

  
• Snowflake and Redshift writers has fixed eventual columns mismatch.

Minor Improvements

• Quick search in component list was improved - it has better accuracy
• Component name can be finally submitted by pressing ENTER
  

  

Linked/Source Buckets

From now, you'll be able to find source/linked buckets information in Storage section in Keboola Connection. This is very helpful when you need to find out which projects are using (linking) your shared bucket. Also, vice versa, which bucket is the source for your bucket.

MFA required also for Google Login

If you have MFA (Multi-factor Authentication) enabled, a confirmation code is required if you use "Login with Google" functionality. Please contact us if you have problems with login.

Facebok Extractor uses page access token for page/posts insights retrieval

Due to breaking changes recently introduced by Facebok API our facebook extractor is updated so it uses page access token for page or posts insights retrieval instead of user access token. This leads to slower extraction if more pages are included in a query. User access token is still used for other data retrieval such as feed, likes, comments. Moreover, this change does not affect facebook ads extractor. 

Improvements

• We slightly updated UI for the recently published Tokens page

Fixes

• Project Power consumption is shown only for the current + 2 previous months. This is only a temporary limitation.  It will soon be solved and return to showing you more data

There was a short Snowflake outage between 10:30 and 10:35 CEST (09:30am and 09:35am UTC) in US region.

• Sandboxes might have lost their data and worksheets
• Transformation jobs might have finished with an error
• Async data loads and exports were unaffected
  

We're investigating the impact and root cause and will update this post as soon as we know more. Snowflake is now back fully operational.

UPDATE Jan 30 2018: Snowflake released their RCA.

We are glad to introduce a new UI for Storage Api Tokens that can be now found under the Users & Settings section. We will be removing the old one found under Storage section. The new UI covers the same functionality as the old one.

As a security measure, the token itself will not be shown anymore, only once after its creation. The only way to see an existing token in the UI is to send it via email (temporary link to token is sent) or refresh it and get a new token string. On the backend, the token can still be seen in the response from the tokens list api call but will be removed in the near future.

You haven't heard from us for a while. We're sorry. Here's what's new.

New Components

• Mailchimp Writer by Robin Nemeth

Updated Components

• SSH Proxy in Generic Extractor
• AdWords Extractor is available in the EU region
• Tree Depth Application was refactored and is significantly faster

Minor Improvements

• SSL configuration of all database extractors is on the same page with credentials and the SSH tunnel configuration
• Database extractors give a warning if your connection is invalid
• Apify Extractor accepts a list of urls from a table in Storage
• New part about ad-hoc data exploration in Jupyter was added to the tutorial on Ad-hoc Data Analysis

Fixes

• Database extractors automatically changes table names to lowercase
• Fixed a bug affecting non-incremental import of sliced tables in the BigQuery and Snowflake extractors 

Blog

Our developers have published 2 blog posts

• Application logging in AWS Lambda with Serverless plugin and Papertrail
• Xdebug for a CLI App in Docker (and PHPStorm)

Community News

• Docker powered GoodData CLI for less used GoodData API features (dataset synchronization and SLI Hashes optimization)

Today (8.1.) at 20:05 - 21:56 UTC a number of jobs failed with internal or encryption error. This was caused by a bug affecting OAuth configurations. We have reverted the internal release. We do apologize for this enormous mess up.