Week in Review — December 3, 2019

New Components

AppsFlyer Extractor

  • We’re happy to welcome the AppsFlyer Extractor to the family!

  • AppsFlyer is the market leader in mobile advertising attribution and analytics, helping marketers to pinpoint their targeting, optimize their ad spend, and boost ROI.

  • This component was developed by KDS Team.

DynamoDB Writer

  • Another great addition to our component collection is DynamoDB Writer!

  • This component lets you write data from our Storage into AWS' DynamoDB, which is a key-value, document-based database. It's fully managed, multiregion, multimaster, durable with built-in security, backup and restore, and in-memory caching for internet-scale applications.

  • This component was developed by KDS Team.

CSV to XLSX Processor

  • Highly demanded utility to convert data in CSV format to XLSX is here!

  • This component was also developed by KDS Team.


Updated Components

AWS S3 Extractor

  • Uses parallel download and it's more than 20 times faster!

Snowflake Extractor

  • Supports incremental load.

  • Supports config rows.

Oracle Extractor

  • Supports incremental load.

  • Supports configuration rows.

  • Implemented retry mechanism for all types of queries

Redshift Extractor

  • Supports incremental load.

MySQL Extractor

  • Implemented retry mechanism for all types of queries

PostgreSQL Extractor

  • Added support for PostgreSQL Server v12


Improvements

Transformations

  • Transformations are collapsed by default.

Data Catalog

  • Improved "empty" page

  • Type of sharing is now shown and will be improved further. 

  • Improved “initial" modal

  • Bucket description is shown where applicable. 

Storage

  • When creating an alias table, you can now filter data by the EMPTY_STRING or SPACE characters.


Fixes

  • Fixed a bug in the Darksky extractor date conversion. The bug caused dates in the date column for places in UTC+ timezones to be one day less than the actual forecast date.


Developers


New Zendesk Extractor

We`ve launched a new version of the Zendesk extractor, which completely replace old version of Zendesk extractor.

It is based on our Generic Extractor with predefined templates to helps download your data easily.


If you are interested in more details like extractor limits and output data format please visit our new documentation.


Feel free to try the new extractor and in if  you have any questions or something is missing, please contact us at support@keboola.com.

The old extractor, now named Zendesk (DEPRECATED) in Keboola Connection, is now deprecated and will be shut down on 27th of October 2016.

If you need help with migration please let us know.

Pingdom Extractor

We've launched a new extractor for Pingdom.

This extractor will fetch data collected by the Pingdom service about your web application's uptime and performance metrics. This allows you to directly examine your application's performance and what effects that may have on your campaigns, sales activities, or other business metrics.

Detailed descriptions of the data structure and a guide to help get you started are available in the KBC User Documentation.



MongoDB Extractor

There's a new extractor available in our group of Docker extractors - MongoDB Extractor.

This extractor allows you fetch data from your MongoDB databases. By specifying collection, query, sort, limit and mapping you're able to extract exactly which parts of your data you want.

On the other hand, MongoDB extractor is very similar to our new set of standard database extractors, so there's a chance you are already familiar with some parts of its UI.

Main features of the MongoDB extractor:

  • you can specify query, sort and limit to filter your data (as in mongoexport commnad)
  • each export has to be named, which helps you identify your exports better
  • there's a mapping section (actually most important) through which you can specify how your data will be processed, how they'll be split to multiple tables and which columns will be exported (thus you can join them with ease)
  • as always, there's an option to have multiple exports in one configuration

Here's a sneak peak of sample configuration:

For more information about its configuration follow the guide at our help site.

Gmail Extractor

We are proud to announce a new member of our group of Docker extractors - Gmail Extractor.

This extractor helps you fetch messages from your Inbox by specifying simple queries. These queries are identical to those you're using in Gmail's web interface. If you're more into advanced search, check this Gmail's Help site.

Main features of the Gmail Extractor:

  • you can specify multiple queries
  • output is divided to multiple tables, which gives you more freedom when selecting/joining data
  • multiple runs of the same query won't cause downloading the same data
  • you can specify the headers you want to download

The process for adding the Gmail Extractor is very similar to the other extractors (e.g. Adwords Extractor v2)

1. Find Gmail Extractor in the list of extractors

2. Create a new configuration for this extractor

3. Authorize the extractor to access your inbox

4. Configure the extractor and specify the queries you want to run

For more detailed information about the extractor configuration options please see the documentation.


Adform Extractor

We've launched a new extractor for Adform. You can start using it right away -- the extractor's interface will guide you through configuration.

With the Adform extractor we are introducing the concept of configuration templates. Templates are predefined common configurations that help you quickly set up the extractor without tons of settings. Templates also reduce duplication of tasks and support knowledge sharing. Soon other extractors will also gain template support, and we are also working on mechanism of publishing templates.

Setup extractor from predefined template:


You can then tune the extractor created from template:

Feel free to use this extractor and if you find any issue or have any question or suggestion let us know at support@keboola.com .