Google Analytics Segments

Google Analytics Extractor now supports Segments.

"Segments allow you to select users and sessions to answer questions that are important to your business. For example, users that have completed at least 2 transactions with a lifetime revenue of over $1,000, or users who visited first on a mobile device followed by a desktop browser."

Read more about Segments here.

Inplace Table Preview

Have an instant preview of the storage table right in place such as transformation mappings configuration, most of the extractors and writers configuration, job detail page etc. No need to switch between Storage Console in most of the cases.

Table id is displayed as a link:

Click on the link and get modal dialog pop up with general info about the table, its sample data, and the most recent events:



Retrying Orchestration Jobs and Warning Notifications

We've heard your cries about how difficult it was to re-run failed jobs in the Orchestrator, so we did something about it:

You can now retry any failed job in your orchestration's job queue. On the (failed) job's detail page you'll see a "Job Retry" button in the upper right corner:

Just click on it and press "run" to re-run failed tasks:

If you need to run just a few tasks (failed or not), click on "Choose orchestration tasks to run" to show the task selection list. Select the ones you want by click on grey button in the middle of the window and middle area and activate/de-activate desired tasks.

The run button will create new tasks, so everything will run in the original environment, under the same circumstances and with the same job parameters.  Just take care to note that it is possible that the data underlying the configuration may have been modified by a different process (ie: someone else working with it) in between the last time the job was run and your re-run.

Notifications

If some tasks are prone to fail often (i.e. wrong credentials in client's Google Analytics), you'll want to activate the "Continue on Failure" flag for the "unstable" tasks. If activated, the Orchestrator will not send an error notification when that specific task fails. Instead the Orchestrator will send out a message to our new notifications channel for "Warnings". Go ahead and subscribe to receive emails about all Warnings:

Adform Extractor

We've launched a new extractor for Adform. You can start using it right away -- the extractor's interface will guide you through configuration.

With the Adform extractor we are introducing the concept of configuration templates. Templates are predefined common configurations that help you quickly set up the extractor without tons of settings. Templates also reduce duplication of tasks and support knowledge sharing. Soon other extractors will also gain template support, and we are also working on mechanism of publishing templates.

Setup extractor from predefined template:


You can then tune the extractor created from template:

Feel free to use this extractor and if you find any issue or have any question or suggestion let us know at support@keboola.com .

Support for Multi-Factor Authentication

Keboola Connection now supports Multi-Factor Authentication (sometimes called two-step verification) using Google Authenticator app. It can be activated in Account section accessible from user menu. You will need to download the app first, version for iPhone is here and for Android here. This feature adds verification by 6-digit code generated by the app after entering of username and password and so increases safety of your account.

Activation looks like this:

And login will look like this:

New Keboola Connection

Today we have launched a brand new user interface Keboola Connection. Some of you have been already working with it and giving us feedback for a while.

Now it is available for everyone, so you can start exploring it right now. There are no big or conceptual changes so we hope everything will be familiar to you. And you'll have your work done faster.

Just a few highlights:

  • Consistent behaviour, every action provides feedback.
  • Interface doesn't lie like the old one, and pending indicators are shown for all actions so you can be sure that everything is saved when your action is complete.
  • It should be more descriptive and should guide you, we know there is still lot of work ahead of us.
  • All extractors, writers and orchestrations can be renamed
  • Faster navigation and linked relations like jobs and component configurations

Finally it is a solid base for upcoming enhancements and features. Important areas are collaboration, project overview and monitoring, better understanding and organization of data, project changelog.

We’d also love to hear your feedback, you can reach us on support@keboola.com or if you want to be closer to development on our Github project page.

In case something went wrong you can still switch to the previous version by the link trick: just change the project url https://connection.keboola.com/admin/projects/YOUR_PROJECT_ID to https://connection.keboola.com/admin/projects-new/YOUR_PROJECT_ID yes, this one is old :) 

Enjoy!

Storage API Client For R

Want to play with your KBC data in your local R environment?

Install the keboola-sapi-r-client and you can.  
(The package is on GitHub so it is installed via the devtools package) 

install.packages("devtools")
library(devtools)

We need to install a github dependency
for aws request signature generation

devtools::install_github("cloudyr/aws.signature")

Now we can install the Storage api client and load it into our R session

devtools::install_github("keboola/sapi-r-client")
library(keboola.sapi.r.client)

Just like any other R package, once installed, it can be invoked in any future session with the library() command.

To instantiate the client just give it a KBC token.
We'll use the token for the currency exchange rates for demonstration purposes.

client <- SapiClient$new('452-33945-de5bb7fecb818901f0834b2431564003296a4b05')

Now we can import data to our R session

currencyData <- client$importTable('in.c-ex-currency.rates')

Just for fun, let's make a simple plot of EUR vs USD using the ggplot2 library
if not installed on your R use install.packages("ggplot2")

# prepare our data
eurVsUsd <- currencyData[which(currencyData$toCurrency == "USD"),]
eurVsUsd$date <- as.Date(eurVsUsd$date)

# load the libraries needed to make our plot
library(ggplot2)
library(scales) # for prettier x-axis labeling

p <- ggplot(eurVsUsd, aes_string(x="date", y="rate")) + geom_point()
# add x-axis scaling and title
p <- p + scale_x_date(breaks="1 year", labels=date_format("%Y"))
p <- p + ggtitle("EUR vs USD")
print(p)

The code for this sample is here in this gist

The Storage API client gives full read and write access to your KBC project within the comforting power of your local R environment.

Imagine the possibilities!

* small print *  This is a development tool in Beta, use at your own risk!