Keboola Status

We've added Dropbox to our list of Writers. 

You can now easily upload any of your out. tables to your dropbox account by using the Writers menu in your project, add Dropbox and authorize Keboola Connection to write to your dropbox folder. Once you're done with that, you can tick any of your output tables and they will be pushed to your dropbox once you run the Writer, or you might just click the upload button next to a table in the list to do an one-time upload. 

If you want to load some data in your R transformation but it can't be stored in a table, you can now use Saved Files feature. This allows you to specify multiple tags and for each tag the engine will download the latest stored file in File uploads with this tag. If no file is found, the transformation will fail. The files are then stored in /data/in/user/{tag} and the manifest files in in /data/in/user/{tag}.manifest.

This comes extremely handy when you externally pre-generate binary data for a transformation (model, bucketing criteria). You just upload the file to the File upload and assign a certain tag, that you will then use in a transformation. 

Keboola Connection now supports Multi-Factor Authentication (sometimes called two-step verification) using Google Authenticator app. It can be activated in Account section accessible from user menu. You will need to download the app first, version for iPhone is here and for Android here. This feature adds verification by 6-digit code generated by the app after entering of username and password and so increases safety of your account.

Activation looks like this:

And login will look like this:

Geocoding component now allows to configure which data provider will be used and in which locale the data will be processed. You can choose from Google Maps, Google Maps for Business, Bing Maps, Yandex, MapQuest, TomTom, OpenCage and OpenStreetMap. See Apiary documentation for more details about configuration. Notice that you need to obtain API key for most services first.

Original mode of the component which used mixed providers with our own API keys still works (for configuration tables without attribute provider) but is only temporary to allow you to migrate and will be removed after few weeks.

One of our Redshift clusters was getting stuck on certain operations. It caused a bottleneck on Provisioning API that delivers database credentials to transformations and other components. 

Affected orchestration have been restarted. We're sorry for this inconvenience.

Database Writer component has been split into MySQL Writer, Oracle Writer and Redshift Writer according to underlying database driver.

Starting now, we will gradually migrate existing configurations from Database Writer to these new writers. 

Please don't be frightened when your Database Writer changes to MySQL Writer for example ;)

AWS S3 service which powers files storage is reporting increased error rate in our main region. It is causing failure of some jobs.

We hope for a quick fix, please bear with us, we'll post any updates here.

UPDATE 1:52 AM PDT AWS team have identified the root cause of the elevated error rates and is actively working on the recovery process now.

UPDATE 3:46 AM PDT The error has been corrected and the service is operating normally.

UPDATE 12:26 PM PDT Unfortunately problems are back again. We are waiting response from AWS.

UPDATE 12:28 PM PDT The issue has been resolved and the service is operating normally.

Today we have launched a brand new user interface Keboola Connection. Some of you have been already working with it and giving us feedback for a while.

Now it is available for everyone, so you can start exploring it right now. There are no big or conceptual changes so we hope everything will be familiar to you. And you'll have your work done faster.

Just a few highlights:

• Consistent behaviour, every action provides feedback.
• Interface doesn't lie like the old one, and pending indicators are shown for all actions so you can be sure that everything is saved when your action is complete.
• It should be more descriptive and should guide you, we know there is still lot of work ahead of us.
• All extractors, writers and orchestrations can be renamed
• Faster navigation and linked relations like jobs and component configurations

Finally it is a solid base for upcoming enhancements and features. Important areas are collaboration, project overview and monitoring, better understanding and organization of data, project changelog.

We’d also love to hear your feedback, you can reach us on support@keboola.com or if you want to be closer to development on our Github project page.

In case something went wrong you can still switch to the previous version by the link trick: just change the project url https://connection.keboola.com/admin/projects/YOUR_PROJECT_ID to https://connection.keboola.com/admin/projects-new/YOUR_PROJECT_ID yes, this one is old :) 

Enjoy!

According to our previous notice, AdWords Extractor has been updated to use new version v201506 of AdWords API. You can start using new metrics.

Listing of users (GET /users), projects (GET /projects) and project users (GET /project-users) has been limited to 10000 results. To this moment listing of much more results didn't work anyway, Writer returned error instead of the listing. So if your writer contains more results and you have a script which process them, you will need to update it to support pagination. It works using parameters offset and limit (see docs for more information)