Project Access Approval

In an effort to increase account sovereignty we've introduced a new feature that will give you more control over who can access your projects and for what purposes.   It is now possible to require that visiting support administrators have their access request approved by an existing project member in order to temporarily join a project.

The setting can be found in your Account settings at the organization level.  This setting will apply to all projects within the organization.

When the support user completes the request form, an email describing the access request is sent to each project member.  

The requested access will be listed in the project settings Users section and can be approved or rejected by any active project member.


Please feel free to check out the help documentation or contact us at support@keboola.com If you have any questions.

Google Drive Extractor Migration

A couple of months ago we launched a new version of Google Drive Extractor and promised to release a migration tool.

Well it took a bit more time then we expected, but as promised, here it is. This tool will help you migrate your configurations to the new version of the extractor.

How to

  1. Click "Proceed to Migration" button in any configuration of the old Google Drive Extractor
  2. A dialog window will open with a list of all configurations in the project
  3. Click the "Migrate" button and a migration job will be created
  4. You can watch the progress of the migration job either in the migration dialog window or in the Jobs list
  5. When the job has finished, you can see the result of the migration for every configuration and also any affected orchestrations will be listed in the "Affected Orchestrations" tab


Backward compatibility

Please be aware that in the new extractor, sheets in one configuration can only be downloaded into the same bucket. In the migration process, the destination bucket is determined from the last sheet of the "old" configuration.

If you have any questions or troubles, please contact support@keboola.com.

Snowflake Database Writer

The much anticipated Snowflake Database Writer is now available!



Key features:

  • container based architecture
  • upload data to your own Snowflake database or use a Keboola provisioned database. 
  • SSH tunnel
  • incremental load

Provisioned database limits:

You can use a Snowflake database provisioned by us, and this database is included in the price of your Keboola Connection project.  Please note, however, that there is a 15 second timeout per query, and an additional fee will be required in order to increase this timeout.

If you have any questions or troubles setting up this writer, please contact our support at support@keboola.com.

Job failures

There were  jobs failures between 1:30 AM - 6:15 AM UTC caused by flooded disk on one of our servers. We are making steps to avoid this issue happening again.

We're sorry for this inconvenience.

Week in review -- December 19, 2016

Hello everyone,

Here's the list of the most important changes we made last week:

Project Power in Credits

A few weeks ago we announced the Project Power (you can find it under User & Settings -> Project Power tab). As we continue to improve this part of Keboola Connection, we are introducing a new unit for measuring the Project Power -- Credits.

We've also begun displaying these power credits for resource consumption instead of Storage IO in job detail.

 
For now, it's most notable that 1 credit is equal to 1 GB of processed data and the smallest unit we measure is "nano credit" (previously Byte). Anyway, don't worry, an upcoming post about this feature will describe Project Power in full.


New GoodData Extractor

You can find it as GoodData Reports. 

The old version of GoodData Extractor has been deprecated and we are preparing a migration tool to ease the transition to the new one.

Read more here http://status.keboola.com/new-version-of-gooddata-extractor.


Create a Project with Promo Code

It is now possible to create a project with a Promo Code. This can be useful for workshops or other events, where attendants will be using Keboola Connection. Please contact your Maintainer for more details.


Enjoy your week and Merry Christmas!

Week in Review -- December 12, 2016

Howdy everybody, 

Here's some highlights from this last week:

  • Performance of the new parallel uploading technique we mentioned last week saw a significant improvement.  We're now able to load 60GB from a foreign S3 bucket (outside of KBC) to a Snowflake storage bucket in approximately 33min.  And the only direction that's going is faster.
  • There are some newly available storage api endpoints for key/value metadata.  Feel free to check out the API documentation for further info.
  • There was a new blog post on our blog: Querying JSON ad-hoc in Snowflake
  • We've updated the JSON parser Chrome extension for Papertrail and it's available in the Chrome Web Store

Be sure to tune in again next week for more updates!


 

Week In Review -- December 5, 2016

Here's the list of most important changes we made last week:

- Docker runner supports headless csv: If columns are specified in the output mapping(in manifest file or in configuration object) then the corresponding csv file is considered to be without a csv header. More details

- Docker runner supports sliced output csv files: More than one csv file can be mapped to one output table, moreover all such files will be uploaded to storage in parallel. This way files bigger than 5GB can be uploaded to storage. More details

- Little cherry on top: Adding new table in Database writer UI now maps the storage table name to the database table name and not the table id:

Happy Monday, Have a great week ahead!