Failing Snowflake Writer

Between Feb 02 22:40 UTC and Feb 03 17:25 UTC all Snowflake Writer jobs ended with the following error:

SQL compilation error: conflicting values file format parameter 'ESCAPE_UNENCLOSED_FIELD', SQL state 42601 in SQLPrepare.

We have identified the root cause of this issue and fixed it. All Snowflake writers should be fully operational now.

Please accept our sincere apologies for this inconvenience.

Call for testers: RStudio and Jupyter Sandboxes

We have been working on RStudio and Jupyter Notebook sandboxes (these are the missing sandboxes for R and Python transformations) for some time and we now feel that it is time to move to the next phase. 

We can now enable these on a per-user basis for early adopters. If you are interested in playing with these Sandboxes please contact us at support@keboola.com (don't forget to tell us your KBC email).

Limitations:

  • Sandboxes are available only as plain sandboxes (not in a transformation bucket yet)
  • HTTPS is not yet supported.
  • Sandbox disk space is limited to 10GB.
  • Memory is limited to 8GB.
  • The UI allows loading only tables to the Sandbox. Loading input files and transformation script is supported only by the API.
  • Sandboxes will be deleted after 5 days.
  • Adding data to existing sandboxes is not supported.

Otherwise, it's like RStudio connected to your KBC project:

The CSV file locations are the same as in transformations (/data/in/tables/). In the meantime, we will work on:

  • HTTPS Support.
  • Creating better UI and integration with transformations.
  • Allowing tables and files to be added to a running sandbox.


Week In Review -- January 30, 2017

Sandboxes

We have introduced garbage collection for MySQL sandboxes. All sandboxes will be automatically discarded after 14 days. Redshift and Snowflake sandboxes will follow soon.

BigQuery Extractor

The Extractor allows you run query with BigQuery legacy SQL or standard SQL dialect.

Snowflake Writer

Empty values are now converted to NULL when the column is set to nullable.

GoodData Extractor

Old version of GoodData extractor has been deprecated in December and will be switched off in upcoming days. Please migrate to the new version if you haven't done it yet. More information here.

Project Access Approval

Now you can require that visiting support administrators will have their access request approved by an existing project member in order to temporarily join your project. See this article for more information.

Project Access Approval

In an effort to increase account sovereignty we've introduced a new feature that will give you more control over who can access your projects and for what purposes.   It is now possible to require that visiting support administrators have their access request approved by an existing project member in order to temporarily join a project.

The setting can be found in your Account settings at the organization level.  This setting will apply to all projects within the organization.

When the support user completes the request form, an email describing the access request is sent to each project member.  

The requested access will be listed in the project settings Users section and can be approved or rejected by any active project member.


Please feel free to check out the help documentation or contact us at support@keboola.com If you have any questions.

Week In Review -- January 16, 2017

Our last week was filled with some bug fixes, performance improvements and old infrastructure deprecation.

Shared Buckets

Shared bucket loading was tweaked to load data directly on Snowflake backend. (available to everyone)

Loading to Sanboxes

Loading data to sandboxes (mainly used by Transformations and Sandboxes themselves) has been improved, which means multiple tables can be loaded at once.

You should notice speed improvement when using more tables in input mapping and loading larger amount of data. (testing phase, available on request)

Also we would like to mention:


Detail of a job with enabled "Multi Load"