Redshift Transformation Input Mapping Update

As of now we're removing type input mapping attribute in Redshift transformations. 

All tables which were set to be created using CREATE VIEW from another schema will now be automatically created using CREATE TABLE and the data will be copied.

There are many reasons behind this update, the most important being a deadlock when deleting tables in Storage that had a view created in a transformation or in an orphaned sandbox.

You may experience slightly slower transformation times and heavier disk usage caused by physically copying data.

Should you experience any unexpected behaviour or a major slowdown, please let us know.

PS: No action required, we're glad you made it here safely.

Orchestrator table deletion announcement

All Orchestration configurations have been migrated to dedicated configuration storage and old configuration tables in sys.c-orchestrator bucket are no longer used.

Therefore we will automatically delete the configuration bucket sys.c-orchestrator (including its contents) on next Wednesday, April 18. After deletion, you will be informed by KBC notification.


To access orchestration configurations programatically, you must use the Orchestration API.

Week In Review - May 9, 2016

Docker app configuration with JSON Schema

This feature is mainly useful for 3rd party developers. 

It is now possible to define configuration UI with JSON Schema.

Read more about this feature in documentation.


Slack Extractor

Another addition to our fast growing family of extractors! 

Slack is a great real time messaging app, read more about it.

Use this extractor and other KBC tools to analyse your conversations, see which users / clients are most active in what channels and when. You can do sentiment analyses of messages and much more.


GitHub Extractor

And another new extractor. This time for most popular Git repository hosting service.

The GitHub API provides access to the many public activities that happen on GitHub.com. 

Read more about GitHub Data. Now you can use these in Keboola Connection environment.


S3 Writer fixes

  • default path 'kbc_upload' is now used when no remote path is specified or it's just '/'. 
  • region 'us-east-1' is now set as default region
  • updated documentation


Week in Review – May 2, 2016

Tableau Writer improvements

You can now use our standard data filter in table export configuration


Geneea NLP Analysis improvements

As in previous case, input date filtering is available



New configurations will use incremental import by default, when primary key is specified.
To make this working in your existing configurations, you will have to create primary index in destination table and edit/save configuration. 


Redshift Transformations

The option for storing persistent tables was removed, because nobody is using it anymore


GoodData Writer improvements

Tables from "in" data stage are newly allowed in configuration


Project settings page redesign


People from Keboola Support are identified by small badge before their icon in users list



Developers

Actions were added to our Docker Runner. It is way to run quick synchronous tasks in your KBC extensions

SSO access to GoodData failures

We have encountered problem with SSO links generated by our GoodData Writer.

UPDATE: This issue has been solved. All SSO links should be valid now.


List of products, which are hit by this problem:

- On demand SSO access to GoodData in Keboola Connection 

- Keboola Academy

- Keboola Sardine


We are working on the fix of the problem. We are sorry for any inconvenience.

MailGun.com issues

Mailgun.com, backend API powering our Pigeon Extractor (email data import), has an incidents with their API. Their status page is here, twitter account here. When they stabilise their platform, everything should be OK. Please be patient.

Week in Review – April 26, 2016

  • Users from support does not count to the users per project limit.
  • Partial imports no longer supported in the UI(Storage Api Console).
  • JSON editor in the generic ui keeps the order of attributes when changed.

We did a little cleaning and dropped unused or deprecated components:

old Sklik extractor, old Adwords extractor, Instagram extractor, Telfa extractor, Marketo extractor, Elasticsearch extractor and writer, Linkdex extractor, App Annie extractor, Mandrill extractor.

Don't worry if you found yourself missing one of those, we are able to bring them back and have found effectively betters ways to do it ;)

Transformation jobs forking

Between 11:08am CEST and 2:03pm CEST under certain circumstances transformation jobs were forking from existing processing transformation jobs. We have found the root cause, fixed it, terminated all forks and restarted all failed orchestrations. If you're still seeing this issue, please let us know.

UPDATE: This issue occurred again between 4:49pm CEST and 8:05pm CEST.

We're sincerely sorry for this inconvenience.

New Twitter Extractor

We've launched a completely new version of the Twitter extractor which replaces the now slightly outdated version of Twitter extractor.

With the new extractor you can have Twitter data in Keboola Connection in just a few clicks. Just authorize your account, select whether you want timeline, mentions, followers or you can do a tweet search, save it and run the extraction.

There are two types of authorization available, you can authorize instantly if you have access to the target Twitter account, or you can use the external authorization and send an authorization link to the Twitter account user to authorize it for you.

If you are interested in more details like extractor limits and output data format please visit our new documentation.

Feel free to try the new extractor and in if  you have any questions or something is missing, please contact us at support@keboola.com

The old extractor, now named Twitter (DEPRECATED) in Keboola Connection, is now deprecated and will be shut down on 19th of June 2016.

If you need help with migration please let us know.