Deprecation of MySQL database provisioning for database writers

We no longer provide Keboola MySQL database provisioning for database writers. Existing Keboola provisioned MySQL databases will be kept intact till the end of Jun 2017. Existing MySQL users will have to move to their own MySQL instances. Here are a few suggestions of vendors which provide MySQL provisioning:

Amazon AWS

- DigitalOcean

- Microsoft Azure

Google Cloud

- Rackspace

You can keep your data inside KBC and connect to them directly. We believe that our Snowflake Writer is a great replacement for your existing MySQL Writer, so please check it out!

Do not hesitate to contact if you have any questions!

Trouble Signing In

Signing into KBC with your Google account is not working presently.
We're investigating and hope to have it resolved shortly.
In the meantime, please sign in using the standard email and password method.

Sorry for this inconvenience,  this post will be updated when further information becomes available.

UPDATE 08:21 UTC We have identified the issue. The fix will be deployed in ASAP.

UPDATE 08:55 UTC Signing in with your Google account is again fully operational.

Week in Review -- March 13, 2017

New Components

Snowflake Extractor
  • Snowflake Extractor is now in private beta. For an early access please contact us at support@keboola.com.

Minor Improvements

  • Next Event application now estimates the date of the next event

Fixes

  • Fixed all dead links on status.keboola.com and help.keboola.com

  • Google Sign In correctly redirects after authorization

  • Keboola Connection cookies use the secure flag

  • Password reset does not leak information about (non)existing user

  • Orchestrator trims notification email addresses, no more whitespace mess

  • GoodData Writer properly propagates errors when creating a new writer

  • GoodData Writer does not remove our domain admin from a project which is shared among more writers


Failing GoodData Writer Jobs

We've noticed some write jobs to GoodData have been failing since their most recent maintenance period.  

We're investigating the issue and will update here as soon as possible.

Update 11:30AM March 12, 2017

The failures were due to a breaking change update to the GoodData date dimension API during their last maintenance period.   It should only affect projects which are using custom date dimensions.  We are currently assessing options to remedy the situation.

Update 20:30 CET March 12, 2017

For any orchestration that failed to write to GoodData this weekend, in order to have it run correctly, please edit the task and change the action from `upload-project` to `load-data`.  It should then work correctly if you re-run it. 

Please note however that new writers with custom time dimensions, or changes to old configurations which had them, may still fail.

Update 13:20 CET March 13, 2017

GoodData has fixed the issue. All existing configurations should work now. The switch from `upload-project` to `load-data` is no longer required, but we still recommend it as best practice to prevent possible future issues.

Update 07:00 CET March 14, 2007

In some cases the GoodData writer jobs are still failing. Switching to `load-data` is the correct remedy. Read what GoodData has to say.

Update 15:47 CET March 14, 2007

The issue seems to have been completely resolved as per GoodData Support.  

Week in Review -- March 6, 2017

Minor Improvements

  • We have upgraded the Google Sign-in to the latest most secure version.

Fixes

  • Dropping a empty primary key in Storage no longer causes an error.

  • Creating a Storage table with a missing S3 file now returns a proper error message.

  • Handle correctly a situation when a primary key is supplied as an array to a Storage table.


Week In Review -- February 13 and 20, 2017

Google BigQuery Writer in private beta

We've been working hard on a BigQuery writer for the Google Cloud Platform.  If you'd like to get early access for the beta release, please let us know at support@keboola.com.

Azor Extractor

There is a new third-party extractor for Azor.  Azor is a Czech service that allows you to monitor your competitor's products prices and availability.

Fixes

  • Trying to add a column with the same name as an existing column, but only different casing will result in an error message.  (ex: customerEmail and CustomerEmail)

  • Table ID was added to workspace loading errors to help determine the cause of the error.

  • Attempting to create an output table with column names beginning with "_" will result in an error.





AWS S3 Outage Resolved

Amazon services are almost restored. Our infrastructure recovered too, everything should be running now. Though the waiting times are expected to be longer. 

We're sorry for this inconvenience and thanks a lot for your understanding and patience.

AWS S3 Outage

Keboola Connection is suffering very hard from the ongoing AWS S3 outage. All workers are down, lots of functionality is broken. For more details please see https://status.aws.amazon.com/

Once the AWS team fixes the issue, Keboola Connection will be up and working again. 

We're sorry for this inconvenience and thanks a lot for your understanding and patience.

Failed jobs

On Sat, Feb 25, 04:05 AM UTC+1 one of our AWS RDS server was restarted. This lead to loss of connection between our lock server and job processes. The outcome may be following

  • Orchestrations, that have all tasks successfully finished, but the orchestration itself failed
  • Failed tasks within orchestrator; the task execution finished successfully, only the job status was not saved correctly
  • Job was scheduled to execute again while it was still running, and especially in transformation jobs this lead to simultaneous execution in the same database/workspace

We will resume all orchestrations, that have failed tasks due to this outage (starting at the task following the failure).

We're sorry for this inconvenience, we're working towards mitigating this bug in the future.

Week In Review -- February 6, 2017

Improvements

  • Description of transformation configuration shows up in a preview

  • Improved description of deprecated GoodData extractor migration 

  • Goodata user role Keboola Editor Plus has been extended by the following permissions:
    • canValidateProject
    • canCreateFolder
    • canManageAttribute
    • canManageAttributeLabel

Fixes

  • Fixed Storage Api bug caused by unlinking a shared bucket from a project containing more shared buckets.