Upcoming configuration changes in GoodData Writer

Our GoodData Writer is going to begin saving configurations to our Components Configurations in the Storage API, rather than the sys stage bucket and tables it uses now. This will bring a performance boost, reduce the API response time (i.e. improve KBC UI performance), improve the clarity of the configuration and bring better versioning and rollback possibilities. This change will apply for bucket attributes (containing GoodData credentials and project identifiers), date dimensions, datasets and filters, see the API docs for more information: http://docs.keboolagooddatawriterv2.apiary.io/#introduction/configuration-in-storage-api/components-api

We will proceed in several steps. First, configurations of all writers will be automatically migrated to the Configuration storage in several waves over the upcoming days. You will be notified by the notifications system in KBC UI once the migration is complete. Once completed, every configuration change performed using the API (including KBC UI) will be written to both places. Please keep in mind however, that if you alter your writer’s configuration directly in sys bucket, these changes won't be synchronised to the new configuration and you will need to manage the synchronisation yourself.

In the second step, we will switch to reading configurations from the Configuration storage rather than the sys bucket. And in the third step, writing to the sys bucket will be stopped and sys bucket configuration tables (data_sets, date_dimensions and filters) will be deleted. We will inform you about each of these steps when they occur.

The remaining configuration tables (projects, users, project_users, filters_projects and filters_users) will not be changing for now, but in the long term they will be completely removed and their data will be only stored in the Writer's backend. So by the end of this journey, we will say goodbye to the whole configuration bucket in sys stage.

Transformation failures

Feb 25th 10:00 GMT+0100

We're investigating issues when working with transformation configurations (creating, saving, deleting). We're sorry for this inconvenience, it will be fixed shortly.

UPDATE Feb 25th 10:10 GMT+0100

The issue has been resolved. Thank you for your patience.

Connection outage

We have experienced a brief outage of  Keboola Connection application and API between 12:42 and 12:45 UTC. Some jobs might have failed with an application exception.

We're sorry for this inconvenience, if not sure what was the cause of any failed job, please contact us atsupport@keboola.com.

End of life announcement: Old ex-generic

The old generic extractor has been fully replaced by ex-generic-v2, and will no longer be supported. 

All existing and actively used configurations have been migrated to the new extractor. If your project used the old version (configured in SAPI tables), you should have already been contacted and received configuration for the new extractor. If you use the old extractor and haven't received a message about it, please contact us at support@keboola.com

The old extractor will be taken down on 29.2.2016

Transformation configuration migration

Following an extensive testing with volunteer users (thank you all, you know who you are!), we will migrate transformation configuration storage for all projects. The migration will happen in several batches processed during a 5 days period next week. We'll be monitoring the process but we don't expect any failures, outages or other bugs.

Expected period of migration is Monday Feb 15th to Friday Feb 19th. Once your project is migrated, you'll get a notification (for each project in which you are an admin). 

During the migration process all your transformations will be serialized and uploaded to your project's File uploads for safekeeping.

Why?

The current method of storing configuration in sys.tr-* buckets has become obsolete and practically prohibits new features. Storing transformation configuration natively in a dedicated configuration storage (part of Storage API) opens, besides having some immediate benefits, the door for new exciting features. 

Benefits

  • faster saving and loading of transformations (faster & smoother UI)
  • elimination of all sys.c-tr-* buckets (cleaner Storage console)
  • plenty of upcoming cool features (versioning, anyone?)

Should you encounter any issues during the migration or in case you have any concerns/questions regarding your project, don't hesitate to contact us at support@keboola.com.


MySQL Transformations Temporal Outage

Today, 11.2.2016 between 11:50 - 12:50 CET we encountered short outage of our MySQL transformation server which at the time led to fail the running transformations and no new transformations could be started either. The server is now up and everything is running properly. We are sorry for any inconvenience.

Introducing notifications

We're adding a new channel to inform you about important events in Keboola Connection or any of your projects. Notifications show up as a bell icon next to your name or the Keboola logo. 

When there's a new notification waiting for you the bell has a red badge. Clicking on the icon you'll go to the Notifications page, where you'll see all notifications. Unread notifications are highlighted and you can mark each notification as read or mark all notifications as read in a single click. 

Notifications will inform you

  • about new significant features
  • about important events regarding your project (outages, migrations)
  • when your project reaches contract limits

It's not a Facebook feed, we promise we won't bother you too often.