Week in review -- April 15, 2019

Updated Components

DB extractors:

  • Source shows schema as well as table name in tables list. Also it's visible from first glance which tables are created from a storage table and which are from SQL. 

  • Table schema is shown also in config rows detail sidebar

  • When adding tables you can click the schema name and all tables in schema at once


Delayed jobs in EU region

Execution of some table import jobs scheduled after 07:42 UTC was delayed up to 30 minutes. The delay was caused by new platform release which was immediately rolled back. All systems are now operational.

Week in review -- March 27, 2019

New Features

  • Added fulltext search in API tokens.
  • Added fulltext search and sorting by name in Orchestrations.

Minor Updates

  • We have discontinued Productboard and all your new ideas come directly into our inbox. Please feel free to share with us anything on your mind.
  • Python and R transformations show the link to the transformation configuration.
  • After successfully validating a SQL transformation you can immediately run it. 


New version of GoodData Writer

We have released a new version of GoodData writer. It runs fully in our Docker infrastructure and so uses its full potential. 

The UI was rewritten and the UX was brought closer to other writers. The component itself handles only updates of data model and data loads. Provisioning of projects and users is a standalone app with backend in AWS Lambda and is used by the ui seamlessly. (You can look to API documentation in Apiary.)

Other custom features of the old Writer like mandatory user filters and cloned projects have to be handled in a custom way outside of the Writer.

The old Writer was unpublished but you can still use existing configurations. Its depreciation and a way of configuration migration will be announced in the near future. But you are strongly encouraged not to create new configurations anymore.

Power BI Desktop not showing Snowflake tables

We're investigating issues with Power BI not showing tables in your Snowflake workspace.

We're sorry for this inconvenience, we'll be updating this post with our findings.

UPDATE 17:26 CET

Snowflake confirmed they can reproduce the issue and are investigating further. 

The issue affects transient tables (CREATE TABLE statement), but does not affect views. As a temporary workaround we suggest to log in directly into the Snowflake workspace and create views from all tables in the schema. These views should be immediately visible in Power BI.


UPDATE 11:20 CET

Snowflake are preparing a new version of the ODBC Driver which allows Power BI to see the tables. Use the support button in your project to contact us to obtain this driver.


Orchestration Failures in the US Region

Today, on March 15 2019 from 16:34:15 UTC to 16:35:12 UTC there were some orchestration failures in the US region due to an internal system upgrade.

There were not many failures (around 20, so very few are affected), but if you had an orchestration running at that time, please check to make sure that you were unaffected.

We are working on making sure that this will not happen again for any future upgrades.

Snowflake issues in EU region

We were affected by a brief outage of the EU region Snowflake database on Mar 07 between 17:45:00 UTC and 18:25:00 UTC in the EU region. The problem affected extractors and transformations. Please check your orchestrations and re-run them if necessary. Projects in the US region were unaffected. We apologise for the inconvenience caused.

Weeks in review -- March 1, 2019

New Features

  • Oracle Writer - supports setting custom schema in credentials configuration
  • GitHub Extractor - adds organization to downloaded commits and issues
  • Storage API - supports multiple where filters and order by statement inside datapreview and asynchronous table export. You can quickly search for your data in datapreview with multiple conditions. We are going to add this feature to UI soon.
  • BigQuery Extractor - supports extracting data from the EU region


UI

  • full page table preview for Storage tables



Bug fixes

  • OAuth Broker API - fixed missing component credentials
  • Oracle Extractor - fixed manifest for exported tables if there were more than one table with the same name in different schemas
  • Transformations 
    • unpaired closing comment tag ( */ ) in SQL query is now properly identified as a user error
    • added additional retries when creating a workspace


    Deprecation of GET method in GoodData SSO login

    GoodData SSO login using GET links will stop working on March 18. It means that property link in the response of SSO login using GoodData Writer will stop working too. 

    If you use any custom solution built upon our Writer, you need to migrate it to the new POST login, i.e. take property encryptedClaims from our resource and call this GoodData API call: https://help.gooddata.com/display/doc/API+Reference#/reference/authentication/sso-pgp-login which will login your user. SSO links to GoodData in our Connection UI are already migrated to the new method.


    Refined Storage Console

    We're happy to announce a small technology update of our Storage Console. Several months in the making, this will allow us to bring new features in the near future.

    Even though the primary purpose of this update is to bring the code up to date and align the design with the rest of the UI, we have already made some small improvements:

    • You can no longer see an additional loading page when navigating to Storage from other pages.
    • Search in buckets (or tables) highlights the matched parts of your search query in yellow.

    • An active bucket is highlighted on the left side when its detail or a detail of its table is active.

    • Files and Jobs sections are automatically reloaded every 20 seconds.
    • Event sections have predefined searches, so you can filter events faster.

    • Buttons Create Bucket, Link Bucket and Reload are now bigger.

    • There's an option to create Table Alias directly from a table detail (in Actions).

    • Other minor cosmetic things like navigation, buttons, etc.