Week In Review -- January 9, 2017

Happy New Year everyone! Some good news here, some long awaited features finally made it.

  • Shared buckets allow you to share data between projects. Making RESTbox deprecated one feature at a time.
  • We decided to scrap all Project Power stats older than Jan 5th. We hope this is the last adjustment.
  • Bugfixes in GetStat and Qualtrics extractors.
  • Redshift bloating tables popped up again. We were not able to detect certain cases. Fixed.

Also the UI got some love

  • Link to documentation in the left pane, so you don't have to guess it

  • Long Run Ids wrap correctly in the job detail, if you're into deep job nesting
  • Google Drive Extractor does not delete the input for custom header names every 5 seconds

What's coming up next?

  • New Facebook and Salesforce extractors are getting really close.
  • Developer Portal is almost ready. There is no UI so far, we're API first.
  • Keboola Connection in AWS EU region.

Job failures

There were  jobs failures between 1:30 AM - 6:15 AM UTC caused by flooded disk on one of our servers. We are making steps to avoid this issue happening again.

We're sorry for this inconvenience.

Shared buckets

We're happy to announce the release of the Shared Buckets  feature.  It's an easy way to share data between projects in Keboola Connection.

    This will help you:

    • Have greater organizational control over your data
    • Speedup your data workflow
    • Reduce your project usage totals

    For more details about Shared Buckets, see our User documentation. Developers can find more info in our API documentation in Apiary.



      Project Power Reset

      Since the Project Power feature has been developed/improved in a continuous manner, and the last thing we want to do is provide partial (or worse, inaccurate) results, we have decided to begin measuring credit consumption from the beginning of this year, 2017.

      So all Project Power statistics from 2016 will no longer be shown, and the Project Power era officially begins for everybody from Jan 5, 2017 (as in image bellow).

      Thanks for your understanding.

      Error on job detail page

      Due to recent update in one of our components few of you may noticed "Internal Error" message while waiting for job to finish its processing.

      Issue affected users browsing job detail page between 17:20 and 17:40 CEST (Jan 5, 2017).

      We are very sorry for inconvenience.

      Week in review -- December 27, 2016

      Hello everyone,

      Last week we have updated the R environment for both custom science and transformations to version 3.3.2.

      Apart from that not much has happened last week because our office has been seized:


      If everything goes as planned, this should be our last post of the year. So we wish you Happy New Year!

      Job failures

      Job Failures

      There were jobs failures between 4 AM - 9 AM UTC caused by one of our servers dying in a horrible slow and painful death.

      We're sorry for this inconvenience, we have restarted the affected orchestrations.


      Week in review -- December 19, 2016

      Hello everyone,

      Here's the list of the most important changes we made last week:

      Project Power in Credits

      A few weeks ago we announced the Project Power (you can find it under User & Settings -> Project Power tab). As we continue to improve this part of Keboola Connection, we are introducing a new unit for measuring the Project Power -- Credits.

      We've also begun displaying these power credits for resource consumption instead of Storage IO in job detail.

       
      For now, it's most notable that 1 credit is equal to 1 GB of processed data and the smallest unit we measure is "nano credit" (previously Byte). Anyway, don't worry, an upcoming post about this feature will describe Project Power in full.


      New GoodData Extractor

      You can find it as GoodData Reports. 

      The old version of GoodData Extractor has been deprecated and we are preparing a migration tool to ease the transition to the new one.

      Read more here http://status.keboola.com/new-version-of-gooddata-extractor.


      Create a Project with Promo Code

      It is now possible to create a project with a Promo Code. This can be useful for workshops or other events, where attendants will be using Keboola Connection. Please contact your Maintainer for more details.


      Enjoy your week and Merry Christmas!

      New version of GoodData extractor

      We have released a new version of GoodData extractor. It runs fully in our Docker infrastructure and so uses its whole potential. It is no longer dependent on GoodData Writer and calls GoodData API directly. It can either take credentials from a chosen writer or you can specify your own. Then you specify uri of reports you want to download as in the old version.

      The old extractor is now deprecated and will be switched off by the end of January. A migration wizard which will help you with transition will appear in the old extractor ui later today.

      Week in Review -- December 12, 2016

      Howdy everybody, 

      Here's some highlights from this last week:

      • Performance of the new parallel uploading technique we mentioned last week saw a significant improvement.  We're now able to load 60GB from a foreign S3 bucket (outside of KBC) to a Snowflake storage bucket in approximately 33min.  And the only direction that's going is faster.
      • There are some newly available storage api endpoints for key/value metadata.  Feel free to check out the API documentation for further info.
      • There was a new blog post on our blog: Querying JSON ad-hoc in Snowflake
      • We've updated the JSON parser Chrome extension for Papertrail and it's available in the Chrome Web Store

      Be sure to tune in again next week for more updates!