2019 edit

2019-07-31 Peter

Apologies - forgot to say I was going on holiday! Apologies for the lack of updates, and the bigger than usual update this week. Remember, you can get daily news updates from our twitter feed (@OnDataEng)…

Technology updates (details are on the relevant technology pages):

Greenplum is up to release 5.12
Apache Knox 1.3 is out, with support for Hue, Cloudera Manager and Apache Livy
Apache Solr 8.2 is out
Cloudera Data Science Workbench 1.6 is out, with support for multiple editors including Jupyter, RStudio and PyCharm
Elastic Cloud Enterprise 2.3 is out, with support for role based access control

Other technology news:

From Cloudera, details on YuniKorn, their new universal resource scheduler that can underpin both Kubernetes and Hadoop YARN resource scheduling - link
From Datanami, thoughts on Object Stores and ScaleOutFilesystems - link
There’s a bunch of vulnerabilities announced for Apache Storm - CVE-2018-11779; CVE-2018-1320 and CVE-2019-0202
Azure Data Lake Store now supports Azure Blob Storage API as well as an HDFS compatible API - link
From Datanami, Ascend has launched with an Autonomous Dataflow Service - looks interesting, if anyone has any thoughts please share - link
Redis now has a module that turns it into a Time Series Databases - link
CDH now supports and will include Apache Phoenix for SQL over HBase - link
Google Big Query now has a new user interface, GIS functions, persistent UDFs and more - link
From the ODBS Industry Watch blog, an interview on LeanXcale, a hybrid Transactional Analytical (HTAP) database - I’m still not sure what to make of these, thoughts welcomed - link