New Hadoop Charms Available


#1

Hi folks,

Just a note to say that the latest Bigtop charms are now available on the Edge channel.

This include updated:

Hadoop Namenode
Hadoop ResourceManager
Hadoop Slave (that will get renamed after this release)
and Hadoop Client.

I have an updated Spark charm I’m testing locally and will update on the edge channel shortly which will update Spark to 2.2.3

This bumps our Bigtop release from 1.2.x to 1.4.0 and the release notes can be found here:
https://blogs.apache.org/bigtop/entry/release-of-apache-bigtop-13

Going forward I will update the charms for Juju Storage and Network support and will look to bring in the K8S Hadoop charms in line with the Bigtop community activity, I dont’ see much value in rolling our own I’d rather have a few other developers helping out so I shall lend a hand upstream and bring them down to Juju when ready.

Anyway… I’ll leave them in edge and update the bundles and test a few things over the next week or so and slowly bump them through the channels. Unless someone says otherwise I’m gonna run a lazy consensus on this one and if no one squeals I’ll push them into stable in a week or so.

Tom


#2

Sorry for the delay, Spark on Edge channel is 2.2.3!


#3

Hive is now at 2.3.3
Hbase is now at 1.3.2

both on the edge channel. I’ve not tested these yet so YMMV.