Charm needed: HBase

Reported by Mark Mims on 2011-06-22
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juju Charms Collection
Medium
James Page

Bug Description

HBase formula

Mark Mims (mark-mims) on 2011-06-22
Changed in principia:
assignee: nobody → Mark Mims (mark-mims)
summary: - new-formula (HBase)
+ Formula needed: HBase
Changed in principia:
importance: Undecided → Critical
tags: added: hot
Changed in principia:
importance: Critical → Medium
summary: - Formula needed: HBase
+ Charm needed: HBase
tags: added: new-charm
removed: new-formula
Clint Byrum (clint-fewbar) wrote :

Removing new-charm tag from bugs that don't have an actual new-charm to review.

tags: removed: new-charm
James Page (james-page) wrote :

Mark - OK if I steal this off you? Have something working against the hadoop-ubuntu PPA packages...

Mark Mims (mark-mims) wrote :

np... thanks!

Changed in charms:
assignee: Mark Mims (mark-mims) → James Page (james-page)
James Page (james-page) on 2012-02-23
Changed in charms:
status: New → In Progress
James Page (james-page) wrote :

OK - I think that these are ready for review now.

This is a two parter:

1) A single hadoop charm that can deploy all of the hadoop mapreduce and hdfs roles either together or in separate service units

2) A single hbase charm that can deploy all of the hbase roles; it also supports the gateways for thrift, avro and rest but I've not been able to test those yet (working on that).

The only thing I have noticed is a bit of raceyness between the namenode and the jobtracker when deployed together in a single service unit as the jobtracker waits for the namenode to get its stuff in order - it causes tasktrackers which check in early in deployments to give up.

Both charms have a pretty comprehensive README.

tags: added: new-charm
James Page (james-page) wrote :

Oh - and most of my testing has been on the local provider - I have done some in ec2 (will do some more...) which did flush out one bug with dotdee - files in the .d directory must start with numbers!

James Page (james-page) wrote :

Hadoop charm tested in ec2 as well - works OK; picked up a couple of bugs so have pushed a new revision to the branch.

Robert Ayres (robert-ayres) wrote :

Have done some testing in EC2, everything seems to work fine.

Have made a couple of minor changes to the documentation in https://code.launchpad.net/~robert-ayres/charms/precise/hbase/trunk - mention of running HDFS in append mode and other corrections.

One thing I did notice was '/etc/dotdee/root/.ssh/authorized_keys.d' directory is world readable along with the various node keys. Not sure if this was intentional, but thought I'd point this out as the 'authorized_keys' file sourced is private.

James Page (james-page) wrote :

Robert - merges in your changes - thankyou!

Changed in charms:
status: In Progress → Fix Committed
tags: added: precise
James Page (james-page) on 2012-04-24
Changed in charms:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers

Related blueprints