Charm needed: HBase

Bug #800708 reported by Mark Mims
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juju Charms Collection
Fix Released
Medium
James Page

Bug Description

HBase formula

Mark Mims (mark-mims)
Changed in principia:
assignee: nobody → Mark Mims (mark-mims)
summary: - new-formula (HBase)
+ Formula needed: HBase
Changed in principia:
importance: Undecided → Critical
tags: added: hot
Changed in principia:
importance: Critical → Medium
summary: - Formula needed: HBase
+ Charm needed: HBase
tags: added: new-charm
removed: new-formula
Revision history for this message
Clint Byrum (clint-fewbar) wrote :

Removing new-charm tag from bugs that don't have an actual new-charm to review.

tags: removed: new-charm
Revision history for this message
James Page (james-page) wrote :

Mark - OK if I steal this off you? Have something working against the hadoop-ubuntu PPA packages...

Revision history for this message
Mark Mims (mark-mims) wrote :

np... thanks!

Changed in charms:
assignee: Mark Mims (mark-mims) → James Page (james-page)
James Page (james-page)
Changed in charms:
status: New → In Progress
Revision history for this message
James Page (james-page) wrote :

OK - I think that these are ready for review now.

This is a two parter:

1) A single hadoop charm that can deploy all of the hadoop mapreduce and hdfs roles either together or in separate service units

2) A single hbase charm that can deploy all of the hbase roles; it also supports the gateways for thrift, avro and rest but I've not been able to test those yet (working on that).

The only thing I have noticed is a bit of raceyness between the namenode and the jobtracker when deployed together in a single service unit as the jobtracker waits for the namenode to get its stuff in order - it causes tasktrackers which check in early in deployments to give up.

Both charms have a pretty comprehensive README.

tags: added: new-charm
Revision history for this message
James Page (james-page) wrote :

Oh - and most of my testing has been on the local provider - I have done some in ec2 (will do some more...) which did flush out one bug with dotdee - files in the .d directory must start with numbers!

Revision history for this message
James Page (james-page) wrote :

Hadoop charm tested in ec2 as well - works OK; picked up a couple of bugs so have pushed a new revision to the branch.

Revision history for this message
Robert Ayres (robert-ayres) wrote :

Have done some testing in EC2, everything seems to work fine.

Have made a couple of minor changes to the documentation in https://code.launchpad.net/~robert-ayres/charms/precise/hbase/trunk - mention of running HDFS in append mode and other corrections.

One thing I did notice was '/etc/dotdee/root/.ssh/authorized_keys.d' directory is world readable along with the various node keys. Not sure if this was intentional, but thought I'd point this out as the 'authorized_keys' file sourced is private.

Revision history for this message
James Page (james-page) wrote :

Robert - merges in your changes - thankyou!

Changed in charms:
status: In Progress → Fix Committed
tags: added: precise
James Page (james-page)
Changed in charms:
status: Fix Committed → Fix Released
Revision history for this message
amir sanjar (asanjar) wrote :

.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Related blueprints

Remote bug watches

Bug watches keep track of this bug in other bug trackers.