New Charm: Ceph

[Jorge Castro]

We need a formula for Ceph.

Here are the criteria for formulas: https://ensemble.ubuntu.com/Principia

[Clint Byrum (clint-fewbar)]

The first skeleton of a fully featured ceph charm are included in the linked branch. Would appreciate some review. It requires some manual steps via ssh. Most notably, you must deploy and add units, then do:

juju set ceph root-ssh=yes

Then login to one of the nodes and do

sudo mkcephfs -a -c /etc/ceph/ceph.conf

After this, scaling up / down will require manual steps according to CEPH's documentation.

Also this runs mds and mon and osd on each node, which will work but only if there are an odd number of nodes.

Also not yet using cephx auth, so its quite open to attack.

Also if you turn on the optional RADOS s3 gateway:

juju set ceph rados-port=80

You will have an S3 interface on said port on all units. To create credentials, on any unit run 'sudo radosgw_admin' to generate the S3 credentials.

Leaving as 'new-charm' for comment before pushing to official list.

[Dustin Kirkland  (kirkland)]

On Thu, Oct 13, 2011 at 2:34 AM, Clint Byrum <email address hidden> wrote:
> The first skeleton of a fully featured ceph charm are included in the
> linked branch. Would appreciate some review. It requires some manual
> steps via ssh.

For the ssh steps, it would be really nice to have a capistrano
charm/service/relation colocated on each of the nodes. Ideally, we'd
have a nice, clean, supportable way of doing this (spraying commands,
even as root, to a set of nodes).

[Dustin Kirkland  (kirkland)]

Disregard my comments about capistrano here. This is a separate issue, and me/Juan/Clint have discussed a pretty simple/cool way of doing juju+capistrano.

[Clint Byrum (clint-fewbar)]

Marking Fix Released. The ceph charm is there and official now, and at least moderately useful for automating scaling ceph UP. Scaling down is somewhat tricky! Also bootstrapping is quite clunky. The CEPH devs are aware of that and trying to get rid of the need for rsyncing things around.