SM: On SM provisoned storage, ceph -w sometimes throws errors

[Vinod Nair]

Provisioned a cluster Using SM UI , even though the provision succeeded , ceph -w throws errors

Version : 2.10 Build 27 Ubuntu 12.04 icehouse

root@cmbu-gravity-06:/store# ceph -w
    cluster e839ed67-df4c-4fae-92dd-207c2d60229a
     health HEALTH_OK
     monmap e2: 3 mons at {cmbu-gravity-06=8.0.0.1:6789/0,cmbu-starwars-01=8.0.0.2:6789/0,cmbu-starwars-02=8.0.0.3:6789/0}, election epoch 8, quorum 0,1,2 cmbu-gravity-06,cmbu-starwars-01,cmbu-starwars-02
     osdmap e48: 6 osds: 6 up, 6 in
      pgmap v126: 384 pgs, 2 pools, 1778 MB data, 229 objects
            3773 MB used, 3070 GB / 3074 GB avail
                 384 active+clean

2015-02-10 18:21:18.914803 mon.0 [INF] from='client.? 8.0.0.2:0/1008063' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.bootstrap-osd", "caps": ["mon", "allow profile bootstrap-osd"]}]: dispatch
2015-02-10 18:21:20.127407 mon.0 [INF] from='client.? 8.0.0.2:0/1008096' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.bootstrap-osd", "caps": ["mon", "allow profile bootstrap-osd"]}]: dispatch
2015-02-10 18:21:21.350727 mon.0 [INF] from='client.? 8.0.0.2:0/1008127' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.bootstrap-osd", "caps": ["mon", "allow profile bootstrap-osd"]}]: dispatch
2015-02-10 18:21:22.553028 mon.2 [INF] from='client.? 8.0.0.2:0/1008160' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.bootstrap-osd", "caps": ["mon", "allow profile bootstrap-osd"]}]: dispatch
2015-02-10 18:21:22.618964 mon.0 [INF] from='client.26735 :/0' entity='forwarded-request' cmd=[{"prefix": "auth get-or-create", "entity": "client.bootstrap-osd", "caps": ["mon", "allow profile bootstrap-osd"]}]: dispatch
^Croot@cmbu-gravity-06:/store#

ceph -s ok though
root@cmbu-gravity-06:/store# ceph -s
    cluster e839ed67-df4c-4fae-92dd-207c2d60229a
     health HEALTH_OK
     monmap e2: 3 mons at {cmbu-gravity-06=8.0.0.1:6789/0,cmbu-starwars-01=8.0.0.2:6789/0,cmbu-starwars-02=8.0.0.3:6789/0}, election epoch 8, quorum 0,1,2 cmbu-gravity-06,cmbu-starwars-01,cmbu-starwars-02
     osdmap e48: 6 osds: 6 up, 6 in
      pgmap v126: 384 pgs, 2 pools, 1778 MB data, 229 objects
            3773 MB used, 3070 GB / 3074 GB avail
                 384 active+clean

server-manager status server --cluster_id vinod-cluster1
{
    "server": [
        {
            "id": "cmbu-starwars-01",
            "ip_address": "10.87.129.228",
            "mac_address": "00:25:90:CA:2C:88",
            "status": "provision_completed"
        },
        {
            "id": "cmbu-starwars-02",
            "ip_address": "10.87.129.234",
            "mac_address": "00:25:90:CA:2D:24",
            "status": "provision_completed"
        },
        {
            "id": "cmbu-gravity-06",
            "ip_address": "10.87.140.215",
            "mac_address": "00:25:90:AB:9C:6C",
            "status": "provision_completed"
        }
    ]
}

[Dheeraj Gautam (dgautam)]

This is not a bug. These are INFO messages not ERRORs. This is expected behavior as puppet keeps running and checking if keys are configured. These

So removing blocker tag.

[Dheeraj Gautam (dgautam)]

Completion of last comment #1
===========================
This is not a bug. These are INFO messages not ERRORs. This is expected behavior as puppet keeps running and checking if keys are configured. These should go away once puppet will stop.

[Dheeraj Gautam (dgautam)]

With latest release even after puppet agent stop working, "ceph -w" still prints those errors. So bug is not fixed even after puppet stops working.

Discussed this with Vinod, this could be moved to next release.

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/7944
Committed: http://github.org/Juniper/contrail-puppet/commit/03ce667802412918fb0a83c13e795af2b92b774c
Submitter: Zuul
Branch: R2.1

commit 03ce667802412918fb0a83c13e795af2b92b774c
Author: Dheeraj Gautam <email address hidden>
Date: Sun Mar 1 22:27:26 2015 -0800

SM-Storage: Added some checks file while adding OSDs

1. Added checks while adding auth for OSS. This helps in reducing the
command ran for ceph OSD, so "ceph -w" output.

Change-Id: I93fc4cc6587721b1c03e2ca26747511bc6f27796
Partial-Bug: #1420582

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/8040
Submitter: Dheeraj Gautam (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/8040
Committed: http://github.org/Juniper/contrail-puppet/commit/55ac6414cf874f25a745039d46dff6d47eaa6a28
Submitter: Zuul
Branch: master

commit 55ac6414cf874f25a745039d46dff6d47eaa6a28
Author: Dheeraj Gautam <email address hidden>
Date: Sun Mar 1 22:27:26 2015 -0800

SM-Storage: Added some checks file while adding OSDs

1. Added checks while adding auth for OSS. This helps in reducing the
command ran for ceph OSD, so "ceph -w" output.

Change-Id: I93fc4cc6587721b1c03e2ca26747511bc6f27796
Partial-Bug: #1420582

[Vivek (vivekgarg)]

Moving to fix commited state, don’t see any errors in ceph -w in build 2.10~48 or 2.10~49 while writing to the disks in SM provisioned cluster.