Provision Wil Loop until it finishes completely ,   For the storage failures in 14.04  ,, we need to wait for Dheeraj
 
following packages have unmet dependencies:                                                                                                                                     
 contrail-storage : Depends: cinder-volume but it is not going to be installed                                                                                                     
E: Unable to correct problems, you have held broken packages.                                                                                                                      
Error: /Stage[storage]/Contrail::Storage/Contrail::Lib::Storage_common[storage-compute]/Package[contrail-storage]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install contrail-storage' returned 100: Reading package lists...                                                                
Building dependency tree...                                                                                                                                                        
Reading state information...                                                                                                                                                        
Some packages could not be installed. This may mean that you have                                                                                                                   
requested an impossible situation or if you are using the unstable                                                                                                                 
distribution that some required packages have not yet been created                                                                                                                 
or been moved out of Incoming.                                                                                                                                                      
The following information may help to resolve the situation:                                                                                                                       
                                                                                                                                                                                    
The following packages have unmet dependencies:                                                                                                                                     
 contrail-storage : Depends: cinder-volume but it is not going to be installed                                                                                                      
E: Unable to correct problems, you have held broken packages.
Thanks
Vinod
 
From: Vivek Garg 
Sent: Tuesday, February 17, 2015 3:36 PM
To: Jeba Paulaiyan; Vinod Nair; Michael Nishimoto; Nitish Krishna Kaveri Poompatnam
Cc: Abhay Joshi; Dheeraj Gautam; Jeya Ganesh Babu Jegatheesan; Wenqing Liang
Subject: RE: Sm provisioning failing in Build 32 also
 
This is for build 33. 12.04 SM with 14.04 target node and the provisioning is looping.
 
From: Vivek Garg 
Sent: Tuesday, February 17, 2015 3:35 PM
To: Jeba Paulaiyan; Vinod Nair; Michael Nishimoto; Nitish Krishna Kaveri Poompatnam
Cc: Abhay Joshi; Dheeraj Gautam; Jeya Ganesh Babu Jegatheesan; Wenqing Liang
Subject: RE: Sm provisioning failing in Build 32 also
 
Setup storage compute fails
Setup config storage compute fails
 
Here is the log :
(/Stage[compute]/Contrail::Compute/Contrail::Lib::Report_status[compute_started]/Exec[contrail-status-compute_started]/returns) 2015-02-17 15:24:38 (0.00 B/s) - 'server_status?server_id=cmbu-toystory-01&state=compute_started.49' saved [0/0]
Feb 17 15:24:38 cmbu-toystory-01 puppet-agent[25444]: (/Stage[compute]/Contrail::Compute/Contrail::Lib::Report_status[compute_started]/Exec[contrail-status-compute_started]/returns) executed successfully
Feb 17 15:24:39 cmbu-toystory-01 puppet-agent[25444]: (/Stage[storage]/Contrail::Profile::Storage/Contrail::Storage/Contrail::Lib::Storage_common[storage-compute]/Contrail::Lib::Report_status[storage_started]/Exec[contrail-status-storage_started]/returns) --2015-02-17 15:24:39--  http://10.87.132.105:9002/server_status?server_id=cmbu-toystory-01&state=storage_started
Feb 17 15:24:39 cmbu-toystory-01 puppet-agent[25444]: (/Stage[storage]/Contrail::Profile::Storage/Contrail::Storage/Contrail::Lib::Storage_common[storage-compute]/Contrail::Lib::Report_status[storage_started]/Exec[contrail-status-storage_started]/returns) Connecting to 10.87.132.105:9002... connected.
Feb 17 15:24:39 cmbu-toystory-01 puppet-agent[25444]: (/Stage[storage]/Contrail::Profile::Storage/Contrail::Storage/Contrail::Lib::Storage_common[storage-compute]/Contrail::Lib::Report_status[storage_started]/Exec[contrail-status-storage_started]/returns) HTTP request sent, awaiting response... 200 OK
Feb 17 15:24:39 cmbu-toystory-01 puppet-agent[25444]: (/Stage[storage]/Contrail::Profile::Storage/Contrail::Storage/Contrail::Lib::Storage_common[storage-compute]/Contrail::Lib::Report_status[storage_started]/Exec[contrail-status-storage_started]/returns) Length: 0 [text/html]
Feb 17 15:24:39 cmbu-toystory-01 puppet-agent[25444]: (/Stage[storage]/Contrail::Profile::Storage/Contrail::Storage/Contrail::Lib::Storage_common[storage-compute]/Contrail::Lib::Report_status[storage_started]/Exec[contrail-status-storage_started]/returns) Saving to: 'server_status?server_id=cmbu-toystory-01&state=storage_started.46'
Feb 17 15:24:39 cmbu-toystory-01 puppet-agent[25444]: (/Stage[storage]/Contrail::Profile::Storage/Contrail::Storage/Contrail::Lib::Storage_common[storage-compute]/Contrail::Lib::Report_status[storage_started]/Exec[contrail-status-storage_started]/returns)      0K                                                        0.00 =0s
Feb 17 15:24:39 cmbu-toystory-01 puppet-agent[25444]: (/Stage[storage]/Contrail::Profile::Storage/Contrail::Storage/Contrail::Lib::Storage_common[storage-compute]/Contrail::Lib::Report_status[storage_started]/Exec[contrail-status-storage_started]/returns) 2015-02-17 15:24:39 (0.00 B/s) - 'server_status?server_id=cmbu-toystory-01&state=storage_started.46' saved [0/0]
Feb 17 15:24:39 cmbu-toystory-01 puppet-agent[25444]: (/Stage[storage]/Contrail::Profile::Storage/Contrail::Storage/Contrail::Lib::Storage_common[storage-compute]/Contrail::Lib::Report_status[storage_started]/Exec[contrail-status-storage_started]/returns) executed successfully
Feb 17 15:24:44 cmbu-toystory-01 puppet-agent[25444]: (/Stage[storage]/Contrail::Profile::Storage/Contrail::Storage/Contrail::Lib::Storage_common[storage-compute]/Contrail::Lib::Report_status[storage_completed]/Exec[contrail-status-storage_completed]) Dependency Package[contrail-storage] has failures: true
Feb 17 15:24:44 cmbu-toystory-01 puppet-agent[25444]: (/Stage[storage]/Contrail::Profile::Storage/Contrail::Storage/Contrail::Lib::Storage_common[storage-compute]/Contrail::Lib::Report_status[storage_completed]/Exec[contrail-status-storage_completed]) Skipping because of failed dependencies
Feb 17 15:24:44 cmbu-toystory-01 puppet-agent[25444]: (/Stage[post]/Contrail::Provision_complete/Contrail::Lib::Report_status[provision_completed]/Exec[contrail-status-provision_completed]) Dependency Exec[setup-config-storage-compute] has failures: true
Feb 17 15:24:44 cmbu-toystory-01 puppet-agent[25444]: (/Stage[post]/Contrail::Provision_complete/Contrail::Lib::Report_status[provision_completed]/Exec[contrail-status-provision_completed]) Dependency Package[contrail-storage] has failures: true
Feb 17 15:24:44 cmbu-toystory-01 puppet-agent[25444]: (/Stage[post]/Contrail::Provision_complete/Contrail::Lib::Report_status[provision_completed]/Exec[contrail-status-provision_completed]) Skipping because of failed dependencies
 
 
-Vivek
 
 
From: Jeba Paulaiyan 
Sent: Tuesday, February 17, 2015 3:18 PM
To: Vinod Nair; Michael Nishimoto; Vivek Garg; Nitish Krishna Kaveri Poompatnam
Cc: Abhay Joshi; Dheeraj Gautam; Jeya Ganesh Babu Jegatheesan; Wenqing Liang
Subject: Re: Sm provisioning failing in Build 32 also
 
+Vivek and Nitish.
 
Vivek is testing 12.04 SM with 14.04 target node and he reports the provisioning is looping. Nitish is helping him debug it.
 
Thanks,
Jeba
 
From: Vinod Nair <email address hidden>
Date: Tuesday, February 17, 2015 at 3:15 PM
To: Michael Nishimoto <email address hidden>
Cc: Abhay Joshi <email address hidden>, Dheeraj Gautam <email address hidden>, Jeya Ganesh Babu Jegatheesan <email address hidden>, Jeba Paulaiyan <email address hidden>, Wenqing Liang <email address hidden>
Subject: RE: Sm provisioning failing in Build 32 also
 
Yes With SM
 
 
 
From: Michael Nishimoto 
Sent: Tuesday, February 17, 2015 3:14 PM
To: Vinod Nair
Cc: Abhay Joshi; Dheeraj Gautam; Jeya Ganesh Babu Jegatheesan; Jeba Paulaiyan; Wenqing Liang
Subject: Re: Sm provisioning failing in Build 32 also
 
Is this with SM installs?
 
We have two SM installs which appear to be hanging
 
Michael 

Sent from my iPhone

On Feb 17, 2015, at 3:06 PM, "Vinod Nair" <email address hidden> wrote:

Hi Abhay
 
Looks like something was wrong with Build 32..
 
I trued build 33  on 12.04 now and everything if fine including live migration
 
 
Thanks
Vinod
 
From: Abhay Joshi 
Sent: Tuesday, February 17, 2015 2:28 PM
To: Vinod Nair; Dheeraj Gautam; Michael Nishimoto
Cc: Jeya Ganesh Babu Jegatheesan; Jeba Paulaiyan; Wenqing Liang
Subject: Re: Sm provisioning failing in Build 32 also
 
Talked to Dheeraj. We are not able to see issue without storage. I also explained him the change. He is going to reinvestigate.
 
From: Vinod Nair <email address hidden>
Date: Monday, February 16, 2015 at 9:22 PM
To: Dheeraj Gautam <email address hidden>, Michael Nishimoto <email address hidden>, Abhay Joshi <email address hidden>
Cc: Jeya Ganesh Babu Jegatheesan <email address hidden>, Jeba Paulaiyan <email address hidden>, Wenqing Liang <email address hidden>
Subject: RE: Sm provisioning failing in Build 32 also
 
+ Abhay
 
Hi Abhay
 
Can you confirm pls
 
Thanks
Vinod
 
From: Dheeraj Gautam 
Sent: Monday, February 16, 2015 7:18 PM
To: Michael Nishimoto; Vinod Nair
Cc: Jeya Ganesh Babu Jegatheesan; Jeba Paulaiyan; Wenqing Liang
Subject: Re: Sm provisioning failing in Build 32 also
 
Hi Vinod/Michael,
 
This failure is not because of Storage. The failure is happening before storage itself. 
 
This could be because of recent change by Abhay (in 31 and further) related to keystone 
https://github.com/Juniper/contrail-puppet/commit/94f0ef444d656838bda04788aa288ea5c95b242c
 
 
-Dheeraj
 
From: Michael Nishimoto <email address hidden>
Date: Tuesday, February 17, 2015 at 6:17 AM
To: Vinod Nair <email address hidden>, Dheeraj Gautam <email address hidden>
Cc: Jeya Ganesh Babu Jegatheesan <email address hidden>, Jeba Paulaiyan <email address hidden>, Wenqing Liang <email address hidden>
Subject: Re: Sm provisioning failing in Build 32 also
 
Jeba/Wenqing:
 
How are the automated regressions doing?
 
Is this failing only in SM?
 
Jeba: we really need to work with the SM team to get their CI going the code base is too fragile.  We can’t expect the rest of the Contrail team to understand all the additional requirements that we are putting on their code.
The fab-based CI+Storage needs to get in now, so we have a good base to work from.
 
Vinod: Thanks for working during the holiday.
 
Michael
 
 
 
From: Vinod Nair <email address hidden>
Date: Monday, February 16, 2015 at 2:39 PM
To: Dheeraj Gautam <email address hidden>
Cc: Jeya Ganesh Babu Jegatheesan <email address hidden>, Michael Nishimoto <email address hidden>
Subject: Sm provisioning failing in Build 32 also
 
Hi Dh
 
I tried provision using SM 12.04 icehouse and is failing as below
 
server-manager status server --cluster_id vinod-cluster1
{
    "server": [
        {
            "id": "cmbu-starwars-01",
            "ip_address": "10.87.129.228",
            "mac_address": "00:25:90:CA:2C:88",
            "status": "compute_started"
        },
        {
            "id": "cmbu-starwars-02",
            "ip_address": "10.87.129.234",
            "mac_address": "00:25:90:CA:2D:24",
            "status": "compute_started"
        },
        {
            "id": "cmbu-gravity-06",
            "ip_address": "10.87.140.215",
            "mac_address": "00:25:90:AB:9C:6C",
            "status": "database_completed"
        }
    ]
}
 
 
dmin.keyring-cmbu-gravity-06]) Dependency Keystone_service[keystone] has failures: true
Feb 16 14:35:48 cmbu-gravity-06 puppet-agent[21686]: (/Stage[storage]/Contrail::Storage/Contrail::Lib::Storage_common[storage-master]/Ceph::Mon[cmbu-gravity-06]/Exec[ceph-mon-ceph.client.admin.keyring-cmbu-gravity-06]) Dependency Keystone_service[novav3] has failures: true
Feb 16 14:35:48 cmbu-gravity-06 puppet-agent[21686]: (/Stage[storage]/Contrail::Storage/Contrail::Lib::Storage_common[storage-master]/Ceph::Mon[cmbu-gravity-06]/Exec[ceph-mon-ceph.client.admin.keyring-cmbu-gravity-06]) Dependency Keystone_service[neutron] has failures: true
Feb 16 14:35:48 cmbu-gravity-06 puppet-agent[21686]: (/Stage[storage]/Contrail::Storage/Contrail::Lib::Storage_common[storage-master]/Ceph::Mon[cmbu-gravity-06]/Exec[ceph-mon-ceph.client.admin.keyring-cmbu-gravity-06]) Skipping because of failed dependencies
Feb 16 14:35:48 cmbu-gravity-06 puppet-agent[21686]: (/Stage[storage]/Contrail::Storage/Contrail::Lib::Storage_common[storage-master]/Ceph::Mon[cmbu-gravity-06]/Service[ceph-mon-cmbu-gravity-06]) Dependency Keystone_tenant[test] has failures: true
Feb 16 14:35:48 cmbu-gravity-06 puppet-agent[21686]: (/Stage[storage]/Contrail::Storage/Contrail::Lib::Storage_common[storage-master]/Ceph::Mon[cmbu-gravity-06]/Service[ceph-mon-cmbu-gravity-06]) Dependency Keystone_service[nova] has failures: true
Feb 16 14:35:48 cmbu-gravity-06 puppet-agent[21686]: (/Stage[storage]/Contrail::Storage/Contrail::Lib::Storage_common[storage-master]/Ceph::Mon[cmbu-gravity-06]/Service[ceph-mon-cmbu-gravity-06]) Dependency Keystone_service[glance] has failures: true
Feb 16 14:35:48 cmbu-gravity-06 puppet-agent[21686]: (/Stage[storage]/Contrail::Storage/Contrail::Lib::Storage_common[storage-master]/Ceph::Mon[cmbu-gravity-06]/Service[ceph-mon-cmbu-gravity-06]) Dependency Keystone_service[nova_ec2] has failures: true
Feb 16 14:35:48 cmbu-gravity-06 puppet-agent[21686]: (/Stage[storage]/Contrail::Storage/Contrail::Lib::Storage_common[storage-master]/Ceph::Mon[cmbu-gravity-06]/Service[ceph-mon-cmbu-gravity-06]) Dependency Keystone_service[keystone] has failures: true
Feb 16 14:35:48 cmbu-gravity-06 rsyslogd-2177: imuxsock begins to drop messages from pid 21686 due to rate-limiting