After upgrade Lucid->Maverick, all nodes need to be re-registered

Bug #644759 reported by C de-Avillez
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Eucalyptus
Invalid
Undecided
Unassigned
eucalyptus (Ubuntu)
Fix Released
High
Unassigned

Bug Description

Upgraded first the CLC/CC/SC/Walrus (all-in-one topology). Then upgraded 3 NCs. This is what happened:

ubuntu@cempedak:~/uec-testing-scripts$ euca-describe-availability-zones verbose
AVAILABILITYZONE UEC-TEST1 10.55.55.2
AVAILABILITYZONE |- vm types free / max cpu ram disk
AVAILABILITYZONE |- m1.small 0000 / 0000 1 192 2
AVAILABILITYZONE |- c1.medium 0000 / 0000 1 256 5
AVAILABILITYZONE |- m1.large 0000 / 0000 2 512 10
AVAILABILITYZONE |- m1.xlarge 0000 / 0000 2 1024 20
AVAILABILITYZONE |- c1.xlarge 0000 / 0000 4 2048 20
ubuntu@cempedak:~/uec-testing-scripts$ sudo euca_conf --deregister-nodes "10.55.55.5 10.55.55.7 10.55.55.8"
SUCCESS: removed node '10.55.55.5' from '//etc/eucalyptus/eucalyptus.local.conf'
SUCCESS: removed node '10.55.55.7' from '//etc/eucalyptus/eucalyptus.local.conf'
SUCCESS: removed node '10.55.55.8' from '//etc/eucalyptus/eucalyptus.local.conf'
ubuntu@cempedak:~/uec-testing-scripts$ sudo euca_conf --register-nodes "10.55.55.5 10.55.55.7 10.55.55.8"

INFO: We expect all nodes to have eucalyptus installed in //var/lib/eucalyptus/keys for key synchronization.

Trying rsync to sync keys with "10.55.55.5"...The authenticity of host '10.55.55.5 (10.55.55.5)' can't be established.
RSA key fingerprint is 13:47:51:c5:8a:6d:c6:4c:23:50:2e:bb:67:ce:a2:4c.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '10.55.55.5' (RSA) to the list of known hosts.
done.

Trying rsync to sync keys with "10.55.55.7"...The authenticity of host '10.55.55.7 (10.55.55.7)' can't be established.
RSA key fingerprint is 1e:04:e8:cf:d8:16:c5:d5:d5:ad:31:7d:c4:d7:64:11.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '10.55.55.7' (RSA) to the list of known hosts.
done.

Trying rsync to sync keys with "10.55.55.8"...The authenticity of host '10.55.55.8 (10.55.55.8)' can't be established.
RSA key fingerprint is 47:a6:1e:90:5f:93:aa:8b:cd:d7:1e:e0:00:c8:b5:f0.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '10.55.55.8' (RSA) to the list of known hosts.
done.
ubuntu@cempedak:~/uec-testing-scripts$ euca-describe-availability-zones verbose
AVAILABILITYZONE UEC-TEST1 10.55.55.2
AVAILABILITYZONE |- vm types free / max cpu ram disk
AVAILABILITYZONE |- m1.small 0000 / 0000 1 192 2
AVAILABILITYZONE |- c1.medium 0000 / 0000 1 256 5
AVAILABILITYZONE |- m1.large 0000 / 0000 2 512 10
AVAILABILITYZONE |- m1.xlarge 0000 / 0000 2 1024 20
AVAILABILITYZONE |- c1.xlarge 0000 / 0000 4 2048 20
ubuntu@cempedak:~/uec-testing-scripts$ euca-describe-availability-zones verbose
AVAILABILITYZONE UEC-TEST1 10.55.55.2
AVAILABILITYZONE |- vm types free / max cpu ram disk
AVAILABILITYZONE |- m1.small 0048 / 0048 1 192 2
AVAILABILITYZONE |- c1.medium 0048 / 0048 1 256 5
AVAILABILITYZONE |- m1.large 0024 / 0024 2 512 10
AVAILABILITYZONE |- m1.xlarge 0024 / 0024 2 1024 20
AVAILABILITYZONE |- c1.xlarge 0012 / 0012 4 2048 20
ubuntu@cempedak:~/uec-testing-scripts$

Mathias Gug (mathiaz)
Changed in eucalyptus (Ubuntu):
importance: Undecided → Medium
importance: Medium → High
Revision history for this message
C de-Avillez (hggdh2) wrote :

from the cc.log:

[Thu Sep 23 14:43:12 2010][014472][EUCAINFO ] refresh_resources(): called
[Thu Sep 23 14:43:12 2010][014472][EUCADEBUG ] ncClientCall(ncDescribeResource): called ncURL=http://10.55.55.5:8775/axis2/services/EucalyptusNC timeout=20
[Thu Sep 23 14:43:12 2010][027693][EUCADEBUG ] DEBUG: requested URI http://10.55.55.5:8775/axis2/services/EucalyptusNC
[Thu Sep 23 14:43:12 2010][027693][EUCADEBUG ] ncClientCall(ncDescribeResource): ppid=14472 client calling 'ncDescribeResource'
[Thu Sep 23 14:43:12 2010][027693][EUCAERROR ] ERROR: DescribeResource() could not be invoked (check NC host, port, and credentials)
[Thu Sep 23 14:43:12 2010][027693][EUCADEBUG ] ncClientCall(ncDescribeResource): ppid=14472 done calling 'ncDescribeResource' with exit code '1'
[Thu Sep 23 14:43:12 2010][014472][EUCADEBUG ] ncClientCall(ncDescribeResource): done clientrc=0 opFail=1
[Thu Sep 23 14:43:12 2010][014472][EUCAERROR ] refresh_resources(): bad return from ncDescribeResource(10.55.55.5) (1)
[Thu Sep 23 14:43:12 2010][014472][EUCADEBUG ] ncClientCall(ncDescribeResource): called ncURL=http://10.55.55.8:8775/axis2/services/EucalyptusNC timeout=20
[Thu Sep 23 14:43:12 2010][027694][EUCADEBUG ] DEBUG: requested URI http://10.55.55.8:8775/axis2/services/EucalyptusNC
[Thu Sep 23 14:43:12 2010][027694][EUCADEBUG ] ncClientCall(ncDescribeResource): ppid=14472 client calling 'ncDescribeResource'
[Thu Sep 23 14:43:12 2010][027694][EUCAERROR ] ERROR: DescribeResource() could not be invoked (check NC host, port, and credentials)
[Thu Sep 23 14:43:12 2010][027694][EUCADEBUG ] ncClientCall(ncDescribeResource): ppid=14472 done calling 'ncDescribeResource' with exit code '1'
[Thu Sep 23 14:43:12 2010][014472][EUCADEBUG ] ncClientCall(ncDescribeResource): done clientrc=0 opFail=1
[Thu Sep 23 14:43:12 2010][014472][EUCAERROR ] refresh_resources(): bad return from ncDescribeResource(10.55.55.8) (1)
[Thu Sep 23 14:43:12 2010][014472][EUCADEBUG ] ncClientCall(ncDescribeResource): called ncURL=http://10.55.55.7:8775/axis2/services/EucalyptusNC timeout=20
[Thu Sep 23 14:43:12 2010][027695][EUCADEBUG ] DEBUG: requested URI http://10.55.55.7:8775/axis2/services/EucalyptusNC
[Thu Sep 23 14:43:12 2010][027695][EUCADEBUG ] ncClientCall(ncDescribeResource): ppid=14472 client calling 'ncDescribeResource'
[Thu Sep 23 14:43:12 2010][027695][EUCAERROR ] ERROR: DescribeResource() could not be invoked (check NC host, port, and credentials)
[Thu Sep 23 14:43:12 2010][027695][EUCADEBUG ] ncClientCall(ncDescribeResource): ppid=14472 done calling 'ncDescribeResource' with exit code '1'
[Thu Sep 23 14:43:12 2010][014472][EUCADEBUG ] ncClientCall(ncDescribeResource): done clientrc=0 opFail=1
[Thu Sep 23 14:43:12 2010][014472][EUCAERROR ] refresh_resources(): bad return from ncDescribeResource(10.55.55.7) (1)
[Thu Sep 23 14:43:12 2010][014472][EUCADEBUG ] refresh_resources(): done

Revision history for this message
C de-Avillez (hggdh2) wrote :

logs uploaded to lp:~hggdh2/%2Bjunk/uec-qa/
Pushed up to revision 62.

Revision history for this message
C de-Avillez (hggdh2) wrote :

The attached tar file contains the output of 'openssl x509 -text' for certificates for a NC (santol):

node-certs-after-register.txt: certificates after a euca_conf --deregister/register
node-certs-after-upgrade.txt: certificates after the upgrade
node-certs-before-upgrade.txt: certificates in the original Lucid install.

Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package eucalyptus - 2.0+bzr1241-0ubuntu3

---------------
eucalyptus (2.0+bzr1241-0ubuntu3) maverick; urgency=low

  * debian/eucalyptus-java-common.{pre|postinst}: Backup /usr/share/eucalytpus
    to enable the euca_upgrade script to be able to properly upgrade
    the components. (LP: #646100, #644759)
  * debian/patches/07-local_support_euca_conf-in.patch:
    - Do not upgrade /etc/eucalyptus/eucalyptus.local.conf as it shouldn't
      contain settings that require updating, and has the undesirable feature
      of disabling eucalyptus network settings. (LP: #644733)
    - Resolved removal of nodes from nodes.list when deregistering a node
      (LP: #640502)
 -- Dave Walker (Daviey) <email address hidden> Mon, 27 Sep 2010 23:41:14 +0100

Changed in eucalyptus (Ubuntu):
status: New → Fix Released
Neil Soman (neilsoman)
Changed in eucalyptus:
status: New → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Bug attachments

Remote bug watches

Bug watches keep track of this bug in other bug trackers.