Master node and slaves have different timezones - UTC and PST accordingly

Bug #1424701 reported by Andrey Sledzinskiy
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Critical
Alexander Gordeev
6.0.x
Fix Committed
High
Alexander Gordeev

Bug Description

{

    "build_id": "2015-02-22_22-54-44",
    "ostf_sha": "1a0b2c6618fac098473c2ed5a9af11d3a886a3bb",
    "build_number": "138",
    "release_versions":

{

    "2014.2-6.1":

{

    "VERSION":

{

    "build_id": "2015-02-22_22-54-44",
    "ostf_sha": "1a0b2c6618fac098473c2ed5a9af11d3a886a3bb",
    "build_number": "138",
    "api": "1.0",
    "nailgun_sha": "8a1e03b5863f4e91981278f154b088069415efae",
    "production": "docker",
    "python-fuelclient_sha": "5657dbf06fddb74adb61e9668eb579a1c57d8af8",
    "astute_sha": "d81ff53c2f467151ecde120d3a4d284e3b5b3dfc",
    "feature_groups":

            [
                "mirantis"
            ],
            "release": "6.1",
            "fuelmain_sha": "b975019fabdb429c1869047df18dd792d2163ecc",
            "fuellib_sha": "f5d713a3121fa971d63386f0d751a37dc58d061c"
        }
    }

},
"auth_required": true,
"api": "1.0",
"nailgun_sha": "8a1e03b5863f4e91981278f154b088069415efae",
"production": "docker",
"python-fuelclient_sha": "5657dbf06fddb74adb61e9668eb579a1c57d8af8",
"astute_sha": "d81ff53c2f467151ecde120d3a4d284e3b5b3dfc",
"feature_groups":

    [
        "mirantis"
    ],
    "release": "6.1",
    "fuelmain_sha": "b975019fabdb429c1869047df18dd792d2163ecc",
    "fuellib_sha": "f5d713a3121fa971d63386f0d751a37dc58d061c"

}

Steps:
1. Create and deploy next cluster - CentOS, HA, Neutron Vlan, 3 controllers, 2 compute
2. Check timezones on master and slave nodes

Expected - timezone is UTC on both
Actual -
[root@nailgun ~]# date +%Z
UTC
[root@node-1 ~]# date +%Z
PST

It was discovered in next test - http://jenkins-product.srt.mirantis.net:8080/view/6.1_swarm/job/6.1.system_test.centos.ha_neutron_destructive/42/testReport/junit/%28root%29/ha_haproxy_termination/ha_haproxy_termination/

Logs from test are attached

Revision history for this message
Andrey Sledzinskiy (asledzinskiy) wrote :
Changed in fuel:
status: New → Confirmed
assignee: Fuel Library Team (fuel-library) → Stanislaw Bogatkin (sbogatkin)
Revision history for this message
Stanislaw Bogatkin (sbogatkin) wrote :

Cannot reproduce on current master (#141)

[root@nailgun ~]# date
Tue Feb 24 13:28:50 UTC 2015
[root@nailgun ~]# for i in {1..5}; do ssh node-$i hostname && date; done
Warning: Permanently added 'node-1' (RSA) to the list of known hosts.
node-1.test.domain.local
Tue Feb 24 13:28:50 UTC 2015
Warning: Permanently added 'node-2' (RSA) to the list of known hosts.
node-2.test.domain.local
Tue Feb 24 13:28:50 UTC 2015
Warning: Permanently added 'node-3' (RSA) to the list of known hosts.
node-3.test.domain.local
Tue Feb 24 13:28:50 UTC 2015
Warning: Permanently added 'node-4' (RSA) to the list of known hosts.
node-4.test.domain.local
Tue Feb 24 13:28:50 UTC 2015
Warning: Permanently added 'node-5' (RSA) to the list of known hosts.
node-5.test.domain.local
Tue Feb 24 13:28:51 UTC 2015
[root@nailgun ~]#

Changed in fuel:
status: Confirmed → Incomplete
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :
Changed in fuel:
status: Incomplete → Confirmed
Revision history for this message
Stanislaw Bogatkin (sbogatkin) wrote :

Okay :)
Problem actually related to that fact that in swarm tests we have image-base provisioning enabled by default (and in usual deployment we haven't - it's why I can't reproduce this bug in usual way).
In usual Centos deployed by cobbler we set
timezone --utc Etc/UTC

and in target OS we have:
[root@node-1 ~]# cat /etc/sysconfig/clock
ZONE="Etc/UTC"

and in image for image-base provisioning we hadn't set this option:
[root@nailgun targetimages]# pwd
/var/www/nailgun/targetimages
[root@nailgun targetimages]# cat centos_65_x86_64.img.gz | gunzip > centos_65_x86_64.img
[root@nailgun targetimages]# ls
centos_65_x86_64-boot.img.gz centos_65_x86_64.img centos_65_x86_64.img.gz profile.yaml TRANS.TBL ubuntu_1204_amd64-boot.img.gz ubuntu_1204_amd64.img.gz
[root@nailgun targetimages]# mount -o loop centos_65_x86_64.img /mnt/
[root@nailgun targetimages]# cat /mnt/etc/sysconfig/clock
ZONE="America/New_York"
UTC=True

So. it should be changed in image.

Changed in fuel:
assignee: Stanislaw Bogatkin (sbogatkin) → Aleksandr Gordeev (a-gordeev)
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :
Changed in fuel:
importance: High → Critical
tags: added: image-based
tags: added: provision
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-web (master)

Fix proposed to branch: master
Review: https://review.openstack.org/165083

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-web (master)

Reviewed: https://review.openstack.org/165083
Committed: https://git.openstack.org/cgit/stackforge/fuel-web/commit/?id=f33fa29890a72d4d590ca8d82d041f694472f1e0
Submitter: Jenkins
Branch: master

commit f33fa29890a72d4d590ca8d82d041f694472f1e0
Author: Alexander Gordeev <email address hidden>
Date: Tue Mar 17 17:04:46 2015 +0300

    [IBP] Set UTC timezone by default

    Timezone on slave nodes was set to 'America/Los_Angeles' (PDT) by
    default, meanwhile UTC was set on master node.

    This patch will set UTC timezone for slave nodes, too.

    Change-Id: Ib2dc3883de9523ab29ea67f128b2bb43e00a8aff
    Closes-Bug: #1424701

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-web (stable/6.0)

Fix proposed to branch: stable/6.0
Review: https://review.openstack.org/165103

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-web (stable/6.0)

Reviewed: https://review.openstack.org/165103
Committed: https://git.openstack.org/cgit/stackforge/fuel-web/commit/?id=9d117dc771ff8117241d63ff8dc0ef21c177d103
Submitter: Jenkins
Branch: stable/6.0

commit 9d117dc771ff8117241d63ff8dc0ef21c177d103
Author: Alexander Gordeev <email address hidden>
Date: Tue Mar 17 17:04:46 2015 +0300

    [IBP] Set UTC timezone by default

    Timezone on slave nodes was set to 'America/Los_Angeles' (PDT) by
    default, meanwhile UTC was set on master node.

    This patch will set UTC timezone for slave nodes, too.

    Change-Id: Ib2dc3883de9523ab29ea67f128b2bb43e00a8aff
    Closes-Bug: #1424701
    (cherry picked from commit f33fa29890a72d4d590ca8d82d041f694472f1e0)

Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

for 6.1 verified
VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.1"
  api: "1.0"
  build_number: "206"
  build_id: "2015-03-18_22-54-44"
  nailgun_sha: "ff2e37abf5801757bd20b80a7d2d41df2e08ed63"
  python-fuelclient_sha: "14f2b3e0c9fd1580d85a83b7eea95fbe893665ac"
  astute_sha: "3e43895621370e65737b240e999f6c7391e68352"
  fuellib_sha: "de7ea04ef1a8b8399949d1ad28c6ac29d2b3e084"
  ostf_sha: "9435ec9f0aaf5bb8b9773347af871ab281b9ae78"
  fuelmain_sha: "fbfe367850a7e902d67d5ba05bfb9ed937a38dae"

Changed in fuel:
status: Fix Committed → Fix Released
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

set status for 6.0 fix committed according to

Reviewed: https://review.openstack.org/165103
Committed: https://git.openstack.org/cgit/stackforge/fuel-web/commit/?id=9d117dc771ff8117241d63ff8dc0ef21c177d103
Submitter: Jenkins
Branch: stable/6.0

commit 9d117dc771ff8117241d63ff8dc0ef21c177d103
Author: Alexander Gordeev <email address hidden>
Date: Tue Mar 17 17:04:46 2015 +0300

    [IBP] Set UTC timezone by default

    Timezone on slave nodes was set to 'America/Los_Angeles' (PDT) by
    default, meanwhile UTC was set on master node.

    This patch will set UTC timezone for slave nodes, too.

    Change-Id: Ib2dc3883de9523ab29ea67f128b2bb43e00a8aff
    Closes-Bug: #1424701
    (cherry picked from commit f33fa29890a72d4d590ca8d82d041f694472f1e0)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.