Cannot sync time: Failed to wait peer on node
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
In Progress
|
High
|
Fuel QA Team | ||
Mitaka |
Fix Released
|
High
|
Dmitry Ilyin | ||
Newton |
Confirmed
|
High
|
Fuel QA Team | ||
Ocata |
Confirmed
|
High
|
Fuel QA Team |
Bug Description
Detailed bug description:
during time sync by devops the following exception is raised
2017-01-12 04:21:34 - ERROR decorators.py:126 -- Traceback (most recent call last):
File "/home/
result = func(*args, **kwargs)
File "/home/
self.
File "/home/
self.
File "/home/
new_time = sync_time(
File "/home/
return func(*args, **kwargs)
File "/home/
g_ntp.
File "/home/
ntp.wait_peer()
File "/home/
self.
File "/home/
raise TimeoutError(
TimeoutError: Failed to wait peer on node u'slave-01'
The issue was found by
https:/
https:/
this behavior was observed on srv88-bud.
Steps to reproduce:
1. deploy env with 3 controllers
2. find controller node with
root@node-1:~# ps axu | grep ntp
ntp 26223 0.0 0.0 27100 3612 ? Ss 15:45 0:00 /usr/sbin/ntpd -u ntp:ntp -p /var/run/ntpd.pid -4 -g -c /etc/ntp.conf
ntp 28364 0.0 0.1 27224 4444 ? Ss 15:46 0:00 ntpd -n -g -u 103:107
3. migrate all vips psc resources from node(vip_
4. stop/start ntpd
# crm resource stop p_ntp
# crm resource start p_ntp
5. execute
# ip netns exec vrouter ntpq -pn 127.0.0.1
Expected results:
> remote refid st t when poll reach delay offset jitter
> =======
> *10.109.8.1 81.2.254.224 3 u 7 8 377 0.193 -0.032 0.053
Actual result:
> remote refid st t when poll reach delay offset jitter
> =======
> 10.109.8.1 .INIT. 16 - - 8 0 0.000 0.000 0.000
So, it's a strange bug...This behavior is observed for only controller node with 2 ntpd processes.
The process
"/usr/sbin/ntpd -u ntp:ntp -p /var/run/ntpd.pid -4 -g -c /etc/ntp.conf" is managed by pacemaker and
process "ntpd -n -g -u 103:107" is initialized by upstart, as I understood.
Changed in fuel: | |
assignee: | nobody → Stanislaw Bogatkin (sbogatkin) |
Changed in fuel: | |
assignee: | Stanislaw Bogatkin (sbogatkin) → Oleksiy Molchanov (omolchanov) |
assignee: | Oleksiy Molchanov (omolchanov) → Stanislaw Bogatkin (sbogatkin) |
Changed in fuel: | |
assignee: | Stanislaw Bogatkin (sbogatkin) → Oleksiy Molchanov (omolchanov) |
Changed in fuel: | |
importance: | Undecided → High |
Changed in fuel: | |
status: | New → Confirmed |
Changed in fuel: | |
assignee: | Oleksiy Molchanov (omolchanov) → Dmitry Ilyin (idv1985) |
tags: | added: area-library |
summary: |
- [9.x swarm] Cannot sync time: Failed to wait peer on node + Cannot sync time: Failed to wait peer on node |
Our ntp package contain ntp upstart and systemV scripts, but original package doesn't contain upstart. This breaks our ntp-pacemaker deployment.
http:// packages. ubuntu. com/ru/ trusty/ amd64/ntp/ filelist
root@node-6:~# dpkg -S /etc/init.d/ntp
ntp: /etc/init.d/ntp
root@node-6:~# dpkg -S /etc/init/ntp.conf
ntp: /etc/init/ntp.conf
root@node-6:~# apt-cache policy ntp p5+dfsg- 3~u14.04+ mos1 p5+dfsg- 3~u14.04+ mos1 p5+dfsg- 3~u14.04+ mos1 0 mirror. fuel-infra. org/mos- repos/ubuntu/ snapshots/ 9.0-latest/ mos9.0- proposed/ main amd64 Packages mirror. fuel-infra. org/mos- repos/ubuntu/ 9.0/ mos9.0-updates/main amd64 Packages dpkg/status 2.6.p5+ dfsg-3ubuntu2. 14.04.10 0 archive. ubuntu. com/ubuntu/ trusty- security/ main amd64 Packages archive. ubuntu. com/ubuntu/ trusty-updates/main amd64 Packages
ntp:
Installed: 2:4.2.6.
Candidate: 2:4.2.6.
Version table:
*** 2:4.2.6.
1200 http://
1050 http://
100 /var/lib/
1:4.
500 http://
500 http://