MCollective call failed in agent 'puppetsync'
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
Confirmed
|
High
|
Vladimir Sharshov |
Bug Description
{"build_id": "2014-07-
MOS: 5.0.1
stack: Ubuntu 12.04
mode: HA (3 controllers, 3 ceph, 3 mongo, 2 computes), ceilometer is turned on via UI
Deployment fails with:
2014-08-11T16:00:02 debug: [575] 0a93f725-
2014-08-11T16:00:02 debug: [575] 0a93f725-
2014-08-11T16:00:02 debug: [575] 0a93f725-
2014-08-11T16:00:02 debug: [575] 0a93f725-
2014-08-11T16:00:02 debug: [575] 0a93f725-
2014-08-11T16:00:02 debug: [575] 0a93f725-
2014-08-11T16:00:02 debug: [575] 0a93f725-
2014-08-11T16:00:02 debug: [575] 0a93f725-
2014-08-11T16:00:02 debug: [575] 0a93f725-
2014-08-11T16:00:02 debug: [575] 0a93f725-
2014-08-11T16:00:02 debug: [575] 0a93f725-
2014-08-11T16:00:02 err: [575] MCollective call failed in agent 'puppetsync', method 'rsync', failed nodes:
ID: 41 - Reason: Fail to upload folder using command rsync -c -r --delete rsync:/
rsync error: error in rsync protocol data stream (code 12) at io.c(764) [Receiver=3.0.9]
2014-08-11T16:00:02 warning: [575] Rsync problem. Try to repeat: 1 attempt
2014-08-11T16:00:22 debug: [575] 0a93f725-
2014-08-11T16:00:22 debug: [575] 0a93f725-
2014-08-11T16:00:22 debug: [575] 0a93f725-
2014-08-11T16:00:22 debug: [575] 0a93f725-
2014-08-11T16:00:22 debug: [575] 0a93f725-
2014-08-11T16:00:22 debug: [575] 0a93f725-
2014-08-11T16:00:22 debug: [575] 0a93f725-
2014-08-11T16:00:22 debug: [575] 0a93f725-
2014-08-11T16:00:22 debug: [575] 0a93f725-
2014-08-11T16:00:22 debug: [575] 0a93f725-
2014-08-11T16:00:22 debug: [575] 0a93f725-
2014-08-11T16:00:22 err: [575] MCollective call failed in agent 'puppetsync', method 'rsync', failed nodes:
ID: 42 - Reason: Fail to upload folder using command rsync -c -r --delete rsync:/
rsync error: error in rsync protocol data stream (code 12) at io.c(764) [Receiver=3.0.9]
2014-08-11T16:00:22 warning: [575] Rsync problem. Try to repeat: 2 attempt
2014-08-11T16:00:43 debug: [575] 0a93f725-
2014-08-11T16:00:43 debug: [575] 0a93f725-
2014-08-11T16:00:43 debug: [575] 0a93f725-
2014-08-11T16:00:43 debug: [575] 0a93f725-
2014-08-11T16:00:43 debug: [575] 0a93f725-
2014-08-11T16:00:43 debug: [575] 0a93f725-
2014-08-11T16:00:43 debug: [575] 0a93f725-
2014-08-11T16:00:43 debug: [575] 0a93f725-
2014-08-11T16:00:43 debug: [575] 0a93f725-
2014-08-11T16:00:43 debug: [575] 0a93f725-
2014-08-11T16:00:43 debug: [575] 0a93f725-
2014-08-11T16:00:43 err: [575] MCollective call failed in agent 'puppetsync', method 'rsync', failed nodes:
ID: 42 - Reason: Fail to upload folder using command rsync -c -r --delete rsync:/
rsync error: error in rsync protocol data stream (code 12) at io.c(764) [Receiver=3.0.9]
2014-08-11T16:00:43 warning: [575] Rsync problem. Try to repeat: 3 attempt
2014-08-11T16:01:03 debug: [575] 0a93f725-
2014-08-11T16:01:03 debug: [575] 0a93f725-
2014-08-11T16:01:03 debug: [575] 0a93f725-
2014-08-11T16:01:03 debug: [575] 0a93f725-
2014-08-11T16:01:03 debug: [575] 0a93f725-
2014-08-11T16:01:03 debug: [575] 0a93f725-
2014-08-11T16:01:03 debug: [575] 0a93f725-
2014-08-11T16:01:03 debug: [575] 0a93f725-
2014-08-11T16:01:03 debug: [575] 0a93f725-
2014-08-11T16:01:03 debug: [575] 0a93f725-
2014-08-11T16:01:03 debug: [575] 0a93f725-
2014-08-11T16:01:03 err: [575] MCollective call failed in agent 'puppetsync', method 'rsync', failed nodes:
ID: 42 - Reason: Fail to upload folder using command rsync -c -r --delete rsync:/
rsync error: error in rsync protocol data stream (code 12) at io.c(764) [Receiver=3.0.9]
2014-08-11T16:01:03 warning: [575] Rsync problem. Try to repeat: 4 attempt
2014-08-11T16:01:24 debug: [575] 0a93f725-
2014-08-11T16:01:24 debug: [575] 0a93f725-
2014-08-11T16:01:24 debug: [575] 0a93f725-
2014-08-11T16:01:24 debug: [575] 0a93f725-
2014-08-11T16:01:24 debug: [575] 0a93f725-
2014-08-11T16:01:24 debug: [575] 0a93f725-
2014-08-11T16:01:24 debug: [575] 0a93f725-
2014-08-11T16:01:24 debug: [575] 0a93f725-
2014-08-11T16:01:24 debug: [575] 0a93f725-
2014-08-11T16:01:24 debug: [575] 0a93f725-
2014-08-11T16:01:24 debug: [575] 0a93f725-
2014-08-11T16:01:24 err: [575] MCollective call failed in agent 'puppetsync', method 'rsync', failed nodes:
ID: 42 - Reason: Fail to upload folder using command rsync -c -r --delete rsync:/
rsync error: error in rsync protocol data stream (code 12) at io.c(764) [Receiver=3.0.9]
2014-08-11T16:01:24 warning: [575] Rsync problem. Try to repeat: 5 attempt
2014-08-11T16:01:44 debug: [575] 0a93f725-
2014-08-11T16:01:44 debug: [575] 0a93f725-
2014-08-11T16:01:44 debug: [575] 0a93f725-
2014-08-11T16:01:44 debug: [575] 0a93f725-
2014-08-11T16:01:44 debug: [575] 0a93f725-
2014-08-11T16:01:44 debug: [575] 0a93f725-
2014-08-11T16:01:44 debug: [575] 0a93f725-
2014-08-11T16:01:44 debug: [575] 0a93f725-
2014-08-11T16:01:44 debug: [575] 0a93f725-
2014-08-11T16:01:44 debug: [575] 0a93f725-
2014-08-11T16:01:44 debug: [575] 0a93f725-
2014-08-11T16:01:44 err: [575] MCollective call failed in agent 'puppetsync', method 'rsync', failed nodes:
ID: 42 - Reason: Fail to upload folder using command rsync -c -r --delete rsync:/
rsync error: error in rsync protocol data stream (code 12) at io.c(764) [Receiver=3.0.9]
2014-08-11T16:01:44 warning: [575] Rsync problem. Try to repeat: 6 attempt
2014-08-11T16:02:05 debug: [575] 0a93f725-
2014-08-11T16:02:05 debug: [575] 0a93f725-
2014-08-11T16:02:05 debug: [575] 0a93f725-
2014-08-11T16:02:05 debug: [575] 0a93f725-
2014-08-11T16:02:05 debug: [575] 0a93f725-
2014-08-11T16:02:05 debug: [575] 0a93f725-
2014-08-11T16:02:05 debug: [575] 0a93f725-
2014-08-11T16:02:05 debug: [575] 0a93f725-
2014-08-11T16:02:05 debug: [575] 0a93f725-
2014-08-11T16:02:05 debug: [575] 0a93f725-
2014-08-11T16:02:05 debug: [575] 0a93f725-
2014-08-11T16:02:05 err: [575] MCollective call failed in agent 'puppetsync', method 'rsync', failed nodes:
ID: 38 - Reason: Fail to upload folder using command rsync -c -r --delete rsync:/
rsync error: error in rsync protocol data stream (code 12) at io.c(764) [Receiver=3.0.9]
2014-08-11T16:02:05 warning: [575] Rsync problem. Try to repeat: 7 attempt
2014-08-11T16:02:26 debug: [575] 0a93f725-
2014-08-11T16:02:26 debug: [575] 0a93f725-
2014-08-11T16:02:26 debug: [575] 0a93f725-
2014-08-11T16:02:26 debug: [575] 0a93f725-
2014-08-11T16:02:26 debug: [575] 0a93f725-
2014-08-11T16:02:26 debug: [575] 0a93f725-
2014-08-11T16:02:26 debug: [575] 0a93f725-
2014-08-11T16:02:26 debug: [575] 0a93f725-
2014-08-11T16:02:26 debug: [575] 0a93f725-
2014-08-11T16:02:26 debug: [575] 0a93f725-
2014-08-11T16:02:26 debug: [575] 0a93f725-
2014-08-11T16:02:26 err: [575] MCollective call failed in agent 'puppetsync', method 'rsync', failed nodes:
ID: 42 - Reason: Fail to upload folder using command rsync -c -r --delete rsync:/
rsync error: error in rsync protocol data stream (code 12) at io.c(764) [Receiver=3.0.9]
2014-08-11T16:02:26 warning: [575] Rsync problem. Try to repeat: 8 attempt
2014-08-11T16:02:46 debug: [575] 0a93f725-
2014-08-11T16:02:46 debug: [575] 0a93f725-
2014-08-11T16:02:46 debug: [575] 0a93f725-
2014-08-11T16:02:46 debug: [575] 0a93f725-
2014-08-11T16:02:46 debug: [575] 0a93f725-
2014-08-11T16:02:46 debug: [575] 0a93f725-
2014-08-11T16:02:46 debug: [575] 0a93f725-
2014-08-11T16:02:46 debug: [575] 0a93f725-
2014-08-11T16:02:46 debug: [575] 0a93f725-
2014-08-11T16:02:46 debug: [575] 0a93f725-
2014-08-11T16:02:46 debug: [575] 0a93f725-
2014-08-11T16:02:46 err: [575] MCollective call failed in agent 'puppetsync', method 'rsync', failed nodes:
ID: 31 - Reason: Fail to upload folder using command rsync -c -r --delete rsync:/
rsync error: error in rsync protocol data stream (code 12) at io.c(764) [Receiver=3.0.9]
2014-08-11T16:02:46 warning: [575] Rsync problem. Try to repeat: 9 attempt
2014-08-11T16:03:07 debug: [575] 0a93f725-
2014-08-11T16:03:07 debug: [575] 0a93f725-
2014-08-11T16:03:07 debug: [575] 0a93f725-
2014-08-11T16:03:07 debug: [575] 0a93f725-
2014-08-11T16:03:07 debug: [575] 0a93f725-
2014-08-11T16:03:07 debug: [575] 0a93f725-
2014-08-11T16:03:07 debug: [575] 0a93f725-
2014-08-11T16:03:07 debug: [575] 0a93f725-
2014-08-11T16:03:07 debug: [575] 0a93f725-
2014-08-11T16:03:07 debug: [575] 0a93f725-
2014-08-11T16:03:07 debug: [575] 0a93f725-
2014-08-11T16:03:07 err: [575] MCollective call failed in agent 'puppetsync', method 'rsync', failed nodes:
ID: 42 - Reason: Fail to upload folder using command rsync -c -r --delete rsync:/
rsync error: error in rsync protocol data stream (code 12) at io.c(764) [Receiver=3.0.9]
2014-08-11T16:03:07 err: [575] Unexpected error 0a93f725-
ID: 42 - Reason: Fail to upload folder using command rsync -c -r --delete rsync:/
rsync error: error in rsync protocol data stream (code 12) at io.c(764) [Receiver=3.0.9]
traceback /usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
/usr/lib64/
2014-08-11T16:03:07 err: [575] Error running RPC method deploy: 0a93f725-
ID: 42 - Reason: Fail to upload folder using command rsync -c -r --delete rsync:/
rsync error: error in rsync protocol data stream (code 12) at io.c(764) [Receiver=3.0.9]
, trace: ["/usr/
2014-08-11T16:03:07 info: [575] Casting message to Nailgun: {"method"
As I can see failed node change from repeat to repeat
Changed in fuel: | |
milestone: | none → 5.1 |
assignee: | nobody → Fuel Library Team (fuel-library) |
Changed in fuel: | |
milestone: | 5.1 → 5.0.2 |
description: | updated |
Changed in fuel: | |
assignee: | Fuel Library Team (fuel-library) → Vladimir Sharshov (vsharshov) |
Changed in fuel: | |
status: | New → Confirmed |
importance: | Undecided → High |
All nodes reply to ping from fuel master
# fuel node -----|- ------- ------- ---|--- ------| ------- -----|- ------- ------- ----|-- ------- ---|--- ------- -----|- ------
id | status | name | cluster | ip | mac | roles | pending_roles | online
---|---
39 | error | Untitled (c3:e0) | 7 | 10.20.0.20 | 38:ea:a7:35:c3:e0 | mongo | | True
33 | error | Untitled (c2:d4) | 7 | 10.20.0.12 | 38:ea:a7:35:c2:d4 | ceph-osd | | True
31 | error | Untitled (c3:78) | 7 | 10.20.0.10 | 38:ea:a7:35:c3:78 | ceph-osd | | True
34 | error | Untitled (c0:80) | 7 | 10.20.0.13 | 38:ea:a7:35:c0:80 | controller | | True
40 | error | Untitled (c2:4c) | 7 | 10.20.0.15 | 38:ea:a7:35:c2:4c | compute | | True
32 | error | Untitled (51:60) | 7 | 10.20.0.11 | 38:ea:a7:36:51:60 | ceph-osd | | True
38 | error | Untitled (a0:84) | 7 | 10.20.0.19 | 38:ea:a7:90:a0:84 | mongo | | True
42 | error | Untitled (bf:d0) | 7 | 10.20.0.17 | 38:ea:a7:35:bf:d0 | controller | | True
41 | error | Untitled (e9:c0) | 7 | 10.20.0.16 | 38:ea:a7:35:e9:c0 | compute | | True
36 | error | Untitled (c0:a8) | 7 | 10.20.0.14 | 38:ea:a7:35:c0:a8 | controller | | True
35 | error | Untitled (c2:fc) | 7 | 10.20.0.18 | 38:ea:a7:35:c2:fc | mongo | | True