Task[connectivity_tests/2] Stopping the deployment process!

Bug #1624481 reported by Alexey. Kalashnikov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Invalid
High
Fuel Sustaining

Bug Description

One of the swarm test failed:
https://product-ci.infra.mirantis.net/job/9.x.system_test.ubuntu.bonding_ha/61/testReport/(root)/bonding_conf_consistency/bonding_conf_consistency/

with message
http://paste.openstack.org/show/580193/
...
AssertionError: Task 'deploy' has incorrect status. ready != error

-----------------------
Test scenario:
1. Create an environment
2. Add 3 nodes with controller role
3. Add 1 node with compute role
4. Setup bonding for all interfaces (including admin interface
           bonding)
5. Run network verification
6. Update 'connectivity_tests' puppet manifest to cause the deployment process fail right after 'netconfig' task is finished
7. Start deployment and wait until it fails <<< failed here
8. Verify that interfaces are not lost from the configured bonds
9. Restore the initial version of 'connectivity_tests' manifest
10. Redeploy the cluster and run basic health checks
11. Run network verification

Expected Result:
deployment process failed after "netconfig" is finished

Actual Result
Task[connectivity_tests/2] Stopping the deployment process
-------------------------

cut from astutue.log
http://paste.openstack.org/show/580192/
...
2016-09-16 02:38:37 DEBUG [8367] Node[2]: Node 2: task connectivity_tests, task status running
2016-09-16 02:38:37 ERROR [8367] Node 2(connectivity_tests) status: error
2016-09-16 02:38:37 DEBUG [8367] Node 2 has failed to deploy. There is no more retries for puppet run.
2016-09-16 02:38:37 DEBUG [8367] {"nodes"=>[{"status"=>"error", "error_type"=>"deploy", "uid"=>"2", "role"=>"connectivity_tests"}]}
2016-09-16 02:38:37 DEBUG [8367] Task time summary: connectivity_tests with status failed on node 2 took 00:00:10
...
2016-09-16 02:38:43 DEBUG [8367] Cluster[]: Process node: Node[3]
2016-09-16 02:38:43 DEBUG [8367] Cluster[]: Process node: Node[2]
2016-09-16 02:38:43 DEBUG [8367] Cluster[]: Process node: Node[master]
2016-09-16 02:38:43 DEBUG [8367] Cluster[]: Process node: Node[4]
2016-09-16 02:38:43 DEBUG [8367] Cluster[]: Process node: Node[virtual_sync_node]
2016-09-16 02:38:43 INFO [8367] Cluster[]: All nodes are finished. Failed tasks: Task[connectivity_tests/2] Stopping the deployment process!

ifconfig -a from nodes:
http://paste.openstack.org/show/580196/

logs snapshot:
https://drive.google.com/open?id=0B0EB6QSDWt2vcld4WkgzNVFoYmM

Tags: area-python
Dmitry Klenov (dklenov)
Changed in fuel:
milestone: none → 9.1
assignee: nobody → Fuel Sustaining (fuel-sustaining-team)
importance: Undecided → High
status: New → Confirmed
tags: added: area-python
Revision history for this message
Dmitry Pyzhov (dpyzhov) wrote :

Looks like expected behaviour. You've broken the task and it fails. What do you expect from the developers?

Changed in fuel:
status: Confirmed → Incomplete
Changed in fuel:
assignee: Fuel Sustaining (fuel-sustaining-team) → Fuel QA Team (fuel-qa)
status: Incomplete → New
Revision history for this message
Nastya Urlapova (aurlapova) wrote :

@Dima, there is a message: Node 2 has failed to deploy. There is no more retries for puppet run.
Why you think that is QA issue?

Changed in fuel:
assignee: Fuel QA Team (fuel-qa) → Fuel Sustaining (fuel-sustaining-team)
Revision history for this message
Nastya Urlapova (aurlapova) wrote :

Moved to Invalid, we could not find a failed env.

description: updated
Changed in fuel:
status: New → Incomplete
milestone: 9.1 → 9.2
status: Incomplete → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.