[Spark] Failed to scale cluster
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Sahara |
Fix Released
|
High
|
Andrey Pavlov |
Bug Description
Environment:
Devstack with Heat and Neutron.
How to reproduce:
1. Create three node group templates. For example,
{
"name": "slave-datanode",
"description": "Test template for worker node",
"flavor_id": "2",
"plugin_name": "spark",
"hadoop_
"node_
"floating_
}
{
"name": "slave",
"description": "Test template for worker node",
"flavor_id": "2",
"plugin_name": "spark",
"hadoop_
"node_
"floating_
}
{
"name": "datanode",
"description": "Test template for worker node",
"flavor_id": "2",
"plugin_name": "spark",
"hadoop_
"node_
"floating_
}
2. Create a cluster template. For example,
{
"name": "some-cluster-
"description": "Test cluster template",
"plugin_name": "spark",
"hadoop_
"cluster_
"HDFS": {
}
},
"node_groups": [
{
"name": "master-node",
},
{
"name": "worker-node-1",
},
{
"name": "worker-node-2",
},
{
"name": "worker-node-3",
}
],
"neutron_
}
3. Create a cluster. For example,
{
"name": "spark-cluster",
"plugin_name": "spark",
"hadoop_
"cluster_
"default_
"user_
"description": "Test cluster by Spark plugin"
}
4. Wait for "Active" status for cluster
5. Try to scale cluster. For example,
{
"resize_
{
"name": "worker-node-2",
"count": 0
},
{
"name": "worker-node-3",
"count": 0
}
],
"add_
{
"
"count": 1,
"name": "new-worker-node-2"
},
{
"
"count": 1,
"name": "new-worker-node-3"
}
]
}
Expected result:
Cluster can be successfully scaled.
Observed result:
Cluster hangs in "Decommissioning" status.
Changed in sahara: | |
status: | New → Confirmed |
importance: | Undecided → High |
milestone: | none → kilo-1 |
Changed in sahara: | |
milestone: | kilo-1 → kilo-2 |
Changed in sahara: | |
milestone: | kilo-2 → kilo-3 |
Changed in sahara: | |
assignee: | nobody → Andrey Pavlov (apavlov-n) |
Changed in sahara: | |
status: | Fix Committed → Fix Released |
Changed in sahara: | |
milestone: | kilo-3 → 2015.1.0 |
Fix proposed to branch: master /review. openstack. org/153993
Review: https:/