Remove using hiera('nodes') from osnailyfacter module

Bug #1531128 reported by Sergey Vasilenko
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
Medium
Artem Roma
8.0.x
Won't Fix
Medium
Sergey Vasilenko
Mitaka
Won't Fix
Medium
Artem Roma

Bug Description

Using hiera('nodes') is deprecated.
We should stop use it, because this approach not fully compatible with flexible networking (network roles).

Bugfix should contains two serial patches:
1. Patch to fuel library, that removes all using of hiera('nodes')
2. Patch to Nailgun, that stop generates of nodes array

Changed in fuel:
assignee: nobody → Sergey Vasilenko (xenolog)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-library (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/263876

Dmitry Pyzhov (dpyzhov)
tags: removed: area-python
Dmitry Pyzhov (dpyzhov)
no longer affects: fuel/mitaka
tags: added: team-network tech-debt
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/263876
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=d89b25921c2cd982dca92a55a46b98ed50a060a2
Submitter: Jenkins
Branch: master

commit d89b25921c2cd982dca92a55a46b98ed50a060a2
Author: Sergey Vasilenko <email address hidden>
Date: Tue Jan 5 17:56:18 2016 +0300

    No more use nodes list.

    Nodes list is deprecated, beause incompatible with network-roles model.
    Network metadata should be used instead.

    This patchset implements:
    * remove nodes list from fixtures
    * remove unused function filter_nodes
    * remove some unused code, related to nodes list
    * new parser function get_node_key_name() for generating immutable node key name
    * fix parser function roles_include() for using network_metadata
    * use roles_include() if need instead directly lookup into network_metadata
    * fix some manifests for use network_matadata/nodes

    Change-Id: I2e6b1cd5cb75263efc995aa9f62bd3073abed1b8
    Related-bug: #1531128
    Related-bug: #1538220

Changed in fuel:
assignee: Sergey Vasilenko (xenolog) → Aleksey Kasatkin (alekseyk-ru)
Changed in fuel:
status: In Progress → Confirmed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-web (master)

Fix proposed to branch: master
Review: https://review.openstack.org/301573

Changed in fuel:
status: Confirmed → In Progress
Changed in fuel:
status: In Progress → Triaged
assignee: Aleksey Kasatkin (alekseyk-ru) → Fuel Python Team (fuel-python)
tags: added: area-python
Artem Roma (aroma-x)
Changed in fuel:
assignee: Fuel Python Team (fuel-python) → Artem Roma (aroma-x)
Changed in fuel:
milestone: 9.0 → 10.0
Revision history for this message
Dmitry Pyzhov (dpyzhov) wrote :

Technical debt, doesn't affect real users. Removing from Mitaka release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.openstack.org/308931

Changed in fuel:
status: Triaged → In Progress
Revision history for this message
Artem Roma (aroma-x) wrote :

AFAIC, 'nodes' data is skipped by the manifests (after according change to the library) and deployment tasks utilizing the info has type skipped [1] for releases >= 9.0 (thus is not processed by the Nailgun). All that implies that serialization of the attribute has no real impact on production environment.

However it is hard to introduce the change to Nailgun. Mainly because of this bug [2]; as separate fixture for tests for serializers of versions >= 9.0 must be used and there is no mechanism yet to process such separate fixtures by the testing infrastructure (for more details, please, see description for mentioned related bug).

With that being said the importance of the bug, IMO, should be lowered to medium with all efforts to focus on the related bug.

[1]: https://github.com/openstack/fuel-library/blob/master/deployment/puppet/osnailyfacter/modular/astute/tasks.yaml#L36-L40
[2]: https://bugs.launchpad.net/fuel/+bug/1517874

Changed in fuel:
importance: High → Medium
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-web (master)

Change abandoned by Aleksey Kasatkin (<email address hidden>) on branch: master
Review: https://review.openstack.org/301573
Reason: It was a POC. Fix is introduced in https://review.openstack.org/308931

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/310200

Changed in fuel:
assignee: Artem Roma (aroma-x) → Aleksandr Didenko (adidenko)
Changed in fuel:
assignee: Aleksandr Didenko (adidenko) → Artem Roma (aroma-x)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/310200
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=8be916680a076d825b1941c139c8911c56e746fa
Submitter: Jenkins
Branch: master

commit 8be916680a076d825b1941c139c8911c56e746fa
Author: Aleksandr Didenko <email address hidden>
Date: Tue Apr 26 15:22:38 2016 +0200

    Fix deprecated nodes list in yaql expressions

    'nodes' list is deprecated and replaced with
    'network_metadata/nodes' hash. Update yaql_exp accordingly.

    Change-Id: I795f944ca3b1fc49fae07ddc36c2eabcfcc968ed
    Partial-bug: #1531128

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-web (master)

Reviewed: https://review.openstack.org/308931
Committed: https://git.openstack.org/cgit/openstack/fuel-web/commit/?id=3a8b82887b8a507a122382428bee7b6ca938908d
Submitter: Jenkins
Branch: master

commit 3a8b82887b8a507a122382428bee7b6ca938908d
Author: Artem Roma <email address hidden>
Date: Thu Apr 28 15:40:24 2016 +0300

    Remove 'nodes' from deployment 9.0 serializer output

    Now serialized deployment info for environments >= 9.0 does not contain
    'nodes' field; it is removed from the output of the serializer.

    Unit and integration tests are updated. Deployment tasks fixture
    changed: 'nodes' references in yaql expressions changed to
    'network_metadata.nodes'

    Change-Id: Ibdb2cf85732c0293314298e6a342b071ece18cc3
    Closes-Bug: #1531128

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/316110

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/316110
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=aa3310b5d537bf186ffdbac5c7fd836cb6cae378
Submitter: Jenkins
Branch: master

commit aa3310b5d537bf186ffdbac5c7fd836cb6cae378
Author: Aleksandr Didenko <email address hidden>
Date: Fri May 13 15:23:08 2016 +0200

    Use proper nodes list source in enable_quorum task

    We no longer use 'nodes' list in hiera (astute.yaml), nodes info
    if in hash inside of 'network_metadata' hash. This patch updates
    enable_quorum.rb script accordingly.

    Change-Id: Iaf78a02a8c1d617e00010a7fd5bb94183607927a
    Partial-bug: #1531128

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-web (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/317429

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-web (master)

Reviewed: https://review.openstack.org/317429
Committed: https://git.openstack.org/cgit/openstack/fuel-web/commit/?id=80d7188700a699f0c3da763f5103e793b3c1d9c0
Submitter: Jenkins
Branch: master

commit 80d7188700a699f0c3da763f5103e793b3c1d9c0
Author: Artem Roma <email address hidden>
Date: Tue May 17 15:21:25 2016 +0300

    Remove 'nodes' key from serializer for 10.0

    'nodes' data is deprecated so must be removed from 10.0 version
    serializer output. The change was moved to separate serializer class in
    order to maintain compatibility with previously deployed 9.0 clusters
    after upgrade to 10.0.

    Change-Id: I8fef591908cd8b1e4ace5502bb1e80cb37786c6e
    Related-Bug: #1531128

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.