rally jobs broken on unmaintantained/yoga and older branches

Bug #2069704 reported by Bence Romsics
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
neutron
Fix Released
High
Bernard Cafarelli

Bug Description

affected branches: unmaintantained/yoga and older
affected jobs: neutron-ovs-rally-task (voting), neutron-ovn-rally-task (non-voting)

typical error message:

2024-06-16 01:35:40.555933 | controller | ++ /opt/stack/rally-openstack/devstack/lib/rally:init_rally:124 : rally --config-file /etc/rally/rally.conf deployment create --name devstack --filename /tmp/tmp.5bKViViucY
2024-06-16 01:35:44.306252 | controller | Command failed, please check log for more info
2024-06-16 01:35:44.314415 | controller | 2024-06-16 01:35:44.306 82074 CRITICAL rally [-] Unhandled error: sqlalchemy.exc.InvalidRequestError: No transaction is begun.
2024-06-16 01:35:44.314470 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally Traceback (most recent call last):
2024-06-16 01:35:44.314524 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/bin/rally", line 8, in <module>
2024-06-16 01:35:44.314559 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally sys.exit(main())
2024-06-16 01:35:44.314629 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/rally/cli/main.py", line 40, in main
2024-06-16 01:35:44.314657 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally return cliutils.run(sys.argv, categories)
2024-06-16 01:35:44.314702 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/rally/cli/cliutils.py", line 669, in run
2024-06-16 01:35:44.314748 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally ret = fn(*fn_args, **fn_kwargs)
2024-06-16 01:35:44.314795 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/rally/plugins/__init__.py", line 59, in wrapper
2024-06-16 01:35:44.314841 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally return func(*args, **kwargs)
2024-06-16 01:35:44.314887 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/rally/cli/commands/deployment.py", line 109, in create
2024-06-16 01:35:44.314930 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally deployment = api.deployment.create(config=config, name=name)
2024-06-16 01:35:44.314995 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/rally/api.py", line 107, in create
2024-06-16 01:35:44.315021 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally return self._create(config, name).to_dict()
2024-06-16 01:35:44.315096 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/rally/api.py", line 89, in _create
2024-06-16 01:35:44.315140 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally deployment = objects.Deployment(name=name, config=config,
2024-06-16 01:35:44.315212 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/rally/common/objects/deploy.py", line 76, in __init__
2024-06-16 01:35:44.315256 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally self._env = env_mgr.EnvManager.create(
2024-06-16 01:35:44.315368 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/rally/plugins/__init__.py", line 59, in wrapper
2024-06-16 01:35:44.315413 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally return func(*args, **kwargs)
2024-06-16 01:35:44.315455 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/rally/env/env_mgr.py", line 374, in create
2024-06-16 01:35:44.315497 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally self = cls._validate_and_create_env(name, spec)
2024-06-16 01:35:44.315563 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/rally/env/env_mgr.py", line 276, in _validate_and_create_env
2024-06-16 01:35:44.315608 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally return cls(db.env_create(name, STATUS.INIT, description, extras,
2024-06-16 01:35:44.315684 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/rally/common/db/api.py", line 135, in wrapper
2024-06-16 01:35:44.315728 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally result = f(session, *args, **kwargs)
2024-06-16 01:35:44.315769 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__
2024-06-16 01:35:44.315811 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally next(self.gen)
2024-06-16 01:35:44.315875 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope
2024-06-16 01:35:44.315901 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally yield resource
2024-06-16 01:35:44.315977 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__
2024-06-16 01:35:44.316003 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally next(self.gen)
2024-06-16 01:35:44.316071 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session
2024-06-16 01:35:44.316124 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally self.session.rollback()
2024-06-16 01:35:44.316146 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
2024-06-16 01:35:44.316194 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally self.force_reraise()
2024-06-16 01:35:44.316233 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
2024-06-16 01:35:44.316280 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally raise self.value
2024-06-16 01:35:44.316319 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session
2024-06-16 01:35:44.316362 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally self._end_session_transaction(self.session)
2024-06-16 01:35:44.316403 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction
2024-06-16 01:35:44.316444 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally session.commit()
2024-06-16 01:35:44.316495 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1429, in commit
2024-06-16 01:35:44.316536 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally raise sa_exc.InvalidRequestError("No transaction is begun.")
2024-06-16 01:35:44.316590 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally sqlalchemy.exc.InvalidRequestError: No transaction is begun.
2024-06-16 01:35:44.316614 | controller | 2024-06-16 01:35:44.306 82074 ERROR rally ^[[00m
2024-06-16 01:35:44.686439 | controller | + /opt/stack/rally-openstack/devstack/lib/rally:init_rally:1 : exit_trap

example job failures:

https://zuul.opendev.org/t/openstack/build/f31271a9d9d94aeeb47250878d21538f
https://zuul.opendev.org/t/openstack/build/89bd8f7b92ad4bea8925143fc8451ee9
https://zuul.opendev.org/t/openstack/build/f6ae550750a24076b8e73f8dc707d75d

yatin (yatinkarel)
Changed in neutron:
status: New → Confirmed
importance: Low → High
Changed in neutron:
assignee: nobody → Bernard Cafarelli (bcafarel)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to neutron (unmaintained/yoga)

Fix proposed to branch: unmaintained/yoga
Review: https://review.opendev.org/c/openstack/neutron/+/922230

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to neutron (unmaintained/xena)

Fix proposed to branch: unmaintained/xena
Review: https://review.opendev.org/c/openstack/neutron/+/922231

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to neutron (unmaintained/wallaby)

Fix proposed to branch: unmaintained/wallaby
Review: https://review.opendev.org/c/openstack/neutron/+/922232

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to neutron (unmaintained/victoria)

Fix proposed to branch: unmaintained/victoria
Review: https://review.opendev.org/c/openstack/neutron/+/922233

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to neutron (unmaintained/xena)

Reviewed: https://review.opendev.org/c/openstack/neutron/+/922231
Committed: https://opendev.org/openstack/neutron/commit/c5f0c71254db6fcbfeaa3dc55152cf6b01997afb
Submitter: "Zuul (22348)"
Branch: unmaintained/xena

commit c5f0c71254db6fcbfeaa3dc55152cf6b01997afb
Author: Bernard Cafarelli <email address hidden>
Date: Tue Jun 18 17:30:06 2024 +0200

    [unmaintained] Drop rally jobs

    Rally jobs in unmaintained/yoga and older branches now fail with
    sqlalchemy errors. Given the status of these branches and goal of rally
    testing, let's drop these jobs in yoga and older branches

    Conflicts:
            zuul.d/project.yaml
            zuul.d/rally.yaml

    Closes-Bug: #2069704
    Change-Id: If4b446dfe8a063e03676b8d90bbbb529f4c39d19
    (cherry picked from commit f16dccf32bcb4d8098cbade03f675129c9137dec)

tags: added: in-unmaintained-xena
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to neutron (unmaintained/yoga)

Reviewed: https://review.opendev.org/c/openstack/neutron/+/922230
Committed: https://opendev.org/openstack/neutron/commit/f16dccf32bcb4d8098cbade03f675129c9137dec
Submitter: "Zuul (22348)"
Branch: unmaintained/yoga

commit f16dccf32bcb4d8098cbade03f675129c9137dec
Author: Bernard Cafarelli <email address hidden>
Date: Tue Jun 18 17:30:06 2024 +0200

    [unmaintained] Drop rally jobs

    Rally jobs in unmaintained/yoga and older branches now fail with
    sqlalchemy errors. Given the status of these branches and goal of rally
    testing, let's drop these jobs in yoga and older branches

    Closes-Bug: #2069704
    Change-Id: If4b446dfe8a063e03676b8d90bbbb529f4c39d19

tags: added: in-unmaintained-yoga
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to neutron (unmaintained/wallaby)

Reviewed: https://review.opendev.org/c/openstack/neutron/+/922232
Committed: https://opendev.org/openstack/neutron/commit/091b920305031ecb6adbb23613c7184d5c581133
Submitter: "Zuul (22348)"
Branch: unmaintained/wallaby

commit 091b920305031ecb6adbb23613c7184d5c581133
Author: Bernard Cafarelli <email address hidden>
Date: Tue Jun 18 17:30:06 2024 +0200

    [unmaintained] Drop rally jobs

    Rally jobs in unmaintained/yoga and older branches now fail with
    sqlalchemy errors. Given the status of these branches and goal of rally
    testing, let's drop these jobs in yoga and older branches

    Conflicts:
            zuul.d/project.yaml
            zuul.d/rally.yaml

    Closes-Bug: #2069704
    Change-Id: If4b446dfe8a063e03676b8d90bbbb529f4c39d19
    (cherry picked from commit f16dccf32bcb4d8098cbade03f675129c9137dec)

tags: added: in-unmaintained-wallaby
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to neutron (unmaintained/victoria)

Reviewed: https://review.opendev.org/c/openstack/neutron/+/922233
Committed: https://opendev.org/openstack/neutron/commit/5bfeccc055786667532b2954aed4de10b1aa7f2f
Submitter: "Zuul (22348)"
Branch: unmaintained/victoria

commit 5bfeccc055786667532b2954aed4de10b1aa7f2f
Author: Bernard Cafarelli <email address hidden>
Date: Tue Jun 18 17:30:06 2024 +0200

    [unmaintained] Drop rally jobs

    Rally jobs in unmaintained/yoga and older branches now fail with
    sqlalchemy errors. Given the status of these branches and goal of rally
    testing, let's drop these jobs in yoga and older branches

    Conflicts:
            zuul.d/project.yaml
            zuul.d/rally.yaml

    Closes-Bug: #2069704
    Change-Id: If4b446dfe8a063e03676b8d90bbbb529f4c39d19
    (cherry picked from commit f16dccf32bcb4d8098cbade03f675129c9137dec)

tags: added: in-unmaintained-victoria
Revision history for this message
Bernard Cafarelli (bcafarel) wrote :

Merged from yoga to victoria, should be good!

Changed in neutron:
status: Confirmed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.