kolla-ansible

ValueError: Field value 21 is invalid

Bug #1755205 reported by bjolo on 2018-03-12

This bug affects 2 people

Affects		Status	Importance	Assigned to	Milestone
	kolla-ansible	Invalid	Undecided	Unassigned
	neutron	Invalid	Undecided	Unassigned

Bug Description

we just upgraded to Pike from ocata and a new error is now seen in the log files. We have not done any config changes, just upgraded the containers

We are running kolla-ansible

neutron-server.log

2018-03-12 16:13:09.298 53 DEBUG neutron_lib.callbacks.manager [req-8351b200-f441-425d-87a9-a29dbe01a729 - - - - -] Notify callbacks ['neutron.services.segments.plugin.NovaSegmentNotifier._notify_host_addition_to_aggregate-16251827'] for segment_host_mapping, after_create _notify_loop /var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lib/callbacks/manager.py:167
2018-03-12 16:13:09.335 53 DEBUG oslo_concurrency.lockutils [-] Lock "notifier-59bf1c54-b85b-4380-b08c-061c0cb242a2" acquired by "neutron.notifiers.batch_notifier.synced_send" :: waited 0.000s inner /var/lib/kolla/venv/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:270
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server [req-cf93a4c0-9462-41e5-9922-b9b55ef6d1e2 - - - - -] Exception during message handling: ValueError: Field value 21 is invalid
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 232, in inner
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server return func(*args, **kwargs)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/api/rpc/handlers/resources_rpc.py", line 143, in bulk_pull
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server **filter_kwargs)]
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 468, in get_objects
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server return [cls._load_object(context, db_obj) for db_obj in db_objs]
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 403, in _load_object
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server obj.from_db_object(db_obj)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 346, in from_db_object
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server setattr(self, field, fields[field])
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 72, in setter
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server field_value = field.coerce(self, name, value)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/fields.py", line 195, in coerce
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server return self._type.coerce(obj, attr, value)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/fields.py", line 317, in coerce
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server raise ValueError(msg)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server ValueError: Field value 21 is invalid
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server
2018-03-12 16:13:11.336 53 DEBUG oslo_concurrency.lockutils [-] Lock "notifier-59bf1c54-b85b-4380-b08c-061c0cb242a2" released by "neutron.notifiers.batch_notifier.synced_send" :: held 2.002s inner /var/lib/kolla/venv/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:282
2018-03-12 16:13:11.727 56 DEBUG neutron_lib.callbacks.manager [req-c10e276c-512a-43b3-a21d-03a3fe198c4d - - - - -] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223372036848016538'] for agent, after_update _notify_loop /var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lib/callbacks/manager.py:167
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server [req-a88c8346-db34-48d6-bb79-432b9261ba16 - - - - -] Exception during message handling: ValueError: Field value 21 is invalid
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 232, in inner
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server return func(*args, **kwargs)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/api/rpc/handlers/resources_rpc.py", line 143, in bulk_pull
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server **filter_kwargs)]
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 468, in get_objects
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server return [cls._load_object(context, db_obj) for db_obj in db_objs]
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 403, in _load_object
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server obj.from_db_object(db_obj)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 346, in from_db_object
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server setattr(self, field, fields[field])
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 72, in setter
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server field_value = field.coerce(self, name, value)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/fields.py", line 195, in coerce
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server return self._type.coerce(obj, attr, value)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/fields.py", line 317, in coerce
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server raise ValueError(msg)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server ValueError: Field value 21 is invalid
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server

Revision history for this message

bjolo (bjorn-lofdahl) wrote on 2018-03-15:

root cause found but needs to be fixed. Found that somehow a user managed to insert an incorrect security rule, which caused the stack trace. After deleting the faulty row, no more errors in the log files.

MariaDB [neutron]> select * from securitygrouprules where protocol=21;
+----------------------------------+--------------------------------------+--------------------------------------+-----------------+-----------+-----------+----------+----------------+----------------+------------------+------------------+
| project_id | id | security_group_id | remote_group_id | direction | ethertype | protocol | port_range_min | port_range_max | remote_ip_prefix | standard_attr_id |
+----------------------------------+--------------------------------------+--------------------------------------+-----------------+-----------+-----------+----------+----------------+----------------+------------------+------------------+
| 4b92bf106afb4f2cb311870e2aecb653 | 981c3860-fb5f-4ba6-abfb-56189cbcd2f9 | b173b005-79fe-4116-88de-e2db05a3a443 | NULL | egress | IPv4 | 21 | NULL | NULL | 0.0.0.0/0 | 1596441 |
+----------------------------------+--------------------------------------+--------------------------------------+-----------------+-----------+-----------+----------+----------------+----------------+------------------+------------------+

Revision history for this message

zhaobo (zhaobo6) wrote on 2018-03-19:

Neutron doesn't set the protocol as a Interger value, it be stored as varchar in db.

Changed in neutron:
status:	New → Invalid

Michal Nasiadka (mnasiadka) on 2023-03-28

Changed in kolla-ansible:
status:	New → Invalid

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.