Proper error message to user in case 4 byte unicode characters are used for entity names.

[Sheel Rana]

mysql database does not support 4 byte unicode due to its utf8 character set.

If any operation is executed with 4byte unicode name, it reports 500 error without any proper error message to user.
This will be confusing for user as no information is present about why this issue occurred.

Please refer below for details:

nova secgroup-create sheel 🌋
ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'oslo_db.exception.DBError'> (HTTP 500) (Request-ID: req-a4eef1d6-11fa-4188-b116-ffdf728e04f4)

Bug can be reproduced by simply using 4byte unicode characters in name of security group.

This is 100% reproducible.

[Augustina Ragwitz (auggy)]

This is a feature request. If you'd like to move forward with using 4-byte unicode characters on the backend, please submit a spec for doing so. If the issue is that the returned error is confusing and you'd like that improved, that is a valid bug and this issue can be reopened with that as the bug description.

[Augustina Ragwitz (auggy)]

Link to blueprint process: https://wiki.openstack.org/wiki/Blueprints

[Sheel Rana (ranasheel2000)]

Actually I have already created BP for same.
Please refer below link:

https://blueprints.launchpad.net/nova/+spec/handling-4-byte-unicode-nova

[Sheel Rana (ranasheel2000)]

BP implementation will require much time because of migration related changes.
Spec for same is already in discussion.
Please refer below:

https://review.openstack.org/#/c/280371/

So, I created this bug for better message to user in case 4 byte unicode is used in entity names as short term fix.

I will update the issue details and reopen it for short time fix.

Thanks!!

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/282862

[Sheel Rana (ranasheel2000)]

Here is the sample output after fix:

root@sheel-VirtualBox:/opt/stack/nova/nova/db/sqlalchemy# nova secgroup-create sheel4 🌋
ERROR (BadRequest): Invalid parameters- 4 byte unicode characters used in Name=sheel4 or Description=🌋. (HTTP 400) (Request-ID: req-503aaf79-b5bc-4984-97ea-9b77ae243c2e)

[Sheel Rana (ranasheel2000)]

As discussed with nova cores, I will check with schema validation for security groups to fix this issue...
working on same..

[OpenStack Infra (hudson-openstack)]

Change abandoned by Matt Riedemann (<email address hidden>) on branch: master
Review: https://review.openstack.org/282862

[Markus Zoeller (markus_z) (mzoeller)]

@Sheel: Are you still working on that?

[Sheel Rana (ranasheel2000)]

Dear Markus,

I am bit busy these days. So currently I am not looking into it.
In case anyone interested, please pick it. Else I will do it in next month or so.

[Sean Dague (sdague)]

There are no currently open reviews on this bug, changing
the status back to the previous state and unassigning. If
there are active reviews related to this bug, please include
links in comments.

[Sean Dague (sdague)]

Found open reviews for this bug in gerrit, setting to In Progress.

review: https://review.openstack.org/407514 in branch: master