Errors creating users and projects

[Eduardo Pérez]

After a fresh install of OpenStack Stein using Juju Charms I'm getting errors and items not appearing when creating new users and projects. Here are several tests I made:

When creating ONLY a new user in a domain different than admin_domain, the user creates successfully but is not shown in the user list on the GUI even after a refresh/logout. Using the CLI shows that it was created successfully.

When creating ONLY a project in a domain different than admin_domain, the project creates successfully but is not shown in the user list on the GUI even after a refresh/logout. Using the CLI shows that it was created successfully.

When creating a user in a domain different than admin_domain, the project list in the form is empty.

When creating a user AND a project in any domain (using the "+" icon in the user creation form), after creating the project the GIU hangs on a "Working..." spinning wheel and the following error appears on the web console:

Uncaught SyntaxError: Unexpected token < in JSON at position 53
    at JSON.parse (<anonymous>)
    at Function.jQuery.parseJSON (439e79e74c16.js:567)
    at Function.jQuery.parseJSON (439e79e74c16.js:720)
    at processServerSuccess (c1b8ea0c3a19.js:80)
    at Object.success (c1b8ea0c3a19.js:84)
    at fire (439e79e74c16.js:210)
    at Object.fireWith [as resolveWith] (439e79e74c16.js:216)
    at done (439e79e74c16.js:626)
    at XMLHttpRequest.callback (439e79e74c16.js:653)

After a refresh, the project is created but not the user.

When creating a new user and a project separately in admin_domain everything works OK. After that I can see both and assign the project to the user.

In all the pages I load from Horizon I get the following warning on the web console:

439e79e74c16.js:700 JQMIGRATE: $(html) HTML strings must start with '<' character
migrateWarn @ 439e79e74c16.js:700
jQuery.fn.init @ 439e79e74c16.js:714
jQuery @ 439e79e74c16.js:15
success @ c1b8ea0c3a19.js:204
fire @ 439e79e74c16.js:210
fireWith @ 439e79e74c16.js:216
done @ 439e79e74c16.js:626
callback @ 439e79e74c16.js:653
439e79e74c16.js:700 console.trace
migrateWarn @ 439e79e74c16.js:700
jQuery.fn.init @ 439e79e74c16.js:714
jQuery @ 439e79e74c16.js:15
success @ c1b8ea0c3a19.js:204
fire @ 439e79e74c16.js:210
fireWith @ 439e79e74c16.js:216
done @ 439e79e74c16.js:626
callback @ 439e79e74c16.js:653

==========================================================================

[Impact]

New users and projects created in domain other than admin_domain are not
displayed in dashboard.
Creation of project from User creation form hangs and never returns

This patch fixes both the issues mentioned above

[Test Case]

Tests involved 3 cases
- Creation of Project in different domain context
- Creation of User in different domain context
- Creation of Project in Create User form

1. Reproducing the issue

1a. Login to horizon as admin user
1b. Go to page Identity->Domains and select "SetDomainContext" button for domain other than default or admin

1c. Go to page Identity->Projects
1d. Click on Create Project, enter new project details and click on Finish
1e. The page gets refreshed but the new project is not displayed

1f. Go to page Identity->Users
1g. Click on Create User, enter new user details and click on Create User button in the form
1h. The page gets refreshed but the new user is not displayed

1i. Go to page Identity->Users
1j. Click on Create User and enter new user details
1k. Click on + symbol under Primary project in the form to create New project. Spinning wheel rotates forever.

2. Install the package with fixed code

3. Confirm bug have been fixed

3a. Repeat steps 1a-1d. New project should be displayed in the table
3b. Repeat steps 1f-1h. New user should be displayed in the table
3c. Repeat steps 1i-1k, Project creation form should be opened
3d. Add new project details and click on Create Project button in the form. Project should be displayed in User creation form.
3e. Click on Create User button in Create user form
3f. Users page should be refreshed and new user will be displayed
3g. Go to Identity->Projects and new project created during user creation should be displayed

[Regression Potential]

Upstream CI passed for all the releases including the backported versions.
Installation of new package will restart apache service and hence there will be downtime of horizon service for few milliseconds.

[Eduardo Pérez (eperezf)]

Error

Uncaught SyntaxError: Unexpected token < in JSON at position 53
    at JSON.parse (<anonymous>)
    at Function.jQuery.parseJSON (439e79e74c16.js:567)
    at Function.jQuery.parseJSON (439e79e74c16.js:720)
    at processServerSuccess (c1b8ea0c3a19.js:80)
    at Object.success (c1b8ea0c3a19.js:84)
    at fire (439e79e74c16.js:210)
    at Object.fireWith [as resolveWith] (439e79e74c16.js:216)
    at done (439e79e74c16.js:626)
    at XMLHttpRequest.callback (439e79e74c16.js:653)

Also happens when requesting a floating IP via the associate floating IP option on the instance menu. The Floating IP gets created but never associated. After a refresh I can see the IP in the list and associate it correctly.

[Eduardo Pérez (eperezf)]

Any news on this bug? It still affects the latest Train release.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/697962

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/698398

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/697962
Committed: https://git.openstack.org/cgit/openstack/horizon/commit/?id=9aca7a94e28589484e312770cc1ee2b8243211bb
Submitter: Zuul
Branch: master

commit 9aca7a94e28589484e312770cc1ee2b8243211bb
Author: Hemanth Nakkina <email address hidden>
Date: Mon Dec 9 14:59:59 2019 +0530

    Fix users/projects list when domain context is changed

    In case of Keystone Multidomain setup, the project and users list
    is empty when the domain context is changed. Horizon uses domain
    scoped token for keystone api calls to get list of projects and users.
    And domain scoped token cannot get information about projects and users
    in other domains, the list is empty.

    This patch modifies the use of domain scoped token only when domain
    context is not modified.

    The bug have 3 parts
    1. Users are not listed on GUI in different domain
    2. Projects are not listed on GUI in different domain
    3. Gui hangs during creation of user/project using + option
    This patch handles case 1 and 2.

    Change-Id: Ibafe3e2eb3ee1ee5c9eb5d2a276a0edfa3e7c607
    Partial-Bug: #1826114
    Closes-Bug: #1830782

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/train
Review: https://review.opendev.org/698866

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/698867

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/698398
Committed: https://git.openstack.org/cgit/openstack/horizon/commit/?id=8fb86b2adbdf4fae63faabc8937728c43c1777d5
Submitter: Zuul
Branch: master

commit 8fb86b2adbdf4fae63faabc8937728c43c1777d5
Author: Hemanth Nakkina <email address hidden>
Date: Wed Dec 11 10:09:22 2019 +0530

    GUI hangs on creation of project in User creation form

    On creation of project in user creation form, the response is sent
    as html and the javascript try to parse the output as json and fails.

    The project creation response should be sent as text/plain so that
    javascript can parse the string as json.

    The bug have 3 parts
    1. Users are not listed on GUI in different domain
    2. Projects are not listed on GUI in different domain
    3. Gui hangs during creation of user/project using + option
    Case 1 & 2 are fixed at https://review.opendev.org/#/c/697962/
    This patch fixes case 3.

    Change-Id: I4936a158ad99cf9d7514e79c06ed2315ce11218b
    Closes-Bug: #1826114

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/train
Review: https://review.opendev.org/699324

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/699325

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/698866
Committed: https://git.openstack.org/cgit/openstack/horizon/commit/?id=02f4d8ab762cd8587873e832bdcb8e4c1ec0656c
Submitter: Zuul
Branch: stable/train

commit 02f4d8ab762cd8587873e832bdcb8e4c1ec0656c
Author: Hemanth Nakkina <email address hidden>
Date: Mon Dec 9 14:59:59 2019 +0530

    Fix users/projects list when domain context is changed

    In case of Keystone Multidomain setup, the project and users list
    is empty when the domain context is changed. Horizon uses domain
    scoped token for keystone api calls to get list of projects and users.
    And domain scoped token cannot get information about projects and users
    in other domains, the list is empty.

    This patch modifies the use of domain scoped token only when domain
    context is not modified.

    The bug have 3 parts
    1. Users are not listed on GUI in different domain
    2. Projects are not listed on GUI in different domain
    3. Gui hangs during creation of user/project using + option
    This patch handles case 1 and 2.

    Change-Id: Ibafe3e2eb3ee1ee5c9eb5d2a276a0edfa3e7c607
    Partial-Bug: #1826114
    Closes-Bug: #1830782
    (cherry picked from commit 9aca7a94e28589484e312770cc1ee2b8243211bb)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/698867
Committed: https://git.openstack.org/cgit/openstack/horizon/commit/?id=f6490abc288f667e9af299264e5eebf7eb931355
Submitter: Zuul
Branch: stable/stein

commit f6490abc288f667e9af299264e5eebf7eb931355
Author: Hemanth Nakkina <email address hidden>
Date: Mon Dec 9 14:59:59 2019 +0530

    Fix users/projects list when domain context is changed

    In case of Keystone Multidomain setup, the project and users list
    is empty when the domain context is changed. Horizon uses domain
    scoped token for keystone api calls to get list of projects and users.
    And domain scoped token cannot get information about projects and users
    in other domains, the list is empty.

    This patch modifies the use of domain scoped token only when domain
    context is not modified.

    The bug have 3 parts
    1. Users are not listed on GUI in different domain
    2. Projects are not listed on GUI in different domain
    3. Gui hangs during creation of user/project using + option
    This patch handles case 1 and 2.

    Change-Id: Ibafe3e2eb3ee1ee5c9eb5d2a276a0edfa3e7c607
    Partial-Bug: #1826114
    Closes-Bug: #1830782
    (cherry picked from commit 9aca7a94e28589484e312770cc1ee2b8243211bb)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/699325
Committed: https://git.openstack.org/cgit/openstack/horizon/commit/?id=4d19c56026e51ee496185734b18c896bee93023c
Submitter: Zuul
Branch: stable/stein

commit 4d19c56026e51ee496185734b18c896bee93023c
Author: Hemanth Nakkina <email address hidden>
Date: Wed Dec 11 10:09:22 2019 +0530

    GUI hangs on creation of project in User creation form

    On creation of project in user creation form, the response is sent
    as html and the javascript try to parse the output as json and fails.

    The project creation response should be sent as text/plain so that
    javascript can parse the string as json.

    The bug have 3 parts
    1. Users are not listed on GUI in different domain
    2. Projects are not listed on GUI in different domain
    3. Gui hangs during creation of user/project using + option
    Case 1 & 2 are fixed at https://review.opendev.org/#/c/697962/
    This patch fixes case 3.

    Change-Id: I4936a158ad99cf9d7514e79c06ed2315ce11218b
    Closes-Bug: #1826114
    (cherry picked from commit 8fb86b2adbdf4fae63faabc8937728c43c1777d5)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/699324
Committed: https://git.openstack.org/cgit/openstack/horizon/commit/?id=fbce904348db0143cfe5b48c13dc7d52416bf0e4
Submitter: Zuul
Branch: stable/train

commit fbce904348db0143cfe5b48c13dc7d52416bf0e4
Author: Hemanth Nakkina <email address hidden>
Date: Wed Dec 11 10:09:22 2019 +0530

    GUI hangs on creation of project in User creation form

    On creation of project in user creation form, the response is sent
    as html and the javascript try to parse the output as json and fails.

    The project creation response should be sent as text/plain so that
    javascript can parse the string as json.

    The bug have 3 parts
    1. Users are not listed on GUI in different domain
    2. Projects are not listed on GUI in different domain
    3. Gui hangs during creation of user/project using + option
    Case 1 & 2 are fixed at https://review.opendev.org/#/c/697962/
    This patch fixes case 3.

    Change-Id: I4936a158ad99cf9d7514e79c06ed2315ce11218b
    Closes-Bug: #1826114
    (cherry picked from commit 8fb86b2adbdf4fae63faabc8937728c43c1777d5)

[Hemanth Nakkina (hemanth-n)]

Attached debdiffs for eoan, disco, uca train, uca stein.

[Ubuntu Foundations Team Bug Bot (crichton)]

The attachment "lp1826114_eoan.debdiff" seems to be a debdiff. The ubuntu-sponsors team has been subscribed to the bug report so that they can review and hopefully sponsor the debdiff. If the attachment isn't a patch, please remove the "patch" flag from the attachment, remove the "patch" tag, and if you are member of the ~ubuntu-sponsors, unsubscribe the team.

[This is an automated message performed by a Launchpad user owned by ~brian-murray, for any issue please contact him.]

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/horizon 18.0.0 release.

[Corey Bryant (corey.bryant)]

This is fixed in the focal horizon package.

[Corey Bryant (corey.bryant)]

Disco is EOL this month so we can fix this directly in Rocky.

[Corey Bryant (corey.bryant)]

s/Rocky/Stein ^

[Sahid Orentino (sahid-ferdjaoui)]

Corey, it's ready to be merge/uploaded.

Please consider stable/train and stable/stein branches [0].
Also that I verified the behavior with eoan-train and bionic-stein, you can find the builds [1][2].

Thanks,
s.

[0] https://code.launchpad.net/~sahid-ferdjaoui/ubuntu/+source/horizon/+git/horizon
[1] https://launchpad.net/~sahid-ferdjaoui/+archive/ubuntu/eoan-train
[2] https://launchpad.net/~sahid-ferdjaoui/+archive/ubuntu/bionic-stein-horizon

[Corey Bryant (corey.bryant)]

Thanks all, this has been uploaded to the Ubuntu Eoan unapproved queue at:
https://launchpad.net/ubuntu/eoan/+queue?queue_state=1&queue_text=horizon

And has also been uploaded to the stein-staging PPA.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/horizon 15.2.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/horizon 16.1.0 release.

[Corey Bryant (corey.bryant)]

Hello Eduardo, or anyone else affected,

Accepted horizon into stein-proposed. The package will build now and be available in the Ubuntu Cloud Archive in a few hours, and then in the -proposed repository.

Please help us by testing this new package. To enable the -proposed repository:

  sudo add-apt-repository cloud-archive:stein-proposed
  sudo apt-get update

Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-stein-needed to verification-stein-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-stein-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Hemanth Nakkina (hemanth-n)]

Verified stein on bionic. Project and User pages on Horizon dashboard displayed the corresponding project/user information for the selected domain.
Test environment is built using stsstack-bundle with series bionic and release stein.

Version of package tested -
python3-django-horizon/bionic-proposed,now 3:15.1.1-0ubuntu1.1~cloud1

[Corey Bryant (corey.bryant)]

Thanks @Hemanth for the quick testing.

[Timo Aaltonen (tjaalton)]

Hello Eduardo, or anyone else affected,

Accepted horizon into eoan-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/horizon/3:16.0.0-0ubuntu1.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-eoan to verification-done-eoan. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-eoan. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Hemanth Nakkina (hemanth-n)]

Verified on ubuntu series eoan. Project and User pages on Horizon dashboard displayed the corresponding project/user information for the selected domain.
Test environment is built using stsstack-bundle with series eoan.

Version of package tested -
python3-django-horizon/eoan-proposed,now 3:16.0.0-0ubuntu1.1

[Corey Bryant (corey.bryant)]

Hello Eduardo, or anyone else affected,

Accepted horizon into train-proposed. The package will build now and be available in the Ubuntu Cloud Archive in a few hours, and then in the -proposed repository.

Please help us by testing this new package. To enable the -proposed repository:

  sudo add-apt-repository cloud-archive:train-proposed
  sudo apt-get update

Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-train-needed to verification-train-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-train-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Hemanth Nakkina (hemanth-n)]

Verified train on bionic. Project and User pages on Horizon dashboard displayed the corresponding project/user information for the selected domain.
Test environment is built using stsstack-bundle with series bionic and release train.

Version of package tested -
python3-django-horizon/bionic-proposed,now 3:16.0.0-0ubuntu1.1~cloud0

[Łukasz Zemczak (sil2100)]

The verification of the Stable Release Update for horizon has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[Launchpad Janitor (janitor)]

This bug was fixed in the package horizon - 3:16.0.0-0ubuntu1.1

---------------
horizon (3:16.0.0-0ubuntu1.1) eoan; urgency=medium

  [ Corey Bryant ]
  * d/gbp.conf: Create stable/train branch.

  [ Hemanth Nakkina ]
  * Fix users/projects list when domain context is changed (LP: #1826114)
    - d/p/fix-user-list-for-different-domain.patch.
  * GUI hangs on creation of project in User creation form (LP: #1826114)
    - d/p/gui-hangs-on-project-creation.patch.

 -- Hemanth Nakkina <email address hidden> Tue, 07 Jan 2020 12:02:44 +0530

[Corey Bryant (corey.bryant)]

The verification of the Stable Release Update for horizon has completed successfully and the package has now been released to -updates. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[Corey Bryant (corey.bryant)]

This bug was fixed in the package horizon - 3:16.0.0-0ubuntu1.1~cloud0
---------------

 horizon (3:16.0.0-0ubuntu1.1~cloud0) bionic-train; urgency=medium
 .
   * New update for the Ubuntu Cloud Archive.
 .
 horizon (3:16.0.0-0ubuntu1.1) eoan; urgency=medium
 .
   [ Corey Bryant ]
   * d/gbp.conf: Create stable/train branch.
 .
   [ Hemanth Nakkina ]
   * Fix users/projects list when domain context is changed (LP: #1826114)
     - d/p/fix-user-list-for-different-domain.patch.
   * GUI hangs on creation of project in User creation form (LP: #1826114)
     - d/p/gui-hangs-on-project-creation.patch.

[Corey Bryant (corey.bryant)]

The verification of the Stable Release Update for horizon has completed successfully and the package has now been released to -updates. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[Corey Bryant (corey.bryant)]

This bug was fixed in the package horizon - 3:15.1.1-0ubuntu1.1~cloud1
---------------

 horizon (3:15.1.1-0ubuntu1.1~cloud1) bionic-stein; urgency=medium
 .
   * Fix users/projects list when domain context is changed (LP: #1826114)
     - d/p/fix-user-list-for-different-domain.patch.
   * GUI hangs on creation of project in User creation form (LP: #1826114)
     - d/p/gui-hangs-on-project-creation.patch.