Bug #1540133 “Publicurl for a swift/v1 endpoint contains IP addr...” : Bugs : Fuel for OpenStack

Revision history for this message

Roman Podoliaka (rpodolyaka) wrote on 2016-02-01:

#1

Anatolii, what MOS release is this?

tags:	added: area-ceph
Changed in mos:
status:	New → Incomplete
assignee:	nobody → Anatolii Neliubin (aneliubin)

Revision history for this message

Anatolii Neliubin (aneliubin) wrote on 2016-02-01: Re: [Bug 1540133] Re: Publicurl for a swift/v1 endpoint contains IP address instead of FQDN when swift is launched using ceph

#2

Download full text (4.1 KiB)

Hello Roman,

Sorry, I forgot to mention about the Fuel version.

[root@fuel remote]# fuel fuel-version
DEPRECATION WARNING: /etc/fuel/client/config.yaml exists and will be used
as the source for settings. This behavior is deprecated. Please specify the
path to your custom settings file in the FUELCLIENT_CUSTOM_SETTINGS
environment variable.
api: '1.0'
astute_sha: 6c5b73f93e24cc781c809db9159927655ced5012
auth_required: true
build_id: '301'
build_number: '301'
feature_groups:
- mirantis
fuel-agent_sha: 50e90af6e3d560e9085ff71d2950cfbcca91af67
fuel-library_sha: 5d50055aeca1dd0dc53b43825dc4c8f7780be9dd
fuel-nailgun-agent_sha: d7027952870a35db8dc52f185bb1158cdd3d1ebd
fuel-ostf_sha: 2cd967dccd66cfc3a0abd6af9f31e5b4d150a11c
fuelmain_sha: a65d453215edb0284a2e4761be7a156bb5627677
nailgun_sha: 4162b0c15adb425b37608c787944d1983f543aa8
openstack_version: 2015.1.0-7.0
production: docker
python-fuelclient_sha: 486bde57cda1badb68f915f66c61b544108606f3
release: '7.0'
release_versions:
  2015.1.0-7.0:
    VERSION:
      api: '1.0'
      astute_sha: 6c5b73f93e24cc781c809db9159927655ced5012
      build_id: '301'
      build_number: '301'
      feature_groups:
      - mirantis
      fuel-agent_sha: 50e90af6e3d560e9085ff71d2950cfbcca91af67
      fuel-library_sha: 5d50055aeca1dd0dc53b43825dc4c8f7780be9dd
      fuel-nailgun-agent_sha: d7027952870a35db8dc52f185bb1158cdd3d1ebd
      fuel-ostf_sha: 2cd967dccd66cfc3a0abd6af9f31e5b4d150a11c
      fuelmain_sha: a65d453215edb0284a2e4761be7a156bb5627677
      nailgun_sha: 4162b0c15adb425b37608c787944d1983f543aa8
      openstack_version: 2015.1.0-7.0
      production: docker
      python-fuelclient_sha: 486bde57cda1badb68f915f66c61b544108606f3
      release: '7.0'

On Mon, Feb 1, 2016 at 3:39 PM, Roman Podoliaka <
<email address hidden>> wrote:

> Anatolii, what MOS release is this?
>
> ** Tags added: area-ceph
>
> ** Changed in: mos
> Status: New => Incomplete
>
> ** Changed in: mos
> Assignee: (unassigned) => Anatolii Neliubin (aneliubin)
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1540133
>
> Title:
> Publicurl for a swift/v1 endpoint contains IP address instead of FQDN
> when swift is launched using ceph
>
> Status in Mirantis OpenStack:
> Incomplete
>
> Bug description:
> The publicurl keystone endpoint for swift/v1 contains an IP address
> instead of FQDN when swift is deployed using ceph.
> root@node-1:~# openstack catalog list
>
> +----------+----------------+-----------------------------------------------------------------------------------+
> | Name | Type | Endpoints
> |
>
> +----------+----------------+-----------------------------------------------------------------------------------+
> | nova | compute | RegionOne
> |
> | | | publicURL:
> https://public.fuel.local:8774/v2/0bdfbd845a8a4f3d8d9a259cf8d74e25 |
> | | | internalURL:
> https://public.fuel.local:8774/v2/0bdfbd845a8a4f3d8d9a259cf8d74e25 |
> | | | admin...

Hello Roman,

Sorry, I forgot to mention about the Fuel version.

[root@fuel remote]# fuel fuel-version
DEPRECATION WARNING: /etc/fuel/client/config.yaml exists and will be used
as the source for settings. This behavior is deprecated. Please specify the
path to your custom settings file in the FUELCLIENT_CUSTOM_SETTINGS
environment variable.
api: '1.0'
astute_sha: 6c5b73f93e24cc781c809db9159927655ced5012
auth_required: true
build_id: '301'
build_number: '301'
feature_groups:
- mirantis
fuel-agent_sha: 50e90af6e3d560e9085ff71d2950cfbcca91af67
fuel-library_sha: 5d50055aeca1dd0dc53b43825dc4c8f7780be9dd
fuel-nailgun-agent_sha: d7027952870a35db8dc52f185bb1158cdd3d1ebd
fuel-ostf_sha: 2cd967dccd66cfc3a0abd6af9f31e5b4d150a11c
fuelmain_sha: a65d453215edb0284a2e4761be7a156bb5627677
nailgun_sha: 4162b0c15adb425b37608c787944d1983f543aa8
openstack_version: 2015.1.0-7.0
production: docker
python-fuelclient_sha: 486bde57cda1badb68f915f66c61b544108606f3
release: '7.0'
release_versions:
  2015.1.0-7.0:
    VERSION:
      api: '1.0'
      astute_sha: 6c5b73f93e24cc781c809db9159927655ced5012
      build_id: '301'
      build_number: '301'
      feature_groups:
      - mirantis
      fuel-agent_sha: 50e90af6e3d560e9085ff71d2950cfbcca91af67
      fuel-library_sha: 5d50055aeca1dd0dc53b43825dc4c8f7780be9dd
      fuel-nailgun-agent_sha: d7027952870a35db8dc52f185bb1158cdd3d1ebd
      fuel-ostf_sha: 2cd967dccd66cfc3a0abd6af9f31e5b4d150a11c
      fuelmain_sha: a65d453215edb0284a2e4761be7a156bb5627677
      nailgun_sha: 4162b0c15adb425b37608c787944d1983f543aa8
      openstack_version: 2015.1.0-7.0
      production: docker
      python-fuelclient_sha: 486bde57cda1badb68f915f66c61b544108606f3
      release: '7.0'

On Mon, Feb 1, 2016 at 3:39 PM, Roman Podoliaka <
rpodolyaka+bugs@mirantis.com> wrote:

> Anatolii, what MOS release is this?
>
> ** Tags added: area-ceph
>
> ** Changed in: mos
>        Status: New => Incomplete
>
> ** Changed in: mos
>      Assignee: (unassigned) => Anatolii Neliubin (aneliubin)
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1540133
>
> Title:
>   Publicurl for a swift/v1 endpoint contains IP address instead of FQDN
>   when swift is launched using ceph
>
> Status in Mirantis OpenStack:
>   Incomplete
>
> Bug description:
>   The publicurl keystone endpoint for swift/v1 contains an IP address
> instead of FQDN when swift is deployed using ceph.
>   root@node-1:~# openstack catalog list
>
> +----------+----------------+-----------------------------------------------------------------------------------+
>   | Name     | Type           | Endpoints
>                                        |
>
> +----------+----------------+-----------------------------------------------------------------------------------+
>   | nova     | compute        | RegionOne
>                                        |
>   |          |                |   publicURL:
> https://public.fuel.local:8774/v2/0bdfbd845a8a4f3d8d9a259cf8d74e25   |
>   |          |                |   internalURL:
> https://public.fuel.local:8774/v2/0bdfbd845a8a4f3d8d9a259cf8d74e25 |
>   |          |                |   adminURL:
> https://public.fuel.local:8774/v2/0bdfbd845a8a4f3d8d9a259cf8d74e25    |
>   ...SKIPPED....
>   | swift    | object-store   | RegionOne
>                                        |
>   |          |                |   publicURL:
> https://172.16.0.3:8080/swift/v1                                     |
>   |          |                |   internalURL:
> https://172.16.0.3:8080/swift/v1                                   |
>   |          |                |   adminURL:
> https://172.16.0.3:8080/swift/v1                                      |
>
>   From Fuel interface:
>   Storage Backends
>   Ceph RBD for volumes (Cinder)
>   Ceph RadosGW for objects (Swift API)
>   Ceph RBD for ephemeral volumes (Nova)
>   Ceph RBD for images (Glance)
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/mos/+bug/1540133/+subscriptions
>

--

Kind regards,
Anatolii Neliubin, OpenStack Operations Engineer
------------------------------

Mirantis, Inc.
(925) 808-FUEL

Anatolii Neliubin (aneliubin) on 2016-02-20

tags:	added: customer-found
description:	updated

Dina Belova (dbelova) on 2016-03-04

Changed in mos:
status:	Incomplete → Confirmed
importance:	Undecided → Medium
assignee:	Anatolii Neliubin (aneliubin) → MOS Puppet Team (mos-puppet)
milestone:	none → 7.0-updates

Denis Egorenko (degorenko) on 2016-03-04

Changed in mos:
assignee:	MOS Puppet Team (mos-puppet) → Denis Egorenko (degorenko)

Revision history for this message

Denis Egorenko (degorenko) wrote on 2016-03-04:

#3

Here is fix: https://review.openstack.org/#/c/288473/

Changed in mos:
status:	Confirmed → In Progress

Revision history for this message

Andrew Woodward (xarses) wrote on 2016-03-10:

#4

by observation of code changed, master needs a similar fix

no longer affects:	mos/9.0.x
affects:	mos → fuel
Changed in fuel:
milestone:	7.0-updates → none
milestone:	none → 7.0-updates

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-03-14: Fix proposed to fuel-library (master)

#5

Fix proposed to branch: master
Review: https://review.openstack.org/292289

Changed in fuel:
status:	Confirmed → In Progress

OpenStack Infra (hudson-openstack) on 2016-03-21

Changed in fuel:
assignee:	Denis Egorenko (degorenko) → Alex Schultz (alex-schultz)

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-03-25: Fix merged to fuel-library (master)

#6

Reviewed: https://review.openstack.org/292289
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=c8aeb0fbef38063def6c99b85844f433591dce4e
Submitter: Jenkins
Branch: master

commit c8aeb0fbef38063def6c99b85844f433591dce4e
Author: Denis Egorenko <email address hidden>
Date: Mon Mar 14 13:23:21 2016 +0300

Set proper public address for swift endpoint for Ceph

    Currently we are not handling situation when we have Ceph with RadosGW
    enabled with enabled TLS/SSL. As a result we have wrong addresses
    for Swift endpoints in Keystone. This commit fixes that.

Also this patch creates radosgw_keystone task for managing endpoint and
removes unused parameters from ceph-osd and radosgw modulars.

Change-Id: Id86d85a13fbec27265156a5b12fad0fd892c7cd9
Closes-bug: #1540133

Changed in fuel:
status:	In Progress → Fix Committed

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-03-25: Fix proposed to fuel-library (stable/8.0)

#7

Fix proposed to branch: stable/8.0
Review: https://review.openstack.org/297751

Oleksiy Molchanov (omolchanov) on 2016-03-31

tags:

added: dev-to-verify on-verification

Oleksiy Molchanov (omolchanov) on 2016-03-31

tags:

removed: on-verification

Revision history for this message

Rodion Tikunov (rtikunov) wrote on 2016-06-06:

#8

Fixing this bug in 7.0 by patch https://review.openstack.org/288473/ causes a new bug. Full support for Swift's URL schema (including account identifier extracted from URL, not only from an auth token) has not supported in radosgw [0]

[0] https://bugs.launchpad.net/mos/+bug/1520966/comments/3

Revision history for this message

Denis Egorenko (degorenko) wrote on 2016-06-06:

#9

Not sure that i got your problem. My patch doesn't change swift endpoint URLs - only public address with/without TLS.

So, it was swift/v1 before my patch: https://review.openstack.org/#/c/288473/5/deployment/puppet/ceph/manifests/keystone.pp

And it is swift/v1 with my patch: https://review.openstack.org/#/c/288473/5/deployment/puppet/osnailyfacter/modular/ceph/radosgw_keystone.pp

How you got your endpoint with v1/AUTH_%(tenant_id)s ?

Revision history for this message

Rodion Tikunov (rtikunov) wrote on 2016-06-07:

#10

From puppet.log:
2016-06-06 10:09:20 +0000 /Stage[main]/Swift::Keystone::Auth/Keystone::Resource::Service_identity[swift]/Keystone_service[swift] (info): Starting to evaluate the resource
2016-06-06 10:09:20 +0000 Puppet (debug): Executing '/usr/bin/openstack service create --format shell object-store --name swift --description Openstack Object-Store Service'
2016-06-06 10:09:20 +0000 Puppet::Type::Keystone_service::ProviderOpenstack (debug): OpenStack request: 'service create ["object-store", "--name", "swift", "--description", "Openstack Object-Store Service"]' returned: '{:description=>"Openstack Object-Store Service", :enabled=>"True", :id=>"834f8134f2a04acbb74e420c68f3e7cf", :name=>"swift", :type=>"object-store"}'
2016-06-06 10:09:20 +0000 /Stage[main]/Swift::Keystone::Auth/Keystone::Resource::Service_identity[swift]/Keystone_service[swift]/ensure (notice): created
2016-06-06 10:09:20 +0000 /Stage[main]/Swift::Keystone::Auth/Keystone::Resource::Service_identity[swift]/Keystone_service[swift] (debug): The container Keystone::Resource::Service_identity[swift] will propagate my refresh event
2016-06-06 10:09:20 +0000 /Stage[main]/Swift::Keystone::Auth/Keystone::Resource::Service_identity[swift]/Keystone_service[swift] (info): Evaluated in 0.56 seconds
2016-06-06 10:09:20 +0000 /Stage[main]/Swift::Keystone::Auth/Keystone::Resource::Service_identity[swift]/Keystone_endpoint[RegionOne/swift] (info): Starting to evaluate the resource
2016-06-06 10:09:20 +0000 Puppet (debug): Executing '/usr/bin/openstack endpoint create --format shell swift --region RegionOne --publicurl https://public.fuel.local:8080/v1/AUTH_%(tenant_id)s --internalurl http://192.168.0.2:8080/v1/AUTH_%(tenant_id)s --adminurl http://192.168.0.2:8080/v1/AUTH_%(tenant_id)s'
2016-06-06 10:09:21 +0000 Puppet::Type::Keystone_endpoint::ProviderOpenstack (debug): OpenStack request: 'endpoint create ["swift", "--region", "RegionOne", "--publicurl", "https://public.fuel.local:8080/v1/AUTH_%(tenant_id)s", "--internalurl", "http://192.168.0.2:8080/v1/AUTH_%(tenant_id)s", "--adminurl", "http://192.168.0.2:8080/v1/AUTH_%(tenant_id)s"]' returned: '{:adminurl=>"http://192.168.0.2:8080/v1/AUTH_%(tenant_id)s", :id=>"9e64da77368f4b6fbe003d55069262f5", :internalurl=>"http://192.168.0.2:8080/v1/AUTH_%(tenant_id)s", :publicurl=>"https://public.fuel.local:8080/v1/AUTH_%(tenant_id)s", :region=>"RegionOne", :service_id=>"834f8134f2a04acbb74e420c68f3e7cf", :service_name=>"swift", :service_type=>"object-store"}'
2016-06-06 10:09:21 +0000 /Stage[main]/Swift::Keystone::Auth/Keystone::Resource::Service_identity[swift]/Keystone_endpoint[RegionOne/swift]/ensure (notice): created
2016-06-06 10:09:21 +0000 /Stage[main]/Swift::Keystone::Auth/Keystone::Resource::Service_identity[swift]/Keystone_endpoint[RegionOne/swift] (debug): The container Keystone::Resource::Service_identity[swift] will propagate my refresh event
2016-06-06 10:09:21 +0000 /Stage[main]/Swift::Keystone::Auth/Keystone::Resource::Service_identity[swift]/Keystone_endpoint[RegionOne/swift] (info): Evaluated in 0.64 seconds

Revision history for this message

Rodion Tikunov (rtikunov) wrote on 2016-06-07:

#11

Your patch is looking good. But maybe it changes behaviour which described in another bug [0]

[0] https://bugs.launchpad.net/fuel/+bug/1541485/comments/3

Revision history for this message

Denis Egorenko (degorenko) wrote on 2016-06-07:

#12

As i understand from logs, you don't have RadosGW and using native swift. My patch is only for RadosGW+Ceph.

You have Swift::Keystone task - my patch is adding radosgw/keystone.pp task.

Revision history for this message

Rodion Tikunov (rtikunov) wrote on 2016-06-07:

#13

No, I have the same env. The settings are:
MOS 7.0
Storage Backends
Ceph RBD for volumes (Cinder)
Ceph RadosGW for objects (Swift API)
Ceph RBD for ephemeral volumes (Nova)
Ceph RBD for images (Glance)

TLS for OpenStack public endpoints enabled.

Maybe it better to merge your patch and fail a new bug for this issue.

Revision history for this message

Denis Egorenko (degorenko) wrote on 2016-06-07:

#14

Then it is really strange to see task Swift::Keystone on your env.

Probably you should fail another bug.

Revision history for this message

Rodion Tikunov (rtikunov) wrote on 2016-06-08:

#15

Sorry, I forgot to run `fuel rel --sync-deployment-tasks --dir /etc/puppet/` after applying the patch.
Now it works well for 8.0. But for 7.0 doesn't, please look at my comment in patch review.

Revision history for this message

Denis Egorenko (degorenko) wrote on 2016-09-02:

#16

Vitaly, for 7.0 fix is already on review https://review.openstack.org/288473

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-09-23: Fix merged to fuel-library (stable/7.0)

#17

Reviewed: https://review.openstack.org/288473
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=cea1856489d4ab41d0c0d3411a15be7fa60d68a3
Submitter: Jenkins
Branch: stable/7.0

commit cea1856489d4ab41d0c0d3411a15be7fa60d68a3
Author: Denis Egorenko <email address hidden>
Date: Fri Mar 4 17:17:20 2016 +0300

Set proper public address for swift endpoint for Ceph

    Currently we are not handling situation when we have Ceph with RadosGW
    enabled with enabled TLS/SSL. As a result we have wrong addresses
    for Swift endpoints in Keystone. This commit fixes that.

Also this patch creates radosgw_keystone task for managing endpoint and
removes unused parameters from ceph-osd and radosgw modulars.

Change-Id: Id86d85a13fbec27265156a5b12fad0fd892c7cd9
Closes-bug: #1540133

TatyanaGladysheva (tgladysheva) on 2016-09-26

tags:

added: on-verification

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-09-26: Fix merged to fuel-library (stable/8.0)

#18

Reviewed: https://review.openstack.org/297751
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=7c72b904b7901fda0515094221f7903469a7ef70
Submitter: Jenkins
Branch: stable/8.0

commit 7c72b904b7901fda0515094221f7903469a7ef70
Author: Denis Egorenko <email address hidden>
Date: Mon Mar 14 13:23:21 2016 +0300

Set proper public address for swift endpoint for Ceph

    Currently we are not handling situation when we have Ceph with RadosGW
    enabled with enabled TLS/SSL. As a result we have wrong addresses
    for Swift endpoints in Keystone. This commit fixes that.

Also this patch creates radosgw_keystone task for managing endpoint and
removes unused parameters from ceph-osd and radosgw modulars.

Change-Id: Id86d85a13fbec27265156a5b12fad0fd892c7cd9
Closes-bug: #1540133

Revision history for this message

TatyanaGladysheva (tgladysheva) wrote on 2016-10-04:

#19

Verified on MOS 7.0 + MU6 updates.

Actual results:
root@node-1:~# openstack catalog list
+----------+----------------+-----------------------------------------------------+
| Name | Type | Endpoints
+----------+----------------+-----------------------------------------------------+
...
| swift | object-store | RegionOne | | | publicURL: https://public.fuel.local:8080/swift/v1
| | | internalURL: https://public.fuel.local:8080/swift/v1
| | | adminURL: https://public.fuel.local:8080/swift/v1
...

tags:

removed: on-verification

TatyanaGladysheva (tgladysheva) on 2017-02-09

tags:

added: on-verification

Revision history for this message

TatyanaGladysheva (tgladysheva) wrote on 2017-02-10:

#20

Verified on MOS 8.0 + MU4 updates.

Actual results:
root@node-8:~# openstack catalog list
+----------+----------------+----------------------------------------------------------------------------+
| Name | Type | Endpoints |
+----------+----------------+----------------------------------------------------------------------------+
...
| swift | object-store | RegionOne |
| | | publicURL: https://public.fuel.local:8080/swift/v1 |
| | | internalURL: http://10.109.11.3:8080/swift/v1 |
| | | adminURL: http://10.109.11.3:8080/swift/v1
...

tags:

removed: on-verification

	Status	Importance	Assigned to	Milestone
Fuel for OpenStack	Fix Released	Medium	Denis Egorenko	Fuel for OpenStack 9.0
7.0.x	Fix Released	Medium	Denis Egorenko	Fuel for OpenStack 7.0-mu-6
8.0.x	Fix Released	Medium	Denis Egorenko	Fuel for OpenStack 8.0-mu-4
Mitaka	Fix Released	Medium	Denis Egorenko	Fuel for OpenStack 9.0

Fuel for OpenStack

Publicurl for a swift/v1 endpoint contains IP address instead of FQDN when swift is launched using ceph

Bug Description

Duplicates of this bug

Other bug subscribers

Remote bug watches