Fuel 11 OCATA UCA with unpinned HAproxy, installs MOS package anyway

Bug #1686597 reported by Luca Cervigni
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Incomplete
Medium
Michael Polenchuk

Bug Description

Hello

After selecting the installation with UCA repositories and unpinning HAproxy to use the upstream packages, the deployment still installs the MOS package.

root@controller-01:/etc/apt/sources.list.d/disabled# apt-cache policy haproxy
haproxy:
  Installed: 1.6.3-1~u16.04+mos3
  Candidate: 1.6.3-1ubuntu0.1
  Version table:
     1.6.3-1ubuntu0.1 500
        500 http://archive.ubuntu.com/ubuntu xenial-security/main amd64 Packages
        500 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages
     1.6.3-1 500
        500 http://archive.ubuntu.com/ubuntu xenial/main amd64 Packages
 *** 1.6.3-1~u16.04+mos3 100
        100 /var/lib/dpkg/status

Disabling the MOS repos:

root@controller-01:/etc/apt/sources.list.d/disabled# apt-cache policy haproxy
haproxy:
  Installed: 1.6.3-1~u16.04+mos3
  Candidate: 1.6.3-1ubuntu0.1
  Version table:
     1.6.3-1ubuntu0.1 500
        500 http://archive.ubuntu.com/ubuntu xenial-security/main amd64 Packages
        500 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages
     1.6.3-1 500
        500 http://archive.ubuntu.com/ubuntu xenial/main amd64 Packages
 *** 1.6.3-1~u16.04+mos3 100
        100 /var/lib/dpkg/status

Revision history for this message
Michael Polenchuk (mpolenchuk) wrote :

Please show output of "hiera repo_setup" cmd on any controller.
It'd be good to get content of /etc/hiera dir as well.

Changed in fuel:
milestone: none → 11.x-updates
importance: Undecided → Medium
status: New → Incomplete
Revision history for this message
Luca Cervigni (cervigni) wrote :
Download full text (3.3 KiB)

Here

[root@fuel ~]# hiera repo_setup
nil

[root@fuel ~]# cat /etc/hiera.yaml
---
  !ruby/sym logger: noop
  !ruby/sym backends:
    - yaml
  !ruby/sym yaml:
    !ruby/sym datadir: /etc/hiera
  !ruby/sym hierarchy:
    - defaults
    - "%{clientcert}"
    - "%{environment}"
    - global
    - plugins_placeholder
    - override/common
    - "class/%{calling_class}"
    - "module/%{calling_module}"
    - nodes
    - networks
    - astute
    - common
  !ruby/sym merge_behavior: deeper

[root@fuel ~]# cat /etc/hiera/astute.yaml
"ADMIN_NETWORK":
  "dhcp_gateway": "146.118.52.2"
  "dhcp_pool_end": "146.118.52.240"
  "dhcp_pool_start": "146.118.52.10"
  "interface": "eth0"
  "ipaddress": "146.118.52.2"
  "mac": "40:f2:e9:f0:f1:fa"
  "netmask": "255.255.255.0"
  "ssh_network": "146.118.52.0/24"
"BOOTSTRAP":
  "flavor": "ubuntu"
  "hashed_root_password": "xxxxxxxxx"
  "http_proxy": ""
  "https_proxy": ""
  "repos":
  - "name": "ubuntu"
    "priority": !!null "null"
    "section": "main universe multiverse"
    "suite": "xenial"
    "type": "deb"
    "uri": "http://archive.ubuntu.com/ubuntu"
  - "name": "ubuntu-updates"
    "priority": !!null "null"
    "section": "main universe multiverse"
    "suite": "xenial-updates"
    "type": "deb"
    "uri": "http://archive.ubuntu.com/ubuntu"
  - "name": "ubuntu-security"
    "priority": !!null "null"
    "section": "main universe multiverse"
    "suite": "xenial-security"
    "type": "deb"
    "uri": "http://archive.ubuntu.com/ubuntu"
  - "name": "mos"
    "priority": !!int "1050"
    "section": "main restricted"
    "suite": "mos11.0"
    "type": "deb"
    "uri": "http://127.0.0.1:8080/ubuntu/x86_64"
  - "name": "mos-updates"
    "priority": !!int "1050"
    "section": "main restricted"
    "suite": "mos11.0-updates"
    "type": "deb"
    "uri": "http://mirror.fuel-infra.org/mos-repos/ubuntu/11.0"
  - "name": "mos-security"
    "priority": !!int "1050"
    "section": "main restricted"
    "suite": "mos11.0-security"
    "type": "deb"
    "uri": "http://mirror.fuel-infra.org/mos-repos/ubuntu/11.0"
  - "name": "mos-holdback"
    "priority": !!int "1100"
    "section": "main restricted"
    "suite": "mos11.0-holdback"
    "type": "deb"
    "uri": "http://mirror.fuel-infra.org/mos-repos/ubuntu/11.0"
  "skip_default_img_build": !!bool "false"
"DNS_DOMAIN": "nimbus.pawsey.org.au"
"DNS_SEARCH": "nimbus.pawsey.org.au"
"DNS_UPSTREAM": "146.118.50.6"
"FEATURE_GROUPS":
- "experimental"
- "advanced"
"FUEL_ACCESS":
  "password": "xxxxxxxx"
  "user": "admin"
"HOSTNAME": "fuel"
"NTP1": "0.fuel.pool.ntp.org"
"NTP2": "1.fuel.pool.ntp.org"
"NTP3": "2.fuel.pool.ntp.org"
"PRODUCTION": "docker"
"TEST_DNS": "www.google.com"
"astute":
  "password": "xxxxxxx"
  "user": "naily"
"cobbler":
  "password": "xxxxxx"
  "user": "cobbler"
"keystone":
  "admin_token": "xxxxxx"
  "monitord_password": "xxxxxxx"
  "monitord_user": "monitord"
  "nailgun_password": "xxxxxxx"
  "nailgun_user": "nailgun"
  "ostf_password": "xxxxxx"
  "ostf_user": "ostf"
  "service_token_off": "true"
"mcollective":
  "password": "xxxxxx"
  "user": "mcollective"
"postgres":
  "keystone_dbname": "keystone"
  "keystone_password": "xxxxxx"
  "keystone_user": "k...

Read more...

Revision history for this message
Luca Cervigni (cervigni) wrote :
Download full text (6.4 KiB)

root@node-111:~# hiera repo_setup
{"metadata"=>
  {"always_editable"=>true,
   "group"=>"general",
   "label"=>"Repositories",
   "weight"=>50},
 "pin_ceph"=>false,
 "pin_haproxy"=>false,
 "pin_rabbitmq"=>false,
 "repo_type"=>"uca",
 "repos"=>
  [{"name"=>"ubuntu",
    "priority"=>nil,
    "section"=>"main universe multiverse",
    "suite"=>"xenial",
    "type"=>"deb",
    "uri"=>"http://archive.ubuntu.com/ubuntu/"},
   {"name"=>"ubuntu-updates",
    "priority"=>nil,
    "section"=>"main universe multiverse",
    "suite"=>"xenial-updates",
    "type"=>"deb",
    "uri"=>"http://archive.ubuntu.com/ubuntu/"},
   {"name"=>"ubuntu-security",
    "priority"=>nil,
    "section"=>"main universe multiverse",
    "suite"=>"xenial-security",
    "type"=>"deb",
    "uri"=>"http://archive.ubuntu.com/ubuntu/"},
   {"name"=>"uca",
    "priority"=>1080,
    "section"=>"main",
    "suite"=>"xenial-updates/ocata",
    "type"=>"deb",
    "uri"=>"http://ubuntu-cloud.archive.canonical.com/ubuntu"},
   {"name"=>"uca-proposed",
    "priority"=>1080,
    "section"=>"main",
    "suite"=>"xenial-proposed/ocata",
    "type"=>"deb",
    "uri"=>"http://ubuntu-cloud.archive.canonical.com/ubuntu"},
   {"name"=>"mos",
    "priority"=>1050,
    "section"=>"main restricted",
    "suite"=>"mos11.0",
    "type"=>"deb",
    "uri"=>"http://146.118.52.2:8080/ocata-11.0/ubuntu/x86_64"},
   {"name"=>"mos-updates",
    "priority"=>1050,
    "section"=>"main restricted",
    "suite"=>"mos11.0-updates",
    "type"=>"deb",
    "uri"=>"http://mirror.fuel-infra.org/mos-repos/ubuntu/11.0/"},
   {"name"=>"mos-security",
    "priority"=>1050,
    "section"=>"main restricted",
    "suite"=>"mos11.0-security",
    "type"=>"deb",
    "uri"=>"http://mirror.fuel-infra.org/mos-repos/ubuntu/11.0/"},
   {"name"=>"mos-holdback",
    "priority"=>1100,
    "section"=>"main restricted",
    "suite"=>"mos11.0-holdback",
    "type"=>"deb",
    "uri"=>"http://mirror.fuel-infra.org/mos-repos/ubuntu/11.0/"},
   {"name"=>"Auxiliary",
    "priority"=>1150,
    "section"=>"main restricted",
    "suite"=>"auxiliary",
    "type"=>"deb",
    "uri"=>"http://146.118.52.2:8080/ocata-11.0/ubuntu/auxiliary"}]}

root@controller-01:~# hiera repo_setup
{"metadata"=>
  {"always_editable"=>true,
   "group"=>"general",
   "label"=>"Repositories",
   "weight"=>50},
 "pin_ceph"=>false,
 "pin_haproxy"=>false,
 "pin_rabbitmq"=>false,
 "repo_type"=>"uca",
 "repos"=>
  [{"name"=>"ubuntu",
    "priority"=>nil,
    "section"=>"main universe multiverse",
    "suite"=>"xenial",
    "type"=>"deb",
    "uri"=>"http://archive.ubuntu.com/ubuntu/"},
   {"name"=>"ubuntu-updates",
    "priority"=>nil,
    "section"=>"main universe multiverse",
    "suite"=>"xenial-updates",
    "type"=>"deb",
    "uri"=>"http://archive.ubuntu.com/ubuntu/"},
   {"name"=>"ubuntu-security",
    "priority"=>nil,
    "section"=>"main universe multiverse",
    "suite"=>"xenial-security",
    "type"=>"deb",
    "uri"=>"http://archive.ubuntu.com/ubuntu/"},
   {"name"=>"uca",
    "priority"=>1080,
    "section"=>"main",
    "suite"=>"xenial-updates/ocata",
    "type"=>"deb",
    "uri"=>"http://ubuntu-cloud.archive.canonical.com/ubuntu"},
   {"name"=>"uca-proposed"...

Read more...

Revision history for this message
Luca Cervigni (cervigni) wrote :

let me know what files you need in /etc/hiera that I need to clean them up from private info

Revision history for this message
Michael Polenchuk (mpolenchuk) wrote :

Please describe all the steps performed to get such apt policy output.
Since with latest iso with unpinned haproxy package we've got:
# apt-cache policy haproxy
haproxy:
  Installed: 1.6.3-1~u16.04+mos3
  Candidate: 1.6.3-1~u16.04+mos3
  Version table:
     1.6.3-1ubuntu0.1 500
        500 http://archive.ubuntu.com/ubuntu xenial-security/main amd64 Packages
        500 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages
     1.6.3-1 500
        500 http://archive.ubuntu.com/ubuntu xenial/main amd64 Packages
 *** 1.6.3-1~u16.04+mos3 1050
       1050 http://10.20.0.2:8080/ocata-11.0/ubuntu/x86_64 mos11.0/main amd64 Packages
        100 /var/lib/dpkg/status

Changed in fuel:
assignee: nobody → Michael Polenchuk (mpolenchuk)
Revision history for this message
Luca Cervigni (cervigni) wrote :

Micheal,
If unpinned to mos repositories, why the package installed is from the mos repositories?
It should be the 1.6.3-1 from the UCA repos isn't it?

Revision history for this message
Michael Polenchuk (mpolenchuk) wrote :

Because package candidate (latest by version) to install is from mos repo anyway.

Revision history for this message
Luca Cervigni (cervigni) wrote :

Michael,

I discovered after investigation that the Mirantis HAPROXY packages is modified to use multiple configuration files stored under /etc/haproxy/conf.d/* . This is not the case in the upstream haproxy package from the UCA repos that wants an unique conf file under /etc/haproxy/haproxy.cfg.

Two questions, first, could you open a bug to modify the configuration of the fuel deployment? it does not make any sense asking the user if wants the package pinned or not to the MOS repos, because it is an obligation to have the MOS package or the deployment fails since the haproxy configuration is written on separate files under conf.d .

The second is, do you know if any other modifications have been done in the MOS haproxy package aside from the reading of the different config files?

Many thanks

Revision history for this message
Michael Polenchuk (mpolenchuk) wrote :

Luca,
1. Could you please open a bug since you have more context/details.
2. All changes are in the changeLog.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.