Ansible Fuel Update Fails at cobbler with error code 4

[A]

See File Attached for Ansible Log

Detailed bug description:

Fuel upgrade fails with the following error:

"Debug: Processing report from fuel.domain.tld with processor Puppet::Reports::Store", "The were failures while running task: cobbler with exit code: 4"

Steps to reproduce:

Fresh install of MOS 9.0
Update using the 9.2 Doc - https://docs.mirantis.com/openstack/fuel/fuel-9.2/release-notes/update-product/update-prerequisites-9-2.html

Fuel Master has the following configurations:

/etc/yum.conf
http_proxy=http://10.122.141.124:3128

/etc/environment
http_proxy=http://10.122.141.124:3128

/etc/hosts
14.2.106.5 fuel.domain.tld fuel

Expected results:

Upgrade to complete as intended

Reproducibility:

Occurs every time I attempt to upgrade

Workaround:
None

Impact:
High cannot upgrade environment to install plugin. Plug in has a MOS version requirement.
Lost Fuel Master GUI cannot proceed with installation.

[A (dlaxman92)]

Hello Vitaly,

Thanks for taking a look!

Is there any possible workaround for this? Or will I need to wait for an
MOS update?

On Wed, Mar 1, 2017 at 8:13 AM, Vitaly Sedelnik <email address hidden>
wrote:

> ** Changed in: mos
> Status: New => Confirmed
>
> ** Changed in: mos
> Importance: Undecided => High
>
> ** Changed in: mos
> Assignee: (unassigned) => MOS Maintenance (mos-maintenance)
>
> ** Changed in: mos
> Milestone: None => 9.x-updates
>
> ** Tags added: area-update
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1668293
>
> Title:
> Ansible Fuel Update Fails at cobbler with error code 4
>
> Status in Mirantis OpenStack:
> Confirmed
>
> Bug description:
> See File Attached for Ansible Log
>
> Detailed bug description:
>
> Fuel upgrade fails with the following error:
>
> "Debug: Processing report from fuel.domain.tld with processor
> Puppet::Reports::Store", "The were failures while running task:
> cobbler with exit code: 4"
>
>
> Steps to reproduce:
>
> Fresh install of MOS 9.0
> Update using the 9.2 Doc - https://docs.mirantis.com/
> openstack/fuel/fuel-9.2/release-notes/update-product/
> update-prerequisites-9-2.html
>
> Fuel Master has the following configurations:
>
> /etc/yum.conf
> http_proxy=http://10.122.141.124:3128
>
> /etc/environment
> http_proxy=http://10.122.141.124:3128
>
> /etc/hosts
> 14.2.106.5 fuel.domain.tld fuel
>
> Expected results:
>
> Upgrade to complete as intended
>
> Reproducibility:
>
> Occurs every time I attempt to upgrade
>
> Workaround:
> None
>
> Impact:
> High cannot upgrade environment to install plugin. Plug in has a MOS
> version requirement.
> Lost Fuel Master GUI cannot proceed with installation.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/mos/+bug/1668293/+subscriptions
>

[Anton Chevychalov (achevychalov)]

Could you please provide us a puppet logs from master node.

[A (dlaxman92)]

Puppet Logs

[A (dlaxman92)]

Hello Anton,

Hopefully these log will suffice as I have lost GUI access after attempting
the update. If you require more, please provide the path to logs your
require.

Regards,

On Tue, Mar 14, 2017 at 5:23 AM, Anton Chevychalov <
<email address hidden>> wrote:

> Could you please provide us a puppet logs from master node.
>
> ** Changed in: mos
> Assignee: MOS Maintenance (mos-maintenance) => Anton Chevychalov
> (achevychalov)
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1668293
>
> Title:
> Ansible Fuel Update Fails at cobbler with error code 4
>
> Status in Mirantis OpenStack:
> Confirmed
>
> Bug description:
> See File Attached for Ansible Log
>
> Detailed bug description:
>
> Fuel upgrade fails with the following error:
>
> "Debug: Processing report from fuel.domain.tld with processor
> Puppet::Reports::Store", "The were failures while running task:
> cobbler with exit code: 4"
>
>
> Steps to reproduce:
>
> Fresh install of MOS 9.0
> Update using the 9.2 Doc - https://docs.mirantis.com/
> openstack/fuel/fuel-9.2/release-notes/update-product/
> update-prerequisites-9-2.html
>
> Fuel Master has the following configurations:
>
> /etc/yum.conf
> http_proxy=http://10.122.141.124:3128
>
> /etc/environment
> http_proxy=http://10.122.141.124:3128
>
> /etc/hosts
> 14.2.106.5 fuel.domain.tld fuel
>
> Expected results:
>
> Upgrade to complete as intended
>
> Reproducibility:
>
> Occurs every time I attempt to upgrade
>
> Workaround:
> None
>
> Impact:
> High cannot upgrade environment to install plugin. Plug in has a MOS
> version requirement.
> Lost Fuel Master GUI cannot proceed with installation.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/mos/+bug/1668293/+subscriptions
>

[Anton Chevychalov (achevychalov)]

Please provide /var/log/puppet-error.log /var/log/puppet.log from master node.

[A (dlaxman92)]

Hello Anton,

Those logs do not seem have been generated on my master node.

[root@fuel log]# pwd
/var/log
[root@fuel log]# ls -al
total 41248
drwxr-xr-x. 20 root root 4096 Mar 14 13:32 .
drwxr-xr-x. 22 root root 4096 Feb 27 17:55 ..
-rw-r--r--. 1 root root 373180 Mar 14 13:32 aleccham@14.0.25.248
drwxr-xr-x. 2 root root 4096 Feb 24 03:39 anaconda
drwxr-xr-x. 2 root root 4096 Jan 16 10:29 astute
drwxr-xr-x. 2 root root 4096 Mar 14 03:28 atop
drwx------. 2 root root 4096 Mar 14 02:20 audit
-rw-r--r--. 1 root root 11527 Feb 27 17:56 boot.log
-rw-------. 1 root utmp 4224 Feb 27 17:53 btmp
drwxr-xr-x. 6 root root 4096 Jul 28 2016 cobbler
-rw-------. 1 root root 4477 Feb 24 05:20 cron
-rw-r--r--. 1 root root 2072 Feb 24 03:52 dhcp_checker.log
-rw-r--r--. 1 root root 176335 Feb 27 17:56 dmesg
-rw-r--r--. 1 root root 176125 Feb 26 16:25 dmesg.old
-rw-r-----. 1 nobody root 30919363 Mar 14 15:20 dnsmasq.log
-rw-r--r--. 1 root root 519067 Feb 24 05:32
fuel-bootstrap-image-build.log
-rw-r--r--. 1 root root 23650 Feb 24 03:52 fuelmenu.log
drwxr-xr-x. 2 root root 4096 Nov 14 19:51 glusterfs
-rw-------. 1 root root 2630 Feb 26 15:46 grubby
drwx------. 2 root root 4096 Nov 14 18:05 httpd
drwxr-x---. 2 keystone keystone 4096 Mar 11 03:42 keystone
-rw-r--r--. 1 root root 291416 Mar 14 15:18 lastlog
drwx------. 2 root root 16384 Feb 24 03:19 lost+found
-rw-------. 1 root root 0 Feb 24 03:23 maillog
-rw-r--r--. 1 root root 246227 Mar 14 15:20 mcollective.log
-rw-r--r--. 1 root root 2097323 Mar 14 10:08 mcollective.log.0
-rw-r--r--. 1 root root 2097178 Mar 12 13:51 mcollective.log.1
-rw-r--r--. 1 root root 2097186 Mar 10 17:35 mcollective.log.2
-rw-r--r--. 1 root root 2097313 Mar 8 21:18 mcollective.log.3
-rw-------. 1 root root 403089 Feb 24 05:21 messages
drwxr-xr-x. 2 nailgun root 4096 Mar 14 03:28 nailgun
drwxr-xr-x. 2 root root 4096 Mar 9 21:30 nginx
drwxr-xr-x. 2 ntp ntp 4096 Feb 6 07:34 ntpstats
drwxr-xr-x. 2 root root 4096 Feb 24 05:11 ostf
-rw-r--r--. 1 root root 263038 Feb 27 17:56 ostf.log
drwx------. 2 root root 4096 Jun 10 2014 ppp
drwxr-x---. 2 puppet puppet 4096 Mar 14 13:32 puppet
-rw-r--r--. 1 root root 373180 Mar 14 13:32 Puppet.logs.tgz
drwxr-xr-x. 2 rabbitmq rabbitmq 4096 Aug 22 2016 rabbitmq
drwxr-x---. 5 root root 4096 Feb 24 05:21 remote
drwxr-xr-x. 2 root root 4096 Mar 14 00:00 sa
-rw-------. 1 root root 14300 Feb 24 05:17 secure
-rw-------. 1 root root 0 Feb 24 03:23 spooler
-rw-------. 1 root root 0 Feb 24 03:21 tallylog
-rw-r--r--. 1 root root 104 Feb 24 05:33
url_access_checker.log
-rw-r--r--. 1 root root 40 Feb 24 03:41 wpa_supplicant.log
-rw-rw-r--. 1 root utmp 33408 Mar 14 15:1...

[Anton Chevychalov (achevychalov)]

Ok. In that case please provide cobbler logs.

[A (dlaxman92)]

Cobbler logs

[A (dlaxman92)]

They have been attached.

On Tue, Mar 14, 2017 at 11:37 AM, Anton Chevychalov <
<email address hidden>> wrote:

> Ok. In that case please provide cobbler logs.
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1668293
>
> Title:
> Ansible Fuel Update Fails at cobbler with error code 4
>
> Status in Mirantis OpenStack:
> Confirmed
>
> Bug description:
> See File Attached for Ansible Log
>
> Detailed bug description:
>
> Fuel upgrade fails with the following error:
>
> "Debug: Processing report from fuel.domain.tld with processor
> Puppet::Reports::Store", "The were failures while running task:
> cobbler with exit code: 4"
>
>
> Steps to reproduce:
>
> Fresh install of MOS 9.0
> Update using the 9.2 Doc - https://docs.mirantis.com/
> openstack/fuel/fuel-9.2/release-notes/update-product/
> update-prerequisites-9-2.html
>
> Fuel Master has the following configurations:
>
> /etc/yum.conf
> http_proxy=http://10.122.141.124:3128
>
> /etc/environment
> http_proxy=http://10.122.141.124:3128
>
> /etc/hosts
> 14.2.106.5 fuel.domain.tld fuel
>
> Expected results:
>
> Upgrade to complete as intended
>
> Reproducibility:
>
> Occurs every time I attempt to upgrade
>
> Workaround:
> None
>
> Impact:
> High cannot upgrade environment to install plugin. Plug in has a MOS
> version requirement.
> Lost Fuel Master GUI cannot proceed with installation.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/mos/+bug/1668293/+subscriptions
>

[Anton Chevychalov (achevychalov)]

Something goes wrong with httpd. Could you please issue "/usr/bin/systemctl start httpd" on master?

[A (dlaxman92)]

[root@fuel ~]# /usr/bin/systemctl start httpd
Job for httpd.service failed because the control process exited with error
code. See "systemctl status httpd.service" and "journalctl -xe" for details.
[root@fuel ~]#
[root@fuel ~]# systemctl status httpd.service
● httpd.service - The Apache HTTP Server
   Loaded: loaded (/usr/lib/systemd/system/httpd.service; enabled; vendor
preset: disabled)
  Drop-In: /etc/systemd/system/httpd.service.d
           └─restart.conf
   Active: activating (auto-restart) (Result: exit-code) since Tue
2017-03-14 17:19:41 UTC; 2s ago
     Docs: man:httpd(8)
           man:apachectl(8)
  Process: 7854 ExecStop=/bin/kill -WINCH ${MAINPID} (code=exited,
status=1/FAILURE)
  Process: 7852 ExecStart=/usr/sbin/httpd $OPTIONS -DFOREGROUND
(code=exited, status=1/FAILURE)
 Main PID: 7852 (code=exited, status=1/FAILURE)

Mar 14 17:19:41 fuel systemd[1]: Child 7854 belongs to httpd.service
Mar 14 17:19:41 fuel systemd[1]: httpd.service: control process exited,
cod...=1
Mar 14 17:19:41 fuel systemd[1]: httpd.service got final SIGCHLD for state
stop
Mar 14 17:19:41 fuel systemd[1]: httpd.service changed stop -> failed
Mar 14 17:19:41 fuel systemd[1]: Job httpd.service/start finished,
result=failed
Mar 14 17:19:41 fuel systemd[1]: Failed to start The Apache HTTP Server.
Mar 14 17:19:41 fuel systemd[1]: Unit httpd.service entered failed state.
Mar 14 17:19:41 fuel systemd[1]: httpd.service failed.
Mar 14 17:19:41 fuel systemd[1]: httpd.service changed failed ->
auto-restart
Mar 14 17:19:41 fuel systemd[1]: httpd.service: cgroup is empty
Hint: Some lines were ellipsized, use -l to show in full.
[root@fuel ~]#

On Tue, Mar 14, 2017 at 12:23 PM, Anton Chevychalov <
<email address hidden>> wrote:

> Something goes wrong with httpd. Could you please issue
> "/usr/bin/systemctl start httpd" on master?
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1668293
>
> Title:
> Ansible Fuel Update Fails at cobbler with error code 4
>
> Status in Mirantis OpenStack:
> Confirmed
>
> Bug description:
> See File Attached for Ansible Log
>
> Detailed bug description:
>
> Fuel upgrade fails with the following error:
>
> "Debug: Processing report from fuel.domain.tld with processor
> Puppet::Reports::Store", "The were failures while running task:
> cobbler with exit code: 4"
>
>
> Steps to reproduce:
>
> Fresh install of MOS 9.0
> Update using the 9.2 Doc - https://docs.mirantis.com/
> openstack/fuel/fuel-9.2/release-notes/update-product/
> update-prerequisites-9-2.html
>
> Fuel Master has the following configurations:
>
> /etc/yum.conf
> http_proxy=http://10.122.141.124:3128
>
> /etc/environment
> http_proxy=http://10.122.141.124:3128
>
> /etc/hosts
> 14.2.106.5 fuel.domain.tld fuel
>
> Expected results:
>
> Upgrade to complete as intended
>
> Reproducibility:
>
> Occurs every time I attempt to upgrade
>
> Workaround:
> None
>
> Impact:
> High cannot upgrade environment to install plugin. Plug in has a MOS
> version requirement.
> Lost Fuel Master GUI cannot proceed with installation.
>
> To manage notifications about...

[Anton Chevychalov (achevychalov)]

Seems that for some reason you have zombie http process. Could you please issue "ps -ef | grep http" and send logs from /var/log/httpd

[A (dlaxman92)]

ps -ef | grep http
root 15806 15778 0 13:24 pts/0 00:00:00 grep --color=auto http

On Wed, Mar 15, 2017 at 5:50 AM, Anton Chevychalov <
<email address hidden>> wrote:

> Seems that for some reason you have zombie http process. Could you
> please issue "ps -ef | grep http" and send logs from /var/log/httpd
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1668293
>
> Title:
> Ansible Fuel Update Fails at cobbler with error code 4
>
> Status in Mirantis OpenStack:
> Confirmed
>
> Bug description:
> See File Attached for Ansible Log
>
> Detailed bug description:
>
> Fuel upgrade fails with the following error:
>
> "Debug: Processing report from fuel.domain.tld with processor
> Puppet::Reports::Store", "The were failures while running task:
> cobbler with exit code: 4"
>
>
> Steps to reproduce:
>
> Fresh install of MOS 9.0
> Update using the 9.2 Doc - https://docs.mirantis.com/
> openstack/fuel/fuel-9.2/release-notes/update-product/
> update-prerequisites-9-2.html
>
> Fuel Master has the following configurations:
>
> /etc/yum.conf
> http_proxy=http://10.122.141.124:3128
>
> /etc/environment
> http_proxy=http://10.122.141.124:3128
>
> /etc/hosts
> 14.2.106.5 fuel.domain.tld fuel
>
> Expected results:
>
> Upgrade to complete as intended
>
> Reproducibility:
>
> Occurs every time I attempt to upgrade
>
> Workaround:
> None
>
> Impact:
> High cannot upgrade environment to install plugin. Plug in has a MOS
> version requirement.
> Lost Fuel Master GUI cannot proceed with installation.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/mos/+bug/1668293/+subscriptions
>

[A (dlaxman92)]

Hello Vitaly,

Any progress on the issue?

Regards,

On Wed, Mar 15, 2017 at 9:26 AM, Alec Chamberlain <email address hidden>
wrote:

> ps -ef | grep http
> root 15806 15778 0 13:24 pts/0 00:00:00 grep --color=auto http
>
> On Wed, Mar 15, 2017 at 5:50 AM, Anton Chevychalov <
> <email address hidden>> wrote:
>
>> Seems that for some reason you have zombie http process. Could you
>> please issue "ps -ef | grep http" and send logs from /var/log/httpd
>>
>> --
>> You received this bug notification because you are subscribed to the bug
>> report.
>> https://bugs.launchpad.net/bugs/1668293
>>
>> Title:
>> Ansible Fuel Update Fails at cobbler with error code 4
>>
>> Status in Mirantis OpenStack:
>> Confirmed
>>
>> Bug description:
>> See File Attached for Ansible Log
>>
>> Detailed bug description:
>>
>> Fuel upgrade fails with the following error:
>>
>> "Debug: Processing report from fuel.domain.tld with processor
>> Puppet::Reports::Store", "The were failures while running task:
>> cobbler with exit code: 4"
>>
>>
>> Steps to reproduce:
>>
>> Fresh install of MOS 9.0
>> Update using the 9.2 Doc - https://docs.mirantis.com/open
>> stack/fuel/fuel-9.2/release-notes/update-product/update-
>> prerequisites-9-2.html
>>
>> Fuel Master has the following configurations:
>>
>> /etc/yum.conf
>> http_proxy=http://10.122.141.124:3128
>>
>> /etc/environment
>> http_proxy=http://10.122.141.124:3128
>>
>> /etc/hosts
>> 14.2.106.5 fuel.domain.tld fuel
>>
>> Expected results:
>>
>> Upgrade to complete as intended
>>
>> Reproducibility:
>>
>> Occurs every time I attempt to upgrade
>>
>> Workaround:
>> None
>>
>> Impact:
>> High cannot upgrade environment to install plugin. Plug in has a MOS
>> version requirement.
>> Lost Fuel Master GUI cannot proceed with installation.
>>
>> To manage notifications about this bug go to:
>> https://bugs.launchpad.net/mos/+bug/1668293/+subscriptions
>>
>
>

[Dmitry Teselkin (teselkin-d)]

Could you please show the output of

jounrnalctl -xl -u httpd

[A (dlaxman92)]

Sure I will update shortly with the requested.

On Mon, Mar 27, 2017 at 10:51 AM, Dmitry Teselkin <email address hidden>
wrote:

> Could you please show the output of
>
> jounrnalctl -xl -u httpd
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1668293
>
> Title:
> Ansible Fuel Update Fails at cobbler with error code 4
>
> Status in Mirantis OpenStack:
> Confirmed
>
> Bug description:
> See File Attached for Ansible Log
>
> Detailed bug description:
>
> Fuel upgrade fails with the following error:
>
> "Debug: Processing report from fuel.domain.tld with processor
> Puppet::Reports::Store", "The were failures while running task:
> cobbler with exit code: 4"
>
>
> Steps to reproduce:
>
> Fresh install of MOS 9.0
> Update using the 9.2 Doc - https://docs.mirantis.com/
> openstack/fuel/fuel-9.2/release-notes/update-product/
> update-prerequisites-9-2.html
>
> Fuel Master has the following configurations:
>
> /etc/yum.conf
> http_proxy=http://10.122.141.124:3128
>
> /etc/environment
> http_proxy=http://10.122.141.124:3128
>
> /etc/hosts
> 14.2.106.5 fuel.domain.tld fuel
>
> Expected results:
>
> Upgrade to complete as intended
>
> Reproducibility:
>
> Occurs every time I attempt to upgrade
>
> Workaround:
> None
>
> Impact:
> High cannot upgrade environment to install plugin. Plug in has a MOS
> version requirement.
> Lost Fuel Master GUI cannot proceed with installation.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/mos/+bug/1668293/+subscriptions
>

[A (dlaxman92)]

Please find attached.

On Mon, Mar 27, 2017 at 12:21 PM, Alec Chamberlain <email address hidden>
wrote:

> Sure I will update shortly with the requested.
>
> On Mon, Mar 27, 2017 at 10:51 AM, Dmitry Teselkin <email address hidden>
> wrote:
>
>> Could you please show the output of
>>
>> jounrnalctl -xl -u httpd
>>
>> --
>> You received this bug notification because you are subscribed to the bug
>> report.
>> https://bugs.launchpad.net/bugs/1668293
>>
>> Title:
>> Ansible Fuel Update Fails at cobbler with error code 4
>>
>> Status in Mirantis OpenStack:
>> Confirmed
>>
>> Bug description:
>> See File Attached for Ansible Log
>>
>> Detailed bug description:
>>
>> Fuel upgrade fails with the following error:
>>
>> "Debug: Processing report from fuel.domain.tld with processor
>> Puppet::Reports::Store", "The were failures while running task:
>> cobbler with exit code: 4"
>>
>>
>> Steps to reproduce:
>>
>> Fresh install of MOS 9.0
>> Update using the 9.2 Doc - https://docs.mirantis.com/open
>> stack/fuel/fuel-9.2/release-notes/update-product/update-
>> prerequisites-9-2.html
>>
>> Fuel Master has the following configurations:
>>
>> /etc/yum.conf
>> http_proxy=http://10.122.141.124:3128
>>
>> /etc/environment
>> http_proxy=http://10.122.141.124:3128
>>
>> /etc/hosts
>> 14.2.106.5 fuel.domain.tld fuel
>>
>> Expected results:
>>
>> Upgrade to complete as intended
>>
>> Reproducibility:
>>
>> Occurs every time I attempt to upgrade
>>
>> Workaround:
>> None
>>
>> Impact:
>> High cannot upgrade environment to install plugin. Plug in has a MOS
>> version requirement.
>> Lost Fuel Master GUI cannot proceed with installation.
>>
>> To manage notifications about this bug go to:
>> https://bugs.launchpad.net/mos/+bug/1668293/+subscriptions
>>
>
>

[A (dlaxman92)]

So I had to rebuilt this environment, but still fail when I attempt to
run ansible-playbook
playbooks/update_fuel.yml -e '{"rebuild_bootstrap":false}

New failed log attached.

On Tue, Mar 28, 2017 at 3:59 PM, Alec Chamberlain <email address hidden>
wrote:

> Please find attached.
>
> On Mon, Mar 27, 2017 at 12:21 PM, Alec Chamberlain <email address hidden>
> wrote:
>
>> Sure I will update shortly with the requested.
>>
>> On Mon, Mar 27, 2017 at 10:51 AM, Dmitry Teselkin <<email address hidden>
>> > wrote:
>>
>>> Could you please show the output of
>>>
>>> jounrnalctl -xl -u httpd
>>>
>>> --
>>> You received this bug notification because you are subscribed to the bug
>>> report.
>>> https://bugs.launchpad.net/bugs/1668293
>>>
>>> Title:
>>> Ansible Fuel Update Fails at cobbler with error code 4
>>>
>>> Status in Mirantis OpenStack:
>>> Confirmed
>>>
>>> Bug description:
>>> See File Attached for Ansible Log
>>>
>>> Detailed bug description:
>>>
>>> Fuel upgrade fails with the following error:
>>>
>>> "Debug: Processing report from fuel.domain.tld with processor
>>> Puppet::Reports::Store", "The were failures while running task:
>>> cobbler with exit code: 4"
>>>
>>>
>>> Steps to reproduce:
>>>
>>> Fresh install of MOS 9.0
>>> Update using the 9.2 Doc - https://docs.mirantis.com/open
>>> stack/fuel/fuel-9.2/release-notes/update-product/update-prer
>>> equisites-9-2.html
>>>
>>> Fuel Master has the following configurations:
>>>
>>> /etc/yum.conf
>>> http_proxy=http://10.122.141.124:3128
>>>
>>> /etc/environment
>>> http_proxy=http://10.122.141.124:3128
>>>
>>> /etc/hosts
>>> 14.2.106.5 fuel.domain.tld fuel
>>>
>>> Expected results:
>>>
>>> Upgrade to complete as intended
>>>
>>> Reproducibility:
>>>
>>> Occurs every time I attempt to upgrade
>>>
>>> Workaround:
>>> None
>>>
>>> Impact:
>>> High cannot upgrade environment to install plugin. Plug in has a MOS
>>> version requirement.
>>> Lost Fuel Master GUI cannot proceed with installation.
>>>
>>> To manage notifications about this bug go to:
>>> https://bugs.launchpad.net/mos/+bug/1668293/+subscriptions
>>>
>>
>>
>

[A (dlaxman92)]

I can provide access to the environment if needed.

On Tue, Mar 28, 2017 at 7:02 PM, Alec Chamberlain <email address hidden>
wrote:

> So I had to rebuilt this environment, but still fail when I attempt to run
> ansible-playbook playbooks/update_fuel.yml -e
> '{"rebuild_bootstrap":false}
>
> New failed log attached.
>
>
>
> On Tue, Mar 28, 2017 at 3:59 PM, Alec Chamberlain <email address hidden>
> wrote:
>
>> Please find attached.
>>
>> On Mon, Mar 27, 2017 at 12:21 PM, Alec Chamberlain <email address hidden>
>> wrote:
>>
>>> Sure I will update shortly with the requested.
>>>
>>> On Mon, Mar 27, 2017 at 10:51 AM, Dmitry Teselkin <
>>> <email address hidden>> wrote:
>>>
>>>> Could you please show the output of
>>>>
>>>> jounrnalctl -xl -u httpd
>>>>
>>>> --
>>>> You received this bug notification because you are subscribed to the bug
>>>> report.
>>>> https://bugs.launchpad.net/bugs/1668293
>>>>
>>>> Title:
>>>> Ansible Fuel Update Fails at cobbler with error code 4
>>>>
>>>> Status in Mirantis OpenStack:
>>>> Confirmed
>>>>
>>>> Bug description:
>>>> See File Attached for Ansible Log
>>>>
>>>> Detailed bug description:
>>>>
>>>> Fuel upgrade fails with the following error:
>>>>
>>>> "Debug: Processing report from fuel.domain.tld with processor
>>>> Puppet::Reports::Store", "The were failures while running task:
>>>> cobbler with exit code: 4"
>>>>
>>>>
>>>> Steps to reproduce:
>>>>
>>>> Fresh install of MOS 9.0
>>>> Update using the 9.2 Doc - https://docs.mirantis.com/open
>>>> stack/fuel/fuel-9.2/release-notes/update-product/update-prer
>>>> equisites-9-2.html
>>>>
>>>> Fuel Master has the following configurations:
>>>>
>>>> /etc/yum.conf
>>>> http_proxy=http://10.122.141.124:3128
>>>>
>>>> /etc/environment
>>>> http_proxy=http://10.122.141.124:3128
>>>>
>>>> /etc/hosts
>>>> 14.2.106.5 fuel.domain.tld fuel
>>>>
>>>> Expected results:
>>>>
>>>> Upgrade to complete as intended
>>>>
>>>> Reproducibility:
>>>>
>>>> Occurs every time I attempt to upgrade
>>>>
>>>> Workaround:
>>>> None
>>>>
>>>> Impact:
>>>> High cannot upgrade environment to install plugin. Plug in has a MOS
>>>> version requirement.
>>>> Lost Fuel Master GUI cannot proceed with installation.
>>>>
>>>> To manage notifications about this bug go to:
>>>> https://bugs.launchpad.net/mos/+bug/1668293/+subscriptions
>>>>
>>>
>>>
>>
>

[Dmitry Teselkin (teselkin-d)]

Could you please check apache config by running command below?

/usr/sbin/apachectl configtest

[A (dlaxman92)]

[root@fuel mos_mu]# /usr/sbin/apachectl configtest
[Thu Mar 30 20:12:22.052001 2017] [so:warn] [pid 24593] AH01574: module
ssl_module is already loaded, skipping
Syntax OK
[root@fuel mos_mu]#

On Thu, Mar 30, 2017 at 6:54 AM, Dmitry Teselkin <email address hidden>
wrote:

> Could you please check apache config by running command below?
>
> /usr/sbin/apachectl configtest
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1668293
>
> Title:
> Ansible Fuel Update Fails at cobbler with error code 4
>
> Status in Mirantis OpenStack:
> Confirmed
>
> Bug description:
> See File Attached for Ansible Log
>
> Detailed bug description:
>
> Fuel upgrade fails with the following error:
>
> "Debug: Processing report from fuel.domain.tld with processor
> Puppet::Reports::Store", "The were failures while running task:
> cobbler with exit code: 4"
>
>
> Steps to reproduce:
>
> Fresh install of MOS 9.0
> Update using the 9.2 Doc - https://docs.mirantis.com/
> openstack/fuel/fuel-9.2/release-notes/update-product/
> update-prerequisites-9-2.html
>
> Fuel Master has the following configurations:
>
> /etc/yum.conf
> http_proxy=http://10.122.141.124:3128
>
> /etc/environment
> http_proxy=http://10.122.141.124:3128
>
> /etc/hosts
> 14.2.106.5 fuel.domain.tld fuel
>
> Expected results:
>
> Upgrade to complete as intended
>
> Reproducibility:
>
> Occurs every time I attempt to upgrade
>
> Workaround:
> None
>
> Impact:
> High cannot upgrade environment to install plugin. Plug in has a MOS
> version requirement.
> Lost Fuel Master GUI cannot proceed with installation.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/mos/+bug/1668293/+subscriptions
>