Bug #1396781 “Error in Database Population script for Neutron” : Bugs : openstack-manuals

Revision history for this message

Anne Gentle (annegentle) wrote on 2014-11-27:

#1

Thanks for logging! I don't think we would put this exactly in the Juno version of the guide, but in the master might be what you mean, if the neutron database needs to match on a master install. So for docs it can be published to /trunk/ this way.

Revision history for this message

Anne Gentle (annegentle) wrote on 2014-11-27:

#2

Also isn't this a bug for neutron?

Revision history for this message

Matt Kassawara (ionosphere80) wrote on 2014-11-29:

#3

According to the Juno release code, "juno" is a valid database version.

https://github.com/openstack/neutron/blob/stable/juno/neutron/db/migration/alembic_migrations/versions/juno_release.py

For the Juno release, you want to use the "juno" database version. For trunk (only available using source), you want to use the "HEAD" database version.

Revision history for this message

Matt Kassawara (ionosphere80) wrote on 2014-11-29:

#4

Not a neutron bug.

Changed in openstack-manuals:
status:	New → Incomplete

Revision history for this message

Anne Gentle (annegentle) wrote on 2014-11-29:

#5

Okay Gary, this is documented as it should be in the Juno guide. Typically we won't keep the trunk version of the guide updated as most people are installing a stable version. Matt has done lots of installs and can help you troubleshoot.

no longer affects:	neutron
Changed in openstack-manuals:
status:	Incomplete → Won't Fix

Revision history for this message

Garysday (garysday) wrote on 2014-11-29: Re: [Bug 1396781] Re: Error in Database Population script for Neutron

#6

Anne..

No issues.. But I followed the guide from a week or so back (PDF).. The
first point didn't work.. I.e getting Juno from cloud-archive. (Not without
trusty first) , so following the guide one point by point leaves with many
issues... I had issues with glance, nova and neutron so far.. I managed to
get them fixed but the documentation is clearly missing some points..

I.e. in some places RPC_back end = rabbit just doesn't work and I was
advised to use more convolutes string (which did work) , in neutron using
service_plugins = router didn't work either along with some other ml2
issues etc..

I'm not an expert, But I'm trying to get more skilled in openstack.. I'm
not hopless either I've been in it for 15+ years and can fix most
things.... Anyway should I try to raise additional documentation bugs. I'm
now not sure if im on the trusty distro or the pure Juno release to be
honest..

Cheers

G

On Sat, 29 Nov 2014 23:35 Anne Gentle <email address hidden> wrote:

> Okay Gary, this is documented as it should be in the Juno guide.
> Typically we won't keep the trunk version of the guide updated as most
> people are installing a stable version. Matt has done lots of installs
> and can help you troubleshoot.
>
> ** No longer affects: neutron
>
> ** Changed in: openstack-manuals
> Status: Incomplete => Won't Fix
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1396781
>
> Title:
> Error in Database Population script for Neutron
>
> Status in OpenStack Manuals:
> Won't Fix
>
> Bug description:
> In the 'to finalise installation' section the following script is used
>
> su -s /bin/sh -c "neutron-db-manage --config-file
> /etc/neutron/neutron.conf \
> --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade juno"
> neutron
>
> This reports an error as juno is unknown, to resolve this the script
> should be changed to
>
> su -s /bin/sh -c "neutron-db-manage --config-file
> /etc/neutron/neutron.conf \
> --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head"
> neutron
>
> An explanation should be added saying that 'head' is equivalent to the
> latest trunk release.
>
> -----------------------------------
> Built: 2014-11-26T19:02:57 00:00
> git SHA: 5595fde364e55699d2bf5e7b0aabdf9cdd154f00
> URL: http://docs.openstack.org/juno/install-guide/install/
> apt/content/neutron-controller-node.html
> source File: file:/home/jenkins/workspace/openstack-manuals-tox-doc-
> publishdocs/doc/install-guide/section_neutron-controller-node.xml
> xml:id: neutron-controller-node
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/openstack-manuals/+bug/1396781/+subscriptions
>

Anne..

No issues.. But I followed the guide from a week or so back (PDF).. The
first point didn't work.. I.e getting Juno from cloud-archive. (Not without
trusty first) , so following the guide one point by point leaves with many
issues... I had issues with glance, nova and neutron so far.. I managed to
get them fixed but the documentation is clearly missing some points..

I.e. in some places RPC_back end = rabbit just doesn't work and I was
advised to use more convolutes string (which did work) , in neutron using
service_plugins = router didn't work either along with some other ml2
issues etc..

I'm not an expert, But I'm trying to get more skilled in openstack.. I'm
not hopless either I've been in it for 15+ years and can fix most
things.... Anyway should I try to raise additional documentation bugs. I'm
now not sure if im on the trusty distro or the pure Juno release to be
honest..

Cheers

G

On Sat, 29 Nov 2014 23:35 Anne Gentle <anne@openstack.org> wrote:

> Okay Gary, this is documented as it should be in the Juno guide.
> Typically we won't keep the trunk version of the guide updated as most
> people are installing a stable version. Matt has done lots of installs
> and can help you troubleshoot.
>
> ** No longer affects: neutron
>
> ** Changed in: openstack-manuals
>        Status: Incomplete => Won't Fix
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1396781
>
> Title:
>   Error in Database Population script for Neutron
>
> Status in OpenStack Manuals:
>   Won't Fix
>
> Bug description:
>   In the 'to finalise installation' section the following script is used
>
>    su -s /bin/sh -c "neutron-db-manage --config-file
> /etc/neutron/neutron.conf \
>     --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade juno"
> neutron
>
>   This reports an error as juno is unknown, to resolve this the script
>   should be changed to
>
>    su -s /bin/sh -c "neutron-db-manage --config-file
> /etc/neutron/neutron.conf \
>     --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head"
> neutron
>
>   An explanation should be added saying that 'head' is equivalent to the
>   latest trunk release.
>
>   -----------------------------------
>   Built: 2014-11-26T19:02:57 00:00
>   git SHA: 5595fde364e55699d2bf5e7b0aabdf9cdd154f00
>   URL: http://docs.openstack.org/juno/install-guide/install/
> apt/content/neutron-controller-node.html
>   source File: file:/home/jenkins/workspace/openstack-manuals-tox-doc-
> publishdocs/doc/install-guide/section_neutron-controller-node.xml
>   xml:id: neutron-controller-node
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/openstack-manuals/+bug/1396781/+subscriptions
>

Tom Fifield (fifieldt) on 2014-11-30

Changed in openstack-manuals:
status:	Won't Fix → New

Revision history for this message

Matt Kassawara (ionosphere80) wrote on 2014-11-30:

#7

Are you sure that you're using Juno packages? I have tested the installation guide with Juno dozens of times at this point and have yet to see an issue with using "rpc_backend = rabbit" in the neutron configuration. Also, can you open additional bugs for the other problems you mentioned with glance and nova?

Changed in openstack-manuals:
assignee:	nobody → Matt Kassawara (ionosphere80)
status:	New → Incomplete

Revision history for this message

Anne Gentle (annegentle) wrote on 2014-11-30:

#8

Hi again Gary, I'd really like to get to the bottom of your issues by examining the PDF file you have and where you downloaded it from. We have issues with old documentation laying around and I want to get to the root cause of where you got this PDF. Can you exactly replicate the steps you took to get it and attach the file and paste the link here?

I'm not being defensive, believe me, I want the doc to improve too! But I am afraid we're chasing the wrong "bug" here and I want to see what you're seeing. Thanks!

Revision history for this message

Garysday (garysday) wrote on 2014-11-30:

#9

Anne.

I took the PDF from docs.openstack.org. the Ubuntu guide.

First thing very early on is getting cloud-archive:Juno this didn't work...
Let me try to repeat from my guide on a new machine tonight and post the
results along with some proper cut and pastes of my issues (right now I'm
typing on my phone)..

Cheers

Gary

On Sun, 30 Nov 2014 04:00 Anne Gentle <email address hidden> wrote:

> Hi again Gary, I'd really like to get to the bottom of your issues by
> examining the PDF file you have and where you downloaded it from. We
> have issues with old documentation laying around and I want to get to
> the root cause of where you got this PDF. Can you exactly replicate the
> steps you took to get it and attach the file and paste the link here?
>
> I'm not being defensive, believe me, I want the doc to improve too! But
> I am afraid we're chasing the wrong "bug" here and I want to see what
> you're seeing. Thanks!
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1396781
>
> Title:
> Error in Database Population script for Neutron
>
> Status in OpenStack Manuals:
> Incomplete
>
> Bug description:
> In the 'to finalise installation' section the following script is used
>
> su -s /bin/sh -c "neutron-db-manage --config-file
> /etc/neutron/neutron.conf \
> --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade juno"
> neutron
>
> This reports an error as juno is unknown, to resolve this the script
> should be changed to
>
> su -s /bin/sh -c "neutron-db-manage --config-file
> /etc/neutron/neutron.conf \
> --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head"
> neutron
>
> An explanation should be added saying that 'head' is equivalent to the
> latest trunk release.
>
> -----------------------------------
> Built: 2014-11-26T19:02:57 00:00
> git SHA: 5595fde364e55699d2bf5e7b0aabdf9cdd154f00
> URL: http://docs.openstack.org/juno/install-guide/install/
> apt/content/neutron-controller-node.html
> source File: file:/home/jenkins/workspace/openstack-manuals-tox-doc-
> publishdocs/doc/install-guide/section_neutron-controller-node.xml
> xml:id: neutron-controller-node
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/openstack-manuals/+bug/1396781/+subscriptions
>

Anne.

I took the PDF from docs.openstack.org. the Ubuntu guide.

First thing very early on is getting cloud-archive:Juno this didn't work...
Let me try to repeat from my guide on a new machine tonight and post the
results along with some proper cut and pastes of my issues (right now I'm
typing on my phone)..

Cheers

Gary

On Sun, 30 Nov 2014 04:00 Anne Gentle <anne@openstack.org> wrote:

> Hi again Gary, I'd really like to get to the bottom of your issues by
> examining the PDF file you have and where you downloaded it from. We
> have issues with old documentation laying around and I want to get to
> the root cause of where you got this PDF. Can you exactly replicate the
> steps you took to get it and attach the file and paste the link here?
>
> I'm not being defensive, believe me, I want the doc to improve too! But
> I am afraid we're chasing the wrong "bug" here and I want to see what
> you're seeing. Thanks!
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1396781
>
> Title:
>   Error in Database Population script for Neutron
>
> Status in OpenStack Manuals:
>   Incomplete
>
> Bug description:
>   In the 'to finalise installation' section the following script is used
>
>    su -s /bin/sh -c "neutron-db-manage --config-file
> /etc/neutron/neutron.conf \
>     --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade juno"
> neutron
>
>   This reports an error as juno is unknown, to resolve this the script
>   should be changed to
>
>    su -s /bin/sh -c "neutron-db-manage --config-file
> /etc/neutron/neutron.conf \
>     --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head"
> neutron
>
>   An explanation should be added saying that 'head' is equivalent to the
>   latest trunk release.
>
>   -----------------------------------
>   Built: 2014-11-26T19:02:57 00:00
>   git SHA: 5595fde364e55699d2bf5e7b0aabdf9cdd154f00
>   URL: http://docs.openstack.org/juno/install-guide/install/
> apt/content/neutron-controller-node.html
>   source File: file:/home/jenkins/workspace/openstack-manuals-tox-doc-
> publishdocs/doc/install-guide/section_neutron-controller-node.xml
>   xml:id: neutron-controller-node
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/openstack-manuals/+bug/1396781/+subscriptions
>

Revision history for this message

Matt Kassawara (ionosphere80) wrote on 2014-11-30:

#10

Gary,

A patch fixed the (rather frustrating) cloud-archive:juno problem a few days ago. Ubuntu 14.04 includes Icehouse, so any configuration issues that prevent it from properly using the Juno repository might cause accidental installation of Icehouse packages (2014.1 instead of 2014.2).

Revision history for this message

Matt Kassawara (ionosphere80) wrote on 2014-12-11:

#11

I cannot reproduce this issue on a fresh installation of Juno on Ubuntu 14.04.

Changed in openstack-manuals:
status:	Incomplete → Invalid

Revision history for this message

Garysday (garysday) wrote on 2014-12-11:

#12

Matt..

To be honest me either, to be honest with my original install I was having
issues with every component install I started again with a fresh Juno
install and the latest documentation and all is good.. I wonder if I had a
buggy dev build or something else.. the last major issue I had was nova
using null credentials on the compute node even though the e configuration
was verified to be good.. so I said let's try again and it's been smooth
sailing all the way up to cinder installation which I will take today..

Cheers

Gary

On Thu, 11 Dec 2014 02:06 Matt Kassawara <email address hidden> wrote:

> I cannot reproduce this issue on a fresh installation of Juno on Ubuntu
> 14.04.
>
> ** Changed in: openstack-manuals
> Status: Incomplete => Invalid
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1396781
>
> Title:
> Error in Database Population script for Neutron
>
> Status in OpenStack Manuals:
> Invalid
>
> Bug description:
> In the 'to finalise installation' section the following script is used
>
> su -s /bin/sh -c "neutron-db-manage --config-file
> /etc/neutron/neutron.conf \
> --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade juno"
> neutron
>
> This reports an error as juno is unknown, to resolve this the script
> should be changed to
>
> su -s /bin/sh -c "neutron-db-manage --config-file
> /etc/neutron/neutron.conf \
> --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head"
> neutron
>
> An explanation should be added saying that 'head' is equivalent to the
> latest trunk release.
>
> -----------------------------------
> Built: 2014-11-26T19:02:57 00:00
> git SHA: 5595fde364e55699d2bf5e7b0aabdf9cdd154f00
> URL: http://docs.openstack.org/juno/install-guide/install/
> apt/content/neutron-controller-node.html
> source File: file:/home/jenkins/workspace/openstack-manuals-tox-doc-
> publishdocs/doc/install-guide/section_neutron-controller-node.xml
> xml:id: neutron-controller-node
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/openstack-manuals/+bug/1396781/+subscriptions
>

Matt..

To be honest me either,  to be honest with my original install I was having
issues with every component install  I started again with a fresh Juno
install and  the latest documentation and all is good.. I wonder if I had a
buggy dev build or something else..  the last major issue I had was nova
using null credentials on the compute node even though the e configuration
was verified to be good.. so I said let's try again and it's been smooth
sailing all the way up to cinder installation which I will take today..

Cheers

Gary

On Thu, 11 Dec 2014 02:06 Matt Kassawara <mkassawara@gmail.com> wrote:

> I cannot reproduce this issue on a fresh installation of Juno on Ubuntu
> 14.04.
>
> ** Changed in: openstack-manuals
>        Status: Incomplete => Invalid
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1396781
>
> Title:
>   Error in Database Population script for Neutron
>
> Status in OpenStack Manuals:
>   Invalid
>
> Bug description:
>   In the 'to finalise installation' section the following script is used
>
>    su -s /bin/sh -c "neutron-db-manage --config-file
> /etc/neutron/neutron.conf \
>     --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade juno"
> neutron
>
>   This reports an error as juno is unknown, to resolve this the script
>   should be changed to
>
>    su -s /bin/sh -c "neutron-db-manage --config-file
> /etc/neutron/neutron.conf \
>     --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head"
> neutron
>
>   An explanation should be added saying that 'head' is equivalent to the
>   latest trunk release.
>
>   -----------------------------------
>   Built: 2014-11-26T19:02:57 00:00
>   git SHA: 5595fde364e55699d2bf5e7b0aabdf9cdd154f00
>   URL: http://docs.openstack.org/juno/install-guide/install/
> apt/content/neutron-controller-node.html
>   source File: file:/home/jenkins/workspace/openstack-manuals-tox-doc-
> publishdocs/doc/install-guide/section_neutron-controller-node.xml
>   xml:id: neutron-controller-node
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/openstack-manuals/+bug/1396781/+subscriptions
>

Revision history for this message

Matt Kassawara (ionosphere80) wrote on 2014-12-11:

#13

Your issues sound a lot like what might happen if you tried using the Juno installation guide with Icehouse packages.

Revision history for this message

amirali (amiralishafigh) wrote on 2015-09-08:

#14

hey all
it seems that error rises from upgrade to juno and conversion of itmes in DB
these are some log files from /var/log/neutron of me

root@controller:~# tail /var/log/neutron/neutron-server.log
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher context)
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher cursor.execute(statement, parameters)
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/MySQLdb/cursors.py", line 174, in execute
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher self.errorhandler(self, exc, value)
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 36, in defaulterrorhandler
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher raise errorclass, errorvalue
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher OperationalError: (_mysql_exceptions.OperationalError) (1054, "Unknown column 'agents.load' in 'field list'") [SQL: u'SELECT agents.id AS agents_id, agents.agent_type AS agents_agent_type, agents.`binary` AS agents_binary, agents.topic AS agents_topic, agents.host AS agents_host, agents.admin_state_up AS agents_admin_state_up, agents.created_at AS agents_created_at, agents.started_at AS agents_started_at, agents.heartbeat_timestamp AS agents_heartbeat_timestamp, agents.description AS agents_description, agents.configurations AS agents_configurations, agents.`load` AS agents_load \nFROM agents \nWHERE agents.agent_type = %s AND agents.host = %s'] [parameters: ('Metadata agent', 'network1')]
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher

hey all
it seems that error rises from upgrade to juno and conversion of itmes in DB 
these are some log files from /var/log/neutron of me

root@controller:~# tail /var/log/neutron/neutron-server.log
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher     context)
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher     cursor.execute(statement, parameters)
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/MySQLdb/cursors.py", line 174, in execute
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher     self.errorhandler(self, exc, value)
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 36, in defaulterrorhandler
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher     raise errorclass, errorvalue
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher OperationalError: (_mysql_exceptions.OperationalError) (1054, "Unknown column 'agents.load' in 'field list'") [SQL: u'SELECT agents.id AS agents_id, agents.agent_type AS agents_agent_type, agents.`binary` AS agents_binary, agents.topic AS agents_topic, agents.host AS agents_host, agents.admin_state_up AS agents_admin_state_up, agents.created_at AS agents_created_at, agents.started_at AS agents_started_at, agents.heartbeat_timestamp AS agents_heartbeat_timestamp, agents.description AS agents_description, agents.configurations AS agents_configurations, agents.`load` AS agents_load \nFROM agents \nWHERE agents.agent_type = %s AND agents.host = %s'] [parameters: ('Metadata agent', 'network1')]
2015-08-02 19:43:44.896 1806 ERROR oslo_messaging.rpc.dispatcher

openstack-manuals

Error in Database Population script for Neutron

Bug Description

Other bug subscribers

Remote bug watches