version tracker tool should pull versions from openstack/releases repo

[Martin André]

Right now it picks the versions from tarballs.openstack.org which has 2 issues:
* if forces us to maintain the major version number for each project
* it parses HTML to find the latest version

We should get the latest versions from https://github.com/openstack/releases instead that provides easily consumable yaml files with all versions per project per release.

[Rodolfo Alonso (rodolfo-alonso-hernandez)]

Hello Martin. Where exactly in releases.openstack.org can we retrieve the latest versions?

Because in the web page you have a list of releases (OpenStack releases) and then, in each page, a list of project releases (pointing to the tarballs).

Please, can you guide me?

[Jeff Peeler (jpeeler-z)]

It's under "most recent version" - http://releases.openstack.org/liberty/index.html.

[Rodolfo Alonso (rodolfo-alonso-hernandez)]

So what you are proposing is to parse the web page? Should be easier to have a text file, or a sql query.

Parsing the content of a web page is not a good solution.

[Jeffrey Zhang (jeffrey4l)]

parse the web page will help us get the latest release version. No other action need be taken.

If we use text file or sql query, where is it come from?

[Martin André (mandre)]

BTW, scrapping the web page is exactly what we're doing right now. I don't know where else we can get a list of all the latest releases in a format that we can consume easily.

[Rodolfo Alonso (rodolfo-alonso-hernandez)]

Maybe we can ask people maintaining this web page to generate a json file with this content:
    release:
        project_name: {version: " ", etc: " "}
        project_name2: ...

But, of course, to parse the web page is feasible.

[Jeffrey Zhang (jeffrey4l)]

this script is help use to maintain this kinda of list, now. we can
not do the copy/paste job manually.

On 3/9/16, Rodolfo Alonso <email address hidden> wrote:
> Maybe we can ask people maintaining this web page to generate a json file
> with this content:
> release:
> project_name: {version: " ", etc: " "}
> project_name2: ...
>
> But, of course, to parse the web page is feasible.
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1554337
>
> Title:
> version tracker tool should pull versions from releases.openstack.org
>
> Status in kolla:
> Triaged
>
> Bug description:
> Right now it picks the versions from tarballs.openstack.org which has 2
> issues:
> * if forces us to maintain the major version number for each project
> * it causes an HTTP query for each project
>
> We should get the latest versions from releases.openstack.org instead.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/kolla/+bug/1554337/+subscriptions
>

--
Jeffrey Zhang
Blog: http://xcodest.me

[Rodolfo Alonso (rodolfo-alonso-hernandez)]

Sorry for being so insistent. I think there is a good place to retrieve all this information:
- This information is daily updated.
- This is the unique source of common information for all projects.
- All information is structured and written in yaml.

https://github.com/openstack/releases
https://github.com/openstack/releases/tree/master/deliverables

What do you think?

[Jeffrey Zhang (jeffrey4l)]

cool, this is a better place to retrieve version info.

[Martin André (mandre)]

Rodolpho, please continue to be insistent, that's how we're going to improve things.

I've updated the issue description, thanks for the suggestion.

[Sam Yaple (s8m)]

Hey i didnt see this bug. I have recently merged changes to allow it to dynamically pull projects lists based on what we build in Kolla. This includes looking up the major series number as well.

Is that enough to resolve this bug? https://review.openstack.org/#/c/295057/

[Jeffrey Zhang (jeffrey4l)]

Sam, this bug tend to use the repo https://github.com/openstack/releases/tree/master/deliverables/mitaka as the source to get the latest version instead of html source.

In this way, it will be faster(just clone a repo is enought, rather than get several html page, which is slow) and stable.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/432300
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=ffbc25c1d2f67bbbe80909629f02b0eeb19d5ef5
Submitter: Jenkins
Branch: master

commit ffbc25c1d2f67bbbe80909629f02b0eeb19d5ef5
Author: Jeffrey Zhang <email address hidden>
Date: Fri Feb 10 11:39:14 2017 +0800

    Get OpenStack service versions from openstack/releases repo

    In old implementation, version-check always get the latest versions
    rather than versions for certain release. it is useless for stable
    branch. And it parses from tarballs.openstack.org site, which is
    very slow.

    In this new implementation, version-check gets versions from
    openstack/releases repo, which is faster and accurate. It also support
    get versions for certain OpenStack release. For example, get the Ocata
    latest release version.

    ./verion-check.py --openstack-release ocata

    Closes-Bug: #1554337
    Change-Id: Ie8951625817d82f38cf820cf9bd44ae447e2eb75

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla 5.0.0.0b3 development milestone.