sitemap does not include translated API guides

[Andreas Jaeger]

I just regenerated the sitemap for developer.openstack.org and noticed that the translated API Guides (quick start) are not in the sitemap. Those are currently not in an index page on developer.openstack.org, they are only linked from docs.openstack.org

[Anne Gentle (annegentle)]

Wondering if there's anything in the robots.txt file, but it's just this, so this looks okay to me:

# openstack-manuals/www/robots.txt
User-agent: Googlebot
Disallow: /*.pdf$

# Keep OpenStack users from accidentally using docs for the upcoming release
User-agent: *
Disallow: /draft/

We can certainly link from index.html, looks like it needs changing to the new RST-built one anyway.

[Christian Berendt (berendt)]

We cann add a list of start URLs to the spider that should be used as starting point. At the moment this is only developer.openstack.org. Andreas, can you please provide a list of additional URLs that should be used? I will have a look on the spider implementation we are using and document how to use additional start URLs.

[Andreas Jaeger (jaegerandi)]

http://docs.openstack.org/de/ links to the GErman API Guide, some for Japanese. Korean will follow.

URL:
http://developer.openstack.org/de/api-guide/quick-start/

Anne, we could also add "translated" index pages to developer.openstack.org like we do for docs.openstack.org.

[Anne Gentle (annegentle)]

Ah, I hadn't realized there were some translations for API docs started. I think it's a good idea to add translated index pages to developer.openstack.org.

[Andreas Jaeger (jaegerandi)]

This has been fixed now