Translation download not working

[Patrick Chevalley]

It is not possible to download translation for a project.

After I click Download the confirmation page show:
"There are 4335 file requests on the export queue. The backlog is approximately 28 hours."

Even after waiting for days I still not receive the message with the download link.

[Jürgen Gmach (jugmac00)]

This bug report was created as advised on https://answers.launchpad.net/launchpad/+question/703938

[Nico Stumpf (stumpf)]

I can confirm a similar behaviour for me:

"Your request has been received. Expect to receive an email shortly." is stated after requesting a translation download. I did not yet receive an email, although the first request was yesterday morning.

[Colin Watson (cjwatson)]

OK, so, after a couple of unsuccessful attempts to improve this situation by tweaking timeouts, I investigated further.

Since this problem appeared to be a timeout uploading to the librarian, and since I recently changed Launchpad's internal librarian client to have a timeout when it previously didn't (to improve system resiliency against network outages), I naturally assumed the problems were related. They were, but not as strongly as I'd thought.

I deployed the timeout change at 2022-11-25T14:47:25Z (that's when the overall deployment completed; it will have been effective on the particular unit running translation exports a little earlier than that). _Entirely coincidentally_, at 2022-11-25T15:55:31Z, a user made an export request for an entire project series, encompassing 4108 files in total. Since then, that request has been sitting at the head of the queue and repeatedly failing. If an export fails, then we normally notify the user and carry on; however, if the export succeeds but uploading the resulting file fails, then we crash. That's not great.

My inclination is to make upload failures notify the user and move on with the next request, just as export failures do. It may also be worth restricting who can make project series export requests, as opposed to requests to export individual templates etc.

[Colin Watson (cjwatson)]

We've changed the exporter so that it makes progress even in the case of a librarian upload failure, and it's now working its way through the backlog.

[Patrick Chevalley (pch)]

Thank you very much!

I confirm I receive the message for the two translation I asked a download.

[Patrick Chevalley (pch)]

I successfully upload an updated template but the download fail:

Hello Patrick Chevalley,

Launchpad encountered problems exporting the files you requested.
The Launchpad Translations team has been notified of this problem.
Please reply to this email for further assistance.

If you want to retry your request, you can do so at

  https://translations.launchpad.net/ccdciel/trunk/+export.

--
Automatic message from Launchpad.net.

[Colin Watson (cjwatson)]

Try exporting the two templates in that project separately and see if that helps?

[Patrick Chevalley (pch)]

I try to export the template separately.
This work for ccdciel-hints and I can download the file.
But I get the same error message for the ccdciel template and also for the unique template of the skychart project.

This is not big download, ccdciel translation tar is 366K, skychart is 1.3M.

[Clement Lefebvre (clementlefebvre)]

Hi,

I still get the same error as yesterday when trying to download POs from https://translations.launchpad.net/linuxmint/latest/+export.

Launchpad encountered problems exporting the files you requested.
The Launchpad Translations team has been notified of this problem.
Please reply to this email for further assistance.

[Clement Lefebvre (clementlefebvre)]

Confirmed. We've got 45 templates here.

Downloading just one of them (mintinstall) worked.
Downloading the series continues to fail.

Shall I open a different bug report? This one seems to be about individual templates.

[Clement Lefebvre (clementlefebvre)]

Ah no it fails on single templates also.. it must depend on the size of the translations. I can't download translations for https://translations.launchpad.net/linuxmint/latest/+pots/cinnamon/+export.

[Colin Watson (cjwatson)]

We've moved the relevant job to a machine in the same datacentre as the librarian, which seems to have helped somewhat, although I've seen one similar failure afterwards so I know it hasn't fixed everything. Nevertheless, it may be worth trying again.

[Clement Lefebvre (clementlefebvre)]

Hi Colin,

Attempts are still failing this morning. Both for the series and for many of the individual templates:

- xviewer
- xreader
- xed

just failed a few minutes ago.

[Clement Lefebvre (clementlefebvre)]

Downloading translations for 1 template in only 11 languages doesn't even work right now.

xviewer, PO downloads for:

Brazilian Portuguese
Danish
Dutch
Finnish
French
German
Italian
Polish
Portuguese
Spanish
Swedish

Fails.

[Patrick Chevalley (pch)]

I try to export again my projects Skychart and CCDciel and both failed.

[DURAND Gérard (gd-on)]

This bug has been signaled one month ago and is still not solved ? Really ?
I have myself tried to download a french or spanish translation (.po file) since several days without success, from https://translations.launchpad.net/codeblocks-gd.

[Brian Wenzky (marcomes)]

We are unable to download any translation, even a single language

[Colin Watson (cjwatson)]

Further work on this is in https://bugs.launchpad.net/launchpad/+bug/1998616 - no need to continue commenting on this bug.