Launchpad itself

snap builds randomly failing via proxy

Bug #2057771 reported by Alan Pope 🍺🐧🐱 🦄 on 2024-03-13

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	Launchpad itself	New	Undecided	Unassigned

Bug Description

I'm trying to build amd64,armhf,arm64 snaps of forgejo, using the yaml at https://codeberg.org/forgejo-contrib/snap using snapcraft remote-build

It kept failing with errors connecting to the npm registry.

So I added the following to the override-build stanza in the yaml:

+
+ # Setup proxy access if required.
+ if [[ -n "${http_proxy:-}" ]]; then
+ export HTTP_PROXY="${http_proxy}"
+ export HTTPS_PROXY="${https_proxy}"
+ npm config set proxy "${http_proxy}"
+ npm config set https-proxy "${https_proxy}"
+ fi
+

However, it's now failing inconsistently. Sometimes it will work on one architecture and fail on another or fail on all three. It's seemingly random.

Here's the log of it failing most recently.

https://launchpadlibrarian.net/719122167/buildlog_snap_ubuntu_jammy_armhf_snapcraft-forgejo-1ad726ec7fd27ef347bb79e64066f66c_BUILDING.txt.gz

Here's a snippet:

```
[13/Mar/2024:11:25:02 +0000] "CONNECT registry.npmjs.org:443 HTTP/1.1" 200 10142 "-" "npm/10.2.4 node/v18.19.1 linux arm workspaces/false"
[13/Mar/2024:11:25:02 +0000] "CONNECT registry.npmjs.org:443 HTTP/1.1" 200 6375 "-" "npm/10.2.4 node/v18.19.1 linux arm workspaces/false"
[13/Mar/2024:11:25:02 +0000] "CONNECT registry.npmjs.org:443 HTTP/1.1" 200 6164 "-" "npm/10.2.4 node/v18.19.1 linux arm workspaces/false"
[13/Mar/2024:11:25:02 +0000] "CONNECT registry.npmjs.org:443 HTTP/1.1" 200 45089 "-" "npm/10.2.4 node/v18.19.1 linux arm workspaces/false"
:: npm ERR! Proxy connection ended before receiving CONNECT response
::
:: npm ERR! A complete log of this run can be found in: /root/.npm/_logs/2024-03-13T11_24_42_677Z-debug-0.log
:: make[1]: *** [Makefile:949: node_modules] Error 1
:: make: *** [Makefile:989: public/assets/js/index.js] Error 2
[13/Mar/2024:11:25:02 +0000] "CONNECT registry.npmjs.org:443 HTTP/1.1" 200 71514 "-" "npm/10.2.4 node/v18.19.1 linux arm workspaces/false"
[13/Mar/2024:11:25:02 +0000] "CONNECT registry.npmjs.org:443 HTTP/1.1" 200 51562 "-" "npm/10.2.4 node/v18.19.1 linux arm workspaces/false"
[13/Mar/2024:11:25:02 +0000] "CONNECT registry.npmjs.org:443 HTTP/1.1" 200 34537 "-" "npm/10.2.4 node/v18.19.1 linux arm workspaces/false"
'override-build' in part 'forgejo' failed with code 2.
Review the scriptlet and make sure it's correct.
```

See original description

Alan Pope 🍺🐧🐱 🦄 (popey) on 2024-03-13

description:

updated

Jürgen Gmach (jugmac00) on 2024-03-13

affects:

rutabaga → launchpad

Revision history for this message

Jürgen Gmach (jugmac00) wrote on 2024-03-13:

Hi Alan,

Thanks for reaching out. We had a couple of similar reports lately, but there it was about builds taking more than 6 hours and the proxy token expired, which does not seem to be the case here.

Do you see the same issues when building the Snap locally?

Revision history for this message

Alan Pope 🍺🐧🐱 🦄 (popey) wrote on 2024-03-13:

Hi. Thanks for the quick response.

Works fine every time locally. Only fails when doing remote build in launchpad. The fact it's inconsistent is weird too. I ran the same remote-build three times in a row and got different results each time. One time, amd64 worked, armhf and arm64 failed, another time I got an arm64 build and another build got me the armhf build. I don't seem to be able to get all three to work together.

Revision history for this message

Alan Pope 🍺🐧🐱 🦄 (popey) wrote on 2024-04-04:

I'm seeing the issue again tonight. I triggered three builds across all three architectures in succession. It seems random.

Build set one:

✖ - amd64 https://launchpad.net/~popey/forgejo-snap/+snap/forgejo-snap/+build/2441706
✔ - armhf https://launchpad.net/~popey/forgejo-snap/+snap/forgejo-snap/+build/2441705
✖ - arm64 https://launchpad.net/~popey/forgejo-snap/+snap/forgejo-snap/+build/2441707