Launchpad itself

  1. Bug #2024181
  2. Activity log

Activity log for bug #2024181

Date Who What changed Old value New value Message
2023-06-16 12:08:04 Nathan Teodosio bug added bug
2023-06-26 06:56:34 Nathan Teodosio description Pull phases from third-parties (i.e. non-archive) very often fail on ARM Launchpad builders. I don’t have the exact numbers but that is certainly around 50% of the builds. Occasionally the builds fails without logs, and more rarely they are restarted without any intervention — the logs are wiped anew, but the build time isn't reset when this happens. These last cases don't really allow me to affirm it was a connectivity issue though, and I am just mentioning it for what it's worth. I observe this problem for more than one year already; It requires me to open the failure log and see if it was connection failure, then retry it if yes. Example errors are: ---> Downloading 'chromium-114.0.5735.90.tar.xz' 0% Sorry, an error occurred in Snapcraft: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) <--- ---> Cloning into '/build/chromium/parts/chromium/build/third_party/llvm'... error: RPC failed; curl 56 GnuTLS recv error (-54): Error in the pull function. <--- ---> Running git clone https://chromium.googlesource.com/external/github.com/llvm/llvm-project /build/chromium/parts/chromium/build/third_party/llvm Cloning into '/build/chromium/parts/chromium/build/third_party/llvm'... error: RPC failed; curl 56 GnuTLS recv error (-110): The TLS connection was non-properly terminated. fatal: the remote end hung up unexpectedly fatal: early EOF fatal: index-pack failed Failed. CheckoutGitRepo failed. <--- The 49 KiB logs in https://launchpad.net/~nteodosio/+snap/arm-fix-buildgn or the small logs in https://launchpad.net/~nteodosio/+snap/arm-dont-optimize are some more examples. Pull phases from third-parties (i.e. non-archive) very often fail on ARM Launchpad builders. I don’t have the exact numbers but that is certainly around 50% of the builds. Occasionally the builds fails without logs, and more rarely they are restarted without any intervention — the logs are wiped anew, but the build time isn't reset when this happens. These last cases don't really allow me to affirm it was a connectivity issue though, and I am just mentioning it for what it's worth. I observe this problem for more than one year already; It requires me to open the failure log and see if it was connection failure, then retry it if yes. Example errors are: ---> Downloading 'chromium-114.0.5735.90.tar.xz' 0% Sorry, an error occurred in Snapcraft: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) <--- ---> Cloning into '/build/chromium/parts/chromium/build/third_party/llvm'... error: RPC failed; curl 56 GnuTLS recv error (-54): Error in the pull function. <--- ---> Running git clone https://chromium.googlesource.com/external/github.com/llvm/llvm-project /build/chromium/parts/chromium/build/third_party/llvm Cloning into '/build/chromium/parts/chromium/build/third_party/llvm'... error: RPC failed; curl 56 GnuTLS recv error (-110): The TLS connection was non-properly terminated. fatal: the remote end hung up unexpectedly fatal: early EOF fatal: index-pack failed Failed. CheckoutGitRepo failed. <--- ---> 2023-06-26 06:49:24 (140 KB/s) - Connection closed at byte 5501411. Retrying. --2023-06-26 06:49:25-- (try: 2) https://nodejs.org/dist/v16.13.0/node-v16.13.0-linux-arm64.tar.gz Connecting to 10.10.10.1:8222... connected. OpenSSL: error:0A000126:SSL routines::unexpected eof while reading Unable to establish SSL connection. <--- The 49 KiB logs in https://launchpad.net/~nteodosio/+snap/arm-fix-buildgn or the small logs in https://launchpad.net/~nteodosio/+snap/arm-dont-optimize are some more examples.
2023-06-28 13:13:25 Ines Almeida bug added subscriber Ines Almeida
2023-07-18 09:12:00 Nathan Teodosio description Pull phases from third-parties (i.e. non-archive) very often fail on ARM Launchpad builders. I don’t have the exact numbers but that is certainly around 50% of the builds. Occasionally the builds fails without logs, and more rarely they are restarted without any intervention — the logs are wiped anew, but the build time isn't reset when this happens. These last cases don't really allow me to affirm it was a connectivity issue though, and I am just mentioning it for what it's worth. I observe this problem for more than one year already; It requires me to open the failure log and see if it was connection failure, then retry it if yes. Example errors are: ---> Downloading 'chromium-114.0.5735.90.tar.xz' 0% Sorry, an error occurred in Snapcraft: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) <--- ---> Cloning into '/build/chromium/parts/chromium/build/third_party/llvm'... error: RPC failed; curl 56 GnuTLS recv error (-54): Error in the pull function. <--- ---> Running git clone https://chromium.googlesource.com/external/github.com/llvm/llvm-project /build/chromium/parts/chromium/build/third_party/llvm Cloning into '/build/chromium/parts/chromium/build/third_party/llvm'... error: RPC failed; curl 56 GnuTLS recv error (-110): The TLS connection was non-properly terminated. fatal: the remote end hung up unexpectedly fatal: early EOF fatal: index-pack failed Failed. CheckoutGitRepo failed. <--- ---> 2023-06-26 06:49:24 (140 KB/s) - Connection closed at byte 5501411. Retrying. --2023-06-26 06:49:25-- (try: 2) https://nodejs.org/dist/v16.13.0/node-v16.13.0-linux-arm64.tar.gz Connecting to 10.10.10.1:8222... connected. OpenSSL: error:0A000126:SSL routines::unexpected eof while reading Unable to establish SSL connection. <--- The 49 KiB logs in https://launchpad.net/~nteodosio/+snap/arm-fix-buildgn or the small logs in https://launchpad.net/~nteodosio/+snap/arm-dont-optimize are some more examples. Pull phases from third-parties (i.e. non-archive) very often fail on ARM Launchpad builders. I don’t have the exact numbers but that is certainly around 50% of the builds. Occasionally the builds fails without logs, and more rarely they are restarted without any intervention — the logs are wiped anew, but the build time isn't reset when this happens. These last cases don't really allow me to affirm it was a connectivity issue though, and I am just mentioning it for what it's worth. I observe this problem for more than one year already; It requires me to open the failure log and see if it was connection failure, then retry it if yes. Example errors are: ---> Downloading 'chromium-114.0.5735.90.tar.xz' 0% Sorry, an error occurred in Snapcraft: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) <--- ---> Cloning into '/build/chromium/parts/chromium/build/third_party/llvm'... error: RPC failed; curl 56 GnuTLS recv error (-54): Error in the pull function. <--- ---> Running git clone https://chromium.googlesource.com/external/github.com/llvm/llvm-project /build/chromium/parts/chromium/build/third_party/llvm Cloning into '/build/chromium/parts/chromium/build/third_party/llvm'... error: RPC failed; curl 56 GnuTLS recv error (-110): The TLS connection was non-properly terminated. fatal: the remote end hung up unexpectedly fatal: early EOF fatal: index-pack failed Failed. CheckoutGitRepo failed. <--- ---> 2023-06-26 06:49:24 (140 KB/s) - Connection closed at byte 5501411. Retrying. --2023-06-26 06:49:25-- (try: 2) https://nodejs.org/dist/v16.13.0/node-v16.13.0-linux-arm64.tar.gz Connecting to 10.10.10.1:8222... connected. OpenSSL: error:0A000126:SSL routines::unexpected eof while reading Unable to establish SSL connection. <--- ---> Failed to fetch package: The item '/root/.cache/snapcraft/download/libopus0_1.3.1-0.1build2_arm64.deb' could not be fetched: 407 Proxy Authentication Required [IP: 10.10.10.1 8222]. <--- The 49 KiB logs in https://launchpad.net/~nteodosio/+snap/arm-fix-buildgn or the small logs in https://launchpad.net/~nteodosio/+snap/arm-dont-optimize are some more examples.
2023-10-27 06:43:55 Nathan Teodosio description Pull phases from third-parties (i.e. non-archive) very often fail on ARM Launchpad builders. I don’t have the exact numbers but that is certainly around 50% of the builds. Occasionally the builds fails without logs, and more rarely they are restarted without any intervention — the logs are wiped anew, but the build time isn't reset when this happens. These last cases don't really allow me to affirm it was a connectivity issue though, and I am just mentioning it for what it's worth. I observe this problem for more than one year already; It requires me to open the failure log and see if it was connection failure, then retry it if yes. Example errors are: ---> Downloading 'chromium-114.0.5735.90.tar.xz' 0% Sorry, an error occurred in Snapcraft: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) <--- ---> Cloning into '/build/chromium/parts/chromium/build/third_party/llvm'... error: RPC failed; curl 56 GnuTLS recv error (-54): Error in the pull function. <--- ---> Running git clone https://chromium.googlesource.com/external/github.com/llvm/llvm-project /build/chromium/parts/chromium/build/third_party/llvm Cloning into '/build/chromium/parts/chromium/build/third_party/llvm'... error: RPC failed; curl 56 GnuTLS recv error (-110): The TLS connection was non-properly terminated. fatal: the remote end hung up unexpectedly fatal: early EOF fatal: index-pack failed Failed. CheckoutGitRepo failed. <--- ---> 2023-06-26 06:49:24 (140 KB/s) - Connection closed at byte 5501411. Retrying. --2023-06-26 06:49:25-- (try: 2) https://nodejs.org/dist/v16.13.0/node-v16.13.0-linux-arm64.tar.gz Connecting to 10.10.10.1:8222... connected. OpenSSL: error:0A000126:SSL routines::unexpected eof while reading Unable to establish SSL connection. <--- ---> Failed to fetch package: The item '/root/.cache/snapcraft/download/libopus0_1.3.1-0.1build2_arm64.deb' could not be fetched: 407 Proxy Authentication Required [IP: 10.10.10.1 8222]. <--- The 49 KiB logs in https://launchpad.net/~nteodosio/+snap/arm-fix-buildgn or the small logs in https://launchpad.net/~nteodosio/+snap/arm-dont-optimize are some more examples. Pull phases from third-parties (i.e. non-archive) very often fail on ARM Launchpad builders. I don’t have the exact numbers but that is certainly around 50% of the builds. Occasionally the builds fails without logs, and more rarely they are restarted without any intervention — the logs are wiped anew, but the build time isn't reset when this happens. These last cases don't really allow me to affirm it was a connectivity issue though, and I am just mentioning it for what it's worth. I observe this problem for more than one year already; It requires me to open the failure log and see if it was connection failure, then retry it if yes. Example errors are: ---> Downloading 'chromium-114.0.5735.90.tar.xz' 0% Sorry, an error occurred in Snapcraft: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) <--- ---> Cloning into '/build/chromium/parts/chromium/build/third_party/llvm'... error: RPC failed; curl 56 GnuTLS recv error (-54): Error in the pull function. <--- ---> Running git clone https://chromium.googlesource.com/external/github.com/llvm/llvm-project /build/chromium/parts/chromium/build/third_party/llvm Cloning into '/build/chromium/parts/chromium/build/third_party/llvm'... error: RPC failed; curl 56 GnuTLS recv error (-110): The TLS connection was non-properly terminated. fatal: the remote end hung up unexpectedly fatal: early EOF fatal: index-pack failed Failed. CheckoutGitRepo failed. <--- ---> 2023-06-26 06:49:24 (140 KB/s) - Connection closed at byte 5501411. Retrying. --2023-06-26 06:49:25-- (try: 2) https://nodejs.org/dist/v16.13.0/node-v16.13.0-linux-arm64.tar.gz Connecting to 10.10.10.1:8222... connected. OpenSSL: error:0A000126:SSL routines::unexpected eof while reading Unable to establish SSL connection. <--- ---> Failed to fetch package: The item '/root/.cache/snapcraft/download/libopus0_1.3.1-0.1build2_arm64.deb' could not be fetched: 407 Proxy Authentication Required [IP: 10.10.10.1 8222]. <--- and most common one: ---> :: + craftctl default None Full execution log: '/root/.local/state/snapcraft/log/snapcraft-20230720-103153.207821.log' Build failed <--- The 49 KiB logs in https://launchpad.net/~nteodosio/+snap/arm-fix-buildgn or the small logs in https://launchpad.net/~nteodosio/+snap/arm-dont-optimize are some more examples.