RabbitMQ repos for arm64 not found

[zrsolis]

Getting the following errors when attempting to run the setup-infrastructure play:

TASK [rabbitmq_server : Update Apt cache] ***************************************************************************************************************************************************************************************************************************************
FAILED - RETRYING: [infra1]: Update Apt cache (5 retries left).
FAILED - RETRYING: [infra1]: Update Apt cache (4 retries left).
FAILED - RETRYING: [infra1]: Update Apt cache (3 retries left).
FAILED - RETRYING: [infra1]: Update Apt cache (2 retries left).
FAILED - RETRYING: [infra1]: Update Apt cache (1 retries left).
fatal: [infra1]: FAILED! => {"attempts": 5, "changed": false, "msg": "Failed to update apt cache: W:https://ppa1.novemberain.com/rabbitmq/rabbitmq-server/deb/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details., W:https://ppa1.novemberain.com/rabbitmq/rabbitmq-erlang/deb/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details., W:http://downloads.mariadb.com/MariaDB/mariadb-10.11.2/repo/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details., E:Failed to fetch https://ppa1.novemberain.com/rabbitmq/rabbitmq-server/deb/ubuntu/dists/jammy/main/binary-arm64/Packages 404 Not Found [IP: 104.21.27.7 443], E:Failed to fetch https://ppa1.novemberain.com/rabbitmq/rabbitmq-erlang/deb/ubuntu/dists/jammy/main/binary-arm64/Packages 404 Not Found [IP: 104.21.27.7 443], E:Some index files failed to download. They have been ignored, or old ones used instead."}

Running apt update on the infra node confirms:
E: Failed to fetch https://ppa1.novemberain.com/rabbitmq/rabbitmq-server/deb/ubuntu/dists/jammy/main/binary-arm64/Packages 404 Not Found [IP: 104.21.27.7 443]
E: Failed to fetch https://ppa1.novemberain.com/rabbitmq/rabbitmq-erlang/deb/ubuntu/dists/jammy/main/binary-arm64/Packages 404 Not Found [IP: 104.21.27.7 443]

This is a fresh stable/2023.1 install on Raspberry Pi CM4 nodes.

[Dmitriy Rabotyagov (noonedeadpunk)]

Hey,

Can you kindly try setting this up in your user_variables.yml and re-run os-rabbitmq-install.yml after that?

rabbitmq_install_method: distro

You might also need to drop /etc/apt/sources.list.d/els_erlang.list and /etc/apt/sources.list.d/RabbitMQ.list from the infra host manually.

[zrsolis (zrsolis)]

I was literally just typing in "it works when switching to rabbitmq_install_method: distro". I didn't change the sources, it dropped them automatically but yeah. It's installing now with that method, it's just the default method isn't working

[Dmitriy Rabotyagov (noonedeadpunk)]

I would say that it's a known issue which happens due to us struggling to find good default source of erlang that will match cross-arch.

Setting distro will make consequences of not matching version cross-OS or with different version of OS (ie OS upgrade path).

So it's not a trivial issue to solve, unfortunately, without any trade-offs.

[zrsolis (zrsolis)]

Totally understandable and definitely no easy solutions. Still good to have this issue documented SOMEWHERE for the next person who happens to come across this issue.