snapcraft refuses to checkout svn part source on buildd

[Lucy Llewellyn]

Related to #1668358

When snapcraft tries to checkout a part's source from a remote subversion repository the process fails due to receiving an HTTP 403 response from an OPTIONS request to the repo URL.

Build log of an affected build:

https://launchpad.net/~build.snapcraft.io/+snap/f0892aa6b109a984ea5151605244b3a1/+build/481450/+files/buildlog_snap_ubuntu_bionic_i386_f0892aa6b109a984ea5151605244b3a1_BUILDING.txt.gz

This is preventing updates to my tvheadend snap as there is no other source repository (e.g. git) for the part that I'm building (oscam).

snapcraft.yaml:

https://github.com/diddlesnaps/tvheadend/blob/master/snap/snapcraft.yaml

The build works fine via multipass on my local system, which doesn't have the same proxy setup that the buildd has. This suggests the problem is somewhere within the buildd or proxy setup.

[Neil McPhail (njmcphail)]

See also https://bugs.launchpad.net/snapcraft/+bug/1718245

[William Grant (wgrant)]

Is that the right log? The error there is:

reader-cryptoworks.c:10:18: error: field ‘exp’ has incomplete type
  BIGNUM exp;
                  ^~~
reader-cryptoworks.c:11:18: error: field ‘ucpk’ has incomplete type
  BIGNUM ucpk;

[Lucy Llewellyn (lucyllewy)]

thanks, wgrant, you're correct that I included the wrong log which is from an out of date git mirror of the svn source (so out of date that it isn't usable as an alternative to checking-out via svn) :-)

Please see this one instead https://launchpad.net/~build.snapcraft.io/+snap/f0892aa6b109a984ea5151605244b3a1/+build/481450/+files/buildlog_snap_ubuntu_bionic_i386_f0892aa6b109a984ea5151605244b3a1_BUILDING.txt.gz

I've correct the link in the description, too.

[Lucy Llewellyn (lucyllewy)]

This is the relevant error from the correct log:

Pulling oscam
[02/Mar/2019:15:25:35 +0000] "OPTIONS http://www.streamboard.tv/svn/oscam/trunk HTTP/1.1" 403 2037 "-" "SVN/1.9.7 (i686-pc-linux-gnu) serf/1.3.9"
svn: E170013: Unable to connect to a repository at URL 'http://www.streamboard.tv/svn/oscam/trunk'
svn: E175013: Access to '/svn/oscam/trunk' forbidden
Downloading 'libusb-1.0.22.tar.bz2' 0%
Downloading 'libusb-1.0.22.tar.bz2' 100%
Failed to pull source, command 'svn checkout http://www.streamboard.tv/svn/oscam/trunk/ /build/tvheadend/parts/oscam/src' exited with code 1.
Build failed

[Colin Watson (cjwatson)]

I'm not quite sure why this would have broken, since https://svn.apache.org/repos/asf/subversion/trunk/notes/http-and-webdav/webdav-protocol doesn't list OPTIONS as being used by checkout, but on the other hand OPTIONS is a reasonable enough HTTP method to allow so it's probably simplest to just do that. I'll make sure that I can reproduce this locally and then adjust the proxy configuration.

[Colin Watson (cjwatson)]

Fix in our sysadmin queue for deployment now.

[Colin Watson (cjwatson)]

The proxy now allows OPTIONS, so this works now. Thanks for your report.