d-i apt-setup/local0/repository not working

[Carl Karsten]

Binary package hint: debian-installer

I have this in my presseed file (attached):

d-i apt-setup/local0/repository string http://ppa.launchpad.net/carlfk/ppa/ubuntu maverick main
d-i apt-setup/local0/comment string Carls PPA
d-i apt-setup/local0/source boolean true
d-i apt-setup/local0/key string http://keyserver.ubuntu.com:11371/pks/lookup?op=get&search=0x2EB11AEDA224C43C

It does not get added to /etc/apt/sources.list

Doesn't work in natty either. It worked in ibex, I think worked in jaunty, I don't know if it works in lucid.

ProblemType: Bug
DistroRelease: Ubuntu 10.10
Package: debian-installer (not installed)
ProcVersionSignature: Ubuntu 2.6.35-27.48-generic 2.6.35.11
Uname: Linux 2.6.35-27-generic i686
Architecture: i386
CurrentDmesg: [ 23.184026] eth0: no IPv6 routers present
Date: Thu Mar 3 15:37:37 2011
Lsusb:
 Bus 003 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
 Bus 002 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
 Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
MachineType: Hewlett-Packard Presario V2000 (EH463UA#ABA)
MemoryUsage:
 total used free shared buffers cached
 Mem: 636460 194584 441876 0 18244 99836
 -/+ buffers/cache: 76504 559956
 Swap: 2301948 0 2301948
PccardctlIdent:
 Socket 0:
   no product info available
PccardctlStatus:
 Socket 0:
   no card
ProcCmdLine: BOOT_IMAGE=/boot/vmlinuz-2.6.35-27-generic root=UUID=0480b667-08b2-4c21-be80-0ba68c3c9877 ro quiet splash
ProcEnviron:
 SHELL=/bin/bash
 LANG=en_US
SourcePackage: debian-installer
dmi.bios.date: 08/04/2005
dmi.bios.vendor: Hewlett-Packard
dmi.bios.version: F.11
dmi.board.name: 3093
dmi.board.vendor: Quanta
dmi.board.version: 47.0D
dmi.chassis.type: 10
dmi.chassis.vendor: Quanta
dmi.chassis.version: N/A
dmi.modalias: dmi:bvnHewlett-Packard:bvrF.11:bd08/04/2005:svnHewlett-Packard:pnPresarioV2000(EH463UA#ABA):pvrRev1:rvnQuanta:rn3093:rvr47.0D:cvnQuanta:ct10:cvrN/A:
dmi.product.name: Presario V2000 (EH463UA#ABA)
dmi.product.version: Rev 1
dmi.sys.vendor: Hewlett-Packard

[Carl Karsten (carlfk)]

root@dhcp134:/var/log/installer# head -n 1993 syslog | tail -n +1906

Mar 21 18:31:07 debconf: --> SET apt-setup/local0/repository http://ddebs.ubuntu.com natty main restricted universe multiverse
Mar 21 18:31:07 debconf: <-- 10 apt-setup/local0/repository doesn't exist
Mar 21 18:31:07 debconf: --> REGISTER debian-installer/dummy apt-setup/local0/repository
Mar 21 18:31:07 debconf: <-- 0
Mar 21 18:31:07 debconf: --> SET apt-setup/local0/repository http://ddebs.ubuntu.com natty main restricted universe multiverse
Mar 21 18:31:07 debconf: <-- 0 value set
Mar 21 18:31:07 debconf: --> SUBST apt-setup/local0/repository ID apt-setup/local0/repository
Mar 21 18:31:07 debconf: Adding [ID] -> [apt-setup/local0/repository]
Mar 21 18:31:07 debconf: <-- 0
Mar 21 18:31:07 debconf: --> FSET apt-setup/local0/repository seen true
Mar 21 18:31:07 debconf: <-- 0 true
Mar 21 18:31:07 debconf: --> SET apt-setup/local0/comment ubuntu debugging stuff
Mar 21 18:31:07 debconf: <-- 10 apt-setup/local0/comment doesn't exist
Mar 21 18:31:07 debconf: --> REGISTER debian-installer/dummy apt-setup/local0/comment
Mar 21 18:31:07 debconf: <-- 0
Mar 21 18:31:07 debconf: --> SET apt-setup/local0/comment ubuntu debugging stuff
Mar 21 18:31:07 debconf: <-- 0 value set
Mar 21 18:31:07 debconf: --> SUBST apt-setup/local0/comment ID apt-setup/local0/comment
Mar 21 18:31:07 debconf: Adding [ID] -> [apt-setup/local0/comment]
Mar 21 18:31:07 debconf: <-- 0
Mar 21 18:31:07 debconf: --> FSET apt-setup/local0/comment seen true
Mar 21 18:31:07 debconf: <-- 0 true
Mar 21 18:31:07 debconf: --> SET apt-setup/local0/source true
Mar 21 18:31:07 debconf: <-- 10 apt-setup/local0/source doesn't exist
Mar 21 18:31:07 debconf: --> REGISTER debian-installer/dummy apt-setup/local0/source
Mar 21 18:31:07 debconf: <-- 0
Mar 21 18:31:07 debconf: --> SET apt-setup/local0/source true
Mar 21 18:31:07 debconf: <-- 0 value set
Mar 21 18:31:07 debconf: --> SUBST apt-setup/local0/source ID apt-setup/local0/source
Mar 21 18:31:07 debconf: Adding [ID] -> [apt-setup/local0/source]
Mar 21 18:31:07 debconf: <-- 0
Mar 21 18:31:07 debconf: --> FSET apt-setup/local0/source seen true
Mar 21 18:31:07 debconf: <-- 0 true
Mar 21 18:31:07 debconf: --> SET apt-setup/local0/key http://keyserver.ubuntu.com:11371/pks/lookup?op=get&search=0x428D7C015E0577F2
Mar 21 18:31:07 debconf: <-- 10 apt-setup/local0/key doesn't exist
Mar 21 18:31:07 debconf: --> REGISTER debian-installer/dummy apt-setup/local0/key
Mar 21 18:31:07 debconf: <-- 0
Mar 21 18:31:07 debconf: --> SET apt-setup/local0/key http://keyserver.ubuntu.com:11371/pks/lookup?op=get&search=0x428D7C015E0577F2
Mar 21 18:31:07 debconf: <-- 0 value set
Mar 21 18:31:07 debconf: --> SUBST apt-setup/local0/key ID apt-setup/local0/key
Mar 21 18:31:07 debconf: Adding [ID] -> [apt-setup/local0/key]
Mar 21 18:31:07 debconf: <-- 0
Mar 21 18:31:07 debconf: --> FSET apt-setup/local0/key seen true
Mar 21 18:31:07 debconf: <-- 0 true

Mar 21 18:31:07 debconf: --> SET apt-setup/local1/repository http://ppa.launchpad.net/carlfk/ppa/ubuntu natty main
Mar 21 18:31:07 debconf: <-- 10 apt-setup/local1/repository doesn't exist
Mar 21 18:31:07 debconf: --> REGISTER debian-installer/dummy ...

[Evan (ev)]

Can you please try again with the following key set?

d-i debian-installer/allow_unauthenticated boolean true

Thanks!

[Carl Karsten (carlfk)]

no help:

May 30 01:08:52 debconf: --> SET debian-installer/allow_unauthenticated true
May 30 01:08:52 debconf: <-- 0 value set
May 30 01:08:52 debconf: --> FSET debian-installer/allow_unauthenticated seen true
May 30 01:08:52 debconf: <-- 0 true
May 30 01:08:52 debconf: --> SET apt-setup/local0/repository http://ddebs.ubuntu.com natty main restricted universe multiverse
May 30 01:08:52 debconf: <-- 10 apt-setup/local0/repository doesn't exist

[Carl Karsten (carlfk)]

from attached syslog

Jun 27 19:20:15 debconf: --> PROGRESS INFO apt-setup/progress/local
Jun 27 19:20:15 debconf: <-- 0 OK
Jun 27 19:20:15 debconf: --> GET apt-setup/local0/repository
Jun 27 19:20:15 debconf: <-- 0 http://ddebs.ubuntu.com natty main restricted uni
verse multiverse
Jun 27 19:20:15 debconf: --> GET apt-setup/local0/comment
Jun 27 19:20:15 debconf: <-- 0 ubuntu debugging stuff
Jun 27 19:20:15 debconf: --> GET apt-setup/local0/key
Jun 27 19:20:15 debconf: <-- 0 http://keyserver.ubuntu.com:11371/pks/lookup?op=g
et&search=0x428D7C015E0577F2
Jun 27 19:20:15 debconf: --> GET apt-setup/local0/source
Jun 27 19:20:15 debconf: <-- 0 true
Jun 27 19:20:15 debconf: --> GET mirror/http/proxy
Jun 27 19:20:15 debconf: <-- 0 http://g2a.personnelware.com:8000/
Jun 27 19:20:15 debconf: --> PROGRESS SET 500
Jun 27 19:20:15 debconf: <-- 0 OK
Jun 27 19:20:15 apt-setup: warning: /usr/lib/apt-setup/generators/60local return
ed error code 1; discarding output
Jun 27 19:20:15 debconf: --> PROGRESS SET 600
Jun 27 19:20:15 debconf: <-- 0 OK
Jun 27 19:20:15 debconf: --> PROGRESS INFO apt-setup/progress/services-select
Jun 27 19:20:15 debconf: <-- 10 apt-setup/progress/services-select does not exis
t
Jun 27 19:20:15 debconf: --> SUBST apt-setup/progress/fallback SCRIPT services-s
elect
Jun 27 19:20:15 debconf: Adding [SCRIPT] -> [services-select]
Jun 27 19:20:15 debconf: <-- 0
Jun 27 19:20:15 debconf: --> PROGRESS INFO apt-setup/progress/fallback
Jun 27 19:20:15 debconf: <-- 0 OK
Jun 27 19:20:15 debconf: --> GET mirror/suite
Jun 27 19:20:15 debconf: <-- 0 oneiric
Jun 27 19:20:15 debconf: --> GET apt-setup/restricted
Jun 27 19:20:15 debconf: <-- 0 true
Jun 27 19:20:15 debconf: --> GET apt-setup/partner
Jun 27 19:20:15 debconf: <-- 0 false

[Carl Karsten (carlfk)]

I am using squid-deb-proxy, which works with the PPAs once I boot into the installed system, so shouldn't be a problem here either.

[Carl Karsten (carlfk)]

output from /usr/lib/apt-setup/generators/60local

+ . /usr/share/debconf/confmodule
+ [ ! 1 ]
+ [ -z 1 ]
+ DEBCONF_OLD_FD_BASE=4
+ export DEBCONF_OLD_FD_BASE
+ file=/target/tmp/fileoTAXu4
+ chroot=
+ [ /target ]
+ chroot=chroot
+ i=0
+ db_get apt-setup/local0/repository
+ _db_cmd GET apt-setup/local0/repository
+ IFS= printf %s\n GET apt-setup/local0/repository
+ IFS=
 read -r _db_internal_line
+ RET=http://ppa.launchpad.net/maxb/ppa/ubuntu natty main
+ return 0
+ [ http://ppa.launchpad.net/maxb/ppa/ubuntu natty main ]
+ repository=http://ppa.launchpad.net/maxb/ppa/ubuntu natty main
+ comment=
+ db_get apt-setup/local0/comment
+ _db_cmd GET apt-setup/local0/comment
+ IFS= printf %s\n GET apt-setup/local0/comment
+ IFS=
 read -r _db_internal_line
+ RET=10 apt-setup/local0/comment doesn't exist
+ return 10
+ key=
+ db_get apt-setup/local0/key
+ _db_cmd GET apt-setup/local0/key
+ IFS= printf %s\n GET apt-setup/local0/key
+ IFS=
 read -r _db_internal_line
+ RET=http://keyserver.ubuntu.com:11371/pks/lookup?op=get&search=0x9CC1A69E3DC9DB5420FAB05AD701E18D0B717EF0
+ return 0
+ key=http://keyserver.ubuntu.com:11371/pks/lookup?op=get&search=0x9CC1A69E3DC9DB5420FAB05AD701E18D0B717EF0
+ echo
+ [ -n ]
+ echo deb http://ppa.launchpad.net/maxb/ppa/ubuntu natty main
+ db_get apt-setup/local0/source
+ _db_cmd GET apt-setup/local0/source
+ IFS= printf %s\n GET apt-setup/local0/source
+ IFS=
 read -r _db_internal_line
+ RET=10 apt-setup/local0/source doesn't exist
+ return 10
+ [ -n http://keyserver.ubuntu.com:11371/pks/lookup?op=get&search=0x9CC1A69E3DC9DB5420FAB05AD701E18D0B717EF0 ]
+ fetch-url http://keyserver.ubuntu.com:11371/pks/lookup?op=get&search=0x9CC1A69E3DC9DB5420FAB05AD701E18D0B717EF0 /target/tmp/key0.pub
wget: server returned error: HTTP/1.0 403 Forbidden

[Carl Karsten (carlfk)]

/usr/lib/fetch-url/http

        # use the proxy for wgets (should speed things up)
        if db_get mirror/$proto/proxy; then
                export ${proto}_proxy="$RET"
        fi

+ http_proxy=http://g2a.personnelware.com:8000 wget http://keyserver.ubuntu.com:11371/pks/lookup?op=get&search=0x9CC1A69E3DC9DB5420FAB05AD701E18D0B717EF0
Connecting to g2a.personnelware.com:8000 (192.168.1.20:8000)
wget: server returned error: HTTP/1.0 403 Forbidden

Trying an install without proxy now.

[Carl Karsten (carlfk)]

Yep, removed proxy, apt-setup/local0/repository got added to etc/apt/sources.list.

I see 2 or 3 bugs here: I'll be happy to open new bugs if someone asks.

1. If this is the only reason to enable the proxy: # use the proxy for wgets (should speed things up)
don't use the proxy. I suspect there are more reasons, like the proxy is the only way to get to the internet, so not using it will be good for my case but bad for some other case. We should be sure there is a case that would be bad though. like maybe proxying keys are bad and shouldn't be done anyway, so if it was working it should be fixed to not work.

2. squid-deb-proxy needs to handle this. Whatever this is.

3. d-i needs to error when this errors. failing silently is bad.

[Colin Watson (cjwatson)]

There are certainly cases where the proxy is the only way to get to the Internet, and there's no reason why proxying keys should be bad. squid-deb-proxy should be fixed to handle this, I think. I've opened a new task on this bug for that.

I agree that apt-setup should have error handling for this. I'm working on that.

[Colin Watson (cjwatson)]

Fix committed to Debian.

[Launchpad Janitor (janitor)]

This bug was fixed in the package apt-setup - 1:0.55ubuntu1

---------------
apt-setup (1:0.55ubuntu1) precise; urgency=low

  * Resynchronise with Debian. Remaining changes:
    - Install the Ubuntu mirror generator instead of Debian's.
    - Set apt-setup/security_host to security.ubuntu.com, or
      ports.ubuntu.com on ports architectures; adjust directory and
      distribution to match.
    - Add security sources for restricted, universe, and multiverse,
      commented out unless the respective components are enabled. Disable
      security generator checks for contrib and non-free.
    - For CD installs, leave the sources.list created by apt-setup in
      /etc/apt/sources.list.apt-setup, and restore the sources.list created
      during base installation for the rest of the installation.
    - Honour OVERRIDE_BASE_INSTALLABLE when checking
      /cdrom/.disk/base_installable.
    - Set the mirror verification timeout to 30 seconds.
    - Adjust services-select for Ubuntu, removing volatile and adding
      partner (apt-setup/partner) and extras (apt-setup/extras).
    - Always disable the CD at the end of installation if any mirrors are
      present, even if it's a complete CD.
    - Pre-populate apt's lists directory with signed Release files for
      archive.ubuntu.com (and mirrors) and security.ubuntu.com, to protect
      against downgrade attacks right from initial installation.
    - Run 'apt-get update' for all sources.list lines produced by a single
      generator in one go, and don't comment out sources.list lines if it
      fails.
    - Make the path to security updates configurable, as well as the host.
    - Remove restricted from cdrom entry if apt-setup/restricted is false.
    - Make sure apt-cdrom doesn't unmount the CD if cd_type ends with
      /single.
    - Enable all network sources, including security updates, even if the
      network is unconfigured.
    - Honour apt-setup/restricted, apt-setup/universe, and
      apt-setup/multiverse when writing -backports lines.
    - Run 'apt-get update', without downloading package lists or cleaning up
      old files, after moving the sources.list generated during base system
      installation back into place.
    - If OVERRIDE_LEAVE_CD_MOUNTED is set, don't unmount /cdrom; this is a
      bad idea in a live CD environment!
    - Bail out cleanly from cdrom generator if /cdrom/.disk/info doesn't
      exist or has zero size.
    - Enable backports by default now that we have NotAutomatic enabled and
      working.
    - Enable multiarch by default for amd64 installations. This can be
      controlled by preseeding apt-setup/multiarch.
  * Add Release files for precise, and remove those for oneiric (except for
    extras.ubuntu.com, where precise doesn't exist yet).

apt-setup (1:0.55) unstable; urgency=low

  [ Samuel Thibault ]
  * Explicitly unmount bind mounts, do not rely on the OS to do it itself.

  [ Colin Watson ]
  * Display an error message if downloading the public key for a local
    repository fails, and allow the user to retry (LP: #728710).

  [ Updated translations ]
  * Bulgarian (bg.po) by Damyan Ivanov
  * German (de.po) by Holger Wansing
  * Ba...

[Carl Karsten (carlfk)]

Seems squid-deb-proxy is deliberately strict by default, if the user wants to use ppas, they need to enable this.

juser@dc10b:/etc/squid-deb-proxy/mirror-dstdomain.acl.d$ cat 10-default
# /etc/squid-deb-proxy/mirror-dstdomain.acl.d/10-default
#
# network destinations that are allowed by this cache

# launchpad personal package archives (disabled by default)
#ppa.launchpad.net
#private-ppa.launchpad.net