[fuel-bootstrap] Proxy parameter is not working for bootstrap building

[Dmitry Kalashnik]

Steps to reproduce:
1. Setup proxy server on host
2. Create VM with two interfaces, host-only and internal network
3. Boot VM from ISO
4. Add host as proxy in fuel-bootstrap
5. Save and quit

Expected behavior:
Ubuntu bootstrap is built and activates

Actual behavior:
Ubuntu bootstrap is failed to build

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/266771

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/268094

[hogetaro (hogetaro)]

Still reproducing.

 with:
  ISO: fuel-community-8.0-1395-2016-01-15_07-18-51.iso
  patch to fuel-agent: patch set7 of https://review.openstack.org/266771
  patch to fuel-library: patch set1 of https://review.openstack.org/268094

Steps to reproduce:
1. Setup proxy server on host (192.168.0.30:3128 for me)
2. Create VM with two interfaces, host-only and internal network
3. Boot VM from ISO (fuel-community-8.0-1395-2016-01-15_07-18-51.iso)
4. Add host 192.168.0.30:3128 as proxy in fuel-bootstrap
5. Save and quit -> fails same as original report
6. cd /usr/lib/python2.7/site-packages; patch -p1 < /tmp/patch-from-266771
7. cd /etc/puppet/modules/nailgun/examples/; patch -p5 < /tmp/patch-from-268094
8. fuel-bootstrap -v build --activate` 2>&1 |tee fuel-bootstrap.log

Expected behavior:
Ubuntu bootstrap is built and activates

Actual behavior:
Ubuntu bootstrap is failed to build

Detailed output:

Full output `fuel-bootstrap.log` is here http://paste.openstack.org/show/484077/

----------- a snip from the log --------------------
Adding repository preference: name=mos, priority=1050
Trying to initialize http request object http://127.0.0.1:8080/ubuntu/x86_64/dists/mos8.0/Release, byte range: 0
Starting new HTTP connection (1): 192.168.0.30
"GET http://127.0.0.1:8080/ubuntu/x86_64/dists/mos8.0/Release HTTP/1.1" 503 3435
Successful http request to http://127.0.0.1:8080/ubuntu/x86_64/dists/mos8.0/Release on 1 retry
Failed to build bootstrap image: 503 Server Error: Service Unavailable
Cleanup chroot
Trying to execute command: fuser -v /tmp/tmpU8hWb_.fuel-agent-image
There are no running processes in /tmp/tmpU8hWb_.fuel-agent-image
Finally: umounting procfs /tmp/tmpU8hWb_.fuel-agent-image/proc
Trying to execute command: mountpoint -q /tmp/tmpU8hWb_.fuel-agent-image/proc
Trying to umount /tmp/tmpU8hWb_.fuel-agent-image/proc
Trying to execute command: umount /tmp/tmpU8hWb_.fuel-agent-image/proc
Finally: umounting chroot tree /tmp/tmpU8hWb_.fuel-agent-image
Umounting target file systems: /tmp/tmpU8hWb_.fuel-agent-image
Trying to execute command: mountpoint -q /tmp/tmpU8hWb_.fuel-agent-image/
Trying to umount /tmp/tmpU8hWb_.fuel-agent-image/
Trying to execute command: umount /tmp/tmpU8hWb_.fuel-agent-image/
Finally: detaching loop device: /dev/loop1
Trying to figure out if loop device /dev/loop1 is attached
Trying to execute command: losetup -a
Loop device /dev/loop1 seems to be attached. Trying to detach.
Trying to execute command: losetup -d /dev/loop1
Finally: removing temporary file: /tmp/tmpzrZCoC.fuel-agent-image
503 Server Error: Service Unavailable
clean up BuildCommand
got an error: 503 Server Error: Service Unavailable
----------- a snip from the log --------------------

http proxy server log (squid on 192.168.0.30) :
[18/Jan/2016:00:38:29 +0900.783] 1 192.168.0.100 TCP_MISS/503 3769 GET http
://127.0.0.1:8080/ubuntu/x86_64/dists/mos8.0/Release - HIER_DIRECT/127.0.0.1 tex
t/html

It should not come to here!

[Arthur Svechnikov (asvechnikov)]

@hogetaro

Yes it will be reproduced, because of after applying patch for puppets (https://review.openstack.org/#/c/268094/) them wasn't rerun, so localhost wasn't added to direct_repo_addresses in fuel_bootstrap_cli.yaml. Please try to rerun puppets
`puppet apply --detailed-exitcodes -d -v /etc/puppet/modules/nailgun/examples/host-only.pp`
or add localhost to direct_repo_addr
`fuel-bootstrap -v build --activate --direct_repo_addr '127.0.0.1'`

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/268094
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=f82e0e8ea57fe3c5c43da68a46f125bf70394163
Submitter: Jenkins
Branch: master

commit f82e0e8ea57fe3c5c43da68a46f125bf70394163
Author: slava <email address hidden>
Date: Fri Jan 15 14:41:20 2016 +0300

    Add loopback ip into direct repo addresses array

    Some of repositories are located on master node by default. All external
    repositories will be accessible through proxy instead of local repositories
    in case fuel master is isolated.

    Change-Id: Ia62d7ea5567e76584f962d5bd17b1378b2688fe1
    Closes-bug: #1533227

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/8.0
Review: https://review.openstack.org/269106

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/266771
Committed: https://git.openstack.org/cgit/openstack/fuel-agent/commit/?id=81adecbf8a5800769a640ae8dad947f70cd14658
Submitter: Jenkins
Branch: master

commit 81adecbf8a5800769a640ae8dad947f70cd14658
Author: Artur Svechnikov <email address hidden>
Date: Wed Jan 13 11:25:48 2016 +0300

    Add proxies for ubunutu bootstrap building

    Change-Id: I7a942d88dd2861be35253798ae6c187667b86836
    Closes-Bug: #1533227

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/8.0
Review: https://review.openstack.org/269619

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/269619
Committed: https://git.openstack.org/cgit/openstack/fuel-agent/commit/?id=9d550d821ef2d2b310803fccd953baa7cbb2152b
Submitter: Jenkins
Branch: stable/8.0

commit 9d550d821ef2d2b310803fccd953baa7cbb2152b
Author: Artur Svechnikov <email address hidden>
Date: Wed Jan 13 11:25:48 2016 +0300

    Add proxies for ubunutu bootstrap building

    Change-Id: I7a942d88dd2861be35253798ae6c187667b86836
    Closes-Bug: #1533227
    (cherry picked from commit 81adecbf8a5800769a640ae8dad947f70cd14658)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/269106
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=ebf176507f81ce6e5f4cea139e205389bd28062a
Submitter: Jenkins
Branch: stable/8.0

commit ebf176507f81ce6e5f4cea139e205389bd28062a
Author: slava <email address hidden>
Date: Fri Jan 15 14:41:20 2016 +0300

    Add loopback ip into direct repo addresses array

    Some of repositories are located on master node by default. All external
    repositories will be accessible through proxy instead of local repositories
    in case fuel master is isolated.

    Change-Id: Ia62d7ea5567e76584f962d5bd17b1378b2688fe1
    Closes-bug: #1533227
    (cherry picked from commit f82e0e8ea57fe3c5c43da68a46f125bf70394163)

[Dmitry Kalashnik (dkalashnik)]

Verified on ISO #460

[Dmitry Kalashnik (dkalashnik)]

Verified on http://pastebin.com/wn3gAeV3