Unable to bootstrap lxd provider on s390x

[Cheryl Jennings]

Taken from: https://github.com/juju/juju/issues/4656

$ sudo juju bootstrap --upload-tools --config default-series=xenial take2 lxd
Creating Juju controller "local.take2" on lxd/localhost
Bootstrapping model "take2"
Starting new instance for initial controller
Launching instance
ERROR unexpected problem parsing hardware info: bad "arch" characteristic: "s390x" not recognized
 - juju-2d0c9a99-da2a-4394-8a57-d8cb9da8e2ba-machine-0
panic: runtime error: invalid memory address or nil pointer dereference
[signal 0xb code=0x1 addr=0x0 pc=0x2aa12c80352]

goroutine 1 [running]:
panic(0x2aa13c904c0, 0xc8200140e0)
    /usr/lib/go/src/runtime/panic.go:464 +0x474
github.com/juju/juju/provider/common.Bootstrap(0x3ff90142240, 0xc8201fed60, 0x3ff900fdfd0, 0xc82017eb40, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /home/ubuntu/go/src/github.com/juju/juju/provider/common/bootstrap.go:50 +0x122
github.com/juju/juju/provider/common.DefaultProvider.BootstrapEnv(0x3ff900fdfd0, 0xc82017eb40, 0x3ff90142240, 0xc8201fed60, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /home/ubuntu/go/src/github.com/juju/juju/provider/common/provider.go:23 +0x5e
github.com/juju/juju/provider/common.(*DefaultProvider).BootstrapEnv(0xc820367f30, 0x3ff90142240, 0xc8201fed60, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    <autogenerated>:64 +0xf0
github.com/juju/juju/provider/lxd.(*environ).Bootstrap(0xc82017eb40, 0x3ff90142240, 0xc8201fed60, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /home/ubuntu/go/src/github.com/juju/juju/provider/lxd/environ.go:152 +0x82
github.com/juju/juju/environs/bootstrap.Bootstrap(0x3ff90142240, 0xc8201fed60, 0x3ff900fdfd0, 0xc82017eb40, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /home/ubuntu/go/src/github.com/juju/juju/environs/bootstrap/bootstrap.go:187 +0x14e4
github.com/juju/juju/cmd/juju/commands.bootstrapFuncs.Bootstrap(0x3ff90142240, 0xc8201fed60, 0x3ff900fdfd0, 0xc82017eb40, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /home/ubuntu/go/src/github.com/juju/juju/cmd/juju/commands/bootstrap.go:231 +0x68
github.com/juju/juju/cmd/juju/commands.(*bootstrapFuncs).Bootstrap(0x2aa1546e2f0, 0x3ff90142240, 0xc8201fed60, 0x3ff900fdfd0, 0xc82017eb40, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    <autogenerated>:65 +0x10e
github.com/juju/juju/cmd/juju/commands.(*bootstrapCommand).Run(0xc82041c1e0, 0xc8203fa780, 0x0, 0x0)
    /home/ubuntu/go/src/github.com/juju/juju/cmd/juju/commands/bootstrap.go:453 +0x260e
github.com/juju/juju/cmd/modelcmd.(*modelCommandWrapper).Run(0xc82028c120, 0xc8203fa780, 0x0, 0x0)
    <autogenerated>:111 +0x94
github.com/juju/juju/cmd/modelcmd.(*baseCommandWrapper).Run(0xc82028bf00, 0xc8203fa780, 0x0, 0x0)
    /home/ubuntu/go/src/github.com/juju/juju/cmd/modelcmd/base.go:166 +0xe4
github.com/juju/cmd.(*SuperCommand).Run(0xc820164000, 0xc8203fa780, 0x0, 0x0)
    /home/ubuntu/go/src/github.com/juju/cmd/supercommand.go:446 +0x674
github.com/juju/cmd.Main(0x3ff9013f1a0, 0xc820164000, 0xc8203fa780, 0xc82000a0f0, 0x6, 0x6, 0x2aa14375640)
    /home/ubuntu/go/src/github.com/juju/cmd/cmd.go:279 +0x32e
github.com/juju/juju/cmd/juju/commands.Main(0xc82000a0e0, 0x7, 0x7)
    /home/ubuntu/go/src/github.com/juju/juju/cmd/juju/commands/main.go:83 +0x5aa
main.main()
    /home/ubuntu/go/src/github.com/juju/juju/cmd/juju/main.go:27 +0x42

[Dimitri John Ledkov (xnox)]

I think this should do it:
https://github.com/juju/utils/pull/199

[Cheryl Jennings (cherylj)]

Looks like s390x arch support also needs to be added to 1.25.

[Dimitri John Ledkov (xnox)]

Hi,

I have proposed patch on github to fix juju 2 lxd provider.

juju 1.25 so far works fine on s390x - local provider is the one I used there.

Regards,

Dimitri.

On 9 March 2016 at 17:23, Cheryl Jennings <email address hidden> wrote:
> Looks like s390x arch support also needs to be added to 1.25.
>
> ** Also affects: juju-core/1.25
> Importance: Undecided
> Status: New
>
> ** Changed in: juju-core/1.25
> Status: New => Triaged
>
> ** Changed in: juju-core/1.25
> Importance: Undecided => High
>
> ** Changed in: juju-core/1.25
> Milestone: None => 1.25.5
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1554675
>
> Title:
> Unable to bootstrap lxd provider on s390x
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/juju-core/+bug/1554675/+subscriptions

--
Regards,

Dimitri.

[Cheryl Jennings (cherylj)]

@xnox - can you confirm that it works with the 1.25.4 that's in proposed?

[Dimitri John Ledkov (xnox)]

On 9 March 2016 at 18:13, Cheryl Jennings <email address hidden> wrote:
> @xnox - can you confirm that it works with the 1.25.4 that's in
> proposed?

You should be able to check that with juju-qa team. I was told by them
not to touch -proposed... and they have access to z/VM and should be
testing juju there, the one they release&bless.

--
Regards,

Dimitri.

[Dimitri John Ledkov (xnox)]

I guess the dependency needs to be updated in the main juju repo too...:

https://github.com/juju/juju/pull/4670

Also I can't find 1.25.4 in xenial-proposed. Which location do you mean when you say "in proposed"? I guess I can build it out of the branch myself.... hopefully.

[Cheryl Jennings (cherylj)]

It's in the juju proposed PPA: https://launchpad.net/~juju/+archive/proposed

[Antonio Rosales (arosales)]

Following the other Xenial LXD bugs (1554675, 1551440, 1557747) I was able to bootstrap a Xenial controller on x86, but no lock on s390.

I am posting here as it is similar, but not the same stack trace:

juju@s3lp1-juju01:~$ juju bootstrap test lxd --debug --config default-series=xenial --upload-tools
2016-03-30 07:43:56 INFO juju.cmd supercommand.go:60 running juju [2.0-beta3 gc go1.6]
2016-03-30 07:43:56 INFO cmd cmd.go:141 cloud "lxd" not found, trying as a provider name
2016-03-30 07:43:56 INFO cmd cmd.go:141 no credentials found, checking environment
2016-03-30 07:43:56 DEBUG juju.cmd.juju.commands bootstrap.go:363 preparing controller with config: map[type:lxd name:admin uuid:464b7dcf-f89b-4caa-8422-1b93764de6b1 controller-uuid:464b7dcf-f89b-4caa-8422-1b93764de6b1 default-series:xenial]
2016-03-30 07:44:06 DEBUG juju.tools.lxdclient client.go:65 connecting to LXD remote "local": ""
2016-03-30 07:44:06 DEBUG juju.tools.lxdclient client.go:65 connecting to LXD remote "juju-remote": "10.0.3.1"
2016-03-30 07:44:06 INFO cmd cmd.go:129 Creating Juju controller "local.test" on lxd/localhost
2016-03-30 07:44:06 INFO juju.cmd.juju.commands bootstrap.go:486 combined bootstrap constraints:
2016-03-30 07:44:06 INFO juju.network network.go:299 setting prefer-ipv6 to false
2016-03-30 07:44:06 INFO cmd cmd.go:129 Bootstrapping model "admin"
2016-03-30 07:44:06 DEBUG juju.environs.bootstrap bootstrap.go:147 model "admin" supports service/machine networks: false
2016-03-30 07:44:06 DEBUG juju.environs.bootstrap bootstrap.go:149 network management by juju enabled: true
2016-03-30 07:44:07 INFO cmd cmd.go:129 Starting new instance for initial controller
Launching instance
2016-03-30 07:44:07 DEBUG juju.provider.lxd environ_broker.go:49 StartInstance: "0", xenial
2016-03-30 07:44:07 DEBUG juju.provider.lxd environ_broker.go:78 tools: &tools.Tools{Version:version.Binary{Number:version.Number{Major:2, Minor:0, Tag:"beta", Patch:3, Build:1}, Series:"xenial", Arch:"s390x"}, URL:"", SHA256:"", Size:0}
2016-03-30 07:44:07 DEBUG juju.cloudconfig.instancecfg instancecfg.go:566 Setting numa ctl preference to false
2016-03-30 07:44:07 DEBUG juju.environs imagemetadata.go:112 using image datasource "default cloud images"
2016-03-30 07:44:07 DEBUG juju.environs imagemetadata.go:112 using image datasource "default ubuntu cloud images"
2016-03-30 07:44:07 DEBUG juju.provider.lxd environ_broker.go:120 LXD requires https://, using: https://cloud-images.ubuntu.com/releases/
2016-03-30 07:44:07 INFO juju.tools.lxdclient client_image.go:65 found cached image "ubuntu-xenial" = 995321b9835c02947b8279bba7d4f8650fd113b02500ba201a3aea311611d208
2016-03-30 07:44:07 DEBUG juju.service discovery.go:59 discovered init system "systemd" from series "xenial"
2016-03-30 07:44:07 DEBUG juju.provider.lxd environ_broker.go:217 LXD user data; 1342 bytes
2016-03-30 07:44:07 INFO juju.provider.lxd environ_broker.go:195 starting instance "juju-464b7dcf-f89b-4caa-8422-1b93764de6b1-machine-0" (image "ubuntu-xenial")...
2016-03-30 07:44:20 INFO juju.provider.lxd environ_broker.go:64 started instance "juju-464b7dcf-f89b-4caa-8422-1b93764de6b1-machine-0"
 - juju-464b7dcf-f89b-4caa-8422-1b93764de...

[Cheryl Jennings (cherylj)]

1.25 PR: https://github.com/juju/juju/pull/4932

[Cheryl Jennings (cherylj)]

@xnox - were you able to confirm that a s390x bootstrap succeeds with a new build of master?

[Dimitri John Ledkov (xnox)]

Is there a PPA for both 1.25.5 and 2.0 beta4 (5?) that I can pull and test? I really hope I do not have to rebuild both from scratch, due to disk space constraints i believe all of that environment/builds are wiped already.