Floating IP leakage on boot_runcommand_delete

[Toni Freger]

Rally version: 0.0.5
latest Kilo on AIO.

Json test:
{
  "VMTasks.boot_runcommand_delete": [
    {
      "runner": {
        "type": "constant",
        "concurrency": 30,
        "times": 250
      },
      "args": {
        "username": "cirros",
        "floating_network": "public",
        "script": "samples/tasks/support/instance_dd_test.sh",
        "image": {
          "name": "^cirros.*"
        },
        "use_floatingip": true,
        "fixed_network": "net_int",
        "interpreter": "/bin/sh",
        "flavor": {
          "name": "nano"
        }
      },
      "sla": {
        "failure_rate": {
          "max": 0
        }
      },
      "context": {
        "users": {
          "project_domain": "default",
          "users_per_tenant": 1,
          "tenants": 1,
          "resource_management_workers": 30,
          "user_domain": "default"
        },
        "quotas": {
          "neutron": {
            "security_group": -1,
            "port": -1,
            "floatingip": -1
          },
          "nova": {
            "instances": -1,
            "cores": -1
          }
        }
      }
    }
  ]
}

If Server/FIP fails to achieve connectivity, Server will be deleted but not the FIP.
Due to this problem next iterations failed with " Error IpAddressGenerationFailureClient: No more IP addresses available on network 982a23df-afbf-4036-a185-beec6e7511c9."

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/222111

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/222191

[Liyingjun (liyingjun)]

Can not reproduce in devstack environment.

[Yair Fried (yfried)]

You need to cause ping to fail.
I did it by setting up a breakpoint before wait_for_ping and manually
destroying the ICMP rule

Regards
Yair
On Sep 11, 2015 09:01, "Liyingjun" <email address hidden> wrote:

> Can not reproduce in devstack environment.
>
> --
> You received this bug notification because you are a bug assignee.
> https://bugs.launchpad.net/bugs/1492980
>
> Title:
> Floating IP leakage on boot_runcommand_delete
>
> Status in Rally:
> In Progress
>
> Bug description:
> Rally version: 0.0.5
> latest Kilo on AIO.
>
> Json test:
> {
> "VMTasks.boot_runcommand_delete": [
> {
> "runner": {
> "type": "constant",
> "concurrency": 30,
> "times": 250
> },
> "args": {
> "username": "cirros",
> "floating_network": "public",
> "script": "samples/tasks/support/instance_dd_test.sh",
> "image": {
> "name": "^cirros.*"
> },
> "use_floatingip": true,
> "fixed_network": "net_int",
> "interpreter": "/bin/sh",
> "flavor": {
> "name": "nano"
> }
> },
> "sla": {
> "failure_rate": {
> "max": 0
> }
> },
> "context": {
> "users": {
> "project_domain": "default",
> "users_per_tenant": 1,
> "tenants": 1,
> "resource_management_workers": 30,
> "user_domain": "default"
> },
> "quotas": {
> "neutron": {
> "security_group": -1,
> "port": -1,
> "floatingip": -1
> },
> "nova": {
> "instances": -1,
> "cores": -1
> }
> }
> }
> }
> ]
> }
>
> If Server/FIP fails to achieve connectivity, Server will be deleted but
> not the FIP.
> Due to this problem next iterations failed with " Error
> IpAddressGenerationFailureClient: No more IP addresses available on network
> 982a23df-afbf-4036-a185-beec6e7511c9."
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/rally/+bug/1492980/+subscriptions
>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/222111
Committed: https://git.openstack.org/cgit/openstack/rally/commit/?id=9d80b049a57b8c6437830d50f2efb048157e3bbc
Submitter: Jenkins
Branch: master

commit 9d80b049a57b8c6437830d50f2efb048157e3bbc
Author: Yair Fried <email address hidden>
Date: Thu Sep 10 13:13:47 2015 +0300

    [Cleanup] FloatingIP

    Adds Neutron's and Nova's floating-ip to cleanup

    Change-Id: Iaeb1fefdcb40f492f0bb15ed06546ba70ee6c8ef
    Related-Bug: #1492980

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/222191
Committed: https://git.openstack.org/cgit/openstack/rally/commit/?id=895ee6ea21d79ec7ce59bdb6f65df27e281c64ac
Submitter: Jenkins
Branch: master

commit 895ee6ea21d79ec7ce59bdb6f65df27e281c64ac
Author: Yair Fried <email address hidden>
Date: Thu Sep 10 16:26:58 2015 +0300

    [VMTask] Avoid Floating IP leakage

    Moves 'wait_for_ping' from boot_server logic to try-except

    Change-Id: I0624c0b523a0cb87720715cb0a22514c2a37b330
    Closes-bug: #1492980