[3.0.2.0-35]SVC failure after AAP config is deleted

[Ganesha HV]

Topo
====
nodeb12 - single node setup

1]. Configured a v2 ECMP SVC between vn1 and vn2 with 2 Service VMs.
2]. Configured AAP on the left and right interfaces. This showed the active-standby flag set on the service instance interface properties.
3]. Removed the AAP config and saw that the intermediate RIs have been deleted and no route-leaking is seen between the VNs.

"contrail-svc-monitor.log" 846 lines, 92174 characters
  116 iip = InstanceIpSM.get(iip_id)
  117 if not iip or not iip.instance_ip_secondary:
iip_id = '63d21691-b6d7-4c59-adb1-9a5fee710ca9'
vmi = <svc_monitor.config_db.VirtualMachineInterfaceSM object>
vmi.instance_ips = set(['19fc26b4-0cc8-4a3b-8b65-b2232f7c6c40'])
<type 'exceptions.RuntimeError'>: Set changed size during iteration
    __class__ = <type 'exceptions.RuntimeError'>
    __delattr__ = <method-wrapper '__delattr__' of exceptions.RuntimeError object>
    __dict__ = {}
    __doc__ = 'Unspecified run-time error.'
    __format__ = <built-in method __format__ of exceptions.RuntimeError object>
    __getattribute__ = <method-wrapper '__getattribute__' of exceptions.RuntimeError object>
    __getitem__ = <method-wrapper '__getitem__' of exceptions.RuntimeError object>
    __getslice__ = <method-wrapper '__getslice__' of exceptions.RuntimeError object>
    __hash__ = <method-wrapper '__hash__' of exceptions.RuntimeError object>
    __init__ = <method-wrapper '__init__' of exceptions.RuntimeError object>
    __new__ = <built-in method __new__ of type object>
    __reduce__ = <built-in method __reduce__ of exceptions.RuntimeError object>
    __reduce_ex__ = <built-in method __reduce_ex__ of exceptions.RuntimeError object>
    __repr__ = <method-wrapper '__repr__' of exceptions.RuntimeError object>
    __setattr__ = <method-wrapper '__setattr__' of exceptions.RuntimeError object>
    __setstate__ = <built-in method __setstate__ of exceptions.RuntimeError object>
    __sizeof__ = <built-in method __sizeof__ of exceptions.RuntimeError object>
    __str__ = <method-wrapper '__str__' of exceptions.RuntimeError object>
    __subclasshook__ = <built-in method __subclasshook__ of type object>
    __unicode__ = <built-in method __unicode__ of exceptions.RuntimeError object>
    args = ('Set changed size during iteration',)
    message = 'Set changed size during iteration'

The above is a description of an error in a Python program. Here is
the original traceback:

Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/svc_monitor/rabbit.py", line 39, in _vnc_subscribe_callback
    self._vnc_subscribe_actions(oper_info)
  File "/usr/lib/python2.7/dist-packages/svc_monitor/rabbit.py", line 108, in _vnc_subscribe_actions
    res_obj.evaluate()
  File "/usr/lib/python2.7/dist-packages/svc_monitor/config_db.py", line 615, in evaluate
    self._manager.port_tuple_agent.update_port_tuple(pt_id=pt_id)
  File "/usr/lib/python2.7/dist-packages/svc_monitor/port_tuple.py", line 275, in update_port_tuple
    self.set_port_allowed_address_pairs(port, vmi, vmi_obj)
  File "/usr/lib/python2.7/dist-packages/svc_monitor/port_tuple.py", line 151, in set_port_allowed_address_pairs
    self.update_secondary_iip(vmi)
  File "/usr/lib/python2.7/dist-packages/svc_monitor/port_tuple.py", line 115, in update_secondary_iip
    for iip_id in vmi.instance_ips:
RuntimeError: Set changed size during iteration

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/20163
Submitter: Rudra Rugge (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/20164
Submitter: Rudra Rugge (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/20163
Committed: http://github.org/Juniper/contrail-controller/commit/1c236b5ed2b43e190326d0f875a7b8e65f9639c3
Submitter: Zuul
Branch: master

commit 1c236b5ed2b43e190326d0f875a7b8e65f9639c3
Author: Rudra Rugge <email address hidden>
Date: Thu May 12 09:56:17 2016 -0700

Port tuple list modification during iip udpate

Copy the list of instance-ip uuids from vmi so that
any modification in the iterations does not cause
set change size issues.

Also fix issue with reseting of service-chain-ip
flag.

Change-Id: I9332bc371cd4d7534d488e76186e930c4bfe1ccb
Closes-Bug: 1581118
Closes-bug: 1548920

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/20164
Committed: http://github.org/Juniper/contrail-controller/commit/0c1364610cd856e784d6a5244f2cc42fa3dd9fcc
Submitter: Zuul
Branch: R3.0

commit 0c1364610cd856e784d6a5244f2cc42fa3dd9fcc
Author: Rudra Rugge <email address hidden>
Date: Thu May 12 09:56:17 2016 -0700

Port tuple list modification during iip udpate

Copy the list of instance-ip uuids from vmi so that
any modification in the iterations does not cause
set change size issues.

Also fix issue with reseting of service-chain-ip
flag.

Change-Id: I9332bc371cd4d7534d488e76186e930c4bfe1ccb
Closes-Bug: 1581118
Closes-bug: 1548920