OpenStack Compute (nova)

Live Migration failure: 'unicode' object has no attribute '_o'

Bug #1638381 reported by Einar Næss Jensen
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Expired
Undecided
Unassigned

Bug Description

nova live-migration a7ff526d-0cab-4da7-92c2-49d8e89d1d27 dev02-compute-01 --block-migrate

gives this in nova log:
2016-11-01 21:48:49.242 14425 ERROR nova.virt.libvirt.driver [req-750740d4-c988-4d91-b690-78fca9ac20b4 08e955c2ffdb49b1abeb5b5c4f8fad03 805b50c70a744113b7d87dd248111275 - - -] [instance: a7ff526d-0cab-4da7-92c2-49d8e89d1d27] Live Migration failure: 'unicode' object has no attribute '_o'
2016-11-01 21:48:49.288 14425 ERROR nova.virt.libvirt.driver [req-750740d4-c988-4d91-b690-78fca9ac20b4 08e955c2ffdb49b1abeb5b5c4f8fad03 805b50c70a744113b7d87dd248111275 - - -] [instance: a7ff526d-0cab-4da7-92c2-49d8e89d1d27] Migration operation has aborted

and instance is not live-migrated.

regular migrating works:

root@dev02-controller-01:~# nova migrate a7ff526d-0cab-4da7-92c2-49d8e89d1d27
root@dev02-controller-01:~# nova list --all
WARNING: Option "--all_tenants" is deprecated; use "--all-tenants"; this option will be removed in novaclient 3.3.0.
+--------------------------------------+----------------------+----------------------------------+---------+------------------+-------------+------------------------+
| ID | Name | Tenant ID | Status | Task State | Power State | Networks |
+--------------------------------------+----------------------+----------------------------------+---------+------------------+-------------+------------------------+
| a7ff526d-0cab-4da7-92c2-49d8e89d1d27 | Centos7-provider-01 | 975ce89aac384a44be29269198817d00 | RESIZE | resize_migrating | Running | provider=10.100.16.53 |
| edbf68ea-fa00-4493-813e-214fa87599b1 | centos7-selfserved | 975ce89aac384a44be29269198817d00 | ACTIVE | - | Running | selfservice=172.16.1.5 |
| d303140e-447f-4ec6-9226-fa041a777f3c | democirr | 975ce89aac384a44be29269198817d00 | SHUTOFF | - | Shutdown | provider=10.100.16.57 |
| 93aeb4c8-46b9-44f2-b32f-152305e3e747 | frontend | 8e37b03ab46f4cc8bfc21f1659f2613b | SHUTOFF | - | Shutdown | provider=10.100.16.55 |
| 24104cff-d89d-4ecf-a53a-786e68a5d1e4 | fsdfs | 975ce89aac384a44be29269198817d00 | ACTIVE | - | Running | provider=10.100.16.63 |
| 9538b44e-2c92-40cc-a37e-032af7dd3cf7 | provider1 | 975ce89aac384a44be29269198817d00 | SHUTOFF | - | Shutdown | provider=10.100.16.52 |
| 2744b560-7105-4cb8-ada0-0dfefa92fdf4 | selfservice-instance | 975ce89aac384a44be29269198817d00 | ACTIVE | - | Running | selfservice=172.16.1.3 |
+--------------------------------------+----------------------+----------------------------------+---------+------------------+-------------+------------------------+
root@dev02-controller-01:~# nova list --all
WARNING: Option "--all_tenants" is deprecated; use "--all-tenants"; this option will be removed in novaclient 3.3.0.
+--------------------------------------+----------------------+----------------------------------+---------------+------------+-------------+------------------------+
| ID | Name | Tenant ID | Status | Task State | Power State | Networks |
+--------------------------------------+----------------------+----------------------------------+---------------+------------+-------------+------------------------+
| a7ff526d-0cab-4da7-92c2-49d8e89d1d27 | Centos7-provider-01 | 975ce89aac384a44be29269198817d00 | VERIFY_RESIZE | - | Running | provider=10.100.16.53 |
| edbf68ea-fa00-4493-813e-214fa87599b1 | centos7-selfserved | 975ce89aac384a44be29269198817d00 | ACTIVE | - | Running | selfservice=172.16.1.5 |
| d303140e-447f-4ec6-9226-fa041a777f3c | democirr | 975ce89aac384a44be29269198817d00 | SHUTOFF | - | Shutdown | provider=10.100.16.57 |
| 93aeb4c8-46b9-44f2-b32f-152305e3e747 | frontend | 8e37b03ab46f4cc8bfc21f1659f2613b | SHUTOFF | - | Shutdown | provider=10.100.16.55 |
| 24104cff-d89d-4ecf-a53a-786e68a5d1e4 | fsdfs | 975ce89aac384a44be29269198817d00 | ACTIVE | - | Running | provider=10.100.16.63 |
| 9538b44e-2c92-40cc-a37e-032af7dd3cf7 | provider1 | 975ce89aac384a44be29269198817d00 | SHUTOFF | - | Shutdown | provider=10.100.16.52 |
| 2744b560-7105-4cb8-ada0-0dfefa92fdf4 | selfservice-instance | 975ce89aac384a44be29269198817d00 | ACTIVE | - | Running | selfservice=172.16.1.3 |
+--------------------------------------+----------------------+----------------------------------+---------------+------------+-------------+------------------------+
root@dev02-controller-01:~# nova resize-confirm a7ff526d-0cab-4da7-92c2-49d8e89d1d27

root@dev02-controller-01:~# nova --debug live-migration a7ff526d-0cab-4da7-92c2-49d8e89d1d27 dev02-compute-01 --block-migrate
DEBUG (extension:157) found extension EntryPoint.parse('v2token = keystoneauth1.loading._plugins.identity.v2:Token')
DEBUG (extension:157) found extension EntryPoint.parse('admin_token = keystoneauth1.loading._plugins.admin_token:AdminToken')
DEBUG (extension:157) found extension EntryPoint.parse('v3oidcauthcode = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectAuthorizationCode')
DEBUG (extension:157) found extension EntryPoint.parse('v2password = keystoneauth1.loading._plugins.identity.v2:Password')
DEBUG (extension:157) found extension EntryPoint.parse('v3password = keystoneauth1.loading._plugins.identity.v3:Password')
DEBUG (extension:157) found extension EntryPoint.parse('v3oidcpassword = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectPassword')
DEBUG (extension:157) found extension EntryPoint.parse('token = keystoneauth1.loading._plugins.identity.generic:Token')
DEBUG (extension:157) found extension EntryPoint.parse('v3token = keystoneauth1.loading._plugins.identity.v3:Token')
DEBUG (extension:157) found extension EntryPoint.parse('password = keystoneauth1.loading._plugins.identity.generic:Password')
DEBUG (session:248) REQ: curl -g -i -X GET http://dev02-controller-01:35357/v3 -H "Accept: application/json" -H "User-Agent: keystoneauth1/2.4.1 python-requests/2.9.1 CPython/2.7.6"
INFO (connectionpool:208) Starting new HTTP connection (1): dev02-controller-01
DEBUG (connectionpool:388) "GET /v3 HTTP/1.1" 200 259
DEBUG (session:277) RESP: [200] Content-Length: 259 Vary: X-Auth-Token Keep-Alive: timeout=5, max=100 Server: Apache/2.4.7 (Ubuntu) Connection: Keep-Alive Date: Tue, 01 Nov 2016 20:53:49 GMT x-openstack-request-id: req-a726a5de-c67c-4200-8a50-95fe8a8336f0 Content-Type: application/json X-Distribution: Ubuntu
RESP BODY: {"version": {"status": "stable", "updated": "2016-04-04T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.6", "links": [{"href": "http://dev02-controller-01:35357/v3/", "rel": "self"}]}}

DEBUG (base:165) Making authentication request to http://dev02-controller-01:35357/v3/auth/tokens
DEBUG (connectionpool:388) "POST /v3/auth/tokens HTTP/1.1" 201 2945
DEBUG (session:248) REQ: curl -g -i -X GET http://dev02-controller-01:8774/v2.1/805b50c70a744113b7d87dd248111275 -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}2b925bd156a461395f89d54de774916f93c8f0d5"
INFO (connectionpool:208) Starting new HTTP connection (1): dev02-controller-01
DEBUG (connectionpool:388) "GET /v2.1/805b50c70a744113b7d87dd248111275 HTTP/1.1" 404 52
DEBUG (session:277) RESP: [404] Date: Tue, 01 Nov 2016 20:53:50 GMT Connection: keep-alive Content-Type: text/plain; charset=UTF-8 Content-Length: 52 X-Compute-Request-Id: req-905c2e09-57d1-4895-8dde-9de26bba034b
RESP BODY: 404 Not Found

The resource could not be found.

DEBUG (session:248) REQ: curl -g -i -X GET http://dev02-controller-01:8774/v2.1/ -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}2b925bd156a461395f89d54de774916f93c8f0d5"
DEBUG (connectionpool:388) "GET /v2.1/ HTTP/1.1" 200 393
DEBUG (session:277) RESP: [200] Content-Length: 393 X-Compute-Request-Id: req-9438b4be-4e92-4f81-85ad-0e7128723592 Vary: X-OpenStack-Nova-API-Version Connection: keep-alive X-Openstack-Nova-Api-Version: 2.1 Date: Tue, 01 Nov 2016 20:53:50 GMT Content-Type: application/json
RESP BODY: {"version": {"status": "CURRENT", "updated": "2013-07-23T11:33:21Z", "links": [{"href": "http://dev02-controller-01:8774/v2.1/", "rel": "self"}, {"href": "http://docs.openstack.org/", "type": "text/html", "rel": "describedby"}], "min_version": "2.1", "version": "2.25", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.compute+json;version=2.1"}], "id": "v2.1"}}

DEBUG (extension:157) found extension EntryPoint.parse('v2token = keystoneauth1.loading._plugins.identity.v2:Token')
DEBUG (extension:157) found extension EntryPoint.parse('admin_token = keystoneauth1.loading._plugins.admin_token:AdminToken')
DEBUG (extension:157) found extension EntryPoint.parse('v3oidcauthcode = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectAuthorizationCode')
DEBUG (extension:157) found extension EntryPoint.parse('v2password = keystoneauth1.loading._plugins.identity.v2:Password')
DEBUG (extension:157) found extension EntryPoint.parse('v3password = keystoneauth1.loading._plugins.identity.v3:Password')
DEBUG (extension:157) found extension EntryPoint.parse('v3oidcpassword = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectPassword')
DEBUG (extension:157) found extension EntryPoint.parse('token = keystoneauth1.loading._plugins.identity.generic:Token')
DEBUG (extension:157) found extension EntryPoint.parse('v3token = keystoneauth1.loading._plugins.identity.v3:Token')
DEBUG (extension:157) found extension EntryPoint.parse('password = keystoneauth1.loading._plugins.identity.generic:Password')
DEBUG (session:248) REQ: curl -g -i -X GET http://dev02-controller-01:8774/v2.1/805b50c70a744113b7d87dd248111275/servers/a7ff526d-0cab-4da7-92c2-49d8e89d1d27 -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-OpenStack-Nova-API-Version: 2.25" -H "X-Auth-Token: {SHA1}2b925bd156a461395f89d54de774916f93c8f0d5"
DEBUG (connectionpool:388) "GET /v2.1/805b50c70a744113b7d87dd248111275/servers/a7ff526d-0cab-4da7-92c2-49d8e89d1d27 HTTP/1.1" 200 2117
DEBUG (session:277) RESP: [200] Content-Length: 2117 X-Compute-Request-Id: req-b1b33174-eeb3-4e0b-9eb7-f278f0c02c91 Vary: X-OpenStack-Nova-API-Version Connection: keep-alive X-Openstack-Nova-Api-Version: 2.25 Date: Tue, 01 Nov 2016 20:53:50 GMT Content-Type: application/json
RESP BODY: {"server": {"status": "ACTIVE", "OS-EXT-SRV-ATTR:ramdisk_id": "", "updated": "2016-11-01T20:45:22Z", "hostId": "23c69f0f16f38cd104ed15d12fd769cddb331f652ce8d4fd5c4a373e", "OS-EXT-SRV-ATTR:host": "dev02-compute-02", "addresses": {"provider": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:84:56:17", "version": 4, "addr": "10.100.16.53", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://dev02-controller-01:8774/v2.1/805b50c70a744113b7d87dd248111275/servers/a7ff526d-0cab-4da7-92c2-49d8e89d1d27", "rel": "self"}, {"href": "http://dev02-controller-01:8774/805b50c70a744113b7d87dd248111275/servers/a7ff526d-0cab-4da7-92c2-49d8e89d1d27", "rel": "bookmark"}], "key_name": "mykey", "image": {"id": "586e1ef7-7d83-4c64-ad33-59a4e24920cb", "links": [{"href": "http://dev02-controller-01:8774/805b50c70a744113b7d87dd248111275/images/586e1ef7-7d83-4c64-ad33-59a4e24920cb", "rel": "bookmark"}]}, "OS-EXT-SRV-ATTR:user_data": null, "OS-EXT-STS:task_state": null, "OS-EXT-STS:vm_state": "active", "OS-EXT-SRV-ATTR:instance_name": "instance-00000003", "OS-EXT-SRV-ATTR:root_device_name": "/dev/vda", "OS-SRV-USG:launched_at": "2016-11-01T20:47:38.000000", "locked": false, "flavor": {"id": "3", "links": [{"href": "http://dev02-controller-01:8774/805b50c70a744113b7d87dd248111275/flavors/3", "rel": "bookmark"}]}, "id": "a7ff526d-0cab-4da7-92c2-49d8e89d1d27", "security_groups": [{"name": "default"}], "description": "Centos7-provider-01", "OS-EXT-SRV-ATTR:kernel_id": "", "host_status": "UP", "OS-EXT-AZ:availability_zone": "nova", "user_id": "0fb207dcae87430e8e0ae8010b669717", "name": "Centos7-provider-01", "OS-EXT-SRV-ATTR:launch_index": 0, "created": "2016-09-06T18:12:02Z", "tenant_id": "975ce89aac384a44be29269198817d00", "OS-DCF:diskConfig": "MANUAL", "OS-EXT-SRV-ATTR:hypervisor_hostname": "dev02-compute-02.dev.iaas.ntnu.no", "os-extended-volumes:volumes_attached": [], "accessIPv4": "", "accessIPv6": "", "OS-EXT-SRV-ATTR:reservation_id": "r-800tt0si", "OS-EXT-SRV-ATTR:hostname": "centos7-provider-01", "progress": 0, "OS-EXT-STS:power_state": 1, "config_drive": "", "OS-SRV-USG:terminated_at": null, "metadata": {}}}

DEBUG (session:248) REQ: curl -g -i -X POST http://dev02-controller-01:8774/v2.1/805b50c70a744113b7d87dd248111275/servers/a7ff526d-0cab-4da7-92c2-49d8e89d1d27/action -H "User-Agent: python-novaclient" -H "Content-Type: application/json" -H "Accept: application/json" -H "X-OpenStack-Nova-API-Version: 2.25" -H "X-Auth-Token: {SHA1}2b925bd156a461395f89d54de774916f93c8f0d5" -d '{"os-migrateLive": {"block_migration": true, "host": "dev02-compute-01"}}'
DEBUG (connectionpool:388) "POST /v2.1/805b50c70a744113b7d87dd248111275/servers/a7ff526d-0cab-4da7-92c2-49d8e89d1d27/action HTTP/1.1" 202 0
DEBUG (session:277) RESP: [202] Content-Length: 0 X-Compute-Request-Id: req-be31ee6d-b5d8-4384-b857-3c2ba686422e Vary: X-OpenStack-Nova-API-Version Connection: keep-alive X-Openstack-Nova-Api-Version: 2.25 Date: Tue, 01 Nov 2016 20:53:50 GMT Content-Type: application/json

on controller:
ii nova-api 2:13.1.0-0ubuntu1~cloud0 all OpenStack Compute - API frontend
ii nova-common 2:13.1.0-0ubuntu1~cloud0 all OpenStack Compute - common files
ii nova-conductor 2:13.1.0-0ubuntu1~cloud0 all OpenStack Compute - conductor service
ii nova-consoleauth 2:13.1.0-0ubuntu1~cloud0 all OpenStack Compute - Console Authenticator
ii nova-novncproxy 2:13.1.0-0ubuntu1~cloud0 all OpenStack Compute - NoVNC proxy
ii nova-scheduler 2:13.1.0-0ubuntu1~cloud0 all OpenStack Compute - virtual machine scheduler
ii python-nova 2:13.1.0-0ubuntu1~cloud0 all OpenStack Compute Python libraries
ii python-novaclient 2:3.3.1-2~cloud0 all client library for OpenStack Compute API - Python 2.7

on compute 1

ii nova-common 2:13.1.1-0ubuntu1~cloud0 all OpenStack Compute - common files
ii nova-compute 2:13.1.1-0ubuntu1~cloud0 all OpenStack Compute - compute node base
ii nova-compute-kvm 2:13.1.1-0ubuntu1~cloud0 all OpenStack Compute - compute node (KVM)
ii nova-compute-libvirt 2:13.1.1-0ubuntu1~cloud0 all OpenStack Compute - compute node libvirt support
ii python-nova 2:13.1.1-0ubuntu1~cloud0 all OpenStack Compute Python libraries
ii python-novaclient 2:3.3.1-2~cloud0 all client library for OpenStack Compute API - Python 2.7

on compute 2

ii nova-common 2:13.1.1-0ubuntu1~cloud0 all OpenStack Compute - common files
ii nova-compute 2:13.1.1-0ubuntu1~cloud0 all OpenStack Compute - compute node base
ii nova-compute-kvm 2:13.1.1-0ubuntu1~cloud0 all OpenStack Compute - compute node (KVM)
ii nova-compute-libvirt 2:13.1.1-0ubuntu1~cloud0 all OpenStack Compute - compute node libvirt support
ii python-nova 2:13.1.1-0ubuntu1~cloud0 all OpenStack Compute Python libraries
ii python-novaclient 2:3.3.1-2~cloud0 all client library for OpenStack Compute API - Python 2.7

Revision history for this message
Einar Næss Jensen (einar-nass-jensen) wrote :

The vm's do not have a shared storage.
passwordless ssh is set up for user nova on all compute nodes

Revision history for this message
Matt Riedemann (mriedem) wrote :

Is there a stacktrace associated with this?

805b50c70a744113b7d87dd248111275 - - -] [instance: a7ff526d-0cab-4da7-92c2-49d8e89d1d27] Live Migration failure: 'unicode' object has no attribute '_o'

That would be needed to know where the actual failure is.

Revision history for this message
Matt Riedemann (mriedem) wrote :

Crap, we don't actually stacktrace there...

https://github.com/openstack/nova/blob/stable/mitaka/nova/virt/libvirt/driver.py#L6111

Can you change that LOG.error to a LOG.exception and recreate and then post logs with the stacktrace?

Changed in nova:
status: New → Incomplete
Revision history for this message
Einar Næss Jensen (einar-nass-jensen) wrote :

Added the exception logging
2016-11-06 15:22:56.989 3123 ERROR nova.virt.libvirt.driver [req-d62bc190-1dd9-4439-9ed5-bb08ec585063 08e955c2ffdb49b1abeb5b5c4f8fad03 805b50c70a744113b7d87dd248111275 - - -] [instance: a7ff526d-0cab-4da7-92c2-49d8e89d1d27] Live Migration failure: operation failed: Failed to connect to remote libvirt URI qemu+tcp://dev02-compute-01/system: unable to connect to server at 'dev02-compute-01:16509': Connection refused
2016-11-06 15:22:57.030 3123 ERROR nova.virt.libvirt.driver [req-d62bc190-1dd9-4439-9ed5-bb08ec585063 08e955c2ffdb49b1abeb5b5c4f8fad03 805b50c70a744113b7d87dd248111275 - - -] [instance: a7ff526d-0cab-4da7-92c2-49d8e89d1d27] Migration operation has aborted

Revision history for this message
Einar Næss Jensen (einar-nass-jensen) wrote :
Download full text (18.1 KiB)

# nova --debug live-migration a7ff526d-0cab-4da7-92c2-49d8e89d1d27 dev02-compute-01 --block-migrate
DEBUG (shell:1082) You must provide a username or user ID via --os-username, --os-user-id, env[OS_USERNAME] or env[OS_USER_ID]
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/novaclient/shell.py", line 1080, in main
    OpenStackComputeShell().main(argv)
  File "/usr/lib/python2.7/dist-packages/novaclient/shell.py", line 835, in main
    _("You must provide a username "
CommandError: You must provide a username or user ID via --os-username, --os-user-id, env[OS_USERNAME] or env[OS_USER_ID]
ERROR (CommandError): You must provide a username or user ID via --os-username, --os-user-id, env[OS_USERNAME] or env[OS_USER_ID]
root@dev02-controller-01:~# . admin-openrc
root@dev02-controller-01:~# nova --debug live-migration a7ff526d-0cab-4da7-92c2-49d8e89d1d27 dev02-compute-01 --block-migrate
DEBUG (extension:157) found extension EntryPoint.parse('v2token = keystoneauth1.loading._plugins.identity.v2:Token')
DEBUG (extension:157) found extension EntryPoint.parse('admin_token = keystoneauth1.loading._plugins.admin_token:AdminToken')
DEBUG (extension:157) found extension EntryPoint.parse('v3oidcauthcode = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectAuthorizationCode')
DEBUG (extension:157) found extension EntryPoint.parse('v2password = keystoneauth1.loading._plugins.identity.v2:Password')
DEBUG (extension:157) found extension EntryPoint.parse('v3password = keystoneauth1.loading._plugins.identity.v3:Password')
DEBUG (extension:157) found extension EntryPoint.parse('v3oidcpassword = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectPassword')
DEBUG (extension:157) found extension EntryPoint.parse('token = keystoneauth1.loading._plugins.identity.generic:Token')
DEBUG (extension:157) found extension EntryPoint.parse('v3token = keystoneauth1.loading._plugins.identity.v3:Token')
DEBUG (extension:157) found extension EntryPoint.parse('password = keystoneauth1.loading._plugins.identity.generic:Password')
DEBUG (session:248) REQ: curl -g -i -X GET http://dev02-controller-01:35357/v3 -H "Accept: application/json" -H "User-Agent: keystoneauth1/2.4.1 python-requests/2.9.1 CPython/2.7.6"
INFO (connectionpool:208) Starting new HTTP connection (1): dev02-controller-01
DEBUG (connectionpool:388) "GET /v3 HTTP/1.1" 200 259
DEBUG (session:277) RESP: [200] Content-Length: 259 Vary: X-Auth-Token Keep-Alive: timeout=5, max=100 Server: Apache/2.4.7 (Ubuntu) Connection: Keep-Alive Date: Sun, 06 Nov 2016 14:19:03 GMT x-openstack-request-id: req-c17f2e5e-cd53-4087-aec8-11e63ae1e7ca Content-Type: application/json X-Distribution: Ubuntu
RESP BODY: {"version": {"status": "stable", "updated": "2016-04-04T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.6", "links": [{"href": "http://dev02-controller-01:35357/v3/", "rel": "self"}]}}

DEBUG (base:165) Making authentication request to http://dev02-controller-01:35357/v3/auth/tokens
DEBUG (connectionpool:388) "POST /v3/auth/tokens HTTP/1.1" 201 2945
DEBUG (session:248) REQ: curl -g -i -X GET http://dev02-controller-01:8...

Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for OpenStack Compute (nova) because there has been no activity for 60 days.]

Changed in nova:
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.