test_create_get_delete_object flakey fail

[Christopher Yeoh]

http://logs.openstack.org/50/62550/2/gate/gate-grenade-dsvm/5c105a6/testr_results.html.gz

ft114.1: tempest.thirdparty.boto.test_s3_objects.S3BucketsTest.test_create_get_delete_object[gate,smoke]_StringException: Empty attachments:
  stderr
  stdout

pythonlogging:'': {{{
2013-12-27 01:20:07,965 REQ: curl -i -X POST http://127.0.0.1:5000/v2.0/tokens -H "Content-Type: application/json" -H "User-Agent: python-keystoneclient"
2013-12-27 01:20:07,966 REQ BODY: {"auth": {"tenantName": "demo", "passwordCredentials": {"username": "demo", "password": "secret"}}}
2013-12-27 01:20:07,968 Starting new HTTP connection (1): 127.0.0.1
2013-12-27 01:20:08,146 "POST /v2.0/tokens HTTP/1.1" 200 8332
2013-12-27 01:20:08,147 RESP: [200] CaseInsensitiveDict({'date': 'Fri, 27 Dec 2013 01:20:08 GMT', 'vary': 'X-Auth-Token', 'content-length': '8332', 'content-type': 'application/json'})
RESP BODY: {"access": {"token": {"issued_at": "2013-12-27T01:20:08.103208", "expires": "2013-12-28T01:20:08Z", "id": "MIIOtAYJKoZIhvcNAQcCoIIOpTCCDqECAQExCTAHBgUrDgMCGjCCDQoGCSqGSIb3DQEHAaCCDPsEggz3eyJhY2Nlc3MiOiB7InRva2VuIjogeyJpc3N1ZWRfYXQiOiAiMjAxMy0xMi0yN1QwMToyMDowOC4xMDMyMDgiLCAiZXhwaXJlcyI6ICIyMDEzLTEyLTI4VDAxOjIwOjA4WiIsICJpZCI6ICJwbGFjZWhvbGRlciIsICJ0ZW5hbnQiOiB7ImRlc2NyaXB0aW9uIjogbnVsbCwgImVuYWJsZWQiOiB0cnVlLCAiaWQiOiAiNDcyMzRjNzUyNzg1NDVlMDg2ZjkyZDQ3MmFhNzMyZWEiLCAibmFtZSI6ICJkZW1vIn19LCAic2VydmljZUNhdGFsb2ciOiBbeyJlbmRwb2ludHMiOiBbeyJhZG1pblVSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjg3NzQvdjIvNDcyMzRjNzUyNzg1NDVlMDg2ZjkyZDQ3MmFhNzMyZWEiLCAicmVnaW9uIjogIlJlZ2lvbk9uZSIsICJpbnRlcm5hbFVSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjg3NzQvdjIvNDcyMzRjNzUyNzg1NDVlMDg2ZjkyZDQ3MmFhNzMyZWEiLCAiaWQiOiAiMDI4YTZjMGRmOTBhNDQ2MmIxOGVhN2Q4YzVlMjU3MTIiLCAicHVibGljVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3NC92Mi80NzIzNGM3NTI3ODU0NWUwODZmOTJkNDcyYWE3MzJlYSJ9XSwgImVuZHBvaW50c19saW5rcyI6IFtdLCAidHlwZSI6ICJjb21wdXRlIiwgIm5hbWUiOiAibm92YSJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3Ni92Mi80NzIzNGM3NTI3ODU0NWUwODZmOTJkNDcyYWE3MzJlYSIsICJyZWdpb24iOiAiUmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3Ni92Mi80NzIzNGM3NTI3ODU0NWUwODZmOTJkNDcyYWE3MzJlYSIsICJpZCI6ICIyMWZmYjM4MDk2NzE0MmEzOWNiNTNmZWQ5OTkxOWRjYSIsICJwdWJsaWNVUkwiOiAiaHR0cDovLzEyNy4wLjAuMTo4Nzc2L3YyLzQ3MjM0Yzc1Mjc4NTQ1ZTA4NmY5MmQ0NzJhYTczMmVhIn1dLCAiZW5kcG9pbnRzX2xpbmtzIjogW10sICJ0eXBlIjogInZvbHVtZXYyIiwgIm5hbWUiOiAiY2luZGVyIn0sIHsiZW5kcG9pbnRzIjogW3siYWRtaW5VUkwiOiAiaHR0cDovLzEyNy4wLjAuMTo4Nzc0L3YzIiwgInJlZ2lvbiI6ICJSZWdpb25PbmUiLCAiaW50ZXJuYWxVUkwiOiAiaHR0cDovLzEyNy4wLjAuMTo4Nzc0L3YzIiwgImlkIjogIjRmMjM0NDY3ZWJhNzRmMmY4MDVkOThjZDY5ZTdhYWMxIiwgInB1YmxpY1VSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjg3NzQvdjMifV0sICJlbmRwb2ludHNfbGlua3MiOiBbXSwgInR5cGUiOiAiY29tcHV0ZXYzIiwgIm5hbWUiOiAibm92YSJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6MzMzMyIsICJyZWdpb24iOiAiUmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6MzMzMyIsICJpZCI6ICI1YjgwNmQ4ZWEwZGI0MTk2YjcxZmQ2YmRiZTA0NmJlZiIsICJwdWJsaWNVUkwiOiAiaHR0cDovLzEyNy4wLjAuMTozMzMzIn1dLCAiZW5kcG9pbnRzX2xpbmtzIjogW10sICJ0eXBlIjogInMzIiwgIm5hbWUiOiAiczMifSwgeyJlbmRwb2ludHMiOiBbeyJhZG1pblVSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjkyOTIiLCAicmVnaW9uIjogIlJlZ2lvbk9uZSIsICJpbnRlcm5hbFVSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjkyOTIiLCAiaWQiOiAiNTkwNjdjMWM4MTdlNGVkZTlhMDVkYzZhZDA4NzcwYjMiLCAicHVibGljVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6OTI5MiJ9XSwgImVuZHBvaW50c19saW5rcyI6IFtdLCAidHlwZSI6ICJpbWFnZSIsICJuYW1lIjogImdsYW5jZSJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3Ni92MS80NzIzNGM3NTI3ODU0NWUwODZmOTJkNDcyYWE3MzJlYSIsICJyZWdpb24iOiAiUmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3Ni92MS80NzIzNGM3NTI3ODU0NWUwODZmOTJkNDcyYWE3MzJlYSIsICJpZCI6ICIzYTkwZjkxNDM1NGE0MmVmOGUzNGMzMTQxMzRkYWM4NyIsICJwdWJsaWNVUkwiOiAiaHR0cDovLzEyNy4wLjAuMTo4Nzc2L3YxLzQ3MjM0Yzc1Mjc4NTQ1ZTA4NmY5MmQ0NzJhYTczMmVhIn1dLCAiZW5kcG9pbnRzX2xpbmtzIjogW10sICJ0eXBlIjogInZvbHVtZSIsICJuYW1lIjogImNpbmRlciJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3My9zZXJ2aWNlcy9BZG1pbiIsICJyZWdpb24iOiAiUmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3My9zZXJ2aWNlcy9DbG91ZCIsICJpZCI6ICIzZGMxY2Q0M2YyNDM0ZGU1ODI4YzI3OTJiOWMxMmNjOSIsICJwdWJsaWNVUkwiOiAiaHR0cDovLzEyNy4wLjAuMTo4NzczL3NlcnZpY2VzL0Nsb3VkIn1dLCAiZW5kcG9pbnRzX2xpbmtzIjogW10sICJ0eXBlIjogImVjMiIsICJuYW1lIjogImVjMiJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODA4MCIsICJyZWdpb24iOiAiUmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODA4MC92MS9BVVRIXzQ3MjM0Yzc1Mjc4NTQ1ZTA4NmY5MmQ0NzJhYTczMmVhIiwgImlkIjogIjFmZjA4NTFhNTgzNjRlYmI5Y2ZmNjYyZmUwNGM3ZmEyIiwgInB1YmxpY1VSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjgwODAvdjEvQVVUSF80NzIzNGM3NTI3ODU0NWUwODZmOTJkNDcyYWE3MzJlYSJ9XSwgImVuZHBvaW50c19saW5rcyI6IFtdLCAidHlwZSI6ICJvYmplY3Qtc3RvcmUiLCAibmFtZSI6ICJzd2lmdCJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6MzUzNTcvdjIuMCIsICJyZWdpb24iOiAiUmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6NTAwMC92Mi4wIiwgImlkIjogIjA2MjE5MmFhODQwNzQ4YzJiNGIyMThmZGY2YjZlM2RhIiwgInB1YmxpY1VSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjUwMDAvdjIuMCJ9XSwgImVuZHBvaW50c19saW5rcyI6IFtdLCAidHlwZSI6ICJpZGVudGl0eSIsICJuYW1lIjogImtleXN0b25lIn1dLCAidXNlciI6IHsidXNlcm5hbWUiOiAiZGVtbyIsICJyb2xlc19saW5rcyI6IFtdLCAiaWQiOiAiNGVjNDA5ZDY2ZGYyNDkyNDgzYzc2MDRkYTkzOWQ5YjgiLCAicm9sZXMiOiBbeyJuYW1lIjogImFub3RoZXJyb2xlIn0sIHsibmFtZSI6ICJNZW1iZXIifV0sICJuYW1lIjogImRlbW8ifSwgIm1ldGFkYXRhIjogeyJpc19hZG1pbiI6IDAsICJyb2xlcyI6IFsiNGVlMGIwOTQ0NWFjNDk4Y2FhMWNmN2M4ZDY4MjNhNDAiLCAiMzAwYmQ3ZTUxMjI4NGJhOTg5YWVmN2U3OTUzZjI4M2IiXX19fTGCAYEwggF9AgEBMFwwVzELMAkGA1UEBhMCVVMxDjAMBgNVBAgMBVVuc2V0MQ4wDAYDVQQHDAVVbnNldDEOMAwGA1UECgwFVW5zZXQxGDAWBgNVBAMMD3d3dy5leGFtcGxlLmNvbQIBATAHBgUrDgMCGjANBgkqhkiG9w0BAQEFAASCAQCouxu8chI2534tVhv0Za5JLLkmcU-MuKV+XcxhBqUKIgdj-JiBfPOPcy0PmR-lEgjBckxQbYbPNEVL4GXHN36fSfdvNH+pPqndwNe8wIKzJbB0G0qocGbS8P+s4ub45-amOszPEGBKUrf65b9d9TZiE0eKB1Zh3eivANt8dQRMHVqEGd-2yz9VFc6S3NGSNObcfQ-qnqx+icOc1J99Ty9JJK8CMLS7g987fdqaCfdzKbSUIDcWE1fGvcyfKtO1jXXLULBGn8+gipnxTrFvsNifPT+VTrGLsEYtYBD5kY36JoiJFUfJ1NocI5DeEDzjKFAXpfTQSLfvxjDa5M-Izcr7", "tenant": {"description": null, "enabled": true, "id": "47234c75278545e086f92d472aa732ea", "name": "demo"}}, "serviceCatalog": [{"endpoints": [{"adminURL": "http://127.0.0.1:8774/v2/47234c75278545e086f92d472aa732ea", "region": "RegionOne", "internalURL": "http://127.0.0.1:8774/v2/47234c75278545e086f92d472aa732ea", "id": "028a6c0df90a4462b18ea7d8c5e25712", "publicURL": "http://127.0.0.1:8774/v2/47234c75278545e086f92d472aa732ea"}], "endpoints_links": [], "type": "compute", "name": "nova"}, {"endpoints": [{"adminURL": "http://127.0.0.1:8776/v2/47234c75278545e086f92d472aa732ea", "region": "RegionOne", "internalURL": "http://127.0.0.1:8776/v2/47234c75278545e086f92d472aa732ea", "id": "21ffb380967142a39cb53fed99919dca", "publicURL": "http://127.0.0.1:8776/v2/47234c75278545e086f92d472aa732ea"}], "endpoints_links": [], "type": "volumev2", "name": "cinder"}, {"endpoints": [{"adminURL": "http://127.0.0.1:8774/v3", "region": "RegionOne", "internalURL": "http://127.0.0.1:8774/v3", "id": "4f234467eba74f2f805d98cd69e7aac1", "publicURL": "http://127.0.0.1:8774/v3"}], "endpoints_links": [], "type": "computev3", "name": "nova"}, {"endpoints": [{"adminURL": "http://127.0.0.1:3333", "region": "RegionOne", "internalURL": "http://127.0.0.1:3333", "id": "5b806d8ea0db4196b71fd6bdbe046bef", "publicURL": "http://127.0.0.1:3333"}], "endpoints_links": [], "type": "s3", "name": "s3"}, {"endpoints": [{"adminURL": "http://127.0.0.1:9292", "region": "RegionOne", "internalURL": "http://127.0.0.1:9292", "id": "59067c1c817e4ede9a05dc6ad08770b3", "publicURL": "http://127.0.0.1:9292"}], "endpoints_links": [], "type": "image", "name": "glance"}, {"endpoints": [{"adminURL": "http://127.0.0.1:8776/v1/47234c75278545e086f92d472aa732ea", "region": "RegionOne", "internalURL": "http://127.0.0.1:8776/v1/47234c75278545e086f92d472aa732ea", "id": "3a90f914354a42ef8e34c314134dac87", "publicURL": "http://127.0.0.1:8776/v1/47234c75278545e086f92d472aa732ea"}], "endpoints_links": [], "type": "volume", "name": "cinder"}, {"endpoints": [{"adminURL": "http://127.0.0.1:8773/services/Admin", "region": "RegionOne", "internalURL": "http://127.0.0.1:8773/services/Cloud", "id": "3dc1cd43f2434de5828c2792b9c12cc9", "publicURL": "http://127.0.0.1:8773/services/Cloud"}], "endpoints_links": [], "type": "ec2", "name": "ec2"}, {"endpoints": [{"adminURL": "http://127.0.0.1:8080", "region": "RegionOne", "internalURL": "http://127.0.0.1:8080/v1/AUTH_47234c75278545e086f92d472aa732ea", "id": "1ff0851a58364ebb9cff662fe04c7fa2", "publicURL": "http://127.0.0.1:8080/v1/AUTH_47234c75278545e086f92d472aa732ea"}], "endpoints_links": [], "type": "object-store", "name": "swift"}, {"endpoints": [{"adminURL": "http://127.0.0.1:35357/v2.0", "region": "RegionOne", "internalURL": "http://127.0.0.1:5000/v2.0", "id": "062192aa840748c2b4b218fdf6b6e3da", "publicURL": "http://127.0.0.1:5000/v2.0"}], "endpoints_links": [], "type": "identity", "name": "keystone"}], "user": {"username": "demo", "roles_links": [], "id": "4ec409d66df2492483c7604da939d9b8", "roles": [{"name": "anotherrole"}, {"name": "Member"}], "name": "demo"}, "metadata": {"is_admin": 0, "roles": ["4ee0b09445ac498caa1cf7c8d6823a40", "300bd7e512284ba989aef7e7953f283b"]}}}

2013-12-27 01:20:08,149 Parsed 2013-12-28T01:20:08Z into {'tz_sign': None, 'second_fraction': None, 'hour': u'01', 'tz_hour': None, 'month': u'12', 'timezone': u'Z', 'second': u'08', 'tz_minute': None, 'year': u'2013', 'separator': u'T', 'day': u'28', 'minute': u'20'} with default timezone <iso8601.iso8601.Utc object at 0x23008d0>
2013-12-27 01:20:08,149 Got u'2013' for 'year' with default None
2013-12-27 01:20:08,149 Got u'12' for 'month' with default None
2013-12-27 01:20:08,150 Got u'28' for 'day' with default None
2013-12-27 01:20:08,150 Got u'01' for 'hour' with default None
2013-12-27 01:20:08,150 Got u'20' for 'minute' with default None
2013-12-27 01:20:08,150 Got u'08' for 'second' with default None
2013-12-27 01:20:08,151 Parsed 2013-12-28T01:20:08Z into {'tz_sign': None, 'second_fraction': None, 'hour': u'01', 'tz_hour': None, 'month': u'12', 'timezone': u'Z', 'second': u'08', 'tz_minute': None, 'year': u'2013', 'separator': u'T', 'day': u'28', 'minute': u'20'} with default timezone <iso8601.iso8601.Utc object at 0x23008d0>
2013-12-27 01:20:08,151 Got u'2013' for 'year' with default None
2013-12-27 01:20:08,151 Got u'12' for 'month' with default None
2013-12-27 01:20:08,151 Got u'28' for 'day' with default None
2013-12-27 01:20:08,152 Got u'01' for 'hour' with default None
2013-12-27 01:20:08,152 Got u'20' for 'minute' with default None
2013-12-27 01:20:08,152 Got u'08' for 'second' with default None
2013-12-27 01:20:08,152 REQ: curl -i -X GET http://127.0.0.1:35357/v2.0/users/4ec409d66df2492483c7604da939d9b8/credentials/OS-EC2 -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: MIIOtAYJKoZIhvcNAQcCoIIOpTCCDqECAQExCTAHBgUrDgMCGjCCDQoGCSqGSIb3DQEHAaCCDPsEggz3eyJhY2Nlc3MiOiB7InRva2VuIjogeyJpc3N1ZWRfYXQiOiAiMjAxMy0xMi0yN1QwMToyMDowOC4xMDMyMDgiLCAiZXhwaXJlcyI6ICIyMDEzLTEyLTI4VDAxOjIwOjA4WiIsICJpZCI6ICJwbGFjZWhvbGRlciIsICJ0ZW5hbnQiOiB7ImRlc2NyaXB0aW9uIjogbnVsbCwgImVuYWJsZWQiOiB0cnVlLCAiaWQiOiAiNDcyMzRjNzUyNzg1NDVlMDg2ZjkyZDQ3MmFhNzMyZWEiLCAibmFtZSI6ICJkZW1vIn19LCAic2VydmljZUNhdGFsb2ciOiBbeyJlbmRwb2ludHMiOiBbeyJhZG1pblVSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjg3NzQvdjIvNDcyMzRjNzUyNzg1NDVlMDg2ZjkyZDQ3MmFhNzMyZWEiLCAicmVnaW9uIjogIlJlZ2lvbk9uZSIsICJpbnRlcm5hbFVSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjg3NzQvdjIvNDcyMzRjNzUyNzg1NDVlMDg2ZjkyZDQ3MmFhNzMyZWEiLCAiaWQiOiAiMDI4YTZjMGRmOTBhNDQ2MmIxOGVhN2Q4YzVlMjU3MTIiLCAicHVibGljVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3NC92Mi80NzIzNGM3NTI3ODU0NWUwODZmOTJkNDcyYWE3MzJlYSJ9XSwgImVuZHBvaW50c19saW5rcyI6IFtdLCAidHlwZSI6ICJjb21wdXRlIiwgIm5hbWUiOiAibm92YSJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3Ni92Mi80NzIzNGM3NTI3ODU0NWUwODZmOTJkNDcyYWE3MzJlYSIsICJyZWdpb24iOiAiUmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3Ni92Mi80NzIzNGM3NTI3ODU0NWUwODZmOTJkNDcyYWE3MzJlYSIsICJpZCI6ICIyMWZmYjM4MDk2NzE0MmEzOWNiNTNmZWQ5OTkxOWRjYSIsICJwdWJsaWNVUkwiOiAiaHR0cDovLzEyNy4wLjAuMTo4Nzc2L3YyLzQ3MjM0Yzc1Mjc4NTQ1ZTA4NmY5MmQ0NzJhYTczMmVhIn1dLCAiZW5kcG9pbnRzX2xpbmtzIjogW10sICJ0eXBlIjogInZvbHVtZXYyIiwgIm5hbWUiOiAiY2luZGVyIn0sIHsiZW5kcG9pbnRzIjogW3siYWRtaW5VUkwiOiAiaHR0cDovLzEyNy4wLjAuMTo4Nzc0L3YzIiwgInJlZ2lvbiI6ICJSZWdpb25PbmUiLCAiaW50ZXJuYWxVUkwiOiAiaHR0cDovLzEyNy4wLjAuMTo4Nzc0L3YzIiwgImlkIjogIjRmMjM0NDY3ZWJhNzRmMmY4MDVkOThjZDY5ZTdhYWMxIiwgInB1YmxpY1VSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjg3NzQvdjMifV0sICJlbmRwb2ludHNfbGlua3MiOiBbXSwgInR5cGUiOiAiY29tcHV0ZXYzIiwgIm5hbWUiOiAibm92YSJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6MzMzMyIsICJyZWdpb24iOiAiUmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6MzMzMyIsICJpZCI6ICI1YjgwNmQ4ZWEwZGI0MTk2YjcxZmQ2YmRiZTA0NmJlZiIsICJwdWJsaWNVUkwiOiAiaHR0cDovLzEyNy4wLjAuMTozMzMzIn1dLCAiZW5kcG9pbnRzX2xpbmtzIjogW10sICJ0eXBlIjogInMzIiwgIm5hbWUiOiAiczMifSwgeyJlbmRwb2ludHMiOiBbeyJhZG1pblVSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjkyOTIiLCAicmVnaW9uIjogIlJlZ2lvbk9uZSIsICJpbnRlcm5hbFVSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjkyOTIiLCAiaWQiOiAiNTkwNjdjMWM4MTdlNGVkZTlhMDVkYzZhZDA4NzcwYjMiLCAicHVibGljVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6OTI5MiJ9XSwgImVuZHBvaW50c19saW5rcyI6IFtdLCAidHlwZSI6ICJpbWFnZSIsICJuYW1lIjogImdsYW5jZSJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3Ni92MS80NzIzNGM3NTI3ODU0NWUwODZmOTJkNDcyYWE3MzJlYSIsICJyZWdpb24iOiAiUmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3Ni92MS80NzIzNGM3NTI3ODU0NWUwODZmOTJkNDcyYWE3MzJlYSIsICJpZCI6ICIzYTkwZjkxNDM1NGE0MmVmOGUzNGMzMTQxMzRkYWM4NyIsICJwdWJsaWNVUkwiOiAiaHR0cDovLzEyNy4wLjAuMTo4Nzc2L3YxLzQ3MjM0Yzc1Mjc4NTQ1ZTA4NmY5MmQ0NzJhYTczMmVhIn1dLCAiZW5kcG9pbnRzX2xpbmtzIjogW10sICJ0eXBlIjogInZvbHVtZSIsICJuYW1lIjogImNpbmRlciJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3My9zZXJ2aWNlcy9BZG1pbiIsICJyZWdpb24iOiAiUmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODc3My9zZXJ2aWNlcy9DbG91ZCIsICJpZCI6ICIzZGMxY2Q0M2YyNDM0ZGU1ODI4YzI3OTJiOWMxMmNjOSIsICJwdWJsaWNVUkwiOiAiaHR0cDovLzEyNy4wLjAuMTo4NzczL3NlcnZpY2VzL0Nsb3VkIn1dLCAiZW5kcG9pbnRzX2xpbmtzIjogW10sICJ0eXBlIjogImVjMiIsICJuYW1lIjogImVjMiJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODA4MCIsICJyZWdpb24iOiAiUmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6ODA4MC92MS9BVVRIXzQ3MjM0Yzc1Mjc4NTQ1ZTA4NmY5MmQ0NzJhYTczMmVhIiwgImlkIjogIjFmZjA4NTFhNTgzNjRlYmI5Y2ZmNjYyZmUwNGM3ZmEyIiwgInB1YmxpY1VSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjgwODAvdjEvQVVUSF80NzIzNGM3NTI3ODU0NWUwODZmOTJkNDcyYWE3MzJlYSJ9XSwgImVuZHBvaW50c19saW5rcyI6IFtdLCAidHlwZSI6ICJvYmplY3Qtc3RvcmUiLCAibmFtZSI6ICJzd2lmdCJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6MzUzNTcvdjIuMCIsICJyZWdpb24iOiAiUmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly8xMjcuMC4wLjE6NTAwMC92Mi4wIiwgImlkIjogIjA2MjE5MmFhODQwNzQ4YzJiNGIyMThmZGY2YjZlM2RhIiwgInB1YmxpY1VSTCI6ICJodHRwOi8vMTI3LjAuMC4xOjUwMDAvdjIuMCJ9XSwgImVuZHBvaW50c19saW5rcyI6IFtdLCAidHlwZSI6ICJpZGVudGl0eSIsICJuYW1lIjogImtleXN0b25lIn1dLCAidXNlciI6IHsidXNlcm5hbWUiOiAiZGVtbyIsICJyb2xlc19saW5rcyI6IFtdLCAiaWQiOiAiNGVjNDA5ZDY2ZGYyNDkyNDgzYzc2MDRkYTkzOWQ5YjgiLCAicm9sZXMiOiBbeyJuYW1lIjogImFub3RoZXJyb2xlIn0sIHsibmFtZSI6ICJNZW1iZXIifV0sICJuYW1lIjogImRlbW8ifSwgIm1ldGFkYXRhIjogeyJpc19hZG1pbiI6IDAsICJyb2xlcyI6IFsiNGVlMGIwOTQ0NWFjNDk4Y2FhMWNmN2M4ZDY4MjNhNDAiLCAiMzAwYmQ3ZTUxMjI4NGJhOTg5YWVmN2U3OTUzZjI4M2IiXX19fTGCAYEwggF9AgEBMFwwVzELMAkGA1UEBhMCVVMxDjAMBgNVBAgMBVVuc2V0MQ4wDAYDVQQHDAVVbnNldDEOMAwGA1UECgwFVW5zZXQxGDAWBgNVBAMMD3d3dy5leGFtcGxlLmNvbQIBATAHBgUrDgMCGjANBgkqhkiG9w0BAQEFAASCAQCouxu8chI2534tVhv0Za5JLLkmcU-MuKV+XcxhBqUKIgdj-JiBfPOPcy0PmR-lEgjBckxQbYbPNEVL4GXHN36fSfdvNH+pPqndwNe8wIKzJbB0G0qocGbS8P+s4ub45-amOszPEGBKUrf65b9d9TZiE0eKB1Zh3eivANt8dQRMHVqEGd-2yz9VFc6S3NGSNObcfQ-qnqx+icOc1J99Ty9JJK8CMLS7g987fdqaCfdzKbSUIDcWE1fGvcyfKtO1jXXLULBGn8+gipnxTrFvsNifPT+VTrGLsEYtYBD5kY36JoiJFUfJ1NocI5DeEDzjKFAXpfTQSLfvxjDa5M-Izcr7"
2013-12-27 01:20:08,154 Starting new HTTP connection (1): 127.0.0.1
2013-12-27 01:20:08,186 "GET /v2.0/users/4ec409d66df2492483c7604da939d9b8/credentials/OS-EC2 HTTP/1.1" 200 433
2013-12-27 01:20:08,187 RESP: [200] CaseInsensitiveDict({'date': 'Fri, 27 Dec 2013 01:20:08 GMT', 'vary': 'X-Auth-Token', 'content-length': '433', 'content-type': 'application/json'})
RESP BODY: {"credentials": [{"access": "aafd7f75efb94e1184e5a37f33bc26d9", "tenant_id": "47234c75278545e086f92d472aa732ea", "secret": "4f3eff02a2a34ef985ba6bc092b077c4", "user_id": "4ec409d66df2492483c7604da939d9b8", "trust_id": null}, {"access": "d9b85f59d0d449be8f767cadf8ce9ddc", "tenant_id": "96869b560b7b4ac88147194347a03504", "secret": "1600df066e0c4a78af1c0839ea38995e", "user_id": "4ec409d66df2492483c7604da939d9b8", "trust_id": null}]}
}}}

Traceback (most recent call last):
  File "tempest/thirdparty/boto/test_s3_objects.py", line 42, in test_create_get_delete_object
    bucket = self.client.create_bucket(bucket_name)
  File "tempest/services/botoclients.py", line 77, in func
    return getattr(conn, name)(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/boto/s3/connection.py", line 498, in create_bucket
    data=data)
  File "/usr/local/lib/python2.7/dist-packages/boto/s3/connection.py", line 550, in make_request
    retry_handler=retry_handler
  File "/usr/local/lib/python2.7/dist-packages/boto/connection.py", line 1017, in make_request
    retry_handler=retry_handler)
  File "/usr/local/lib/python2.7/dist-packages/boto/connection.py", line 897, in _mexe
    request.body, request.headers)
  File "/usr/lib/python2.7/httplib.py", line 958, in request
    self._send_request(method, url, body, headers)
  File "/usr/lib/python2.7/httplib.py", line 992, in _send_request
    self.endheaders(body)
  File "/usr/lib/python2.7/httplib.py", line 954, in endheaders
    self._send_output(message_body)
  File "/usr/lib/python2.7/httplib.py", line 814, in _send_output
    self.send(msg)
  File "/usr/lib/python2.7/httplib.py", line 776, in send
    self.connect()
  File "/usr/lib/python2.7/httplib.py", line 757, in connect
    self.timeout, self.source_address)
  File "/usr/lib/python2.7/socket.py", line 571, in create_connection
    raise err
error: [Errno 111] Connection refused

[Mauro S M Rodrigues (maurorodrigues)]

Two questions:
Is s3 api provided by ec2 api on nova? I ask that because of the line:
GET http://127.0.0.1:35357/v2.0/users/4ec409d66df2492483c7604da939d9b8/credentials/OS-EC2

If so, since we have a problem to kill nova-api process (http://lists.openstack.org/pipermail/openstack-dev/2013-December/022796.html ) and due to that we don't have any logs about nova-api which refused the connection

Can you provide steps to reproduce it locally?

Thanks

[Mauro S M Rodrigues (maurorodrigues)]

Forgive me and sorry for my comment which doesn't make sense at all. will remove the incomplete and wait for someone else to see this.

[David Kranz (david-kranz)]

I don't see any recent hits in logstash for this and it looks more like an infra or other flaky than a tempest bug.