[ https://issues.apache.org/jira/browse/CLOUDSTACK-6863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gaurav Aradhye resolved CLOUDSTACK-6863. ---------------------------------------- Resolution: Fixed > [Automation] test_09_delete_detached_volume failing inconsistently with > during simulator run > --------------------------------------------------------------------------------------------- > > Key: CLOUDSTACK-6863 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-6863 > Project: CloudStack > Issue Type: Test > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Automation > Affects Versions: 4.4.0 > Reporter: Rayees Namathponnan > Priority: Blocker > Fix For: 4.4.0 > > > Error Message > Job failed: {jobprocstatus : 0, created : u'2014-06-08T08:22:13-0700', cmd : > u'org.apache.cloudstack.api.command.admin.volume.AttachVolumeCmdByAdmin', > userid : u'4c29db3e-ef1e-11e3-a86b-00163e0af42c', jobstatus : 2, jobid : > u'83431fd6-b825-4135-9ad8-2569d640c49c', jobresultcode : 530, jobresulttype : > u'object', jobresult : {errorcode : 530, errortext : u'Unexpected > exception'}, accountid : u'4c29b190-ef1e-11e3-a86b-00163e0af42c'} > -------------------- >> begin captured stdout << --------------------- > === TestName: test_09_delete_detached_volume | Status : EXCEPTION === > --------------------- >> end captured stdout << ---------------------- > -------------------- >> begin captured logging << -------------------- > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: ::::::::::::STARTED : TC: test_09_delete_detached_volume ::::::::::: > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: Delete Volume ID: 272cac5d-ae41-4050-9de4-8423f868cafd > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: Payload: {'account': u'test-account-TestCreateVolume-4E4YII', > 'domainid': u'4c297c20-ef1e-11e3-a86b-00163e0af42c', 'name': 'Test Volume', > 'zoneid': u'b7c31495-c072-48b0-8a58-6f306766e5fb', 'apiKey': > u'itSv94rGboiox-l2LC0VMd7G23t_AbSJWTe_itqpq662L3ZycKb8e-YR6nGLeOXj139gHU4E4OQM30re12HD4A', > 'command': 'createVolume', 'signature': 'EkCWUkVoE7Z70x8DFQq3YFEzuqQ=', > 'diskofferingid': u'0445f51d-b324-49bf-9bec-f144d937a5da', 'response': 'json'} > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: ========Sending GET Cmd : createVolume======= > requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection > (1): 172.16.88.23 > requests.packages.urllib3.connectionpool: DEBUG: "GET > /client/api?account=test-account-TestCreateVolume-4E4YII&domainid=4c297c20-ef1e-11e3-a86b-00163e0af42c&name=Test+Volume&zoneid=b7c31495-c072-48b0-8a58-6f306766e5fb&apiKey=itSv94rGboiox-l2LC0VMd7G23t_AbSJWTe_itqpq662L3ZycKb8e-YR6nGLeOXj139gHU4E4OQM30re12HD4A&command=createVolume&signature=EkCWUkVoE7Z70x8DFQq3YFEzuqQ%3D&diskofferingid=0445f51d-b324-49bf-9bec-f144d937a5da&response=json > HTTP/1.1" 200 121 > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: === Jobid: 0cf9d61c-011a-421d-aff1-888bff6dd1ae Started === > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: Payload: {'signature': 'N835/7k+Amcr5xbSUAn2G+mxTco=', 'apiKey': > u'itSv94rGboiox-l2LC0VMd7G23t_AbSJWTe_itqpq662L3ZycKb8e-YR6nGLeOXj139gHU4E4OQM30re12HD4A', > 'command': 'queryAsyncJobResult', 'response': 'json', 'jobid': > u'0cf9d61c-011a-421d-aff1-888bff6dd1ae'} > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: ========Sending GET Cmd : queryAsyncJobResult======= > requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection > (1): 172.16.88.23 > requests.packages.urllib3.connectionpool: DEBUG: "GET > /client/api?jobid=0cf9d61c-011a-421d-aff1-888bff6dd1ae&apiKey=itSv94rGboiox-l2LC0VMd7G23t_AbSJWTe_itqpq662L3ZycKb8e-YR6nGLeOXj139gHU4E4OQM30re12HD4A&command=queryAsyncJobResult&response=json&signature=N835%2F7k%2BAmcr5xbSUAn2G%2BmxTco%3D > HTTP/1.1" 200 430 > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: Response : {jobprocstatus : 0, created : u'2014-06-08T08:22:08-0700', > cmd : > u'org.apache.cloudstack.api.command.admin.volume.CreateVolumeCmdByAdmin', > userid : u'4c29db3e-ef1e-11e3-a86b-00163e0af42c', jobstatus : 0, jobid : > u'0cf9d61c-011a-421d-aff1-888bff6dd1ae', jobresultcode : 0, jobinstanceid : > u'2094423c-96fc-45af-a898-f058ef742c05', jobinstancetype : u'Volume', > accountid : u'4c29b190-ef1e-11e3-a86b-00163e0af42c'} > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: === JobId:0cf9d61c-011a-421d-aff1-888bff6dd1ae is Still Processing, > Will TimeOut in:3595 ==== > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: Payload: {'signature': 'N835/7k+Amcr5xbSUAn2G+mxTco=', 'apiKey': > u'itSv94rGboiox-l2LC0VMd7G23t_AbSJWTe_itqpq662L3ZycKb8e-YR6nGLeOXj139gHU4E4OQM30re12HD4A', > 'command': 'queryAsyncJobResult', 'response': 'json', 'jobid': > u'0cf9d61c-011a-421d-aff1-888bff6dd1ae'} > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: ========Sending GET Cmd : queryAsyncJobResult======= > requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection > (1): 172.16.88.23 > requests.packages.urllib3.connectionpool: DEBUG: "GET > /client/api?jobid=0cf9d61c-011a-421d-aff1-888bff6dd1ae&apiKey=itSv94rGboiox-l2LC0VMd7G23t_AbSJWTe_itqpq662L3ZycKb8e-YR6nGLeOXj139gHU4E4OQM30re12HD4A&command=queryAsyncJobResult&response=json&signature=N835%2F7k%2BAmcr5xbSUAn2G%2BmxTco%3D > HTTP/1.1" 200 1075 > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: Response : {jobprocstatus : 0, created : u'2014-06-08T08:22:08-0700', > cmd : > u'org.apache.cloudstack.api.command.admin.volume.CreateVolumeCmdByAdmin', > userid : u'4c29db3e-ef1e-11e3-a86b-00163e0af42c', jobstatus : 1, jobid : > u'0cf9d61c-011a-421d-aff1-888bff6dd1ae', jobresultcode : 0, jobresulttype : > u'object', jobresult : {domain : u'ROOT', domainid : > u'4c297c20-ef1e-11e3-a86b-00163e0af42c', jobstatus : 0, zoneid : > u'b7c31495-c072-48b0-8a58-6f306766e5fb', quiescevm : False, id : > u'2094423c-96fc-45af-a898-f058ef742c05', size : 1073741824, diskofferingname > : u'Disk offering', diskofferingdisplaytext : u'Disk offering', displayvolume > : True, destroyed : False, state : u'Allocated', type : u'DATADISK', zonename > : u'Sandbox-simulator', tags : [], isextractable : True, account : > u'test-account-TestCreateVolume-4E4YII', name : u'Test Volume', created : > u'2014-06-08T08:22:08-0700', storagetype : u'shared', hypervisor : u'None', > jobid : u'0cf9d61c-011a-421d-aff1-888bff6dd1ae', diskofferingid : > u'0445f51d-b324-49bf-9bec-f144d937a5da'}, accountid : > u'4c29b190-ef1e-11e3-a86b-00163e0af42c'} > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: ===Jobid:0cf9d61c-011a-421d-aff1-888bff6dd1ae ; StartTime:Sun Jun 8 > 20:56:46 2014 ; EndTime:Sun Jun 8 20:56:51 2014 ; TotalTime:-5=== > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: Response : {jobprocstatus : 0, created : u'2014-06-08T08:22:08-0700', > cmd : > u'org.apache.cloudstack.api.command.admin.volume.CreateVolumeCmdByAdmin', > userid : u'4c29db3e-ef1e-11e3-a86b-00163e0af42c', jobstatus : 1, jobid : > u'0cf9d61c-011a-421d-aff1-888bff6dd1ae', jobresultcode : 0, jobresulttype : > u'object', jobresult : {domain : u'ROOT', domainid : > u'4c297c20-ef1e-11e3-a86b-00163e0af42c', jobstatus : 0, zoneid : > u'b7c31495-c072-48b0-8a58-6f306766e5fb', quiescevm : False, id : > u'2094423c-96fc-45af-a898-f058ef742c05', size : 1073741824, diskofferingname > : u'Disk offering', diskofferingdisplaytext : u'Disk offering', displayvolume > : True, destroyed : False, state : u'Allocated', type : u'DATADISK', zonename > : u'Sandbox-simulator', tags : [], isextractable : True, account : > u'test-account-TestCreateVolume-4E4YII', name : u'Test Volume', created : > u'2014-06-08T08:22:08-0700', storagetype : u'shared', hypervisor : u'None', > jobid : u'0cf9d61c-011a-421d-aff1-888bff6dd1ae', diskofferingid : > u'0445f51d-b324-49bf-9bec-f144d937a5da'}, accountid : > u'4c29b190-ef1e-11e3-a86b-00163e0af42c'} > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: Payload: {'apiKey': > u'itSv94rGboiox-l2LC0VMd7G23t_AbSJWTe_itqpq662L3ZycKb8e-YR6nGLeOXj139gHU4E4OQM30re12HD4A', > 'virtualmachineid': u'713d9214-6e5d-424c-b69f-5e2e670d09cb', 'id': > u'2094423c-96fc-45af-a898-f058ef742c05', 'command': 'attachVolume', > 'signature': 'XYEw/Ihjwuv1+rQSOui85iOR9ws=', 'response': 'json'} > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: ========Sending GET Cmd : attachVolume======= > requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection > (1): 172.16.88.23 > requests.packages.urllib3.connectionpool: DEBUG: "GET > /client/api?apiKey=itSv94rGboiox-l2LC0VMd7G23t_AbSJWTe_itqpq662L3ZycKb8e-YR6nGLeOXj139gHU4E4OQM30re12HD4A&virtualmachineid=713d9214-6e5d-424c-b69f-5e2e670d09cb&id=2094423c-96fc-45af-a898-f058ef742c05&command=attachVolume&signature=XYEw%2FIhjwuv1%2BrQSOui85iOR9ws%3D&response=json > HTTP/1.1" 200 77 > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: === Jobid: 83431fd6-b825-4135-9ad8-2569d640c49c Started === > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: Payload: {'signature': 'nOn4ZhqJz4r0RvI62cuEsnaSRXU=', 'apiKey': > u'itSv94rGboiox-l2LC0VMd7G23t_AbSJWTe_itqpq662L3ZycKb8e-YR6nGLeOXj139gHU4E4OQM30re12HD4A', > 'command': 'queryAsyncJobResult', 'response': 'json', 'jobid': > u'83431fd6-b825-4135-9ad8-2569d640c49c'} > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: ========Sending GET Cmd : queryAsyncJobResult======= > requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection > (1): 172.16.88.23 > requests.packages.urllib3.connectionpool: DEBUG: "GET > /client/api?jobid=83431fd6-b825-4135-9ad8-2569d640c49c&apiKey=itSv94rGboiox-l2LC0VMd7G23t_AbSJWTe_itqpq662L3ZycKb8e-YR6nGLeOXj139gHU4E4OQM30re12HD4A&command=queryAsyncJobResult&response=json&signature=nOn4ZhqJz4r0RvI62cuEsnaSRXU%3D > HTTP/1.1" 200 430 > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: Response : {jobprocstatus : 0, created : u'2014-06-08T08:22:13-0700', > cmd : > u'org.apache.cloudstack.api.command.admin.volume.AttachVolumeCmdByAdmin', > userid : u'4c29db3e-ef1e-11e3-a86b-00163e0af42c', jobstatus : 0, jobid : > u'83431fd6-b825-4135-9ad8-2569d640c49c', jobresultcode : 0, jobinstanceid : > u'2094423c-96fc-45af-a898-f058ef742c05', jobinstancetype : u'Volume', > accountid : u'4c29b190-ef1e-11e3-a86b-00163e0af42c'} > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: === JobId:83431fd6-b825-4135-9ad8-2569d640c49c is Still Processing, > Will TimeOut in:3595 ==== > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: Payload: {'signature': 'nOn4ZhqJz4r0RvI62cuEsnaSRXU=', 'apiKey': > u'itSv94rGboiox-l2LC0VMd7G23t_AbSJWTe_itqpq662L3ZycKb8e-YR6nGLeOXj139gHU4E4OQM30re12HD4A', > 'command': 'queryAsyncJobResult', 'response': 'json', 'jobid': > u'83431fd6-b825-4135-9ad8-2569d640c49c'} > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: ========Sending GET Cmd : queryAsyncJobResult======= > requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection > (1): 172.16.88.23 > requests.packages.urllib3.connectionpool: DEBUG: "GET > /client/api?jobid=83431fd6-b825-4135-9ad8-2569d640c49c&apiKey=itSv94rGboiox-l2LC0VMd7G23t_AbSJWTe_itqpq662L3ZycKb8e-YR6nGLeOXj139gHU4E4OQM30re12HD4A&command=queryAsyncJobResult&response=json&signature=nOn4ZhqJz4r0RvI62cuEsnaSRXU%3D > HTTP/1.1" 200 440 > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: Response : {jobprocstatus : 0, created : u'2014-06-08T08:22:13-0700', > cmd : > u'org.apache.cloudstack.api.command.admin.volume.AttachVolumeCmdByAdmin', > userid : u'4c29db3e-ef1e-11e3-a86b-00163e0af42c', jobstatus : 2, jobid : > u'83431fd6-b825-4135-9ad8-2569d640c49c', jobresultcode : 530, jobresulttype : > u'object', jobresult : {errorcode : 530, errortext : u'Unexpected > exception'}, accountid : u'4c29b190-ef1e-11e3-a86b-00163e0af42c'} > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > ERROR: ==== __poll: Exception Occurred :Job failed: {jobprocstatus : 0, > created : u'2014-06-08T08:22:13-0700', cmd : > u'org.apache.cloudstack.api.command.admin.volume.AttachVolumeCmdByAdmin', > userid : u'4c29db3e-ef1e-11e3-a86b-00163e0af42c', jobstatus : 2, jobid : > u'83431fd6-b825-4135-9ad8-2569d640c49c', jobresultcode : 530, jobresulttype : > u'object', jobresult : {errorcode : 530, errortext : u'Unexpected > exception'}, accountid : u'4c29b190-ef1e-11e3-a86b-00163e0af42c'} ==== > Traceback (most recent call last): > File > "/automation/virtenv/00-16-3e-0a-f4-2c/597/testenv/lib/python2.7/site-packages/marvin/cloudstackConnection.py", > line 105, in __poll > % async_response) > Exception: Job failed: {jobprocstatus : 0, created : > u'2014-06-08T08:22:13-0700', cmd : > u'org.apache.cloudstack.api.command.admin.volume.AttachVolumeCmdByAdmin', > userid : u'4c29db3e-ef1e-11e3-a86b-00163e0af42c', jobstatus : 2, jobid : > u'83431fd6-b825-4135-9ad8-2569d640c49c', jobresultcode : 530, jobresulttype : > u'object', jobresult : {errorcode : 530, errortext : u'Unexpected > exception'}, accountid : u'4c29b190-ef1e-11e3-a86b-00163e0af42c'} > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > DEBUG: Response : FAILED > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > ERROR: marvinRequest : CmdName: > <marvin.cloudstackAPI.attachVolume.attachVolumeCmd object at 0x29507d0> > Exception: ['Traceback (most recent call last):\n', ' File > "/automation/virtenv/00-16-3e-0a-f4-2c/597/testenv/lib/python2.7/site-packages/marvin/cloudstackConnection.py", > line 373, in marvinRequest\n raise self.__lastError\n', "Exception: Job > failed: {jobprocstatus : 0, created : u'2014-06-08T08:22:13-0700', cmd : > u'org.apache.cloudstack.api.command.admin.volume.AttachVolumeCmdByAdmin', > userid : u'4c29db3e-ef1e-11e3-a86b-00163e0af42c', jobstatus : 2, jobid : > u'83431fd6-b825-4135-9ad8-2569d640c49c', jobresultcode : 530, jobresulttype : > u'object', jobresult : {errorcode : 530, errortext : u'Unexpected > exception'}, accountid : u'4c29b190-ef1e-11e3-a86b-00163e0af42c'}\n"] > Traceback (most recent call last): > File > "/automation/virtenv/00-16-3e-0a-f4-2c/597/testenv/lib/python2.7/site-packages/marvin/cloudstackConnection.py", > line 373, in marvinRequest > raise self.__lastError > Exception: Job failed: {jobprocstatus : 0, created : > u'2014-06-08T08:22:13-0700', cmd : > u'org.apache.cloudstack.api.command.admin.volume.AttachVolumeCmdByAdmin', > userid : u'4c29db3e-ef1e-11e3-a86b-00163e0af42c', jobstatus : 2, jobid : > u'83431fd6-b825-4135-9ad8-2569d640c49c', jobresultcode : 530, jobresulttype : > u'object', jobresult : {errorcode : 530, errortext : u'Unexpected > exception'}, accountid : u'4c29b190-ef1e-11e3-a86b-00163e0af42c'} > test_09_delete_detached_volume (integration.smoke.test_volumes.TestVolumes): > CRITICAL: EXCEPTION: test_09_delete_detached_volume: ['Traceback (most recent > call last):\n', ' File "/usr/local/lib/python2.7/unittest/case.py", line > 331, in run\n testMethod()\n', ' File > "/automation/virtenv/00-16-3e-0a-f4-2c/597/test/integration/smoke/test_volumes.py", > line 731, in test_09_delete_detached_volume\n > self.virtual_machine.attach_volume(self.apiClient, self.volume_1)\n', ' File > "/automation/virtenv/00-16-3e-0a-f4-2c/597/testenv/lib/python2.7/site-packages/marvin/lib/base.py", > line 647, in attach_volume\n return apiclient.attachVolume(cmd)\n', ' > File > "/automation/virtenv/00-16-3e-0a-f4-2c/597/testenv/lib/python2.7/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py", > line 1565, in attachVolume\n response = > self.connection.marvinRequest(command, response_type=response, > method=method)\n', ' File > "/automation/virtenv/00-16-3e-0a-f4-2c/597/testenv/lib/python2.7/site-packages/marvin/cloudstackConnection.py", > line 378, in marvinRequest\n raise e\n', "Exception: Job failed: > {jobprocstatus : 0, created : u'2014-06-08T08:22:13-0700', cmd : > u'org.apache.cloudstack.api.command.admin.volume.AttachVolumeCmdByAdmin', > userid : u'4c29db3e-ef1e-11e3-a86b-00163e0af42c', jobstatus : 2, jobid : > u'83431fd6-b825-4135-9ad8-2569d640c49c', jobresultcode : 530, jobresulttype : > u'object', jobresult : {errorcode : 530, errortext : u'Unexpected > exception'}, accountid : u'4c29b190-ef1e-11e3-a86b-00163e0af42c'}\n"] > --------------------- >> end captured logging << --------------------- -- This message was sent by Atlassian JIRA (v6.2#6252)