Sailaja Mada created CLOUDSTACK-1639: ----------------------------------------
Summary: Failed to enable primary storage to maintenance mode [Primary storage added at the cluster level] Key: CLOUDSTACK-1639 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-1639 Project: CloudStack Issue Type: Bug Security Level: Public (Anyone can view this level - this is the default.) Components: Storage Controller Affects Versions: 4.2.0 Reporter: Sailaja Mada Assignee: edison su Priority: Critical Setup: Advanced networking zone with Xen 6.1 Steps: 1. Tried to enable primary storage to maintenance mode which is in up state, Observation : It failed with below exception. 2013-03-12 12:28:40,965 DEBUG [cloud.api.ApiServlet] (catalina-exec-5:null) ===END=== 10.144.7.13 -- GET command=listStoragePools&id=ef996b6b-80d7-3c64-b83a-7017cd620c28&response=json&sessionkey=hDfOx9R3UY3sQnY4xMSW8G%2BINEE%3D&_=1363071600847 2013-03-12 12:28:41,404 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-14:null) Ping from 4 2013-03-12 12:28:41,447 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-15:null) Ping from 3 2013-03-12 12:28:43,011 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===START=== 10.144.7.13 -- GET command=enableStorageMaintenance&id=ef996b6b-80d7-3c64-b83a-7017cd620c28&response=json&sessionkey=hDfOx9R3UY3sQnY4xMSW8G%2BINEE%3D&_=1363071602844 2013-03-12 12:28:43,034 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-1:null) submit async job-74, details: AsyncJobVO {id:74, userId: 2, accountId: 2, sessionKey: null, instanceType: null, instanceId: 202, cmd: org.apache.cloudstack.api.command.admin.storage.PreparePrimaryStorageForMaintenanceCmd, cmdOriginator: null, cmdInfo: {"response":"json","id":"ef996b6b-80d7-3c64-b83a-7017cd620c28","sessionkey":"hDfOx9R3UY3sQnY4xMSW8G+INEE\u003d","ctxUserId":"2","_":"1363071602844","ctxAccountId":"2","ctxStartEventId":"101"}, cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, processStatus: 0, resultCode: 0, result: null, initMsid: 222273143235720, completeMsid: null, lastUpdated: null, lastPolled: null, created: null} 2013-03-12 12:28:43,036 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===END=== 10.144.7.13 -- GET command=enableStorageMaintenance&id=ef996b6b-80d7-3c64-b83a-7017cd620c28&response=json&sessionkey=hDfOx9R3UY3sQnY4xMSW8G%2BINEE%3D&_=1363071602844 2013-03-12 12:28:43,038 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-51:job-74) Executing org.apache.cloudstack.api.command.admin.storage.PreparePrimaryStorageForMaintenanceCmd for job-74 2013-03-12 12:28:43,046 ERROR [cloud.async.AsyncJobManagerImpl] (Job-Executor-51:job-74) Unexpected exception while executing org.apache.cloudstack.api.command.admin.storage.PreparePrimaryStorageForMaintenanceCmd com.cloud.exception.InvalidParameterValueException: Primary storage with id 202 is not ready for migration, as the status is:Up at com.cloud.storage.StorageManagerImpl.preparePrimaryStorageForMaintenance(StorageManagerImpl.java:1411) at com.cloud.storage.StorageManagerImpl.preparePrimaryStorageForMaintenance(StorageManagerImpl.java:190) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:319) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80) at com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:40) at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202) at $Proxy115.preparePrimaryStorageForMaintenance(Unknown Source) at org.apache.cloudstack.api.command.admin.storage.PreparePrimaryStorageForMaintenanceCmd.execute(PreparePrimaryStorageForMaintenanceCmd.java:102) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:165) at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80) at com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:46) at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2013-03-12 12:28:43,048 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-51:job-74) Complete async job-74, jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Primary storage with id 202 is not ready for migration, as the status is:Up mysql> select * from storage_pool; +-----+----------+--------------------------------------+-------------------+------+----------------+--------+------------+-----------------+----------------+----------------+-----------+------------------------+---------------------+---------+-------------+--------+---------------------+---------+ | id | name | uuid | pool_type | port | data_center_id | pod_id | cluster_id | available_bytes | capacity_bytes | host_address | user_info | path | created | removed | update_time | status | storage_provider_id | scope | +-----+----------+--------------------------------------+-------------------+------+----------------+--------+------------+-----------------+----------------+----------------+-----------+------------------------+---------------------+---------+-------------+--------+---------------------+---------+ | 200 | primary1 | 13d6ff71-ac44-32b4-8d82-a6a005bf9ec2 | NetworkFilesystem | 2049 | 1 | 1 | 1 | 296157315072 | 879609315328 | 10.102.192.100 | NULL | /cpg_vol/sailaja/xenps | 2013-03-11 11:23:40 | NULL | NULL | Up | 3 | CLUSTER | | 201 | primary2 | 14cde048-318f-3033-84e9-f9f3e28e30c4 | NetworkFilesystem | 2049 | 1 | NULL | NULL | 0 | 0 | 10.102.192.100 | NULL | /cpg_vol/sailaja/ps2 | 2013-03-12 04:23:29 | NULL | NULL | Up | 3 | ZONE | | 202 | Primary3 | ef996b6b-80d7-3c64-b83a-7017cd620c28 | NetworkFilesystem | 2049 | 1 | 1 | 1 | 293909495808 | 879609315328 | 10.102.192.100 | NULL | /cpg_vol/sailaja/ps3 | 2013-03-12 04:28:18 | NULL | NULL | Up | 3 | CLUSTER | +-----+----------+--------------------------------------+-------------------+------+----------------+--------+------------+-----------------+----------------+----------------+-----------+------------------------+---------------------+---------+-------------+--------+---------------------+---------+ 3 rows in set (0.00 sec) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira