[ https://issues.apache.org/jira/browse/CLOUDSTACK-528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650599#comment-13650599 ]
Guillaume Fraysse commented on CLOUDSTACK-528: ---------------------------------------------- Hello I'm working with Nicolas. Here is the result of the select : mysql> select * from configuration where name like "%secondary.storage.vm%"; +----------+----------+-------------------+----------------------+--------------------------+------------------------------------------------------------------------------------------------------------------------+ | category | instance | component | name | value | description | +----------+----------+-------------------+----------------------+--------------------------+------------------------------------------------------------------------------------------------------------------------+ | Hidden | DEFAULT | management-server | secondary.storage.vm | c5j1YtdWPXA2NTcyWEkJwg== | Deploys a VM per zone to manage secondary storage if true, otherwise secondary storage is mounted on management server | +----------+----------+-------------------+----------------------+--------------------------+------------------------------------------------------------------------------------------------------------------------+ 1 row in set (0.00 sec) which is neither true nor false I set value to true and re-tested, I still can't add a secondary storage, here are the logs : 2013-05-07 10:20:34,992 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Cmd: StartupCommand{type=Second aryStorage, dataCenter='1', pod='null', cluster='null', guid='nfs://rr.isia.boi.cloud.mbs/ifs/cloud/chevilly/clustervmw- prp/secondarystorage', name='nfs://rr.isia.boi.cloud.mbs/ifs/cloud/chevilly/clustervmw-prp/secondarystorage', id=null, v ersion='4.1.0', iqn='NoIqn', publicIpAddress='null', publicNetmask='null', publicMacAddress='null', privateIpAddress='10 .200.194.26', privateMacAddress='00:50:56:a9:50:b6', privateNetmask='255.255.254.0', storageIpAddress='10.200.194.26', s torageNetmask='255.255.254.0', storageMacAddress='00:50:56:a9:50:b6', storageIpAddressDeux='null', storageMacAddressDeux ='null', storageNetmaskDeux='null', agentTag='null', resourceName='null', gatewayIpAddress='null'} 2013-05-07 10:20:34,993 DEBUG [agent.transport.Request] (TP-Processor21:null) Seq -1--1: Startup request from directly c onnected host: { Cmd , MgmtId: -1, via: -1, Ver: v1, Flags: 111, [{"type":"SecondaryStorage","dataCenter":"1","guid":"n fs://rr.isia.boi.cloud.mbs/ifs/cloud/chevilly/clustervmw-prp/secondarystorage","name":"nfs://rr.isia.boi.cloud.mbs/ifs/c loud/chevilly/clustervmw-prp/secondarystorage","version":"4.1.0","iqn":"NoIqn","privateIpAddress":"10.200.194.26","priva teMacAddress":"00:50:56:a9:50:b6","privateNetmask":"255.255.254.0","storageIpAddress":"10.200.194.26","storageNetmask":" 255.255.254.0","storageMacAddress":"00:50:56:a9:50:b6","wait":0}] } 2013-05-07 10:20:35,000 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Create cmd com.cloud.agent.api. StartupSecondaryStorageCommand 2013-05-07 10:20:35,011 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Dispatch event CREATE_HOST_VO_F OR_DIRECT_CONNECT for Host[-0-null] 2013-05-07 10:20:35,012 DEBUG [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Dispatching resource state even t CREATE_HOST_VO_FOR_DIRECT_CONNECT to PremiumSecondaryStorageManagerImpl_EnhancerByCloudStack_8d8d4cdc 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Event ok ... create host 2013-05-07 10:20:35,012 INFO [storage.secondary.SecondaryStorageManagerImpl] (TP-Processor21:null) Create Host ....... 2013-05-07 10:20:35,012 INFO [storage.secondary.SecondaryStorageManagerImpl] (TP-Processor21:null) Startup command: nfs://rr.isia.boi.cloud.mbs/ifs/cloud/chevilly/clustervmw-prp/secondarystorage 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Result dispatch event : null 2013-05-07 10:20:35,012 DEBUG [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Dispatching resource state event CREATE_HOST_VO_FOR_DIRECT_CONNECT to JuniperSRXExternalFirewallElement_EnhancerByCloudStack_aed6b9b6 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Event ok ... create host 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Result dispatch event : null 2013-05-07 10:20:35,012 DEBUG [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Dispatching resource state event CREATE_HOST_VO_FOR_DIRECT_CONNECT to VmwareServerDiscoverer_EnhancerByCloudStack_aef5c6ed 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Event ok ... create host 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Result dispatch event : null 2013-05-07 10:20:35,012 DEBUG [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Dispatching resource state event CREATE_HOST_VO_FOR_DIRECT_CONNECT to KvmServerDiscoverer_EnhancerByCloudStack_58952627 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Event ok ... create host 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Result dispatch event : null 2013-05-07 10:20:35,012 DEBUG [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Dispatching resource state event CREATE_HOST_VO_FOR_DIRECT_CONNECT to ConsoleProxyManagerImpl_EnhancerByCloudStack_dbba41f4 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Event ok ... create host 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Result dispatch event : null 2013-05-07 10:20:35,012 DEBUG [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Dispatching resource state event CREATE_HOST_VO_FOR_DIRECT_CONNECT to XcpServerDiscoverer_EnhancerByCloudStack_5b8245ab 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Event ok ... create host 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Result dispatch event : null 2013-05-07 10:20:35,012 DEBUG [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Dispatching resource state event CREATE_HOST_VO_FOR_DIRECT_CONNECT to NiciraNvp 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Event ok ... create host 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Result dispatch event : null 2013-05-07 10:20:35,012 DEBUG [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Dispatching resource state event CREATE_HOST_VO_FOR_DIRECT_CONNECT to NetscalerElement_EnhancerByCloudStack_f0c2290e 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Event ok ... create host 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Result dispatch event : null 2013-05-07 10:20:35,012 DEBUG [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Dispatching resource state event CREATE_HOST_VO_FOR_DIRECT_CONNECT to NetworkUsageManagerImpl_EnhancerByCloudStack_ecd89d3b 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Event ok ... create host 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Result dispatch event : null 2013-05-07 10:20:35,012 DEBUG [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Dispatching resource state event CREATE_HOST_VO_FOR_DIRECT_CONNECT to F5ExternalLoadBalancerElement_EnhancerByCloudStack_7f218365 2013-05-07 10:20:35,012 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Event ok ... create host 2013-05-07 10:20:35,013 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Result dispatch event : null 2013-05-07 10:20:35,013 DEBUG [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Dispatching resource state event CREATE_HOST_VO_FOR_DIRECT_CONNECT to OvmDiscoverer_EnhancerByCloudStack_c4ebbd52 2013-05-07 10:20:35,013 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Event ok ... create host 2013-05-07 10:20:35,013 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Result dispatch event : null 2013-05-07 10:20:35,013 DEBUG [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Dispatching resource state event CREATE_HOST_VO_FOR_DIRECT_CONNECT to BigSwitchVnsElement_EnhancerByCloudStack_a52c330c 2013-05-07 10:20:35,013 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Event ok ... create host 2013-05-07 10:20:35,013 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Result dispatch event : null 2013-05-07 10:20:35,013 WARN [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) Unable to connect due to com.cloud.utils.exception.CloudRuntimeException: No resource state adapter response at com.cloud.resource.ResourceManagerImpl.createHostVO(ResourceManagerImpl.java:1841) at com.cloud.resource.ResourceManagerImpl.createHostAndAgent(ResourceManagerImpl.java:1954) at com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:852) at com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:628) at org.apache.cloudstack.api.command.admin.host.AddSecondaryStorageCmd.execute(AddSecondaryStorageCmd.java:80) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162) at com.cloud.api.ApiServer.queueCommand(ApiServer.java:509) at com.cloud.api.ApiServer.handleRequest(ApiServer.java:359) at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:315) at com.cloud.api.ApiServlet.doGet(ApiServlet.java:66) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:190) at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:291) at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:776) at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:705) at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:898) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:690) at java.lang.Thread.run(Thread.java:662) 2013-05-07 10:20:35,019 INFO [cloud.resource.ResourceManagerImpl] (TP-Processor21:null) server resources successfully discovered by SecondaryStorage 2013-05-07 10:20:35,020 INFO [cloud.api.ApiServer] (TP-Processor21:null) Failed to add secondary storage 2013-05-07 10:20:35,020 DEBUG [cloud.api.ApiServlet] (TP-Processor21:null) ===END=== 10.60.2.68 -- GET command=addSecondaryStorage&zoneId=dda44dc5-1084-442a-b946-00c66387a45a&url=nfs%3A%2F%2Frr.isia.boi.cloud.mbs%2Fifs%2Fcloud%2Fchevilly%2Fclustervmw-prp%2Fsecondarystorage&response=json&sessionkey=jfiA%2BtBtZfGElYQA8R0Z%2F5n3IYQ%3D&_=1367914834076 2013-05-07 10:20:42,030 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) HostStatsCollector is running... 2013-05-07 10:20:42,045 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-418:null) Seq 1-802566696: Executing request 2013-05-07 10:20:42,538 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-418:null) Seq 1-802566696: Response Received: 2013-05-07 10:20:42,539 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 1-802566696: Received: { Ans: , MgmtId: 345051320502, via: 1, Ver: v1, Flags: 10, { GetHostStatsAnswer } } 2013-05-07 10:20:42,551 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-439:null) Seq 2-1732915791: Executing request 2013-05-07 10:20:43,033 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-439:null) Seq 2-1732915791: Response Received: > Failed to create secondary storage > ---------------------------------- > > Key: CLOUDSTACK-528 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-528 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Storage Controller > Affects Versions: 4.0.0, 4.1.0 > Environment: CentOS > Reporter: Tamas Monos > Priority: Blocker > Fix For: 4.1.0 > > > Hi, > I cannot add secondary storage to my existing Zone. This prevents the > platform from operating. > API call via GUI captured by tcpdump: > http://sandbox.veber.co.uk/client/api?command=addSecondaryStorage&zoneId=a8d21e6d-bc9e-4dc2-b996-fc22727cd9c1&url=nfs%3A%2F%2F192.168.1.2%2Fwatford_cloud&response=json&sessionkey=DGl3OmkfQRGwuIDZFoOpoF2WBJU%3D&_=1353673985114 > Result: > Unable to connect due to > java.lang.IllegalArgumentException: Host 192.168.1.4 sent incorrect data > center: null > at > com.cloud.resource.ResourceManagerImpl.createHostVO(ResourceManagerImpl.java:1501) > at > com.cloud.resource.ResourceManagerImpl.createHostAndAgent(ResourceManagerImpl.java:1629) > at > com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:720) > at > com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:551) > at > com.cloud.api.commands.AddSecondaryStorageCmd.execute(AddSecondaryStorageCmd.java:79) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138) > at com.cloud.api.ApiServer.queueCommand(ApiServer.java:543) > at com.cloud.api.ApiServer.handleRequest(ApiServer.java:422) > at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:304) > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:63) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) > at > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) > at > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) > at > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) > at > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) > at > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) > at > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) > at > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) > at > org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889) > at > org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721) > at > org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2268) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > 2012-11-23 12:32:58,518 INFO [cloud.resource.ResourceManagerImpl] > (catalina-exec-23:null) server resources successfully discovered by > SecondaryStorage > 2012-11-23 12:32:58,518 WARN [cloud.api.ApiDispatcher] > (catalina-exec-23:null) class com.cloud.api.ServerApiException : Failed to > add secondary storage > Debug: > mysql> select uuid from data_center where name='Watford'; > +--------------------------------------+ > | uuid | > +--------------------------------------+ > | a8d21e6d-bc9e-4dc2-b996-fc22727cd9c1 | > +--------------------------------------+ > The Zone ID matches but API throws exception while the IS is supplied in the > query. > Scenario: > I have upgraded from 3.0.2 to 4.0.0. Due to the upgrade scripts did not > update the systemVMs to the new template I've applied a workaround and > recreated the systemVMs with the new templates. After that I've enabled > storage clean-up and the cleanup script destroyed everything on my primary > storage including systemVMs. I wanted to re-create them but cannot add > secondary storage to the Zone. > The applied workarounds during upgrade: > 1. Add new vmware template to CS with name systemvm-vmware-4.0 (I have > re-imported it) 2. Wait till the template is downloaded and installed > successfully > 3. Look up id of this template in DB (Name should match the input provided in > step > mysql> select id from `cloud`.`vm_template` where name = > mysql> 'systemvm-vmware-4.0' and removed is null; > 4. Update template type to SYSTEM > mysql> update `cloud`.`vm_template` set type='SYSTEM' where id = > mysql> <id-from-step3>; > 5. Update template Id for all system Vms > mysql> update `cloud`.`vm_instance` set vm_template_id = <id-from-step3> > mysql> where type <> 'User' and hypervisor_type = 'VMware'; > 6. Restart all system Vms -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira