Just to follow up on this, I wiped out all of my cached dependencies, updated from upstream again, and ran
mvn -P developer,systemvm clean install -D noredist and I am now able to create an SR. On Wed, Apr 16, 2014 at 12:36 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > The interesting thing here is that this has always worked with my SAN > until I recently updated my CloudStack codebase. > > Now SR.create actually seems to create the SR (as it did in the past), but > then it times out while doing a read. > > > On Wed, Apr 16, 2014 at 12:27 PM, Anthony Xu <xuefei...@citrix.com> wrote: > >> Normally , SR.scan will not take too long, if SR.scan times out after 600 >> seconds, I think there might be some problems with the SR, I think you >> need to fix the SR issue first. >> You can execute xe sr-scan in any XS hosts to see what's the problem. >> >> >> Anthony >> >> -----Original Message----- >> From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] >> Sent: Wednesday, April 16, 2014 11:21 AM >> To: Anthony Xu >> Cc: Murali Reddy; dev@cloudstack.apache.org >> Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out >> >> What I had done was change the xapiwait (or something like that) global >> setting and then re-start my management server. >> >> >> On Wed, Apr 16, 2014 at 12:19 PM, Mike Tutkowski < >> mike.tutkow...@solidfire.com> wrote: >> >> > Ah, that's probably it. Thanks! >> > >> > >> > On Wed, Apr 16, 2014 at 12:11 PM, Anthony Xu <xuefei...@citrix.com> >> wrote: >> > >> >> I think you need to change value in DB configuration, changing the >> >> java code will not change the value in DB if the DB is already >> initialized. >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> +----------+----------+--------------+----------+-------+----------------------------------------------+---------------+---------+-------+------------+ >> >> >> >> | Advanced | DEFAULT | AgentManager | xapiwait | 60 | Time (in >> >> seconds) to wait for XAPI to return | NULL | NULL | NULL >> >> | 0 | >> >> >> >> >> >> >> >> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] >> >> *Sent:* Wednesday, April 16, 2014 11:09 AM >> >> *To:* Anthony Xu >> >> *Cc:* Murali Reddy; dev@cloudstack.apache.org >> >> >> >> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out >> >> >> >> >> >> >> >> Thanks, Anthony >> >> >> >> >> >> >> >> I will need to re-test. I changed that value from 60 to 600 last >> >> night and still saw an issue. >> >> >> >> >> >> >> >> Maybe I'll just start over from scratch and see if all is well. >> >> >> >> >> >> >> >> Thanks for the follow-up! >> >> >> >> >> >> >> >> On Wed, Apr 16, 2014 at 12:05 PM, Anthony Xu <xuefei...@citrix.com> >> >> wrote: >> >> >> >> Just checked in a fix for this. >> >> >> >> change xapitimeout to 600 second, >> >> >> >> looks like we need to change some XAPI calls to Async before shorten >> >> the timeout >> >> >> >> >> >> >> >> >> >> >> >> Anthony >> >> >> >> >> >> >> >> *From:* Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] >> >> *Sent:* Wednesday, April 16, 2014 7:27 AM >> >> *To:* Murali Reddy >> >> *Cc:* Anthony Xu; dev@cloudstack.apache.org >> >> >> >> >> >> *Subject:* Re: [4.4]copy_vhd_from_secondarystorage is timing out >> >> >> >> >> >> >> >> This is a similar problem to what I sent an e-mail out about last >> night: >> >> XmlRpcException (Read timed out). For me it's happening when >> >> CitrixResourceBase issues SR.create. >> >> >> >> >> >> >> >> This issue is currently blocking my testing progress and I'm not >> >> really sure who might be the right person to look into this. >> >> >> >> >> >> >> >> Any thoughts on this anyone? >> >> >> >> >> >> >> >> On Wed, Apr 16, 2014 at 1:51 AM, Murali Reddy >> >> <murali.re...@citrix.com> >> >> wrote: >> >> >> >> System VM's are launching fine now after Anthony's fix. But user VM's >> >> are failing to get created with exception. >> >> >> >> >> >> >> >> 43275 2014-04-16 12:59:08,647 DEBUG >> >> [c.c.h.x.r.XenServerConnectionPool] >> >> (DirectAgent-137:ctx-4761cb0c) XmlRpcException for method: >> >> VDI.snapshot due to org.apache.xmlrpc.XmlRpcException: Failed to >> >> create input stream: Read timed out >> >> >> >> 43276 2014-04-16 12:59:08,647 WARN >> >> [c.c.h.x.r.XenServerStorageProcessor] >> >> (DirectAgent-137:ctx-4761cb0c) Catch Exception >> >> org.apache.xmlrpc.XmlRpcException for template + due to >> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: >> >> Read timed out >> >> >> >> >> >> >> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: >> >> Read timed out >> >> >> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: >> >> Read timed out >> >> >> >> at >> >> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlRpc >> >> SunHttpTransport.java:99) >> >> >> >> at >> >> org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStre >> >> amTransport.java:152) >> >> >> >> at >> >> org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTr >> >> ansport.java:143) >> >> >> >> at >> >> org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcSun >> >> HttpTransport.java:69) >> >> >> >> at >> >> org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorke >> >> r.java:56) >> >> >> >> at >> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) >> >> >> >> at >> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) >> >> >> >> at >> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) >> >> >> >> at com.xensource.xenapi.Connection.dispatch(Connection.java:285) >> >> >> >> at >> >> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerCo >> >> nnection.dispatch(XenServerConnectionPool.java:456) >> >> >> >> at com.xensource.xenapi.VDI.snapshot(VDI.java:1155) >> >> >> >> at >> >> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTempl >> >> ateToPrimaryStorage(XenServerStorageProcessor.java:972) >> >> >> >> at >> >> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute >> >> (StorageSubsystemCommandHandlerBase.java:77) >> >> >> >> >> >> >> >> *From: *Mike Tutkowski <mike.tutkow...@solidfire.com> >> >> *Date: *Wednesday, 16 April 2014 12:35 AM >> >> *To: *"dev@cloudstack.apache.org" <dev@cloudstack.apache.org> >> >> *Cc: *Murali Reddy <murali.re...@citrix.com> >> >> >> >> >> >> *Subject: *Re: [4.4]copy_vhd_from_secondarystorage is timing out >> >> >> >> >> >> >> >> Hi Anthony, >> >> >> >> >> >> >> >> Can you go into a bit more depth about copy_vhd_from_secondarystorage >> >> not being used with XenServer 6.2? >> >> >> >> >> >> >> >> Does that mean "public Answer >> >> copyTemplateToPrimaryStorage(CopyCommand >> >> cmd)" in XenServerStorageProcessor is not called when XenServer 6.2 >> >> is in use? >> >> >> >> >> >> >> >> I'm testing out a feature of mine for 4.4, but have only been using >> >> XenServer 6.1 so far. >> >> >> >> >> >> >> >> Thanks! >> >> >> >> Mike >> >> >> >> >> >> >> >> On Tue, Apr 15, 2014 at 12:44 PM, Anthony Xu <xuefei...@citrix.com> >> >> wrote: >> >> >> >> Hi Murali, >> >> >> >> It is caused by the commit, I tested the commit on XS 6.2 FOX, which >> >> doesn't use copy_vhd_from_secondarystorage, that's why I didn't see >> >> this issue. >> >> >> >> Just disabled XAPI Event in 4.4 branch. >> >> >> >> >> >> Thanks, >> >> Anthony >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> -----Original Message----- >> >> From: Murali Reddy >> >> Sent: Tuesday, April 15, 2014 10:54 AM >> >> To: dev@cloudstack.apache.org; Anthony Xu >> >> Subject: Re: [4.4]copy_vhd_from_secondarystorage is timing out >> >> >> >> >> >> I am still running into this issue. Alex reverted complete change >> >> replacing xapi.jar, which was also resulting XmlRpc exceptions but >> >> system VM's were launching fine after revert. I may be wrong but >> >> looking at the stack trace and recent commits, commit >> >> 9f44909e63a19b2b8034baa13b92e24ea2eb0227 (use event instead of poll >> >> for xapi async call in XS 6.2 and above to reduce the pressure on >> >> XAPI) may be causing this issue. Anthony can you please take a look? >> >> >> >> >> >> On 14/04/14 8:12 AM, "Mike Tutkowski" <mike.tutkow...@solidfire.com> >> >> wrote: >> >> >> >> >I was seeing a similar issue when XAPI was changed when I tried to >> >> >create an SR. >> >> > >> >> >I wonder if that XAPI issue hasn't been fully resolved. >> >> > >> >> > >> >> >On Sun, Apr 13, 2014 at 4:16 PM, Srikanteswararao Talluri < >> >> >srikanteswararao.tall...@citrix.com> wrote: >> >> > >> >> >> Did anybody see this on latest 4.4? >> >> >> >> >> >> >> >> >> 2014-04-14 00:01:34,305 DEBUG [c.c.h.x.r.XenServerConnectionPool] >> >> >> (DirectAgent-71:ctx-12d9be59) XmlRpcException for method: >> >> >>event.from due to >> >> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: >> >> >>Read timed out >> >> >> >> >> >> 2014-04-14 00:01:34,305 WARN [c.c.h.x.r.CitrixResourceBase] >> >> >> (DirectAgent-71:ctx-12d9be59) callHostPlugin failed for cmd: >> >> >> copy_vhd_from_secondarystorage with args mountpoint: >> >> >>10.147.28.7:/export/home/talluri/psec/template/tmpl/1/1/, >> >> >> sruuid: b3dd21aa-8e82-a923-ed29-ee58220d158b, namelabel: >> >> >> cloud-8498d88f-be6b-41b6-bece-a58bbc1fbc32, due to Failed to >> >> >>create input >> >> >> stream: Read timed out >> >> >> >> >> >> org.apache.xmlrpc.XmlRpcException: Failed to create input stream: >> >> >> Read timed out >> >> >> >> >> >> at >> >> >> >> >> >>org.apache.xmlrpc.client.XmlRpcSunHttpTransport.getInputStream(XmlR >> >> >>pcS >> >> >>unH >> >> >>ttpTransport.java:99) >> >> >> >> >> >> at >> >> >> >> >> >>org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcSt >> >> >>rea >> >> >>mTr >> >> >>ansport.java:152) >> >> >> >> >> >> at >> >> >> >> >> >>org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttp >> >> >>Tra >> >> >>nsp >> >> >>ort.java:143) >> >> >> >> >> >> at >> >> >> >> >> >>org.apache.xmlrpc.client.XmlRpcSunHttpTransport.sendRequest(XmlRpcS >> >> >>unH >> >> >>ttp >> >> >>Transport.java:69) >> >> >> >> >> >> at >> >> >> >> >> >>org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWor >> >> >>ker >> >> >>.ja >> >> >>va:56) >> >> >> >> >> >> at >> >> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:16 >> >> >> 7) >> >> >> >> >> >> at >> >> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:13 >> >> >> 7) >> >> >> >> >> >> at >> >> >> org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:12 >> >> >> 6) >> >> >> >> >> >> at >> >> >> com.xensource.xenapi.Connection.dispatch(Connection.java:285) >> >> >> >> >> >> at >> >> >> >> >> >>com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServer >> >> >>Con >> >> >>nec >> >> >>tion.dispatch(XenServerConnectionPool.java:456) >> >> >> >> >> >> at com.xensource.xenapi.Event.properFrom(Event.java:310) >> >> >> >> >> >> at >> >> >> >> >> >>com.cloud.hypervisor.xen.resource.XenServer620Resource.waitForTask( >> >> >>Xen >> >> >>Ser >> >> >>ver620Resource.java:125) >> >> >> >> >> >> at >> >> >> >> >> >>com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin >> >> >>Asy >> >> >>nc( >> >> >>CitrixResourceBase.java:3558) >> >> >> >> >> >> at >> >> >> >> >> >>com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vh >> >> >>d_f >> >> >>rom >> >> >>_secondarystorage(XenServerStorageProcessor.java:826) >> >> >> >> >> >> at >> >> >> >> >> >>com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTem >> >> >>pla >> >> >>teT >> >> >>oPrimaryStorage(XenServerStorageProcessor.java:962) >> >> >> >> >> >> at >> >> >> >> >> >>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execu >> >> >>te( >> >> >>Sto >> >> >>rageSubsystemCommandHandlerBase.java:77) >> >> >> >> >> >> at >> >> >> >> >> >>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handl >> >> >>eSt >> >> >>ora >> >> >>geCommands(StorageSubsystemCommandHandlerBase.java:52) >> >> >> >> >> >> at >> >> >> >> >> >>com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest >> >> >>(Ci >> >> >>tri >> >> >>xResourceBase.java:542) >> >> >> >> >> >> at >> >> >> >> >> >>com.cloud.hypervisor.xen.resource.XenServer56Resource.executeReques >> >> >>t(X >> >> >>enS >> >> >>erver56Resource.java:60) >> >> >> >> >> >> at >> >> >> >> >> >>com.cloud.hypervisor.xen.resource.XenServer610Resource.executeReque >> >> >>st( >> >> >>Xen >> >> >>Server610Resource.java:92) >> >> >> >> >> >> at >> >> >> >> >> >>com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(Direct >> >> >>Age >> >> >>ntA >> >> >>ttache.java:216) >> >> >> >> >> >> at >> >> >> >> >> >>org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run( >> >> >>Man >> >> >>age >> >> >>dContextRunnable.java:49) >> >> >> >> >> >> at >> >> >> >> >> >>org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1. >> >> >>cal >> >> >>l(D >> >> >>efaultManagedContext.java:56) >> >> >> >> >> >> at >> >> >> >> >> >>org.apache.cloudstack.managed.context.impl.DefaultManagedContext.ca >> >> >>llW >> >> >>ith >> >> >>Context(DefaultManagedContext.java:103) >> >> >> >> >> >> >> >> >> 547,2-9 >> >> >> >> >> > >> >> > >> >> > >> >> >-- >> >> >*Mike Tutkowski* >> >> >*Senior CloudStack Developer, SolidFire Inc.* >> >> >e: mike.tutkow...@solidfire.com >> >> >o: 303.746.7302 >> >> >Advancing the way the world uses the >> >> >cloud<http://solidfire.com/solution/overview/?video=play> >> >> >*(tm)* >> >> > >> >> >> >> >> >> >> >> >> >> >> >> -- >> >> *Mike Tutkowski* >> >> >> >> *Senior CloudStack Developer, SolidFire Inc.* >> >> >> >> e: mike.tutkow...@solidfire.com >> >> >> >> o: 303.746.7302 >> >> >> >> Advancing the way the world uses the >> >> cloud<http://solidfire.com/solution/overview/?video=play> >> >> *(tm)* >> >> >> >> >> >> >> >> >> >> >> >> -- >> >> *Mike Tutkowski* >> >> >> >> *Senior CloudStack Developer, SolidFire Inc.* >> >> >> >> e: mike.tutkow...@solidfire.com >> >> >> >> o: 303.746.7302 >> >> >> >> Advancing the way the world uses the >> >> cloud<http://solidfire.com/solution/overview/?video=play> >> >> *(tm)* >> >> >> >> >> >> >> >> >> >> >> >> -- >> >> *Mike Tutkowski* >> >> >> >> *Senior CloudStack Developer, SolidFire Inc.* >> >> >> >> e: mike.tutkow...@solidfire.com >> >> >> >> o: 303.746.7302 >> >> >> >> Advancing the way the world uses the >> >> cloud<http://solidfire.com/solution/overview/?video=play> >> >> *(tm)* >> >> >> > >> > >> > >> > -- >> > *Mike Tutkowski* >> > *Senior CloudStack Developer, SolidFire Inc.* >> > e: mike.tutkow...@solidfire.com >> > o: 303.746.7302 >> > Advancing the way the world uses the >> > cloud<http://solidfire.com/solution/overview/?video=play> >> > *(tm)* >> > >> >> >> >> -- >> *Mike Tutkowski* >> *Senior CloudStack Developer, SolidFire Inc.* >> e: mike.tutkow...@solidfire.com >> o: 303.746.7302 >> Advancing the way the world uses the >> cloud<http://solidfire.com/solution/overview/?video=play> >> *(tm)* >> > > > > -- > *Mike Tutkowski* > *Senior CloudStack Developer, SolidFire Inc.* > e: mike.tutkow...@solidfire.com > o: 303.746.7302 > Advancing the way the world uses the > cloud<http://solidfire.com/solution/overview/?video=play> > *(tm)* > -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud<http://solidfire.com/solution/overview/?video=play> *(tm)*
