Thanks so much for that info!

I feel I'm getting closer. I added /mnt and subfolders were created shortly
thereafter.

I don't know if you saw another e-mail I sent out under a different
subject, but I think that e-mail describes the current cause of my problems
(a misunderstanding in VMware code between used and available bytes).


On Mon, Jul 15, 2013 at 7:57 PM, Vijayendra Bhamidipati <
vijayendra.bhamidip...@citrix.com> wrote:

> Hi Mike!
>
> I haven't actually ever run my setup on Mac OS X, do my work on a CentOS
> VM.. should give that a try soon. The last time I tried, I ran into issues
> with deploydb (mysql errored out on some syntax when granting root
> privileges to the cloud user if I remember right) and got diverted and
> couldn't revisit it - you could probably help me out there if I get stuck
> again :)
>
> The sudo shouldn't matter and infact shouldn't be used, lest we miss
> issues that can occur when sudo isn't used. The command line to bring up
> the mgmt. server should have the -Dnonoss flag in it though :
>
>         mvn -pl :cloud-client-ui jetty:run -Dnonoss
>
> The keystore error doesn't matter either - the mgmt. server simply
> generates and uses default settings.
>
> Here are my MAVEN_OPTS:
>
> [root@vijay-vm1 3415fix1]# echo $MAVEN_OPTS
> -Xmx1024m -XX:MaxPermSize=500m -Xdebug
> -Xrunjdwp:transport=dt_socket,address=8787,server=y,suspend=n
> [root@vijay-vm1 3415fix1]#
>
> You can increase the MaxPermSize to 1024M, that should help avoid the
> permgen space issue.
>
> What about the umask? Is it set to 022?
>
> As a workaround, how about you creating a /mnt/ and chmod -R 777 /mnt/ and
> retrying? I think it should do the trick to help you proceed while we
> figure out the root cause in the meantime.
>
>
> Regards,
> Vijay
>
>
> -----Original Message-----
> From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
> Sent: Monday, July 15, 2013 6:43 PM
> To: dev@cloudstack.apache.org
> Subject: Re: Secondary Storage Setup Question
>
> This is my related env var:
>
> MAVEN_OPTS=-XX:MaxPermSize=1024m -Xmx2048m -Xdebug
> -Xrunjdwp:transport=dt_socket,address=8787,server=y,suspend=n
>
>
> On Mon, Jul 15, 2013 at 7:40 PM, Mike Tutkowski <
> mike.tutkow...@solidfire.com> wrote:
>
> > Tried to run it with sudo, but got the following PermGen exception:
> >
> > java.lang.OutOfMemoryError: PermGen space at
> > java.lang.ClassLoader.findBootstrapClass(Native Method)  at
> > java.lang.ClassLoader.findBootstrapClassOrNull(ClassLoader.java:926)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:297)
> >  at
> > org.codehaus.plexus.classworlds.realm.ClassRealm.loadClass(ClassRealm.
> > java:239)
> > at
> > org.codehaus.plexus.classworlds.realm.ClassRealm.loadClass(ClassRealm.
> > java:230)
> >  at
> > org.mortbay.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader
> > .java:378)
> > at
> > org.mortbay.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader
> > .java:363)  at
> > org.apache.log4j.helpers.SyslogWriter.write(SyslogWriter.java:130)
> > at org.apache.log4j.helpers.QuietWriter.write(QuietWriter.java:48)
> >  at
> > org.apache.log4j.helpers.SyslogQuietWriter.write(SyslogQuietWriter.jav
> > a:54) at
> > org.apache.log4j.net.SyslogAppender.append(SyslogAppender.java:338)
> >  at
> > org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
> > at
> > org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(
> > AppenderAttachableImpl.java:66)  at
> > org.apache.log4j.Category.callAppenders(Category.java:206)
> > at org.apache.log4j.Category.forcedLog(Category.java:391)
> >  at org.apache.log4j.Category.log(Category.java:856)
> > at
> > org.apache.commons.logging.impl.Log4JLogger.error(Log4JLogger.java:257
> > )
> >  at
> > org.springframework.web.context.ContextLoader.initWebApplicationContex
> > t(ContextLoader.java:307)
> > at
> > org.springframework.web.context.ContextLoaderListener.contextInitializ
> > ed(ContextLoaderListener.java:111)
> >  at
> > org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.j
> > ava:549) at
> > org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
> >  at
> > org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java
> > :1282)
> > at
> > org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:5
> > 18)  at
> > org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
> > at
> > org.mortbay.jetty.plugin.Jetty6PluginWebAppContext.doStart(Jetty6Plugi
> > nWebAppContext.java:115)
> >  at
> > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:5
> > 0)
> > at
> > org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.
> > java:152)
> >  at
> > org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHand
> > lerCollection.java:156) at
> > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:5
> > 0)
> >  at
> > org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.
> > java:152) at
> > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:5
> > 0)
> >  at
> > org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:1
> > 30)
> >
> >
> > On Mon, Jul 15, 2013 at 7:31 PM, Mike Tutkowski <
> > mike.tutkow...@solidfire.com> wrote:
> >
> >> Thanks for all the detail, Vijay!
> >>
> >> I looked and do not see a /mnt folder at all.
> >>
> >> This is the contents of the template.properties file I downloaded
> >> earlier today when seeding my secondary storage location:
> >>
> >> filename=7035599C-FDB7-4B8F-B880-3C8D0176F921.ova
> >>
> >> description=SystemVM Template
> >>
> >> checksum=
> >>
> >> hvm=false
> >>
> >> size=261563904
> >>
> >> ova=true
> >>
> >> id=8
> >>
> >> public=true
> >>
> >> ova.filename=7035599C-FDB7-4B8F-B880-3C8D0176F921.ova
> >>
> >> uniquename=routing-8
> >>
> >> ova.virtualsize=261563904
> >>
> >> virtualsize=261563904
> >>
> >> ova.size=261563904
> >>
> >>
> >> I agree that I must have a permissions issue. Do you think it could
> >> be the way I run the management server?
> >>
> >>
> >> mvn -pl client jetty:run
> >>
> >> I do see an SSL keystore error while the CS MS is starting up, but I
> >> don't think this is the problem.
> >>
> >> Maybe I need to run the command with sudo?
> >>
> >> I'm still a bit new to Mac OS X. :)
> >>
> >>
> >> On Mon, Jul 15, 2013 at 7:16 PM, Vijayendra Bhamidipati <
> >> vijayendra.bhamidip...@citrix.com> wrote:
> >>
> >>> Hi Mike,
> >>>
> >>> The very first time the mgmt. server has to bring up the SSVM, it
> >>> needs to prepare the ova template and make it available to ESX such
> >>> that ESX can import the ovf generated from the ova template over to
> >>> primary storage, thus deploying the system VM. So, the mgmt server
> >>> mounts the primary storage as a datastore on the ESX host first. The
> >>> mgmt. server then tries to unpack the ova (to create two files - ovf
> >>> and vmdk), and it does so within the same directory where the
> >>> template resides (on secondary storage). So, to do that, it attempts
> >>> to mount -t nfs that secondary share on the mgmt. server node in a
> >>> new mount point by the name format "/mnt/VM/abcdefghijk.lmnopqrs"
> >>> (this name is autogenerated using a rand() like function). In your
> >>> setup, either the creation of that mount point or the actual mount
> procedure is failing:
> >>>
> >>> [vmware.manager.VmwareManagerImpl] (DirectAgent-270:172.16.140.2)
> >>> Unable to create mount point for nfs://172.16.140.5/export/secondary
> >>>
> >>>
> >>> Do you see a /mnt/VM/<>.<> in your mgmt. server host? If you do, can
> >>> you mount the secondary on to it manually?
> >>>
> >>> In case the above mount operation fails in the mgmt. server, it uses
> >>> "/mnt/sec/" by default - which is what you see. I would much prefer
> >>> an exception to be thrown instead of /mnt/sec being returned. I am
> >>> not sure why this string is returned instead - Kelven could throw more
> light on that.
> >>>
> >>> This is why I still think that there is some permissions issue with
> >>> your setup.
> >>>
> >>> Routing-8.ova is the default unique name for the system VM template
> >>> for vmware. You will find it in the template.properties file in the
> >>> template/tmpl/1/8 directory.
> >>>
> >>> As for the local datastore on the ESX host, cloudstack doesn't use
> >>> it. I think that using local datastores can be a cause of failures
> >>> due to lack of space and can cause availability issues. This was a
> >>> scaling issue in initial openstack Xenserver deployments that used
> >>> local storage because of
> >>> dom0 having only 4GB of space, and afaics the cloudstack
> >>> architecture probably avoided it from the beginning for similar
> >>> reasons. The team could chip in with their views regarding this.
> >>>
> >>>
> >>> Regards,
> >>> Vijay
> >>>
> >>>
> >>> -----Original Message-----
> >>> From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
> >>> Sent: Monday, July 15, 2013 5:30 PM
> >>> To: dev@cloudstack.apache.org
> >>> Subject: Re: Secondary Storage Setup Question
> >>>
> >>> It seems like we're trying to create mount points on ESX. Is that
> >>> correct?
> >>> They appear to be failing.
> >>>
> >>> INFO  [storage.resource.VmwareStorageProcessor]
> >>> (DirectAgent-24:172.16.140.2) Template routing-8 is not setup yet,
> >>> setup template from secondary storage with uuid name:
> >>> 37ef1524d36338b8bef2f601843a0e12
> >>> INFO  [storage.resource.VmwareStorageProcessor]
> >>> (DirectAgent-270:172.16.140.2) Executing
> >>> copyTemplateFromSecondaryToPrimary. secondaryStorage: nfs://
> >>> 172.16.140.5/export/secondary, templatePathAtSecondaryStorage:
> >>> template/tmpl/1/8/, templateName: routing-8 ERROR
> >>> [vmware.manager.VmwareManagerImpl] (DirectAgent-270:172.16.140.2)
> >>> Unable to create mount: /mnt/VM/1.4ec55471 ERROR
> >>> [vmware.manager.VmwareManagerImpl]
> >>> (DirectAgent-270:172.16.140.2) Unable to create mount:
> >>> /mnt/VM/1.75fed209 ERROR [vmware.manager.VmwareManagerImpl]
> >>> (DirectAgent-270:172.16.140.2) Unable to create mount:
> >>> /mnt/VM/1.3224a6b ERROR [vmware.manager.VmwareManagerImpl]
> >>> (DirectAgent-270:172.16.140.2) Unable to create mount:
> >>> /mnt/VM/1.637a2ecd ERROR [vmware.manager.VmwareManagerImpl]
> >>> (DirectAgent-270:172.16.140.2) Unable to create mount:
> >>> /mnt/VM/1.18e47846 ERROR [vmware.manager.VmwareManagerImpl]
> >>> (DirectAgent-270:172.16.140.2) Unable to create mount:
> >>> /mnt/VM/1.788773b3 ERROR [vmware.manager.VmwareManagerImpl]
> >>> (DirectAgent-270:172.16.140.2) Unable to create mount:
> >>> /mnt/VM/1.32f1b5bb ERROR [vmware.manager.VmwareManagerImpl]
> >>> (DirectAgent-270:172.16.140.2) Unable to create mount:
> >>> /mnt/VM/1.5b1ef2a5 ERROR [vmware.manager.VmwareManagerImpl]
> >>> (DirectAgent-270:172.16.140.2) Unable to create mount:
> >>> /mnt/VM/1.356fba4c ERROR [vmware.manager.VmwareManagerImpl]
> >>> (DirectAgent-270:172.16.140.2) Unable to create mount:
> >>> /mnt/VM/1.121112ad WARN  [vmware.manager.VmwareManagerImpl]
> >>> (DirectAgent-270:172.16.140.2) Unable to create a mount point ERROR
> >>> [vmware.manager.VmwareManagerImpl] (DirectAgent-270:172.16.140.2)
> >>> Unable to create mount point for nfs://172.16.140.5/export/secondary
> >>> INFO  [storage.resource.VmwareStorageProcessor]
> >>> (DirectAgent-270:172.16.140.2) Secondary storage mount point:
> >>> /mnt/sec INFO  [storage.resource.VmwareStorageProcessor]
> >>> (DirectAgent-270:172.16.140.2) Executing command: tar
> >>> --no-same-owner -xf /mnt/sec/template/tmpl/1/8/routing-8.ova
> >>> INFO  [cloud.ha.HighAvailabilityManagerImpl] (HA-1:) checking health
> >>> of usage server
> >>>
> >>>
> >>>
> >>>
> >>> On Mon, Jul 15, 2013 at 6:19 PM, Mike Tutkowski <
> >>> mike.tutkow...@solidfire.com> wrote:
> >>>
> >>> > So, I see references like this in the log:
> >>> >
> >>> > 2013-07-15 18:12:59,378 INFO
> >>> > [storage.resource.VmwareStorageProcessor]
> >>> > (DirectAgent-270:172.16.140.2) Executing command: tar
> >>> > --no-same-owner -xf /mnt/sec/template/tmpl/1/8/routing-8.ova
> >>> >
> >>> >
> >>> > 1) I'm not sure why it's referencing /mnt/sec.
> >>> >
> >>> > 2) I don't see any routing-8.ova file on my NFS share.
> >>> >
> >>> >
> >>> > I do see that the NFS primary that I set up at /export/primary is
> >>> > represented in vCenter as a datastore with what appears to be a
> >>> > UUID for a name, so that makes sense. :)
> >>> >
> >>> >
> >>> > It also looks like something has been successfully copied at some
> >>> > point to that NAS datastore as it has a file that wasn't there
> >>> > when I set up the system initially.
> >>> >
> >>> >
> >>> > When I added my VMware cluster, CS did not automatically add the
> >>> > local datastore I had on my ESX host (just one host in this
> >>> > cluster). I was a bit surprised by that. I went ahead and added
> >>> > that local datastore manually to CloudStack.
> >>> >
> >>> >
> >>> > On Mon, Jul 15, 2013 at 5:37 PM, Mike Tutkowski <
> >>> > mike.tutkow...@solidfire.com> wrote:
> >>> >
> >>> >> I mean withOUT DevCloud2. :)
> >>> >>
> >>> >>
> >>> >> On Mon, Jul 15, 2013 at 5:37 PM, Mike Tutkowski <
> >>> >> mike.tutkow...@solidfire.com> wrote:
> >>> >>
> >>> >>> Also, I just have the one secondary storage configured in
> >>> >>> CloudStack with the following path:
> >>> >>>
> >>> >>> nfs://172.16.140.5/export/secondary
> >>> >>>
> >>> >>> Thanks so much for your help! I'm picking up quite a bit from
> >>> >>> setting this up with DevCloud2.
> >>> >>>
> >>> >>>
> >>> >>> On Mon, Jul 15, 2013 at 5:34 PM, Mike Tutkowski <
> >>> >>> mike.tutkow...@solidfire.com> wrote:
> >>> >>>
> >>> >>>> My /etc/exports file reads:
> >>> >>>>
> >>> >>>> /export  *(rw,async,no_root_squash)
> >>> >>>>
> >>> >>>>
> >>> >>>> On Mon, Jul 15, 2013 at 5:32 PM, Mike Tutkowski <
> >>> >>>> mike.tutkow...@solidfire.com> wrote:
> >>> >>>>
> >>> >>>>> Oh, wait.
> >>> >>>>>
> >>> >>>>> /mnt/sec/template/tmpl/1/8/
> >>> >>>>>
> >>> >>>>> If this is referencing my NFS share (which I'm guessing it
> >>> >>>>> is), my NFS share is /export/secondary ...
> >>> >>>>>
> >>> >>>>> Should I rename it?
> >>> >>>>>
> >>> >>>>>
> >>> >>>>> On Mon, Jul 15, 2013 at 5:31 PM, Mike Tutkowski <
> >>> >>>>> mike.tutkow...@solidfire.com> wrote:
> >>> >>>>>
> >>> >>>>>> I think you're correct (about permissions). Do you think I
> >>> >>>>>> missed a step in the instructions when setting up ESX?
> >>> >>>>>>
> >>> >>>>>> java.io.IOException: Cannot run program "tar" (in directory
> >>> >>>>>> "/mnt/sec/template/tmpl/1/8"): error=2, No such file or
> >>> >>>>>> directory at
> >>> >>>>>> java.lang.ProcessBuilder.start(ProcessBuilder.java:460)
> >>> >>>>>> at com.cloud.utils.script.Script.execute(Script.java:183)
> >>> >>>>>>  at com.cloud.utils.script.Script.execute(Script.java:161)
> >>> >>>>>> at
> >>> >>>>>> com.cloud.storage.resource.VmwareStorageProcessor.copyTemplat
> >>> >>>>>> eFro
> >>> >>>>>> mSecondaryToPrimary(VmwareStorageProcessor.java:153)
> >>> >>>>>>  at
> >>> >>>>>> com.cloud.storage.resource.VmwareStorageProcessor.copyTemplat
> >>> >>>>>> eToP
> >>> >>>>>> rimaryStorage(VmwareStorageProcessor.java:249)
> >>> >>>>>> at
> >>> >>>>>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase
> >>> >>>>>> .exe
> >>> >>>>>> cute(StorageSubsystemCommandHandlerBase.java:70)
> >>> >>>>>>  at
> >>> >>>>>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase
> >>> >>>>>> .han
> >>> >>>>>> dleStorageCommands(StorageSubsystemCommandHandlerBase.java:49
> >>> >>>>>> )
> >>> >>>>>> at
> >>> >>>>>> com.cloud.hypervisor.vmware.resource.VmwareResource.executeRe
> >>> >>>>>> ques
> >>> >>>>>> t(VmwareResource.java:565)
> >>> >>>>>>  at
> >>> >>>>>> com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAge
> >>> >>>>>> ntAt
> >>> >>>>>> tache.java:186)
> >>> >>>>>> at
> >>> >>>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors
> >>> >>>>>> .jav
> >>> >>>>>> a:439)
> >>> >>>>>>  at
> >>> >>>>>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java
> >>> >>>>>> :303
> >>> >>>>>> ) at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> >>> >>>>>>  at
> >>> >>>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFut
> >>> >>>>>> ureT
> >>> >>>>>> ask.access$301(ScheduledThreadPoolExecutor.java:98)
> >>> >>>>>> at
> >>> >>>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFut
> >>> >>>>>> ureT
> >>> >>>>>> ask.run(ScheduledThreadPoolExecutor.java:206)
> >>> >>>>>>  at
> >>> >>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Thread
> >>> >>>>>> Pool
> >>> >>>>>> Executor.java:895)
> >>> >>>>>> at
> >>> >>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPool
> >>> >>>>>> Exec
> >>> >>>>>> utor.java:918)  at java.lang.Thread.run(Thread.java:680)
> >>> >>>>>> Caused by: java.io.IOException: error=2, No such file or
> >>> >>>>>> directory at java.lang.UNIXProcess.forkAndExec(Native Method)
> >>> >>>>>> at
> >>> >>>>>> java.lang.UNIXProcess.<init>(UNIXProcess.java:53)
> >>> >>>>>> at java.lang.ProcessImpl.start(ProcessImpl.java:91)
> >>> >>>>>>  at java.lang.ProcessBuilder.start(ProcessBuilder.java:453)
> >>> >>>>>> ... 16 more
> >>> >>>>>>
> >>> >>>>>>
> >>> >>>>>>
> >>> >>>>>> On Mon, Jul 15, 2013 at 5:29 PM, Vijayendra Bhamidipati <
> >>> >>>>>> vijayendra.bhamidip...@citrix.com> wrote:
> >>> >>>>>>
> >>> >>>>>>> Looks like /mnt/sec/template/tmpl/1/8/ isn't writable - what
> >>> >>>>>>> do the directory permissions show? Also, what's the umask?
> >>> >>>>>>> What other exceptions show up (look for the earliest one in
> the logs)?
> >>> >>>>>>>
> >>> >>>>>>> Regards,
> >>> >>>>>>> Vijay
> >>> >>>>>>>
> >>> >>>>>>> -----Original Message-----
> >>> >>>>>>> From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
> >>> >>>>>>> Sent: Monday, July 15, 2013 4:23 PM
> >>> >>>>>>> To: dev@cloudstack.apache.org
> >>> >>>>>>> Subject: Re: Secondary Storage Setup Question
> >>> >>>>>>>
> >>> >>>>>>> Any thoughts on this? I have my zone, pod, and cluster up
> >>> >>>>>>> and running, but am getting several exception, including the
> >>> following:
> >>> >>>>>>>
> >>> >>>>>>> ERROR [storage.resource.VmwareStorageProcessor]
> >>> >>>>>>> (DirectAgent-56:172.16.140.2) Unable to unpack snapshot OVA
> >>> >>>>>>> file
> >>> at:
> >>> >>>>>>> /mnt/sec/template/tmpl/1/8/routing-8.ova
> >>> >>>>>>> ERROR [storage.resource.VmwareStorageProcessor]
> >>> >>>>>>> (DirectAgent-56:172.16.140.2) Unable to execute
> >>> >>>>>>> PrimaryStorageDownloadCommand due to exception
> >>> >>>>>>> java.lang.Exception: Unable to unpack snapshot OVA file at:
> >>> >>>>>>> /mnt/sec/template/tmpl/1/8/routing-8.ova
> >>> >>>>>>> at
> >>> >>>>>>>
> >>> >>>>>>> com.cloud.storage.resource.VmwareStorageProcessor.copyTempla
> >>> >>>>>>> teFr
> >>> >>>>>>> omSecondaryToPrimary(VmwareStorageProcessor.java:157)
> >>> >>>>>>> at
> >>> >>>>>>>
> >>> >>>>>>> com.cloud.storage.resource.VmwareStorageProcessor.copyTempla
> >>> >>>>>>> teTo
> >>> >>>>>>> PrimaryStorage(VmwareStorageProcessor.java:249)
> >>> >>>>>>> at
> >>> >>>>>>>
> >>> >>>>>>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBas
> >>> >>>>>>> e.ex
> >>> >>>>>>> ecute(StorageSubsystemCommandHandlerBase.java:70)
> >>> >>>>>>> at
> >>> >>>>>>>
> >>> >>>>>>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBas
> >>> >>>>>>> e.ha
> >>> >>>>>>> ndleStorageCommands(StorageSubsystemCommandHandlerBase.java:
> >>> >>>>>>> 49)
> >>> >>>>>>> at
> >>> >>>>>>>
> >>> >>>>>>> com.cloud.hypervisor.vmware.resource.VmwareResource.executeR
> >>> >>>>>>> eque
> >>> >>>>>>> st(VmwareResource.java:565)
> >>> >>>>>>> at
> >>> >>>>>>>
> >>> >>>>>>> com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAg
> >>> >>>>>>> entA
> >>> >>>>>>> ttache.java:186)
> >>> >>>>>>> at
> >>> >>>>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executor
> >>> >>>>>>> s.ja
> >>> >>>>>>> va:439) at
> >>> >>>>>>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.jav
> >>> >>>>>>> a:30
> >>> >>>>>>> 3) at
> >>> >>>>>>> java.util.concurrent.FutureTask.run(FutureTask.java:138)
> >>> >>>>>>> at
> >>> >>>>>>>
> >>> >>>>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu
> >>> >>>>>>> ture
> >>> >>>>>>> Task.access$301(ScheduledThreadPoolExecutor.java:98)
> >>> >>>>>>> at
> >>> >>>>>>>
> >>> >>>>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu
> >>> >>>>>>> ture
> >>> >>>>>>> Task.run(ScheduledThreadPoolExecutor.java:206)
> >>> >>>>>>> at
> >>> >>>>>>>
> >>> >>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Threa
> >>> >>>>>>> dPoo
> >>> >>>>>>> lExecutor.java:895)
> >>> >>>>>>> at
> >>> >>>>>>>
> >>> >>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo
> >>> >>>>>>> lExe
> >>> >>>>>>> cutor.java:918) at java.lang.Thread.run(Thread.java:680)
> >>> >>>>>>>
> >>> >>>>>>>
> >>> >>>>>>>
> >>> >>>>>>> On Mon, Jul 15, 2013 at 3:05 PM, Vijayendra Bhamidipati <
> >>> >>>>>>> vijayendra.bhamidip...@citrix.com> wrote:
> >>> >>>>>>>
> >>> >>>>>>> > You can copy over the entire contents over to your nfs
> >>> >>>>>>> > server share and reuse it - just make sure that any temp
> >>> >>>>>>> > files that get created between deployments in that
> >>> >>>>>>> > secondary storage nfs directory are removed before you go
> >>> >>>>>>> > ahead and create your zones. For example,
> >>> >>>>>>> vmware
> >>> >>>>>>> > deployments store and retrieve the systemvm.iso file from
> >>> >>>>>>> > the $secstorage/systemvm/ directory - so every time you
> >>> >>>>>>> > recreate your zone, remove this file first, else you'd
> >>> >>>>>>> > probably hit weird issues that nobody else is running
> >>> >>>>>>> > into. You can also clear the files
> >>> >>>>>>> under
> >>> >>>>>>> > snapshots/ and volumes/ if they don't get cleaned up after
> >>> >>>>>>> > you
> >>> >>>>>>> nuke your setup and just retain the template directory chain.
> >>> >>>>>>> >
> >>> >>>>>>> > Regards,
> >>> >>>>>>> > Vijay
> >>> >>>>>>> >
> >>> >>>>>>> > -----Original Message-----
> >>> >>>>>>> > From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com]
> >>> >>>>>>> > Sent: Monday, July 15, 2013 2:00 PM
> >>> >>>>>>> > To: dev@cloudstack.apache.org
> >>> >>>>>>> > Subject: Re: Secondary Storage Setup Question
> >>> >>>>>>> >
> >>> >>>>>>> > Since I am copying the template info to the computer
> >>> >>>>>>> > running the CS MS, but
> >>> >>>>>>> > - ultimately - I'd like this template info on my NFS
> >>> >>>>>>> > server, can I just copy the new folder (and all
> >>> >>>>>>> > subfolders, of course) to the
> >>> >>>>>>> right
> >>> >>>>>>> > location on the NFS server or are there other changes that
> >>> >>>>>>> > would
> >>> >>>>>>> need
> >>> >>>>>>> > to be performed?
> >>> >>>>>>> >
> >>> >>>>>>> > Thanks for the help! :)
> >>> >>>>>>> >
> >>> >>>>>>> >
> >>> >>>>>>> > On Mon, Jul 15, 2013 at 2:57 PM, Mike Tutkowski <
> >>> >>>>>>> > mike.tutkow...@solidfire.com> wrote:
> >>> >>>>>>> >
> >>> >>>>>>> > > This command seems to be working (6% done at the moment):
> >>> >>>>>>> > >
> >>> >>>>>>> > > ./cloud-install-sys-tmplt -m
> >>> >>>>>>> > > /Users/mtutkowski/Documents/nfs -u
> >>> >>>>>>> > >
> >>> >>>>>>> http://jenkins.cloudstack.org/job/build-systemvm-master/last
> >>> >>>>>>> Succ
> >>> >>>>>>> essf
> >>> >>>>>>> > > ul
> >>> >>>>>>> > >
> >>> >>>>>>> Build/artifact/tools/appliance/dist/systemvmtemplate-2013-07
> >>> >>>>>>> -14-
> >>> >>>>>>> mast
> >>> >>>>>>> > > er -vmware.ova-h vmware -F -o localhost -r root -d
> >>> >>>>>>> > > password
> >>> >>>>>>> > >
> >>> >>>>>>> > >
> >>> >>>>>>> > > On Mon, Jul 15, 2013 at 2:55 PM, Mike Tutkowski <
> >>> >>>>>>> > > mike.tutkow...@solidfire.com> wrote:
> >>> >>>>>>> > >
> >>> >>>>>>> > >> Here are my super-secret DB settings. :)
> >>> >>>>>>> > >>
> >>> >>>>>>> > >> # CloudStack database settings
> >>> >>>>>>> > >>
> >>> >>>>>>> > >> db.cloud.username=cloud
> >>> >>>>>>> > >>
> >>> >>>>>>> > >> db.cloud.password=cloud
> >>> >>>>>>> > >>
> >>> >>>>>>> > >> db.root.password=
> >>> >>>>>>> > >>
> >>> >>>>>>> > >> db.cloud.host=localhost
> >>> >>>>>>> > >>
> >>> >>>>>>> > >> db.cloud.port=3306
> >>> >>>>>>> > >>
> >>> >>>>>>> > >> db.cloud.name=cloud
> >>> >>>>>>> > >>
> >>> >>>>>>> > >>
> >>> >>>>>>> > >> On Mon, Jul 15, 2013 at 2:50 PM, Vijayendra Bhamidipati
> >>> >>>>>>> > >> < vijayendra.bhamidip...@citrix.com> wrote:
> >>> >>>>>>> > >>
> >>> >>>>>>> > >>> Hi Mike,
> >>> >>>>>>> > >>>
> >>> >>>>>>> > >>> The db.properties file that you copied over should
> >>> >>>>>>> > >>> contain the
> >>> >>>>>>> db
> >>> >>>>>>> > >>> usernames and passwords - can you check that file?
> >>> >>>>>>> > >>>
> >>> >>>>>>> > >>> Regards,
> >>> >>>>>>> > >>> Vijay
> >>> >>>>>>> > >>>
> >>> >>>>>>> > >>> -----Original Message-----
> >>> >>>>>>> > >>> From: Mike Tutkowski
> >>> >>>>>>> > >>> [mailto:mike.tutkow...@solidfire.com]
> >>> >>>>>>> > >>> Sent: Monday, July 15, 2013 1:49 PM
> >>> >>>>>>> > >>> To: dev@cloudstack.apache.org
> >>> >>>>>>> > >>> Subject: Re: Secondary Storage Setup Question
> >>> >>>>>>> > >>>
> >>> >>>>>>> > >>> Looks like I need to specify my username and password.
> >>> >>>>>>> > >>>
> >>> >>>>>>> > >>> Also, it looks like wget is not installed on my computer.
> >>> >>>>>>> > >>>
> >>> >>>>>>> > >>>
> >>> >>>>>>> > >>> On Mon, Jul 15, 2013 at 2:40 PM, Mike Tutkowski <
> >>> >>>>>>> > >>> mike.tutkow...@solidfire.com> wrote:
> >>> >>>>>>> > >>>
> >>> >>>>>>> > >>> > Great - thanks. I'm not sure if I should specify -s
> >>> >>>>>>> > >>> > and the secret or
> >>> >>>>>>> > >>> not.
> >>> >>>>>>> > >>> > The way I'm doing this, with the DB on one computer
> >>> >>>>>>> > >>> > and the
> >>> >>>>>>> NFS
> >>> >>>>>>> > >>> > share on another, I was just assuming I could leave
> >>> >>>>>>> > >>> > off
> >>> -s.
> >>> >>>>>>> > >>> >
> >>> >>>>>>> > >>> > This is the current result I get (using the path
> >>> >>>>>>> > >>> > John
> >>> >>>>>>> provided
> >>> >>>>>>> > >>> > for the OVA
> >>> >>>>>>> > >>> > file):
> >>> >>>>>>> > >>> >
> >>> >>>>>>> > >>> > ./cloud-install-sys-tmplt -m
> >>> >>>>>>> > >>> > /Users/mtutkowski/Documents/nfs
> >>> >>>>>>> -u
> >>> >>>>>>> > >>> >
> >>> >>>>>>> http://jenkins.cloudstack.org/job/build-systemvm-master/syst
> >>> >>>>>>> emvm
> >>> >>>>>>> > >>> > te mpla te-2013-07-14-master-vmware.ova-h vmware -F
> >>> >>>>>>> > >>> > sed: 1: "s/^[[:space:]]*//;s/[[: ...": bad flag in
> >>> >>>>>>> > >>> > substitute
> >>> >>>>>>> > command:
> >>> >>>>>>> > >>> 'i'
> >>> >>>>>>> > >>> > ERROR 1045 (28000): Access denied for user 'cloud'@
> >>> >>>>>>> 'localhost'
> >>> >>>>>>> > >>> > (using
> >>> >>>>>>> > >>> > password: NO)
> >>> >>>>>>> > >>> > Unable to get template Id from database Installation
> >>> >>>>>>> > >>> > failed
> >>> >>>>>>> > >>> >
> >>> >>>>>>> > >>> > Any thoughts on this?
> >>> >>>>>>> > >>> >
> >>> >>>>>>> > >>> > Thanks again
> >>> >>>>>>> > >>> >
> >>> >>>>>>> > >>> >
> >>> >>>>>>> > >>> > On Mon, Jul 15, 2013 at 2:36 PM, Vijayendra
> >>> >>>>>>> > >>> > Bhamidipati < vijayendra.bhamidip...@citrix.com>
> wrote:
> >>> >>>>>>> > >>> >
> >>> >>>>>>> > >>> >> Hi Mike,
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >> Yes, you can leave out the -s option in that case.
> >>> >>>>>>> > >>> >> Looking
> >>> >>>>>>> at
> >>> >>>>>>> > >>> >> the script, the -F option if specified, deletes all
> >>> >>>>>>> > >>> >> existing files in the destination directory where
> >>> >>>>>>> > >>> >> the system
> >>> >>>>>>> templates
> >>> >>>>>>> > >>> >> are to be placed, so if you want it to start clean,
> >>> >>>>>>> > >>> >> you
> >>> >>>>>>> should
> >>> >>>>>>> > >>> >> specify that, else you can leave it out as well,
> >>> >>>>>>> > >>> >> it'll be
> >>> >>>>>>> fine.
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >> Regards,
> >>> >>>>>>> > >>> >> Vijay
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >> -----Original Message-----
> >>> >>>>>>> > >>> >> From: Mike Tutkowski
> >>> >>>>>>> > >>> >> [mailto:mike.tutkow...@solidfire.com]
> >>> >>>>>>> > >>> >> Sent: Monday, July 15, 2013 1:31 PM
> >>> >>>>>>> > >>> >> To: dev@cloudstack.apache.org
> >>> >>>>>>> > >>> >> Subject: Re: Secondary Storage Setup Question
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >> Just curious about the optional parameter:
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> /usr/lib64/cloud/common/scripts/storage/secondary/cloud-inst
> >>> >>>>>>> all
> >>> >>>>>>> > >>> >> -s
> >>> >>>>>>> > >>> >> ys-t
> >>> >>>>>>> > >>> >> mplt
> >>> >>>>>>> > >>> >> -m /mnt/secondary -u
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> http://download.cloud.com/templates/burbank/burbank-systemvm
> >>> >>>>>>> -08
> >>> >>>>>>> > >>> >> 01
> >>> >>>>>>> > >>> >> 2012
> >>> >>>>>>> > >>> >> .ova
> >>> >>>>>>> > >>> >> -h<
> >>> >>>>>>> http://download.cloud.com/templates/burbank/burbank-systemvm
> >>> >>>>>>> > >>> >> -0
> >>> >>>>>>> > >>> >> 8012 012.ova-h>vmware -s
> >>> >>>>>>> > >>> >> <optional-management-server-secret-key>
> >>> >>>>>>> > >>> >> -F
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >> If you don't want to specify a secret key, do you
> >>> >>>>>>> > >>> >> also leave the -s
> >>> >>>>>>> > >>> off?
> >>> >>>>>>> > >>> >> How's about the -F?
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >> Thanks!
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >> On Mon, Jul 15, 2013 at 1:58 PM, Mike Tutkowski <
> >>> >>>>>>> > >>> >> mike.tutkow...@solidfire.com> wrote:
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >> > Perfect - thanks!
> >>> >>>>>>> > >>> >> >
> >>> >>>>>>> > >>> >> >
> >>> >>>>>>> > >>> >> > On Mon, Jul 15, 2013 at 12:51 PM, Vijayendra
> >>> >>>>>>> > >>> >> > Bhamidipati < vijayendra.bhamidip...@citrix.com>
> >>> wrote:
> >>> >>>>>>> > >>> >> >
> >>> >>>>>>> > >>> >> >> Hi Mike,
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >> You can find the cloud-install-sys-tmplt script
> >>> >>>>>>> > >>> >> >> in the source at
> >>> >>>>>>> > >>> >> >> ./scripts/storage/secondary/cloud-install-sys-tm
> >>> >>>>>>> > >>> >> >> plt
> >>> >>>>>>> > >>> >> >> - you can run that directly from that location
> >>> >>>>>>> > >>> >> >> and preseed your secondary
> >>> >>>>>>> > >>> storage.
> >>> >>>>>>> > >>> >> >> The script would error out with a message saying
> >>> >>>>>>> > >>> >> >> it can't read
> >>> >>>>>>> > >>> >> >> /etc/cloudstack/management/db.properties
> >>> >>>>>>> > >>> >> >> - you can simply mkdir -p
> >>> >>>>>>> > >>> >> >> /etc/cloudstack/management/ and copy over your
> >>> >>>>>>> > >>> >> >> src's utils/conf/db.properties (or
> >>> >>>>>>> > >>> >> >> db.properties.override if you have
> >>> >>>>>>> > >>> >> >> it) to that directory and rerun the script.
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >> Regards,
> >>> >>>>>>> > >>> >> >> Vijay
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >> -----Original Message-----
> >>> >>>>>>> > >>> >> >> From: Mike Tutkowski [mailto:
> >>> >>>>>>> mike.tutkow...@solidfire.com]
> >>> >>>>>>> > >>> >> >> Sent: Sunday, July 14, 2013 11:47 PM
> >>> >>>>>>> > >>> >> >> To: dev@cloudstack.apache.org
> >>> >>>>>>> > >>> >> >> Subject: Secondary Storage Setup Question
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >> Hi,
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >> I'm trying to set up CloudStack with a
> >>> >>>>>>> > >>> >> >> VMware-only
> >>> >>>>>>> configuration.
> >>> >>>>>>> > >>> >> >> In the past, I've always used DevCloud2, which
> >>> >>>>>>> > >>> >> >> has worked nicely when I had Xen in the mix.
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >> One of the steps I need to do, of course, is to
> >>> >>>>>>> > >>> >> >> configure secondary storage.
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >> I have two NFS shares:
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >> /export/primary
> >>> >>>>>>> > >>> >> >> /export/secondary
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >> My management server is running in Eclipse on a
> >>> >>>>>>> > >>> >> >> different computer than the one the NFS shares
> >>> >>>>>>> > >>> >> >> are
> >>> on.
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >> I've gotten to the point where I'm supposed to
> >>> >>>>>>> > >>> >> >> seed secondary storage with a system VM template
> >>> >>>>>>> > >>> >> >> (
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.0.
> >>> >>>>>>> > >>> >> >> 0-in
> >>> >>>>>>> > >>> >> >> cub
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> ating/html/Installation_Guide/management-server-install-flow
> >>> >>>>>>> > >>> >> >> .h
> >>> >>>>>>> > >>> >> >> tml
> >>> >>>>>>> > >>> >> >> ).
> >>> >>>>>>> > >>> >> >> It makes reference to a script I'm supposed to run.
> >>> >>>>>>> > >>> >> >> The problem is
> >>> >>>>>>> > >>> >> >> - since I didn't install the CS MS on this
> >>> >>>>>>> > >>> >> >> computer
> >>> >>>>>>> (it's on
> >>> >>>>>>> > >>> >> >> a different
> >>> >>>>>>> > >>> >> >> computer)
> >>> >>>>>>> > >>> >> >> - I never downloaded any scripts.
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >> It might be elsewhere in the directions, but can
> >>> >>>>>>> > >>> >> >> someone point me to what I need to have
> >>> >>>>>>> > >>> >> >> downloaded (and from
> >>> >>>>>>> where)
> >>> >>>>>>> > >>> >> >> on my computer hosting these NFS shares so I can
> >>> >>>>>>> > >>> >> >> run the necessary
> >>> >>>>>>> > script?
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >> Thanks!
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >> --
> >>> >>>>>>> > >>> >> >> *Mike Tutkowski* *Senior CloudStack Developer,
> >>> >>>>>>> > >>> >> >> SolidFire Inc.*
> >>> >>>>>>> > >>> >> >> e: mike.tutkow...@solidfire.com
> >>> >>>>>>> > >>> >> >> o: 303.746.7302
> >>> >>>>>>> > >>> >> >> Advancing the way the world uses the
> >>> >>>>>>> > >>> >> >> cloud<http://solidfire.com/solution/overview/?vi
> >>> >>>>>>> > >>> >> >> deo=
> >>> >>>>>>> > >>> >> >> play
> >>> >>>>>>> >
> >>> >>>>>>> > >>> >> >> *(tm)*
> >>> >>>>>>> > >>> >> >>
> >>> >>>>>>> > >>> >> >
> >>> >>>>>>> > >>> >> >
> >>> >>>>>>> > >>> >> >
> >>> >>>>>>> > >>> >> > --
> >>> >>>>>>> > >>> >> > *Mike Tutkowski*
> >>> >>>>>>> > >>> >> > *Senior CloudStack Developer, SolidFire Inc.*
> >>> >>>>>>> > >>> >> > e: mike.tutkow...@solidfire.com
> >>> >>>>>>> > >>> >> > o: 303.746.7302
> >>> >>>>>>> > >>> >> > Advancing the way the world uses the
> >>> >>>>>>> > >>> >> > cloud<http://solidfire.com/solution/overview/?vid
> >>> >>>>>>> > >>> >> > eo=p
> >>> >>>>>>> > >>> >> > lay>
> >>> >>>>>>> > >>> >> > *(tm)*
> >>> >>>>>>> > >>> >> >
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >> --
> >>> >>>>>>> > >>> >> *Mike Tutkowski*
> >>> >>>>>>> > >>> >> *Senior CloudStack Developer, SolidFire Inc.*
> >>> >>>>>>> > >>> >> e: mike.tutkow...@solidfire.com
> >>> >>>>>>> > >>> >> o: 303.746.7302
> >>> >>>>>>> > >>> >> Advancing the way the world uses the
> >>> >>>>>>> > >>> >> cloud<http://solidfire.com/solution/overview/?video
> >>> >>>>>>> > >>> >> =pla
> >>> >>>>>>> > >>> >> y>
> >>> >>>>>>> > >>> >> *(tm)*
> >>> >>>>>>> > >>> >>
> >>> >>>>>>> > >>> >
> >>> >>>>>>> > >>> >
> >>> >>>>>>> > >>> >
> >>> >>>>>>> > >>> > --
> >>> >>>>>>> > >>> > *Mike Tutkowski*
> >>> >>>>>>> > >>> > *Senior CloudStack Developer, SolidFire Inc.*
> >>> >>>>>>> > >>> > e: mike.tutkow...@solidfire.com
> >>> >>>>>>> > >>> > o: 303.746.7302
> >>> >>>>>>> > >>> > Advancing the way the world uses the
> >>> >>>>>>> > >>> > cloud<http://solidfire.com/solution/overview/?video=
> >>> >>>>>>> > >>> > play
> >>> >>>>>>> > >>> > >
> >>> >>>>>>> > >>> > *(tm)*
> >>> >>>>>>> > >>> >
> >>> >>>>>>> > >>>
> >>> >>>>>>> > >>>
> >>> >>>>>>> > >>>
> >>> >>>>>>> > >>> --
> >>> >>>>>>> > >>> *Mike Tutkowski*
> >>> >>>>>>> > >>> *Senior CloudStack Developer, SolidFire Inc.*
> >>> >>>>>>> > >>> e: mike.tutkow...@solidfire.com
> >>> >>>>>>> > >>> o: 303.746.7302
> >>> >>>>>>> > >>> Advancing the way the world uses the
> >>> >>>>>>> > >>> cloud<http://solidfire.com/solution/overview/?video=pl
> >>> >>>>>>> > >>> ay>
> >>> >>>>>>> > >>> *(tm)*
> >>> >>>>>>> > >>>
> >>> >>>>>>> > >>
> >>> >>>>>>> > >>
> >>> >>>>>>> > >>
> >>> >>>>>>> > >> --
> >>> >>>>>>> > >> *Mike Tutkowski*
> >>> >>>>>>> > >> *Senior CloudStack Developer, SolidFire Inc.*
> >>> >>>>>>> > >> e: mike.tutkow...@solidfire.com
> >>> >>>>>>> > >> o: 303.746.7302
> >>> >>>>>>> > >> Advancing the way the world uses the
> >>> >>>>>>> > >> cloud<http://solidfire.com/solution/overview/?video=pla
> >>> >>>>>>> > >> y>
> >>> >>>>>>> > >> *(tm)*
> >>> >>>>>>> > >>
> >>> >>>>>>> > >
> >>> >>>>>>> > >
> >>> >>>>>>> > >
> >>> >>>>>>> > > --
> >>> >>>>>>> > > *Mike Tutkowski*
> >>> >>>>>>> > > *Senior CloudStack Developer, SolidFire Inc.*
> >>> >>>>>>> > > e: mike.tutkow...@solidfire.com
> >>> >>>>>>> > > o: 303.746.7302
> >>> >>>>>>> > > Advancing the way the world uses the
> >>> >>>>>>> > > cloud<http://solidfire.com/solution/overview/?video=play
> >>> >>>>>>> > > >
> >>> >>>>>>> > > *(tm)*
> >>> >>>>>>> > >
> >>> >>>>>>> >
> >>> >>>>>>> >
> >>> >>>>>>> >
> >>> >>>>>>> > --
> >>> >>>>>>> > *Mike Tutkowski*
> >>> >>>>>>> > *Senior CloudStack Developer, SolidFire Inc.*
> >>> >>>>>>> > e: mike.tutkow...@solidfire.com
> >>> >>>>>>> > o: 303.746.7302
> >>> >>>>>>> > Advancing the way the world uses the
> >>> >>>>>>> > cloud<http://solidfire.com/solution/overview/?video=play>
> >>> >>>>>>> > *(tm)*
> >>> >>>>>>> >
> >>> >>>>>>>
> >>> >>>>>>>
> >>> >>>>>>>
> >>> >>>>>>> --
> >>> >>>>>>> *Mike Tutkowski*
> >>> >>>>>>> *Senior CloudStack Developer, SolidFire Inc.*
> >>> >>>>>>> e: mike.tutkow...@solidfire.com
> >>> >>>>>>> o: 303.746.7302
> >>> >>>>>>> Advancing the way the world uses the
> >>> >>>>>>> cloud<http://solidfire.com/solution/overview/?video=play>
> >>> >>>>>>> *(tm)*
> >>> >>>>>>>
> >>> >>>>>>
> >>> >>>>>>
> >>> >>>>>>
> >>> >>>>>> --
> >>> >>>>>> *Mike Tutkowski*
> >>> >>>>>> *Senior CloudStack Developer, SolidFire Inc.*
> >>> >>>>>> e: mike.tutkow...@solidfire.com
> >>> >>>>>> o: 303.746.7302
> >>> >>>>>> Advancing the way the world uses the
> >>> >>>>>> cloud<http://solidfire.com/solution/overview/?video=play>
> >>> >>>>>> *(tm)*
> >>> >>>>>>
> >>> >>>>>
> >>> >>>>>
> >>> >>>>>
> >>> >>>>> --
> >>> >>>>> *Mike Tutkowski*
> >>> >>>>> *Senior CloudStack Developer, SolidFire Inc.*
> >>> >>>>> e: mike.tutkow...@solidfire.com
> >>> >>>>> o: 303.746.7302
> >>> >>>>> Advancing the way the world uses the
> >>> >>>>> cloud<http://solidfire.com/solution/overview/?video=play>
> >>> >>>>> *(tm)*
> >>> >>>>>
> >>> >>>>
> >>> >>>>
> >>> >>>>
> >>> >>>> --
> >>> >>>> *Mike Tutkowski*
> >>> >>>> *Senior CloudStack Developer, SolidFire Inc.*
> >>> >>>> e: mike.tutkow...@solidfire.com
> >>> >>>> o: 303.746.7302
> >>> >>>> Advancing the way the world uses the
> >>> >>>> cloud<http://solidfire.com/solution/overview/?video=play>
> >>> >>>> *(tm)*
> >>> >>>>
> >>> >>>
> >>> >>>
> >>> >>>
> >>> >>> --
> >>> >>> *Mike Tutkowski*
> >>> >>> *Senior CloudStack Developer, SolidFire Inc.*
> >>> >>> e: mike.tutkow...@solidfire.com
> >>> >>> o: 303.746.7302
> >>> >>> Advancing the way the world uses the
> >>> >>> cloud<http://solidfire.com/solution/overview/?video=play>
> >>> >>> *(tm)*
> >>> >>>
> >>> >>
> >>> >>
> >>> >>
> >>> >> --
> >>> >> *Mike Tutkowski*
> >>> >> *Senior CloudStack Developer, SolidFire Inc.*
> >>> >> e: mike.tutkow...@solidfire.com
> >>> >> o: 303.746.7302
> >>> >> Advancing the way the world uses the
> >>> >> cloud<http://solidfire.com/solution/overview/?video=play>
> >>> >> *(tm)*
> >>> >>
> >>> >
> >>> >
> >>> >
> >>> > --
> >>> > *Mike Tutkowski*
> >>> > *Senior CloudStack Developer, SolidFire Inc.*
> >>> > e: mike.tutkow...@solidfire.com
> >>> > o: 303.746.7302
> >>> > Advancing the way the world uses the
> >>> > cloud<http://solidfire.com/solution/overview/?video=play>
> >>> > *(tm)*
> >>> >
> >>>
> >>>
> >>>
> >>> --
> >>> *Mike Tutkowski*
> >>> *Senior CloudStack Developer, SolidFire Inc.*
> >>> e: mike.tutkow...@solidfire.com
> >>> o: 303.746.7302
> >>> Advancing the way the world uses the
> >>> cloud<http://solidfire.com/solution/overview/?video=play>
> >>> *(tm)*
> >>>
> >>
> >>
> >>
> >> --
> >> *Mike Tutkowski*
> >> *Senior CloudStack Developer, SolidFire Inc.*
> >> e: mike.tutkow...@solidfire.com
> >> o: 303.746.7302
> >> Advancing the way the world uses the
> >> cloud<http://solidfire.com/solution/overview/?video=play>
> >> *(tm)*
> >>
> >
> >
> >
> > --
> > *Mike Tutkowski*
> > *Senior CloudStack Developer, SolidFire Inc.*
> > e: mike.tutkow...@solidfire.com
> > o: 303.746.7302
> > Advancing the way the world uses the
> > cloud<http://solidfire.com/solution/overview/?video=play>
> > *(tm)*
> >
>
>
>
> --
> *Mike Tutkowski*
> *Senior CloudStack Developer, SolidFire Inc.*
> e: mike.tutkow...@solidfire.com
> o: 303.746.7302
> Advancing the way the world uses the
> cloud<http://solidfire.com/solution/overview/?video=play>
> *(tm)*
>



-- 
*Mike Tutkowski*
*Senior CloudStack Developer, SolidFire Inc.*
e: mike.tutkow...@solidfire.com
o: 303.746.7302
Advancing the way the world uses the
cloud<http://solidfire.com/solution/overview/?video=play>
*™*

Reply via email to