RE: CS4 AWS S3 support

[Asmita Vagyani]

I used the source, build the project and then I am using Cloudstack 4.0.0

I am using the S3 browser to connect to the S3 AWS API. It supports all AWS 
features with the s3 compatible services.
I register a user on Cloudstack for using s3 AWS services.
I have used NFS mount as my storage pool.
I login to this tool using the Account Name, API key, secret Key and the AWS S3 
service endpoint.
It allows me to login then.
Then I create bucket into the S3 browser.
In Cloudstack awsapi.log I can see logs are generated and the bucket is created 
successfully.
In the /s3storage folder  I am able to see buckets.

When  an error occurred during Getting buckets list on S3 browser, I decided to 
look for only bucket.
So I chose to use this approach from the IE browser I try yo look into the 
bucket named test12323 using API:
http://:7080/awsapi/rest/AmazonS3/test12323 

Then it gives me ACL issue.

Thanks and Regards.

Asmita Patil Vagyani. 

-Original Message-
From: Rajesh Battala [mailto:rajesh.batt...@citrix.com] 
Sent: 27 March 2013 AM 10:31
To: users@cloudstack.apache.org
Subject: RE: CS4 AWS S3 support

Asmita,
Are you using S3 from source or from the build?
Can you report when are you facing the issues with ACL's?

Thanks
Rajesh Battala

> -Original Message-
> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> Sent: Wednesday, March 27, 2013 10:16 AM
> To: 'users@cloudstack.apache.org'
> Subject: RE: CS4 AWS S3 support
> 
> Hi Rajesh,
> 
> Is there any work-around to avoid the ACL permission issues?
> 
> Thanks and Regards.
> 
> Asmita
> 
> -Original Message-
> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
> Sent: 26 March 2013 PM 07:47
> To: users@cloudstack.apache.org; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> Good to know the issue is resolve. As I had already told it's because 
> of the permission issue.
> 
> There are few bugs related to ACL's. feel free to file bugs against S3.
> I had run all the boto unit tests, most of them were working fine.
> 
> 
> Thanks
> Rajesh Battala
> 
> > -Original Message-
> > From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> > Sent: Tuesday, March 26, 2013 6:52 PM
> > To: 'users@cloudstack.apache.org'; 'Sebastien Goasguen'
> > Subject: RE: CS4 AWS S3 support
> >
> > Issue is resolved now.
> > I used set gid on the /s3storage folder and then it allowed to create 
> > buckets.
> > Now the bucket gets created in mount point folder, but the owner of 
> > folder is nobody user.
> >
> > Now when I use: 
> > http://:7080/awsapi/rest/AmazonS3/test12323
> > This should give me details abt the bucket.
> >
> > I get following error on IE browser: Access denied -
> > com.cloud.bridge.service.exception.PermissionDeniedException: Access 
> > Denied
> > - ACLs do not give user the required permission What is the issue?
> >
> > Logs show-
> > com.cloud.bridge.service.exception.PermissionDeniedException: Access 
> > Denied
> > - ACLs do not give user the required permission
> > at
> >
> com.cloud.bridge.service.core.s3.S3Engine.accessAllowed(S3Engine.java:
> 1762)
> > at
> > com.cloud.bridge.service.core.s3.S3Engine.verifyAccess(S3Engine.java:1729)
> > at
> > com.cloud.bridge.service.core.s3.S3Engine.listBucketContents(S3Engine.
> > java:36
> > 2)
> > at
> > com.cloud.bridge.service.controller.s3.S3BucketAction.executeGetBuck
> > et
> > (S3Bu
> > cketAction.java:578)
> > at
> >
> com.cloud.bridge.service.controller.s3.S3BucketAction.execute(S3BucketAction.
> > java:202)
> > at
> >
> com.cloud.bridge.service.S3RestServlet.processRequest(S3RestServlet.ja
> va:181)
> > at 
> > com.cloud.bridge.service.S3RestServlet.doGet(S3RestServlet.java:84)
> > at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> > at
> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(App
> > li
> > cationFilte
> > rChain.java:290)
> > at
> > org.apache.catalina.core.ApplicationFilterChain.doFilter(Application
> > Fi
> > lterChain.j
> > ava:206)
> > at
> > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapper
> > Va
> > lve
> > .java:233)
> > at
> > org.apache.catalina.core.StandardContextValve.invoke(StandardContext
> > Va
> > lve.j
> > ava:191)
> > at
> > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.
> > ja
> > va:12
> > 7)
> > at
> >
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.ja
> va:102)
> > at
> > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
> > at
> > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineVa
> > lv
> > e.jav
> > a:109)
> > at
> >
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java
> :298)
> > at
> > org.apache.coyote.http11.Http11NioProcessor.pr

RE: CS4 AWS S3 support

[Rajesh Battala]

Asmita,
Are you using S3 from source or from the build?
Can you report when are you facing the issues with ACL's?

Thanks
Rajesh Battala

> -Original Message-
> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> Sent: Wednesday, March 27, 2013 10:16 AM
> To: 'users@cloudstack.apache.org'
> Subject: RE: CS4 AWS S3 support
> 
> Hi Rajesh,
> 
> Is there any work-around to avoid the ACL permission issues?
> 
> Thanks and Regards.
> 
> Asmita
> 
> -Original Message-
> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
> Sent: 26 March 2013 PM 07:47
> To: users@cloudstack.apache.org; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> Good to know the issue is resolve. As I had already told it's because of the
> permission issue.
> 
> There are few bugs related to ACL's. feel free to file bugs against S3.
> I had run all the boto unit tests, most of them were working fine.
> 
> 
> Thanks
> Rajesh Battala
> 
> > -Original Message-
> > From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> > Sent: Tuesday, March 26, 2013 6:52 PM
> > To: 'users@cloudstack.apache.org'; 'Sebastien Goasguen'
> > Subject: RE: CS4 AWS S3 support
> >
> > Issue is resolved now.
> > I used set gid on the /s3storage folder and then it allowed to create 
> > buckets.
> > Now the bucket gets created in mount point folder, but the owner of
> > folder is nobody user.
> >
> > Now when I use: http://:7080/awsapi/rest/AmazonS3/test12323
> > This should give me details abt the bucket.
> >
> > I get following error on IE browser: Access denied -
> > com.cloud.bridge.service.exception.PermissionDeniedException: Access
> > Denied
> > - ACLs do not give user the required permission What is the issue?
> >
> > Logs show-
> > com.cloud.bridge.service.exception.PermissionDeniedException: Access
> > Denied
> > - ACLs do not give user the required permission
> > at
> >
> com.cloud.bridge.service.core.s3.S3Engine.accessAllowed(S3Engine.java:1762)
> > at
> > com.cloud.bridge.service.core.s3.S3Engine.verifyAccess(S3Engine.java:1729)
> > at
> > com.cloud.bridge.service.core.s3.S3Engine.listBucketContents(S3Engine.
> > java:36
> > 2)
> > at
> > com.cloud.bridge.service.controller.s3.S3BucketAction.executeGetBucket
> > (S3Bu
> > cketAction.java:578)
> > at
> >
> com.cloud.bridge.service.controller.s3.S3BucketAction.execute(S3BucketAction.
> > java:202)
> > at
> >
> com.cloud.bridge.service.S3RestServlet.processRequest(S3RestServlet.java:181)
> > at 
> > com.cloud.bridge.service.S3RestServlet.doGet(S3RestServlet.java:84)
> > at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> > at
> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appli
> > cationFilte
> > rChain.java:290)
> > at
> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFi
> > lterChain.j
> > ava:206)
> > at
> > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperVa
> > lve
> > .java:233)
> > at
> > org.apache.catalina.core.StandardContextValve.invoke(StandardContextVa
> > lve.j
> > ava:191)
> > at
> > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.ja
> > va:12
> > 7)
> > at
> >
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> > at
> > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
> > at
> > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValv
> > e.jav
> > a:109)
> > at
> >
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> > at
> > org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor
> > .jav
> > a:889)
> > at
> > org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.pro
> > ce
> > ss(Http11NioProtocol.java:721)
> > at
> > org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint
> > .java
> > :2268)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> > ava:1
> > 110)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
> > 603)
> > at java.lang.Thread.run(Thread.java:722)
> >
> >
> > Thanks and Regards.
> >
> > Asmita
> >
> > -Original Message-
> > From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
> > Sent: 26 March 2013 PM 06:00
> > To: users@cloudstack.apache.org; 'Sebastien Goasguen'
> > Subject: RE: CS4 AWS S3 support
> >
> > From the code, this exception will be thrown  if the S3 is not able to
> > create the
> > folder(bucket) in that specified location.
> > Please check the permission and mount points. That is only issue.
> >
> > Thanks
> > Rajesh Battala
> >
> >
> >
> > > -Original Message-
> > > From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.

RE: CS4 AWS S3 support

[Asmita Vagyani]

Hi Rajesh,

Is there any work-around to avoid the ACL permission issues?

Thanks and Regards.

Asmita 

-Original Message-
From: Rajesh Battala [mailto:rajesh.batt...@citrix.com] 
Sent: 26 March 2013 PM 07:47
To: users@cloudstack.apache.org; 'Sebastien Goasguen'
Subject: RE: CS4 AWS S3 support

Good to know the issue is resolve. As I had already told it's because of the 
permission issue. 

There are few bugs related to ACL's. feel free to file bugs against S3.
I had run all the boto unit tests, most of them were working fine. 


Thanks
Rajesh Battala

> -Original Message-
> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> Sent: Tuesday, March 26, 2013 6:52 PM
> To: 'users@cloudstack.apache.org'; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> Issue is resolved now.
> I used set gid on the /s3storage folder and then it allowed to create buckets.
> Now the bucket gets created in mount point folder, but the owner of 
> folder is nobody user.
> 
> Now when I use: http://:7080/awsapi/rest/AmazonS3/test12323
> This should give me details abt the bucket.
> 
> I get following error on IE browser: Access denied -
> com.cloud.bridge.service.exception.PermissionDeniedException: Access 
> Denied
> - ACLs do not give user the required permission What is the issue?
> 
> Logs show-
> com.cloud.bridge.service.exception.PermissionDeniedException: Access 
> Denied
> - ACLs do not give user the required permission
> at
> com.cloud.bridge.service.core.s3.S3Engine.accessAllowed(S3Engine.java:1762)
> at
> com.cloud.bridge.service.core.s3.S3Engine.verifyAccess(S3Engine.java:1729)
> at
> com.cloud.bridge.service.core.s3.S3Engine.listBucketContents(S3Engine.
> java:36
> 2)
> at
> com.cloud.bridge.service.controller.s3.S3BucketAction.executeGetBucket
> (S3Bu
> cketAction.java:578)
> at
> com.cloud.bridge.service.controller.s3.S3BucketAction.execute(S3BucketAction.
> java:202)
> at
> com.cloud.bridge.service.S3RestServlet.processRequest(S3RestServlet.java:181)
> at com.cloud.bridge.service.S3RestServlet.doGet(S3RestServlet.java:84)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appli
> cationFilte
> rChain.java:290)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFi
> lterChain.j
> ava:206)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperVa
> lve
> .java:233)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextVa
> lve.j
> ava:191)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.ja
> va:12
> 7)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
> at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValv
> e.jav
> a:109)
> at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> at
> org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor
> .jav
> a:889)
> at
> org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.pro
> ce
> ss(Http11NioProtocol.java:721)
> at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint
> .java
> :2268)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> ava:1
> 110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
> 603)
> at java.lang.Thread.run(Thread.java:722)
> 
> 
> Thanks and Regards.
> 
> Asmita
> 
> -Original Message-
> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
> Sent: 26 March 2013 PM 06:00
> To: users@cloudstack.apache.org; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> From the code, this exception will be thrown  if the S3 is not able to 
> create the
> folder(bucket) in that specified location.
> Please check the permission and mount points. That is only issue.
> 
> Thanks
> Rajesh Battala
> 
> 
> 
> > -Original Message-
> > From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> > Sent: Tuesday, March 26, 2013 5:31 PM
> > To: 'users@cloudstack.apache.org'; 'Sebastien Goasguen'
> > Subject: RE: CS4 AWS S3 support
> >
> > Hi ,
> >
> > Yes, folder is created on root directory and mount this is the mount point.
> > The ownership is assigned to the root group and cloud user.
> >
> > $mount
> >
> > /dev/mapper/RootVolGroup-RootVol on / type ext4 (rw) proc on /proc 
> > type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type 
> > devpts
> > (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs
> > (rw,rootcontext="system_u:object_r:tmpfs_t:s0")
> > /dev/sda1 on /boot type ext4 (rw)
> > /de

Re: default template

[Carlos Reategui]

ignore that... I screwed something up during the install and just re-did my
install.


On Tue, Mar 26, 2013 at 7:38 PM, Carlos Reategui wrote:

> I forgot to cloud-install-sys-tmplt the default acton template before
> creating my zone.
>
> How do I tell it to reload after the fact so that I get the default centos
> template?
>
> thanks
> Carlos
>

default template

[Carlos Reategui]

I forgot to cloud-install-sys-tmplt the default acton template before
creating my zone.

How do I tell it to reload after the fact so that I get the default centos
template?

thanks
Carlos

Re: Upgrade to 4.1

[David Nalley]

It's a bug if it isn't.

--David

On Tue, Mar 26, 2013 at 8:09 PM, Carlos Reategui  wrote:
> Just curious if the update to 4.1 will be as simple as:
> apt-get upgrade

Upgrade to 4.1

[Carlos Reategui]

Just curious if the update to 4.1 will be as simple as:
apt-get upgrade

Re: VMWare 5.1 errors with 4.1

[Kirk Kosinski]

Hi, Francois.  CloudStack needs admin rights at the vCenter server
level, not just at the datacenter level.  The "Unable to setup custom
field facility" error indicates a lack of needed permissions.

Best regards,
Kirk

On 03/26/2013 01:36 PM, Francois Gaudreault wrote:
> I should give a bit more details here.  Our vCenter contains other
> DataCenter, and we give administrative rights to the cloudstack user only
> to a specific DC.  Is that sufficient?  Do we need top-level privileges for
> adding custom fields?
> 
> Francois
> 
> 
> On Tue, Mar 26, 2013 at 4:17 PM, Francois Gaudreault <
> fgaudrea...@cloudops.com> wrote:
> 
>>  Hi,
>>
>> We compiled the 4.1 latest code today, and when we try to add a zone with
>> a VMWare cluster, we end up with this error:
>>
>> INFO  [network.vpc.VpcManagerImpl] (VpcChecker-1:) Found 0 removed VPCs to
>> cleanup
>> INFO  [hypervisor.vmware.VmwareServerDiscoverer] (catalina-exec-14:)
>> Discover host. dc: 2, pod: 2, cluster: 6, uri host: 10.0.22.12
>> INFO  [hypervisor.vmware.VmwareServerDiscoverer] (catalina-exec-14:)
>> Detected private network label : vSwitch0
>> Started
>> INFO  [vmware.manager.VmwareManagerImpl] (catalina-exec-14:) Preparing
>> network on host com.cloud.hypervisor.vmware.util.VmwareContext@184cdd35for 
>> vSwitch0
>> INFO  [vmware.mo.HypervisorHostHelper] (catalina-exec-14:) Network
>> cloud.private.untagged.0.1-vSwitch0 is ready on vSwitch vSwitch0
>> INFO  [vmware.manager.VmwareManagerImpl] (catalina-exec-14:) Preparing
>> network on host com.cloud.hypervisor.vmware.util.VmwareContext@184cdd35for 
>> vSwitch0
>> INFO  [vmware.mo.HypervisorHostHelper] (catalina-exec-14:) Network
>> cloud.private.untagged.0.1-vSwitch0 is ready on vSwitch vSwitch0
>> Started
>> ERROR [vmware.resource.VmwareResource] (catalina-exec-14:) Unexpected
>> Exception
>> java.lang.Exception: Unable to setup custom field facility for
>> Datastore:cloud.uuid
>> at com.cloud.hypervisor.vmware.mo.CustomFieldsManagerMO.
>> ensureCustomFieldDef(CustomFieldsManagerMO.java:80)
>> at com.cloud.hypervisor.vmware.resource.VmwareResource.
>> configure(VmwareResource.java:4804)
>> at com.cloud.hypervisor.vmware.VmwareServerDiscoverer.find(
>> VmwareServerDiscoverer.java:268)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(
>> NativeMethodAccessorImpl.java:57)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
>> DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:616)
>> at org.springframework.aop.support.AopUtils.
>> invokeJoinpointUsingReflection(AopUtils.java:319)
>> at org.springframework.aop.framework.ReflectiveMethodInvocation.
>> invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>> at org.springframework.aop.framework.ReflectiveMethodInvocation.
>> proceed(ReflectiveMethodInvocation.java:150)
>> at org.springframework.aop.aspectj.MethodInvocationProceedingJoin
>> Point.proceed(MethodInvocationProceedingJoinPoint.java:80)
>> at com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(
>> TransactionContextBuilder.java:45)
>> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
>> DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:616)
>> at org.springframework.aop.aspectj.AbstractAspectJAdvice.
>> invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621)
>> at org.springframework.aop.aspectj.AbstractAspectJAdvice.
>> invokeAdviceMethod(AbstractAspectJAdvice.java:610)
>> at org.springframework.aop.aspectj.AspectJAroundAdvice.
>> invoke(AspectJAroundAdvice.java:65)
>> at org.springframework.aop.framework.ReflectiveMethodInvocation.
>> proceed(ReflectiveMethodInvocation.java:172)
>> at org.springframework.aop.interceptor.
>> ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90)
>> at org.springframework.aop.framework.ReflectiveMethodInvocation.
>> proceed(ReflectiveMethodInvocation.java:172)
>> at org.springframework.aop.framework.JdkDynamicAopProxy.
>> invoke(JdkDynamicAopProxy.java:202)
>> at sun.proxy.$Proxy238.find(Unknown Source)
>> at com.cloud.resource.ResourceManagerImpl.discoverCluster(
>> ResourceManagerImpl.java:521)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(
>> NativeMethodAccessorImpl.java:57)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
>> DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:616)
>> at org.springframework.aop.support.AopUtils.
>> invokeJoinpointUsingReflection(AopUtils.java:319)
>> at org.springframework.aop.framework.ReflectiveMethodInvocation.
>> invokeJoinpoint(R

Re: question about cloudstack sticky policy of load balancer?

[Chiradeep Vittal]

More information here:
http://docs.aws.amazon.com/ElasticLoadBalancing/latest/DeveloperGuide/US_St
ickySessions.html


Appcookie is a cookie inserted by the application. For example, JSESSIONID
is typically inserted by Java Web servers

Lbcookie is a cookie inserted by the LB itself.

On 3/26/13 8:53 AM, "Wang Fei"  wrote:

>as we know that, there are three sticky policy for load balancer.
>
>1, source base
>2, appcookie
>3, lbcookie
>
>sourcebase is simple and I understand how it implement. but the rest two
>is
>not use quite often. so, I don't know some param meaning of appcookie,
>such
>as mode, length and request learn.  can you explain these field and how
>these two policy works briefly? how it persistent and how it dispatch the
>request based on cookie?
>
>
>
>
>best regards

Re: Xenserver xencenter

[Kirk Jantzer]

Xencenter manages xenserver(s).
On Mar 26, 2013 5:17 PM, "Seif Eddine Jemli" 
wrote:

> Hi,
>
> i am confused : what's the difference between xenserver and xencenter?
>
> Do the host machines where i have to install Xenserver need to contain only
> one operating system? Because i read that i can't use a dual booting
> machine.
> ?
>
> thanks
>

Xenserver xencenter

[Seif Eddine Jemli]

Hi,

i am confused : what's the difference between xenserver and xencenter?

Do the host machines where i have to install Xenserver need to contain only
one operating system? Because i read that i can't use a dual booting
machine.
?

thanks

Re: [DISCUSS] Event Announcements?

[Kelly Hair]

SoŠ stick with marketing@ is what it sounds like.  Makes sense.







On 3/26/13 5:09 PM, "Chip Childers"  wrote:

>On Tue, Mar 26, 2013 at 09:04:37PM +, Mathias Mullins wrote:
>> Have we ever thought of having an announce@ like Apache does?
>
>In progress, but that will be *only* for release announcements and major
>project announcements...  not for events.
>

Re: [DISCUSS] Event Announcements?

[Chip Childers]

On Tue, Mar 26, 2013 at 09:04:37PM +, Mathias Mullins wrote:
> Have we ever thought of having an announce@ like Apache does?

In progress, but that will be *only* for release announcements and major
project announcements...  not for events.

Re: [DISCUSS] Event Announcements?

[Mathias Mullins]

Have we ever thought of having an announce@ like Apache does?

Thanks,
Matt


On 3/26/13 4:15 PM, "Joe Brockmeier"  wrote:

>On Fri, Mar 22, 2013, at 04:39 PM, Bryan Whitehead wrote:
>> I would like to see them. I also wouldn't mind a separate list for such
>> things.
>> 
>> It is pretty annoying to find out about something too lateŠ
>
>Absolutely. 
>
>OK - I haven't gotten a flood of "please don't send event announcements
>to users" replies, so I'm going to start making sure we post event
>announcements to this list without getting obnoxious about it.
>
>Thanks all - hope that we can find a nice happy medium where everybody
>can be aware of what's going on in the community without excess email.
>Thanks!
>
>Best,
>
>jzb
>-- 
>Joe Brockmeier
>j...@zonker.net
>Twitter: @jzb
>http://www.dissociatedpress.net/

RE: Video drivers

[Edison Su]

Need to modify kvm agent code to change video adapter, as the video driver is 
hard coded.

> -Original Message-
> From: Aleksey Samarin [mailto:nrg3...@gmail.com]
> Sent: Tuesday, March 26, 2013 12:18 AM
> To: cloudstack-us...@incubator.apache.org
> Subject: Video drivers
> 
> Hello everyone!
> 
> Anyone tried to change video adapter in kvm vm, from cirrus to vga/vmware?
> 
> I'm using CS 4.0, Ubuntu 12.10
> 
> Thanks!

Re: VMWare 5.1 errors with 4.1

[Francois Gaudreault]

I should give a bit more details here.  Our vCenter contains other
DataCenter, and we give administrative rights to the cloudstack user only
to a specific DC.  Is that sufficient?  Do we need top-level privileges for
adding custom fields?

Francois


On Tue, Mar 26, 2013 at 4:17 PM, Francois Gaudreault <
fgaudrea...@cloudops.com> wrote:

>  Hi,
>
> We compiled the 4.1 latest code today, and when we try to add a zone with
> a VMWare cluster, we end up with this error:
>
> INFO  [network.vpc.VpcManagerImpl] (VpcChecker-1:) Found 0 removed VPCs to
> cleanup
> INFO  [hypervisor.vmware.VmwareServerDiscoverer] (catalina-exec-14:)
> Discover host. dc: 2, pod: 2, cluster: 6, uri host: 10.0.22.12
> INFO  [hypervisor.vmware.VmwareServerDiscoverer] (catalina-exec-14:)
> Detected private network label : vSwitch0
> Started
> INFO  [vmware.manager.VmwareManagerImpl] (catalina-exec-14:) Preparing
> network on host com.cloud.hypervisor.vmware.util.VmwareContext@184cdd35for 
> vSwitch0
> INFO  [vmware.mo.HypervisorHostHelper] (catalina-exec-14:) Network
> cloud.private.untagged.0.1-vSwitch0 is ready on vSwitch vSwitch0
> INFO  [vmware.manager.VmwareManagerImpl] (catalina-exec-14:) Preparing
> network on host com.cloud.hypervisor.vmware.util.VmwareContext@184cdd35for 
> vSwitch0
> INFO  [vmware.mo.HypervisorHostHelper] (catalina-exec-14:) Network
> cloud.private.untagged.0.1-vSwitch0 is ready on vSwitch vSwitch0
> Started
> ERROR [vmware.resource.VmwareResource] (catalina-exec-14:) Unexpected
> Exception
> java.lang.Exception: Unable to setup custom field facility for
> Datastore:cloud.uuid
> at com.cloud.hypervisor.vmware.mo.CustomFieldsManagerMO.
> ensureCustomFieldDef(CustomFieldsManagerMO.java:80)
> at com.cloud.hypervisor.vmware.resource.VmwareResource.
> configure(VmwareResource.java:4804)
> at com.cloud.hypervisor.vmware.VmwareServerDiscoverer.find(
> VmwareServerDiscoverer.java:268)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:616)
> at org.springframework.aop.support.AopUtils.
> invokeJoinpointUsingReflection(AopUtils.java:319)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.
> invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.
> proceed(ReflectiveMethodInvocation.java:150)
> at org.springframework.aop.aspectj.MethodInvocationProceedingJoin
> Point.proceed(MethodInvocationProceedingJoinPoint.java:80)
> at com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(
> TransactionContextBuilder.java:45)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:616)
> at org.springframework.aop.aspectj.AbstractAspectJAdvice.
> invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621)
> at org.springframework.aop.aspectj.AbstractAspectJAdvice.
> invokeAdviceMethod(AbstractAspectJAdvice.java:610)
> at org.springframework.aop.aspectj.AspectJAroundAdvice.
> invoke(AspectJAroundAdvice.java:65)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.
> proceed(ReflectiveMethodInvocation.java:172)
> at org.springframework.aop.interceptor.
> ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.
> proceed(ReflectiveMethodInvocation.java:172)
> at org.springframework.aop.framework.JdkDynamicAopProxy.
> invoke(JdkDynamicAopProxy.java:202)
> at sun.proxy.$Proxy238.find(Unknown Source)
> at com.cloud.resource.ResourceManagerImpl.discoverCluster(
> ResourceManagerImpl.java:521)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:616)
> at org.springframework.aop.support.AopUtils.
> invokeJoinpointUsingReflection(AopUtils.java:319)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.
> invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.
> proceed(ReflectiveMethodInvocation.java:150)
> at org.springframework.aop.aspectj.MethodInvocationProceedingJoin
> Point.proceed(MethodInvocationProceedingJoinPoint.java:80)
> at com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(
> T

VMWare 5.1 errors with 4.1

[Francois Gaudreault]

Hi,

We compiled the 4.1 latest code today, and when we try to add a zone 
with a VMWare cluster, we end up with this error:


INFO  [network.vpc.VpcManagerImpl] (VpcChecker-1:) Found 0 removed VPCs 
to cleanup
INFO  [hypervisor.vmware.VmwareServerDiscoverer] (catalina-exec-14:) 
Discover host. dc: 2, pod: 2, cluster: 6, uri host: 10.0.22.12
INFO  [hypervisor.vmware.VmwareServerDiscoverer] (catalina-exec-14:) 
Detected private network label : vSwitch0

Started
INFO  [vmware.manager.VmwareManagerImpl] (catalina-exec-14:) Preparing 
network on host com.cloud.hypervisor.vmware.util.VmwareContext@184cdd35 
for vSwitch0
INFO  [vmware.mo.HypervisorHostHelper] (catalina-exec-14:) Network 
cloud.private.untagged.0.1-vSwitch0 is ready on vSwitch vSwitch0
INFO  [vmware.manager.VmwareManagerImpl] (catalina-exec-14:) Preparing 
network on host com.cloud.hypervisor.vmware.util.VmwareContext@184cdd35 
for vSwitch0
INFO  [vmware.mo.HypervisorHostHelper] (catalina-exec-14:) Network 
cloud.private.untagged.0.1-vSwitch0 is ready on vSwitch vSwitch0

Started
ERROR [vmware.resource.VmwareResource] (catalina-exec-14:) Unexpected 
Exception
java.lang.Exception: Unable to setup custom field facility for 
Datastore:cloud.uuid
at 
com.cloud.hypervisor.vmware.mo.CustomFieldsManagerMO.ensureCustomFieldDef(CustomFieldsManagerMO.java:80)
at 
com.cloud.hypervisor.vmware.resource.VmwareResource.configure(VmwareResource.java:4804)
at 
com.cloud.hypervisor.vmware.VmwareServerDiscoverer.find(VmwareServerDiscoverer.java:268)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:616)
at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:319)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at 
org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80)
at 
com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:45)

at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:616)
at 
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621)
at 
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610)
at 
org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at 
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)

at sun.proxy.$Proxy238.find(Unknown Source)
at 
com.cloud.resource.ResourceManagerImpl.discoverCluster(ResourceManagerImpl.java:521)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:616)
at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:319)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at 
org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80)
at 
com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:39)

at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:616)
at 
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621)
at 
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(Abstrac

Re: [DISCUSS] Event Announcements?

[Joe Brockmeier]

On Fri, Mar 22, 2013, at 04:39 PM, Bryan Whitehead wrote:
> I would like to see them. I also wouldn't mind a separate list for such
> things.
> 
> It is pretty annoying to find out about something too late…

Absolutely. 

OK - I haven't gotten a flood of "please don't send event announcements
to users" replies, so I'm going to start making sure we post event
announcements to this list without getting obnoxious about it. 

Thanks all - hope that we can find a nice happy medium where everybody
can be aware of what's going on in the community without excess email.
Thanks!

Best,

jzb
-- 
Joe Brockmeier
j...@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/

unable to start VPN access

[tawfiq zidi]

HI,

I had enabled vpn acess in an instance, and I followed those steps :

1)
https://support.getcloudservices.com/entries/22002407-CloudStack-Configure-VPN-and-VPN-Users

2)
https://support.getcloudservices.com/entries/22001616-CloudStack-Configure-Windows-7-for-VPN-Access


I am trying to connect to a VPN using my windows 7 laptop. I am getting an
error msg:



“The remote connection was not made because the attempted VPN tunnels
failed. The VPN server might be unreachable. If this connection is
attempting to use an L2TP/IPsec tunnel, the security parameters required
for IPsec negotiation might not be configured properly.”



What to do? Can anyone help??


Best regards.

RE: api commands override/modification

[Pranav Saxena]

Hey Valery,

Not very sure but I don't think there's any documentation which would give you 
the code level details for modifying an API . For that you need to search for 
that specific function and then dig into the logic there. You could though have 
a look at this - 
http://download.cloud.com/releases/3.0.3/api_3.0.3/TOC_Root_Admin.html to get a 
feel of how many API's are there in all and what all parameters they accept.

Thanks,
Pranav

-Original Message-
From: Valery Ciareszka [mailto:valery.teres...@gmail.com] 
Sent: Tuesday, March 26, 2013 9:47 PM
To: cloudstack-us...@incubator.apache.org
Subject: api commands override/modification

Hi all,

Is there any guide about how to create/modify api commands in cloudstack ?
I use 4.0.1 and want to slightly modify(or create i.e.
associateIpAddressAlt) associateIpAddress() api call. What is the best way of 
doing that ?

--
Regards,
Valery

http://protocol.by/slayer

api commands override/modification

[Valery Ciareszka]

Hi all,

Is there any guide about how to create/modify api commands in cloudstack ?
I use 4.0.1 and want to slightly modify(or create i.e.
associateIpAddressAlt) associateIpAddress() api call. What is the best way
of doing that ?

-- 
Regards,
Valery

http://protocol.by/slayer

question about cloudstack sticky policy of load balancer?

[Wang Fei]

as we know that, there are three sticky policy for load balancer.

1, source base
2, appcookie
3, lbcookie

sourcebase is simple and I understand how it implement. but the rest two is
not use quite often. so, I don't know some param meaning of appcookie, such
as mode, length and request learn.  can you explain these field and how
these two policy works briefly? how it persistent and how it dispatch the
request based on cookie?




best regards

Re: Unable to add rebuilt xenserver host

[Kirk Jantzer]

Any more ideas? Haven't been able to add this no matter what I do. If I'm
going to roll CS into production, re-adding a rebuilt host should be
trivial.


On Fri, Mar 22, 2013 at 2:48 PM, Warren Nicholson <
warren.nichol...@nfinausa.com> wrote:

> There are good articles for xe pif setup (including the CloudStack admin
> guide).
>
> I've also noticed I had to reboot after setting up the IP's in the
> ifcg-xenbrx files.
>
> I'm sure the network & the bonding should be similar to the old unit to
> reconnect
>
> Warren
>
> -Original Message-
> From: Ahmad Emneina [mailto:aemne...@gmail.com]
> Sent: Friday, March 22, 2013 1:43 PM
> To: Kirk Jantzer
> Cc: Cloudstack users mailing list
> Subject: Re: Unable to add rebuilt xenserver host
>
> there you go, it seems the nics/networks arent programmed the same as the
> other hosts in the pool. if you clear that up... add it back through
> cloudstack.
>
>
> On Fri, Mar 22, 2013 at 11:35 AM, Kirk Jantzer
> wrote:
>
> > I get: "This server's network backend is different from the master's"
> >
> >
> > On Fri, Mar 22, 2013 at 2:30 PM, Jason Davis  wrote:
> >
> >> Yeah had the same thought. Seems that the cluster master is balking.
> >> So yeah, try in XenCenter.
> >>
> >>
> >> On Fri, Mar 22, 2013 at 1:23 PM, Kirk Jantzer  >> >wrote:
> >>
> >> > You mean through Xen Center?
> >> >
> >> >
> >> > On Fri, Mar 22, 2013 at 2:19 PM, Ahmad Emneina 
> >> wrote:
> >> >
> >> > > from the log snippet it seems the host cant join the cluster. can
> >> > > you
> >> try
> >> > > this out of band from cloudstack, join pool from the host, and
> >> > > see
> >> what
> >> > you
> >> > > get?
> >> > >
> >> > >
> >> > > On Fri, Mar 22, 2013 at 11:10 AM, Kirk Jantzer <
> >> kirk.jant...@gmail.com
> >> > >wrote:
> >> > >
> >> > >> There's no entry for that host in host_details :-(
> >> > >>
> >> > >>
> >> > >> On Fri, Mar 22, 2013 at 1:30 PM, Ahmad Emneina
> >> > >>  >> > >wrote:
> >> > >>
> >> > >>> have you looked at host_details? There should still be an entry
> >> > >>> with
> >> > the
> >> > >>> same host details. I'm not entirely sure if this is safe, but
> >> > >>> you
> >> might
> >> > >>> want to back up your db, then delete the entries for the
> >> > >>> problem
> >> host
> >> > >>> from
> >> > >>> both the cloud.host and cloud.host_details tables.
> >> > >>>
> >> > >>>
> >> > >>> On Fri, Mar 22, 2013 at 9:57 AM, Kirk Jantzer <
> >> kirk.jant...@gmail.com
> >> > >>> >wrote:
> >> > >>>
> >> > >>> > Anybody?
> >> > >>> >
> >> > >>> >
> >> > >>> > On Thu, Mar 21, 2013 at 8:58 PM, Kirk Jantzer <
> >> > kirk.jant...@gmail.com
> >> > >>> > >wrote:
> >> > >>> >
> >> > >>> > > I deleted the host from cloud.host, as well as any old
> >> > >>> > > guests in cloud.vm_instance that had that host as
> last_host_id.
> >> > >>> > > On Mar 21, 2013 8:53 PM, "Jason Davis" 
> >> wrote:
> >> > >>> > >
> >> > >>> > >> Not in front of my workstation but I bet the UUID in the
> >> > cloud.host
> >> > >>> > >> portion
> >> > >>> > >> of the DB still exists even if it is marked "removed".
> >> > >>> > >> Easy
> >> way to
> >> > >>> fix
> >> > >>> > >> this
> >> > >>> > >> is to slightly change that UUID.
> >> > >>> > >> On Mar 21, 2013 2:34 PM, "Kirk Jantzer" <
> >> kirk.jant...@gmail.com>
> >> > >>> wrote:
> >> > >>> > >>
> >> > >>> > >> > Background: I evicted a host from my cluster to do some
> >> testing
> >> > >>> with
> >> > >>> > >> some
> >> > >>> > >> > other opensource products. When I was done, I
> >> > >>> > >> > reinstalled XS
> >> as
> >> > I
> >> > >>> did
> >> > >>> > to
> >> > >>> > >> > all the other hosts, however I am unable to add the host
> >> back to
> >> > >>> the
> >> > >>> > >> > cluster. I did find a post about duplicate entries in
> >> > >>> > >> > the db,
> >> > so I
> >> > >>> > >> deleted
> >> > >>> > >> > the entry, but am still unable to add it. Thoughts?
> >> > >>> > >> >
> >> > >>> > >> > CS 4.0.1
> >> > >>> > >> > XenServer 6.0.2
> >> > >>> > >> >
> >> > >>> > >> > Output of /var/log/cloud/management/management-server.log:
> >> > >>> > >> >
> >> > >>> > >> > 2013-03-21 15:23:11,989 DEBUG [cloud.api.ApiServlet]
> >> > >>> > (http-8080-3:null)
> >> > >>> > >> > ===START===   -- GET
> >> > >>> > >> >
> >> > >>> > >> >
> >> > >>> > >>
> >> > >>> >
> >> > >>>
> >> >
> >>
> >> command=addHost&zoneid=7551e0e8-5c64-4955-b368-cf497bd9fd16&podid=811
> >> 51bfa-d519-4b1d-92ca-df7ce424460c&clusterid=9ec5ca37-df78-4910-b09f-d
> >> 9be3bed2269&hypervisor=XenServer&clustertype=CloudManaged&hosttags=&u
> >> sername=root&url=http%3A%2F%2F&response=json&sessionkey=LP
> >> R4A%2FAuwEtdUbF%2BdvSyLpg7rnA%3D&_=1363893870935
> >> > >>> > >> > 2013-03-21 15:23:12,001 INFO
> >> >  [cloud.resource.ResourceManagerImpl]
> >> > >>> > >> > (http-8080-3:null) Trying to add a new host at http://
> >> > 
> >> > >>> in
> >> > >>> > >> data
> >> > >>> > >> > center 1
> >> > >>> > >> > 2013-03-21 15:23:12,059 DEBUG
> >> > >>> [xen.resource.XenServerConnectionPool]
> >> > >>> > >> > (http-8080-3:n

Re: ip management questions

[Valery Ciareszka]

> -is it somehow possible to specify ip (or network pool) that would be
> assigned to virtual router ?

>>I don't think so.

I have finally managed to specify it via direct mysql hack:

update user_ip_address set account_id=2 where
public_ip_address='10.1.18.70';
update user_ip_address set domain_id=1 where public_ip_address='10.1.18.70';
update user_ip_address set allocated='2013-03-26 14:33:33' where
public_ip_address='10.15.18.70';
update user_ip_address set network_id='204' where
public_ip_address='10.1.18.70';
update user_ip_address set state='Allocated' where
public_ip_address='10.1.18.70';

Then I was able to enable static nat for this ip / create firewall rules.

I have following question: is this hack sufficient ? Shouldn't I change
something else in other tables so that database would remain consistent and
wouldn't cause erorrs in management server ?





On Sat, Mar 16, 2013 at 6:54 AM, Kirk Kosinski wrote:

> Hi, Valery.
>
> > I have following questions:
> > -why it is impossible to add more than 1 untagged network to public
> > (Infrastructure>Zones>zone0>eth0>Public)
>
> The design is that there is one subnet per VLAN.  You can add additional
> IP ranges to your existing untagged network if they are in the same subnet.
>
> > -is it somehow possible to specify ip (or network pool) that would be
> > assigned to virtual router ?
>
> I don't think so.
>
> > -is there any way to see current IP usage (some kind of IP management) ?
> I
> > wish to see list of ips and corresponding router vms/account names these
> ip
> > are bound to. I.e. i receive abuse on some ip address. How do I find
> > account this ip does belong ?
>
> You can get some info from the API.
>
>
> http://incubator.apache.org/cloudstack/docs/api/apidocs-4.0.0/root_admin/listPublicIpAddresses.html
>
> http://incubator.apache.org/cloudstack/docs/api/apidocs-4.0.0/root_admin/listRouters.html
>
> > -is there way to manage reverse dns entries from cloudstack ? (I am about
> > to start writing script that would capture events from cloudstack
> > management log on associateIpAddress/disassociateIpAddress; get username;
> > get domain name; update rdns). User should also have ability to set
> custom
> > PTR entry. Maybe somebody already faced this problem ? How did you deal
> > with it ?
>
> The CloudStack-managed DNS server isn't really configurable.  If you
> need to use some advanced DNS features, you might want to disable the
> CloudStack DNS and use your own instead.
>
> Best regards,
> Kirk
>
>


-- 
Regards,
Valery

http://protocol.by/slayer

RE: CS4 AWS S3 support

[Rajesh Battala]

Good to know the issue is resolve. As I had already told it's because of the 
permission issue. 

There are few bugs related to ACL's. feel free to file bugs against S3.
I had run all the boto unit tests, most of them were working fine. 


Thanks
Rajesh Battala

> -Original Message-
> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> Sent: Tuesday, March 26, 2013 6:52 PM
> To: 'users@cloudstack.apache.org'; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> Issue is resolved now.
> I used set gid on the /s3storage folder and then it allowed to create buckets.
> Now the bucket gets created in mount point folder, but the owner of folder is
> nobody user.
> 
> Now when I use: http://:7080/awsapi/rest/AmazonS3/test12323
> This should give me details abt the bucket.
> 
> I get following error on IE browser: Access denied -
> com.cloud.bridge.service.exception.PermissionDeniedException: Access Denied
> - ACLs do not give user the required permission What is the issue?
> 
> Logs show-
> com.cloud.bridge.service.exception.PermissionDeniedException: Access Denied
> - ACLs do not give user the required permission
> at
> com.cloud.bridge.service.core.s3.S3Engine.accessAllowed(S3Engine.java:1762)
> at
> com.cloud.bridge.service.core.s3.S3Engine.verifyAccess(S3Engine.java:1729)
> at
> com.cloud.bridge.service.core.s3.S3Engine.listBucketContents(S3Engine.java:36
> 2)
> at
> com.cloud.bridge.service.controller.s3.S3BucketAction.executeGetBucket(S3Bu
> cketAction.java:578)
> at
> com.cloud.bridge.service.controller.s3.S3BucketAction.execute(S3BucketAction.
> java:202)
> at
> com.cloud.bridge.service.S3RestServlet.processRequest(S3RestServlet.java:181)
> at com.cloud.bridge.service.S3RestServlet.doGet(S3RestServlet.java:84)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilte
> rChain.java:290)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.j
> ava:206)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve
> .java:233)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.j
> ava:191)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:12
> 7)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
> at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.jav
> a:109)
> at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> at
> org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.jav
> a:889)
> at
> org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.proce
> ss(Http11NioProtocol.java:721)
> at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java
> :2268)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1
> 110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
> 603)
> at java.lang.Thread.run(Thread.java:722)
> 
> 
> Thanks and Regards.
> 
> Asmita
> 
> -Original Message-
> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
> Sent: 26 March 2013 PM 06:00
> To: users@cloudstack.apache.org; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> From the code, this exception will be thrown  if the S3 is not able to create 
> the
> folder(bucket) in that specified location.
> Please check the permission and mount points. That is only issue.
> 
> Thanks
> Rajesh Battala
> 
> 
> 
> > -Original Message-
> > From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> > Sent: Tuesday, March 26, 2013 5:31 PM
> > To: 'users@cloudstack.apache.org'; 'Sebastien Goasguen'
> > Subject: RE: CS4 AWS S3 support
> >
> > Hi ,
> >
> > Yes, folder is created on root directory and mount this is the mount point.
> > The ownership is assigned to the root group and cloud user.
> >
> > $mount
> >
> > /dev/mapper/RootVolGroup-RootVol on / type ext4 (rw) proc on /proc
> > type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type
> > devpts
> > (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs
> > (rw,rootcontext="system_u:object_r:tmpfs_t:s0")
> > /dev/sda1 on /boot type ext4 (rw)
> > /dev/mapper/RootVolGroup-DataVol on /data type ext4 (rw)
> > /dev/mapper/RootVolGroup-VarVol on /var type ext4 (rw) none on
> > /proc/sys/fs/binfmt_misc type binfmt_misc (rw) sunrpc on
> > /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw) nfsd on /proc/fs/nfsd
> > type nfsd (rw) tornfs01sx.sigmasys.net:/data/cloudstack/s3storage on
> > /s3storage type nfs

RE: CS4 AWS S3 support

[Asmita Vagyani]

Issue is resolved now.
I used set gid on the /s3storage folder and then it allowed to create buckets.
Now the bucket gets created in mount point folder, but the owner of folder is 
nobody user.

Now when I use: http://:7080/awsapi/rest/AmazonS3/test12323
This should give me details abt the bucket.

I get following error on IE browser: Access denied - 
com.cloud.bridge.service.exception.PermissionDeniedException: Access Denied - 
ACLs do not give user the required permission What is the issue?

Logs show-
com.cloud.bridge.service.exception.PermissionDeniedException: Access Denied - 
ACLs do not give user the required permission
at 
com.cloud.bridge.service.core.s3.S3Engine.accessAllowed(S3Engine.java:1762)
at 
com.cloud.bridge.service.core.s3.S3Engine.verifyAccess(S3Engine.java:1729)
at 
com.cloud.bridge.service.core.s3.S3Engine.listBucketContents(S3Engine.java:362)
at 
com.cloud.bridge.service.controller.s3.S3BucketAction.executeGetBucket(S3BucketAction.java:578)
at 
com.cloud.bridge.service.controller.s3.S3BucketAction.execute(S3BucketAction.java:202)
at 
com.cloud.bridge.service.S3RestServlet.processRequest(S3RestServlet.java:181)
at com.cloud.bridge.service.S3RestServlet.doGet(S3RestServlet.java:84)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at 
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
at 
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
at 
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721)
at 
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2268)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)


Thanks and Regards.

Asmita 

-Original Message-
From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
Sent: 26 March 2013 PM 06:00
To: users@cloudstack.apache.org; 'Sebastien Goasguen'
Subject: RE: CS4 AWS S3 support

>From the code, this exception will be thrown  if the S3 is not able to create 
>the folder(bucket) in that specified location. 
Please check the permission and mount points. That is only issue. 

Thanks
Rajesh Battala



> -Original Message-
> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> Sent: Tuesday, March 26, 2013 5:31 PM
> To: 'users@cloudstack.apache.org'; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> Hi ,
> 
> Yes, folder is created on root directory and mount this is the mount point.
> The ownership is assigned to the root group and cloud user.
> 
> $mount
> 
> /dev/mapper/RootVolGroup-RootVol on / type ext4 (rw) proc on /proc 
> type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type 
> devpts
> (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs
> (rw,rootcontext="system_u:object_r:tmpfs_t:s0")
> /dev/sda1 on /boot type ext4 (rw)
> /dev/mapper/RootVolGroup-DataVol on /data type ext4 (rw) 
> /dev/mapper/RootVolGroup-VarVol on /var type ext4 (rw) none on 
> /proc/sys/fs/binfmt_misc type binfmt_misc (rw) sunrpc on 
> /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw) nfsd on /proc/fs/nfsd 
> type nfsd (rw) tornfs01sx.sigmasys.net:/data/cloudstack/s3storage on 
> /s3storage type nfs 
> (rw,rsize=8192,wsize=8192,timeo=14,intr,vers=4,addr=xx.xx.xx.xx,client
> addr=xx
> .xx.xx.xx)
> 
> 
> Thanks and Regards.
> 
> Asmita
> 
> -Original Message-
> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
> Sent: 26 March 2013 PM 05:21
> To: users@cloudstack.apache.org; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> Is the storage point/ folder is created?
> You need to create the storage folder "/s3storage" in the server.
> 
> Thanks
> Rajesh Battala
> 
> > -Original Message-
> > From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> > Sent: Tuesday, March 26, 2013 5:12 PM
> > To: 'Sebastien Goasguen'; 'users@cloudstack.apache.org'
> > Subject

RE: CS4 AWS S3 support

[Asmita Vagyani]

Issue is resolved now.
I used set gid on the /s3storage folder and then it allowed to create buckets.

Now when I use: http://:7080/awsapi/rest/AmazonS3/test12323 
This should give me details abt the bucket.

I get following error on IE browser: Access denied - 
com.cloud.bridge.service.exception.PermissionDeniedException: Access Denied - 
ACLs do not give user the required permission
What is the issue?

Logs show-
com.cloud.bridge.service.exception.PermissionDeniedException: Access Denied - 
ACLs do not give user the required permission
at 
com.cloud.bridge.service.core.s3.S3Engine.accessAllowed(S3Engine.java:1762)
at 
com.cloud.bridge.service.core.s3.S3Engine.verifyAccess(S3Engine.java:1729)
at 
com.cloud.bridge.service.core.s3.S3Engine.listBucketContents(S3Engine.java:362)
at 
com.cloud.bridge.service.controller.s3.S3BucketAction.executeGetBucket(S3BucketAction.java:578)
at 
com.cloud.bridge.service.controller.s3.S3BucketAction.execute(S3BucketAction.java:202)
at 
com.cloud.bridge.service.S3RestServlet.processRequest(S3RestServlet.java:181)
at com.cloud.bridge.service.S3RestServlet.doGet(S3RestServlet.java:84)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at 
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
at 
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
at 
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721)
at 
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2268)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)


Thanks and Regards.

Asmita 

-Original Message-
From: Rajesh Battala [mailto:rajesh.batt...@citrix.com] 
Sent: 26 March 2013 PM 06:00
To: users@cloudstack.apache.org; 'Sebastien Goasguen'
Subject: RE: CS4 AWS S3 support

>From the code, this exception will be thrown  if the S3 is not able to create 
>the folder(bucket) in that specified location. 
Please check the permission and mount points. That is only issue. 

Thanks
Rajesh Battala



> -Original Message-
> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> Sent: Tuesday, March 26, 2013 5:31 PM
> To: 'users@cloudstack.apache.org'; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> Hi ,
> 
> Yes, folder is created on root directory and mount this is the mount point.
> The ownership is assigned to the root group and cloud user.
> 
> $mount
> 
> /dev/mapper/RootVolGroup-RootVol on / type ext4 (rw) proc on /proc 
> type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type 
> devpts
> (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs
> (rw,rootcontext="system_u:object_r:tmpfs_t:s0")
> /dev/sda1 on /boot type ext4 (rw)
> /dev/mapper/RootVolGroup-DataVol on /data type ext4 (rw) 
> /dev/mapper/RootVolGroup-VarVol on /var type ext4 (rw) none on 
> /proc/sys/fs/binfmt_misc type binfmt_misc (rw) sunrpc on 
> /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw) nfsd on /proc/fs/nfsd 
> type nfsd (rw) tornfs01sx.sigmasys.net:/data/cloudstack/s3storage on 
> /s3storage type nfs 
> (rw,rsize=8192,wsize=8192,timeo=14,intr,vers=4,addr=xx.xx.xx.xx,client
> addr=xx
> .xx.xx.xx)
> 
> 
> Thanks and Regards.
> 
> Asmita
> 
> -Original Message-
> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
> Sent: 26 March 2013 PM 05:21
> To: users@cloudstack.apache.org; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> Is the storage point/ folder is created?
> You need to create the storage folder "/s3storage" in the server.
> 
> Thanks
> Rajesh Battala
> 
> > -Original Message-
> > From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> > Sent: Tuesday, March 26, 2013 5:12 PM
> > To: 'Sebastien Goasguen'; 'users@cloudstack.apache.org'
> > Subject: RE: CS4 AWS S3 support
> >
> > I have reported a bug -
> > https://issues.apache.org/jir

RE: CS4 AWS S3 support

[Asmita Vagyani]

Permissions are set correctly, I have re-examined the whole system.

Thanks and Regards.

Asmita 

-Original Message-
From: Rajesh Battala [mailto:rajesh.batt...@citrix.com] 
Sent: 26 March 2013 PM 06:00
To: users@cloudstack.apache.org; 'Sebastien Goasguen'
Subject: RE: CS4 AWS S3 support

>From the code, this exception will be thrown  if the S3 is not able to create 
>the folder(bucket) in that specified location. 
Please check the permission and mount points. That is only issue. 

Thanks
Rajesh Battala



> -Original Message-
> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> Sent: Tuesday, March 26, 2013 5:31 PM
> To: 'users@cloudstack.apache.org'; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> Hi ,
> 
> Yes, folder is created on root directory and mount this is the mount point.
> The ownership is assigned to the root group and cloud user.
> 
> $mount
> 
> /dev/mapper/RootVolGroup-RootVol on / type ext4 (rw) proc on /proc 
> type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type 
> devpts
> (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs
> (rw,rootcontext="system_u:object_r:tmpfs_t:s0")
> /dev/sda1 on /boot type ext4 (rw)
> /dev/mapper/RootVolGroup-DataVol on /data type ext4 (rw) 
> /dev/mapper/RootVolGroup-VarVol on /var type ext4 (rw) none on 
> /proc/sys/fs/binfmt_misc type binfmt_misc (rw) sunrpc on 
> /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw) nfsd on /proc/fs/nfsd 
> type nfsd (rw) tornfs01sx.sigmasys.net:/data/cloudstack/s3storage on 
> /s3storage type nfs 
> (rw,rsize=8192,wsize=8192,timeo=14,intr,vers=4,addr=xx.xx.xx.xx,client
> addr=xx
> .xx.xx.xx)
> 
> 
> Thanks and Regards.
> 
> Asmita
> 
> -Original Message-
> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
> Sent: 26 March 2013 PM 05:21
> To: users@cloudstack.apache.org; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> Is the storage point/ folder is created?
> You need to create the storage folder "/s3storage" in the server.
> 
> Thanks
> Rajesh Battala
> 
> > -Original Message-
> > From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> > Sent: Tuesday, March 26, 2013 5:12 PM
> > To: 'Sebastien Goasguen'; 'users@cloudstack.apache.org'
> > Subject: RE: CS4 AWS S3 support
> >
> > I have reported a bug -
> > https://issues.apache.org/jira/browse/CLOUDSTACK-
> > 1807
> >
> > Now, when I create a bucket using the S3 AWS API on cloudstack I get
> > > error as - OutOfStorageException: Unable to create
> > > /s3storage/test123 for bucket test123 Stacktrace is-
> > > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > > (catalina-exec-int-22:null) Request header x-amz-date:Tue, 26 Mar
> > > 2013
> > > 11:13:42 GMT
> > > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > > (catalina-exec-int-22:null) Request header
> > > host:torvm-cloudstack-mgmt.sigmasys.net:7080
> > > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > > (catalina-exec-int-22:null) Request header content-length:0
> > > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > > (catalina-exec-int-22:null) Request header connection:Keep-Alive
> > > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > > (catalina-exec-int-22:null) - End of request -
> > > 2013-03-26 07:13:47,800 DEBUG [bridge.service.UserContext]
> > > (catalina-exec-
> > int-22:null) initializing a new [anonymous] UserContext!
> > > 2013-03-26 07:13:47,815 ERROR [bridge.service.S3RestServlet]
> > > (catalina-exec-int-22:null) Unexpected exception Unable to create
> > > /s3storage/test123 for bucket test123
> > > com.cloud.bridge.service.exception.OutOfStorageException: Unable 
> > > to create
> > /s3storage/test123 for bucket test123
> > >at
> > com.cloud.bridge.io.S3FileSystemBucketAdapter.createContainer(S3File
> > Sy
> > stemB
> > ucketAdapter.java:55)
> > >at
> > com.cloud.bridge.service.core.s3.S3Engine.allocBucketStorageHost(S3E
> > ng
> > ine.ja
> > va:1466)
> > >at
> > com.cloud.bridge.service.core.s3.S3Engine.handleRequest(S3Engine.java:
> > 210)
> > >at
> > com.cloud.bridge.service.controller.s3.S3BucketAction.executePutBuck
> > et
> > (S3Buc
> > ketAction.java:837)
> > >at
> >
> com.cloud.bridge.service.controller.s3.S3BucketAction.execute(S3BucketAction.
> > java:159)
> > >at
> > com.cloud.bridge.service.S3RestServlet.processRequest(S3RestServlet.
> > ja
> > va:181)
> > >at 
> > > com.cloud.bridge.service.S3RestServlet.doPut(S3RestServlet.java:97)
> > >at javax.servlet.http.HttpServlet.service(HttpServlet.java:640)
> > >at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> > >at
> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(App
> > li
> > cationFilte
> > rChain.java:290)
> > >at
> > org.apache.catalina.core.ApplicationFilterChain.doFilter(Application
> > Fi
> > lterChain.j
> > ava:206)
> > >at
> > org.apache.c

RE: CS4 AWS S3 support

[Rajesh Battala]

>From the code, this exception will be thrown  if the S3 is not able to create 
>the folder(bucket) in that specified location. 
Please check the permission and mount points. That is only issue. 

Thanks
Rajesh Battala



> -Original Message-
> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> Sent: Tuesday, March 26, 2013 5:31 PM
> To: 'users@cloudstack.apache.org'; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> Hi ,
> 
> Yes, folder is created on root directory and mount this is the mount point.
> The ownership is assigned to the root group and cloud user.
> 
> $mount
> 
> /dev/mapper/RootVolGroup-RootVol on / type ext4 (rw) proc on /proc type
> proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type devpts
> (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs
> (rw,rootcontext="system_u:object_r:tmpfs_t:s0")
> /dev/sda1 on /boot type ext4 (rw)
> /dev/mapper/RootVolGroup-DataVol on /data type ext4 (rw)
> /dev/mapper/RootVolGroup-VarVol on /var type ext4 (rw) none on
> /proc/sys/fs/binfmt_misc type binfmt_misc (rw) sunrpc on
> /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw) nfsd on /proc/fs/nfsd type nfsd 
> (rw)
> tornfs01sx.sigmasys.net:/data/cloudstack/s3storage on /s3storage type nfs
> (rw,rsize=8192,wsize=8192,timeo=14,intr,vers=4,addr=xx.xx.xx.xx,clientaddr=xx
> .xx.xx.xx)
> 
> 
> Thanks and Regards.
> 
> Asmita
> 
> -Original Message-
> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
> Sent: 26 March 2013 PM 05:21
> To: users@cloudstack.apache.org; 'Sebastien Goasguen'
> Subject: RE: CS4 AWS S3 support
> 
> Is the storage point/ folder is created?
> You need to create the storage folder "/s3storage" in the server.
> 
> Thanks
> Rajesh Battala
> 
> > -Original Message-
> > From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> > Sent: Tuesday, March 26, 2013 5:12 PM
> > To: 'Sebastien Goasguen'; 'users@cloudstack.apache.org'
> > Subject: RE: CS4 AWS S3 support
> >
> > I have reported a bug -
> > https://issues.apache.org/jira/browse/CLOUDSTACK-
> > 1807
> >
> > Now, when I create a bucket using the S3 AWS API on cloudstack I get
> > > error as - OutOfStorageException: Unable to create
> > > /s3storage/test123 for bucket test123 Stacktrace is-
> > > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > > (catalina-exec-int-22:null) Request header x-amz-date:Tue, 26 Mar
> > > 2013
> > > 11:13:42 GMT
> > > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > > (catalina-exec-int-22:null) Request header
> > > host:torvm-cloudstack-mgmt.sigmasys.net:7080
> > > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > > (catalina-exec-int-22:null) Request header content-length:0
> > > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > > (catalina-exec-int-22:null) Request header connection:Keep-Alive
> > > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > > (catalina-exec-int-22:null) - End of request -
> > > 2013-03-26 07:13:47,800 DEBUG [bridge.service.UserContext]
> > > (catalina-exec-
> > int-22:null) initializing a new [anonymous] UserContext!
> > > 2013-03-26 07:13:47,815 ERROR [bridge.service.S3RestServlet]
> > > (catalina-exec-int-22:null) Unexpected exception Unable to create
> > > /s3storage/test123 for bucket test123
> > > com.cloud.bridge.service.exception.OutOfStorageException: Unable to
> > > create
> > /s3storage/test123 for bucket test123
> > >at
> > com.cloud.bridge.io.S3FileSystemBucketAdapter.createContainer(S3FileSy
> > stemB
> > ucketAdapter.java:55)
> > >at
> > com.cloud.bridge.service.core.s3.S3Engine.allocBucketStorageHost(S3Eng
> > ine.ja
> > va:1466)
> > >at
> > com.cloud.bridge.service.core.s3.S3Engine.handleRequest(S3Engine.java:
> > 210)
> > >at
> > com.cloud.bridge.service.controller.s3.S3BucketAction.executePutBucket
> > (S3Buc
> > ketAction.java:837)
> > >at
> >
> com.cloud.bridge.service.controller.s3.S3BucketAction.execute(S3BucketAction.
> > java:159)
> > >at
> > com.cloud.bridge.service.S3RestServlet.processRequest(S3RestServlet.ja
> > va:181)
> > >at 
> > > com.cloud.bridge.service.S3RestServlet.doPut(S3RestServlet.java:97)
> > >at javax.servlet.http.HttpServlet.service(HttpServlet.java:640)
> > >at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> > >at
> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appli
> > cationFilte
> > rChain.java:290)
> > >at
> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFi
> > lterChain.j
> > ava:206)
> > >at
> > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperVa
> > lve
> > .java:233)
> > >at
> > org.apache.catalina.core.StandardContextValve.invoke(StandardContextVa
> > lve.j
> > ava:191)
> > >at
> > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.ja
> > va:12
> > 7)
> > >at
> > org.apache.catalin

RE: CS4 AWS S3 support

[Asmita Vagyani]

Hi ,

Yes, folder is created on root directory and mount this is the mount point.
The ownership is assigned to the root group and cloud user.

$mount 

/dev/mapper/RootVolGroup-RootVol on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw,rootcontext="system_u:object_r:tmpfs_t:s0")
/dev/sda1 on /boot type ext4 (rw)
/dev/mapper/RootVolGroup-DataVol on /data type ext4 (rw)
/dev/mapper/RootVolGroup-VarVol on /var type ext4 (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
nfsd on /proc/fs/nfsd type nfsd (rw)
tornfs01sx.sigmasys.net:/data/cloudstack/s3storage on /s3storage type nfs 
(rw,rsize=8192,wsize=8192,timeo=14,intr,vers=4,addr=xx.xx.xx.xx,clientaddr=xx.xx.xx.xx)


Thanks and Regards.

Asmita 

-Original Message-
From: Rajesh Battala [mailto:rajesh.batt...@citrix.com] 
Sent: 26 March 2013 PM 05:21
To: users@cloudstack.apache.org; 'Sebastien Goasguen'
Subject: RE: CS4 AWS S3 support

Is the storage point/ folder is created? 
You need to create the storage folder "/s3storage" in the server. 

Thanks
Rajesh Battala

> -Original Message-
> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> Sent: Tuesday, March 26, 2013 5:12 PM
> To: 'Sebastien Goasguen'; 'users@cloudstack.apache.org'
> Subject: RE: CS4 AWS S3 support
> 
> I have reported a bug - 
> https://issues.apache.org/jira/browse/CLOUDSTACK-
> 1807
> 
> Now, when I create a bucket using the S3 AWS API on cloudstack I get
> > error as - OutOfStorageException: Unable to create 
> > /s3storage/test123 for bucket test123 Stacktrace is-
> > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > (catalina-exec-int-22:null) Request header x-amz-date:Tue, 26 Mar 
> > 2013
> > 11:13:42 GMT
> > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > (catalina-exec-int-22:null) Request header
> > host:torvm-cloudstack-mgmt.sigmasys.net:7080
> > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > (catalina-exec-int-22:null) Request header content-length:0
> > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > (catalina-exec-int-22:null) Request header connection:Keep-Alive
> > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > (catalina-exec-int-22:null) - End of request -
> > 2013-03-26 07:13:47,800 DEBUG [bridge.service.UserContext] 
> > (catalina-exec-
> int-22:null) initializing a new [anonymous] UserContext!
> > 2013-03-26 07:13:47,815 ERROR [bridge.service.S3RestServlet]
> > (catalina-exec-int-22:null) Unexpected exception Unable to create
> > /s3storage/test123 for bucket test123
> > com.cloud.bridge.service.exception.OutOfStorageException: Unable to 
> > create
> /s3storage/test123 for bucket test123
> >at
> com.cloud.bridge.io.S3FileSystemBucketAdapter.createContainer(S3FileSy
> stemB
> ucketAdapter.java:55)
> >at
> com.cloud.bridge.service.core.s3.S3Engine.allocBucketStorageHost(S3Eng
> ine.ja
> va:1466)
> >at
> com.cloud.bridge.service.core.s3.S3Engine.handleRequest(S3Engine.java:
> 210)
> >at
> com.cloud.bridge.service.controller.s3.S3BucketAction.executePutBucket
> (S3Buc
> ketAction.java:837)
> >at
> com.cloud.bridge.service.controller.s3.S3BucketAction.execute(S3BucketAction.
> java:159)
> >at
> com.cloud.bridge.service.S3RestServlet.processRequest(S3RestServlet.ja
> va:181)
> >at 
> > com.cloud.bridge.service.S3RestServlet.doPut(S3RestServlet.java:97)
> >at javax.servlet.http.HttpServlet.service(HttpServlet.java:640)
> >at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> >at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appli
> cationFilte
> rChain.java:290)
> >at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFi
> lterChain.j
> ava:206)
> >at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperVa
> lve
> .java:233)
> >at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextVa
> lve.j
> ava:191)
> >at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.ja
> va:12
> 7)
> >at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.ja
> va:102)
> >at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:5
> 55)
> >at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValv
> e.jav
> a:109)
> >at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java
> :298)
> >at
> org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor
> .jav
> a:889)
> >at
> org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.pro
> ce
> ss(Http11NioProtocol.java:721)
> >at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint
> .java
> :2

RE: CS4 AWS S3 support

[Rajesh Battala]

Is the storage point/ folder is created? 
You need to create the storage folder "/s3storage" in the server. 

Thanks
Rajesh Battala

> -Original Message-
> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> Sent: Tuesday, March 26, 2013 5:12 PM
> To: 'Sebastien Goasguen'; 'users@cloudstack.apache.org'
> Subject: RE: CS4 AWS S3 support
> 
> I have reported a bug - https://issues.apache.org/jira/browse/CLOUDSTACK-
> 1807
> 
> Now, when I create a bucket using the S3 AWS API on cloudstack I get
> > error as - OutOfStorageException: Unable to create /s3storage/test123
> > for bucket test123 Stacktrace is-
> > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > (catalina-exec-int-22:null) Request header x-amz-date:Tue, 26 Mar 2013
> > 11:13:42 GMT
> > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > (catalina-exec-int-22:null) Request header
> > host:torvm-cloudstack-mgmt.sigmasys.net:7080
> > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > (catalina-exec-int-22:null) Request header content-length:0
> > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > (catalina-exec-int-22:null) Request header connection:Keep-Alive
> > 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet]
> > (catalina-exec-int-22:null) - End of request -
> > 2013-03-26 07:13:47,800 DEBUG [bridge.service.UserContext] (catalina-exec-
> int-22:null) initializing a new [anonymous] UserContext!
> > 2013-03-26 07:13:47,815 ERROR [bridge.service.S3RestServlet]
> > (catalina-exec-int-22:null) Unexpected exception Unable to create
> > /s3storage/test123 for bucket test123
> > com.cloud.bridge.service.exception.OutOfStorageException: Unable to create
> /s3storage/test123 for bucket test123
> >at
> com.cloud.bridge.io.S3FileSystemBucketAdapter.createContainer(S3FileSystemB
> ucketAdapter.java:55)
> >at
> com.cloud.bridge.service.core.s3.S3Engine.allocBucketStorageHost(S3Engine.ja
> va:1466)
> >at
> com.cloud.bridge.service.core.s3.S3Engine.handleRequest(S3Engine.java:210)
> >at
> com.cloud.bridge.service.controller.s3.S3BucketAction.executePutBucket(S3Buc
> ketAction.java:837)
> >at
> com.cloud.bridge.service.controller.s3.S3BucketAction.execute(S3BucketAction.
> java:159)
> >at
> com.cloud.bridge.service.S3RestServlet.processRequest(S3RestServlet.java:181)
> >at 
> > com.cloud.bridge.service.S3RestServlet.doPut(S3RestServlet.java:97)
> >at javax.servlet.http.HttpServlet.service(HttpServlet.java:640)
> >at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
> >at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilte
> rChain.java:290)
> >at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.j
> ava:206)
> >at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve
> .java:233)
> >at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.j
> ava:191)
> >at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:12
> 7)
> >at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> >at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
> >at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.jav
> a:109)
> >at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> >at
> org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.jav
> a:889)
> >at
> org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.proce
> ss(Http11NioProtocol.java:721)
> >at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java
> :2268)
> >at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1
> 110)
> >at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
> 603)
> >at java.lang.Thread.run(Thread.java:722)
> >
> >
> > What could be the reason?
> 
> 
> Thanks and Regards.
> 
> Asmita
> 
> -Original Message-
> From: Sebastien Goasguen [mailto:run...@gmail.com]
> Sent: 26 March 2013 PM 04:57
> To: Asmita Vagyani
> Subject: Re: CS4 AWS S3 support
> 
> 
> On Mar 26, 2013, at 7:19 AM, Asmita Vagyani  systems.com> wrote:
> 
> > There is no bucket created on my NFS mount.
> > This is not an error specific to S3 browser tool.Even if I use this url in 
> > the IE
> browser, it gives 400-Bad request error.
> >
> > When I give url as
> > http://torvm-cloudstack-mgmt.sigmasys.net:7080/awsapi/rest/AmazonS3/te
> > st2342
> > It gives error like :
> > 
> > NoSuchBucket
> > The specified bucket does not exist
> > test2342
> 1DEADBEEF9
> > abCdeFgHiJ1k2LmN3op4q56r7st89
> > 
> >
> > This is a normal behavior. Same behavior I should get when I don't pass any
> name of bucket.
> >> 1..

RE: CS4 AWS S3 support

[Asmita Vagyani]

I have reported a bug - https://issues.apache.org/jira/browse/CLOUDSTACK-1807

Now, when I create a bucket using the S3 AWS API on cloudstack I get 
> error as - OutOfStorageException: Unable to create /s3storage/test123 
> for bucket test123 Stacktrace is-
> 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet] 
> (catalina-exec-int-22:null) Request header x-amz-date:Tue, 26 Mar 2013 
> 11:13:42 GMT
> 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet] 
> (catalina-exec-int-22:null) Request header 
> host:torvm-cloudstack-mgmt.sigmasys.net:7080
> 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet] 
> (catalina-exec-int-22:null) Request header content-length:0
> 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet] 
> (catalina-exec-int-22:null) Request header connection:Keep-Alive
> 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet] 
> (catalina-exec-int-22:null) - End of request -
> 2013-03-26 07:13:47,800 DEBUG [bridge.service.UserContext] 
> (catalina-exec-int-22:null) initializing a new [anonymous] UserContext!
> 2013-03-26 07:13:47,815 ERROR [bridge.service.S3RestServlet] 
> (catalina-exec-int-22:null) Unexpected exception Unable to create 
> /s3storage/test123 for bucket test123
> com.cloud.bridge.service.exception.OutOfStorageException: Unable to create 
> /s3storage/test123 for bucket test123
>at 
> com.cloud.bridge.io.S3FileSystemBucketAdapter.createContainer(S3FileSystemBucketAdapter.java:55)
>at 
> com.cloud.bridge.service.core.s3.S3Engine.allocBucketStorageHost(S3Engine.java:1466)
>at 
> com.cloud.bridge.service.core.s3.S3Engine.handleRequest(S3Engine.java:210)
>at 
> com.cloud.bridge.service.controller.s3.S3BucketAction.executePutBucket(S3BucketAction.java:837)
>at 
> com.cloud.bridge.service.controller.s3.S3BucketAction.execute(S3BucketAction.java:159)
>at 
> com.cloud.bridge.service.S3RestServlet.processRequest(S3RestServlet.java:181)
>at com.cloud.bridge.service.S3RestServlet.doPut(S3RestServlet.java:97)
>at javax.servlet.http.HttpServlet.service(HttpServlet.java:640)
>at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
>at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
>at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>at 
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
>at 
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
>at 
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>at 
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
>at 
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
>at 
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
>at 
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
>at 
> org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
>at 
> org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721)
>at 
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2268)
>at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>at java.lang.Thread.run(Thread.java:722)
> 
> 
> What could be the reason?


Thanks and Regards.

Asmita 

-Original Message-
From: Sebastien Goasguen [mailto:run...@gmail.com] 
Sent: 26 March 2013 PM 04:57
To: Asmita Vagyani
Subject: Re: CS4 AWS S3 support


On Mar 26, 2013, at 7:19 AM, Asmita Vagyani  
wrote:

> There is no bucket created on my NFS mount.
> This is not an error specific to S3 browser tool.Even if I use this url in 
> the IE browser, it gives 400-Bad request error.
> 
> When I give url as 
> http://torvm-cloudstack-mgmt.sigmasys.net:7080/awsapi/rest/AmazonS3/te
> st2342
> It gives error like :
> 
> NoSuchBucket
> The specified bucket does not exist 
> test2342 1DEADBEEF9 
> abCdeFgHiJ1k2LmN3op4q56r7st89
> 
> 
> This is a normal behavior. Same behavior I should get when I don't pass any 
> name of bucket.
>> 1.Please check if this is a bug in CS4.

if you think it's a bug, then please open a bug in jira: 
https://issues.apache.org/jira/browse/CLOUDSTACK

> 
> Now, when I create a bucket using the S3 AWS API on cloudstack I get 
> error as - OutOfStorageException: Unable to create /s3storage/test123 
> for bucket test123 Stacktrace is-
> 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet] 
> (catalina-exec-int-22:null) Request header x-amz-date:Tue, 26 Mar 2013 
> 11:13:42 GMT
> 2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet] 

RE: CS4 AWS S3 support

[Asmita Vagyani]

There is no bucket created on my NFS mount.
This is not an error specific to S3 browser tool.Even if I use this url in the 
IE browser, it gives 400-Bad request error.

When I give url as 
http://torvm-cloudstack-mgmt.sigmasys.net:7080/awsapi/rest/AmazonS3/test2342 
It gives error like :

NoSuchBucket
The specified bucket does not exist
test2342
1DEADBEEF9
abCdeFgHiJ1k2LmN3op4q56r7st89


This is a normal behavior. Same behavior I should get when I don't pass any 
name of bucket.
>1.Please check if this is a bug in CS4.

Now, when I create a bucket using the S3 AWS API on cloudstack
I get error as - OutOfStorageException: Unable to create /s3storage/test123 for 
bucket test123
Stacktrace is-
2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet] 
(catalina-exec-int-22:null) Request header x-amz-date:Tue, 26 Mar 2013 11:13:42 
GMT
2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet] 
(catalina-exec-int-22:null) Request header 
host:torvm-cloudstack-mgmt.sigmasys.net:7080
2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet] 
(catalina-exec-int-22:null) Request header content-length:0
2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet] 
(catalina-exec-int-22:null) Request header connection:Keep-Alive
2013-03-26 07:13:47,796 INFO  [bridge.service.S3RestServlet] 
(catalina-exec-int-22:null) - End of request -
2013-03-26 07:13:47,800 DEBUG [bridge.service.UserContext] 
(catalina-exec-int-22:null) initializing a new [anonymous] UserContext!
2013-03-26 07:13:47,815 ERROR [bridge.service.S3RestServlet] 
(catalina-exec-int-22:null) Unexpected exception Unable to create 
/s3storage/test123 for bucket test123
com.cloud.bridge.service.exception.OutOfStorageException: Unable to create 
/s3storage/test123 for bucket test123
at 
com.cloud.bridge.io.S3FileSystemBucketAdapter.createContainer(S3FileSystemBucketAdapter.java:55)
at 
com.cloud.bridge.service.core.s3.S3Engine.allocBucketStorageHost(S3Engine.java:1466)
at 
com.cloud.bridge.service.core.s3.S3Engine.handleRequest(S3Engine.java:210)
at 
com.cloud.bridge.service.controller.s3.S3BucketAction.executePutBucket(S3BucketAction.java:837)
at 
com.cloud.bridge.service.controller.s3.S3BucketAction.execute(S3BucketAction.java:159)
at 
com.cloud.bridge.service.S3RestServlet.processRequest(S3RestServlet.java:181)
at com.cloud.bridge.service.S3RestServlet.doPut(S3RestServlet.java:97)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:640)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at 
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
at 
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
at 
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721)
at 
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2268)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)


What could be the reason?



Thanks and Regards.

Asmita 


-Original Message-
From: Sebastien Goasguen [mailto:run...@gmail.com] 
Sent: 26 March 2013 PM 04:33
To: Asmita Vagyani
Subject: Re: CS4 AWS S3 support


On Mar 26, 2013, at 6:56 AM, Asmita Vagyani  
wrote:

> Hi Sebastien,
> 
> Thanks , after giving the FQDN instead of IP address, it works.
> Now, atleast the S3 browser is able to invoke the cloudstack S3 AWS REST API.
> 
> I saw in the documentation 
> https://cwiki.apache.org/CLOUDSTACK/s3-api-in-cloudstack.html
> It says to List All Buckets, simply make a call to :
> REST GET request, http://myhost:8080/awsapi/rest/AmazonS3
> 
> However, when I invoke 
> http://torvm-cloudstack-mgmt.sigmasys.net:7080/awsapi/rest/AmazonS3
> I get the 400 Bad request error on browser.
> I get the exception at backend when I checked awsapi.log:
> 

I have never used the S3 browser but it looks like you may have some existing 
buckets in there that cause the error.


> 2013-03-26 06:49:32,080 INFO 

RE: CS4 AWS S3 support

[Asmita Vagyani]

Hi Sebastien,

Thanks , after giving the FQDN instead of IP address, it works.
Now, atleast the S3 browser is able to invoke the cloudstack S3 AWS REST API.

I saw in the documentation 
https://cwiki.apache.org/CLOUDSTACK/s3-api-in-cloudstack.html 
It says to List All Buckets, simply make a call to :
REST GET request, http://myhost:8080/awsapi/rest/AmazonS3

However, when I invoke 
http://torvm-cloudstack-mgmt.sigmasys.net:7080/awsapi/rest/AmazonS3 
I get the 400 Bad request error on browser.
I get the exception at backend when I checked awsapi.log:

2013-03-26 06:49:32,080 INFO  [bridge.service.S3RestServlet] 
(catalina-exec-int-20:null) Request servletPath: /rest/AmazonS3
2013-03-26 06:49:32,080 INFO  [bridge.service.S3RestServlet] 
(catalina-exec-int-20:null) Request header user-agent:S3 Browser3-8-1
2013-03-26 06:49:32,081 INFO  [bridge.service.S3RestServlet] 
(catalina-exec-int-20:null) Request header authorization:AWS 
Qh69lnbtbr0H68i_Q7im7eZNhoFYUyHS8eDU9nyL2k3OP0gBGN0gNHfHWeKQo1EZq2r0MMZK-23U9_wF6PMojg:RWAiwif28JxZ/le9mDkQskfPAd8=
2013-03-26 06:49:32,081 INFO  [bridge.service.S3RestServlet] 
(catalina-exec-int-20:null) Request header x-amz-date:Tue, 26 Mar 2013 10:49:26 
GMT
2013-03-26 06:49:32,081 INFO  [bridge.service.S3RestServlet] 
(catalina-exec-int-20:null) Request header 
host:torvm-cloudstack-mgmt.sigmasys.net:7080
2013-03-26 06:49:32,081 INFO  [bridge.service.S3RestServlet] 
(catalina-exec-int-20:null) - End of request -
2013-03-26 06:49:32,093 DEBUG [bridge.service.UserContext] 
(catalina-exec-int-20:null) initializing a new [anonymous] UserContext!
2013-03-26 06:49:32,093 ERROR [bridge.service.S3RestServlet] 
(catalina-exec-int-20:null) Unexpected exception  is not between 3 and 255 
characters long
com.cloud.bridge.service.exception.InvalidBucketName:  is not between 3 and 255 
characters long
at 
com.cloud.bridge.service.core.s3.S3Engine.verifyBucketName(S3Engine.java:1809)
at 
com.cloud.bridge.service.S3RestServlet.routeRequest(S3RestServlet.java:440)
at 
com.cloud.bridge.service.S3RestServlet.processRequest(S3RestServlet.java:179)
at com.cloud.bridge.service.S3RestServlet.doGet(S3RestServlet.java:84)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at 
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
at 
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
at 
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721)
at 
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2268)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)

Thanks and Regards.

Asmita 

-Original Message-
From: Sebastien Goasguen [mailto:run...@gmail.com] 
Sent: 26 March 2013 PM 04:06
To: Asmita Vagyani
Subject: Re: CS4 AWS S3 support


On Mar 26, 2013, at 6:25 AM, Asmita Vagyani  
wrote:

> Hi
> Where do I register the DNS entry I mean do you mean a local DNS entry or 
> what?

Local entry would do, as long as your "s3 browser" knows how to route 
 to the IP of the endpoint.

> 
> Thanks and Regards.
> 
> Asmita
> 
> -Original Message-
> From: Sebastien Goasguen [mailto:run...@gmail.com]
> Sent: 26 March 2013 PM 03:34
> To: Asmita Vagyani
> Subject: Re: CS4 AWS S3 support
> 
> 
> On Mar 26, 2013, at 4:40 AM, Asmita Vagyani 
>  wrote:
> 
>> Hi all,
>> 
>> I tried to use a couple of freewares/tools like CyberDuck, DragonDisk, etc 
>> which interfaces the Cloudstack S3 APIs.
>> I am stuck at one common point in all these tools.
>> All tools say they support the alternative S3 compatible services, which in 
>> our case is our Cloudstack AWS S3.
>> However, it asks me endpoint of the S3 compatible service.
>> When I mention the endpoint as 
>> http:///awsapi/rest/AmazonS3 it doesnot accept it.
>> It wants the server name as server.com.
>> 
> 
> Asmita, I woud do two things:
> 
> 1-Try to use bot

RE: Change IP range of POD in Cloudstack

[Valery Fongang]

Hi Jayapal,

Thanks I managed to clear the table by running the following SQL command:

 mysql> UPDATE op_dc_ip_address_alloc SET nic_id=NULL, reservation_id=NULL, 
taken=NULL;

Then after I was able to change my POD IP range.

Many thanks

-Original Message-
From: Jayapal Reddy Uradi [mailto:jayapalreddy.ur...@citrix.com] 
Sent: 26 March 2013 03:49
To: users@cloudstack.apache.org
Subject: RE: Change IP range of POD in Cloudstack

Connect to the cloudstack database in management server  using 'mysql' and use 
the database 'cloud '.
Update the entries  'op_dc_ip_address_alloc' table. 

Thanks,
Jayapal

> -Original Message-
> From: Valery Fongang [mailto:fongang.val...@pertechtual.com]
> Sent: Tuesday, March 26, 2013 12:46 AM
> To: users@cloudstack.apache.org
> Subject: RE: Change IP range of POD in Cloudstack
> 
> Hi,
> 
> Sorry I'm a newbie that appears to know how to follow instructions :-)...
> Could you please send me the exact query I need to run?...
> 
> Thanks,
> 
> -Original Message-
> From: Bryan Whitehead [mailto:dri...@megahappy.net]
> Sent: 25 March 2013 17:40
> To: users@cloudstack.apache.org
> Subject: Re: Change IP range of POD in Cloudstack
> 
> You'll need to directly connect to the mysql database and update the record.
> This can break stuff so make sure all VM's (including
> systemVM's) have not already allocated IP's in the range you want to cut off.
> 
> On Mon, Mar 25, 2013 at 5:35 AM, Valery Fongang 
>  wrote:
> > Hi,
> >
> > How can I change (shrink) the IP range of my POD without recreating 
> > the
> entire POD?... When I try to edit it tells me there are IP addresses 
> in this POD that are already assigned. However  I have deleted all 
> system VMs and disabled the entire zone. No user VM exists.
> >
> > Thanks,

RE: CS4 AWS S3 support

[Asmita Vagyani]

Cloustack 4.0.0



Thanks and Regards.

Asmita 


-Original Message-
From: Sebastien Goasguen [mailto:run...@gmail.com] 
Sent: 26 March 2013 PM 02:22
To: Asmita Vagyani
Cc: 'users@cloudstack.apache.org'; 'cloudstack-us...@incubator.apache.org'
Subject: Re: CS4 AWS S3 support

Hi Asmita, which version of CloudStack are you using ?

I did those slides back in September or so, they are a bit dated.

-Sebastien

On Mar 26, 2013, at 4:40 AM, Asmita Vagyani  
wrote:

> Hi all,
> 
> I tried to use a couple of freewares/tools like CyberDuck, DragonDisk, etc 
> which interfaces the Cloudstack S3 APIs.
> I am stuck at one common point in all these tools.
> All tools say they support the alternative S3 compatible services, which in 
> our case is our Cloudstack AWS S3.
> However, it asks me endpoint of the S3 compatible service.
> When I mention the endpoint as 
> http:///awsapi/rest/AmazonS3 it doesnot accept it.
> It wants the server name as server.com.
> 
> Is there any way I can get the S3 webservice endpoint the way these tools 
> want.
> Is this because Cloudstack is not consistent with the EC2 endpoint.
> If yes, when are we planning to make it consistent.
> 
> 
> Thanks and Regards.
> 
> Asmita
> 
> -Original Message-
> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
> Sent: 25 March 2013 PM 09:40
> To: users@cloudstack.apache.org; 'cloudstack-us...@incubator.apache.org'; 
> 'run...@gmail.com'
> Subject: RE: CS4 AWS S3 support
> 
> Am not sure whether s3 browser allows user to configure the settings to 
> access the cloudstack s3.
> If you can configure the settings the way we configure for boto then we can 
> use s3 browser.
> 
> Thanks
> Rajesh Battala
> 
>> -Original Message-
>> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
>> Sent: Monday, March 25, 2013 7:09 PM
>> To: 'users@cloudstack.apache.org';
>> 'cloudstack-us...@incubator.apache.org';
>> 'run...@gmail.com'
>> Subject: RE: CS4 AWS S3 support
>> 
>> Are there any other clients, non-python based.
>> Can I integrate this with S3 browser, such that the S3 browser shows 
>> me buckets created on the NFS drive mounted using cloud-bridge.properties?
>> User can just upload and download files in S3 browser and ultimately 
>> on the NFS drive buckets.
>> 
>> 
>> Thanks and Regards.
>> 
>> Asmita
>> 
>> -Original Message-
>> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
>> Sent: 25 March 2013 PM 04:42
>> To: users@cloudstack.apache.org;
>> 'cloudstack-us...@incubator.apache.org';
>> 'run...@gmail.com'
>> Subject: RE: CS4 AWS S3 support
>> 
>> Asmita,
>> You can follow this link. 
>> https://cwiki.apache.org/CLOUDSTACK/s3-api-in-
>> cloudstack.html
>> 
>> You can use boto client which is python based to send s3 requests to CS.
>> 
>> Thanks
>> Rajesh Battala
>> 
>>> -Original Message-
>>> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
>>> Sent: Monday, March 25, 2013 4:13 PM
>>> To: 'users@cloudstack.apache.org';
>>> 'cloudstack-us...@incubator.apache.org';
>>> 'run...@gmail.com'
>>> Subject: RE: CS4 AWS S3 support
>>> 
>>> Hi,
>>> 
>>> I can see the entry of keys in the usercredential table in CS4 DB.
>>> When I access http:///awsapi link I get the servlet exception :
>>> 
>>> java.lang.RuntimeException: javax.servlet.ServletException: Servlet 
>>> execution threw an exception
>>> com.cloud.bridge.service.EC2MainServlet.doGetOrPost(EC2MainServlet
>>> .java:104)
>>> com.cloud.bridge.service.EC2MainServlet.doGet(EC2MainServlet.java:7
>>> 3)
>>> 
>>> How can I run S3 requests? any links to documentation would be helpful.
>>> 
>>> Thanks and Regards.
>>> 
>>> Asmita
>>> 
>>> 
>>> -Original Message-
>>> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
>>> Sent: 25 March 2013 PM 03:35
>>> To: users@cloudstack.apache.org;
>>> 'cloudstack-us...@incubator.apache.org';
>>> 'run...@gmail.com'
>>> Subject: RE: CS4 AWS S3 support
>>> 
>>> Hi Asmita,
>>> 
>>> In the cloudbridge db, usercredentials table has the 
>>> username/password values present?
>>> Generally, for an existing account, generate the apikey/secrect key 
>>> and register them in awsapi.
>>> 
>>> Were you able to run s3 requests.?  Is awsap is running at 7080 port?
>>> 
>>> Thanks
>>> Rajesh Battala
>>> 
>>> 
 -Original Message-
 From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
 Sent: Monday, March 25, 2013 3:24 PM
 To: 'cloudstack-us...@incubator.apache.org'; 'run...@gmail.com'
 Subject: CS4 AWS S3 support
 
 Hi all,
 
 I am trying to do following to have an implementation of S3 in our
>> application.
 Followed steps given in:
 http://www.slideshare.net/sebastiengoasguen/cloudstack-s3
 
 
 1)  I have enabled S3 support and EC2 support flag in the CS4 global
>>> variables.
 
 2)  I have mounted the NFS store on the CS4 management server  (I am
>> using
 the NFS drive to store the buckets/files uplo

Re: CS4 AWS S3 support

[Sebastien Goasguen]

Hi Asmita, which version of CloudStack are you using ?

I did those slides back in September or so, they are a bit dated.

-Sebastien

On Mar 26, 2013, at 4:40 AM, Asmita Vagyani  
wrote:

> Hi all,
> 
> I tried to use a couple of freewares/tools like CyberDuck, DragonDisk, etc 
> which interfaces the Cloudstack S3 APIs.
> I am stuck at one common point in all these tools.
> All tools say they support the alternative S3 compatible services, which in 
> our case is our Cloudstack AWS S3.
> However, it asks me endpoint of the S3 compatible service.
> When I mention the endpoint as 
> http:///awsapi/rest/AmazonS3 it doesnot accept it.
> It wants the server name as server.com.
> 
> Is there any way I can get the S3 webservice endpoint the way these tools 
> want.
> Is this because Cloudstack is not consistent with the EC2 endpoint.
> If yes, when are we planning to make it consistent.
> 
> 
> Thanks and Regards.
> 
> Asmita 
> 
> -Original Message-
> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com] 
> Sent: 25 March 2013 PM 09:40
> To: users@cloudstack.apache.org; 'cloudstack-us...@incubator.apache.org'; 
> 'run...@gmail.com'
> Subject: RE: CS4 AWS S3 support
> 
> Am not sure whether s3 browser allows user to configure the settings to 
> access the cloudstack s3.
> If you can configure the settings the way we configure for boto then we can 
> use s3 browser.
> 
> Thanks
> Rajesh Battala
> 
>> -Original Message-
>> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
>> Sent: Monday, March 25, 2013 7:09 PM
>> To: 'users@cloudstack.apache.org'; 
>> 'cloudstack-us...@incubator.apache.org';
>> 'run...@gmail.com'
>> Subject: RE: CS4 AWS S3 support
>> 
>> Are there any other clients, non-python based.
>> Can I integrate this with S3 browser, such that the S3 browser shows 
>> me buckets created on the NFS drive mounted using cloud-bridge.properties?
>> User can just upload and download files in S3 browser and ultimately 
>> on the NFS drive buckets.
>> 
>> 
>> Thanks and Regards.
>> 
>> Asmita
>> 
>> -Original Message-
>> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
>> Sent: 25 March 2013 PM 04:42
>> To: users@cloudstack.apache.org; 
>> 'cloudstack-us...@incubator.apache.org';
>> 'run...@gmail.com'
>> Subject: RE: CS4 AWS S3 support
>> 
>> Asmita,
>> You can follow this link. 
>> https://cwiki.apache.org/CLOUDSTACK/s3-api-in-
>> cloudstack.html
>> 
>> You can use boto client which is python based to send s3 requests to CS.
>> 
>> Thanks
>> Rajesh Battala
>> 
>>> -Original Message-
>>> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
>>> Sent: Monday, March 25, 2013 4:13 PM
>>> To: 'users@cloudstack.apache.org';
>>> 'cloudstack-us...@incubator.apache.org';
>>> 'run...@gmail.com'
>>> Subject: RE: CS4 AWS S3 support
>>> 
>>> Hi,
>>> 
>>> I can see the entry of keys in the usercredential table in CS4 DB.
>>> When I access http:///awsapi link I get the servlet exception :
>>> 
>>> java.lang.RuntimeException: javax.servlet.ServletException: Servlet 
>>> execution threw an exception
>>> com.cloud.bridge.service.EC2MainServlet.doGetOrPost(EC2MainServlet
>>> .java:104)
>>> com.cloud.bridge.service.EC2MainServlet.doGet(EC2MainServlet.java:7
>>> 3)
>>> 
>>> How can I run S3 requests? any links to documentation would be helpful.
>>> 
>>> Thanks and Regards.
>>> 
>>> Asmita
>>> 
>>> 
>>> -Original Message-
>>> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
>>> Sent: 25 March 2013 PM 03:35
>>> To: users@cloudstack.apache.org;
>>> 'cloudstack-us...@incubator.apache.org';
>>> 'run...@gmail.com'
>>> Subject: RE: CS4 AWS S3 support
>>> 
>>> Hi Asmita,
>>> 
>>> In the cloudbridge db, usercredentials table has the 
>>> username/password values present?
>>> Generally, for an existing account, generate the apikey/secrect key 
>>> and register them in awsapi.
>>> 
>>> Were you able to run s3 requests.?  Is awsap is running at 7080 port?
>>> 
>>> Thanks
>>> Rajesh Battala
>>> 
>>> 
 -Original Message-
 From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
 Sent: Monday, March 25, 2013 3:24 PM
 To: 'cloudstack-us...@incubator.apache.org'; 'run...@gmail.com'
 Subject: CS4 AWS S3 support
 
 Hi all,
 
 I am trying to do following to have an implementation of S3 in our
>> application.
 Followed steps given in:
 http://www.slideshare.net/sebastiengoasguen/cloudstack-s3
 
 
 1)  I have enabled S3 support and EC2 support flag in the CS4 global
>>> variables.
 
 2)  I have mounted the NFS store on the CS4 management server  (I am
>> using
 the NFS drive to store the buckets/files uploaded by user on this
 drive)
 
 3)  I have configured the cloud-bridge.properties appropriately
 
 host=http://localhost:7080/awsapi
 
 storage.root=/s3storage
 
 storage.multipartDir=__multipart__uploads__
 
 bucket.dns=false
 

RE: CS4 AWS S3 support

[Asmita Vagyani]

Hi all,

I tried to use a couple of freewares/tools like CyberDuck, DragonDisk, etc 
which interfaces the Cloudstack S3 APIs.
I am stuck at one common point in all these tools.
All tools say they support the alternative S3 compatible services, which in our 
case is our Cloudstack AWS S3.
However, it asks me endpoint of the S3 compatible service.
When I mention the endpoint as 
http:///awsapi/rest/AmazonS3 it doesnot accept it.
It wants the server name as server.com.

Is there any way I can get the S3 webservice endpoint the way these tools want.
Is this because Cloudstack is not consistent with the EC2 endpoint.
If yes, when are we planning to make it consistent.


Thanks and Regards.

Asmita 

-Original Message-
From: Rajesh Battala [mailto:rajesh.batt...@citrix.com] 
Sent: 25 March 2013 PM 09:40
To: users@cloudstack.apache.org; 'cloudstack-us...@incubator.apache.org'; 
'run...@gmail.com'
Subject: RE: CS4 AWS S3 support

Am not sure whether s3 browser allows user to configure the settings to access 
the cloudstack s3.
If you can configure the settings the way we configure for boto then we can use 
s3 browser.

Thanks
Rajesh Battala

> -Original Message-
> From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> Sent: Monday, March 25, 2013 7:09 PM
> To: 'users@cloudstack.apache.org'; 
> 'cloudstack-us...@incubator.apache.org';
> 'run...@gmail.com'
> Subject: RE: CS4 AWS S3 support
> 
> Are there any other clients, non-python based.
> Can I integrate this with S3 browser, such that the S3 browser shows 
> me buckets created on the NFS drive mounted using cloud-bridge.properties?
> User can just upload and download files in S3 browser and ultimately 
> on the NFS drive buckets.
> 
> 
> Thanks and Regards.
> 
> Asmita
> 
> -Original Message-
> From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
> Sent: 25 March 2013 PM 04:42
> To: users@cloudstack.apache.org; 
> 'cloudstack-us...@incubator.apache.org';
> 'run...@gmail.com'
> Subject: RE: CS4 AWS S3 support
> 
> Asmita,
> You can follow this link. 
> https://cwiki.apache.org/CLOUDSTACK/s3-api-in-
> cloudstack.html
> 
> You can use boto client which is python based to send s3 requests to CS.
> 
> Thanks
> Rajesh Battala
> 
> > -Original Message-
> > From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> > Sent: Monday, March 25, 2013 4:13 PM
> > To: 'users@cloudstack.apache.org';
> > 'cloudstack-us...@incubator.apache.org';
> > 'run...@gmail.com'
> > Subject: RE: CS4 AWS S3 support
> >
> > Hi,
> >
> > I can see the entry of keys in the usercredential table in CS4 DB.
> > When I access http:///awsapi link I get the servlet exception :
> >
> > java.lang.RuntimeException: javax.servlet.ServletException: Servlet 
> > execution threw an exception
> > com.cloud.bridge.service.EC2MainServlet.doGetOrPost(EC2MainServlet
> > .java:104)
> > com.cloud.bridge.service.EC2MainServlet.doGet(EC2MainServlet.java:7
> > 3)
> >
> > How can I run S3 requests? any links to documentation would be helpful.
> >
> > Thanks and Regards.
> >
> > Asmita
> >
> >
> > -Original Message-
> > From: Rajesh Battala [mailto:rajesh.batt...@citrix.com]
> > Sent: 25 March 2013 PM 03:35
> > To: users@cloudstack.apache.org;
> > 'cloudstack-us...@incubator.apache.org';
> > 'run...@gmail.com'
> > Subject: RE: CS4 AWS S3 support
> >
> > Hi Asmita,
> >
> > In the cloudbridge db, usercredentials table has the 
> > username/password values present?
> > Generally, for an existing account, generate the apikey/secrect key 
> > and register them in awsapi.
> >
> > Were you able to run s3 requests.?  Is awsap is running at 7080 port?
> >
> > Thanks
> > Rajesh Battala
> >
> >
> > > -Original Message-
> > > From: Asmita Vagyani [mailto:asmita.vagy...@sigma-systems.com]
> > > Sent: Monday, March 25, 2013 3:24 PM
> > > To: 'cloudstack-us...@incubator.apache.org'; 'run...@gmail.com'
> > > Subject: CS4 AWS S3 support
> > >
> > > Hi all,
> > >
> > > I am trying to do following to have an implementation of S3 in our
> application.
> > > Followed steps given in:
> > > http://www.slideshare.net/sebastiengoasguen/cloudstack-s3
> > >
> > >
> > > 1)  I have enabled S3 support and EC2 support flag in the CS4 global
> > variables.
> > >
> > > 2)  I have mounted the NFS store on the CS4 management server  (I am
> using
> > > the NFS drive to store the buckets/files uploaded by user on this
> > > drive)
> > >
> > > 3)  I have configured the cloud-bridge.properties appropriately
> > >
> > > host=http://localhost:7080/awsapi
> > >
> > > storage.root=/s3storage
> > >
> > > storage.multipartDir=__multipart__uploads__
> > >
> > > bucket.dns=false
> > >
> > > serviceEndpoint=localhost:7080
> > >
> > >
> > >
> > > 4)  I made up a user account into CS4 client console, generated the 
> > > API key
> > > and the Secret key.
> > >
> > > 5)  I have registered the user by using cloudstack-aws-api-register 
> > > (refer -
> > > http://cloudstack.a

RE: Unable to create snapshot from Volume

[Carl Pickering]

Hi there Ahmad,

The log I posted is all I can see when the process attempts.. Are there other 
logs I can check/change verbosity within log4j?

Carl



Carl Pickering
Systems Engineer | | Trader Media Group
Willow House, Woodlands Business Park, Newton-le-Willows, Cheshire, WA12 0HE
tel | +441616699153   mob | +44 7525 405539

-Original Message-
From: Ahmad Emneina [mailto:aemne...@gmail.com]
Sent: 25 March 2013 20:28
To: Cloudstack users mailing list
Subject: Re: Unable to create snapshot from Volume

Hi there Carl,

Can you post more of the logs? Feel free to add them here:
http://paste.cloudstack.org/

hopefully it will shed more light and we can figure out whats going wrong.


On Mon, Mar 25, 2013 at 3:02 AM, Carl Pickering  wrote:

> Hi there,
>
> I'm having an issue when attempting to create a volume from an
> existing snapshot...
>
> I've created a snapshot of a volume that contains data, and I can see
> it present from within Storage > Volumes > Snapshots with a status of
> Backed Up
>
> When I attempt to use Rightscale to create the volume I get the
> following failure from within CloudStack.
>
> ERROR [cloud.api.ApiDispatcher] (Job-Executor-47:job-1550) Exception
> while executing CreateVolumeCmd:
> com.cloud.utils.exception.CloudRuntimeException: Unable to create
> volume from snapshot 277 due to null
> at
>
> com.cloud.storage.StorageManagerImpl.createVolumeFromSnapshot(StorageManagerImpl.java:588)
> at
> com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:30)
> at
>
> com.cloud.storage.StorageManagerImpl.createVolumeFromSnapshot(StorageManagerImpl.java:623)
> at
>
> com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:1790)
> at
>
> com.cloud.utils.component.ComponentLocator$InterceptorDispatcher.intercept(ComponentLocator.java:1185)
> at
>
> com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:198)
> at
> com.cloud.api.commands.CreateVolumeCmd.execute(CreateVolumeCmd.java:160)
> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:132)
> at
> com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:427)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
>
> I'm using CloudStack 3.0.2 with XenServer..
>
> My volumes disk space look as follows (mounted on a temp server to get
> values):
> cloudstack-sec.zone.mydomain.com:/vol/CLOUDSTACK_02 250G   28G
> 223G  11% /mnt/cs-sec
>
> Can anyone shed any light?
>
> Carl
>




This e-mail is sent on behalf of Trader Media Group Limited, Registered Office: 
Auto Trader House, Cutbush Park Industrial Estate, Danehill, Lower Earley, 
Reading, Berkshire, RG6 4UT(Registered in England No. 4768833). This email and 
any files transmitted with it are confidential and may be legally privileged, 
and intended solely for the use of the individual or entity to whom they are 
addressed. If you have received this email in error please notify the sender. 
This email message has been swept for the presence of computer viruses. 

Video drivers

[Aleksey Samarin]

Hello everyone!

Anyone tried to change video adapter in kvm vm, from cirrus to vga/vmware?

I'm using CS 4.0, Ubuntu 12.10

Thanks!