Re: awsapi s3 Implementation not functioning on 4.2.0 installation on centos 6.3

2014-01-08 Thread Alok Menon
Thank you very much Sebastien . I will  evaluate  riakCS.

Thanks

Alok Menon


On Wed, Jan 8, 2014 at 9:00 PM, sebgoa  wrote:

>
> On Jan 8, 2014, at 4:23 PM, Alok Menon  wrote:
>
> > Hi All,
> >
> > I  tried to reinstall cloudstack-management by issuing "yum reinstall
> > cloudstack-management" and "yum reinstall  cloudstack-awsapi"  .
> > Even after doing this I am facing the same issue.
> >
> > Any help will be greatly appreciated .
> >
> > Thanks
> >
> > Alok Menon
>
> Alok,
>
> The short answer is that you should not use this. This was a tech preview
> back in pre 4.0 and has not seen any development since then.
> This S3 interface is backed by a regular NFS share, so you don't get any
> benefit from a true scalable object store.
> If you want a real S3 implementation you should look at riakCS from basho,
> you can install it easily and run it in combination with CloudStack.
> riakCs will give you S3 and you will be able to use it for secondary
> storage as well as normal object store use outside of CloudStack.
>
> However the EC2 interface works well. A few of us are planning a refactor
> of this EC2 interface, and I think the long-term plan is to remove the
> awsapi package from CloudStack. EC2 and S3 will be enabled through third
> party packages (this is not done yet and has not been voted on).
>
> Hope that makes sense,
>
> -Sebastien
>
> >
> >
> > On Wed, Jan 8, 2014 at 7:36 PM, Alok Menon  >wrote:
> >
> >> Hi ,
> >>
> >> I have installed cloudstack-manangent server on centos 6.3 and I have
> >> added couple of hosts . Everything is working fine as expected apart
> from
> >> enabling Cloudstack AWS s3 implementation.
> >>
> >> Request you to kindly help me fix the issue. Please go through the issue
> >> details below.
> >>
> >> *Steps completed to enable awsapi S3 implementation *
> >> ==
> >> 1) Below settings have been enabled Using Cloudstack_management UI
> >> enable.s3.api enable Amazon S3 API on CloudStack true
> >> s3.rrs.enabled enable s3 reduced redundancy storage true
> >> 2 Modified cloud-bridge.properties to storage.root to a valid directory.
> >> 3) restarted Cloudstack_management service.
> >> 4) Executed below command and received User registration is successful
> >> Message,
> >> cloudstack-aws-api-register
> >>
> --apikey=1cn1BBE9aaA1FSHij3ee6YS4orlsid-EfXaWBXMtX-BsqjtQwEj8UDANzzdQobBrGjTmKnny2sQF_GYRMNBDSA
> >>
> --secretkey=-guBDlSM2OC18wAK_Kj5WGnlq3P1NluChq52jBDcSudOKQ637fh17imMHETkQC5ZIjtaEKuxajos3yADGLIVwA
> >> --cert=cert.pem --
> >>
> >>
> >> *Problem Statement  *=
> >> Tried to access : http://localhost:7080/awsapi/rest/AmazonS3
> >> its resulting in below exception and got 500 response "The endpoint
> >> reference (EPR) for the Operation not found is
> /awsapi/services/AmazonEC2/
> >> and the WSA Action = null"
> >>
> >> SEVERE: Allocate exception for servlet CloudBridgeS3Servlet
> >> javax.servlet.ServletException: Error initializing awsapi: null
> >>at
> >> com.cloud.bridge.service.S3RestServlet.init(S3RestServlet.java:128)
> >>at
> >>
> org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1173)
> >>at
> >>
> org.apache.catalina.core.StandardWrapper.allocate(StandardWrapper.java:809)
> >>at
> >>
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:129)
> >>at
> >>
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
> >>at
> >>
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> >>at
> >>
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> >>at
> >>
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
> >>at
> >>
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
> >>at
> >>
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> >>at
> >>
> org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
> >>at
> >>
> org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721)
> >>at
> >>
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2274)
> >>at
> >>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> >>at
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >>at java.lang.Thread.run(Thread.java:701)
> >> Jan 8, 2014 6:39:00 PM org.apache.axis2.engine.AxisEngine receive
> >> SEVERE: The endpoint reference (EPR) for the Operation not found is
> >> /awsapi/services/AmazonEC2/ and the WSA Action = null
> >> org.apache.axis2.AxisFault: The endpoint reference (EPR) for the
> Operation
> >> not found is /awsapi/services/AmazonEC2/ and the WSA Action = null
> >>at
> >>
> org.apache.axis2.engine.DispatchPha

Re: awsapi s3 Implementation not functioning on 4.2.0 installation on centos 6.3

2014-01-08 Thread sebgoa

On Jan 8, 2014, at 4:23 PM, Alok Menon  wrote:

> Hi All,
> 
> I  tried to reinstall cloudstack-management by issuing "yum reinstall
> cloudstack-management" and "yum reinstall  cloudstack-awsapi"  .
> Even after doing this I am facing the same issue.
> 
> Any help will be greatly appreciated .
> 
> Thanks
> 
> Alok Menon

Alok, 

The short answer is that you should not use this. This was a tech preview back 
in pre 4.0 and has not seen any development since then.
This S3 interface is backed by a regular NFS share, so you don't get any 
benefit from a true scalable object store. 
If you want a real S3 implementation you should look at riakCS from basho, you 
can install it easily and run it in combination with CloudStack.
riakCs will give you S3 and you will be able to use it for secondary storage as 
well as normal object store use outside of CloudStack.

However the EC2 interface works well. A few of us are planning a refactor of 
this EC2 interface, and I think the long-term plan is to remove the awsapi 
package from CloudStack. EC2 and S3 will be enabled through third party 
packages (this is not done yet and has not been voted on).

Hope that makes sense,

-Sebastien

> 
> 
> On Wed, Jan 8, 2014 at 7:36 PM, Alok Menon wrote:
> 
>> Hi ,
>> 
>> I have installed cloudstack-manangent server on centos 6.3 and I have
>> added couple of hosts . Everything is working fine as expected apart from
>> enabling Cloudstack AWS s3 implementation.
>> 
>> Request you to kindly help me fix the issue. Please go through the issue
>> details below.
>> 
>> *Steps completed to enable awsapi S3 implementation *
>> ==
>> 1) Below settings have been enabled Using Cloudstack_management UI
>> enable.s3.api enable Amazon S3 API on CloudStack true
>> s3.rrs.enabled enable s3 reduced redundancy storage true
>> 2 Modified cloud-bridge.properties to storage.root to a valid directory.
>> 3) restarted Cloudstack_management service.
>> 4) Executed below command and received User registration is successful
>> Message,
>> cloudstack-aws-api-register
>> --apikey=1cn1BBE9aaA1FSHij3ee6YS4orlsid-EfXaWBXMtX-BsqjtQwEj8UDANzzdQobBrGjTmKnny2sQF_GYRMNBDSA
>> --secretkey=-guBDlSM2OC18wAK_Kj5WGnlq3P1NluChq52jBDcSudOKQ637fh17imMHETkQC5ZIjtaEKuxajos3yADGLIVwA
>> --cert=cert.pem --
>> 
>> 
>> *Problem Statement  *=
>> Tried to access : http://localhost:7080/awsapi/rest/AmazonS3
>> its resulting in below exception and got 500 response "The endpoint
>> reference (EPR) for the Operation not found is /awsapi/services/AmazonEC2/
>> and the WSA Action = null"
>> 
>> SEVERE: Allocate exception for servlet CloudBridgeS3Servlet
>> javax.servlet.ServletException: Error initializing awsapi: null
>>at
>> com.cloud.bridge.service.S3RestServlet.init(S3RestServlet.java:128)
>>at
>> org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1173)
>>at
>> org.apache.catalina.core.StandardWrapper.allocate(StandardWrapper.java:809)
>>at
>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:129)
>>at
>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
>>at
>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>>at
>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
>>at
>> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
>>at
>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
>>at
>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
>>at
>> org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
>>at
>> org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721)
>>at
>> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2274)
>>at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>>at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>at java.lang.Thread.run(Thread.java:701)
>> Jan 8, 2014 6:39:00 PM org.apache.axis2.engine.AxisEngine receive
>> SEVERE: The endpoint reference (EPR) for the Operation not found is
>> /awsapi/services/AmazonEC2/ and the WSA Action = null
>> org.apache.axis2.AxisFault: The endpoint reference (EPR) for the Operation
>> not found is /awsapi/services/AmazonEC2/ and the WSA Action = null
>>at
>> org.apache.axis2.engine.DispatchPhase.checkPostConditions(DispatchPhase.java:89)
>>at org.apache.axis2.engine.Phase.invoke(Phase.java:334)
>>at org.apache.axis2.engine.AxisEngine.invoke(AxisEngine.java:254)
>>at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:160)
>>at
>> org.apache.axis2.transport.http.util.RESTUtil.invokeAxisEngine(RESTUtil.java:

Re: awsapi s3 Implementation not functioning on 4.2.0 installation on centos 6.3

2014-01-08 Thread Alok Menon
Hi All,

I  tried to reinstall cloudstack-management by issuing "yum reinstall
 cloudstack-management" and "yum reinstall  cloudstack-awsapi"  .
Even after doing this I am facing the same issue.

Any help will be greatly appreciated .

Thanks

Alok Menon


On Wed, Jan 8, 2014 at 7:36 PM, Alok Menon wrote:

> Hi ,
>
> I have installed cloudstack-manangent server on centos 6.3 and I have
> added couple of hosts . Everything is working fine as expected apart from
> enabling Cloudstack AWS s3 implementation.
>
> Request you to kindly help me fix the issue. Please go through the issue
> details below.
>
> *Steps completed to enable awsapi S3 implementation *
> ==
> 1) Below settings have been enabled Using Cloudstack_management UI
> enable.s3.api enable Amazon S3 API on CloudStack true
> s3.rrs.enabled enable s3 reduced redundancy storage true
> 2 Modified cloud-bridge.properties to storage.root to a valid directory.
> 3) restarted Cloudstack_management service.
> 4) Executed below command and received User registration is successful
> Message,
> cloudstack-aws-api-register
> --apikey=1cn1BBE9aaA1FSHij3ee6YS4orlsid-EfXaWBXMtX-BsqjtQwEj8UDANzzdQobBrGjTmKnny2sQF_GYRMNBDSA
> --secretkey=-guBDlSM2OC18wAK_Kj5WGnlq3P1NluChq52jBDcSudOKQ637fh17imMHETkQC5ZIjtaEKuxajos3yADGLIVwA
> --cert=cert.pem --
>
>
> *Problem Statement  *=
> Tried to access : http://localhost:7080/awsapi/rest/AmazonS3
> its resulting in below exception and got 500 response "The endpoint
> reference (EPR) for the Operation not found is /awsapi/services/AmazonEC2/
> and the WSA Action = null"
>
> SEVERE: Allocate exception for servlet CloudBridgeS3Servlet
> javax.servlet.ServletException: Error initializing awsapi: null
> at
> com.cloud.bridge.service.S3RestServlet.init(S3RestServlet.java:128)
> at
> org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1173)
> at
> org.apache.catalina.core.StandardWrapper.allocate(StandardWrapper.java:809)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:129)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
> at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
> at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
> at
> org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
> at
> org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721)
> at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2274)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:701)
> Jan 8, 2014 6:39:00 PM org.apache.axis2.engine.AxisEngine receive
> SEVERE: The endpoint reference (EPR) for the Operation not found is
> /awsapi/services/AmazonEC2/ and the WSA Action = null
> org.apache.axis2.AxisFault: The endpoint reference (EPR) for the Operation
> not found is /awsapi/services/AmazonEC2/ and the WSA Action = null
> at
> org.apache.axis2.engine.DispatchPhase.checkPostConditions(DispatchPhase.java:89)
> at org.apache.axis2.engine.Phase.invoke(Phase.java:334)
> at org.apache.axis2.engine.AxisEngine.invoke(AxisEngine.java:254)
> at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:160)
> at
> org.apache.axis2.transport.http.util.RESTUtil.invokeAxisEngine(RESTUtil.java:135)
> at
> org.apache.axis2.transport.http.util.RESTUtil.processURLRequest(RESTUtil.java:130)
> at
> org.apache.axis2.transport.http.AxisServlet$RestRequestProcessor.processURLRequest(AxisServlet.java:825)
> at
> org.apache.axis2.transport.http.AxisServlet.doGet(AxisServlet.java:271)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
>
>
> *Observation: *
> 
> I am seeing below  exception in catalina.out file during
> cloudstack-management server start-up
>
> 2014 6:11:00 PM org.apache.axis2.deployment.ModuleDeployer deploy
> SEVERE: The addressing-1.5.4.mar module, which is not valid, caused The
> module.xml file cannot be found for the module:
> /usr/share/cloudstack-management/webapps7080/awsapi/WEB-INF/modules/addressing-1.5.4.mar
> org.apache.axis2.deployment.DeploymentException: The module.xml file
> cannot be found for the module:
> /usr/share/cloud

awsapi s3 Implementation not functioning on 4.2.0 installation on centos 6.3

2014-01-08 Thread Alok Menon
Hi ,

I have installed cloudstack-manangent server on centos 6.3 and I have added
couple of hosts . Everything is working fine as expected apart from
enabling Cloudstack AWS s3 implementation.

Request you to kindly help me fix the issue. Please go through the issue
details below.

*Steps completed to enable awsapi S3 implementation *
==
1) Below settings have been enabled Using Cloudstack_management UI
enable.s3.api enable Amazon S3 API on CloudStack true
s3.rrs.enabled enable s3 reduced redundancy storage true
2 Modified cloud-bridge.properties to storage.root to a valid directory.
3) restarted Cloudstack_management service.
4) Executed below command and received User registration is successful
Message,
cloudstack-aws-api-register
--apikey=1cn1BBE9aaA1FSHij3ee6YS4orlsid-EfXaWBXMtX-BsqjtQwEj8UDANzzdQobBrGjTmKnny2sQF_GYRMNBDSA
--secretkey=-guBDlSM2OC18wAK_Kj5WGnlq3P1NluChq52jBDcSudOKQ637fh17imMHETkQC5ZIjtaEKuxajos3yADGLIVwA
--cert=cert.pem --


*Problem Statement  *=
Tried to access : http://localhost:7080/awsapi/rest/AmazonS3
its resulting in below exception and got 500 response "The endpoint
reference (EPR) for the Operation not found is /awsapi/services/AmazonEC2/
and the WSA Action = null"

SEVERE: Allocate exception for servlet CloudBridgeS3Servlet
javax.servlet.ServletException: Error initializing awsapi: null
at
com.cloud.bridge.service.S3RestServlet.init(S3RestServlet.java:128)
at
org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1173)
at
org.apache.catalina.core.StandardWrapper.allocate(StandardWrapper.java:809)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:129)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
at
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
at
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721)
at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2274)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:701)
Jan 8, 2014 6:39:00 PM org.apache.axis2.engine.AxisEngine receive
SEVERE: The endpoint reference (EPR) for the Operation not found is
/awsapi/services/AmazonEC2/ and the WSA Action = null
org.apache.axis2.AxisFault: The endpoint reference (EPR) for the Operation
not found is /awsapi/services/AmazonEC2/ and the WSA Action = null
at
org.apache.axis2.engine.DispatchPhase.checkPostConditions(DispatchPhase.java:89)
at org.apache.axis2.engine.Phase.invoke(Phase.java:334)
at org.apache.axis2.engine.AxisEngine.invoke(AxisEngine.java:254)
at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:160)
at
org.apache.axis2.transport.http.util.RESTUtil.invokeAxisEngine(RESTUtil.java:135)
at
org.apache.axis2.transport.http.util.RESTUtil.processURLRequest(RESTUtil.java:130)
at
org.apache.axis2.transport.http.AxisServlet$RestRequestProcessor.processURLRequest(AxisServlet.java:825)
at
org.apache.axis2.transport.http.AxisServlet.doGet(AxisServlet.java:271)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)


*Observation: *

I am seeing below  exception in catalina.out file during
cloudstack-management server start-up

2014 6:11:00 PM org.apache.axis2.deployment.ModuleDeployer deploy
SEVERE: The addressing-1.5.4.mar module, which is not valid, caused The
module.xml file cannot be found for the module:
/usr/share/cloudstack-management/webapps7080/awsapi/WEB-INF/modules/addressing-1.5.4.mar
org.apache.axis2.deployment.DeploymentException: The module.xml file cannot
be found for the module:
/usr/share/cloudstack-management/webapps7080/awsapi/WEB-INF/modules/addressing-1.5.4.mar
/module
at
org.apache.catalina.startup.HostConfig.deployDirectories(HostConfig.java:964)
at
org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:502)
at
org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277)
at
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321)
at
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(Lifec