[Dev] DAS Error while creating dashboard
.invoke(CarbonTomcatValve.java:47) at org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:57) at org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invokeValves(TomcatValveContainer.java:47) at org.wso2.carbon.tomcat.ext.valves.CompositeValve.invoke(CompositeValve.java:62) at org.wso2.carbon.tomcat.ext.valves.CarbonStuckThreadDetectionValve.invoke(CarbonStuckThreadDetectionValve.java:159) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.wso2.carbon.tomcat.ext.valves.CarbonContextCreatorValve.invoke(CarbonContextCreatorValve.java:57) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1739) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1698) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: org.mozilla.javascript.EcmaError: TypeError: Cannot call method "getOutputStreamName" of null (/portal/controllers/realTime.jag#61) at org.mozilla.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3687) at org.mozilla.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3665) at org.mozilla.javascript.ScriptRuntime.typeError(ScriptRuntime.java:3693) at org.mozilla.javascript.ScriptRuntime.typeError2(ScriptRuntime.java:3712) at org.mozilla.javascript.ScriptRuntime.undefCallError(ScriptRuntime.java:3731) at org.mozilla.javascript.ScriptRuntime.getPropFunctionAndThisHelper(ScriptRuntime.java:2258) at org.mozilla.javascript.ScriptRuntime.getPropFunctionAndThis(ScriptRuntime.java:2251) at org.mozilla.javascript.optimizer.OptRuntime.callProp0(OptRuntime.java:83) at org.jaggeryjs.rhino.portal.controllers.c9._c_script_0(/portal/controllers/realTime.jag:61) at org.jaggeryjs.rhino.portal.controllers.c9.call(/portal/controllers/realTime.jag) at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:394) at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3091) at org.jaggeryjs.rhino.portal.controllers.c9.call(/portal/controllers/realTime.jag) at org.jaggeryjs.rhino.portal.controllers.c9.exec(/portal/controllers/realTime.jag) at org.jaggeryjs.scriptengine.engine.RhinoEngine.execScript(RhinoEngine.java:567) ... 41 more -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [PPaaS] Integrating DAS with Stratos for Metering Service and Monitoring Health Statistics
Hi Devs, Stratos is integrated with DAS for Metering service and Monitoring Health Statistics. In order to implement this requirement, following idea is used: - Here for the Metering service, Instance details (cluster level instance count with time and member level instance details with autoscaling decision) are published from Stratos to DAS, persisted in HBase, analyzed using Spark and saved in MySQL and then shown in DAS dashboard. - For the Monitoring service, Health Statistics aggregated by CEP is sent to DAS and then shown in dashboard as shown above. Currently, I'm in the stage of getting part of instance details and showing it in dashboard. Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [VOTE] Release WSO2 Puppet Modules 1.1.1 RC1
[x] Stable, Go ahead and release Tested below products default profile: 1. WSO2 AS - 5.3.0 2. WSO2 ES - 2.0.0 3. WSO2 GREG - 5.1.0 4. WSO2 MB - 3.1.0 Thanks. On Fri, Mar 18, 2016 at 4:37 PM, Isuru Haththotuwa wrote: > Tested the following: > >- License verification using rat plugin >- Testing of single node deployments of following products: > 1. APIM 1.9.1 > 2. IS 5.0.0 > 3. DAS 3.0.1 > 4. DSS 3.5.0 > 5. ES 2.0.0 > > [x] Stable - Go ahead and release > > > On Thu, Mar 17, 2016 at 3:15 PM, Chamila De Alwis > wrote: > >> Hi, >> >> This is RC1 for WSO2 Puppet Modules 1.1.1. Please download, verify, and >> vote. The vote will be open for 72 hours. >> >> [ ] Broken - Do not release (explain why) >> [ ] Stable - Go ahead and release >> >> This release contains minor fixes to the Puppet templates and the Hiera >> data. >> >> *This release is based on the following tag:* >> https://github.com/wso2/puppet-modules/releases/tag/1.1.1-rc1 >> >> *Release verification guide can be found at:* >> https://github.com/wso2/puppet-modules/wiki/Verifying-Puppet-Modules >> >> *Source and distribution packages can be downloaded at:* >> https://github.com/wso2/puppet-modules/releases/tag/1.1.1-rc1 >> >> Regards, >> Chamila de Alwis >> Committer and PMC Member - Apache Stratos >> Software Engineer | WSO2 | +94772207163 >> Blog: code.chamiladealwis.com >> >> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > Thanks and Regards, > > Isuru H. > +94 716 358 048* <http://wso2.com/>* > > > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [VOTE] Release WSO2 Dockerfiles 1.0.0 RC3
[x] - Go ahead and release. Verified the following: 1. License headers 2. Distribution 3. Build the following products docker images using both default and puppet provisioning methods and tested the basic functionalities using helper scripts: 1. ESB 2. GREG 3. MB 4. BPS 5. CEP 6. ES Thanks. On Mon, Apr 4, 2016 at 9:36 AM, Chamila De Alwis wrote: > *[x] Stable *- Go ahead and release > > Verified the following > >- Repository structure >- Distribution >- Helper Scripts (build, run, stop) for WSO2 MB and WSO2 AM, and smoke >tests for basic product functionality >- License headers >- README content > > > > Regards, > Chamila de Alwis > Committer and PMC Member - Apache Stratos > Software Engineer | WSO2 | +94772207163 > Blog: code.chamiladealwis.com > > > > On Fri, Apr 1, 2016 at 3:54 PM, Isuru Haththotuwa wrote: > >> This is the third release candidate (RC3) of WSO2 Dockerfiles 1.0.0 >> release. >> >> *Tag to be voted upon:* >> https://github.com/wso2/dockerfiles/tree/v1.0.0-rc3 >> >> *Source and distribution packages:* >> https://github.com/wso2/dockerfiles/releases/tag/v1.0.0-rc3 >> >> Please download, test, and vote. The README file under each product >> directory contains instructions on how to try it out locally. >> >> [ ] Broken - Do not release (explain why) >> [ ] Stable - Go ahead and release >> >> This vote will be open for 72 hours or as needed. >> >> -- >> Thanks and Regards, >> >> Isuru H. >> +94 716 358 048* <http://wso2.com/>* >> >> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Kubernetes Artifacts] Applying secure vault for wso2 products when building docker images
Hi All, We need to pass the key store password to kubernetes containers when starting a wso2 server with secure vault enabled. In order to do that, we can use kubernetes secret [1] and can consume them in two ways: 1. using secret volume [2] 2. expose them as environment variables For both approaches we need to add the key store password as secret with base64 encoded value as in [3] and have to use one of the above approach to add it to replication controller. In the first approach, we can consume the secret using secret volume and mount it to preferred path as in [4]. It will create a file with the name of the secret key in the specified path and we can create the password-tmp by reading that file in docker entrypoint script [5]. In order to do that, we need to do modification in docker entrypoint script which currently supports only environment variable to pass key store password and have to a dockerfiles patch release. In the second approach, we can expose the secret as environment variables to containers as in [6]. For this approach, we don't need any modifications in entrypoint.sh but exposing secrets as environment variable is supported in kubernetes 1.2.0 afterwards. But if we want to support kubernetes 1.1.x, we have to pass the key store password in plain text as environment variable which is not good. @ team: Which method is better to incorporate for kubernetes-artifacts release. Please give your suggestions on this. Thanks. [1]. http://kubernetes.io/docs/user-guide/secrets/ [2]. http://kubernetes.io/docs/user-guide/volumes/#secret [3]. https://github.com/Thanu/kubernetes-artifacts/blob/kub-secret-for-key-store-password/wso2esb/secret.yaml [4]. https://github.com/Thanu/kubernetes-artifacts/blob/kub-secret-for-key-store-password/wso2esb/wso2esb-default-controller.yaml [5]. https://github.com/wso2/dockerfiles/blob/master/common/scripts/entrypoint.sh [6]. https://github.com/Thanu/kubernetes-artifacts/blob/kub-secret-for-key-store-password/wso2esb/wso2esb-default-controller.yaml#L42-L48 On Sat, Feb 27, 2016 at 9:45 PM, Thanuja Uruththirakodeeswaran < thanu...@wso2.com> wrote: > Hi All, > > I have updated the puppet modules for secure vault support. Please review > and merger the p/r [1]. I'll send a p/r for kubernetes-artifacts repo with > the changes needed to pass the key store password. I have done the changes > to pass key store password as environment variable for standalone docker > containers. Currently I'm working on passing the password as kubernetes > secret and will send a p/r for this soon. > > [1]. https://github.com/wso2/puppet-modules/pull/16 > > Thanks. > > On Sun, Feb 21, 2016 at 12:24 PM, Imesh Gunaratne wrote: > >> >> >> On Sun, Feb 21, 2016 at 8:05 AM, Thanuja Uruththirakodeeswaran < >> thanu...@wso2.com> wrote: >> >>> Hi All, >>> >>> Currently I'm working on $subject by running cipher tool and user will >>> be able to build a docker image for a wso2 product which will have secured >>> password in config files. >>> >>> In order to do the subject, we need to add cipher-tool.properties, >>> cipher-text.properties and password-tmp file templates to puppet module. I >>> thought of encrypting the passwords using the cipher tool after we execute >>> puppet apply in Docker files [1]. >>> >> >> Yes IMO this is the best option. Docker image build process use puppet >> for configuring the product, once the configuration is done run secure >> vault and secure all credentials. >> >> When the container starts we will need to send the password either using >> an environment variable (in Docker) or via a K8S secret (in K8S) and create >> the password text file. Then we can start the server. >> >> Thanks >> >>> >>> Applying secure vault while building the docker image will be easy and >>> efficient way compared to manually running the cipher tool and updating >>> puppet module templates before building the docker image. >>> >>> I'll update this thread about the progress. Highly appreciate your >>> suggestions on this. >>> >>> [1]. >>> https://github.com/wso2/kubernetes-artifacts/blob/master/wso2esb/docker/Dockerfile#L40 >>> >>> Thanks. >>> >>> -- >>> Thanuja Uruththirakodeeswaran >>> Software Engineer >>> WSO2 Inc.;http://wso2.com >>> lean.enterprise.middleware >>> >>> mobile: +94 774363167 >>> >> >> >> >> -- >> *Imesh Gunaratne* >> Senior Technical Lead >> WSO2 Inc: http://wso2.com >> T: +94 11 214 5345 M: +94 77 374 2057 >> W: http://imesh.gunaratne.org >> Lean . Enterprise . Middleware >> >> > > > -- > Thanuja Uruththirakodeeswaran > Software Engineer > WSO2 Inc.;http://wso2.com > lean.enterprise.middleware > > mobile: +94 774363167 > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Kubernetes Artifacts] Applying secure vault for wso2 products when building docker images
On Tue, Apr 5, 2016 at 5:24 PM, Chamila De Alwis wrote: > I'm in favor of the first approach where the Secret is created as a file > in a volume in the pod. This will allow us to support Kubernetes versions > older than 1.2 (which was released few weeks ago). > > We can enable a parameter in the deploy.sh script which would allow the > user to input the Keystore password. The script can then create a > Kubernetes Secret itself without user intervention. IMO this would ease the > process for the user a lot. WDYT? > +1 for this. I'm currently working on this. > > > Regards, > Chamila de Alwis > Committer and PMC Member - Apache Stratos > Software Engineer | WSO2 | +94772207163 > Blog: code.chamiladealwis.com > > > > On Tue, Apr 5, 2016 at 5:16 PM, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi All, >> >> We need to pass the key store password to kubernetes containers when >> starting a wso2 server with secure vault enabled. In order to do that, we >> can use kubernetes secret [1] and can consume them in two ways: >> >> 1. using secret volume [2] >> 2. expose them as environment variables >> >> For both approaches we need to add the key store password as secret with >> base64 encoded value as in [3] and have to use one of the above approach to >> add it to replication controller. >> >> In the first approach, we can consume the secret using secret volume and >> mount it to preferred path as in [4]. It will create a file with the name >> of the secret key in the specified path and we can create the password-tmp >> by reading that file in docker entrypoint script [5]. In order to do that, >> we need to do modification in docker entrypoint script which currently >> supports only environment variable to pass key store password and have to a >> dockerfiles patch release. >> >> In the second approach, we can expose the secret as environment variables >> to containers as in [6]. For this approach, we don't need any modifications >> in entrypoint.sh but exposing secrets as environment variable is supported >> in kubernetes 1.2.0 afterwards. But if we want to support kubernetes 1.1.x, >> we have to pass the key store password in plain text as environment >> variable which is not good. >> >> @ team: Which method is better to incorporate for kubernetes-artifacts >> release. Please give your suggestions on this. >> >> Thanks. >> >> [1]. http://kubernetes.io/docs/user-guide/secrets/ >> [2]. http://kubernetes.io/docs/user-guide/volumes/#secret >> [3]. >> https://github.com/Thanu/kubernetes-artifacts/blob/kub-secret-for-key-store-password/wso2esb/secret.yaml >> [4]. >> https://github.com/Thanu/kubernetes-artifacts/blob/kub-secret-for-key-store-password/wso2esb/wso2esb-default-controller.yaml >> [5]. >> https://github.com/wso2/dockerfiles/blob/master/common/scripts/entrypoint.sh >> [6]. >> https://github.com/Thanu/kubernetes-artifacts/blob/kub-secret-for-key-store-password/wso2esb/wso2esb-default-controller.yaml#L42-L48 >> >> >> On Sat, Feb 27, 2016 at 9:45 PM, Thanuja Uruththirakodeeswaran < >> thanu...@wso2.com> wrote: >> >>> Hi All, >>> >>> I have updated the puppet modules for secure vault support. Please >>> review and merger the p/r [1]. I'll send a p/r for kubernetes-artifacts >>> repo with the changes needed to pass the key store password. I have done >>> the changes to pass key store password as environment variable for >>> standalone docker containers. Currently I'm working on passing the password >>> as kubernetes secret and will send a p/r for this soon. >>> >>> [1]. https://github.com/wso2/puppet-modules/pull/16 >>> >>> Thanks. >>> >>> On Sun, Feb 21, 2016 at 12:24 PM, Imesh Gunaratne >>> wrote: >>> >>>> >>>> >>>> On Sun, Feb 21, 2016 at 8:05 AM, Thanuja Uruththirakodeeswaran < >>>> thanu...@wso2.com> wrote: >>>> >>>>> Hi All, >>>>> >>>>> Currently I'm working on $subject by running cipher tool and user will >>>>> be able to build a docker image for a wso2 product which will have secured >>>>> password in config files. >>>>> >>>>> In order to do the subject, we need to add cipher-tool.properties, >>>>> cipher-text.properties and password-tmp file templates to puppet module. >>>>> I >>>>> thought of encrypting the passwords using the ci
Re: [Dev] Handling Kubernetes Specific Configurations in Puppet/Hiera
On Fri, Apr 8, 2016 at 7:48 PM, Isuru Haththotuwa wrote: > > > On Fri, Apr 8, 2016 at 5:12 PM, Imesh Gunaratne wrote: > >> Hi Devs, >> >> IMO we need to handle $subject without affecting other deployments. At >> the moment we have updated default.yaml with K8S specific configurations >> and manager and worker yaml files also have clustering configurations >> enabled for K8S. >> > +1. As per the offline discussion, one possible method of doing this is to > have a separation under the product level of hieradata to indicate whether > the configuration is relevant to vm, docker, kubernetes, mesos, etc based > scenarios. So the hieradata structure should change as below: > > hieradata > |--- dev >|--- wso2 >| > |--- >|-- *vm* > |-- > default.yaml > |-- > manager.yaml > |-- worker.yaml >|--* docker* > |-- > default.yaml > |-- > manager.yaml > |-- worker.yaml >|-- *kubernetes* > > |-- > default.yaml > |-- > manager.yaml > |-- worker.yaml > > wdyt? > > +1 for this structure. This will be a easiest way to separate deployment specific configurations. Thanks. Thanks >> >> -- >> *Imesh Gunaratne* >> Senior Technical Lead >> WSO2 Inc: http://wso2.com >> T: +94 11 214 5345 M: +94 77 374 2057 >> W: http://imesh.io >> Lean . Enterprise . Middleware >> >> > > > -- > Thanks and Regards, > > Isuru H. > +94 716 358 048* <http://wso2.com/>* > > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Handling Kubernetes Specific Configurations in Puppet/Hiera
>>>> >>>> >>>>> >>>>>>>>> Why can't we do this by using defined types in Hiera and lookup >>>>>>>>> parameters for a given instance? Based on the identify keys we >>>>>>>>> set for each vm, docker, K8S etc we can select the appropriate data >>>>>>>>> set from Hiera file. >>>>>>>>> >>>>>>>> >>>>>>>> Will you be able to provide a sample? >>>>>>>> >>>>>>> >>>> >>>> I think we can make this with with Defined Types[1][2] without creating >>>> duplicate set of YAML files for each platform. We can do the same as the >>>> example given in the document. >>>> >>> I do not think we need to duplicate the yaml files here. Sorry that the >>> sample in the first reply sent by me implied so. What we can do is refactor >>> out the hiera data so that data which is changing according to the platform >>> (ex.: clustering section) can be moved to a different yaml file(s). For an >>> example, clustering for kubernetes scenario can be included in >>> *puppet-modules/hieradata/dev/wso2/kubernetes/clustering.yaml*. Here, >>> 'kubernetes' is the value of the facter which is used to identify the >>> environment. Similarly, other such data can be refactored out. >>> >> If we follow this approach, then we can't specify product and profile specific data (ex: kubernetes service name varies per product and proxy_ports varies per poduct/profile) in the common platform hiera file: *puppet-modules/hieradata/dev/wso2/kubernetes/clustering.yaml.* >>>> [1] >>>> https://docs.puppet.com/puppet/latest/reference/lang_defined_types.html >>>> [2]http://puppetlunch.com/puppet/hiera.html >>>> >>>> >>>>> >>>>>>>> Thanks >>>>>>>> >>>>>>>>> >>>>>>>>> Thanks, >>>>>>>>> Gayan >>>>>>>>> >>>>>>>>> >>>>>>>>> On Sat, Apr 9, 2016 at 8:28 AM, Imesh Gunaratne >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Fri, Apr 8, 2016 at 7:48 PM, Isuru Haththotuwa < >>>>>>>>>> isu...@wso2.com> wrote: >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> hieradata >>>>>>>>>>> |--- dev >>>>>>>>>>>|--- wso2 >>>>>>>>>>>| >>>>>>>>>>> |--- >>>>>>>>>>>|-- *vm* >>>>>>>>>>> |-- >>>>>>>>>>> default.yaml >>>>>>>>>>> |-- >>>>>>>>>>> manager.yaml >>>>>>>>>>> |-- >>>>>>>>>>> worker.yaml >>>>>>>>>>>|--* >>>>>>>>>>> docker* >>>>>>>>>>> |-- >>>>>>>>>>> default.yaml >>>>>>>>>>> |-- >>>>>>>>>>> manager.yaml >>>>>>>>>>> |-- >>>>>>>>>>> worker.yaml >>>>>>>>>>> |-- >>>>>>>>>>> *kubernetes* >>>>>>>>>>> |-- >>>>>>>>>>> default.yaml >>>>>>>>>>> |-- >>>>>>>>>>> manager.yaml >>>>>>>>>>> |-- >>>>>>>>>>> worker.yaml >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> +1 for the suggestion Isuru, will proceed with this. We can add >>>>>>>>>> other platforms such as OpenShift, Mesos, Cloud Foundry on the same >>>>>>>>>> level. >>>>>>>>>> >>>>>>>>>> Thanks >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Thanks >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> *Imesh Gunaratne* >>>>>>>>>>>> Senior Technical Lead >>>>>>>>>>>> WSO2 Inc: http://wso2.com >>>>>>>>>>>> T: +94 11 214 5345 M: +94 77 374 2057 >>>>>>>>>>>> W: http://imesh.io >>>>>>>>>>>> Lean . Enterprise . Middleware >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> Thanks and Regards, >>>>>>>>>>> >>>>>>>>>>> Isuru H. >>>>>>>>>>> +94 716 358 048* <http://wso2.com/>* >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> *Imesh Gunaratne* >>>>>>>>>> Senior Technical Lead >>>>>>>>>> WSO2 Inc: http://wso2.com >>>>>>>>>> T: +94 11 214 5345 M: +94 77 374 2057 >>>>>>>>>> W: http://imesh.io >>>>>>>>>> Lean . Enterprise . Middleware >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> ___ >>>>>>>>>> Dev mailing list >>>>>>>>>> Dev@wso2.org >>>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> >>>>>>>>> Gayan Gunarathne >>>>>>>>> Technical Lead, WSO2 Inc. (http://wso2.com) >>>>>>>>> Committer & PMC Member, Apache Stratos >>>>>>>>> email : gay...@wso2.com | mobile : +94 775030545 >>>>>>>>> <%2B94%20766819985> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> ___ >>>>>>>>> Dev mailing list >>>>>>>>> Dev@wso2.org >>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> *Imesh Gunaratne* >>>>>>>> Senior Technical Lead >>>>>>>> WSO2 Inc: http://wso2.com >>>>>>>> T: +94 11 214 5345 M: +94 77 374 2057 >>>>>>>> W: http://imesh.io >>>>>>>> Lean . Enterprise . Middleware >>>>>>>> >>>>>>>> >>>>>>>> ___ >>>>>>>> Dev mailing list >>>>>>>> Dev@wso2.org >>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> *Imesh Gunaratne* >>>>>> Senior Technical Lead >>>>>> WSO2 Inc: http://wso2.com >>>>>> T: +94 11 214 5345 M: +94 77 374 2057 >>>>>> W: http://imesh.io >>>>>> Lean . Enterprise . Middleware >>>>>> >>>>>> >>>>>> ___ >>>>>> Dev mailing list >>>>>> Dev@wso2.org >>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Lakmal Warusawithana >>>>> Director - Cloud Architecture; WSO2 Inc. >>>>> Mobile : +94714289692 >>>>> Blog : http://lakmalsview.blogspot.com/ >>>>> >>>>> >>>>> ___ >>>>> Dev mailing list >>>>> Dev@wso2.org >>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>> >>>>> >>>> >>>> >>>> -- >>>> >>>> Gayan Gunarathne >>>> Technical Lead, WSO2 Inc. (http://wso2.com) >>>> Committer & PMC Member, Apache Stratos >>>> email : gay...@wso2.com | mobile : +94 775030545 <%2B94%20766819985> >>>> >>>> >>>> >>>> ___ >>>> Dev mailing list >>>> Dev@wso2.org >>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>> >>>> >>> >>> >>> -- >>> Thanks and Regards, >>> >>> Isuru H. >>> +94 716 358 048* <http://wso2.com/>* >>> >>> >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> *Pubudu Gunatilaka* >> Committer and PMC Member - Apache Stratos >> Software Engineer >> WSO2, Inc.: http://wso2.com >> mobile : +94774078049 <%2B94772207163> >> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DEV][Kubernetes Artifacts] Add /etc/hosts entry using the deploy script
On Fri, Apr 22, 2016 at 10:09 AM, Chamila De Alwis wrote: > Hi, > > Just noticed that, in the README [1], we instruct the user to add a host > mapping manually to access the management console after deploying the > Service. We can do this in the deploy script itself, and cleanup in the > undeploy script. WDYT? > +1, It'll easy the process. > > [1] - > https://github.com/wso2/kubernetes-artifacts/blob/master/wso2am/README.md > > Regards, > Chamila de Alwis > Committer and PMC Member - Apache Stratos > Software Engineer | WSO2 | +94772207163 > Blog: code.chamiladealwis.com > > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [VOTE] Release WSO2 Dockerfiles 1.1.0 RC1
[x] Stable- Go ahead and release Verified the following: 1. License headers 2. Verified the following products default profile with build, run and stop scripts: - WSO2 DSS 3.5.0 - WSO2 ES 2.0.0 - WSO2 CEP 4.0.0 Thanks. On Thu, May 5, 2016 at 2:27 PM, Chamila De Alwis wrote: > *[X] Stable* - Go ahead and release > > Verified the following. > >- Packaging >- License headers >- README content >- Docker build, run, and stop process for the default profiles of the >following products > - WSO2 AM 1.10.0 > - WSO2 AS 5.3.0 > - WSO2 BPS 3.5.0 > - WSO2 BRS 2.2.0 > - WSO2 ESB 4.9.0 > - WSO2 MB 3.1.0 > - WSO2 DAS 3.0.1 > > > > Regards, > Chamila de Alwis > Committer and PMC Member - Apache Stratos > Software Engineer | WSO2 | +94772207163 > Blog: code.chamiladealwis.com > > > > On Mon, May 2, 2016 at 6:10 PM, Abhishek Tiwari < > abhishek.tiwari0...@gmail.com> wrote: > >> +1. >> >> Have tested Dockerfiles with Message Broker. >> >> - Abhishek >> >> On Mon, May 2, 2016 at 5:12 AM, Vishanth Balasubramaniam < >> vishan...@wso2.com> wrote: >> >>> Hi Devs, >>> >>> >>> This is the first release candidate (RC1) of WSO2 Dockerfiles 1.1.0 >>> release. >>> >>> Tag to be voted upon: >>> >>> https://github.com/wso2/dockerfiles/tree/v1.1.0-rc1 >>> >>> Source and distribution packages: >>> >>> https://github.com/wso2/dockerfiles/releases/tag/v1.1.0-rc1 >>> >>> Please download, test, and vote. The README file under the distribution >>> contains guide and instructions on how to try it out locally. >>> >>> [ ] Broken - Do not release (explain why) >>> >>> [ ] Stable - Go ahead and release >>> >>> This vote will be open for 72 hours or as needed. >>> >>> Regards, >>> Vishanth >>> -- >>> *Vishanth Balasubramaniam* >>> Committer & PMC Member, Apache Stratos, >>> Software Engineer, WSO2 Inc.; http://wso2.com >>> >>> mobile: *+94 77 17 377 18* >>> about me: *http://about.me/vishanth <http://about.me/vishanth>* >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [Docker][Puppet] [MB] Setting 'thriftServerHost' in WSO2 MB broker.xml file
ivate(ServiceComponent.java:260)
at
org.eclipse.equinox.internal.ds.model.ServiceComponentProp.activate(ServiceComponentProp.java:146)
at
org.eclipse.equinox.internal.ds.model.ServiceComponentProp.build(ServiceComponentProp.java:345)
at
org.eclipse.equinox.internal.ds.InstanceProcess.buildComponent(InstanceProcess.java:620)
at
org.eclipse.equinox.internal.ds.InstanceProcess.buildComponents(InstanceProcess.java:197)
at org.eclipse.equinox.internal.ds.Resolver.getEligible(Resolver.java:343)
at
org.eclipse.equinox.internal.ds.SCRManager.serviceChanged(SCRManager.java:222)
at
org.eclipse.osgi.internal.serviceregistry.FilteredServiceListener.serviceChanged(FilteredServiceListener.java:107)
at
org.eclipse.osgi.framework.internal.core.BundleContextImpl.dispatchEvent(BundleContextImpl.java:861)
at
org.eclipse.osgi.framework.eventmgr.EventManager.dispatchEvent(EventManager.java:230)
at
org.eclipse.osgi.framework.eventmgr.ListenerQueue.dispatchEventSynchronous(ListenerQueue.java:148)
at
org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEventPrivileged(ServiceRegistry.java:819)
at
org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEvent(ServiceRegistry.java:771)
at
org.eclipse.osgi.internal.serviceregistry.ServiceRegistrationImpl.register(ServiceRegistrationImpl.java:130)
at
org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.registerService(ServiceRegistry.java:214)
at
org.eclipse.osgi.framework.internal.core.BundleContextImpl.registerService(BundleContextImpl.java:433)
at
org.eclipse.osgi.framework.internal.core.BundleContextImpl.registerService(BundleContextImpl.java:451)
at
org.wso2.carbon.core.init.CarbonServerManager.initializeCarbon(CarbonServerManager.java:514)
at
org.wso2.carbon.core.init.CarbonServerManager.removePendingItem(CarbonServerManager.java:290)
at
org.wso2.carbon.core.init.PreAxis2ConfigItemListener.bundleChanged(PreAxis2ConfigItemListener.java:118)
at
org.eclipse.osgi.framework.internal.core.BundleContextImpl.dispatchEvent(BundleContextImpl.java:847)
at
org.eclipse.osgi.framework.eventmgr.EventManager.dispatchEvent(EventManager.java:230)
at
org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:340)
Caused by: org.wso2.andes.kernel.AndesException: Cannot start Thrift server
on port 7611 on host wso2mb-default
at org.wso2.andes.thrift.MBThriftServer.start(MBThriftServer.java:87)
at
org.wso2.andes.kernel.AndesKernelBoot.startThriftServer(AndesKernelBoot.java:440)
at
org.wso2.andes.kernel.AndesKernelBoot.initializeComponents(AndesKernelBoot.java:93)
at org.wso2.andes.server.Broker.startupImpl(Broker.java:293)
... 70 more
Caused by: org.apache.thrift.transport.TTransportException: Could not
create ServerSocket on address wso2mb-default/10.100.186.164:7611.
at org.apache.thrift.transport.TServerSocket.(TServerSocket.java:109)
at org.apache.thrift.transport.TServerSocket.(TServerSocket.java:91)
at org.apache.thrift.transport.TServerSocket.(TServerSocket.java:87)
at org.wso2.andes.thrift.MBThriftServer.start(MBThriftServer.java:75)
... 73 more
TID: [-1234] [] [2016-05-09 05:39:06,816] INFO
{org.wso2.andes.server.registry.ApplicationRegistry} - Shutting down
ApplicationRegistry(org.wso2.andes.server.registry.ConfigurationFileApplicationRegistry@70194966)
{org.wso2.andes.server.registry.ApplicationRegistry}
It's because currently 'thriftServerHost' is set to hostname in broker.xml
[1] and according to MB clustering guide [2] , this should be set to MB
node (docker container) IP which hosts the Thrift Server.
If it's correct, what will be the best approach to update the
'thriftServerHost' value with container IP?
Please give your suggestions.
[1].
https://github.com/wso2/puppet-modules/blob/master/modules/wso2mb/templates/3.1.0/repository/conf/broker.xml.erb#L37
[2]. https://docs.wso2.com/display/CLUSTER44x/Configuring+the+Broker+Nodes
Thanks.
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DEV][Puppet Modules] Unnecessary lookup for wso2::secure_vault_configs
Hi Chamila, On Mon, May 9, 2016 at 1:50 PM, Chamila De Alwis wrote: > Hi, > > In wso2base/manifests/init.pp [1], we do a Hiera lookup > for wso2::secure_vault_configs, without checking if SecureVault > configurations are needed. IMO we should only do this lookup if the > previous lookup for wso2::enable_secure_vault is true. > Yes, we need to do lookup for wso2::secure_vault_configs only if secure vault is enabled. Will do the needed changes. Thanks. Otherwise wso2::secure_vault_configs[key_store_password] has to be added > even if SecureVault is not enabled. > > [1] - > https://github.com/wso2/puppet-modules/blob/master/modules/wso2base/manifests/init.pp#L61-L63 > > > Regards, > Chamila de Alwis > Committer and PMC Member - Apache Stratos > Software Engineer | WSO2 | +94772207163 > Blog: code.chamiladealwis.com > > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Docker][Puppet] [MB] Setting 'thriftServerHost' in WSO2 MB broker.xml file
Hi All,
Thanks for the suggestions !!! As Isuru suggested, the best approach would
be to use an extension point to update thriftServerHost with container
ip. Will go with this approach.
Thanks.
On Mon, May 9, 2016 at 2:01 PM, Akila Ravihansa Perera
wrote:
> Hi Pumudu,
>
> We can't use "%{::ipaddress}" in kubernetes platform since Puppet is only
> used to build the Docker images. The ipaddress is assigned when the
> Kubernetes pods/services are deployed.
>
> I think best method would be to use the extension point as explained by
> Isuru. This should be similar to how we replace the localMemberHost section
> in axis2.xml.
>
> Thanks.
>
> On Mon, May 9, 2016 at 1:34 PM, Pumudu Ruhunage wrote:
>
>> Hi,
>> AFAIU, Thrift hostname should be changed to IP from puppet modules when
>> configuring hiera data[1]. Following line[2] should added to
>> default.yaml[3] to get the IP when initializing.
>>
>> [1]
>> https://github.com/wso2/puppet-modules/wiki/Creating-a-Puppet-Module-for-a-WSO2-Product#create-the-hiera-configuration-data-set
>> [2] wso2::mb_thrift_hostname : "%{::ipaddress}"
>> [3]
>> https://github.com/wso2/puppet-modules/blob/master/hieradata/dev/wso2/wso2mb/3.1.0/kubernetes/default.yaml
>>
>> Thanks,
>> Pumudu
>>
>> On Mon, May 9, 2016 at 12:08 PM, Akalanka Pagoda Arachchi <
>> darsha...@wso2.com> wrote:
>>
>>> Hi Thanuja,
>>>
>>> As you have mentioned, the MB needs the IP address instead of the host
>>> name to configure the Thrift server. So you will have to correct the thrift
>>> server connection details mentioned in "wso2mb-default/
>>> 10.100.186.164:7611".
>>>
>>> Thanks,
>>> Akalanka.
>>>
>>> On Mon, May 9, 2016 at 11:31 AM, Isuru Haththotuwa
>>> wrote:
>>>
>>>> Hi Thanuja,
>>>>
>>>> There is an extension point [1] in the startup script for Dockerfiles,
>>>> where is looks for another script with a particular name format to execute
>>>> before starting the server. You should b able to use that to do a find
>>>> replace in the broker.xml with the container IP.
>>>>
>>>> [1].
>>>> https://github.com/wso2/dockerfiles/blob/master/common/scripts/entrypoint.sh#L87
>>>>
>>>> [2]. docker---init.sh
>>>>
>>>> On Mon, May 9, 2016 at 11:15 AM, Thanuja Uruththirakodeeswaran <
>>>> thanu...@wso2.com> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> When we try to run WSO2 MB docker image build using puppet
>>>>> provisioning with clustering enabled in kubernetes, I'm getting the below
>>>>> error at the server startup:
>>>>>
>>>>> TID: [-1234] [] [2016-05-09 05:39:06,811] ERROR
>>>>> {org.wso2.andes.server.Main} - Exception during startup. Triggering
>>>>> shutdown {org.wso2.andes.server.Main}
>>>>> org.wso2.andes.kernel.AndesException: Unable to initialise application
>>>>> registry
>>>>> at org.wso2.andes.server.Broker.startupImpl(Broker.java:308)
>>>>> at org.wso2.andes.server.Broker.startup(Broker.java:110)
>>>>> at org.wso2.andes.server.Main.startBroker(Main.java:217)
>>>>> at org.wso2.andes.server.Main.execute(Main.java:206)
>>>>> at org.wso2.andes.server.Main.(Main.java:54)
>>>>> at org.wso2.andes.server.Main.main(Main.java:47)
>>>>> at
>>>>> org.wso2.carbon.andes.internal.QpidServiceComponent.startAndesBroker(QpidServiceComponent.java:391)
>>>>> at
>>>>> org.wso2.carbon.andes.internal.QpidServiceComponent.setHazelcastInstance(QpidServiceComponent.java:250)
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> at
>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>>> at
>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>>> at
>>>>> org.eclipse.equinox.internal.ds.model.ComponentReference.bind(ComponentReference.java:376)
>>>>> at
>>>>> org.eclipse.equinox.internal.ds.model.ServiceComponentProp.bindReference(ServiceComponentProp.java:430)
>>>>> at
>>>>> org.eclipse.equinox.internal.ds.InstanceProcess.dynamicBind(InstanceProcess.java:416)
>>>>> at
>>&g
Re: [Dev] [Docker][Puppet] [MB] Setting 'thriftServerHost' in WSO2 MB broker.xml file
Hi All,
I have added the custom extension to wso2mb puppet module through
'system_file_list' method.
Like we used file_list to copy files to wso2 carbon home, we can copy files
which are added */files/system* to system using *system_file_list
*as below:
wso2::system_file_list:
-
file:
target_path:
I used the above approach to fix the MB thrift server issue. Added
wso2mb-default-init.sh extension script to wso2mb/files/system and copied
to /usr/local/bin path using system_file_list as below:
wso2::system_file_list:
-
file: wso2mb-default-init.sh
target_path: /usr/local/bin
Thanks.
On Mon, May 9, 2016 at 2:07 PM, Thanuja Uruththirakodeeswaran <
thanu...@wso2.com> wrote:
> Hi All,
>
> Thanks for the suggestions !!! As Isuru suggested, the best approach would
> be to use an extension point to update thriftServerHost with container
> ip. Will go with this approach.
>
> Thanks.
>
> On Mon, May 9, 2016 at 2:01 PM, Akila Ravihansa Perera > wrote:
>
>> Hi Pumudu,
>>
>> We can't use "%{::ipaddress}" in kubernetes platform since Puppet is
>> only used to build the Docker images. The ipaddress is assigned when the
>> Kubernetes pods/services are deployed.
>>
>> I think best method would be to use the extension point as explained by
>> Isuru. This should be similar to how we replace the localMemberHost section
>> in axis2.xml.
>>
>> Thanks.
>>
>> On Mon, May 9, 2016 at 1:34 PM, Pumudu Ruhunage wrote:
>>
>>> Hi,
>>> AFAIU, Thrift hostname should be changed to IP from puppet modules when
>>> configuring hiera data[1]. Following line[2] should added to
>>> default.yaml[3] to get the IP when initializing.
>>>
>>> [1]
>>> https://github.com/wso2/puppet-modules/wiki/Creating-a-Puppet-Module-for-a-WSO2-Product#create-the-hiera-configuration-data-set
>>> [2] wso2::mb_thrift_hostname : "%{::ipaddress}"
>>> [3]
>>> https://github.com/wso2/puppet-modules/blob/master/hieradata/dev/wso2/wso2mb/3.1.0/kubernetes/default.yaml
>>>
>>> Thanks,
>>> Pumudu
>>>
>>> On Mon, May 9, 2016 at 12:08 PM, Akalanka Pagoda Arachchi <
>>> darsha...@wso2.com> wrote:
>>>
>>>> Hi Thanuja,
>>>>
>>>> As you have mentioned, the MB needs the IP address instead of the host
>>>> name to configure the Thrift server. So you will have to correct the thrift
>>>> server connection details mentioned in "wso2mb-default/
>>>> 10.100.186.164:7611".
>>>>
>>>> Thanks,
>>>> Akalanka.
>>>>
>>>> On Mon, May 9, 2016 at 11:31 AM, Isuru Haththotuwa
>>>> wrote:
>>>>
>>>>> Hi Thanuja,
>>>>>
>>>>> There is an extension point [1] in the startup script for Dockerfiles,
>>>>> where is looks for another script with a particular name format to execute
>>>>> before starting the server. You should b able to use that to do a find
>>>>> replace in the broker.xml with the container IP.
>>>>>
>>>>> [1].
>>>>> https://github.com/wso2/dockerfiles/blob/master/common/scripts/entrypoint.sh#L87
>>>>>
>>>>> [2]. docker---init.sh
>>>>>
>>>>> On Mon, May 9, 2016 at 11:15 AM, Thanuja Uruththirakodeeswaran <
>>>>> thanu...@wso2.com> wrote:
>>>>>
>>>>>> Hi All,
>>>>>>
>>>>>> When we try to run WSO2 MB docker image build using puppet
>>>>>> provisioning with clustering enabled in kubernetes, I'm getting the below
>>>>>> error at the server startup:
>>>>>>
>>>>>> TID: [-1234] [] [2016-05-09 05:39:06,811] ERROR
>>>>>> {org.wso2.andes.server.Main} - Exception during startup. Triggering
>>>>>> shutdown {org.wso2.andes.server.Main}
>>>>>> org.wso2.andes.kernel.AndesException: Unable to initialise
>>>>>> application registry
>>>>>> at org.wso2.andes.server.Broker.startupImpl(Broker.java:308)
>>>>>> at org.wso2.andes.server.Broker.startup(Broker.java:110)
>>>>>> at org.wso2.andes.server.Main.startBroker(Main.java:217)
>>>>>> at org.wso2.andes.server.Main.execute(Main.java:206)
>>>>>> at org.wso2.andes.server.Main.(Main.java:54)
>>>>>> at org.wso2.andes.server.Main.main(Main.java:47)
>>>>>> at
>>>>>> org.wso2.carb
Re: [Dev] DAS 3.0.1 - Empty Dashboard for Smart Home Sample
Hi Gobinath, I tried the same sample and can see the data in dashboards. But you have to wait until smart_home_script spark script is get executed after you ran the sample java client to publish the data to see the data in dashboard. Because the spark script used for this sample (smart_home_script) is scheduled to run every 3 minutes to copy data received to corresponding gadgets' datasources. Thanks. On Fri, May 13, 2016 at 9:25 AM, Gobinath Loganathan wrote: > Hi team, > The Dashboard of DAS does not generate graphical charts for smart home > application sample as expected in QuickStartGuide > <https://docs.wso2.com/display/DAS301/Quick+Start+Guide#QuickStartGuide-DeployingthesampleC-App> > (Screenshot > is attached). However, the "Data Explorer" shows the data as expected. I > face the same problem in both Chrome and Firefox. > > Could anyone suggest a solution for this? > > > Thanks. > > -- > *Gobinath **Loganathan* > Software Engineer, WSO2 Inc. http://wso2.com > > Email : gobin...@wso2.com > Mobile : (+94) 770 780 210 > Blog: javahelps.com <http://www.javahelps.com/> > > > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] DAS 3.0.1 - Empty Dashboard for Smart Home Sample
Hi Gobinath, But if the corresponding gadget datasources don't have data, It will show 'Data is not available for plotting' messgae in gadgets. I've checked this with chrome version 49.0.2623.87. But in your case, gadget is totally empty. This might be due to some other problems. Thanks. On Fri, May 13, 2016 at 9:57 AM, Thanuja Uruththirakodeeswaran < thanu...@wso2.com> wrote: > Hi Gobinath, > > I tried the same sample and can see the data in dashboards. But you have > to wait until smart_home_script spark script is get executed after you ran > the sample java client to publish the data to see the data in dashboard. > Because the spark script used for this sample (smart_home_script) is > scheduled to run every 3 minutes to copy data received to corresponding > gadgets' datasources. > > Thanks. > > On Fri, May 13, 2016 at 9:25 AM, Gobinath Loganathan > wrote: > >> Hi team, >> The Dashboard of DAS does not generate graphical charts for smart home >> application sample as expected in QuickStartGuide >> <https://docs.wso2.com/display/DAS301/Quick+Start+Guide#QuickStartGuide-DeployingthesampleC-App> >> (Screenshot >> is attached). However, the "Data Explorer" shows the data as expected. I >> face the same problem in both Chrome and Firefox. >> >> Could anyone suggest a solution for this? >> >> >> Thanks. >> >> -- >> *Gobinath **Loganathan* >> Software Engineer, WSO2 Inc. http://wso2.com >> >> Email : gobin...@wso2.com >> Mobile : (+94) 770 780 210 >> Blog: javahelps.com <http://www.javahelps.com/> >> >> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > Thanuja Uruththirakodeeswaran > Software Engineer > WSO2 Inc.;http://wso2.com > lean.enterprise.middleware > > mobile: +94 774363167 > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [VOTE] Release WSO2 Kubernetes Artifacts 1.0.0
[x] - Go ahead and release Verified the following: 1. License headers 2. Tested distributed deployment in Kubernetes 1.2.0 with docker images built using puppet provisioning: - WSO2 AS 5.3.0 - WSO2 DSS 3.5.0 - WSO2 ES 2.0.0 - WSO2 BPS 3.5.0 - WSO2 ESB 4.9.0 Thanks. On Fri, May 13, 2016 at 3:23 PM, Chamila De Alwis wrote: > *[X] Stable* - go ahead and release > > Verified the following. > > >1. README content >2. License headers >3. Packaging >4. Tested distributed deployment using Puppet provisioned Docker >images of the following products > 1. WSO2 MB > 2. WSO2 IS > 3. WSO2 GREG > 4. WSO2 BRS > 5. WSO2 ESB > 6. WSO2 DAS > 7. WSO2 DSS > 8. WSO2 AS > > > > > Regards, > Chamila de Alwis > Committer and PMC Member - Apache Stratos > Software Engineer | WSO2 | +94772207163 > Blog: code.chamiladealwis.com > > > > On Thu, May 12, 2016 at 6:17 PM, Imesh Gunaratne wrote: > >> +1 for the release, I verified following and did not see any problems: >> >>- README.md files >>- K8S membership scheme and clustering >>- Built product profile docker images using Puppet provisioning >>- Distributed deployments of following on K8S 1.2: >> - Application Server 5.3.0 >> - API Manager 1.10.0 >> - Enterprise Service Bus 4.9.0 >> - Business Process Server 3.5.0 >> - Business Rules Server 2.2.0 >> - Data Services Server 3.5.0 >> - Enterprise Store 2.0.0 >> - Governance Registry 5.1.0 >> - Data Analytics Server 3.0.1 >> - Complex Event Processor 4.0.0 >> >> Thanks >> >> >> On Wed, May 11, 2016 at 10:57 AM, Isuru Haththotuwa >> wrote: >> >>> This is the first release candidate (RC1) of WSO2 Kubernetes Artifacts >>> 1.0.0. >>> >>> Please download, test and vote. Please refer the README files under each >>> product for details on testing the artifacts. >>> >>> Source & binary distribution files: >>> https://github.com/wso2/kubernetes-artifacts/releases/tag/v1.0.0 >>> >>> Maven staging repo: >>> >>> https://maven.wso2.org/nexus/content/repositories/orgwso2carbonkubernetesartifacts-1001/ >>> >>> The tag to be voted upon: >>> https://github.com/wso2/kubernetes-artifacts/tree/v1.0.0 >>> >>> >>> [ ] Broken - do not release (explain why) >>> >>> [ ] Stable - go ahead and release >>> >>> -- >>> Thanks and Regards, >>> >>> Isuru H. >>> +94 716 358 048* <http://wso2.com/>* >>> >>> >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> *Imesh Gunaratne* >> Senior Technical Lead >> WSO2 Inc: http://wso2.com >> T: +94 11 214 5345 M: +94 77 374 2057 >> W: http://imesh.io TW: @imesh >> Lean . Enterprise . Middleware >> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DEV][Vote] Release WSO2 Puppet Modules 2.0.0
[x] Stable - Go ahead and release Verified the following: 1. License header 2. Packaging 3. Tested below wso2 products default and distributed deployments in default and kubernetes 1.2.0 platform and verified the basic functionalities: - WSO2 BPS 3.5.0 - WSO2 ES 2.0.0 - WSO2 GREG 5.1.0 Thanks. On Mon, May 23, 2016 at 9:14 PM, Imesh Gunaratne wrote: > +1 for the release, I verified following: > >- README files >- Distributed deployments of following products on K8S using Docker >images built using Puppet: > > >- Application Server 5.3.0 > - API Manager 1.10.0 > - Enterprise Service Bus 4.9.0 > - Business Process Server 3.5.0 > - Business Rules Server 2.2.0 > - Data Services Server 3.5.0 > - Enterprise Store 2.0.0 > - Governance Registry 5.1.0 > - Data Analytics Server 3.0.1 > - Complex Event Processor 4.0.0 > > Thanks > > On Wed, May 18, 2016 at 10:24 PM, Chamila De Alwis > wrote: > >> Hi, >> >> >> This is the first release candidate (RC1) for WSO2 Puppet Modules 2.0.0. >> Please download, verify, and vote. Voting will be open for 72 hours. >> >> [ ] Broken - Do not release (explain why) >> >> [ ] Stable - Go ahead and release >> >> Main features and fixes released with this release: >> >>- >> >>Updated Hiera data hierarchy to include deployment Platform >>- >> >>Kubernetes based workflow supported, based on >>wso2/kubernetes-artifacts >>- >> >>system_file_list to copy files with scope outside of CARBON_HOME >>- >> >>Platform specific configuration data sets for Kubernetes >>- >> >> Kubernetes deployment-ready Puppet modules >> - >> >> Data sources matching a distributed set of Kubernetes MySQL >> Services >> - >> >>Streamlined Default platform YAML configuration data >>- >> >>Optional update flags to control product pack and JDK cleanup >>- >> >>Minor fixes on the Hiera data >>- >> >> Issues in YAML file formatting >> - >> >> Puppet templates for identity.xml added to relevant products >> - >> >> Proxy Port values assigned to different products are streamlined >> - >> >> Hostname entries streamlined in default deployment platform data >> set >> - >> >> Pass Through Port Mapping for WSO2 ESB >> - >> >> Fixing Thrift Server IP configuration for WSO2 MB >> - >> >> SecureVault parameters made optional >> - >> >> Reusing Data Source related fields in YAML by inheriting from >> wso2/common.yaml >> - >> >> Fix Symbolic Link creation in WSO2 DAS >> - >> >> Fixed installation directory creation failure when parent >> directory doesn’t exist >> - >> >> Removed use of Kubernetes Master details in Clustering templates >> - >> >> Streamlined use of hiera, hiera_array, and hiera_hash lookup >> - >> >>WSO2 API Manager Gateway Manager-Worker separate profiles in Hieradata >>- >> >>WSO2 PPaaS Puppet module and Hiera data removed >>- >> >>Deprecated older product versions >>- >> >> WSO2 AM 1.9.1 >> - >> >> WSO2 BRS 2.1.0 >> - >> >> WSO2 GREG 4.6.0 >> - >> >> WSO2 IS 5.0.0 >> - >> >> WSO2 MB 3.0.0 >> - >> >>Improve Puppet Vagrant setup to use PUPPET_HOME environment variable >>- >> >>Included sample config.yaml files in the Puppet Vagrant setup to >>quickly test standalone and distributed deployments >>- >> >>Fixed Java System Prefs location issue >>- >> >>Included YAML Style Guide for Hiera data files >> >> >> >> This release is based on the following tag: >> >> https://github.com/wso2/puppet-modules/releases/tag/v2.0.0-rc1 >> >> Release verification guide can be found at: >> >> https://docs.wso2.com/display/PM200/Setting+up+the+Development+Environment >> >> Source and distribution packages can be downloaded at: >> >> https://github.com/wso2/puppet-modules/releases/tag/v2.0.0-rc1 >> >> >> Regards, >> Chamila de Alwis >> Committer and PMC Member - Apache Stratos >> Software Engineer | WSO2 | +94772207163 >> Blog: code.chamiladealwis.com >> >> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > *Imesh Gunaratne* > Senior Technical Lead > WSO2 Inc: http://wso2.com > T: +94 11 214 5345 M: +94 77 374 2057 > W: http://imesh.io TW: @imesh > Lean . Enterprise . Middleware > > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [DEV] [CEP] MySQL table storage engine and character set used with Output Mysql Event Adaptor
Hi , Do we need to set the MySQL *storage engine* as '*MyISAM*' and *character set *to* utf8* for the tables created by the CEP Output MySQL Event Adaptors? I'm using CEP 3.0.0/3.1.0 with MySQL server version *5.6.30*. If I don't set those, by default storage engine is set to *InnoDB* and character set is set to *latin1 *and events are not persisted in the table. Once I change those as said above, events are persisted in the table. Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DEV] [CEP] MySQL table storage engine and character set used with Output Mysql Event Adaptor
Hi , On Fri, May 27, 2016 at 1:11 AM, Lasantha Fernando wrote: > Hi Thanuja, > > Were you able to resolve the issue after changing the charset and engine? > Also can you specify the MySQL connector version that you were using? > Yes, It worked with MyISAM and utf-8. Connector version is *5.1.36.* > > @Mohan, we did a debug session and what we could observe was that the > encoding was set to windows-1252 as I remember. The main issue here was > that there is a logic in MySQL adapter to retrieve the data type of each > column and we map these types to our databridge data types. However, all > non-string data types were returning the value -1, instead of assigned data > type number for BIGINT, INT etc. We were thinking since it was returning > different or incorrect values, this was due to charset mismatch or engine > mismatch. > When we were debugging last time, I've pointed the adapter to already created table which mapped 'long' type stream attribute to 'text' column type. Also stream attributes with 'string' type also mapped to 'text' column type in table. Once I drop the table and let the adpator creates it, table columns are set to BIGINT and VARCHAR type. Now I'm not getting the NPE. But data is not inserted to table. > > Relevant code is under initializeTableInfo() in [1] > > [1] > https://svn.wso2.org/repos/wso2/carbon/platform/branches/turing/components/event-stream/event-output-adaptor/org.wso2.carbon.event.output.adaptor.mysql/1.0.1/src/main/java/org/wso2/carbon/event/output/adaptor/mysql/MysqlEventAdaptorType.java > > Thanks, > Lasantha > > On 27 May 2016 at 00:38, Mohanadarshan Vivekanandalingam > wrote: > >> >> >> On Fri, May 27, 2016 at 12:17 AM, Thanuja Uruththirakodeeswaran < >> thanu...@wso2.com> wrote: >> >>> Hi , >>> >>> Do we need to set the MySQL *storage engine* as '*MyISAM*' and *character >>> set *to* utf8* for the tables created by the CEP Output MySQL Event >>> Adaptors? >>> >>> I'm using CEP 3.0.0/3.1.0 with MySQL server version *5.6.30*. If I >>> don't set those, by default storage engine is set to *InnoDB* and >>> character set is set to *latin1 *and events are not persisted in the >>> table. Once I change those as said above, events are persisted in the table. >>> >>> >> No, it is not a requirement.. >> >> I am using MySQL server version 5.6.28.. Tried with InnoDB engine and >> latin1 charset and it is working fine.. Have you checked data format that >> you tried to insert ? >> > Mohan >> >> >> >>> Thanks. >>> >>> -- >>> Thanuja Uruththirakodeeswaran >>> Software Engineer >>> WSO2 Inc.;http://wso2.com >>> lean.enterprise.middleware >>> >>> mobile: +94 774363167 >>> >> >> >> >> -- >> *V. Mohanadarshan* >> *Senior Software Engineer,* >> *Data Technologies Team,* >> *WSO2, Inc. http://wso2.com <http://wso2.com> * >> *lean.enterprise.middleware.* >> >> email: mo...@wso2.com >> phone:(+94) 771117673 >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > *Lasantha Fernando* > Senior Software Engineer - Data Technologies Team > WSO2 Inc. http://wso2.com > > email: lasan...@wso2.com > mobile: (+94) 71 5247551 > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Mesos] Let's use Marathon CLI for deploying artifacts
On Mon, Jun 20, 2016 at 8:54 PM, Akila Ravihansa Perera wrote: > Hi, > > Shall we do $subject? Marathon CLI is available for Windows, OS X, Linux > [1]. It supports operations that we need provided via REST API. Main > advantage is it handles authentication if the REST API is secured. Also it > simplifies the bash scripts that we need to develop to deploy services. > +1 > > [1] https://docs.mesosphere.com/1.7/usage/cli/install/ > [2] https://docs.mesosphere.com/1.7/usage/cli/command-reference/ > > Thanks. > > -- > Akila Ravihansa Perera > WSO2 Inc.; http://wso2.com/ > > Blog: http://ravihansa3000.blogspot.com > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [DAS] Pagination problem when fetching data to dashboard gadget (JIRA ISSUE - BAM-2114)
Hi, I created a jira issue[1] for the $subject and now it's marked as resolved. So I got the latest source form git repository, built it and ran it. But I think the problem still exists when I'm creating a gadget using processed store data-source. Once I select table and click on "preview", it shows only 10 records. I checked the commit and *main.js* file has been modified, which can be found at "wso2das-3.0.0-SNAPSHOT/repository/deployment/server/jaggeryapps/portal/templates/gadgets/igviz/js/". But I debugged the page using browser's javascript tool. Actually when I hit "preview" button, *wizard.js* is executed (wso2das-3.0.0-SNAPSHOT/repository/deployment/server/jaggeryapps/portal/js/). If we do the same changes that are in main.js to wizard.js, then it's working fine and all records in table are listed. @Dunith Can you please check what I've said is correct. [1]. https://wso2.org/jira/browse/BAM-2114 Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Pagination problem when fetching data to dashboard gadget (JIRA ISSUE - BAM-2114)
Hi Dunith, Thanks for the clarification. Yes now I can get all records once a gadget is created. Thanks On Wed, Aug 12, 2015 at 6:18 PM, Dunith Dhanushka wrote: > Hi Thanuja, > > When you hit Preview button, it only loads the last 10 records. It wont > show all available data in the table since it will be an expensive task. > But once you create a gadget, it'll fetch all the records available in that > table. > > Regards, > Dunith > > On Wed, Aug 12, 2015 at 6:45 AM, Maninda Edirisooriya > wrote: > >> Will look at it. >> >> >> *Maninda Edirisooriya* >> Senior Software Engineer >> >> *WSO2, Inc.*lean.enterprise.middleware. >> >> *Blog* : http://maninda.blogspot.com/ >> *E-mail* : mani...@wso2.com >> *Skype* : @manindae >> *Twitter* : @maninda >> >> On Wed, Aug 12, 2015 at 5:06 PM, Anjana Fernando wrote: >> >>> Hi, >>> >>> @Maninda, please check on this. >>> >>> Cheers, >>> Anjana. >>> >>> On Wed, Aug 12, 2015 at 4:58 PM, Thanuja Uruththirakodeeswaran < >>> thanu...@wso2.com> wrote: >>> >>>> Hi, >>>> >>>> I created a jira issue[1] for the $subject and now it's marked as >>>> resolved. So I got the latest source form git repository, built it and ran >>>> it. But I think the problem still exists when I'm creating a gadget using >>>> processed store data-source. Once I select table and click on "preview", it >>>> shows only 10 records. >>>> >>>> I checked the commit and *main.js* file has been modified, which can >>>> be found at >>>> "wso2das-3.0.0-SNAPSHOT/repository/deployment/server/jaggeryapps/portal/templates/gadgets/igviz/js/". >>>> >>>> But I debugged the page using browser's javascript tool. Actually when >>>> I hit "preview" button, *wizard.js* is executed >>>> (wso2das-3.0.0-SNAPSHOT/repository/deployment/server/jaggeryapps/portal/js/). >>>> If we do the same changes that are in main.js to wizard.js, then it's >>>> working fine and all records in table are listed. >>>> >>>> @Dunith Can you please check what I've said is correct. >>>> >>>> [1]. https://wso2.org/jira/browse/BAM-2114 >>>> >>>> Thanks. >>>> >>>> -- >>>> Thanuja Uruththirakodeeswaran >>>> Software Engineer >>>> WSO2 Inc.;http://wso2.com >>>> lean.enterprise.middleware >>>> >>>> mobile: +94 774363167 >>>> >>> >>> >>> >>> -- >>> *Anjana Fernando* >>> Senior Technical Lead >>> WSO2 Inc. | http://wso2.com >>> lean . enterprise . middleware >>> >> >> > > > -- > Regards, > > Dunith Dhanushka, > Senior Software Engineer > WSO2 Inc, > > Mobile - +94 71 8615744 > Blog - dunithd.wordpress.com <http://blog.dunith.com> > Twitter - @dunithd <http://twitter.com/dunithd> > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [DAS] DAS dashboard table-gadget column order
Hi, I've persisted a event stream in event store which is a HBase database. Then using the following query I created table in spark environment. Also I used H2 database as processed store. CREATE TEMPORARY TABLE memberinfo USING CarbonAnalytics OPTIONS (tableName "MEMBER_INFO"); CREATE TEMPORARY TABLE memberdetails USING CarbonAnalytics OPTIONS (tableName "MEMBER_DETAILS", schema "X STRING, Y STRING, Z STRING"); INSERT OVERWRITE TABLE memberdetails select * from memberinfo; Here MEMBER_INFO - HBase database table, MEMBER_DETAILS - H2 database table When I use the Data Explorer to see records in table "MEMBER_DETAILS", column order as specified in schema. But when I created a table gadget using the same table and added to dashboard, column order is not as in schema. But I think columns are in the order as in HBase database table. What I have to do to get the columns as in schema order? Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] DAS dashboard table-gadget column order
Hi Gimantha, I used external HBase DB and DAS embedded H2 DB. I checked with HBase table and table-gadget column order same as HBase table. I tried with H2 table, but I couldn't see column names as I think it was encrypted or something. How can I check the column names in DAS embedded H2 database? Thanks. On Fri, Aug 14, 2015 at 1:28 PM, Gimantha Bandara wrote: > Hi Thanuja, > Is it same with the H2 table or only the HBase analytics table? > > > On Thu, Aug 13, 2015 at 6:50 PM, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi, >> >> I've persisted a event stream in event store which is a HBase database. >> Then using the following query I created table in spark environment. Also I >> used H2 database as processed store. >> >> CREATE TEMPORARY TABLE memberinfo >> USING CarbonAnalytics >> OPTIONS (tableName "MEMBER_INFO"); >> >> CREATE TEMPORARY TABLE memberdetails >> USING CarbonAnalytics >> OPTIONS (tableName "MEMBER_DETAILS", schema "X STRING, Y STRING, Z >> STRING"); >> >> INSERT OVERWRITE TABLE memberdetails select * from memberinfo; >> >> Here MEMBER_INFO - HBase database table, MEMBER_DETAILS - H2 database >> table >> >> When I use the Data Explorer to see records in table "MEMBER_DETAILS", >> column order as specified in schema. But when I created a table gadget >> using the same table and added to dashboard, column order is not as in >> schema. But I think columns are in the order as in HBase database table. >> >> What I have to do to get the columns as in schema order? >> >> Thanks. >> >> -- >> Thanuja Uruththirakodeeswaran >> Software Engineer >> WSO2 Inc.;http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 774363167 >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > Gimantha Bandara > Software Engineer > WSO2. Inc : http://wso2.com > Mobile : +94714961919 > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] DAS dashboard table-gadget column order
Hi Gimantha, Yes gadget table columns are not in the order as in schema. Data explorer has same column order as in schema. Thanks. On 14 Aug 2015 18:18, "Gimantha Bandara" wrote: > Columns you define in the schema, does not map to RDBMS physical > tables' columns. Are you saying that the gadget tables that you > create, do not have the column order as it is in the schema? Is it in > the same order in the Data explorer? > > On 8/14/15, Thanuja Uruththirakodeeswaran wrote: > > Hi Gimantha, > > > > I used external HBase DB and DAS embedded H2 DB. I checked with HBase > table > > and table-gadget column order same as HBase table. I tried with H2 table, > > but I couldn't see column names as I think it was encrypted or something. > > How can I check the column names in DAS embedded H2 database? > > > > Thanks. > > > > On Fri, Aug 14, 2015 at 1:28 PM, Gimantha Bandara > > wrote: > > > >> Hi Thanuja, > >> Is it same with the H2 table or only the HBase analytics table? > >> > >> > >> On Thu, Aug 13, 2015 at 6:50 PM, Thanuja Uruththirakodeeswaran < > >> thanu...@wso2.com> wrote: > >> > >>> Hi, > >>> > >>> I've persisted a event stream in event store which is a HBase database. > >>> Then using the following query I created table in spark environment. > Also > >>> I > >>> used H2 database as processed store. > >>> > >>> CREATE TEMPORARY TABLE memberinfo > >>> USING CarbonAnalytics > >>> OPTIONS (tableName "MEMBER_INFO"); > >>> > >>> CREATE TEMPORARY TABLE memberdetails > >>> USING CarbonAnalytics > >>> OPTIONS (tableName "MEMBER_DETAILS", schema "X STRING, Y STRING, Z > >>> STRING"); > >>> > >>> INSERT OVERWRITE TABLE memberdetails select * from memberinfo; > >>> > >>> Here MEMBER_INFO - HBase database table, MEMBER_DETAILS - H2 database > >>> table > >>> > >>> When I use the Data Explorer to see records in table "MEMBER_DETAILS", > >>> column order as specified in schema. But when I created a table gadget > >>> using the same table and added to dashboard, column order is not as in > >>> schema. But I think columns are in the order as in HBase database > table. > >>> > >>> What I have to do to get the columns as in schema order? > >>> > >>> Thanks. > >>> > >>> -- > >>> Thanuja Uruththirakodeeswaran > >>> Software Engineer > >>> WSO2 Inc.;http://wso2.com > >>> lean.enterprise.middleware > >>> > >>> mobile: +94 774363167 > >>> > >>> ___ > >>> Dev mailing list > >>> Dev@wso2.org > >>> http://wso2.org/cgi-bin/mailman/listinfo/dev > >>> > >>> > >> > >> > >> -- > >> Gimantha Bandara > >> Software Engineer > >> WSO2. Inc : http://wso2.com > >> Mobile : +94714961919 > >> > > > > > > > > -- > > Thanuja Uruththirakodeeswaran > > Software Engineer > > WSO2 Inc.;http://wso2.com > > lean.enterprise.middleware > > > > mobile: +94 774363167 > > > > > -- > Gimantha Bandara > Software Engineer > WSO2. Inc : http://wso2.com > Mobile : +94714961919 > ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [DAS] Scheduling Spark Script in CApp using Spark Script Configuration File
Hi, I've followed the link [1] and referred sample "Httpd_Log_Analytics" [2] for creating a car file and deploy that in DAS. Here if we want to use the spark script, we can use a file as in [3]. But if the spark script need to be executed for every minute, how we can add the Cron expression in the script configuration xml? [1]. https://docs.wso2.com/display/DAS300/Carbon+Application+Deployment+for+DAS [2]. https://github.com/wso2/product-bam/tree/master/modules/samples/capps/Httpd_Log_Analytics [3]. https://github.com/wso2/product-bam/blob/master/modules/samples/capps/Httpd_Log_Analytics/Sparkscripts_1.0.0/httpd_log_analytics.xml Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Scheduling Spark Script in CApp using Spark Script Configuration File
Hi Sinthuja,
Thanks. It's working. I deployed the Httpd_Log_Analytics" sample after
uncomment the line in its artifacts.xml [1] file. It gives following
message in server console. What's the reason for this?
[2015-08-17 17:20:35,193] INFO
{org.wso2.carbon.application.deployer.internal.ApplicationManager} -
Deploying Carbon Application : Httpd_Log_Analytics.car...
[2015-08-17 17:20:35,215] ERROR
{org.wso2.carbon.application.deployer.internal.ApplicationManager} - Some
dependencies in cApp : Httpd_Log_Analytics_1.0.0 were not satisfied. Check
whether all dependent artifacts are included in cApp file :
/home/thanujau/Documents/Project/wso2das-3.0.0-SNAPSHOT/repository/deployment/server/carbonapps/Httpd_Log_Analytics.car
And if we create a dashboard in DAS, where can we find dashboard json file?
[1].
https://github.com/wso2/product-bam/blob/master/modules/samples/capps/Httpd_Log_Analytics/artifacts.xml
Thanks.
On Mon, Aug 17, 2015 at 4:21 PM, Sinthuja Ragendran
wrote:
> Hi Thanuja,
>
> You can set the cron expression with CronExpression element in the spark
> script artifact xml as shown below.
>
>
>
> AddNewScriptTestWithouTask
> define table TEST_CAPP (server_name string, ip STRING, tenant
> INTEGER, sequence LONG, summary STRING);SELECT ip FROM TEST_CAPP;SELECT
> server_name, count(*) FROM TEST_CAPP GROUP BY server_name;
> 0 * * * * ?
>
>
> Thanks,
> Sinthuja.
>
> On Mon, Aug 17, 2015 at 4:15 PM, Thanuja Uruththirakodeeswaran <
> thanu...@wso2.com> wrote:
>
>> Hi,
>>
>> I've followed the link [1] and referred sample "Httpd_Log_Analytics" [2]
>> for creating a car file and deploy that in DAS. Here if we want to use the
>> spark script, we can use a file as in [3].
>>
>> But if the spark script need to be executed for every minute, how we can
>> add the Cron expression in the script configuration xml?
>>
>> [1].
>> https://docs.wso2.com/display/DAS300/Carbon+Application+Deployment+for+DAS
>> [2].
>> https://github.com/wso2/product-bam/tree/master/modules/samples/capps/Httpd_Log_Analytics
>> [3].
>> https://github.com/wso2/product-bam/blob/master/modules/samples/capps/Httpd_Log_Analytics/Sparkscripts_1.0.0/httpd_log_analytics.xml
>>
>> Thanks.
>>
>> --
>> Thanuja Uruththirakodeeswaran
>> Software Engineer
>> WSO2 Inc.;http://wso2.com
>> lean.enterprise.middleware
>>
>> mobile: +94 774363167
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> *Sinthuja Rajendran*
> Associate Technical Lead
> WSO2, Inc.:http://wso2.com
>
> Blog: http://sinthu-rajan.blogspot.com/
> Mobile: +94774273955
>
>
>
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [DAS] Using Spark UDF in DAS
Hi Devs, I've used a UDF in spark query in DAS by following the below steps: 1. Create a jar file for spark UDF implementation and add it DAS_HOME/repository/components/lib. 2. Add the UDF class to *spark-udf-config.xml* which is in DAS_HOME/repository/conf. After that I tried the UDF in spark console and it worked fine. But now I got the latest changes and built a new pack. There same UDF doesn't work. I can see a new file called *add-to-spark-classpath.xml.* Do I need to any extra configuration for latest pack? Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Using Spark UDF in DAS
Hi Niranda, Sorry for the mess. I checked the UDF in spark console and got *key not found*. I've checked it again. It works fine. Thanks. On Mon, Aug 24, 2015 at 10:06 AM, Niranda Perera wrote: > Hi Thanuja, > > add-to-spark-classpath.xml is not related to UDFs. it is a configuration > file, which can be used to add jars to the spark classpath. but when you > put a jar into repository/components/lib, it will be added to the spark > classpath by default. so, there is no additional configs you have to do. > > what are the errors/ exceptions thrown when you call UDFs? > > > On Mon, Aug 24, 2015 at 9:59 AM, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi Devs, >> >> I've used a UDF in spark query in DAS by following the below steps: >> >> 1. Create a jar file for spark UDF implementation and add it >> DAS_HOME/repository/components/lib. >> 2. Add the UDF class to *spark-udf-config.xml* which is in >> DAS_HOME/repository/conf. >> >> After that I tried the UDF in spark console and it worked fine. But now I >> got the latest changes and built a new pack. There same UDF doesn't work. I >> can see a new file called *add-to-spark-classpath.xml.* >> Do I need to any extra configuration for latest pack? >> >> Thanks. >> >> -- >> Thanuja Uruththirakodeeswaran >> Software Engineer >> WSO2 Inc.;http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 774363167 >> > > > > -- > *Niranda Perera* > Software Engineer, WSO2 Inc. > Mobile: +94-71-554-8430 > Twitter: @n1r44 <https://twitter.com/N1R44> > https://pythagoreanscript.wordpress.com/ > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] DAS dashboard table-gadget column order
Hi Gimantha, Is there any solution to get Table Gadget column order as Data Explorer Table column order? Thanks. On Fri, Aug 14, 2015 at 8:20 PM, Thanuja Uruththirakodeeswaran < thanu...@wso2.com> wrote: > Hi Gimantha, > > Yes gadget table columns are not in the order as in schema. Data explorer > has same column order as in schema. > > Thanks. > On 14 Aug 2015 18:18, "Gimantha Bandara" wrote: > >> Columns you define in the schema, does not map to RDBMS physical >> tables' columns. Are you saying that the gadget tables that you >> create, do not have the column order as it is in the schema? Is it in >> the same order in the Data explorer? >> >> On 8/14/15, Thanuja Uruththirakodeeswaran wrote: >> > Hi Gimantha, >> > >> > I used external HBase DB and DAS embedded H2 DB. I checked with HBase >> table >> > and table-gadget column order same as HBase table. I tried with H2 >> table, >> > but I couldn't see column names as I think it was encrypted or >> something. >> > How can I check the column names in DAS embedded H2 database? >> > >> > Thanks. >> > >> > On Fri, Aug 14, 2015 at 1:28 PM, Gimantha Bandara >> > wrote: >> > >> >> Hi Thanuja, >> >> Is it same with the H2 table or only the HBase analytics table? >> >> >> >> >> >> On Thu, Aug 13, 2015 at 6:50 PM, Thanuja Uruththirakodeeswaran < >> >> thanu...@wso2.com> wrote: >> >> >> >>> Hi, >> >>> >> >>> I've persisted a event stream in event store which is a HBase >> database. >> >>> Then using the following query I created table in spark environment. >> Also >> >>> I >> >>> used H2 database as processed store. >> >>> >> >>> CREATE TEMPORARY TABLE memberinfo >> >>> USING CarbonAnalytics >> >>> OPTIONS (tableName "MEMBER_INFO"); >> >>> >> >>> CREATE TEMPORARY TABLE memberdetails >> >>> USING CarbonAnalytics >> >>> OPTIONS (tableName "MEMBER_DETAILS", schema "X STRING, Y STRING, Z >> >>> STRING"); >> >>> >> >>> INSERT OVERWRITE TABLE memberdetails select * from memberinfo; >> >>> >> >>> Here MEMBER_INFO - HBase database table, MEMBER_DETAILS - H2 database >> >>> table >> >>> >> >>> When I use the Data Explorer to see records in table "MEMBER_DETAILS", >> >>> column order as specified in schema. But when I created a table gadget >> >>> using the same table and added to dashboard, column order is not as in >> >>> schema. But I think columns are in the order as in HBase database >> table. >> >>> >> >>> What I have to do to get the columns as in schema order? >> >>> >> >>> Thanks. >> >>> >> >>> -- >> >>> Thanuja Uruththirakodeeswaran >> >>> Software Engineer >> >>> WSO2 Inc.;http://wso2.com >> >>> lean.enterprise.middleware >> >>> >> >>> mobile: +94 774363167 >> >>> >> >>> ___ >> >>> Dev mailing list >> >>> Dev@wso2.org >> >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >>> >> >>> >> >> >> >> >> >> -- >> >> Gimantha Bandara >> >> Software Engineer >> >> WSO2. Inc : http://wso2.com >> >> Mobile : +94714961919 >> >> >> > >> > >> > >> > -- >> > Thanuja Uruththirakodeeswaran >> > Software Engineer >> > WSO2 Inc.;http://wso2.com >> > lean.enterprise.middleware >> > >> > mobile: +94 774363167 >> > >> >> >> -- >> Gimantha Bandara >> Software Engineer >> WSO2. Inc : http://wso2.com >> Mobile : +94714961919 >> > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [PPaaS] WSO2 Private PaaS build failure
elapsed or updates are forced at org.sonatype.aether.impl.internal.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:538) at org.sonatype.aether.impl.internal.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:216) at org.sonatype.aether.impl.internal.DefaultArtifactResolver.resolveArtifact(DefaultArtifactResolver.java:193) at org.sonatype.aether.impl.internal.DefaultRepositorySystem.resolveArtifact(DefaultRepositorySystem.java:286) at org.apache.maven.artifact.resolver.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:213) ... 27 more Caused by: org.sonatype.aether.transfer.ArtifactNotFoundException: Failure to find org.apache.stratos:org.apache.stratos.tenant.activity.server.feature:zip:4.1.2 in http://maven.wso2.org/nexus/content/repositories/releases/ was cached in the local repository, resolution will not be reattempted until the update interval of wso2.releases has elapsed or updates are forced at org.sonatype.aether.impl.internal.DefaultUpdateCheckManager.newException(DefaultUpdateCheckManager.java:230) at org.sonatype.aether.impl.internal.DefaultUpdateCheckManager.checkArtifact(DefaultUpdateCheckManager.java:204) at org.sonatype.aether.impl.internal.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:427) ... 31 more Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [PPaaS] WSO2 Private PaaS build failure
Hi devs, This occurred because the feature "*org.apache.stratos.tenant.activity.* *server.feature*" is removed from Stratos 4.1.2. If we remove features which are not used in Stratos 4.1.2 and build Private PaaS using Stratos 4.1.2, then it gets build successfully. The changes needed for this can be found here: https://github.com/wso2/product-private-paas/pull/117 Thanks. On Tue, Aug 25, 2015 at 8:14 PM, Thanuja Uruththirakodeeswaran < thanu...@wso2.com> wrote: > Hi Devs, > > I've built *Stratos 4.1.x* branch successfully and after that tried to > build PPaaS using Stratos - 4.1.2. > I'm getting the following error when building PPaaS: > > [INFO] --- carbon-p2-plugin:1.5.4:p2-repo-gen (2-p2-repo-generation) @ > ppaas-p2-profile-gen --- > [ERROR] Error occured when processing the Feature Artifact: > org.apache.stratos:org.apache.stratos.tenant.activity.server.feature:4.1.2 > org.apache.maven.plugin.MojoExecutionException: Error occured when > processing the Feature Artifact: > org.apache.stratos:org.apache.stratos.tenant.activity.server.feature:4.1.2 > at > org.wso2.maven.p2.RepositoryGenMojo.getProcessedFeatureArtifacts(RepositoryGenMojo.java:322) > at > org.wso2.maven.p2.RepositoryGenMojo.createRepo(RepositoryGenMojo.java:197) > at org.wso2.maven.p2.RepositoryGenMojo.execute(RepositoryGenMojo.java:191) > at > org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101) > at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209) > at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) > at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) > at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) > at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) > at > org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) > at > org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) > at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) > at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) > at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) > at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) > at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) > at > org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) > at > org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) > at > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) > Caused by: org.apache.maven.plugin.MojoExecutionException: ERROR > at > org.wso2.maven.p2.generate.utils.MavenUtils.getResolvedArtifact(MavenUtils.java:60) > at > org.wso2.maven.p2.RepositoryGenMojo.getProcessedFeatureArtifacts(RepositoryGenMojo.java:319) > ... 23 more > Caused by: org.apache.maven.artifact.resolver.ArtifactNotFoundException: > Failure to find > org.apache.stratos:org.apache.stratos.tenant.activity.server.feature:zip:4.1.2 > in http://maven.wso2.org/nexus/content/repositories/releases/ was cached > in the local repository, resolution will not be reattempted until the > update interval of wso2.releases has elapsed or updates are forced > > Try downloading the file manually from the project website. > > Then, install it using the command: > mvn install:install-file -DgroupId=org.apache.stratos > -DartifactId=org.apache.stratos.tenant.activity.server.feature > -Dversion=4.1.2 -Dpackaging=zip -Dfile=/path/to/file > > Alternatively, if you host your own repository you can deploy the file > there: > mvn deploy:deploy-file -DgroupId=org.apache.stratos > -DartifactId=org.apache.stratos.tenant.activity.server.feature > -Dversion=4.1.2 -Dpackaging=zip -Dfile=/path/to/file -Durl=[url] > -DrepositoryId=[id] > > > > org.apache.stratos:org.apache.stratos.tenant.activity.server.feature:zip:4.1.2 > > from the specified remote repositories: > wso2.releases ( > http://maven.wso2.org/nexus/content/repositories/releases/, > releases=true, snapshots=true), > wso2.snapshots ( > http://maven.wso2.org/nexus/content/repositories/snapshots/, > releases=false, snapshots=true), >
Re: [Dev] [DAS] Scheduling Spark Script in CApp using Spark Script Configuration File
Hi Sinthuja,
Is the *Httpd_Log_Analytics* sample ready now? I've added the sample car
file to DAS, but I couldn't see its dashboard or gadgets in DAS analytics
dashboard portal.
Thanks.
On Mon, Aug 17, 2015 at 5:47 PM, Sinthuja Ragendran
wrote:
> Hi Thanuja,
>
>
> On Mon, Aug 17, 2015 at 5:38 PM, Thanuja Uruththirakodeeswaran <
> thanu...@wso2.com> wrote:
>
>> Hi Sinthuja,
>>
>> Thanks. It's working. I deployed the Httpd_Log_Analytics" sample after
>> uncomment the line in its artifacts.xml [1] file. It gives following
>> message in server console. What's the reason for this?
>>
>> [2015-08-17 17:20:35,193] INFO
>> {org.wso2.carbon.application.deployer.internal.ApplicationManager} -
>> Deploying Carbon Application : Httpd_Log_Analytics.car...
>> [2015-08-17 17:20:35,215] ERROR
>> {org.wso2.carbon.application.deployer.internal.ApplicationManager} - Some
>> dependencies in cApp : Httpd_Log_Analytics_1.0.0 were not satisfied. Check
>> whether all dependent artifacts are included in cApp file :
>> /home/thanujau/Documents/Project/wso2das-3.0.0-SNAPSHOT/repository/deployment/server/carbonapps/Httpd_Log_Analytics.car
>>
>>
> This sample yet to be completed with dashboard files, and there are some
> issues in gadget files, hence you are experiencing the exception.
>
>
>> And if we create a dashboard in DAS, where can we find dashboard json
>> file?
>>
>
> It's in the registry /_system/config/ues/dashboards/ location.
>
> Thanks,
> Sinthuja
>
>>
>> [1].
>> https://github.com/wso2/product-bam/blob/master/modules/samples/capps/Httpd_Log_Analytics/artifacts.xml
>>
>> Thanks.
>>
>> On Mon, Aug 17, 2015 at 4:21 PM, Sinthuja Ragendran
>> wrote:
>>
>>> Hi Thanuja,
>>>
>>> You can set the cron expression with CronExpression element in the
>>> spark script artifact xml as shown below.
>>>
>>>
>>>
>>> AddNewScriptTestWithouTask
>>> define table TEST_CAPP (server_name string, ip STRING,
>>> tenant INTEGER, sequence LONG, summary STRING);SELECT ip FROM
>>> TEST_CAPP;SELECT server_name, count(*) FROM TEST_CAPP GROUP BY
>>> server_name;
>>> 0 * * * * ?
>>>
>>>
>>> Thanks,
>>> Sinthuja.
>>>
>>> On Mon, Aug 17, 2015 at 4:15 PM, Thanuja Uruththirakodeeswaran <
>>> thanu...@wso2.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I've followed the link [1] and referred sample "Httpd_Log_Analytics"
>>>> [2] for creating a car file and deploy that in DAS. Here if we want to use
>>>> the spark script, we can use a file as in [3].
>>>>
>>>> But if the spark script need to be executed for every minute, how we
>>>> can add the Cron expression in the script configuration xml?
>>>>
>>>> [1].
>>>> https://docs.wso2.com/display/DAS300/Carbon+Application+Deployment+for+DAS
>>>> [2].
>>>> https://github.com/wso2/product-bam/tree/master/modules/samples/capps/Httpd_Log_Analytics
>>>> [3].
>>>> https://github.com/wso2/product-bam/blob/master/modules/samples/capps/Httpd_Log_Analytics/Sparkscripts_1.0.0/httpd_log_analytics.xml
>>>>
>>>> Thanks.
>>>>
>>>> --
>>>> Thanuja Uruththirakodeeswaran
>>>> Software Engineer
>>>> WSO2 Inc.;http://wso2.com
>>>> lean.enterprise.middleware
>>>>
>>>> mobile: +94 774363167
>>>>
>>>> ___
>>>> Dev mailing list
>>>> Dev@wso2.org
>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>>
>>>>
>>>
>>>
>>> --
>>> *Sinthuja Rajendran*
>>> Associate Technical Lead
>>> WSO2, Inc.:http://wso2.com
>>>
>>> Blog: http://sinthu-rajan.blogspot.com/
>>> Mobile: +94774273955
>>>
>>>
>>>
>>
>>
>> --
>> Thanuja Uruththirakodeeswaran
>> Software Engineer
>> WSO2 Inc.;http://wso2.com
>> lean.enterprise.middleware
>>
>> mobile: +94 774363167
>>
>
>
>
> --
> *Sinthuja Rajendran*
> Associate Technical Lead
> WSO2, Inc.:http://wso2.com
>
> Blog: http://sinthu-rajan.blogspot.com/
> Mobile: +94774273955
>
>
>
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [DAS] DAS build failure
Hi Devs, I got the very latest pack upto commit abfad12bbc0d78cfedf833f08af6dc278e1064f7. The build failed because of Integration Test Module failure as follow: Tests run: 213, Failures: 1, Errors: 0, Skipped: 11, Time elapsed: 1,605.615 sec <<< FAILURE! - in TestSuite search(org.wso2.das.integration.tests.restservice.analytics.AnalyticsRestTestCase) Time elapsed: 0.088 sec <<< FAILURE! java.lang.AssertionError: Search result not found expected: but was: at org.testng.Assert.fail(Assert.java:89) at org.testng.Assert.failNotEquals(Assert.java:489) at org.testng.Assert.assertTrue(Assert.java:37) at org.wso2.das.integration.tests.restservice.analytics.AnalyticsRestTestCase.search(AnalyticsRestTestCase.java:454) Results : Failed tests: org.wso2.das.integration.tests.restservice.analytics.AnalyticsRestTestCase.search(org.wso2.das.integration.tests.restservice.analytics.AnalyticsRestTestCase) Run 1: PASS Run 2: AnalyticsRestTestCase.search:454 Search result not found expected: but was: Tests run: 201, Failures: 1, Errors: 0, Skipped: 0 [INFO] [INFO] Reactor Summary: [INFO] [INFO] WSO2 Data Analytics Server SUCCESS [0.681s] [INFO] WSO2 Data Analytics Server - Multi-tenant Dashboard SUCCESS [3.528s] [INFO] WSO2 Data Analytics Server - Styles Parent SUCCESS [0.017s] [INFO] WSO2 Data Analytics Server - Product UI Styles SUCCESS [1.182s] [INFO] WSO2 Data Analytics Server - Multi-tenant UI Styles SUCCESS [0.650s] [INFO] WSO2 Data Analytics Server - Features Parent .. SUCCESS [0.016s] [INFO] WSO2 Data Analytics Server - Features . SUCCESS [0.016s] [INFO] WSO2 Data Analytics Server - Product Style Feature SUCCESS [0.596s] [INFO] WSO2 Data Analytics Server - Multi-tenant-Features SUCCESS [0.014s] [INFO] WSO2 Data Analytics Server - Multi-tenant Style Feature SUCCESS [0.341s] [INFO] WSO2 Data Analytics Server - Multi-tenant Dashboard Feature SUCCESS [0.416s] [INFO] WSO2 Data Analytics Server - Profile Generation ... SUCCESS [32.567s] [INFO] WSO2 Data Analytics Server - Samples .. SUCCESS [0.015s] [INFO] WSO2 Data Analytics Server - Sample Data Publishers SUCCESS [1.093s] [INFO] WSO2 Data Analytics Server - Sample Composite Applications SUCCESS [0.265s] [INFO] WSO2 Data Analytics Server - Sample Spark UDF . SUCCESS [0.014s] [INFO] WSO2 Data Analytics Server - Sample UDF for Geo IP SUCCESS [0.214s] [INFO] WSO2 Data Analytics Server - Distribution . SUCCESS [34.592s] [INFO] WSO2 Data Analytics Server - Integration Tests SUCCESS [0.138s] [INFO] WSO2 Data Analytics Server - Integration Test Common Module SUCCESS [0.808s] [INFO] WSO2 Data Analytics Server - Integration Test UI Pages SUCCESS [0.418s] [INFO] WSO2 Data Analytics Server - Integration Test Common Utils Module SUCCESS [1.113s] [INFO] WSO2 Data Analytics Server - Integration Test Module FAILURE [26:48.745s] [INFO] WSO2 Data Analytics Server - Integration Test UI .. SKIPPED [INFO] WSO2 Data Analytics Server - Integration UI ... SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] Did anyone get this same error? Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Discussion about DAS Analytics Dashboard
Hi Dunith, I'm implementing Metering dashboard for Stratos using DAS. You can find more details and dashboard UI design in the dev thread[1]. Currently I'm trying to create a line chart and table gadgets in dashboard and I need to do some filtering in dashboard. I tried with DAS samples and they don't have the filtering part. So I need to discuss and clarify about it. Also I've discussed about Table Gadget column order problem in thread [2] and need to clarify about that one also. [1]. [Dev] [PPaaS] Integrating DAS with Stratos for Metering Service and Monitoring Health Statistics [2]. [Dev] [DAS] DAS dashboard table-gadget column order Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Scheduling Spark Script in CApp using Spark Script Configuration File
Hi Sinthuja,
I built master branch after analytics-common version upgrade and now I can
see the dashboard and gadgets. I followed the README file [1]. Even though
scripts are executed every minute, I couldn't see any data in dashboard. I
published data using step 6 in README. I checked the tables/data-sources
related with the gadgets in data explorer and spark console. There is no
data in the table. Am I missing anything?
[1]
https://github.com/wso2/product-bam/tree/master/modules/samples/publishers/httpd-logs
Thanks.
On Sun, Aug 30, 2015 at 11:52 PM, Sinthuja Ragendran
wrote:
> Hi Thanuja,
>
> I verified the sample today with my local build which was build today with
> latest code. And I can see the dashboards, and gadgets without any issue. I
> hope you have followed the steps mentioned in the README.txt of
> httpd-logs-sample directory. Please check with the latest pack.
>
> Thanks,
> Sinthuja.
>
> On Fri, Aug 28, 2015 at 9:15 AM, Sinthuja Ragendran
> wrote:
>
>> Hi Thanuja,
>>
>> Yes, the entire sample was working before. Let me check with latest pack
>> and see whether there are issues.
>>
>> Thanks,
>> Sinthuja
>>
>>
>> On Friday, August 28, 2015, Thanuja Uruththirakodeeswaran <
>> thanu...@wso2.com> wrote:
>>
>>> Hi Sinthuja,
>>>
>>> Is the *Httpd_Log_Analytics* sample ready now? I've added the sample
>>> car file to DAS, but I couldn't see its dashboard or gadgets in DAS
>>> analytics dashboard portal.
>>>
>>> Thanks.
>>>
>>> On Mon, Aug 17, 2015 at 5:47 PM, Sinthuja Ragendran
>>> wrote:
>>>
>>>> Hi Thanuja,
>>>>
>>>>
>>>> On Mon, Aug 17, 2015 at 5:38 PM, Thanuja Uruththirakodeeswaran <
>>>> thanu...@wso2.com> wrote:
>>>>
>>>>> Hi Sinthuja,
>>>>>
>>>>> Thanks. It's working. I deployed the Httpd_Log_Analytics" sample after
>>>>> uncomment the line in its artifacts.xml [1] file. It gives following
>>>>> message in server console. What's the reason for this?
>>>>>
>>>>> [2015-08-17 17:20:35,193] INFO
>>>>> {org.wso2.carbon.application.deployer.internal.ApplicationManager} -
>>>>> Deploying Carbon Application : Httpd_Log_Analytics.car...
>>>>> [2015-08-17 17:20:35,215] ERROR
>>>>> {org.wso2.carbon.application.deployer.internal.ApplicationManager} - Some
>>>>> dependencies in cApp : Httpd_Log_Analytics_1.0.0 were not satisfied. Check
>>>>> whether all dependent artifacts are included in cApp file :
>>>>> /home/thanujau/Documents/Project/wso2das-3.0.0-SNAPSHOT/repository/deployment/server/carbonapps/Httpd_Log_Analytics.car
>>>>>
>>>>>
>>>> This sample yet to be completed with dashboard files, and there are
>>>> some issues in gadget files, hence you are experiencing the exception.
>>>>
>>>>
>>>>> And if we create a dashboard in DAS, where can we find dashboard json
>>>>> file?
>>>>>
>>>>
>>>> It's in the registry /_system/config/ues/dashboards/ location.
>>>>
>>>> Thanks,
>>>> Sinthuja
>>>>
>>>>>
>>>>> [1].
>>>>> https://github.com/wso2/product-bam/blob/master/modules/samples/capps/Httpd_Log_Analytics/artifacts.xml
>>>>>
>>>>> Thanks.
>>>>>
>>>>> On Mon, Aug 17, 2015 at 4:21 PM, Sinthuja Ragendran >>>> > wrote:
>>>>>
>>>>>> Hi Thanuja,
>>>>>>
>>>>>> You can set the cron expression with CronExpression element in the
>>>>>> spark script artifact xml as shown below.
>>>>>>
>>>>>>
>>>>>>
>>>>>> AddNewScriptTestWithouTask
>>>>>> define table TEST_CAPP (server_name string, ip STRING,
>>>>>> tenant INTEGER, sequence LONG, summary STRING);SELECT ip FROM
>>>>>> TEST_CAPP;SELECT server_name, count(*) FROM TEST_CAPP GROUP BY
>>>>>> server_name;
>>>>>> 0 * * * * ?
>>>>>>
>>>>>>
>>>>>> Thanks,
>>>>>> Sinthuja.
>>>>>>
>>>>>> On Mon, Aug 17, 2015 at 4:15 PM, Thanuja Uruththirakodeeswaran <
>>>>>> thanu...@wso2.com> wrote:
>>>>>>
>>>>>>
Re: [Dev] Discussion about DAS Analytics Dashboard
Hi Dunith, Yes, I need filtering facility when generating a gadget to filter out the records and I'm wondering where can I add queries for filtering and how can I invoke the filtering logic from dashboard. I'll have a offline discussion with Maninda, since as you said he is the one currently responsible for dashboard side and let you know. Thanks. On Wed, Sep 2, 2015 at 12:12 AM, Dunith Dhanushka wrote: > Hi Thanuja, > > Can you explain the requirement for filtering a little bit further? What I > understood is you need a filtering facility when generating a gadget to > filter out the records for the visualization. (like having a where clause) > > Regards, > Dunith > > On Tue, Sep 1, 2015 at 8:04 AM, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi Dunith, >> >> I'm implementing Metering dashboard for Stratos using DAS. You can find >> more details and dashboard UI design in the dev thread[1]. Currently I'm >> trying to create a line chart and table gadgets in dashboard and I need to >> do some filtering in dashboard. I tried with DAS samples and they don't >> have the filtering part. So I need to discuss and clarify about it. Also >> I've discussed about Table Gadget column order problem in thread [2] and >> need to clarify about that one also. >> >> [1]. [Dev] [PPaaS] Integrating DAS with Stratos for Metering Service and >> Monitoring Health Statistics >> [2]. [Dev] [DAS] DAS dashboard table-gadget column order >> >> Thanks. >> >> -- >> Thanuja Uruththirakodeeswaran >> Software Engineer >> WSO2 Inc.;http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 774363167 >> > > > > -- > Regards, > > Dunith Dhanushka, > Senior Software Engineer > WSO2 Inc, > > Mobile - +94 71 8615744 > Blog - dunithd.wordpress.com <http://blog.dunith.com> > Twitter - @dunithd <http://twitter.com/dunithd> > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Scheduling Spark Script in CApp using Spark Script Configuration File
Hi Sinthuja,
I tested now and I can see the data in dashboard. I think data was not
published yesterday even though I tried the step 6 to publish data. Also I
didn't get any exceptions but I don't know why data was not received.
Sorry for the noise.
Thanks.
On Tue, Sep 1, 2015 at 6:51 PM, Thanuja Uruththirakodeeswaran <
thanu...@wso2.com> wrote:
> Hi Sinthuja,
>
> I built master branch after analytics-common version upgrade and now I can
> see the dashboard and gadgets. I followed the README file [1]. Even though
> scripts are executed every minute, I couldn't see any data in dashboard. I
> published data using step 6 in README. I checked the tables/data-sources
> related with the gadgets in data explorer and spark console. There is no
> data in the table. Am I missing anything?
>
> [1]
> https://github.com/wso2/product-bam/tree/master/modules/samples/publishers/httpd-logs
>
> Thanks.
>
> On Sun, Aug 30, 2015 at 11:52 PM, Sinthuja Ragendran
> wrote:
>
>> Hi Thanuja,
>>
>> I verified the sample today with my local build which was build today
>> with latest code. And I can see the dashboards, and gadgets without any
>> issue. I hope you have followed the steps mentioned in the README.txt of
>> httpd-logs-sample directory. Please check with the latest pack.
>>
>> Thanks,
>> Sinthuja.
>>
>> On Fri, Aug 28, 2015 at 9:15 AM, Sinthuja Ragendran
>> wrote:
>>
>>> Hi Thanuja,
>>>
>>> Yes, the entire sample was working before. Let me check with latest pack
>>> and see whether there are issues.
>>>
>>> Thanks,
>>> Sinthuja
>>>
>>>
>>> On Friday, August 28, 2015, Thanuja Uruththirakodeeswaran <
>>> thanu...@wso2.com> wrote:
>>>
>>>> Hi Sinthuja,
>>>>
>>>> Is the *Httpd_Log_Analytics* sample ready now? I've added the sample
>>>> car file to DAS, but I couldn't see its dashboard or gadgets in DAS
>>>> analytics dashboard portal.
>>>>
>>>> Thanks.
>>>>
>>>> On Mon, Aug 17, 2015 at 5:47 PM, Sinthuja Ragendran
>>>> wrote:
>>>>
>>>>> Hi Thanuja,
>>>>>
>>>>>
>>>>> On Mon, Aug 17, 2015 at 5:38 PM, Thanuja Uruththirakodeeswaran <
>>>>> thanu...@wso2.com> wrote:
>>>>>
>>>>>> Hi Sinthuja,
>>>>>>
>>>>>> Thanks. It's working. I deployed the Httpd_Log_Analytics" sample
>>>>>> after uncomment the line in its artifacts.xml [1] file. It gives
>>>>>> following
>>>>>> message in server console. What's the reason for this?
>>>>>>
>>>>>> [2015-08-17 17:20:35,193] INFO
>>>>>> {org.wso2.carbon.application.deployer.internal.ApplicationManager} -
>>>>>> Deploying Carbon Application : Httpd_Log_Analytics.car...
>>>>>> [2015-08-17 17:20:35,215] ERROR
>>>>>> {org.wso2.carbon.application.deployer.internal.ApplicationManager} -
>>>>>> Some
>>>>>> dependencies in cApp : Httpd_Log_Analytics_1.0.0 were not satisfied.
>>>>>> Check
>>>>>> whether all dependent artifacts are included in cApp file :
>>>>>> /home/thanujau/Documents/Project/wso2das-3.0.0-SNAPSHOT/repository/deployment/server/carbonapps/Httpd_Log_Analytics.car
>>>>>>
>>>>>>
>>>>> This sample yet to be completed with dashboard files, and there are
>>>>> some issues in gadget files, hence you are experiencing the exception.
>>>>>
>>>>>
>>>>>> And if we create a dashboard in DAS, where can we find dashboard json
>>>>>> file?
>>>>>>
>>>>>
>>>>> It's in the registry /_system/config/ues/dashboards/ location.
>>>>>
>>>>> Thanks,
>>>>> Sinthuja
>>>>>
>>>>>>
>>>>>> [1].
>>>>>> https://github.com/wso2/product-bam/blob/master/modules/samples/capps/Httpd_Log_Analytics/artifacts.xml
>>>>>>
>>>>>> Thanks.
>>>>>>
>>>>>> On Mon, Aug 17, 2015 at 4:21 PM, Sinthuja Ragendran <
>>>>>> sinth...@wso2.com> wrote:
>>>>>>
>>>>>>> Hi Thanuja,
>>>>>>>
>>>>>>> You can set the cron expression with CronExpression element in the
&
Re: [Dev] Discussion about DAS Analytics Dashboard
Hi Dunith, Thanks for the update. What I need is when I navigate to this dashboard page, a particular application_id(a) and cluster_id(c) will be passed and by default 30 min time interval(t) will be selected. So I need to visualize data corresponding to filter a,c and t in Line Chart Gadget which is already added to the dashboard page. For that I need to query process store db(mysql db) table using where clause with a,c,t and update data in Line Chart Gadget. The table I'm using for Line Chart Gadget contains columns: Time, ApplicationId, ClusterId, CreatedMemberCount, InitializedmemberCount, TerminatedMemberCount So how can I connect to process store db/ send an API call to back end from dashboard and update Gadget? You are saying using a lucene query, we can filter data and generate gadget. So can I use the same for update the gadget every time user try to do filtering in UI? Thanks. On Wed, Sep 2, 2015 at 6:21 PM, Dunith Dhanushka wrote: > Hi Thanuja, > > I'm working on adding the Lucene based filtering facility to gadget > generation wizard [1]. That will provide you a way of specifying a Lucene > query during gadget generation so that you can filter out your input data > table. I'm hoping to finish it within this week. > > But you might need to get help from UES team (if they are not busy with a > release) for the gadget maximizing feature. > > [1] https://wso2.org/jira/browse/DAS-28 > > Regards, > Dunith > > > > On Tue, Sep 1, 2015 at 10:05 PM, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi Dunith, >> >> Yes, I need filtering facility when generating a gadget to filter out the >> records and I'm wondering where can I add queries for filtering and how can >> I invoke the filtering logic from dashboard. I'll have a offline discussion >> with Maninda, since as you said he is the one currently responsible for >> dashboard side and let you know. >> >> Thanks. >> >> On Wed, Sep 2, 2015 at 12:12 AM, Dunith Dhanushka >> wrote: >> >>> Hi Thanuja, >>> >>> Can you explain the requirement for filtering a little bit further? What >>> I understood is you need a filtering facility when generating a gadget to >>> filter out the records for the visualization. (like having a where clause) >>> >>> Regards, >>> Dunith >>> >>> On Tue, Sep 1, 2015 at 8:04 AM, Thanuja Uruththirakodeeswaran < >>> thanu...@wso2.com> wrote: >>> >>>> Hi Dunith, >>>> >>>> I'm implementing Metering dashboard for Stratos using DAS. You can find >>>> more details and dashboard UI design in the dev thread[1]. Currently I'm >>>> trying to create a line chart and table gadgets in dashboard and I need to >>>> do some filtering in dashboard. I tried with DAS samples and they don't >>>> have the filtering part. So I need to discuss and clarify about it. Also >>>> I've discussed about Table Gadget column order problem in thread [2] and >>>> need to clarify about that one also. >>>> >>>> [1]. [Dev] [PPaaS] Integrating DAS with Stratos for Metering Service >>>> and Monitoring Health Statistics >>>> [2]. [Dev] [DAS] DAS dashboard table-gadget column order >>>> >>>> Thanks. >>>> >>>> -- >>>> Thanuja Uruththirakodeeswaran >>>> Software Engineer >>>> WSO2 Inc.;http://wso2.com >>>> lean.enterprise.middleware >>>> >>>> mobile: +94 774363167 >>>> >>> >>> >>> >>> -- >>> Regards, >>> >>> Dunith Dhanushka, >>> Senior Software Engineer >>> WSO2 Inc, >>> >>> Mobile - +94 71 8615744 >>> Blog - dunithd.wordpress.com <http://blog.dunith.com> >>> Twitter - @dunithd <http://twitter.com/dunithd> >>> >> >> >> >> -- >> Thanuja Uruththirakodeeswaran >> Software Engineer >> WSO2 Inc.;http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 774363167 >> > > > > -- > Regards, > > Dunith Dhanushka, > Senior Software Engineer > WSO2 Inc, > > Mobile - +94 71 8615744 > Blog - dunithd.wordpress.com <http://blog.dunith.com> > Twitter - @dunithd <http://twitter.com/dunithd> > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [DAS] Error creating table using CarbonJDBC
t.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Error creating table using CarbonJDBC
Hi Niranda, I've attached the files here. I tested the connection by DAS datasource "Test Connection" option. It says "Connection is healthy". Do I need to pass any param in analtytics-datasources.xml file for mysql db? Thanks. On Tue, Sep 8, 2015 at 11:25 PM, Niranda Perera wrote: > Hi thanuja, > > can you attach the config files in repository/conf/analytics/* and > repository/conf/datasources/* > > I suspect this is a connection issue. > > rgds > > On Tue, Sep 8, 2015 at 5:28 PM, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi Niranda, >> >> I'm trying the following query in spark: >> >> create temporary table cluster_member using CarbonJDBC options >> (dataSource "ANALYTICS_PROCESSED_DATA_STORE", tableName "CLUSTER_MEMBER"); >> >> But I'm getting the following error. How to fix this? >> >> org.apache.axis2.AxisFault: Exception occurred while trying to invoke >> service method execute >> at >> org.apache.axis2.util.Utils.getInboundFaultFromMessageContext(Utils.java:531) >> at >> org.apache.axis2.description.OutInAxisOperationClient.handleResponse(OutInAxisOperation.java:370) >> at >> org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:445) >> at >> org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225) >> at >> org.apache.axis2.client.OperationClient.execute(OperationClient.java:149) >> at >> org.wso2.carbon.analytics.spark.admin.stub.AnalyticsProcessorAdminServiceStub.execute(AnalyticsProcessorAdminServiceStub.java:912) >> at >> org.wso2.carbon.analytics.spark.ui.client.AnalyticsExecutionClient.executeScriptContent(AnalyticsExecutionClient.java:67) >> at >> org.apache.jsp.spark_002dmanagement.executeScript_005fajaxprocessor_jsp._jspService(executeScript_005fajaxprocessor_jsp.java:110) >> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) >> at >> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:432) >> at >> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:395) >> at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:339) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) >> at org.wso2.carbon.ui.JspServlet.service(JspServlet.java:155) >> at org.wso2.carbon.ui.TilesJspServlet.service(TilesJspServlet.java:80) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) >> at >> org.eclipse.equinox.http.helper.ContextPathServletAdaptor.service(ContextPathServletAdaptor.java:37) >> at >> org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61) >> at >> org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128) >> at >> org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) >> at >> org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68) >> at >> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) >> at >> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) >> at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) >> at >> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) >> at >> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) >> at >> org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter.doFilter(CharacterSetFilter.java:61) >> at >> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) >> at >> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) >> at >> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) >> at >> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) >> at >> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) >> at >> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) >> at >> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) >> at >> org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInvocation(CompositeValve.java:99) >> at >> org.wso2.carbon.tomc
Re: [Dev] [DAS] Error creating table using CarbonJDBC
(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) I checked my local mysql db as well. mysql> show databases; ++ | Database | ++ | information_schema | | ANALYTICS_FS_DB| | ANALYTICS_PROCESSED_DATA_STORE | | as_config_db | | mysql | | performance_schema | | ppaas_config_db| | ppaas_registry_db | | ppaas_user_db | ++ 9 rows in set (0.00 sec) mysql> SELECT TABLE_NAME FROM INFORMATION_SCHEMA.TABLES WHERE TABLE_TYPE = 'BASE TABLE' AND TABLE_SCHEMA='ANALYTICS_PROCESSED_DATA_STORE'; +-+ | TABLE_NAME | +-+ | ANX___7LgRmgTc_ | | ANX___7Lu5N_U8_ | | CLUSTER_MEMBER | +-+ 3 rows in set (0.00 sec) mysql> Thanks. On Wed, Sep 9, 2015 at 10:02 AM, Niranda Perera wrote: > Hi Thanuja, > > I think this is the issue. > > analytics-datasources.xml describes the datasource as > > > WSO2_ANALYTICS_PROCESSED_DATA_STORE_DB > The datasource used for analytics record > store > > > > jdbc:mysql://127.0.0.1:3306/ANALYTICS_PROCESSED_DATA_STORE > root > root > com.mysql.jdbc.Driver > 6 > true > SELECT 1 > 3 > false > > > > > > so, your query, > > create temporary table cluster_member using CarbonJDBC options (dataSource > "ANALYTICS_PROCESSED_DATA_STORE", tableName "CLUSTER_MEMBER"); > > the datasource name has to be "WSO2_ANALYTICS_PROCESSED_DATA_STORE_DB". > > can you check this and let me know? > > > cheers > > > > On Wed, Sep 9, 2015 at 9:02 AM, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi Niranda, >> >> I've attached the files here. I tested the connection by DAS datasource >> "Test Connection" option. It says "Connection is healthy". Do I need to >> pass any param in analtytics-datasources.xml file for mysql db? >> >> Thanks. >> >> On Tue, Sep 8, 2015 at 11:25 PM, Niranda Perera wrote: >> >>> Hi thanuja, >>> >>> can you attach the config files in repository/conf/analytics/* and >>> repository/conf/datasources/* >>> >>> I suspect this is a connection issue. >>> >>> rgds >>> >>> On Tue, Sep 8, 2015 at 5:28 PM, Thanuja Uruththirakodeeswaran < >>> thanu...@wso2.com> wrote: >>> >>>> Hi Niranda, >>>> >>>> I'm trying the following query in spark: >>>> >>>> create temporary table cluster_member using CarbonJDBC options >>>> (dataSource "ANALYTICS_PROCESSED_DATA_STORE", tableName "CLUSTER_MEMBER"); >>>> >>>> But I'm getting the following error. How to fix this? >>>> >>>> org.apache.axis2.AxisFault: Exception occurred while trying to invoke >>>> service method execute >>>> at >>>> org.apache.axis2.util.Utils.getInboundFaultFromMessageContext(Utils.java:531) >>>> at >>>> org.apache.axis2.description.OutInAxisOperationClient.handleResponse(OutInAxisOperation.java:370) >>>> at >>>> org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:445) >>>> at >>>> org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225) >>>> at >>>> org.apache.axis2.client.OperationClient.execute(OperationClient.java:149) >>>> at >>>> org.wso2.carbon.analytics.spark.admin.stub.AnalyticsProcessorAdminServiceStub.execute(AnalyticsProcessorAdminServiceStub.java:912) >>>> at >>>> org.wso2.carbon.analytics.spark.ui.client.AnalyticsExecutionClient.executeScriptContent(AnalyticsExecutionClient.java:67) >>>> at >>>> org.apache.jsp.spark_002dmanagement.executeScript_005fajaxprocessor_jsp._jspService(executeScript_005fajaxprocessor_jsp.java:110) >>>> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70) >>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) >>>> at >>>> org.apache.jasper.servlet.JspServletWrapper.service(JspServl
Re: [Dev] [DAS] Error creating table using CarbonJDBC
Hi Niranda, I've checked this again and I missed 'DB' part in datasource name ' WSO2_ANALYTICS_PROCESSED_DATA_STORE_DB'. Now I can execute the query without exception. Thanks. On Wed, Sep 9, 2015 at 10:30 AM, Niranda Perera wrote: > Thanuja, > > please create a JIRA for this. > > rgds > > On Wed, Sep 9, 2015 at 10:24 AM, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi Niranda, >> >> I have checked this already. It gives the same error. >> >> org.apache.axis2.AxisFault: Exception occurred while trying to invoke >> service method executeQuery >> at >> org.apache.axis2.util.Utils.getInboundFaultFromMessageContext(Utils.java:531) >> at >> org.apache.axis2.description.OutInAxisOperationClient.handleResponse(OutInAxisOperation.java:370) >> at >> org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:445) >> at >> org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225) >> at >> org.apache.axis2.client.OperationClient.execute(OperationClient.java:149) >> at >> org.wso2.carbon.analytics.spark.admin.stub.AnalyticsProcessorAdminServiceStub.executeQuery(AnalyticsProcessorAdminServiceStub.java:2106) >> at >> org.wso2.carbon.analytics.spark.ui.client.AnalyticsExecutionClient.execute(AnalyticsExecutionClient.java:61) >> at >> org.apache.jsp.spark_002dmanagement.execute_005fsparkquery_005fajaxprocessor_jsp._jspService(execute_005fsparkquery_005fajaxprocessor_jsp.java:84) >> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) >> at >> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:432) >> at >> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:395) >> at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:339) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) >> at org.wso2.carbon.ui.JspServlet.service(JspServlet.java:155) >> at org.wso2.carbon.ui.TilesJspServlet.service(TilesJspServlet.java:80) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) >> at >> org.eclipse.equinox.http.helper.ContextPathServletAdaptor.service(ContextPathServletAdaptor.java:37) >> at >> org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61) >> at >> org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128) >> at >> org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) >> at >> org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68) >> at >> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) >> at >> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) >> at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) >> at >> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) >> at >> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) >> at >> org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter.doFilter(CharacterSetFilter.java:61) >> at >> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) >> at >> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) >> at >> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) >> at >> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) >> at >> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) >> at >> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) >> at >> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) >> at >> org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInvocation(CompositeValve.java:99) >> at >> org.wso2.carbon.tomcat.ext.valves.CarbonTomcatValve$1.invoke(CarbonTomcatValve.java:47) >> at >> org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:57) >> at >> org.wso2.carbon.event.receiver.core.internal.tenantmgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:48) >> at >> org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invokeValves(T
[Dev] [DAS] No FileSystem for scheme: file error
Hi Gokul,
I'm running Hbase in *standalone mode* and used HBase as eventsotre in DAS.
II tried with the following two datasource definitions:
1.
WSO2_ANALYTICS_EVENT_STORE_DB_HBASE
The datasource used for analytics file
system
jdbc/WSO2HBaseDB
hbase.master
localhost:16000
2.
WSO2_ANALYTICS_EVENT_STORE_DB_HBASE
The datasource used for analytics file
system
jdbc/WSO2HBaseDB
hbase.master
localhost:16000
hbase.zookeeper.quorum
127.0.0.1
hbase.zookeeper.property.clientPort
2181
I'm getting the following error:
TID: [-1234] [] [2015-09-09 14:35:53,954] WARN
{org.apache.hadoop.hbase.util.DynamicClassLoader} - Failed to identify the
fs of dir
/home/thanujau/Desktop/wso2das-3.0.0-SNAPSHOT/tmp/hbase-thanujau/hbase/lib,
ignored {org.apache.hadoop.hbase.util.DynamicClassLoader}
java.io.IOException: No FileSystem for scheme: file
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:354)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
at
org.apache.hadoop.hbase.util.DynamicClassLoader.(DynamicClassLoader.java:104)
at
org.apache.hadoop.hbase.protobuf.ProtobufUtil.(ProtobufUtil.java:229)
at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64)
at
org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:75)
at
org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:86)
at
org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.retrieveClusterId(ConnectionManager.java:833)
at
org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.(ConnectionManager.java:623)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
*I've attached the full log. I used the same configuration with beta pack.
It worked fine. But in the latest pack I'm getting this error.*
*Also I logged into hbase shell and there is no probelm.*
Thanks.
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
TID: [-1234] [] [2015-09-09 14:35:34,310] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Starting WSO2 Carbon... {org.wso2.carbon.core.internal.CarbonCoreActivator}
TID: [-1234] [] [2015-09-09 14:35:34,311] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Operating System : Linux 3.13.0-57-generic, amd64 {org.wso2.carbon.core.internal.CarbonCoreActivator}
TID: [-1234] [] [2015-09-09 14:35:34,311] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Home: /usr/lib/jvm/jdk1.7.0_79/jre {org.wso2.carbon.core.internal.CarbonCoreActivator}
TID: [-1234] [] [2015-09-09 14:35:34,311] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Version : 1.7.0_79 {org.wso2.carbon.core.internal.CarbonCoreActivator}
TID: [-1234] [] [2015-09-09 14:35:34,311] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java VM : Java HotSpot(TM) 64-Bit Server VM 24.79-b02,Oracle Corporation {org.wso2.carbon.core.internal.CarbonCoreActivator}
TID: [-1234] [] [2015-09-09 14:35:34,311] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Carbon Home : /home/thanujau/Desktop/wso2das-3.0.0-SNAPSHOT {org.wso2.carbon.core.internal.CarbonCoreActivator}
TID: [-1234] [] [2015-09-09 14:35:34,311] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Temp Dir: /home/thanujau/Desktop/wso2das-3.0.0-SNAPSHOT/tmp {org.wso2.carbon.core.internal.CarbonCoreActivator}
TID: [-1234] [] [2015-09-09 14:35:34,311] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - User : thanujau, en-US, Asia/Colombo {org.wso2.carbon.core.internal.CarbonCoreActivator}
TID: [-1234] [] [2015-09-09 14:35:34,
Re: [Dev] [DAS] No FileSystem for scheme: file error
Hi Gokul,
I've added this configuration and tried again. But getting the same error.
Thanks.
On Wed, Sep 9, 2015 at 2:50 PM, Gokul Balakrishnan wrote:
> Hi Thanuja,
>
> As given in the thread "[DAS 3.0.0 Beta] No FileSystem for scheme: file",
> can you add the following properties and try:
>
>
> fs.hdfs.impl
> org.apache.hadoop.hdfs.DistributedFileSystem
>
>
> fs.file.impl
> org.apache.hadoop.fs.LocalFileSystem
>
>
> These settings are available out-of-the-box in the sample datasource
> configuration in recent DAS packs, any reason why they went missing?
>
> Thanks,
>
> On 9 September 2015 at 14:47, Thanuja Uruththirakodeeswaran <
> thanu...@wso2.com> wrote:
>
>> Hi Gokul,
>>
>> I'm running Hbase in *standalone mode* and used HBase as eventsotre in
>> DAS. II tried with the following two datasource definitions:
>>
>> 1.
>>
>> WSO2_ANALYTICS_EVENT_STORE_DB_HBASE
>> The datasource used for analytics file
>> system
>>
>> jdbc/WSO2HBaseDB
>>
>>
>>
>>
>> hbase.master
>> localhost:16000
>>
>>
>>
>>
>>
>> 2.
>>
>> WSO2_ANALYTICS_EVENT_STORE_DB_HBASE
>> The datasource used for analytics file
>> system
>>
>> jdbc/WSO2HBaseDB
>>
>>
>>
>>
>> hbase.master
>> localhost:16000
>>
>>
>> hbase.zookeeper.quorum
>> 127.0.0.1
>>
>>
>> hbase.zookeeper.property.clientPort
>> 2181
>>
>>
>>
>>
>>
>> I'm getting the following error:
>>
>> TID: [-1234] [] [2015-09-09 14:35:53,954] WARN
>> {org.apache.hadoop.hbase.util.DynamicClassLoader} - Failed to identify the
>> fs of dir
>> /home/thanujau/Desktop/wso2das-3.0.0-SNAPSHOT/tmp/hbase-thanujau/hbase/lib,
>> ignored {org.apache.hadoop.hbase.util.DynamicClassLoader}
>> java.io.IOException: No FileSystem for scheme: file
>> at
>> org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584)
>> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591)
>> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
>> at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
>> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:354)
>> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
>> at
>> org.apache.hadoop.hbase.util.DynamicClassLoader.(DynamicClassLoader.java:104)
>> at
>> org.apache.hadoop.hbase.protobuf.ProtobufUtil.(ProtobufUtil.java:229)
>> at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64)
>> at
>> org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:75)
>> at
>> org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:86)
>> at
>> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.retrieveClusterId(ConnectionManager.java:833)
>> at
>> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.(ConnectionManager.java:623)
>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>> at
>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>> at
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>>
>>
>> *I've attached the full log. I used the same configuration with beta
>> pack. It worked fine. But in the latest pack I'm getting this error.*
>>
>> *Also I logged into hbase shell and there is no probelm.*
>>
>> Thanks.
>>
>> --
>> Thanuja Uruththirakodeeswaran
>> Software Engineer
>> WSO2 Inc.;http://wso2.com
>> lean.enterprise.middleware
>>
>> mobile: +94 774363167
>>
>
>
>
> --
> Gokul Balakrishnan
> Senior Software Engineer,
> WSO2, Inc. http://wso2.com
> Mob: +94 77 593 5789 | +1 650 272 9927
>
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] No FileSystem for scheme: file error
Hi Gokul,
I tried it with fresh pack and used default hbase config. Now it's working
fine. Thanks for the help. Since I'm running hbase standalone mode, I used
following datasource configuration:
WSO2_ANALYTICS_RS_DB_HBASE
The datasource used for analytics file
system
jdbc/WSO2HBaseDB
hbase.master
localhost:16000
Thanks.
On Wed, Sep 9, 2015 at 3:07 PM, Thanuja Uruththirakodeeswaran <
thanu...@wso2.com> wrote:
> Hi Gokul,
>
> I've added this configuration and tried again. But getting the same error.
>
> Thanks.
>
> On Wed, Sep 9, 2015 at 2:50 PM, Gokul Balakrishnan wrote:
>
>> Hi Thanuja,
>>
>> As given in the thread "[DAS 3.0.0 Beta] No FileSystem for scheme: file",
>> can you add the following properties and try:
>>
>>
>> fs.hdfs.impl
>> org.apache.hadoop.hdfs.DistributedFileSystem
>>
>>
>> fs.file.impl
>> org.apache.hadoop.fs.LocalFileSystem
>>
>>
>> These settings are available out-of-the-box in the sample datasource
>> configuration in recent DAS packs, any reason why they went missing?
>>
>> Thanks,
>>
>> On 9 September 2015 at 14:47, Thanuja Uruththirakodeeswaran <
>> thanu...@wso2.com> wrote:
>>
>>> Hi Gokul,
>>>
>>> I'm running Hbase in *standalone mode* and used HBase as eventsotre in
>>> DAS. II tried with the following two datasource definitions:
>>>
>>> 1.
>>>
>>> WSO2_ANALYTICS_EVENT_STORE_DB_HBASE
>>> The datasource used for analytics file
>>> system
>>>
>>> jdbc/WSO2HBaseDB
>>>
>>>
>>>
>>>
>>> hbase.master
>>> localhost:16000
>>>
>>>
>>>
>>>
>>>
>>> 2.
>>>
>>> WSO2_ANALYTICS_EVENT_STORE_DB_HBASE
>>> The datasource used for analytics file
>>> system
>>>
>>> jdbc/WSO2HBaseDB
>>>
>>>
>>>
>>>
>>> hbase.master
>>> localhost:16000
>>>
>>>
>>> hbase.zookeeper.quorum
>>> 127.0.0.1
>>>
>>>
>>> hbase.zookeeper.property.clientPort
>>> 2181
>>>
>>>
>>>
>>>
>>>
>>> I'm getting the following error:
>>>
>>> TID: [-1234] [] [2015-09-09 14:35:53,954] WARN
>>> {org.apache.hadoop.hbase.util.DynamicClassLoader} - Failed to identify the
>>> fs of dir
>>> /home/thanujau/Desktop/wso2das-3.0.0-SNAPSHOT/tmp/hbase-thanujau/hbase/lib,
>>> ignored {org.apache.hadoop.hbase.util.DynamicClassLoader}
>>> java.io.IOException: No FileSystem for scheme: file
>>> at
>>> org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584)
>>> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591)
>>> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
>>> at
>>> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
>>> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
>>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
>>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
>>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:354)
>>> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
>>> at
>>> org.apache.hadoop.hbase.util.DynamicClassLoader.(DynamicClassLoader.java:104)
>>> at
>>> org.apache.hadoop.hbase.protobuf.ProtobufUtil.(ProtobufUtil.java:229)
>>> at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64)
>>> at
>>> org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:75)
>>> at
>>> org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooK
[Dev] [UES] Reading request parameters of dashboard page URL inside widget and publish it
Hi Manuranga, I have a widget and gadget in my dashboard page. The widget is to filter some values and then gadget will display the filtered data using the publisher-subscriber model. When I'm navigating to the dashboard page from my main page, I'm passing some params in the URL. I want to read those request param from the page URL and publish those values to the gadget. I'm using '*parent.window.location' *to read the request params inside the widget and publishing that value to subscriber gadget. Lalanke said it's not a good way and suggested to get help from you. Also if I follow this approach and once the values are read from url, I try to publish the values and got *'Uncaught Error: OpenAjax.hub.Error.Disconnected*' error. So what is the best way to read request params and publish it? Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [DAS] Packaging artifacts as CAR file
Hi Devs, I refer this document [1] to create car file to deploy the artifacts in DAS. According to this, can't we package a widget inside the car file? [1]. https://docs.wso2.com/display/DAS300/Packaging+Artifacts+as+a+C-App+Archive Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Packaging artifacts as CAR file
Hi Sinthuja,
Yes I'm getting this error:
[2015-09-17 12:21:44,174] ERROR
{org.wso2.carbon.application.deployer.internal.ApplicationManager} - Some
dependencies in cApp : Stratos-Metering-Service_1.0.0 were not satisfied.
Check whether all dependent artifacts are included in cApp file :
/home/thanujau/Music/wso2das-3.0.0-SNAPSHOT/repository/deployment/server/carbonapps/Stratos-Metering-Service.car
Thanks.
On Thu, Sep 17, 2015 at 12:33 PM, Sinthuja Ragendran
wrote:
> adding Dunith,
>
> I think it should be possible, and should be same as gadget. Are you
> experiencing any exception when you do so?
>
> Thanks,
> Sinthuja.
>
> On Thu, Sep 17, 2015 at 12:26 PM, Thanuja Uruththirakodeeswaran <
> thanu...@wso2.com> wrote:
>
>> Hi Devs,
>>
>> I refer this document [1] to create car file to deploy the artifacts in
>> DAS. According to this, can't we package a widget inside the car file?
>>
>> [1].
>> https://docs.wso2.com/display/DAS300/Packaging+Artifacts+as+a+C-App+Archive
>>
>> Thanks.
>>
>> --
>> Thanuja Uruththirakodeeswaran
>> Software Engineer
>> WSO2 Inc.;http://wso2.com
>> lean.enterprise.middleware
>>
>> mobile: +94 774363167
>>
>
>
>
> --
> *Sinthuja Rajendran*
> Associate Technical Lead
> WSO2, Inc.:http://wso2.com
>
> Blog: http://sinthu-rajan.blogspot.com/
> Mobile: +94774273955
>
>
>
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Packaging artifacts as CAR file
Hi Dunith,
Thanks a lot for pointing this out.
Thanks.
On Thu, Sep 17, 2015 at 2:19 PM, Dunith Dhanushka wrote:
> Hi Thanuja,
>
> Widget deployment has not been enabled yet for DAS since Widget concept
> was introduced later. For the moment you have to manually copy your widgets
> into /portal/store//widgets folder.
>
> Regards,
> Dunith
>
> On Thu, Sep 17, 2015 at 2:10 PM, Sinthuja Ragendran
> wrote:
>
>> Hi Thanuja,
>>
>> Check whether your artefact.xml are properly confifgured with correct
>> type, and you don't have any spelling mistakes in the files. I have seen
>> similar issues when there are issue in the car file..
>>
>> Thanks,
>> Sinthuja.
>>
>>
>>
>> On Thu, Sep 17, 2015 at 1:55 PM, Thanuja Uruththirakodeeswaran <
>> thanu...@wso2.com> wrote:
>>
>>> Hi Sinthuja,
>>>
>>> Yes I'm getting this error:
>>> [2015-09-17 12:21:44,174] ERROR
>>> {org.wso2.carbon.application.deployer.internal.ApplicationManager} - Some
>>> dependencies in cApp : Stratos-Metering-Service_1.0.0 were not satisfied.
>>> Check whether all dependent artifacts are included in cApp file :
>>> /home/thanujau/Music/wso2das-3.0.0-SNAPSHOT/repository/deployment/server/carbonapps/Stratos-Metering-Service.car
>>>
>>> Thanks.
>>>
>>> On Thu, Sep 17, 2015 at 12:33 PM, Sinthuja Ragendran
>>> wrote:
>>>
>>>> adding Dunith,
>>>>
>>>> I think it should be possible, and should be same as gadget. Are you
>>>> experiencing any exception when you do so?
>>>>
>>>> Thanks,
>>>> Sinthuja.
>>>>
>>>> On Thu, Sep 17, 2015 at 12:26 PM, Thanuja Uruththirakodeeswaran <
>>>> thanu...@wso2.com> wrote:
>>>>
>>>>> Hi Devs,
>>>>>
>>>>> I refer this document [1] to create car file to deploy the artifacts
>>>>> in DAS. According to this, can't we package a widget inside the car file?
>>>>>
>>>>> [1].
>>>>> https://docs.wso2.com/display/DAS300/Packaging+Artifacts+as+a+C-App+Archive
>>>>>
>>>>> Thanks.
>>>>>
>>>>> --
>>>>> Thanuja Uruththirakodeeswaran
>>>>> Software Engineer
>>>>> WSO2 Inc.;http://wso2.com
>>>>> lean.enterprise.middleware
>>>>>
>>>>> mobile: +94 774363167
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> *Sinthuja Rajendran*
>>>> Associate Technical Lead
>>>> WSO2, Inc.:http://wso2.com
>>>>
>>>> Blog: http://sinthu-rajan.blogspot.com/
>>>> Mobile: +94774273955
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Thanuja Uruththirakodeeswaran
>>> Software Engineer
>>> WSO2 Inc.;http://wso2.com
>>> lean.enterprise.middleware
>>>
>>> mobile: +94 774363167
>>>
>>
>>
>>
>> --
>> *Sinthuja Rajendran*
>> Associate Technical Lead
>> WSO2, Inc.:http://wso2.com
>>
>> Blog: http://sinthu-rajan.blogspot.com/
>> Mobile: +94774273955
>>
>>
>>
>
>
> --
> Regards,
>
> Dunith Dhanushka,
> Senior Software Engineer
> WSO2 Inc,
>
> Mobile - +94 71 8615744
> Blog - dunithd.wordpress.com <http://blog.dunith.com>
> Twitter - @dunithd <http://twitter.com/dunithd>
>
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Creating user Define Functions in spark-sql
Hi Isuru, Yes, it is not possible to query date directly from spark-sql. I also had a requirement to get current time when executing a query in spark ( similar to mysql NOW()) and formatting a timestamp which is in milli-second to some data format. You can write User Defined Function(UDF) in spark-sql and use it in DAS spark environment as described in this blog [1]. [1]. http://thanu912.blogspot.com/2015/08/using-user-defined-function-udf-in.html Thanks. On Thu, Sep 24, 2015 at 1:56 PM, Isuru Wijesinghe wrote: > Hi, > > I was trying to query on process and task instance data using spark-sql > which published from BPMNDataPublisher to the DAS. Here I need to convert > the date string (eg: Thu Sep 24 09:35:56 IST 2015) into one of the > datetime format that allows in spark. I think it is not possible to query > date directly from spark-sql so I'm thinking of writing a user define > function for it. > > Is it possible to write udf in spark-SQL (like in hive) and if possible > how can I import it into das to run the script? > > (Please find the attached image of the sample data which stored in the das > side) > > > -- > Isuru Wijesinghe > *Software Engineer* > Mobile: 0710933706 > isur...@wso2.com > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [DAS] Line chart y-axis scale and range problems
Hi All, I'm generating a line chart to show details with DAS analytics dashboard using Line Chart Gadgets as below. This line chart uses D3 library and Vega. Here I'm facing following problems: 1. Even though member count values (Y axis values) are integers, in this chart axis values are populated as decimals and I tried to use 'round' property for y axis configuration and couldn't fix it. 2. Also y axis value range is also limited to 5 as shown above 3. As shown in the below image, tool-tip pop y axis value shown as undefined and sometimes tool-tips are not removed. I discussed these issues with Dunith also. It will be helpful if these issues are fixed. Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Line chart y-axis scale and range problems
Hi Nipuna, Tharik, Thanks a lot for the suggestions. I'll follow your suggestions and let you know. Thanks. On Fri, Sep 25, 2015 at 5:05 PM, Tharik Kanaka wrote: > Hi Thanuja, > > I have already noticed this in CEP and reported in a JIRA [1]. This only > happens when you multiple lines to chart. Root cause for this is that Vega > chart will draw the Y axis by considering only first column values. In your > case it has considered "CreatedInstanceCount" where as other lines are > plotted outside. > > You will see decimals since Y axis meant to plot 10 points since maximum > value is 5, it is plotted by 0.5. It will not happen if maximum value > becomes large number such as 50 where as plotting will happen by 5, 10, 15 > and so on. > > [1] https://wso2.org/jira/browse/CEP-1387 > > On Fri, Sep 25, 2015 at 4:27 PM, Nipuna Chandradasa > wrote: > >> Hi Thanuja, >> >> Quick fix for few of these problems. >> >> For the 1st one check the domain which define the range of the y scale. >> may be they are given in decimals. >> >> most of the time y axis value range is mapped with the height of the SVG >> element. if you can quickly look in to it and just adjust the width of the >> SVG element or change the range mapping value in y scale u may be able to >> solve 2nd issue. >> >> >> Thanks. >> >> >> On Fri, Sep 25, 2015 at 4:05 PM, Thanuja Uruththirakodeeswaran < >> thanu...@wso2.com> wrote: >> >>> Hi All, >>> >>> I'm generating a line chart to show details with DAS analytics dashboard >>> using Line Chart Gadgets as below. This line chart uses D3 library and >>> Vega. >>> >>> >>> >>> Here I'm facing following problems: >>> 1. Even though member count values (Y axis values) are integers, in this >>> chart axis values are populated as decimals and I tried to use 'round' >>> property for y axis configuration and couldn't fix it. >>> >>> 2. Also y axis value range is also limited to 5 as shown above >>> >>> 3. As shown in the below image, tool-tip pop y axis value shown as >>> undefined and sometimes tool-tips are not removed. >>> >>> >>> >>> I discussed these issues with Dunith also. It will be helpful if these >>> issues are fixed. >>> >>> Thanks. >>> >>> -- >>> Thanuja Uruththirakodeeswaran >>> Software Engineer >>> WSO2 Inc.;http://wso2.com >>> lean.enterprise.middleware >>> >>> mobile: +94 774363167 >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> Nipuna Marcus >> *Software Engineer* >> WSO2 Inc. >> http://wso2.com/ - "lean . enterprise . middleware" >> Mobile : +94 (0) 713 667906 >> nipu...@wso2.com >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > > *Tharik Kanaka* > > WSO2, Inc |#20, Palm Grove, Colombo 03, Sri Lanka > > Email: tha...@wso2.com | Web: www.wso2.com > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Line chart y-axis scale and range problems
Hi Tharik, Yes as you said vega chart is drawing the y axis by considering the first column (here in my case CreatedInstanceCount) as shown in the below image [1]. As we discussed in offline, in my case I can't define the max value to some constant as with time interval, member count will vary. Thanks a lot for the help Tharik. Thanks. On Fri, Sep 25, 2015 at 5:53 PM, Thanuja Uruththirakodeeswaran < thanu...@wso2.com> wrote: > Hi Nipuna, Tharik, > > Thanks a lot for the suggestions. I'll follow your suggestions and let you > know. > > Thanks. > > On Fri, Sep 25, 2015 at 5:05 PM, Tharik Kanaka wrote: > >> Hi Thanuja, >> >> I have already noticed this in CEP and reported in a JIRA [1]. This only >> happens when you multiple lines to chart. Root cause for this is that Vega >> chart will draw the Y axis by considering only first column values. In your >> case it has considered "CreatedInstanceCount" where as other lines are >> plotted outside. >> >> You will see decimals since Y axis meant to plot 10 points since maximum >> value is 5, it is plotted by 0.5. It will not happen if maximum value >> becomes large number such as 50 where as plotting will happen by 5, 10, 15 >> and so on. >> >> [1] https://wso2.org/jira/browse/CEP-1387 >> >> On Fri, Sep 25, 2015 at 4:27 PM, Nipuna Chandradasa >> wrote: >> >>> Hi Thanuja, >>> >>> Quick fix for few of these problems. >>> >>> For the 1st one check the domain which define the range of the y scale. >>> may be they are given in decimals. >>> >>> most of the time y axis value range is mapped with the height of the SVG >>> element. if you can quickly look in to it and just adjust the width of the >>> SVG element or change the range mapping value in y scale u may be able to >>> solve 2nd issue. >>> >>> >>> Thanks. >>> >>> >>> On Fri, Sep 25, 2015 at 4:05 PM, Thanuja Uruththirakodeeswaran < >>> thanu...@wso2.com> wrote: >>> >>>> Hi All, >>>> >>>> I'm generating a line chart to show details with DAS analytics >>>> dashboard using Line Chart Gadgets as below. This line chart uses D3 >>>> library and Vega. >>>> >>>> >>>> >>>> Here I'm facing following problems: >>>> 1. Even though member count values (Y axis values) are integers, in >>>> this chart axis values are populated as decimals and I tried to use 'round' >>>> property for y axis configuration and couldn't fix it. >>>> >>>> 2. Also y axis value range is also limited to 5 as shown above >>>> >>>> 3. As shown in the below image, tool-tip pop y axis value shown as >>>> undefined and sometimes tool-tips are not removed. >>>> >>>> >>>> >>>> I discussed these issues with Dunith also. It will be helpful if these >>>> issues are fixed. >>>> >>>> Thanks. >>>> >>>> -- >>>> Thanuja Uruththirakodeeswaran >>>> Software Engineer >>>> WSO2 Inc.;http://wso2.com >>>> lean.enterprise.middleware >>>> >>>> mobile: +94 774363167 >>>> >>>> _______ >>>> Dev mailing list >>>> Dev@wso2.org >>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>> >>>> >>> >>> >>> -- >>> Nipuna Marcus >>> *Software Engineer* >>> WSO2 Inc. >>> http://wso2.com/ - "lean . enterprise . middleware" >>> Mobile : +94 (0) 713 667906 >>> nipu...@wso2.com >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> >> *Tharik Kanaka* >> >> WSO2, Inc |#20, Palm Grove, Colombo 03, Sri Lanka >> >> Email: tha...@wso2.com | Web: www.wso2.com >> > > > > -- > Thanuja Uruththirakodeeswaran > Software Engineer > WSO2 Inc.;http://wso2.com > lean.enterprise.middleware > > mobile: +94 774363167 > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Line chart y-axis scale and range problems
Hi Dunith, Thanks a lot for the fix you gave :). It's really helpful and now problem-2 is fixed and it's working fine. As you said Tharik also said problem-1 is a limitation in vega and he has already reported an issue in vega github[1]. [1]. https://github.com/vega/vega/issues/371 Thanks. On Sun, Sep 27, 2015 at 9:52 PM, Dunith Dhanushka wrote: > Hi, > > Incorrect calculation of chart scales caused some points to plot outside > the grid area. When there are multiple values for the Y axis like [1,2,3] > in the chart configuration, only 1 was passed for scale calculation so that > points belong to other series plotted outside. > > This behaviour is fixed now. Take an update from > https://github.com/wso2/VizGrammar/igviz.js > > It seems like [1] is a limitation of Vega. > > Will provide a fix for getting "undefined" for tooltip value. > > Regards, > Dunith > > On Fri, Sep 25, 2015 at 8:58 PM, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi Tharik, >> >> Yes as you said vega chart is drawing the y axis by considering the first >> column (here in my case CreatedInstanceCount) as shown in the below image >> [1]. As we discussed in offline, in my case I can't define the max value to >> some constant as with time interval, member count will vary. Thanks a lot >> for the help Tharik. >> >> Thanks. >> >> On Fri, Sep 25, 2015 at 5:53 PM, Thanuja Uruththirakodeeswaran < >> thanu...@wso2.com> wrote: >> >>> Hi Nipuna, Tharik, >>> >>> Thanks a lot for the suggestions. I'll follow your suggestions and let >>> you know. >>> >>> Thanks. >>> >>> On Fri, Sep 25, 2015 at 5:05 PM, Tharik Kanaka wrote: >>> >>>> Hi Thanuja, >>>> >>>> I have already noticed this in CEP and reported in a JIRA [1]. This >>>> only happens when you multiple lines to chart. Root cause for this is that >>>> Vega chart will draw the Y axis by considering only first column values. In >>>> your case it has considered "CreatedInstanceCount" where as other lines are >>>> plotted outside. >>>> >>>> You will see decimals since Y axis meant to plot 10 points since >>>> maximum value is 5, it is plotted by 0.5. It will not happen if maximum >>>> value becomes large number such as 50 where as plotting will happen by 5, >>>> 10, 15 and so on. >>>> >>>> [1] https://wso2.org/jira/browse/CEP-1387 >>>> >>>> On Fri, Sep 25, 2015 at 4:27 PM, Nipuna Chandradasa >>>> wrote: >>>> >>>>> Hi Thanuja, >>>>> >>>>> Quick fix for few of these problems. >>>>> >>>>> For the 1st one check the domain which define the range of the y >>>>> scale. may be they are given in decimals. >>>>> >>>>> most of the time y axis value range is mapped with the height of the >>>>> SVG element. if you can quickly look in to it and just adjust the width of >>>>> the SVG element or change the range mapping value in y scale u may be able >>>>> to solve 2nd issue. >>>>> >>>>> >>>>> Thanks. >>>>> >>>>> >>>>> On Fri, Sep 25, 2015 at 4:05 PM, Thanuja Uruththirakodeeswaran < >>>>> thanu...@wso2.com> wrote: >>>>> >>>>>> Hi All, >>>>>> >>>>>> I'm generating a line chart to show details with DAS analytics >>>>>> dashboard using Line Chart Gadgets as below. This line chart uses D3 >>>>>> library and Vega. >>>>>> >>>>>> >>>>>> >>>>>> Here I'm facing following problems: >>>>>> 1. Even though member count values (Y axis values) are integers, in >>>>>> this chart axis values are populated as decimals and I tried to use >>>>>> 'round' >>>>>> property for y axis configuration and couldn't fix it. >>>>>> >>>>>> 2. Also y axis value range is also limited to 5 as shown above >>>>>> >>>>>> 3. As shown in the below image, tool-tip pop y axis value shown as >>>>>> undefined and sometimes tool-tips are not removed. >>>>>> >>>>>> >>>>>> >>>>>> I discussed these issues with Dunith also. It will be helpful if
Re: [Dev] [UES] Reading request parameters of dashboard page URL inside widget and publish it
Hi Manuranga, Lalanke, As we discussed offline, currently Lalanke is doing some implementation to publish data from dashboard to gadget using pub-sub model and with the help of Lalanke I was able to patch locally DAS analytics dashboard to use above mentioned feature. Thanks a lot for the help Manurnga and Lalanke. Could you please point out the Jira issue to track this? Thanks. On Wed, Sep 16, 2015 at 9:34 AM, Manuranga Perera wrote: > Hi Thanuja, > Way are you trying to pass the URL parameters? can you please explain what > you trying to implement. and please give us a example of the parameter. > > On Tue, Sep 15, 2015 at 10:27 PM, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi Manuranga, >> >> I have a widget and gadget in my dashboard page. The widget is to filter >> some values and then gadget will display the filtered data using the >> publisher-subscriber model. >> When I'm navigating to the dashboard page from my main page, I'm passing >> some params in the URL. I want to read those request param from the page >> URL and publish those values to the gadget. >> I'm using '*parent.window.location' *to read the request params inside >> the widget and publishing that value to subscriber gadget. >> Lalanke said it's not a good way and suggested to get help from you. Also >> if I follow this approach and once the values are read from url, I try to >> publish the values and got *'Uncaught Error: >> OpenAjax.hub.Error.Disconnected*' error. >> So what is the best way to read request params and publish it? >> >> Thanks. >> >> >> >> -- >> Thanuja Uruththirakodeeswaran >> Software Engineer >> WSO2 Inc.;http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 774363167 >> > > > > -- > With regards, > *Manu*ranga Perera. > > phone : 071 7 70 20 50 > mail : m...@wso2.com > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [UES] Reading request parameters of dashboard page URL inside widget and publish it
Hi Manuranga, I have create a jira [1] to track this issue and attached the local modification I've done. Thanks. [1]. https://wso2.org/jira/browse/UES-582 On Tue, Sep 29, 2015 at 10:00 AM, Manuranga Perera wrote: > we don't have a jira for this. please create one and attach the local > modification you have. > > On Tue, Sep 29, 2015 at 9:59 AM, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi Manuranga, Lalanke, >> >> As we discussed offline, currently Lalanke is doing some implementation >> to publish data from dashboard to gadget using pub-sub model and with the >> help of Lalanke I was able to patch locally DAS analytics dashboard to use >> above mentioned feature. Thanks a lot for the help Manurnga and Lalanke. >> Could you please point out the Jira issue to track this? >> >> Thanks. >> >> On Wed, Sep 16, 2015 at 9:34 AM, Manuranga Perera wrote: >> >>> Hi Thanuja, >>> Way are you trying to pass the URL parameters? can you please explain >>> what you trying to implement. and please give us a example of the parameter. >>> >>> On Tue, Sep 15, 2015 at 10:27 PM, Thanuja Uruththirakodeeswaran < >>> thanu...@wso2.com> wrote: >>> >>>> Hi Manuranga, >>>> >>>> I have a widget and gadget in my dashboard page. The widget is to >>>> filter some values and then gadget will display the filtered data using the >>>> publisher-subscriber model. >>>> When I'm navigating to the dashboard page from my main page, I'm >>>> passing some params in the URL. I want to read those request param from the >>>> page URL and publish those values to the gadget. >>>> I'm using '*parent.window.location' *to read the request params inside >>>> the widget and publishing that value to subscriber gadget. >>>> Lalanke said it's not a good way and suggested to get help from you. >>>> Also if I follow this approach and once the values are read from url, I try >>>> to publish the values and got *'Uncaught Error: >>>> OpenAjax.hub.Error.Disconnected*' error. >>>> So what is the best way to read request params and publish it? >>>> >>>> Thanks. >>>> >>>> >>>> >>>> -- >>>> Thanuja Uruththirakodeeswaran >>>> Software Engineer >>>> WSO2 Inc.;http://wso2.com >>>> lean.enterprise.middleware >>>> >>>> mobile: +94 774363167 >>>> >>> >>> >>> >>> -- >>> With regards, >>> *Manu*ranga Perera. >>> >>> phone : 071 7 70 20 50 >>> mail : m...@wso2.com >>> >> >> >> >> -- >> Thanuja Uruththirakodeeswaran >> Software Engineer >> WSO2 Inc.;http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 774363167 >> > > > > -- > With regards, > *Manu*ranga Perera. > > phone : 071 7 70 20 50 > mail : m...@wso2.com > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [DAS] MySQL Database and Table creation when using carbonJDBC option in spark environment
Hi All, When we create temporary tables in spark environment using carbonJDBC option as explained in [1], we are using a datasource and tableName from which spark environment temporary table will get data as follow: CREATE TEMPORARY TABLE using CarbonJDBC options (dataSource "", tableName ""); I've used a mysql database (sample_datasource) for datasource and used mysql tables created in that database for tableName (sample_table) as follow: CREATE TEMPORARY TABLE sample using CarbonJDBC options (dataSource " sample_datasource", tableName "sample_table"); But I'm creating the mysql database and tables by executing sql statements manually. Is there a way in DAS that we can add these sql statements inside a script and create the database and tables when we start the server? [1]. https://docs.wso2.com/display/DAS300/Spark+Query+Language Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] MySQL Database and Table creation when using carbonJDBC option in spark environment
Hi Imesh, If we take the above scenario, I need to insert the analyzed/aggregated data which is obtained as result after spark sql processing, to my mysql table (sample_table). In order to do that, first we need to create a temporary table using the corresponding mysql database (sample_datasource) and table(sample_table) in spark environment and then only by inserting data to this temporary table in spark environment, we can update our mysql table. In DAS spark environment, we can't directly insert the analyzed data to our mysql table. We should create a temporary table using our datasources to manipulate them. I think that's why they named it as '*temporary*' table. @Niranda Please correct me if I'm wrong. Thanks. On Thu, Oct 1, 2015 at 7:00 AM, Imesh Gunaratne wrote: > Hi Thanuja, > > Can you please explain the purpose of these temporary tables? > > Thanks > > On Wed, Sep 30, 2015 at 11:53 PM, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi All, >> >> When we create temporary tables in spark environment using carbonJDBC >> option as explained in [1], we are using a datasource and tableName from >> which spark environment temporary table will get data as follow: >> CREATE TEMPORARY TABLE using CarbonJDBC options (dataSource >> "> name>", tableName ""); >> >> I've used a mysql database (sample_datasource) for datasource and used >> mysql tables created in that database for tableName (sample_table) as >> follow: >> CREATE TEMPORARY TABLE sample using CarbonJDBC options (dataSource " >> sample_datasource", tableName "sample_table"); >> >> But I'm creating the mysql database and tables by executing sql >> statements manually. Is there a way in DAS that we can add these sql >> statements inside a script and create the database and tables when we start >> the server? >> >> [1]. https://docs.wso2.com/display/DAS300/Spark+Query+Language >> >> Thanks. >> >> -- >> Thanuja Uruththirakodeeswaran >> Software Engineer >> WSO2 Inc.;http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 774363167 >> >> _______ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > *Imesh Gunaratne* > Senior Technical Lead > WSO2 Inc: http://wso2.com > T: +94 11 214 5345 M: +94 77 374 2057 > W: http://imesh.gunaratne.org > Lean . Enterprise . Middleware > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] MySQL Database and Table creation when using carbonJDBC option in spark environment
Hi Imesh,
Please find the answers below:
1. What does this analysis do?
What I'm processing using spark query is from the raw data I received as
thrift events, I'm counting members is different states per application and
cluster every t sec. Spark script is scheduled to execute every t sec to do
that.
2. Why we cannot directly insert them to the RDBMS?
I'm doing the above processing in DAS spark environment / DAL (Data Access
Layer), we can't insert the results directly to RDBMS, because DAL don't
know anything about our RDBMS table and we are using temporary table to do
mapping only to RDBMS table in spark environment and as I understand
'create temporary table' will not create a physical table and do a mapping
to our RDBMS table in spark environment.
Thanks.
On Thu, Oct 1, 2015 at 1:33 PM, Sinthuja Ragendran
wrote:
> Hi Niranda,
>
> On Thu, Oct 1, 2015 at 1:28 PM, Niranda Perera wrote:
>
>> Hi Thanuja and Imesh,
>>
>> let me clarify the use of the term "create temporary table" with regard
>> to Spark.
>> inside DAS we save ('persist') data in DAL (Dara access layer) tables. So
>> in order for us to query these tables, spark needs some sort of a mapping
>> to the tables in DAL in its runtime environment. This mapping is created in
>> the temporary table queries. These temp tables are only a mapping. Not a
>> physical table.
>>
>> @thanuja, yes you are correct! We have to manually create the tables in
>> MySQL before making the temp table mapping in Spark SQL.
>>
> With Carbon JDBC connector, can we try to create the table if it is not
> existing? May be we can let the users to pass the actual create table
> statement as another parameter with options. IMHO it will be more user
> friendly if we could do that, WDYT?
>
> Thanks,
> Sinthuja.
>
>
>> On Thu, Oct 1, 2015 at 9:53 AM, Thanuja Uruththirakodeeswaran <
>> thanu...@wso2.com> wrote:
>>>
>>>
>>> In DAS spark environment, we can't directly insert the analyzed data to
>>> our mysql table. We should create a temporary table using our datasources
>>> to manipulate them.
>>>
>>
>> Yes, can you please explain the reasons? What does this analysis do? Why
>> we cannot directly insert them to the RDBMS?
>>
>> Thanks
>>
>> On Thu, Oct 1, 2015 at 9:53 AM, Thanuja Uruththirakodeeswaran <
>> thanu...@wso2.com> wrote:
>>
>>> Hi Imesh,
>>>
>>> If we take the above scenario, I need to insert the analyzed/aggregated
>>> data which is obtained as result after spark sql processing, to my mysql
>>> table (sample_table). In order to do that, first we need to create a
>>> temporary table using the corresponding mysql database (sample_datasource)
>>> and table(sample_table) in spark environment and then only by inserting
>>> data to this temporary table in spark environment, we can update our mysql
>>> table.
>>>
>>> In DAS spark environment, we can't directly insert the analyzed data to
>>> our mysql table. We should create a temporary table using our datasources
>>> to manipulate them. I think that's why they named it as '*temporary*'
>>> table.
>>>
>>> @Niranda Please correct me if I'm wrong.
>>>
>>> Thanks.
>>>
>>> On Thu, Oct 1, 2015 at 7:00 AM, Imesh Gunaratne wrote:
>>>
>>>> Hi Thanuja,
>>>>
>>>> Can you please explain the purpose of these temporary tables?
>>>>
>>>> Thanks
>>>>
>>>> On Wed, Sep 30, 2015 at 11:53 PM, Thanuja Uruththirakodeeswaran <
>>>> thanu...@wso2.com> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> When we create temporary tables in spark environment using carbonJDBC
>>>>> option as explained in [1], we are using a datasource and tableName from
>>>>> which spark environment temporary table will get data as follow:
>>>>> CREATE TEMPORARY TABLE using CarbonJDBC options
>>>>> (dataSource "", tableName "");
>>>>>
>>>>> I've used a mysql database (sample_datasource) for datasource and used
>>>>> mysql tables created in that database for tableName (sample_table) as
>>>>> follow:
>>>>> CREATE TEMPORARY TABLE sample using CarbonJDBC options (dataSource "
>>>>> sample_datasource", tableName "sample_table");
>>>>>
>>>>> But I'm creating the mysql database and
Re: [Dev] [PPaaS] private-paas-cartridges repository structure
e for the configurator. WDYT? >>>>>>>> >>>>>>>> Thanks, >>>>>>>> Gayan >>>>>>>> >>>>>>>> On Wed, Sep 30, 2015 at 10:44 PM, Gayan Gunarathne >>>>>>> > wrote: >>>>>>>> >>>>>>>>> Hi, >>>>>>>>> >>>>>>>>> On Wed, Sep 30, 2015 at 9:48 PM, Akila Ravihansa Perera < >>>>>>>>> raviha...@wso2.com> wrote: >>>>>>>>> >>>>>>>>>> +1 for having a simple folder structure. I think we can move the >>>>>>>>>> contents in /common/ folder to root folder. One can easily identify >>>>>>>>>> the >>>>>>>>>> important files available and easy to navigate as well. >>>>>>>>>> >>>>>>>>>> What should be the Maven groupId for this repo? How about >>>>>>>>>> "org.wso2.ppaas.cartridges" or "org.wso2.cartridges" ? >>>>>>>>>> >>>>>>>>> We can use org.wso2.ppaas.cartridges as groupId >>>>>>>>> >>>>>>>>> Thanks, >>>>>>>>> Gayan >>>>>>>>> >>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>>> On Wed, Sep 30, 2015 at 9:24 PM, Imesh Gunaratne >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> I would like to reduce the complexity of the folder structure >>>>>>>>>>> and make it much simple. Shall we have some thing like below: >>>>>>>>>>> >>>>>>>>>>> private-paas-cartridges/ >>>>>>>>>>> |--/common/ >>>>>>>>>>>|--/configurator/ >>>>>>>>>>>|--/puppet/ >>>>>>>>>>> |--/wso2-installer/ >>>>>>>>>>>|--/scripts/ >>>>>>>>>>> |---/ec2/init.sh >>>>>>>>>>> |---/openstack/init.sh >>>>>>>>>>> >>>>>>>>>>> |--/wso2esb/4.9.0/ >>>>>>>>>>>|-/template-module/ >>>>>>>>>>>|-/cartridge-agent-plugins/ >>>>>>>>>>>|-/application/ >>>>>>>>>>>|-/docker/ >>>>>>>>>>> >>>>>>>>>>> Thanks >>>>>>>>>>> >>>>>>>>>>> On Wed, Sep 30, 2015 at 9:13 PM, Imesh Gunaratne >>>>>>>>>> > wrote: >>>>>>>>>>> >>>>>>>>>>>> May be we can have this discussion in Dev, I cannot see any >>>>>>>>>>>> reason to take this private. >>>>>>>>>>>> >>>>>>>>>>>> Thanks >>>>>>>>>>>> >>>>>>>>>>>> On Wed, Sep 30, 2015 at 6:26 PM, Gayan Gunarathne < >>>>>>>>>>>> gay...@wso2.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Adding Engineering group >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- Forwarded message -- >>>>>>>>>>>>> From: Gayan Gunarathne >>>>>>>>>>>>> Date: Wed, Sep 30, 2015 at 6:26 PM >>>>>>>>>>>>> Subject: [PPaaS] private-paas-cartridges repository structure >>>>>>>>>>>>> To: Imesh Gunaratne , Reka Thirunavukkarasu < >>>>>>>>>>>>> r...@wso2.com>, Udara Liyanage , Lahiru >>>>>>>>>>>>> Sandaruwa
[Dev] [DAS] SingelSignOn support in DAS Analytics Dashboard
Hi All, I'm currently integrating Private PaaS metering dashboard implemented using DAS analytics dashboard in Private PaaS UI. In Private PaaS applications' topology view, I've added metering dashboard navigation url, and when I'm navigating to dashboard, there we again need to log in to see the dashboard. I have already discussed about this with Sinthuja. She mentioned following that currently in DAS carbon console UI, there is a navigation to analytics dashboard. But there also user has to log in again. Does DAS analytics dashboard support single-sign-on currently? -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Performing SQL COUNT() operation through luciene
Hi Isuru, I think Gimantha has already discussed about this in this thread [1]. The link suggests to do lucene 'group by' queries using writing a custom facet collector. [1]. http://mail-archives.apache.org/mod_mbox/lucene-java-user/201508.mbox/%3CCAPz8bx2j3eM9L6q=r0_XV-8=rskwct84+m3vkchhwk-hopc...@mail.gmail.com%3E Thanks. On Tue, Oct 6, 2015 at 10:59 PM, Isuru Wijesinghe wrote: > Hi Anjana, > > I think the link [1] given something similar to *where* clause in sql (I > mean the *query *part is something similar to *where *clause). Here what > I really need to do is, use the count operation with *group by. * In > addition to that does luicene support for ascending and descending order > ??? > > On Tue, Oct 6, 2015 at 3:54 PM, Anjana Fernando wrote: > >> Hi Isuru, >> >> You can use the REST APIs search count [1] operation. >> >> [1] >> https://docs.wso2.com/display/DAS300/Retrieving+the+Number+of+Records+Matching+the+Given+Search+Query+via+REST+API >> >> Cheers, >> Anjana. >> >> On Tue, Oct 6, 2015 at 1:04 PM, Isuru Wijesinghe >> wrote: >> >>> Hi, >>> >>> I need to perform COUNT() operation through DAS REST API (an example is >>> shown below). I tried to pass COUNT() from a luciene object. But it didn't >>> work for me. Does DAS support COUNT operation through luciene ??? if not >>> how can I enable it in DAS side??? >>> >>> eg: *SELECT startedTime, processDefinitionId, COUNT(processInstanceId) >>> AS processInstanceCount FROM PROCESS_USAGE_SUMMARY GROUP BY startedTime, >>> processDefinitionId;* >>> >>> In addition to that, is that possible to pass more than one parameter to >>> the query part in luicene object, because most graphs have to provide a >>> secondary filter to get the result. As an example I need to filter the >>> result from date range as well as process id. I need something like this. >>> >>> *"query" : "timestamp : [1243214324532 TO 4654365223], processId : >>> 10035" * >>> >>> Any help will be appreciated. >>> >>> -- >>> Isuru Wijesinghe >>> *Software Engineer* >>> Mobile: 0710933706 >>> isur...@wso2.com >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> *Anjana Fernando* >> Senior Technical Lead >> WSO2 Inc. | http://wso2.com >> lean . enterprise . middleware >> > > > > -- > Isuru Wijesinghe > *Software Engineer* > Mobile: 0710933706 > isur...@wso2.com > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] DAS dashboard table-gadget column order
Hi All, I was able to change the column order in table gadget by giving the required columns in gadgetConfig.js file and set the columns varible inside getColumns() in main.js file as columns = gadgetConfig.columns; Also if want to change table column titles as we want (Ex: sometime database table have column as 'MemberId' and in the table gadget we want it as 'Member Id') by introducing a new property (Ex: LABEL_NAME) in gadgetConf.js file as shown in [1] and set this property as column title as in [2]. Complete custom table gadget can be found here [3]. [1]. https://github.com/apache/stratos/blob/stratos-4.1.x/extensions/das/metering-service/capps/stratos-metering-service/Gadget_Member_Status/Member_Status/js/gadgetconf.js [2]. https://github.com/apache/stratos/blob/stratos-4.1.x/extensions/das/metering-service/capps/stratos-metering-service/Gadget_Member_Status/Member_Status/js/main.js#L106 [3]. https://github.com/apache/stratos/tree/stratos-4.1.x/extensions/das/metering-service/capps/stratos-metering-service/Gadget_Member_Status Thanks. On Mon, Aug 24, 2015 at 2:56 PM, Gimantha Bandara wrote: > Hi Dunith, > > Are we internally processing the columns in the schema in gadget > generation.. Like changing the column order? Or are we simply > iterating the columns in the schema returned by JS API when creating > gadgets? > > On 8/24/15, Thanuja Uruththirakodeeswaran wrote: > > Hi Gimantha, > > > > Is there any solution to get Table Gadget column order as Data Explorer > > Table column order? > > > > Thanks. > > > > On Fri, Aug 14, 2015 at 8:20 PM, Thanuja Uruththirakodeeswaran < > > thanu...@wso2.com> wrote: > > > >> Hi Gimantha, > >> > >> Yes gadget table columns are not in the order as in schema. Data > explorer > >> has same column order as in schema. > >> > >> Thanks. > >> On 14 Aug 2015 18:18, "Gimantha Bandara" wrote: > >> > >>> Columns you define in the schema, does not map to RDBMS physical > >>> tables' columns. Are you saying that the gadget tables that you > >>> create, do not have the column order as it is in the schema? Is it in > >>> the same order in the Data explorer? > >>> > >>> On 8/14/15, Thanuja Uruththirakodeeswaran wrote: > >>> > Hi Gimantha, > >>> > > >>> > I used external HBase DB and DAS embedded H2 DB. I checked with HBase > >>> table > >>> > and table-gadget column order same as HBase table. I tried with H2 > >>> table, > >>> > but I couldn't see column names as I think it was encrypted or > >>> something. > >>> > How can I check the column names in DAS embedded H2 database? > >>> > > >>> > Thanks. > >>> > > >>> > On Fri, Aug 14, 2015 at 1:28 PM, Gimantha Bandara > > >>> > wrote: > >>> > > >>> >> Hi Thanuja, > >>> >> Is it same with the H2 table or only the HBase analytics table? > >>> >> > >>> >> > >>> >> On Thu, Aug 13, 2015 at 6:50 PM, Thanuja Uruththirakodeeswaran < > >>> >> thanu...@wso2.com> wrote: > >>> >> > >>> >>> Hi, > >>> >>> > >>> >>> I've persisted a event stream in event store which is a HBase > >>> database. > >>> >>> Then using the following query I created table in spark > environment. > >>> Also > >>> >>> I > >>> >>> used H2 database as processed store. > >>> >>> > >>> >>> CREATE TEMPORARY TABLE memberinfo > >>> >>> USING CarbonAnalytics > >>> >>> OPTIONS (tableName "MEMBER_INFO"); > >>> >>> > >>> >>> CREATE TEMPORARY TABLE memberdetails > >>> >>> USING CarbonAnalytics > >>> >>> OPTIONS (tableName "MEMBER_DETAILS", schema "X STRING, Y STRING, Z > >>> >>> STRING"); > >>> >>> > >>> >>> INSERT OVERWRITE TABLE memberdetails select * from memberinfo; > >>> >>> > >>> >>> Here MEMBER_INFO - HBase database table, MEMBER_DETAILS - H2 > >>> >>> database > >>> >>> table > >>> >>> > >>> >>> When I use the Data Explorer to see records in table > >>> >>> "MEMBER_DETAILS", >
Re: [Dev] Maintaining layouts in a non-tenant-specific location
Hi All, +1 to move default gadgets, widgets and layouts to a common place and copy them to corresponding tenants folder when they login. Thanks. On 9 Oct 2015 15:48, "Tharik Kanaka" wrote: > > Hi Godkul, > > +1. We could move default gadgets, widgets and layouts to separate directory location instead placing them in carbon.super directory > > Regards, > > On Fri, Oct 9, 2015 at 3:01 PM, Gokul Balakrishnan wrote: >> >> Hi Manu, >> >> In carbon-dashboards, we're maintaining all pre-built layouts in the carbon.super directory and copying them over to the tenant space when the tenant logs in [1]. The issue with this behaviour is that any custom layouts the supertenant might have are also copied over. >> >> In order to avoid this, shall we maintain the layouts in a different location and copy them to both supertenant and tenant spaces upon login? >> >> [1] https://github.com/wso2/carbon-dashboards/blob/master/apps/portal/controllers/login.jag#L36 >> >> Thanks, >> >> -- >> Gokul Balakrishnan >> Senior Software Engineer, >> WSO2, Inc. http://wso2.com >> Mob: +94 77 593 5789 | +1 650 272 9927 > > > > > -- > > Tharik Kanaka > > WSO2, Inc |#20, Palm Grove, Colombo 03, Sri Lanka > > Email: tha...@wso2.com | Web: www.wso2.com > > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [CEP] [Siddhi] Error when using custom function in Siddhi Query
Hi All,
I need to get the current time when executing a siddhi query in CEP 3.0.0.
For that I wrote a custom function called 'now()' as below:
import org.wso2.siddhi.core.config.SiddhiContext;
import org.wso2.siddhi.core.executor.function.FunctionExecutor;
import org.wso2.siddhi.query.api.definition.Attribute;
import org.wso2.siddhi.query.api.extension.annotation.SiddhiExtension;
@SiddhiExtension(namespace = "stratos", function = "now")
public class TimeWindowProcessor extends FunctionExecutor {
Attribute.Type returnType = Attribute.Type.LONG;
@Override
public void init(Attribute.Type[] types, SiddhiContext siddhiContext) {
}
@Override
protected Object process(Object obj) {
return System.currentTimeMillis();
}
@Override
public void destroy() {
}
@Override
public Attribute.Type getReturnType() {
return returnType;
}
}
Then I tried to use the above function in siddhi query as below:
from avg_rif_stat
select cluster_id, cluster_instance_id, network_partition_id,
in_flight_request_count,
stratos:concat(cluster_id, '-' ,cluster_instance_id) as
avg_rif_cluster_network
insert into avg_rif_concat;
define partition avg_rif_cluster_partition by
avg_rif_concat.avg_rif_cluster_network;
from avg_rif_concat#window.timeBatch(1 min)
select *stratos:now() as timestamp*, cluster_id,
cluster_instance_id, network_partition_id,
avg(in_flight_request_count) as count
insert into average_in_flight_requests
partition by avg_rif_cluster_partition;
When I stratos server startup I'm getting the below exception:
[2015-10-16 14:24:21,940] INFO
{org.wso2.carbon.event.processor.core.internal.listener.EventReceiverStreamNotificationListenerImpl}
- Trying to redeploy configuration files for stream:
average_in_flight_requests:1.0.0
[2015-10-16 14:24:21,941] ERROR
{org.wso2.carbon.event.processor.core.internal.CarbonEventProcessorService}
- Externally defined stream:
StreamDefinition{
streamId='average_in_flight_requests:1.0.0',
name='average_in_flight_requests',
version='1.0.0',
nickName='average in-flight requests',
description='average of in-flight request count',
tags=null,
metaData=null,
correlationData=null,
*payloadData=[Attribute{name='timestamp', type=LONG},
Attribute{name='cluster_id', type=STRING},
Attribute{name='cluster_instance_id', type=STRING},
Attribute{name='network_partition_id', type=STRING},
Attribute{name='count', type=DOUBLE}],*
}
is different from the existing stream :
StreamDefinition{
streamId='average_in_flight_requests:1.0.0',
name='average_in_flight_requests',
version='1.0.0',
nickName='null',
description='null',
tags=null,
metaData=null,
correlationData=null,
*payloadData=[Attribute{name='timestamp', type=LONG}],*
}
When events are being published following exception is thrown:
[2015-10-16 15:56:57,716] ERROR
{org.wso2.siddhi.core.query.processor.window.TimeBatchWindowProcessor} -
Index: 1, Size: 1
java.lang.IndexOutOfBoundsException: Index: 1, Size: 1
at java.util.ArrayList.rangeCheck(ArrayList.java:635)
at java.util.ArrayList.get(ArrayList.java:411)
at
org.wso2.siddhi.core.query.selector.QuerySelector.process(QuerySelector.java:282)
at
org.wso2.siddhi.core.query.processor.window.TimeBatchWindowProcessor.run(TimeBatchWindowProcessor.java:115)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
I think I have a problem in using the custom function now() in siddhi
query. *If we don't have a parameter to pass in custom method, shall I use
it as now()?*
Please suggest a way to fix this problem.
Thanks.
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] MySQL Database and Table creation when using carbonJDBC option in spark environment
Hi Niranda,
I have created a jira [1] to track the issues we have in carbonJDBC option.
[1]. https://wso2.org/jira/browse/DAS-273
Thanks.
On Thu, Oct 1, 2015 at 3:12 PM, Sinthuja Ragendran
wrote:
> Hi Niranda,
>
> On Thu, Oct 1, 2015 at 2:28 PM, Inosh Goonewardena wrote:
>
>> Hi Niranda,
>>
>> On Thu, Oct 1, 2015 at 1:33 PM, Sinthuja Ragendran
>> wrote:
>>
>>> Hi Niranda,
>>>
>>> On Thu, Oct 1, 2015 at 1:28 PM, Niranda Perera wrote:
>>>
>>>> Hi Thanuja and Imesh,
>>>>
>>>> let me clarify the use of the term "create temporary table" with regard
>>>> to Spark.
>>>> inside DAS we save ('persist') data in DAL (Dara access layer) tables.
>>>> So in order for us to query these tables, spark needs some sort of a
>>>> mapping to the tables in DAL in its runtime environment. This mapping is
>>>> created in the temporary table queries. These temp tables are only a
>>>> mapping. Not a physical table.
>>>>
>>>> @thanuja, yes you are correct! We have to manually create the tables in
>>>> MySQL before making the temp table mapping in Spark SQL.
>>>>
>>> With Carbon JDBC connector, can we try to create the table if it is not
>>> existing? May be we can let the users to pass the actual create table
>>> statement as another parameter with options. IMHO it will be more user
>>> friendly if we could do that, WDYT?
>>>
>>
>> Yes. +1. For tables created using CarbonAnalytics it is possible to
>> provide the table schema as below [1]. I believe we can use the similar
>> approach in CarbonJDBC also to provide the create table query.
>>
>> As per the current implementation what happens is even though the table
>> is created manually before the script execution, "insert overwrite..."
>> statement execution will delete the original table and recreate a new table
>> using a generated schema(schema information is generated using the original
>> table structure). In this approach, table that is re-created at the query
>> execution will not have primary keys and indexes of the original table(if
>> there were any). So if we can provide a complete create table query, we can
>> preserve original table structure too.
>>
>
> Yeah, +1.
>
>
>>
>> On the other hand, I believe we should also support "insert into.."
>> statements in CarbonJDBC. "insert into.." statements will not delete and
>> recreate the table like the "insert overwrite..." statements, and it will
>> only update the existing table[2].
>>
>
> Yeah, I also have concern on this. Because currently the insert overwrite
> statement drops the table, and repopulate the data entirely, and hence the
> dashboard which reads from the table may be empty/partial data. This is
> also an issue when we are purging the original data scenario, where the
> summarised data will also be cleaned and no old data available to
> repopulate the summarised data again. Can we have it as replace the row if
> it's already existing in insert overwrite, rather dropping the entire table
> to avoid such issues?
>
> Thanks,
> Sinthuja.
>
>
>>
>> [1] CREATE TEMPORARY TABLE plugUsage
>> USING CarbonAnalytics
>> OPTIONS (tableName "plug_usage",
>> * schema "house_id INT, household_id INT, plug_id INT, usage
>> FLOAT"*,
>> primaryKeys "household_id, plug_id"
>> );
>>
>> [2] [Dev] [Architecture] Carbon Spark JDBC connector
>>
>>
>>>
>>> Thanks,
>>> Sinthuja.
>>>
>>>
>>>> On Thu, Oct 1, 2015 at 9:53 AM, Thanuja Uruththirakodeeswaran <
>>>> thanu...@wso2.com> wrote:
>>>>>
>>>>>
>>>>> In DAS spark environment, we can't directly insert the analyzed data
>>>>> to our mysql table. We should create a temporary table using our
>>>>> datasources to manipulate them.
>>>>>
>>>>
>>>> Yes, can you please explain the reasons? What does this analysis do?
>>>> Why we cannot directly insert them to the RDBMS?
>>>>
>>>> Thanks
>>>>
>>>> On Thu, Oct 1, 2015 at 9:53 AM, Thanuja Uruththirakodeeswaran <
>>>> thanu...@wso2.com> wrote:
>>>>
>>>>> Hi Imesh,
>>>>>
>>>>> If we take the above scenario, I need to insert the
>>>>> analyzed/aggregated data which is
Re: [Dev] [DAS] MySQL Database and Table creation when using carbonJDBC option in spark environment
3783)
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2447)
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2594)
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2545)
at
com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1901)
at
com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2113)
at
com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2049)
at
com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2034)
at
org.apache.spark.sql.jdbc.carbon.package$JDBCWriteDetails$.savePartition(carbon.scala:175)
at
org.apache.spark.sql.jdbc.carbon.package$JDBCWriteDetails$$anonfun$saveTable$1.apply(carbon.scala:107)
at
org.apache.spark.sql.jdbc.carbon.package$JDBCWriteDetails$$anonfun$saveTable$1.apply(carbon.scala:106)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$29.apply(RDD.scala:878)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$29.apply(RDD.scala:878)
at
org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1767)
at
org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1767)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:63)
at org.apache.spark.scheduler.Task.run(Task.scala:70)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Driver stacktrace:
at org.apache.spark.scheduler.DAGScheduler.org
$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1273)
at
org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1264)
at
org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1263)
at
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
at
org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1263)
at
org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:730)
at
org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:730)
at scala.Option.foreach(Option.scala:236)
at
org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:730)
at
org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1457)
at
org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1418)
at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
This is happening because every time the above 'INSERT INTO' script gets
executed, it tries to copy entire data in memberstatus carbonAnalytics
table to member_status_new carbonJDBC table and *at the time of trying to
insert a already existing record*, the above error is thrown.
But we can run a INSERT INTO statement on top of carbonAnalytics table
which has primary keys set.
Thanks.
On Tue, Oct 20, 2015 at 3:25 PM, Imesh Gunaratne wrote:
> Hi Thanuja,
>
> Can you please explain the following statement that you have mentioned in
> the JIRA?
>
> 2. Also we can't execute INSERT INTO for carbonJDBC table which has
> primary key set.
>
>
> This looks to me that INSERT INTO does not work with CarbonJDBC with
> tables having primary keys.
>
> Thanks
>
>
> On Tue, Oct 20, 2015 at 1:38 PM, Thanuja Uruththirakodeeswaran <
> thanu...@wso2.com> wrote:
>
>> Hi Niranda,
>>
>> I have created a jira [1] to track the issues we have in carbonJDBC
>> option.
>>
>> [1]. https://wso2.org/jira/browse/DAS-273
>>
>> Thanks.
>>
>> On Thu, Oct 1, 2015 at 3:12 PM, Sinthuja Ragendran
>> wrote:
>>
>>> Hi Niranda,
>>>
>>> On Thu, Oct 1, 2015 at 2:28 PM, Inosh Goonewardena
>>> wrote:
>>>
>>>> Hi Niranda,
>>>>
>>>> On Thu, Oct 1, 2015 at 1:33 PM, Sinthuja Ragendran
>>>> wrote:
>>>>
>>>>> Hi Niranda,
>>>>>
>>>>> On Thu, Oct 1, 2015 at 1:28 PM, Niranda Perera
>>>>> wrote:
>>>>>
>>>>>> Hi Thanuja and Imesh,
>>>>>>
>>>>>> let me clarify the use of the term "create temporary table" with
>>>>>> regard to Spark.
>>>>>> inside DAS we save ('persist') data in DAL (Dara access layer)
>>>>>> tables. So in order for us to query these tables, spark needs some sort
>>>>>> of
>>>>>> a mapping to the tables in DAL in its runtime environment. This mapping
>>>>&g
Re: [Dev] [VOTE] Release WSO2 Private PaaS 4.1.0 RC2
Tested wso2 as cartridge and few sample applications with metering and monitoring dashbord in kubernetes. [X] Stable - go ahead and release On 24 Oct 2015 23:07, "Shavindri Dissanayake" wrote: > Tested WSO2 cartridge applications on the mock IaaS. > > [x] Stable - go ahead and release > > Thanks & Regards > Shavindri Dissanayake > Technical Writer > > WSO2 Inc. > lean.enterprise.middleware > > On Sat, Oct 24, 2015 at 10:43 PM, Pubudu Gunatilaka > wrote: > >> Tested WSO2 cartridge applications on Kubernetes. >> >> [x] Stable - go ahead and release >> >> Thank you! >> >> On Sat, Oct 24, 2015 at 9:56 PM, Imesh Gunaratne wrote: >> >>> Here's my +1, I verified Private PaaS 4.1.0-RC2 on Kubernetes 1.0.6 >>> using few WSO2 product cartridges, DAS metering and monitoring dashboards & >>> Carbon cluster discovery features. >>> >>> Thanks >>> >>> On Sat, Oct 24, 2015 at 9:06 PM, Gayan Gunarathne >>> wrote: >>> Verified the followings. 1. PPaaS installer 2. Application deployment using mock Iaas and Kubernetes 3. Application un-deployment 4. Products configuration generation using the Configurator. 5. Product clustering using the PPaaS membership scheme [x] Stable - go ahead and release Thanks, Gayan On Sat, Oct 24, 2015 at 2:33 PM, Akila Ravihansa Perera < raviha...@wso2.com> wrote: > Tested samples apps on ec2 and Kubernetes platforms. > > [x] Stable - go ahead and release > > On Wed, Oct 21, 2015 at 11:00 AM, Gayan Gunarathne > wrote: > >> Hi All, >> >> Please find the release candidate of the WSO2 PPaaS cartridges >> related to the WSO2 Private PaaS 4.1.0. >> >> >> https://svn.wso2.org/repos/wso2/scratch/PPAAS/wso2ppaas-cartridges-4.1.1/ >> >> Please use these set of Cartridges to test the WSO2 Private PaaS >> 4.1.0 release. >> >> Thanks, >> Gayan >> >> On Wed, Oct 21, 2015 at 8:05 AM, Imesh Gunaratne >> wrote: >> >>> Hi Devs, >>> >>> This is the second release candidate of WSO2 Private PaaS 4.1.0. >>> >>> This release fixes the following issues: >>> https://wso2.org/jira/issues/?filter=12467 >>> >>> Please download, test and vote. The vote will be open for 72 hours >>> or as needed. >>> >>> *Source and binary distribution files:* >>> https://svn.wso2.org/repos/wso2/scratch/PPAAS/wso2ppaas-4.1.0-rc2/ >>> >>> *Maven staging repository:* >>> http://maven.wso2.org/nexus/content/repositories/orgwso2ppaas-028/ >>> >>> *The tag to be voted upon:* >>> https://github.com/wso2/product-private-paas/tree/v4.1.0-rc2 >>> >>> >>> [ ] Broken - do not release (explain why) >>> [ ] Stable - go ahead and release >>> >>> >>> Thanks, >>> The WSO2 Private PaaS Team >>> >>> -- >>> *Imesh Gunaratne* >>> Senior Technical Lead >>> WSO2 Inc: http://wso2.com >>> T: +94 11 214 5345 M: +94 77 374 2057 >>> W: http://imesh.gunaratne.org >>> Lean . Enterprise . Middleware >>> >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> >> Gayan Gunarathne >> Technical Lead, WSO2 Inc. (http://wso2.com) >> Committer & PMC Member, Apache Stratos >> email : gay...@wso2.com | mobile : +94 775030545 <%2B94%20766819985> >> >> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > Akila Ravihansa Perera > WSO2 Inc.; http://wso2.com/ > > Blog: http://ravihansa3000.blogspot.com > -- Gayan Gunarathne Technical Lead, WSO2 Inc. (http://wso2.com) Committer & PMC Member, Apache Stratos email : gay...@wso2.com | mobile : +94 775030545 <%2B94%20766819985> >>> >>> >>> >>> -- >>> *Imesh Gunaratne* >>> Senior Technical Lead >>> WSO2 Inc: http://wso2.com >>> T: +94 11 214 5345 M: +94 77 374 2057 >>> W: http://imesh.gunaratne.org >>> Lean . Enterprise . Middleware >>> >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> *Pubudu Gunatilaka* >> Committer and PMC Member - Apache Stratos >> Software Engineer >> WSO2, Inc.: http://wso2.com >> mobile : +94774079049 <%2B94772207163> >> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > ___ Dev mailing list Dev@wso2.org http://wso2.org/c
[Dev] [PPaaS] Reading dasStatsPublisherEabled value and meteringDashboardUrl at web application startup time and set those as application variables
Hi All,
In the current implementation, we are reading dasStatsPublisherEnabled and
meteringDashboardUrl in login.jag file [1] and adding them to session. But
since these values are common to all users, we should read these values at
web application startup and add them to application object. So I tried to
do that in web application initScripts js file (app.js) [2] as follows:
var carbon = require('carbon'),
process = require('process'),
server = new carbon.server.Server(),
conf = carbon.server.loadConfig('thrift-client-config.xml'),
dasConfig = conf. *::['config']. *::['das'],
dasStatsPublisherEnabled = false;
for (var i = 0; i < dasConfig.node.length(); i++) {
dasStatsPublisherEnabled = dasConfig.node[i].statsPublisherEnabled.text();
if (dasStatsPublisherEnabled == true) {
break;
}
}
application.put("dasStatsPublisherEnabled",dasStatsPublisherEnabled);
setTimeout(function(){
application.put("meteringDashboardUrl",
process.getProperty("das.metering.dashboard.url"))
},3);
We can read thirift-client-config.xml file and adding
dasStataPublisherEnabled variable to application without any problems. But
we have problem in reading metering dashboard url which is in
cartridge-config.properties at web app initialization.
Here since* webapp is started before stratos-manager component gets
activated (which reads cartridge-config.properties file and set values in
that file as system properties [3])*, we need to have a timeout to wait for
stratos-manager component to be activated before reading
meteringDashboardUrl using jaggery process module.
Is there a better way to do this without having a timeout? Please give your
suggestions.
[1].
https://github.com/wso2/product-private-paas/blob/master/components/org.wso2.ppaas.manager.console/console/controllers/login/login.jag
[2].
https://github.com/wso2/product-private-paas/blob/master/components/org.wso2.ppaas.manager.console/console/app.js
[3].
https://github.com/apache/stratos/blob/stratos-4.1.x/components/org.apache.stratos.manager/src/main/java/org/apache/stratos/manager/internal/StratosManagerServiceComponent.java#L117
Thanks.
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [PPaaS] Reading dasStatsPublisherEabled value and meteringDashboardUrl at web application startup time and set those as application variables
Hi Manu,
Metering dashboard url is in cartridge-config.properties file[1]. Is there
a way to read this property file directly using jaggery?
I can load the file using carbon module (carbon.server.loadConfig(
'cartridge-config.properties');). But don't know how to read a property
within this file.
[1].
https://github.com/wso2/product-private-paas/blob/master/products/ppaas/modules/distribution/src/main/conf/cartridge-config.properties
Thanks.
On Mon, Nov 9, 2015 at 7:00 AM, Manuranga Perera wrote:
> as I understand metering Dashboard URL is not read from a file. is that
> correct? if you can read it from a file it's the better way to go.
>
> On Fri, Nov 6, 2015 at 3:28 PM, Nipuna Chandradasa
> wrote:
>
>> Hi,
>>
>> May be we can try loading this property file in the app.js (Init script
>> as we discuss earlier).
>> But if that is not working the best way is to put a timeout. Because we
>> have no any other way to get these properties in the init script.
>>
>> Let's ask manu is there any better way to do this using jaggery ?? ...
>> (If we can read the property file without too much file processing)
>>
>> adding manu
>>
>> Regards,
>>
>> On Fri, Nov 6, 2015 at 2:28 PM, Thanuja Uruththirakodeeswaran <
>> thanu...@wso2.com> wrote:
>>
>>> Hi All,
>>>
>>> In the current implementation, we are reading dasStatsPublisherEnabled
>>> and meteringDashboardUrl in login.jag file [1] and adding them to session.
>>> But since these values are common to all users, we should read these values
>>> at web application startup and add them to application object. So I tried
>>> to do that in web application initScripts js file (app.js) [2] as follows:
>>>
>>> var carbon = require('carbon'),
>>> process = require('process'),
>>> server = new carbon.server.Server(),
>>> conf = carbon.server.loadConfig('thrift-client-config.xml'),
>>> dasConfig = conf. *::['config']. *::['das'],
>>> dasStatsPublisherEnabled = false;
>>>
>>>
>>> for (var i = 0; i < dasConfig.node.length(); i++) {
>>> dasStatsPublisherEnabled =
>>> dasConfig.node[i].statsPublisherEnabled.text();
>>> if (dasStatsPublisherEnabled == true) {
>>> break;
>>> }
>>> }
>>> application.put("dasStatsPublisherEnabled",dasStatsPublisherEnabled);
>>>
>>> setTimeout(function(){
>>> application.put("meteringDashboardUrl",
>>> process.getProperty("das.metering.dashboard.url"))
>>> },3);
>>>
>>> We can read thirift-client-config.xml file and adding
>>> dasStataPublisherEnabled variable to application without any problems. But
>>> we have problem in reading metering dashboard url which is in
>>> cartridge-config.properties at web app initialization.
>>>
>>> Here since* webapp is started before stratos-manager component gets
>>> activated (which reads cartridge-config.properties file and set values in
>>> that file as system properties [3])*, we need to have a timeout to wait
>>> for stratos-manager component to be activated before reading
>>> meteringDashboardUrl using jaggery process module.
>>>
>>> Is there a better way to do this without having a timeout? Please give
>>> your suggestions.
>>>
>>> [1].
>>> https://github.com/wso2/product-private-paas/blob/master/components/org.wso2.ppaas.manager.console/console/controllers/login/login.jag
>>> [2].
>>> https://github.com/wso2/product-private-paas/blob/master/components/org.wso2.ppaas.manager.console/console/app.js
>>> [3].
>>> https://github.com/apache/stratos/blob/stratos-4.1.x/components/org.apache.stratos.manager/src/main/java/org/apache/stratos/manager/internal/StratosManagerServiceComponent.java#L117
>>>
>>> Thanks.
>>> --
>>> Thanuja Uruththirakodeeswaran
>>> Software Engineer
>>> WSO2 Inc.;http://wso2.com
>>> lean.enterprise.middleware
>>>
>>> mobile: +94 774363167
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>> Nipuna Marcus
>> *Software Engineer*
>> WSO2 Inc.
>> http://wso2.com/ - "lean . enterprise . middleware"
>> Mobile : +94 (0) 713 667906
>> nipu...@wso2.com
>>
>
>
>
> --
> With regards,
> *Manu*ranga Perera.
>
> phone : 071 7 70 20 50
> mail : m...@wso2.com
>
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [PPaaS] Reading dasStatsPublisherEabled value and meteringDashboardUrl at web application startup time and set those as application variables
On Mon, Nov 9, 2015 at 2:31 PM, Nipuna Chandradasa wrote:
> Hi Thanuja,
> If this file is not loading before this initScript runs can't we call
> this property file inside the initScript using java (We can write java
> inside a Jaggery) and then set the properties and then we can use
> Process method in jag to access the properties .. ???
>
Thanks a lot Nipuna and Manuranga for the suggestions.
I have read the url properties using java inside initScript as follow and
its working fine:
var cartridgeConfig = carbon.server.loadConfig("cartridge-config.properties");
var prop = new java.util.Properties();
var stream = new java.io.ByteArrayInputStream(new
java.lang.String(cartridgeConfig).getBytes());
prop.load(stream);
application.put("meteringDashboardUrl",
prop.getProperty("das.metering.dashboard.url"));
application.put("monitoringDashboardUrl",
prop.getProperty("das.monitoring.dashboard.url"));
> Here's how we can read the property file using Java
>
> http://crunchify.com/java-properties-file-how-to-read-config-properties-values-in-java/
>
> here is some other suggestions i came across they are not that
> reliable ... but FYI
>
> 1.
> http://stackoverflow.com/questions/19310951/how-to-read-a-properties-file-in-javascript-from-project-directory
>
> 2.
> http://stackoverflow.com/questions/20416185/read-properties-file-using-jquery-or-java-script
>
> 3.
> http://stackoverflow.com/questions/9665214/want-to-read-key-value-from-properties-file
>
> Regards,
>
> On Mon, Nov 9, 2015 at 1:42 PM, Thanuja Uruththirakodeeswaran <
> thanu...@wso2.com> wrote:
>
>> Hi Manu,
>>
>> Metering dashboard url is in cartridge-config.properties file[1]. Is
>> there a way to read this property file directly using jaggery?
>>
>> I can load the file using carbon module (carbon.server.loadConfig(
>> 'cartridge-config.properties');). But don't know how to read a property
>> within this file.
>>
>> [1].
>> https://github.com/wso2/product-private-paas/blob/master/products/ppaas/modules/distribution/src/main/conf/cartridge-config.properties
>>
>> Thanks.
>>
>> On Mon, Nov 9, 2015 at 7:00 AM, Manuranga Perera wrote:
>>
>>> as I understand metering Dashboard URL is not read from a file. is that
>>> correct? if you can read it from a file it's the better way to go.
>>>
>>> On Fri, Nov 6, 2015 at 3:28 PM, Nipuna Chandradasa
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> May be we can try loading this property file in the app.js (Init script
>>>> as we discuss earlier).
>>>> But if that is not working the best way is to put a timeout. Because we
>>>> have no any other way to get these properties in the init script.
>>>>
>>>> Let's ask manu is there any better way to do this using jaggery ?? ...
>>>> (If we can read the property file without too much file processing)
>>>>
>>>> adding manu
>>>>
>>>> Regards,
>>>>
>>>> On Fri, Nov 6, 2015 at 2:28 PM, Thanuja Uruththirakodeeswaran <
>>>> thanu...@wso2.com> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> In the current implementation, we are reading dasStatsPublisherEnabled
>>>>> and meteringDashboardUrl in login.jag file [1] and adding them to session.
>>>>> But since these values are common to all users, we should read these
>>>>> values
>>>>> at web application startup and add them to application object. So I tried
>>>>> to do that in web application initScripts js file (app.js) [2] as follows:
>>>>>
>>>>> var carbon = require('carbon'),
>>>>> process = require('process'),
>>>>> server = new carbon.server.Server(),
>>>>> conf = carbon.server.loadConfig('thrift-client-config.xml'),
>>>>> dasConfig = conf. *::['config']. *::['das'],
>>>>> dasStatsPublisherEnabled = false;
>>>>>
>>>>>
>>>>> for (var i = 0; i < dasConfig.node.length(); i++) {
>>>>> dasStatsPublisherEnabled =
>>>>> dasConfig.node[i].statsPublisherEnabled.text();
>>>>> if (dasStatsPublisherEnabled == true) {
>>>>> break;
>>>>> }
>>>>> }
>>>>> application.put("dasStatsPublisherEnabled",dasStatsPublisherEnabled);
>>>>>
>
Re: [Dev] [Test Automation] Mocking Thrift server for an integration test
our purpose? >> >> [1] >> https://github.com/wso2/carbon-analytics-common/blob/master/components/data-bridge/org.wso2.carbon.databridge.agent/src/test/java/org/wso2/carbon/databridge/agent/test/thrift/ThriftTestServer.java >> >> Thanks, >> Lasantha >> >> On 30 August 2015 at 12:59, Akila Ravihansa Perera >> wrote: >> >>> Hi, >>> >>> I'm looking for a way to mock the Thrift receiver in CEP. My requirement >>> is to write an integration test to assert stat publishing functionality (to >>> CEP via Thrift) in my Python app. I'm developing the automation test cases >>> using TestNG framework so I can use any Java based library. Is this >>> possible by using regular Java sockets? >>> >>> I'd rather prefer to start an embedded CEP Thrift receiver in my test >>> method and verify the functionality. Appreciate any help regarding this. >>> >>> Thanks. >>> -- >>> Akila Ravihansa Perera >>> WSO2 Inc.; http://wso2.com/ >>> >>> Blog: http://ravihansa3000.blogspot.com >>> >> >> >> >> -- >> *Lasantha Fernando* >> Senior Software Engineer - Data Technologies Team >> WSO2 Inc. http://wso2.com >> >> email: lasan...@wso2.com >> mobile: (+94) 71 5247551 >> > > > > -- > Akila Ravihansa Perera > WSO2 Inc.; http://wso2.com/ > > Blog: http://ravihansa3000.blogspot.com > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Test Automation] Mocking Thrift server for an integration test
Hi Lasantha, Sorry, I tried this with different ports and when changing the client port to 7613, forgot to change the server port to 7613. I've corrected it and attached the new log. [main] INFO org.wso2.carbon.databridge.receiver.thrift.ThriftDataReceiver - Thrift Server started at localhost [main] INFO org.wso2.carbon.databridge.receiver.thrift.ThriftDataReceiver - Thrift SSL port : 7713 [main] INFO org.wso2.carbon.databridge.receiver.thrift.ThriftDataReceiver - Thrift port : 7613 [main] INFO org.apache.stratos.cloud.controller.statistics.publisher.ThriftTestServer - Test Server Started [main] INFO org.wso2.carbon.databridge.agent.thrift.AgentHolder - Agent created ! [main] INFO org.apache.stratos.common.threading.StratosThreadPool - Thread pool created: [type] Executor Service [id] cloud.controller.stats.publisher.thread.pool [size] 10 [pool-5-thread-1] ERROR org.wso2.carbon.databridge.agent.thrift.AsyncDataPublisher - Error while connection to event receiver org.wso2.carbon.databridge.agent.thrift.exception.AgentException: Cannot borrow client for TCP,localhost:7613,TCP,localhost:7713 at org.wso2.carbon.databridge.agent.thrift.internal.publisher.authenticator.AgentAuthenticator.connect(AgentAuthenticator.java:58) at org.wso2.carbon.databridge.agent.thrift.DataPublisher.start(DataPublisher.java:273) at org.wso2.carbon.databridge.agent.thrift.DataPublisher.(DataPublisher.java:161) at org.wso2.carbon.databridge.agent.thrift.AsyncDataPublisher$ReceiverConnectionWorker.run(AsyncDataPublisher.java:787) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.thrift.transport.TTransportException: Could not connect to 172.17.8.1 on port 7713 at org.apache.thrift.transport.TSSLTransportFactory.createClient(TSSLTransportFactory.java:212) at org.apache.thrift.transport.TSSLTransportFactory.getClientSocket(TSSLTransportFactory.java:166) at org.wso2.carbon.databridge.agent.thrift.internal.pool.client.secure.SecureClientPoolFactory.makeObject(SecureClientPoolFactory.java:90) at org.wso2.carbon.databridge.agent.thrift.internal.pool.client.secure.SecureClientPoolFactory.makeObject(SecureClientPoolFactory.java:48) at org.apache.commons.pool.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:1212) at org.wso2.carbon.databridge.agent.thrift.internal.publisher.authenticator.AgentAuthenticator.connect(AgentAuthenticator.java:50) ... 8 more Caused by: java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:625) at sun.security.ssl.SSLSocketImpl.(SSLSocketImpl.java:413) at sun.security.ssl.SSLSocketFactoryImpl.createSocket(SSLSocketFactoryImpl.java:88) at org.apache.thrift.transport.TSSLTransportFactory.createClient(TSSLTransportFactory.java:208) ... 13 more Thanks. On Tue, Dec 1, 2015 at 3:14 PM, Lasantha Fernando wrote: > Hi Thanuja, > > Looking at the logs above, it seems that the ThriftDataReceiver started on > port 7612, with SSL port 7712. > > [main] INFO org.wso2.carbon.databridge.receiver.thrift.ThriftDataReceiver > - Thrift SSL port : 7712 > [main] INFO org.wso2.carbon.databridge.receiver.thrift.ThriftDataReceiver > - Thrift port : 7612 > [main] INFO > org.apache.stratos.cloud.controller.statistics.publisher.ThriftTestServer > - Test Server Started > > But the agent is trying to connect to port 7613,7713. > > [pool-5-thread-1] ERROR > org.wso2.carbon.databridge.agent.thrift.AsyncDataPublisher - Error while > connection to event receiver > org.wso2.carbon.databridge.agent.thrift.exception.AgentException: Cannot > borrow client for TCP,localhost:7613,TCP,localhost:7713 > > Can you go through the code and verify that the agent is sending to the > same port on which agent is started? It is probably a minor issue when > setting the offsets. > > Thanks, > Lasantha > > > On 1 December 2015 at 15:09, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi Lasantha, >> >> I'm using the ThriftTestServer [1] to check data publisher functionality >> in a java test class. I have set the TrustStore paramby >> DataPublisherTestUtil.setTrustStoreParams(); after setting KeyStore &
Re: [Dev] [VOTE] Release WSO2 Private PaaS 4.1.1 RC1
Hi All, Private PaaS distribution pack is missing cep artifacts because in ppaas distribution assembly [1] we are referring those artifacts from ppaas cep extension which has been removed from ppaas repo. Ideally we should refer these cep artifacts in [1] from Stratos [2]. [1]. https://github.com/wso2/product-private-paas/blob/release-4.1.1/products/ppaas/modules/distribution/src/assembly/bin.xml#L430-L463 [2]. https://github.com/apache/stratos/tree/stratos-4.1.x/extensions/cep/modules/artifacts/wso2cep-3.0.0 Thanks. On Wed, Dec 16, 2015 at 11:32 AM, Gayan Gunarathne wrote: > Hi All, > > This is the first release candidate of WSO2 Private PaaS 4.1.1. > > This release fixes the following issues: > *https://wso2.org/jira/browse/PAAS-305?filter=12582 > <https://wso2.org/jira/browse/PAAS-305?filter=12582>* > > Please download, test and vote. The vote will be open for 72 hours or as > needed. > > *Source and binary distribution files:* > https://svn.wso2.org/repos/wso2/scratch/PPAAS/wso2ppaas-4.1.1-rc1/ > > *Maven staging repository:* > http://maven.wso2.org/nexus/content/repositories/orgwso2ppaas-181/ > > *The tag to be voted upon:* > https://github.com/wso2/product-private-paas/tree/v4.1.1-rc1 > > > [ ] Broken - do not release (explain why) > [ ] Stable - go ahead and release > > > Thanks, > The WSO2 Private PaaS Team > > -- > > Gayan Gunarathne > Technical Lead, WSO2 Inc. (http://wso2.com) > Committer & PMC Member, Apache Stratos > email : gay...@wso2.com | mobile : +94 775030545 <%2B94%20766819985> > > > > _______ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DEV][PPaaS] Puppet modules for WSO2 Products
Hi Chamila, I've started to work on AS puppet module. Could you please take another product. Thanks. On Wed, Dec 23, 2015 at 12:42 PM, Chamila De Alwis wrote: > Hi, > > I've started working on the the Puppet module for WSO2 Application Server > on [1]. This is based on the generic WSO2 Base Puppet module and will > follow the same pattern as the other modules. > > If you have started working on a module, please update with the latest > status. > > [1] - https://github.com/wso2/puppet-modules > > Regards, > Chamila de Alwis > Committer and PMC Member - Apache Stratos > Software Engineer | WSO2 | +94772207163 > Blog: code.chamiladealwis.com > > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DEV][PPaaS] Puppet modules for WSO2 Products
Hi All, I've completed the initial version of puppet module for WSO2 AS - 5.3.0. Please review and merge p/r [1]. [1]. https://github.com/wso2/puppet-modules/pull/5 Thanks. On Wed, Dec 23, 2015 at 1:11 PM, Rajkumar Rajaratnam wrote: > I have completed ESB 4.9.0 and G-Reg 4.6.0/5.1.0 puppet modules with > hiera. I have tested clustering, registry mounting, depsync, etc with > vagrant. > > PS - still we are doing some improvements in hiera data structure at the > moment. > > Thanks, > Raj. > > On Wed, Dec 23, 2015 at 12:54 PM, Chamila De Alwis > wrote: > >> Hi Thanuja, >> >> Sure. I'll start working on WSO2 Message Broker module. >> >> >> Regards, >> Chamila de Alwis >> Committer and PMC Member - Apache Stratos >> Software Engineer | WSO2 | +94772207163 >> Blog: code.chamiladealwis.com >> >> >> >> On Wed, Dec 23, 2015 at 12:53 PM, Thanuja Uruththirakodeeswaran < >> thanu...@wso2.com> wrote: >> >>> Hi Chamila, >>> >>> I've started to work on AS puppet module. Could you please take another >>> product. >>> >>> Thanks. >>> >>> On Wed, Dec 23, 2015 at 12:42 PM, Chamila De Alwis >>> wrote: >>> >>>> Hi, >>>> >>>> I've started working on the the Puppet module for WSO2 Application >>>> Server on [1]. This is based on the generic WSO2 Base Puppet module and >>>> will follow the same pattern as the other modules. >>>> >>>> If you have started working on a module, please update with the latest >>>> status. >>>> >>>> [1] - https://github.com/wso2/puppet-modules >>>> >>>> Regards, >>>> Chamila de Alwis >>>> Committer and PMC Member - Apache Stratos >>>> Software Engineer | WSO2 | +94772207163 >>>> Blog: code.chamiladealwis.com >>>> >>>> >>>> >>> >>> >>> -- >>> Thanuja Uruththirakodeeswaran >>> Software Engineer >>> WSO2 Inc.;http://wso2.com >>> lean.enterprise.middleware >>> >>> mobile: +94 774363167 >>> >> >> > > > -- > Rajkumar Rajaratnam > Committer & PMC Member, Apache Stratos > Software Engineer, WSO2 > > Mobile : +94777568639 > Blog : rajkumarr.com > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [VOTE] Release WSO2 Private PaaS 4.1.1 RC2
+1 for the release Tested ppaas in kubernetes with few wso2 product cartridges along metering and monitering feature. Thanks. On 27 Dec 2015 21:12, "Gayan Gunarathne" > > > On Sun, Dec 27, 2015 at 10:00 AM, Akila Ravihansa Perera < raviha...@wso2.com> wrote: >> >> Hi Gayan, >> >> Since we have forked Python cartridge agent in PPaaS 4.1.1-RC2, users won't be able to use Dockerfile shipped with Stratos to build cartridge images. > > What do you mean by Dockerfile shipped with Stratos? > >> >> Have we documented the steps needed to build cartridge Docker images for PPaaS? > > We are released the Cartridges based on the PPaaS release version. Currently released cartridges are compatible with PPaaS 4.1.0 release.With the PPaaS 4.1.1 released our documentation need to be changed in the case of user using the PPaaS 4.1.1 release >> >> >> Thanks. >> >> On Fri, Dec 25, 2015 at 12:06 AM, Gayan Gunarathne wrote: >>> >>> IMO if the vote is success we can simply move those binaries to the product distribution without doing any alternation to those binaries.This is the same as the staging repo. If the vote is success we promote the staging repo , if it is fails we drop that staging repo. >>> >>> Thanks, >>> Gayan >>> >>> On Thu, Dec 24, 2015 at 11:47 PM, Imesh Gunaratne wrote: On Thu, Dec 24, 2015 at 10:41 PM, Gayan Gunarathne wrote: > > Hi Imesh, > > What is the ration behind that? I don't see any reason to prefix binaries with the release candidate no. As those binaries will be the one which move to the product release distribution if the vote is success, > The only concern is once we do multiple release candidates, how would someone differentiate those if we have the same set of file names? Thanks > Thanks, > Gayan > > On Thu, Dec 24, 2015 at 10:14 PM, Imesh Gunaratne wrote: >> >> Hi Gayan, >> >> I think all the distributions should get prefixed with rc2, see 4.1.0-rc2: >> https://svn.wso2.org/repos/wso2/scratch/PPAAS/wso2ppaas-4.1.0-rc2/ >> >> Thanks >> >> On Mon, Dec 21, 2015 at 7:35 PM, Gayan Gunarathne wrote: >>> >>> Hi All, >>> >>> This is the second release candidate of WSO2 Private PaaS 4.1.1. >>> >>> This release fixes the following issues: >>> https://wso2.org/jira/browse/PAAS-305?filter=12582 >>> >>> Please download, test and vote. The vote will be open for 72 hours or as needed. >>> >>> Source and binary distribution files: >>> https://svn.wso2.org/repos/wso2/scratch/PPAAS/wso2ppaas-4.1.1-rc2/ >>> >>> Maven staging repository: >>> >>> http://maven.wso2.org/nexus/content/repositories/orgwso2ppaas-217/ >>> >>> The tag to be voted upon: >>> https://github.com/wso2/product-private-paas/tree/v4.1.1-rc2 >>> >>> >>> [ ] Broken - do not release (explain why) >>> [ ] Stable - go ahead and release >>> >>> >>> Thanks, >>> The WSO2 Private PaaS Team >>> >>> -- >>> >>> Gayan Gunarathne >>> Technical Lead, WSO2 Inc. (http://wso2.com) >>> Committer & PMC Member, Apache Stratos >>> email : gay...@wso2.com | mobile : +94 775030545 >>> >>> >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >> >> >> >> -- >> Imesh Gunaratne >> Senior Technical Lead >> WSO2 Inc: http://wso2.com >> T: +94 11 214 5345 M: +94 77 374 2057 >> W: http://imesh.gunaratne.org >> Lean . Enterprise . Middleware >> > > > > -- > > Gayan Gunarathne > Technical Lead, WSO2 Inc. (http://wso2.com) > Committer & PMC Member, Apache Stratos > email : gay...@wso2.com | mobile : +94 775030545 > > -- Imesh Gunaratne Senior Technical Lead WSO2 Inc: http://wso2.com T: +94 11 214 5345 M: +94 77 374 2057 W: http://imesh.gunaratne.org Lean . Enterprise . Middleware >>> >>> >>> >>> -- >>> >>> Gayan Gunarathne >>> Technical Lead, WSO2 Inc. (http://wso2.com) >>> Committer & PMC Member, Apache Stratos >>> email : gay...@wso2.com | mobile : +94 775030545 >>> >>> >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >> >> >> >> -- >> Akila Ravihansa Perera >> WSO2 Inc.; http://wso2.com/ >> >> Blog: http://ravihansa3000.blogspot.com > > > > > -- > > Gayan Gunarathne > Technical Lead, WSO2 Inc. (http://wso2.com) > Committer & PMC Member, Apache Stratos > email : gay...@wso2.com | mobile : +94 775030545 > > > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/de
Re: [Dev] [DEV][PPaaS] Puppet modules for WSO2 Products
Hi All, Completed the AS puppet module according to the refactored hiera yaml files and templates. Updated the same p/r [1] with latest changes. Please review and merge. [1]. https://github.com/wso2/puppet-modules/pull/5 Thanks. On Wed, Dec 30, 2015 at 1:03 PM, Rajkumar Rajaratnam wrote: > > > On Wed, Dec 23, 2015 at 1:11 PM, Rajkumar Rajaratnam > wrote: > >> I have completed ESB 4.9.0 and G-Reg 4.6.0/5.1.0 puppet modules with >> hiera. I have tested clustering, registry mounting, depsync, etc with >> vagrant. >> > > Completed PPaaS 4.1.0/4.1.1 puppet modules with hiera. > > Thanks, > Raj. > > >> >> PS - still we are doing some improvements in hiera data structure at the >> moment. >> >> Thanks, >> Raj. >> >> On Wed, Dec 23, 2015 at 12:54 PM, Chamila De Alwis >> wrote: >> >>> Hi Thanuja, >>> >>> Sure. I'll start working on WSO2 Message Broker module. >>> >>> >>> Regards, >>> Chamila de Alwis >>> Committer and PMC Member - Apache Stratos >>> Software Engineer | WSO2 | +94772207163 >>> Blog: code.chamiladealwis.com >>> >>> >>> >>> On Wed, Dec 23, 2015 at 12:53 PM, Thanuja Uruththirakodeeswaran < >>> thanu...@wso2.com> wrote: >>> >>>> Hi Chamila, >>>> >>>> I've started to work on AS puppet module. Could you please take another >>>> product. >>>> >>>> Thanks. >>>> >>>> On Wed, Dec 23, 2015 at 12:42 PM, Chamila De Alwis >>>> wrote: >>>> >>>>> Hi, >>>>> >>>>> I've started working on the the Puppet module for WSO2 Application >>>>> Server on [1]. This is based on the generic WSO2 Base Puppet module and >>>>> will follow the same pattern as the other modules. >>>>> >>>>> If you have started working on a module, please update with the latest >>>>> status. >>>>> >>>>> [1] - https://github.com/wso2/puppet-modules >>>>> >>>>> Regards, >>>>> Chamila de Alwis >>>>> Committer and PMC Member - Apache Stratos >>>>> Software Engineer | WSO2 | +94772207163 >>>>> Blog: code.chamiladealwis.com >>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> Thanuja Uruththirakodeeswaran >>>> Software Engineer >>>> WSO2 Inc.;http://wso2.com >>>> lean.enterprise.middleware >>>> >>>> mobile: +94 774363167 >>>> >>> >>> >> >> >> -- >> Rajkumar Rajaratnam >> Committer & PMC Member, Apache Stratos >> Software Engineer, WSO2 >> >> Mobile : +94777568639 >> Blog : rajkumarr.com >> > > > > -- > Rajkumar Rajaratnam > Committer & PMC Member, Apache Stratos > Software Engineer, WSO2 > > Mobile : +94777568639 > Blog : rajkumarr.com > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DEV][PPaaS]Puppet Modules - Use of MySQL datasources in the default.yaml
terceptor.invoke(JdbcInterceptor.java:109) at org.apache.tomcat.jdbc.pool.interceptor.AbstractCreateStatementInterceptor.invoke(AbstractCreateStatementInterceptor.java:67) at org.apache.tomcat.jdbc.pool.JdbcInterceptor.invoke(JdbcInterceptor.java:109) at org.apache.tomcat.jdbc.pool.interceptor.ConnectionState.invoke(ConnectionState.java:153) at org.apache.tomcat.jdbc.pool.JdbcInterceptor.invoke(JdbcInterceptor.java:109) at org.apache.tomcat.jdbc.pool.TrapException.invoke(TrapException.java:41) at org.apache.tomcat.jdbc.pool.JdbcInterceptor.invoke(JdbcInterceptor.java:109) at org.apache.tomcat.jdbc.pool.DisposableConnectionFacade.invoke(DisposableConnectionFacade.java:80) at com.sun.proxy.$Proxy24.prepareStatement(Unknown Source) at org.wso2.carbon.user.core.claim.dao.ClaimDAO.getDialectCount(ClaimDAO.java:160) ... 22 more I think it's because master datasources (config, gov and user dbs) tables are not created at the server start up. If I start the server with* -Dsetup*, then it's working fine. So how we can handle this if we use h2 db? [1]. https://github.com/wso2/puppet-modules/pull/5 Thanks. On Thu, Jan 7, 2016 at 2:44 PM, Imesh Gunaratne wrote: > > > On Thu, Jan 7, 2016 at 2:31 PM, Chamila De Alwis > wrote: > >> Hi devs, >> >> In the Hiera files, the default.yaml is supposed to contain values for a >> "default" setup, representing a server running out of the box from a >> downloaded product. Therefore, the wso2::master_datasources should point to >> the H2 database. >> >> However, the default.yaml contains datasources pointing to a MySQL >> server. IMO this should change to point to the H2 database. WDYT? >> > > +1 > >> >> Regards, >> Chamila de Alwis >> Committer and PMC Member - Apache Stratos >> Software Engineer | WSO2 | +94772207163 >> Blog: code.chamiladealwis.com >> >> >> > > > -- > *Imesh Gunaratne* > Senior Technical Lead > WSO2 Inc: http://wso2.com > T: +94 11 214 5345 M: +94 77 374 2057 > W: http://imesh.gunaratne.org > Lean . Enterprise . Middleware > > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DEV][PPaaS] Puppet modules for WSO2 Products
Hi All, Completed the DSS 3.5.0 puppet module according to latest hiera structure. Please review and merge p/r [1]. Also note that updated the AS 5.3.0 module with latest changes in p/r [2]. [1]. https://github.com/wso2/puppet-modules/pull/6 [2]. https://github.com/wso2/puppet-modules/pull/5 Thanks. On Thu, Jan 7, 2016 at 12:11 PM, Chamila De Alwis wrote: > Completed and pushed MB 3.0.0 puppet module > > > Regards, > Chamila de Alwis > Committer and PMC Member - Apache Stratos > Software Engineer | WSO2 | +94772207163 > Blog: code.chamiladealwis.com > > > > On Wed, Jan 6, 2016 at 6:16 PM, Isuru Haththotuwa wrote: > >> Completed and pushed BRS 2.2.0 puppet module. >> >> On Wed, Dec 23, 2015 at 12:42 PM, Chamila De Alwis >> wrote: >> >>> Hi, >>> >>> I've started working on the the Puppet module for WSO2 Application >>> Server on [1]. This is based on the generic WSO2 Base Puppet module and >>> will follow the same pattern as the other modules. >>> >>> If you have started working on a module, please update with the latest >>> status. >>> >>> [1] - https://github.com/wso2/puppet-modules >>> >>> Regards, >>> Chamila de Alwis >>> Committer and PMC Member - Apache Stratos >>> Software Engineer | WSO2 | +94772207163 >>> Blog: code.chamiladealwis.com >>> >>> >>> >> >> >> -- >> Thanks and Regards, >> >> Isuru H. >> +94 716 358 048* <http://wso2.com/>* >> >> >> > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [VOTE] Release WSO2 Puppet Modules 1.0.0 RC2
+1 for the release Verified following products with clustering: 1. DSS 3.5.0 2. ESB 4.9.0 3. AS 5.3.0 Also tested DAS 3.0.0 default profile. Thanks. On Wed, Feb 3, 2016 at 9:32 AM, Chamila De Alwis wrote: > +1 release > > Verified the Puppet manifests for BRS, MB, and GREG (default profile) > > Additional changes to templates and hieradata have to be added to cater > for the majority of the possible use cases, however this release can be > done without those changes. More sophisticated and configurable templates > can be added later to each product. > > > Regards, > Chamila de Alwis > Committer and PMC Member - Apache Stratos > Software Engineer | WSO2 | +94772207163 > Blog: code.chamiladealwis.com > > > > On Mon, Feb 1, 2016 at 12:47 PM, Isuru Haththotuwa > wrote: > >> Hi, >> >> AFAIU we can't just use this templates anyway as they are, but might need >> to modify to fit to the usecase. These modules do not cover all the >> parameters that each of the products have, just have the most basic set. >> More importantly this set of puppet modules have standardized the >> separation of data from puppet code by using hiera to use as a common set >> of puppet modules for all WSO2 use cases. We can improve them as we move >> along. >> >> On Mon, Feb 1, 2016 at 11:46 AM, Ramith Jayasinghe >> wrote: >> >>> had a chat with IsuruH and agreed to add the ability to configure this >>> on next release. >>> >>> On Mon, Feb 1, 2016 at 11:25 AM, Ramith Jayasinghe >>> wrote: >>> > HI, >>> > in : >>> https://github.com/wso2/puppet-modules/blob/v1.0.0-rc2/modules/wso2mb/templates/3.0.0/repository/conf/datasources/master-datasources.xml.erb >>> > I see that, >>> > false is not added to MB >>> > data-source (only MB data-source requires that). that would lead to >>> > problems. shall we fix that. >>> > regards >>> > Ramith >>> > >>> > On Mon, Feb 1, 2016 at 11:14 AM, Isuru Haththotuwa >>> wrote: >>> >> Hi devs, >>> >> >>> >> This is the second release candidate of WSO2 Puppet Modules 1.0.0. >>> Please >>> >> download, test and vote. >>> >> >>> >> [ ] Broken - do not release (explain why) >>> >> [ ] Stable - go ahead and release >>> >> >>> >> The tag to be voted upon: >>> >> https://github.com/wso2/puppet-modules/tree/v1.0.0-rc2 >>> >> >>> >> Source and binary distribution files: >>> >> https://github.com/wso2/puppet-modules/releases/tag/v1.0.0-rc2 >>> >> >>> >> The vote will be open for 72 hours or as needed. >>> >> >>> >> -- >>> >> Thanks, >>> >> The WSO2 Private PaaS Team >>> >> >>> >> >>> >> >>> >> ___ >>> >> Dev mailing list >>> >> Dev@wso2.org >>> >> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >> >>> > >>> > >>> > >>> > -- >>> > Ramith Jayasinghe >>> > Technical Lead >>> > WSO2 Inc., http://wso2.com >>> > lean.enterprise.middleware >>> > >>> > E: ram...@wso2.com >>> > P: +94 777542851 >>> >>> >>> >>> -- >>> Ramith Jayasinghe >>> Technical Lead >>> WSO2 Inc., http://wso2.com >>> lean.enterprise.middleware >>> >>> E: ram...@wso2.com >>> P: +94 777542851 >>> >> >> >> >> -- >> Thanks and Regards, >> >> Isuru H. >> +94 716 358 048* <http://wso2.com/>* >> >> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [Kubernetes Artifacts] Applying secure vault for wso2 products when building docker images
Hi All, Currently I'm working on $subject by running cipher tool and user will be able to build a docker image for a wso2 product which will have secured password in config files. In order to do the subject, we need to add cipher-tool.properties, cipher-text.properties and password-tmp file templates to puppet module. I thought of encrypting the passwords using the cipher tool after we execute puppet apply in Docker files [1]. Applying secure vault while building the docker image will be easy and efficient way compared to manually running the cipher tool and updating puppet module templates before building the docker image. I'll update this thread about the progress. Highly appreciate your suggestions on this. [1]. https://github.com/wso2/kubernetes-artifacts/blob/master/wso2esb/docker/Dockerfile#L40 Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Kubernetes Artifacts] Applying secure vault for wso2 products when building docker images
Hi All, I have updated the puppet modules for secure vault support. Please review and merger the p/r [1]. I'll send a p/r for kubernetes-artifacts repo with the changes needed to pass the key store password. I have done the changes to pass key store password as environment variable for standalone docker containers. Currently I'm working on passing the password as kubernetes secret and will send a p/r for this soon. [1]. https://github.com/wso2/puppet-modules/pull/16 Thanks. On Sun, Feb 21, 2016 at 12:24 PM, Imesh Gunaratne wrote: > > > On Sun, Feb 21, 2016 at 8:05 AM, Thanuja Uruththirakodeeswaran < > thanu...@wso2.com> wrote: > >> Hi All, >> >> Currently I'm working on $subject by running cipher tool and user will be >> able to build a docker image for a wso2 product which will have secured >> password in config files. >> >> In order to do the subject, we need to add cipher-tool.properties, >> cipher-text.properties and password-tmp file templates to puppet module. I >> thought of encrypting the passwords using the cipher tool after we execute >> puppet apply in Docker files [1]. >> > > Yes IMO this is the best option. Docker image build process use puppet for > configuring the product, once the configuration is done run secure vault > and secure all credentials. > > When the container starts we will need to send the password either using > an environment variable (in Docker) or via a K8S secret (in K8S) and create > the password text file. Then we can start the server. > > Thanks > >> >> Applying secure vault while building the docker image will be easy and >> efficient way compared to manually running the cipher tool and updating >> puppet module templates before building the docker image. >> >> I'll update this thread about the progress. Highly appreciate your >> suggestions on this. >> >> [1]. >> https://github.com/wso2/kubernetes-artifacts/blob/master/wso2esb/docker/Dockerfile#L40 >> >> Thanks. >> >> -- >> Thanuja Uruththirakodeeswaran >> Software Engineer >> WSO2 Inc.;http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 774363167 >> > > > > -- > *Imesh Gunaratne* > Senior Technical Lead > WSO2 Inc: http://wso2.com > T: +94 11 214 5345 M: +94 77 374 2057 > W: http://imesh.gunaratne.org > Lean . Enterprise . Middleware > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [Puppet-Modules] Puppet Error: cwd must be a fully qualified path
Hi All,
I'm trying to change the cipher tool execution command at [1] so that first
I need to go inside the $carbon_home/bin directory and then trying to
execute the cipher tool with the following code snippet (We need to do this
for carbon kernel 4.2.0 based products as discussed in [2]) :
exec { "Applying secure vault":
user => $user,
path =>
'/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin',
cwd=> '$carbon_home/bin',
command=> 'sh ciphertool.sh -Dconfigure
-Dpassword=$key_store_password',
logoutput => 'on_failure'
}
But the above exec fails with below error:
==> brs.dev.wso2.org: Error: Parameter cwd failed on Exec[Applying secure
vault]: cwd must be a fully qualified path at
/tmp/vagrant-puppet/modules-3737bfc9b53e65d741f2b9b350c2e2ca/wso2base/manifests/apply_secure_vault.pp:28
==> brs.dev.wso2.org: Wrapped exception:
==> brs.dev.wso2.org: cwd must be a fully qualified path
Please give suggestion to resolve this error.
[1].
https://github.com/wso2/puppet-modules/blob/master/modules/wso2base/manifests/apply_secure_vault.pp#L25
[2]. http://mail.wso2.org/mailarchive/dev/2014-April/029446.html
Thanks.
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Puppet-Modules] Puppet Error: cwd must be a fully qualified path
Thanks Manula !!!
The error is because of the syntax error that we need to use *" " *for if
the value has variable. Here the cwd attribute value has carbon_home
variable. Following code will resolve the above puppet error:
exec { "Applying secure vault":
user => $user,
path =>
'/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin',
cwd=> "$carbon_home/bin",
command=> "sh ciphertool.sh -Dconfigure
-Dpassword=$key_store_password",
logoutput => 'on_failure'
}
Thanks.
On Tue, Mar 1, 2016 at 6:27 PM, Thanuja Uruththirakodeeswaran <
thanu...@wso2.com> wrote:
> Hi All,
>
> I'm trying to change the cipher tool execution command at [1] so that
> first I need to go inside the $carbon_home/bin directory and then trying to
> execute the cipher tool with the following code snippet (We need to do this
> for carbon kernel 4.2.0 based products as discussed in [2]) :
>
> exec { "Applying secure vault":
> user => $user,
> path =>
> '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin',
> cwd=> '$carbon_home/bin',
> command=> 'sh ciphertool.sh -Dconfigure
> -Dpassword=$key_store_password',
> logoutput => 'on_failure'
> }
>
> But the above exec fails with below error:
>
> ==> brs.dev.wso2.org: Error: Parameter cwd failed on Exec[Applying secure
> vault]: cwd must be a fully qualified path at
> /tmp/vagrant-puppet/modules-3737bfc9b53e65d741f2b9b350c2e2ca/wso2base/manifests/apply_secure_vault.pp:28
> ==> brs.dev.wso2.org: Wrapped exception:
> ==> brs.dev.wso2.org: cwd must be a fully qualified path
>
> Please give suggestion to resolve this error.
>
> [1].
> https://github.com/wso2/puppet-modules/blob/master/modules/wso2base/manifests/apply_secure_vault.pp#L25
> [2]. http://mail.wso2.org/mailarchive/dev/2014-April/029446.html
>
> Thanks.
>
> --
> Thanuja Uruththirakodeeswaran
> Software Engineer
> WSO2 Inc.;http://wso2.com
> lean.enterprise.middleware
>
> mobile: +94 774363167
>
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Puppet-Modules] Puppet Error: cwd must be a fully qualified path
Thanks Manula. I'll update the code.
On Wed, Mar 2, 2016 at 10:51 AM, Manula Waidyanatha wrote:
> Hi Thanuja,
>
> Always follow the Puppetlabs language style guide [1] when writing puppet
> manifests.
> Even the above code is working, the best practice to surround the
> variables with curly braces.
>
> [1] https://docs.puppetlabs.com/guides/style_guide.html#variables
>
> On Tue, Mar 1, 2016 at 6:59 PM, Thanuja Uruththirakodeeswaran <
> thanu...@wso2.com> wrote:
>
>> Thanks Manula !!!
>>
>> The error is because of the syntax error that we need to use *" " *for
>> if the value has variable. Here the cwd attribute value has carbon_home
>> variable. Following code will resolve the above puppet error:
>>
>> exec { "Applying secure vault":
>> user => $user,
>> path =>
>> '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin',
>> cwd=> "$carbon_home/bin",
>> command => "sh ciphertool.sh -Dconfigure
>> -Dpassword=$key_store_password",
>> logoutput => 'on_failure'
>> }
>>
>> Thanks.
>>
>> On Tue, Mar 1, 2016 at 6:27 PM, Thanuja Uruththirakodeeswaran <
>> thanu...@wso2.com> wrote:
>>
>>> Hi All,
>>>
>>> I'm trying to change the cipher tool execution command at [1] so that
>>> first I need to go inside the $carbon_home/bin directory and then trying to
>>> execute the cipher tool with the following code snippet (We need to do this
>>> for carbon kernel 4.2.0 based products as discussed in [2]) :
>>>
>>> exec { "Applying secure vault":
>>> user => $user,
>>> path =>
>>> '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin',
>>> cwd=> '$carbon_home/bin',
>>> command=> 'sh ciphertool.sh -Dconfigure
>>> -Dpassword=$key_store_password',
>>> logoutput => 'on_failure'
>>> }
>>>
>>> But the above exec fails with below error:
>>>
>>> ==> brs.dev.wso2.org: Error: Parameter cwd failed on Exec[Applying
>>> secure vault]: cwd must be a fully qualified path at
>>> /tmp/vagrant-puppet/modules-3737bfc9b53e65d741f2b9b350c2e2ca/wso2base/manifests/apply_secure_vault.pp:28
>>> ==> brs.dev.wso2.org: Wrapped exception:
>>> ==> brs.dev.wso2.org: cwd must be a fully qualified path
>>>
>>> Please give suggestion to resolve this error.
>>>
>>> [1].
>>> https://github.com/wso2/puppet-modules/blob/master/modules/wso2base/manifests/apply_secure_vault.pp#L25
>>> [2]. http://mail.wso2.org/mailarchive/dev/2014-April/029446.html
>>>
>>> Thanks.
>>>
>>> --
>>> Thanuja Uruththirakodeeswaran
>>> Software Engineer
>>> WSO2 Inc.;http://wso2.com
>>> lean.enterprise.middleware
>>>
>>> mobile: +94 774363167
>>>
>>
>>
>>
>> --
>> Thanuja Uruththirakodeeswaran
>> Software Engineer
>> WSO2 Inc.;http://wso2.com
>> lean.enterprise.middleware
>>
>> mobile: +94 774363167
>>
>
>
>
> --
> Regards,
> Manula Waidyanatha
> Systems Engineer, WSO2, Inc.
> Phone: +94 774 195853
> Blog: blog.manula.org
>
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [VOTE] Release WSO2 Puppet Modules 1.1.0 RC1
[X] - Go ahead and release Verified the below products default profile with secure vault enabled: - AM-1.9.1, AM-1.10.0 - AS-5.3.0 - BPS-3.5.0 - BRS-2.2.0 - CEP-4.0.0 - DAS-3.0.0, DAS-3.0.1 - DSS-3.5.0 - ES-2.0.0 - ESB-4.9.0 - GREG-5.1.0 - IS-5.1.0 - MB-3.0.0, MB-3.1.0 Thanks. On Mon, Mar 7, 2016 at 3:21 AM, Vishanth Balasubramaniam wrote: > [X] Stable - Go ahead and release > >- Tested the default profiles of the following products. >- wso2brs > - wso2bps > - wso2greg > - wso2mb >- Verified Heiradata from some profiles >- Verified the Readme and License > > Regards, > Vishanth > > > On Fri, Mar 4, 2016 at 11:08 AM, Chamila De Alwis > wrote: > >> Hi, >> >> This is the first release candidate of WSO2 Puppet Modules 1.1.0. Please >> download, verify, and vote. >> >> [ ] Broken - Do not release (explain why) >> [ ] Stable - Go ahead and release >> >> *This release is based on the following tag:* >> https://github.com/wso2/puppet-modules/releases/tag/1.1.0-rc1 >> <https://github.com/wso2/puppet-modules/releases/tag/1.1.0-rc1> >> <https://github.com/wso2/puppet-modules/releases/tag/1.1.0-rc1> >> >> *Release verification guide can be found at:* >> https://github.com/wso2/puppet-modules/wiki/Verifying-Puppet-Modules >> >> *This release contains the following new features:* >> >>1. Puppet configurations to enable SecureVault >>2. Puppet templates and Hieradata for WSO2 API Manager 1.10.0 >>3. Additional Hieradata for WSO2 API Manager 1.9.1 Key Manager, >>Store, Publisher, and Gateway profiles >>4. Puppet templates and Hieradata for WSO2 Message Broker 3.1.0 >>5. Puppet templates and Hieradata for WSO2 Data Analytics Server 3.0.1 >> >> Furthermore, it contains minor fixes to streamline Hieradata. >> >> *Source and distribution packages can be downloaded at:* >> https://github.com/wso2/puppet-modules/releases/tag/1.1.0-rc1 >> >> Regards, >> Chamila de Alwis >> Committer and PMC Member - Apache Stratos >> Software Engineer | WSO2 | +94772207163 >> Blog: code.chamiladealwis.com >> >> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > *Vishanth Balasubramaniam* > Committer & PMC Member, Apache Stratos, > Software Engineer, WSO2 Inc.; http://wso2.com > > mobile: *+94 77 17 377 18* > about me: *http://about.me/vishanth <http://about.me/vishanth>* > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [VOTE] Release WSO2 Puppet Modules 1.1.0 RC1
Hi All, I have corrected the README files. Please review the p/r [1]. [1]. https://github.com/wso2/puppet-modules/pull/25 Thanks. On Tue, Mar 8, 2016 at 10:32 AM, Chamila De Alwis wrote: > Hi, > > This vote is now cancelled to correct the above mentioned issues. > > > Regards, > Chamila de Alwis > Committer and PMC Member - Apache Stratos > Software Engineer | WSO2 | +94772207163 > Blog: code.chamiladealwis.com > > > > On Mon, Mar 7, 2016 at 6:21 PM, Isuru Haththotuwa wrote: > >> Verified the following: >> >>1. IS 5.0.0 and 5.1.0 single node deployment >>2. APIM 1.9.1 and 1.10.1 single node deployment >> >> [X] Stable - Go ahead and release >> >> On Fri, Mar 4, 2016 at 11:08 AM, Chamila De Alwis >> wrote: >> >>> Hi, >>> >>> This is the first release candidate of WSO2 Puppet Modules 1.1.0. Please >>> download, verify, and vote. >>> >>> [ ] Broken - Do not release (explain why) >>> [ ] Stable - Go ahead and release >>> >>> *This release is based on the following tag:* >>> https://github.com/wso2/puppet-modules/releases/tag/1.1.0-rc1 >>> <https://github.com/wso2/puppet-modules/releases/tag/1.1.0-rc1> >>> <https://github.com/wso2/puppet-modules/releases/tag/1.1.0-rc1> >>> >>> *Release verification guide can be found at:* >>> https://github.com/wso2/puppet-modules/wiki/Verifying-Puppet-Modules >>> >>> *This release contains the following new features:* >>> >>>1. Puppet configurations to enable SecureVault >>>2. Puppet templates and Hieradata for WSO2 API Manager 1.10.0 >>>3. Additional Hieradata for WSO2 API Manager 1.9.1 Key Manager, >>>Store, Publisher, and Gateway profiles >>>4. Puppet templates and Hieradata for WSO2 Message Broker 3.1.0 >>>5. Puppet templates and Hieradata for WSO2 Data Analytics Server >>>3.0.1 >>> >>> Furthermore, it contains minor fixes to streamline Hieradata. >>> >>> *Source and distribution packages can be downloaded at:* >>> https://github.com/wso2/puppet-modules/releases/tag/1.1.0-rc1 >>> >>> Regards, >>> Chamila de Alwis >>> Committer and PMC Member - Apache Stratos >>> Software Engineer | WSO2 | +94772207163 >>> Blog: code.chamiladealwis.com >>> >>> >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> Thanks and Regards, >> >> Isuru H. >> +94 716 358 048* <http://wso2.com/>* >> >> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [VOTE] Release WSO2 Puppet Modules 1.1.0 RC2
[X] - Go ahead and release. Verified below products default profile with secure vault enabled: - AM-1.9.1, AM-1.10.0 - AS-5.3.0 - BPS-3.5.0 - BRS-2.1.0, BRS-2.2.0 - CEP-4.0.0 - DAS-3.0.0, DAS-3.0.1 - DSS-3.5.0 - ES-2.0.0 - ESB-4.9.0 - GREG-5.1.0 - IS-5.0.0, IS-5.1.0 - MB-3.0.0, MB-3.1.0 Thanks. On Fri, Mar 11, 2016 at 4:34 PM, Vishanth Balasubramaniam < vishan...@wso2.com> wrote: > Hi, > > [X] Stable - Go ahead and release > >- Tested the default profiles of all and clustering scenarios of some. >- wso2as > - wso2am > - wso2brs > - wso2bps > - wso2greg > - wso2mb >- Verified Heiradata from some profiles >- Verified the Readme and License > > Regards, > Vishanth > > On Wed, Mar 9, 2016 at 12:07 PM, Chamila De Alwis > wrote: > >> Hi, >> >> Please note that the voting period is 72 hours. >> >> >> Regards, >> Chamila de Alwis >> Committer and PMC Member - Apache Stratos >> Software Engineer | WSO2 | +94772207163 >> Blog: code.chamiladealwis.com >> >> >> >> On Wed, Mar 9, 2016 at 10:33 AM, Chamila De Alwis >> wrote: >> >>> Hi, >>> >>> This is RC2 for WSO2 Puppet Modules 1.1.0. Please download, verify, and >>> vote. >>> >>> [ ] Broken - Do not release (explain why) >>> [ ] Stable - Go ahead and release >>> >>> *This release is based on the following tag:* >>> https://github.com/wso2/puppet-modules/releases/tag/1.1.0-rc2 >>> >>> *Release verification guide can be found at:* >>> https://github.com/wso2/puppet-modules/wiki/Verifying-Puppet-Modules >>> >>> *Source and distribution packages can be downloaded at:* >>> https://github.com/wso2/puppet-modules/releases/tag/1.1.0-rc2 >>> >>> Regards, >>> Chamila de Alwis >>> Committer and PMC Member - Apache Stratos >>> Software Engineer | WSO2 | +94772207163 >>> Blog: code.chamiladealwis.com >>> >>> >>> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > *Vishanth Balasubramaniam* > Committer & PMC Member, Apache Stratos, > Software Engineer, WSO2 Inc.; http://wso2.com > > mobile: *+94 77 17 377 18* > about me: *http://about.me/vishanth <http://about.me/vishanth>* > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Getting error when starting WSO2 IS 5.1.0 Key Manager in Mesos DC/OS
Hi All, I'm getting below error when deploying WSO2 IS 5.1.0 Key Manager application [1] in Mesos DC/OS. I have used the hosted IS-5.1.0 Key Manager pack [2] to build the docker image. I0627 02:40:36.478433 27342 exec.cpp:143] Version: 0.28.1 I0627 02:40:36.481850 27369 exec.cpp:217] Executor registered on slave 877f8cbc-9f5d-4fed-ab3d-82e145e8d33a-S3 rm: cannot remove '/mnt/192.168.65.111-172.17.0.6/wso2is-km-5.1.0/tmp/axis2-tmp-6697148023468900485.tmp': Directory not empty rm: cannot remove '/mnt/192.168.65.111-172.17.0.6/wso2is-km-5.1.0/tmp/bundles_info_f09679b3-4b3d-4f19-8ddf-139763830045': Directory not empty java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.wso2.carbon.bootstrap.Bootstrap.loadClass(Bootstrap.java:63) at org.wso2.carbon.bootstrap.Bootstrap.main(Bootstrap.java:45) Caused by: java.lang.RuntimeException: /mnt/wso2is-km-5.1.0/repository/components/default/configuration/org.eclipse.osgi/.manager/.fileTable.9 (No such file or directory) at org.wso2.carbon.server.CarbonLauncher.launch(CarbonLauncher.java:115) at org.wso2.carbon.server.Main.launchCarbon(Main.java:160) at org.wso2.carbon.server.Main.main(Main.java:94) ... 6 more If I remove the files in [CARBON_HOME]/repository/components/default/configuration/org.eclipse.osgi/.manager/ directory in the hosted KM pack and use it to build the docker images, I am able to deploy it in successfully and the server starts without any issue. As per the offline discussion with Niranjan, the above mentioned files will be created if we install the features via UI. If we can install Key Manager features using pom files, then above issue will be resolved. @APIM_team: Shall we fix this and host the new IS 5.1.0 Key Manager pack? [1]. https://github.com/wso2/mesos-artifacts/tree/master/wso2is-km [2]. http://product-dist.wso2.com/downloads/api-manager/1.10.0/identity-server/wso2is-5.1.0.zip Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Getting error when starting WSO2 IS 5.1.0 Key Manager in Mesos DC/OS
Hi Udara, On Tue, Jun 28, 2016 at 5:11 PM, Udara Liyanage wrote: > Hi Thanuja, > > Not to deviate the conversation, but to provide some information > > We are running IS as KM pack in Mesos 1.6 environment and we don't get > this error. > Our Mesos nodes are Debian 7. > I tested this using Mesos DC/OS vagrant setup [1] where the nodes have CentOS 7. > > Do we get this error only when running on DCOS or in all environment? > We are getting this only in CentOS 7 environment. I tested the same pack in Ubuntu 14.04 and didn't get any issues when starting the server. [1]. https://github.com/dcos/dcos-vagrant Thanks. > > On Tue, Jun 28, 2016 at 4:50 PM, Nuwan Dias wrote: > >> >> >> On Tuesday, 28 June 2016, Akila Ravihansa Perera >> wrote: >> >>> Hi Nuwan, >>> >>> I think ideally this should have been automated as a maven task and >>> added to the product-apim repo as a tool. The distribution that you have >>> built via UI cannot be replicated. We don't even recommend installing >>> features via UI for a production deployment then why have we hosted this >>> publicly? >>> >> >> We don't recommend? I didn't know that. What is the purpose of leaving >> the feature management UI then? Why doesn't it even have a warning? >> >> Anyhow, many people are using this pack without any issues. And we have >> followed this practise for several releases now. No issues so far. So we >> can't prioritise your request right now since it involves in a significant >> testing effort and we have many things to attend to right now. What does >> it mean to you guys? Are you guys blocked and unable to proceed unless this >> is rehosted? >> >>> >>> Thanks. >>> >>> On Tue, Jun 28, 2016 at 3:47 PM, Imesh Gunaratne wrote: >>> >>>> Hi Nuwan, >>>> >>>> It would be ideal to fix this issue and re-host the distribution or we >>>> can even fix it in the next release. For the time being will mention this >>>> in the documentation and provide steps for the user to overcome this >>>> problem. >>>> >>>> Thanks >>>> >>>> On Tue, Jun 28, 2016 at 2:41 PM, Niranjan Karunanandham < >>>> niran...@wso2.com> wrote: >>>> >>>>> Hi Thanuja / Nuwan, >>>>> >>>>> On Tue, Jun 28, 2016 at 2:08 PM, Nuwan Dias wrote: >>>>> >>>>>> >>>>>> >>>>>> On Tue, Jun 28, 2016 at 11:27 AM, Thanuja Uruththirakodeeswaran < >>>>>> thanu...@wso2.com> wrote: >>>>>> >>>>>>> Hi All, >>>>>>> >>>>>>> I'm getting below error when deploying WSO2 IS 5.1.0 Key Manager >>>>>>> application [1] in Mesos DC/OS. I have used the hosted IS-5.1.0 Key >>>>>>> Manager >>>>>>> pack [2] to build the docker image. >>>>>>> >>>>>>> I0627 02:40:36.478433 27342 exec.cpp:143] Version: 0.28.1 >>>>>>> I0627 02:40:36.481850 27369 exec.cpp:217] Executor registered on >>>>>>> slave 877f8cbc-9f5d-4fed-ab3d-82e145e8d33a-S3 >>>>>>> rm: cannot remove >>>>>>> '/mnt/192.168.65.111-172.17.0.6/wso2is-km-5.1.0/tmp/axis2-tmp-6697148023468900485.tmp': >>>>>>> Directory not empty >>>>>>> rm: cannot remove >>>>>>> '/mnt/192.168.65.111-172.17.0.6/wso2is-km-5.1.0/tmp/bundles_info_f09679b3-4b3d-4f19-8ddf-139763830045': >>>>>>> Directory not empty >>>>>>> java.lang.reflect.InvocationTargetException >>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>>>>>> at >>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>>>>>> at >>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>>>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>>>>> at org.wso2.carbon.bootstrap.Bootstrap.loadClass(Bootstrap.java:63) >>>>>>> at org.wso2.carbon.bootstrap.Bootstrap.main(Bootstrap.java:45) >>>>>>> Caused by: java.lang.RuntimeException: >>>>>>> /mnt/wso2is-km-5.1.0/repository/components/default/configuration/org.eclipse.osgi/.manager/.fileTable.9 >>>>&g
[Dev] Update on Puppet Modules 2.1.0 release
Hi All, This is to give an update on the tasks carried out for WSO2 Puppet Modules [1] 2.1.0 release. *Completed tasks:* - Created new modules for ESB 5.0.0, wso2greg_pubstore (GREG with APIM store publisher) and wso2is_km (IS with APIM key manager). - Removed following modules that were previously deprecated: 1. WSO2 API Manager 1.9.1 2. WSO2 Business Rules Server 2.1.0 3. WSO2 Governance Registry 4.6.0 4. WSO2 Identity Server 5.0.0 5. WSO2 Message Broker 3.0.0 - Introduced new platform for Mesos and created Hiera structure and configuration for deploying WSO2 products on Apache Mesos using WSO2 Mesos Artifacts [2]. - Added support to configure SSO for WSO2 products via Puppet Modules. - Improved secure vault configurations by updating templates with key stores references in all the product modules and adding few more secure vault configs to hiera data. - Completed testing following puppet modules hiera configurations for Mesos platform: 1. WSO2 API Manager 1.10.0 2. WSO2 Application Server 5.3.0 3. WSO2 Business Process Server 3.5.0 and 3.5.1 4. WSO2 Business Rules Server 2.2.0 5. WSO2 Complex Event Processor 4.0.0 6. WSO2 Data Analytics Server 3.0.0 and 3.0.1 7. WSO2 Data Services Server 3.5.0 8. WSO2 Enterprise Store 2.0.0 9. WSO2 Enterprise Service Bus 4.9.0 10. WSO2 Governance Registry 5.1.0 11. WSO2 Governance Registry 5.1.0 with APIM Publisher and Store 12. WSO2 Identity Server 5.1.0 13. WSO2 Identity Server 5.1.0 with APIM Key Manager *Pending Tasks:* - Update and verify WSO2 Message Broker 3.1.0 puppet module hiera configurations in Mesos platform. - Test ESB 5.0.0 puppet module. [1]. https://github.com/wso2/puppet-modules [2]. https://github.com/wso2/mesos-artifacts Thanks. -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [VOTE] Release WSO2 Puppet Modules 2.1.0 RC1
Hi Akila, Thanks for pointing this. I have fixed this in commit [1]. Thanks. [1]. https://github.com/wso2/puppet-modules/commit/71a52d16f3b1d765f911d0ce197f627c36c513a6 On Sat, Jul 23, 2016 at 11:58 AM, Akila Ravihansa Perera wrote: > Hi Pubudu, > > The pom version in master branch should always be a SNAPSHOT version [1]. > > [1] https://github.com/wso2/puppet-modules/blob/master/pom.xml#L24 > > Thanks. > > On Fri, Jul 22, 2016 at 10:04 PM, Pubudu Gunatilaka > wrote: > >> Hi Devs, >> >> This is the first release candidate (RC1) of WSO2 Puppet Modules 2.1.0 >> release. Please download, verify, and vote. Voting will be open for 72 >> hours or as needed. >> >> This release fixes following issues: >> >> https://wso2.org/jira/browse/PMODULES-16?filter=13155 >> >> Source and binary distribution files: >> >> https://github.com/wso2/puppet-modules/releases/tag/v2.1.0-rc1 >> >> The tag to be voted upon: >> >> https://github.com/wso2/puppet-modules/releases/tag/v2.1.0-rc1 >> >> Release verification guide: >> >> https://docs.wso2.com/display/PM210/Setting+up+the+Development+Environment >> >> Refer modules README files for more details. >> >> Please vote as follows. >> >> [+] Stable - go ahead and release >> >> [-] Broken - do not release (please explain why) >> >> Thank you, >> WSO2 PaaS Team. >> >> -- >> *Pubudu Gunatilaka* >> Committer and PMC Member - Apache Stratos >> Software Engineer >> WSO2, Inc.: http://wso2.com >> mobile : +94774078049 <%2B94772207163> >> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > Akila Ravihansa Perera > WSO2 Inc.; http://wso2.com/ > > Blog: http://ravihansa3000.blogspot.com > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [VOTE] Release WSO2 Dockerfiles 1.2.0 RC1
[+1] Stable - Go ahead and release Verified the following: 1. Distribution 2. License Headers 3. Built following products docker images with puppet provisioning for Mesos platform and tested basic functionalities: - WSO2 ES 2.0.0 (Distributed setup) - WSO2 ESB 4.9.0 (Distributed setup) - WSO2 MB 3.1.0 - WSO2 IS 5.1.0 - WSO2 IS KM 5.1.0 Thanks. On Fri, Jul 22, 2016 at 9:27 PM, Anuruddha Liyanarachchi < anurudd...@wso2.com> wrote: > Hi Devs, > > This is the first release candidate (RC1) of WSO2 Dockerfiles 1.2.0 > release. > > *This release fixes the following issues:* > > https://wso2.org/jira/issues/?filter=13159 > > *Tag to be voted upon:* > > https://github.com/wso2/dockerfiles/tree/v1.2.0-rc1 > > *Source and distribution packages:* > > https://github.com/wso2/dockerfiles/releases/tag/v1.2.0-rc1 > > Please download, test, and vote. The README file under the distribution > contains guide and instructions on how to try it out locally. > > [+] Stable - Go ahead and release > > [-] Broken - Do not release (explain why) > > > > This vote will be open for 72 hours or as needed. > > Regards, > WSO2 PaaS team > > > _______ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 <http://wso2.com/signature> ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [VOTE] Release WSO2 Puppet Modules 2.1.0 RC2
[+1] Stable - Go ahead and release Verified the following: 1. Distribution 2. License Headers using RAT plugin 3. README files 4. Verified following products with docker images built with puppet provisioning for Mesos platform and tested basic functionalities: - WSO2 ES 2.0.0 (Distributed setup) - WSO2 AS 5.3.0 (Distributed setup) - WSO2 ESB 4.9.0 (Distributed setup) - WSO2 MB 3.1.0 - WSO2 IS 5.1.0 - WSO2 IS KM 5.1.0 - WSO2 APIM 1.10.0 5. Tested above products in Mesos platform with secure vault enabled. 6. Tested SSO configuration with WSO2 IS 5.1.0 as identity provider and WSO2 ESB 4.9.0 and WSO2 AS 5.3.0 as service providers. Thanks. On Mon, Jul 25, 2016 at 6:39 PM, Pubudu Gunatilaka wrote: > Hi Devs, > > This is the second release candidate (RC2) of WSO2 Puppet Modules 2.1.0 > release. Please download, verify, and vote. Voting will be open for 72 > hours or as needed. > > This release fixes following issues: > https://wso2.org/jira/browse/PMODULES-16?filter=13155 > > Source and binary distribution files: > https://github.com/wso2/puppet-modules/releases/tag/v2.1.0-rc2 > > The tag to be voted upon: > https://github.com/wso2/puppet-modules/releases/tag/v2.1.0-rc2 > > Release verification guide: > https://docs.wso2.com/display/PM210/Setting+up+the+Development+Environment > > Refer modules README files for more details. > > Please vote as follows. > [+] Stable - go ahead and release > [-] Broken - do not release (please explain why) > > Thank you, > WSO2 PaaS Team. > > -- > *Pubudu Gunatilaka* > Committer and PMC Member - Apache Stratos > Software Engineer > WSO2, Inc.: http://wso2.com > mobile : +94774078049 <%2B94772207163> > > > _______ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 <http://wso2.com/signature> ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [VOTE] Release WSO2 Mesos Artifacts 1.0.0 RC1
[x] Stable - Go ahead and release Verified the following: 1. License headers using RAT plugin 2. README files 3. Distributions 4. Helper scripts to load docker images and un/deploy products 5. Deployed following products in Mesos DC/OS 1.7 using docker images built with puppet provisioning and verified basic functionalities: - WSO2 APIM 1.10.0 - WSO2 AS 5.3.0 distributed setup - WSO2 ESB 4.9.0 distributed setup - WSO2 ES 2.0.0 distributed setup - WSO2 IS 5.1.0 - WSO2 MB 3.1.0 - WSO2 IS KM 5.1.0 Thanks. On Tue, Jul 26, 2016 at 11:28 PM, Pubudu Gunatilaka wrote: > Hi Devs, > > This is the first release candidate (RC1) of WSO2 Mesos Artifacts 1.0.0. > > Please download, test and vote. Please refer the README files under each > product for details on testing the artifacts. > > Source & binary distribution files: > https://github.com/wso2/mesos-artifacts/releases/tag/v1.0.0-rc1 > > Maven staging repo: > > https://maven.wso2.org/nexus/content/repositories/orgwso2carbonmesosartifacts-1000/ > > The tag to be voted upon: > https://github.com/wso2/mesos-artifacts/releases/tag/v1.0.0-rc1 > > Mesos Artifacts Documentation: > https://docs.wso2.com/display/MA100/Home > > This vote will be open for 72 hours or as needed. > > [+] Stable - go ahead and release > [-] Broken - do not release (explain why) > > > Regards, > WSO2 PaaS team > > -- > *Pubudu Gunatilaka* > Committer and PMC Member - Apache Stratos > Software Engineer > WSO2, Inc.: http://wso2.com > mobile : +94774078049 <%2B94772207163> > > > ___________ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 <http://wso2.com/signature> ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [GSoC Dockerfiles] Added ability to run smoke tests from test framework
today
>>>>> afternoon?
>>>>>
>>>>
>>>> Would 2:30 PM IST work for you?
>>>>
>>>> Thanks
>>>>
>>>>>
>>>>> Thanks
>>>>> Abhishek
>>>>>
>>>>> On Tue, Aug 9, 2016 at 11:00 PM, Abhishek Tiwari <
>>>>> abhishek.tiwari0...@gmail.com> wrote:
>>>>>
>>>>>> HI Vishanth,
>>>>>>
>>>>>> Friday afternoon works fine with me.
>>>>>>
>>>>>> Thanks
>>>>>> Abhishek
>>>>>>
>>>>>> On Wed, Aug 10, 2016 at 10:52 AM, Vishanth Balasubramaniam <
>>>>>> vishan...@wso2.com> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> Shall we have the demo on Friday Afternoon (IST)?
>>>>>>>
>>>>>>> Regards,
>>>>>>> Vishanth
>>>>>>>
>>>>>>> On Tue, Aug 9, 2016 at 4:28 PM, Abhishek Tiwari <
>>>>>>> abhishek.tiwari0...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi Mentors,
>>>>>>>>
>>>>>>>> Dockerfiles test framework is now able to run smoke tests, with
>>>>>>>> smoke tests for ESB added at this point. Developers can extend the
>>>>>>>> framework to add product specific smoke tests.
>>>>>>>>
>>>>>>>> Smoke test for ESB are implemented as follows:
>>>>>>>> 1. Once a new docker image is deployed and the container is up, the
>>>>>>>> script does a login to WSO2 carbon server and maintains cookies so
>>>>>>>> that it
>>>>>>>> can use logged in state in subsequent requests.
>>>>>>>>
>>>>>>>> 2. Creates a new pass-through proxy service. [1]
>>>>>>>>
>>>>>>>> 3. Validates the newly created proxy service is accessible
>>>>>>>> (validates Http response code for the proxy testing url [2])
>>>>>>>>
>>>>>>>> 4. Removes the newly created proxy service. [3]
>>>>>>>>
>>>>>>>> I would like to demo the current state of the project, please
>>>>>>>> provide your preferred date and time.
>>>>>>>>
>>>>>>>> Thanks
>>>>>>>> Abhishek
>>>>>>>>
>>>>>>>> [1]. Http post using /carbon/proxyservices/template
>>>>>>>> _pass-through.jsp
>>>>>>>> [2]. Http get using /carbon/services/?tryit
>>>>>>>> [3]. Http get using /carbon/service-mgt/delete_service_groups.jsp
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> *Vishanth Balasubramaniam*
>>>>>>> Committer & PMC Member, Apache Stratos,
>>>>>>> Software Engineer, WSO2 Inc.; http://wso2.com
>>>>>>>
>>>>>>> mobile: *+94 77 17 377 18*
>>>>>>> about me: *http://about.me/vishanth <http://about.me/vishanth>*
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> *Imesh Gunaratne*
>>>> Software Architect
>>>> WSO2 Inc: http://wso2.com
>>>> T: +94 11 214 5345 M: +94 77 374 2057
>>>> W: https://medium.com/@imesh TW: @imesh
>>>> lean. enterprise. middleware
>>>>
>>>>
>>>
>>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>
--
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware
mobile: +94 774363167
<http://wso2.com/signature>
TID: [-1] [] [2016-08-18 08:51:00,516] WARN {org.apache.axiom.util.stax.dialect.StAXDialectDetector} - Unable to determine dialect of the StAX implementation at bundleresource://14.fwk682551935/ {org.apache.axiom.util.stax.dialect.StAXDialectDetector}
TID: [-1] [] [2016-08-18 08:51:00,512] WARN {org.apache.axiom.util.stax.dialect.StAXDialectDetector} - Unable to determine dialect of the StAX implementation at bundleresource://14.fwk682551935/ {org.apach
Re: [Dev] [VOTE] Release WSO2 MSF4J 2.1.0 RC3
[x] Stable - go ahead and release Verified below samples: 1. Helloworld 2. Metrics 3. Petstore with docker compose Thanks. On Tue, Nov 1, 2016 at 11:53 AM, SajithAR Ariyarathna wrote: > Hi All, > > I have tested > >- Dynamically registering microservices > > It works fine for above case. > [x] Stable - go ahead and release > > Thanks. > > On Mon, Oct 31, 2016 at 8:41 PM, Thusitha Thilina Dayaratne < > thusit...@wso2.com> wrote: > >> Hi Devs, >> >> This is the 3rd Release Candidate of WSO2 MSF4J(Microservices Framework >> for Java) 2.1.0. >> >> Please download, test the framework and vote. The vote will be open for >> 72 hours or as needed. >> Refer to GitHub readmes for guides. >> >> *Source and binary distribution files:* >> https://github.com/wso2/msf4j/releases/tag/v2.1.0-rc3 >> >> *Maven staging repository:* >> https://maven.wso2.org/nexus/content/repositories/orgwso2msf4j-1010 >> >> *The tag to be voted upon:* >> https://github.com/wso2/msf4j/tree/v2.1.0-rc3 >> >> >> >> [ ] Broken - do not release (explain why) >> [ ] Stable - go ahead and release >> >> Thank you, >> Platform Team >> -- >> Thusitha Dayaratne >> Software Engineer >> WSO2 Inc. - lean . enterprise . middleware | wso2.com >> >> Mobile +94712756809 >> Blog alokayasoya.blogspot.com >> Abouthttp://about.me/thusithathilina >> <http://wso2.com/signature> >> >> > > > -- > Sajith Janaprasad Ariyarathna > Software Engineer; WSO2, Inc.; http://wso2.com/ > <https://wso2.com/signature> > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167 <http://wso2.com/signature> ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
