Re: [Dev] Dev studio errors and feedback

2015-12-16 Thread Dulitha Wijewantha
On Tue, Dec 15, 2015 at 10:26 PM, Awanthika Senarath wrote: > Hi Dulitha, > > Find my responses in-line, > > 1) Can't have the same project name in the workspace. For example - I > create a project called gateway-dev and have gateway-car, gateway-synapse, > gateway-registry.

Re: [Dev] [AppFac][Docker]Best Java Docker Client Library

2015-12-16 Thread Roshan Deniyage
Hi Samith, Yes we evaluated [1] and [2] and not going to use those plugins since our docker files are going to be dynamic and should be available to jenkins job before build begins. That is also possible with number of ways, but decided to change only deployment part in appfactory-jenkins

Re: [Dev] HTTP event receiver to accept batch of same type events

2015-12-16 Thread Udara Rathnayake
I'm able to publish array of objects[1] with your help. Thanks Lasantha. [1] [{ "event": { "payloadData": { } } }, { "event": { "payloadData": { } } }] On Wed, Dec 16, 2015 at 3:12 AM, Lasantha Fernando wrote: > Hi Udara, > > You can

Re: [Dev] [AppFac][Docker]Best Java Docker Client Library

2015-12-16 Thread Roshan Deniyage
Adding missing links ; ​ [1] https://wiki.jenkins-ci.org/display/JENKINS/CloudBees+Docker+Build+and+Publish+plugin [2] https://wiki.jenkins-ci.org/display/JENKINS/Docker+build+step+plugin Hi Samith, > Yes we evaluated [1] and [2] and not going to use those plugins since > our docker files

Re: [Dev] Dev studio errors and feedback

2015-12-16 Thread Awanthika Senarath
Hello Dulitha, ​I agree that artifact name needs to be unqiue to the car file. But in a scenario where you have 2 esb configuration projects having an artifact with the same name (in-sequence.xml) - it crashes the car interface.​ If you have the same ESB artifact in different configuration

Re: [Dev] HTTPS REST Client

2015-12-16 Thread Dharshana Warusavitharana
Hi Malmee, The SSL issue comes with the rest client is because you are going to invoke HTTPS backend with out proper certificate in path. you can set keys to the system path using following String trustStore = System.getProperty("carbon.home") + File.separator + "repository" + File.separator +

Re: [Dev] DAS going OOM frequently

2015-12-16 Thread Anjana Fernando
Hi guys, So as Sumedha told me, the error that has come is a OOM perm gen error. And we suspect it's just because they've installed many features there in the IoT server, so lots of classes being loaded. So after increasing the perm gen size, Sumedha mentioned that the issue hasn't come yet.

Re: [Dev] [DEV][DAS][DSS] Error after installing DSS features on DAS

2015-12-16 Thread Chanuka Dissanayake
Hi Niranda, I have checked it [1]. [1] 85 ACTIVE io.dropwizard.metrics.json_3.1.2 regards, Chanuka. On Thu, Dec 17, 2015 at 11:09 AM, Niranda Perera wrote: > Hi Chanuka, > > can you start the server with the osgiconsole and see if > the

Re: [Dev] [APIM] Sample API (WeatherAPI) no longer works

2015-12-16 Thread Lakshman Udayakantha
this has changed. Now API Manager has embedded calculator API. check the latest API Manager 1.10.0-SNAPSHOT On Thu, Dec 17, 2015 at 12:47 PM, Ayoma Wijethunga wrote: > Hi All, > > API manager "Sample API" no longer works. OpenWeatherMap requires sending > an API Key from 9th

Re: [Dev] Latency Calculation Feature in WSO2 GW

2015-12-16 Thread Viraj Senevirathne
Hi All, In ESB 4.10.0 we are introducing new statistic feature which lets user drill down service level statistics. So for higher level statistics we can include, - Avg,Min, Maximum Mediation times for each service - Statistics of each endpoints - Allow users to enable and disable

Re: [Dev] [DEV][DAS][DSS] Error after installing DSS features on DAS

2015-12-16 Thread Niranda Perera
Hi Chanuka, can you start the server with the osgiconsole and see if the io.dropwizard.metrics:metrics-json bundle s available and properly wired? cheers On Thu, Dec 17, 2015 at 10:44 AM, Chanuka Dissanayake wrote: > > Hi > > I'm getting this error relevant to spark after

Re: [Dev] Best way to access registry data in java

2015-12-16 Thread Ishara Cooray
Hi, By getting the super tenant's registry as below and use the relative resource path worked for me. Registry registry = registryService.getGovernanceSystemRegistry(); path = /apimgt/applicationdata/tenant_tier_policies.xml Thanks for the support Danesh. Ishara Cooray Senior Software

[Dev] Latency Calculation Feature in WSO2 GW

2015-12-16 Thread Nadeeshaan Gunasinghe
Hi all, It has been a requirement to implement a feature for keeping track of the various types of latency metrics in WSO2 GW. At the moment I am involved in implementing this latency metrics calculation feature according to the architecture proposed at [1]. As the first step I am capturing the

Re: [Dev] String plus compiles to append

2015-12-16 Thread Rasika Perera
Hi All, Please find comments inline. Yes, this has been the case for sometime where internally append is used. > Try the same with a loop. +1 have tried this. Even though compiler is optimized to put StringBuilder on multiple "+" concats not too *smart* to use the same StringBuilder instance

Re: [Dev] [VOTE] Release WSO2 Carbon Kernel 5.0.0 RC1

2015-12-16 Thread Manuri Amaya Perera
Hi, We are cancelling this vote due to the following issues. In carbon-bundle-archetype the resource template pom is using maven.bundleplugin.version property which was previously in carbon-kernel pom but not anymore, therefore the version is not getting included as expected. In

Re: [Dev] Latency Calculation Feature in WSO2 GW

2015-12-16 Thread Kasun Indrasiri
We may also need a bit of high level stats too.. For instance things we have included in ESB 4.10. On Thu, Dec 17, 2015 at 10:17 AM, Nadeeshaan Gunasinghe wrote: > Hi all, > It has been a requirement to implement a feature for keeping track of the > various types of

[Dev] [DEV][DAS][DSS] Error after installing DSS features on DAS

2015-12-16 Thread Chanuka Dissanayake
Hi I'm getting this error relevant to spark after installing DSS (version 4.3.4) features on DAS 3.0.0. Cannot execute spark queries. [2015-12-17 10:27:42,811] ERROR > {org.wso2.carbon.analytics.spark.core.internal.AnalyticsComponent} - Error > initializing analytics executor:

Re: [Dev] [AppFac][Docker]Best Java Docker Client Library

2015-12-16 Thread Samith Dassanayake
Hi Roshan, Even though if you use [1], you have to face the dynamic docker file issue right?(Correct me If I am wrong). [1] https://github.com/docker-java/docker-java Regards, Samith On Wed, Dec 16, 2015 at 11:40 PM, Roshan Deniyage wrote: > Adding missing links ; > > ​ >

[Dev] [APIM] Sample API (WeatherAPI) no longer works

2015-12-16 Thread Ayoma Wijethunga
Hi All, API manager "Sample API" no longer works. OpenWeatherMap requires sending an API Key from 9th October 2015 [1 ][2 ]. Rate limited key is available for free. Though extended rate limit is available for FOSS

Re: [Dev] HTTPS REST Client

2015-12-16 Thread Udara Liyanage
Hi, As Isuru mentioned better to use an already implemented library as it provides more functions. Plus use an appropriate ConnectionManager, as I remember default connection manager allows only 2 concurrent requests. You will find a sample that is implemented in Stratos [1] [1]

Re: [Dev] [APIM] Sample API (WeatherAPI) no longer works

2015-12-16 Thread Ayoma Wijethunga
Sounds great... Thanks Lakshman for the information. Just noticed that this has been discussed in mailing list around October 30th. I will check 1.10.0. Thanks again, Ayoma. On Thu, Dec 17, 2015 at 12:50 PM, Lakshman Udayakantha wrote: > this has changed. Now API Manager

Re: [Dev] DAS going OOM frequently

2015-12-16 Thread Anjana Fernando
Hi Ayoma, Thanks for checking up on it, actually "getAllIndexedTables" doesn't return the Set here, it returns an array that was previously populated in the refresh operation, so no need to synchronize that method. Cheers, Anjana. On Wed, Dec 16, 2015 at 5:44 PM, Ayoma Wijethunga

Re: [Dev] DAS going OOM frequently

2015-12-16 Thread Gihan Anuruddha
Hi Niranda, So let say we have to run embedded DAS in a memory restricted environment. So where I can define the spark allocated memory configuration information? Regards, Gihan On Wed, Dec 16, 2015 at 6:55 PM, Niranda Perera wrote: > Hi Sumedha, > > I checked the heapdump

Re: [Dev] DAS going OOM frequently

2015-12-16 Thread Ayoma Wijethunga
And, missed mentioning that when this this race condition / state corruption happens all "get" operations performed on Set/Map get blocked resulting in OOM situation. [1 ] has all that explained nicely. I have checked a heap dump

Re: [Dev] Which key of primary keystore is used to encrypt passwords in secure vault?

2015-12-16 Thread Rasika Perera
Hi Bhathiya, In doc[1] you can configure which key to select on "$PRODUCT_HOME/repository/conf/carbon.xml". Is it what you are looking for? ${carbon.home}/resources/security/wso2carbon.jks JKS wso2carbon <--- Password for key store wso2carbon <--- Which key to select

Re: [Dev] [DSS] Instructions to Generate Auth Credentials for google spreadsheet services

2015-12-16 Thread Anjana Fernando
Hi Rajith, Please put the required docs to explain this scenario clearly. Seems this information is not there. Cheers, Anjana. On Wed, Dec 16, 2015 at 5:53 PM, Rajith Vitharana wrote: > Hi Chanuka, > > You need to have a host name instead of direct IP address(doesn't need to

Re: [Dev] DAS going OOM frequently

2015-12-16 Thread Niranda Perera
Hi Sumedha, I checked the heapdump you provided, and the size of it is around 230MB. I presume this was not a OOM scenario. As per the Spark memory usage, when you use spark in the local mode, the processing will happen inside that JVM itself. So, we have to make sure that we allocate enough

Re: [Dev] DAS going OOM frequently

2015-12-16 Thread Ayoma Wijethunga
Hi, I have seen that same sort of exception occurs, when a HashMap is used by multiple threads concurrently. It was necessary to use ConcurrentHashMap or do the proper synchronization in our logic. This was explained as a state corruption [3 - *(interesting read)*] and it is no wonder looking at

Re: [Dev] DAS going OOM frequently

2015-12-16 Thread Ayoma Wijethunga
Hi Anjana, Yes. Agreed, sorry I misread that. In that case OOM should be fine after the fix. Thank you, Ayoma. On Wed, Dec 16, 2015 at 6:11 PM, Anjana Fernando wrote: > Hi Ayoma, > > Thanks for checking up on it, actually "getAllIndexedTables" doesn't > return the Set here,

[Dev] HTTPS REST Client

2015-12-16 Thread Malmee Weerasinghe
Hi All, We have developed a HTTPS REST client using java in-built methods which works properly. [1] This method is configured to allow self signed certificates. When using apache http client we get a certificate error : javax.net.ssl.SSLPeerUnverifiedException: Host name '192.168.30.227' does

Re: [Dev] DAS going OOM frequently

2015-12-16 Thread Niranda Perera
Hi Gihan, The memory can be set by using the conf parameters ie. " spark.executor.memory" rgds On Wed, Dec 16, 2015 at 7:01 PM, Gihan Anuruddha wrote: > Hi Niranda, > > So let say we have to run embedded DAS in a memory restricted environment. > So where I can define the spark

Re: [Dev] HTTPS REST Client

2015-12-16 Thread Isuru Haththotuwa
Hi Malmee, If you have used java built in methods, that would mean your tool would not be required to depend on an external library such as Apache HTTP client as you have mentioned. This is fine for a simple use case. However, please note if you need more functionality, such as support for all

Re: [Dev] Which key of primary keystore is used to encrypt passwords in secure vault?

2015-12-16 Thread Bhathiya Jayasekara
Exactly. Thank you. On Wed, Dec 16, 2015 at 6:14 PM, Rasika Perera wrote: > Hi Bhathiya, > > In doc[1] you can configure which key to select on > "$PRODUCT_HOME/repository/conf/carbon.xml". Is it what you are looking for? > > >

[Dev] [AppFac][Docker]Best Java Docker Client Library

2015-12-16 Thread Roshan Deniyage
Hi All, For App Factory build artifact feature, we are going with the stand alone Jenkins server for the next release as well. This is the existing method. The only change is instead of building user artifact and push it to some git repository, we are going to build a docker image and push it

Re: [Dev] DAS going OOM frequently

2015-12-16 Thread Ayoma Wijethunga
Hi Anjana, Sorry, I didn't notice that you have already replied this thread. However, please consider my point on "getAllIndexedTables" as well. Thank you, Ayoma. On Wed, Dec 16, 2015 at 5:12 PM, Anjana Fernando wrote: > Hi Sumedha, > > Thank you for reporting the issue.

Re: [Dev] [DSS] Instructions to Generate Auth Credentials for google spreadsheet services

2015-12-16 Thread Rajith Vitharana
Hi Chanuka, You need to have a host name instead of direct IP address(doesn't need to be publicly available) since this is used for browser redirect, you can use a local network shared host name as well. For example say the server is running in your machine,then just use "localhost" as the host

Re: [Dev] DAS going OOM frequently

2015-12-16 Thread Anjana Fernando
Hi Sumedha, Thank you for reporting the issue. I've fixed the concurrent modification exception issue, where, actually both the methods "addIndexedTable" and "removeIndexedTable" needed to be synchronized, since they both work on the shared Set object there. As for the OOM issue, can you please

Re: [Dev] [AppFac][Docker]Best Java Docker Client Library

2015-12-16 Thread Samith Dassanayake
Hi Roshan, Have you looked at [1] [1] https://wiki.jenkins-ci.org/display/JENKINS/CloudBees+Docker+Build+and+Publish+plugin Regards, Samith On Wed, Dec 16, 2015 at 4:58 PM, Roshan Deniyage wrote: > Hi All, >For App Factory build artifact feature, we are going with the

[Dev] Governance Registry - Where to define a new handlebars helpers ?

2015-12-16 Thread Arnaud Charpentier
Hi, We are working on the publisher of governance registry. We are trying to internationalize some text chains with jaggery and the Handlebars template engine. We understood that we have to define a new helper with the function registerHelper of the template engine Handlebars but we can't

[Dev] WSO2 Carbon Kernel 4.4.3 Released

2015-12-16 Thread Nipuni Perera
WSO2 Carbon Kernel 4.4.3 Released ​ The Carbon team is pleased to announce the release of Carbon Kernel 4.4.3. Listed below are the improvements and bug fixes that are introduced with this release. Improvements - [CARBON-14740 ] - Improve

Re: [Dev] PPaaS Artifact Migration Tool

2015-12-16 Thread Imesh Gunaratne
Udara should be able to provide more information on this, AFAIU we should be able to map PersistenceBean.isRequired -> Persistence.localPersistanceRequired. May be other properties we can let the user fill in. Thanks On Wed, Dec 16, 2015 at 12:22 PM, Nishadi Kirielle wrote: >

Re: [Dev] PPaaS Artifact Migration Tool

2015-12-16 Thread Nishadi Kirielle
Thank you On Wed, Dec 16, 2015 at 1:56 PM, Imesh Gunaratne wrote: > Udara should be able to provide more information on this, AFAIU we should be > able to map PersistenceBean.isRequired -> > Persistence.localPersistanceRequired. May be other properties we can let the > user fill

Re: [Dev] HTTP event receiver to accept batch of same type events

2015-12-16 Thread Lasantha Fernando
Hi Udara, You can do this using an HTTP receiver as well. For this, you can use XML input mapping and provide a parent selector xpath and if there are multiple child elements within that larger XML element, they will be taken as multiple events. Alternatively, if you are using JSON input

[Dev] DAS going OOM frequently

2015-12-16 Thread Sumedha Rubasinghe
We have DAS Lite included in IoT Server and several summarisation scripts deployed. Server is going OOM frequently with following exception. Shouldn't this[1] method be synchronised? [1]

[Dev] [DEV][IS] Getting an Unique index or primary key violation exception.

2015-12-16 Thread Kamidu Punchihewa
Hi IS team, I am getting a "Unique index or primary key violation" exception when trying to refresh the access token with the refresh token grant type. The error log is given below. As per the discussion I had offline with Johann, this seems to be a known issue which could occur when tested

[Dev] [DEV][DSS] Write a new query for a google spreadsheet data service

2015-12-16 Thread Chanuka Dissanayake
Hi, I have a spreadsheet which have column names with spaces, how could I $subject. I couldn't find a answer from the docs [1]. [1] https://docs.wso2.com/display/DSS350/Google+Spreadsheet Thanks & Regards, Chanuka. -- Chanuka Dissanayake *Software Engineer | **WSO2 Inc.*; http://wso2.com