Re: [Dev] Developer Studio changes ordering of XML attributes

2016-06-09 Thread Nuwan Pallewela
Hi Rajeevan, This behavior happens when we try to format the configuration. We use javax DocumentBuilder to parse and format and it does not care about the attribute order, since it's meaningless as far as the standard is concerned. This for sure we can fix by manually editing the source

[Dev] [CEP] Dynamic key and values support in CEP output adapter

2016-06-09 Thread Rajjaz Mohammed
Hi All, I'm developing File event publisher as an analytics extension. I have the requirement to get the key and values dynamically. How can achieve this in CEP? any idea? eg: uniqueID1--> filePath1 uniqueID2--> filePath2 uniqueID3--> filePath3 uniqueID4--> filePath4 -- Thank you Best

Re: [Dev] Encrypting VFS URL

2016-06-09 Thread Yashothara Shanmugarajah
As Isuru mentioned we can fetch parameters from the registry. In file connector also we have VFS sending facility. We can give values from Postman. But I am not sure we can use vault-lookup things in that. Thanks. Best Regards, Yashothara.S Software Engineer WSO2 On Fri, Jun 10, 2016 at 9:51

[Dev] Developer Studio changes ordering of XML attributes

2016-06-09 Thread Vimalanathan Rajeevan
Hi, I will explain the issue with the help of Property Mediator. When we are adding a property with an expression to a sequence in Graphical Editor, the source view for that mediator is as follows, http://services.samples; xmlns:m1=" http://services.samples/xsd "/> Here 'expression' is

Re: [Dev] Encrypting VFS URL

2016-06-09 Thread Isuru Udana
Hi Manu, Values for these parameters are set at the deploy time and can only have static values. Unfortunately there is no way achieve this using vfs proxy. In inbound endpoints, we have provided a way to fetch parameters from the registry. However still we cannot use expressions like

Re: [Dev] [GSOC 16] Initial Project Progress

2016-06-09 Thread Isuru Haththotuwa
Hi Osura, This is great progress! This shows that a clustered deployment of WSO2 products on Azure is possible with this membership scheme. About the error, what is says is that a particular resource that the first node is expecting to find in the config registry is not found. This can be due to

Re: [Dev] Exception handling in Spark UDF

2016-06-09 Thread Gimantha Bandara
You will have to catch the exception inside the method itself and log a warning/error meesage and return a default value without throwing the exception out from the method. On Friday, June 10, 2016, Dulitha Wijewantha wrote: > Below is an example usage - > > insert overwrite

Re: [Dev] [VOTE] Release WSO2 Carbon Kernel 4.4.6 RC2

2016-06-09 Thread Rajith Roshan
Hi all, We were able to build the G-Reg pack and able to run all the integration tests without failures. We will send PRs for jasper report orbit bundle and carbon commons, once the kernel 4.4.6 is released. Thanks! Rajith On Thu, Jun 9, 2016 at 6:40 PM, Viraj Senevirathne

[Dev] Encrypting VFS URL

2016-06-09 Thread Manuranga Perera
I have a FTP secured by a password/username. I want to secure the password.I can use vfs encrypt utils [1], but it is trivially decodable. Is there a way to use a secure vault for this? I tried following http://ws.apache.org/ns/synapse; name="vfsy" transports="https http vfs" startOnLoad="true"

Re: [Dev] Exception handling in Spark UDF

2016-06-09 Thread Dulitha Wijewantha
Below is an example usage - insert overwrite table TABLE_NAME select date, count(distinct sessionKey) as activity, appKey, role, first(y.dateDisplay) as dateDisplay from (select sessionKey as sessionKey, dateFormatter(timestamp, "MM/dd/ HH:mm", "-MM-dd:HH") as dateDisplay, appKey as

Re: [Dev] Exception handling in Spark UDF

2016-06-09 Thread Sachith Withana
Hi Dulitha, Can you provide the query that you are using? That would help us give you a better solution I guess. Regards, Sachith On Thu, Jun 9, 2016 at 2:34 PM, Dulitha Wijewantha wrote: > Hi guys, > I have written a customer Spark UDF function that allows me to convert a

Re: [Dev] [IS] RESTful Fine Grained Authorization-as-a-Service (AZaaS)

2016-06-09 Thread Manujith Pallewatte
Hi Pushpalanka, Was confused in the PR procedure, and figured that I forgot to initialize the github repo as you have mentioned in a previous message. So the new location of the codebase is at [1] Over the weekend, I'll fix any remaining issues and send the PR For now I have used the

[Dev] Exception handling in Spark UDF

2016-06-09 Thread Dulitha Wijewantha
Hi guys, I have written a customer Spark UDF function that allows me to convert a date string to a given input format. If there is a ParseException due to input being invalid - the whole spark script will stop execution. Is there away to skip that particular iteration and move on to the next in

Re: [Dev] [GREG] Invalid value error for REG_CREATED_TIME column in REG_RESOURCE with mysql 5.7

2016-06-09 Thread Uvindra Dias Jayasinha
Note that the above feature(auto initialize time stamp columns) was introduced in MYSQL 5.6.5[1], so this kind of change to the scripts will not be compatible with older MySQL versions. [1] http://dev.mysql.com/doc/refman/5.6/en/timestamp-initialization.html#idm139923373307456 On 9 June 2016 at

Re: [Dev] [GREG] Invalid value error for REG_CREATED_TIME column in REG_RESOURCE with mysql 5.7

2016-06-09 Thread Uvindra Dias Jayasinha
Lets just try DEFAULT CURRENT_TIMESTAMP for all TIMESTAMP fields. Avoid using ON UPDATE CURRENT_TIMESTAMP, our code already explicitly updates time stamp fields where required so we do not want MySQL to do this for us. On 9 June 2016 at 22:43, Sewmini Jayaweera wrote: >

Re: [Dev] [GREG] Invalid value error for REG_CREATED_TIME column in REG_RESOURCE with mysql 5.7

2016-06-09 Thread Sewmini Jayaweera
[Adding Uvindra and Maduranga] Sewmini Jayaweera *Software Engineer - QA Team* Mobile: +94 (0) 773 381 250 sewm...@wso2.com On Thu, Jun 9, 2016 at 12:16 PM, Sewmini Jayaweera wrote: > Hi All, > > I get "ERROR 1067 (42000): Invalid default value for > 'REG_LAST_UPDATED_TIME'

Re: [Dev] [GSOC 16] Initial Project Progress

2016-06-09 Thread Osura Rathnayake
Hi Akila, Thank you it worked. On Thu, Jun 9, 2016 at 6:51 PM, Akila Ravihansa Perera wrote: > Hi Osura, > > Please make sure that you have kernel patch0012 applied in > repository/components/patches for Carbon 4.2.0 based products. You can > refer to Carbon release matrix

Re: [Dev] Use of WSO2_ANALYTICS_FS_DB in WSO2 DAS

2016-06-09 Thread Sachith Withana
For analytics datasources, in DAS 3.0.1, yes, only those two are needed. On Thu, Jun 9, 2016 at 9:14 AM, Dulitha Wijewantha wrote: > > > On Wed, Jun 8, 2016 at 4:10 PM, Sachith Withana wrote: > >> Hi Dulitha, >> >> The doc you are referring to is for DAS

Re: [Dev] Use of WSO2_ANALYTICS_FS_DB in WSO2 DAS

2016-06-09 Thread Dulitha Wijewantha
On Wed, Jun 8, 2016 at 4:10 PM, Sachith Withana wrote: > Hi Dulitha, > > The doc you are referring to is for DAS 3.0.0 NOT DAS 3.0.1. > Refer to [1] for DAS 3.0.1 docs. > > In DAS 3.0.0, ANALYTICS_FS_DB is used to store the index data. > > But from 3.0.1 onwards, we are storing

Re: [Dev] [GSOC 16] Initial Project Progress

2016-06-09 Thread Akila Ravihansa Perera
Hi Osura, Please make sure that you have kernel patch0012 applied in repository/components/patches for Carbon 4.2.0 based products. You can refer to Carbon release matrix [1] to get a list of products that are based on Carbon 4.2.0. For Carbon 4.4.1 based products you need kernel patch0005. [1]

Re: [Dev] [VOTE] Release WSO2 Carbon Kernel 4.4.6 RC2

2016-06-09 Thread Viraj Senevirathne
Hi All, We were able to build the ESB pack after including velocity bundle to the mediator feature. Now we are running integration tests with the pack. Will update the thread with results. Regards, On Thu, Jun 9, 2016 at 10:39 AM, Rajith Roshan wrote: > Hi all, > > Since

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-09 Thread Tharindu Edirisinghe
Hi Asantha, Great ! There has been a delay in my replies but it's really good to see your progress with the project with a minimum level of supervision. I will arrange a review next week with the Identity Server team for the work completed so far and then we can provide the Mid Review feedback

Re: [Dev] YAML configuration for HTTP Monitoring Interceptor in MSF4J

2016-06-09 Thread Isuru Perera
So, will the next MSF4J release use that util? Will there be a release of MSF4J with Carbon Kernel 5.1.0? On Thu, Jun 9, 2016 at 3:23 PM, Afkham Azeez wrote: > It will be in the kernel. Still wip. > > On Thu, Jun 9, 2016 at 3:18 PM, Isuru Perera wrote: > >> On

Re: [Dev] Where is MSF4J product?

2016-06-09 Thread Afkham Azeez
Bundle samples are for WSO2 developers only. At the moment you have to install it on to the Carbon kernel. On Thu, Jun 9, 2016 at 4:50 PM, Isuru Perera wrote: > So, how do we test the "MSF4J feature" without a product? I think it would > be much easier if there is a sample

Re: [Dev] Checking isDebugEnabled() for formatted debug logs

2016-06-09 Thread Isuru Perera
On Thu, Jun 9, 2016 at 4:28 PM, Abimaran Kugathasan wrote: > I think, it's depends on the framework and their versions. > > latest versions of slf4j or log4j 2 don't require guard statements. > Have they mentioned about this somewhere? > They use a parameterized log statement

Re: [Dev] Where is MSF4J product?

2016-06-09 Thread Isuru Perera
So, how do we test the "MSF4J feature" without a product? I think it would be much easier if there is a sample distribution. For example carbon-datasources has a distribution. https://github.com/wso2/carbon-datasources/tree/master/distribution We may not need to deploy it to Maven Repository. If

Re: [Dev] [APIM] [IS] IS as KM Error Caused by: java.lang.ClassNotFoundException: org.wso2.carbon.apimgt.keymgt.util.APIManagerOAuthCallbackHandler

2016-06-09 Thread Harsha Kumara
+Bhathiya On Thu, Jun 9, 2016 at 4:45 PM, Harsha Kumara wrote: > Hi All, > > In the IS as KM setup, we are getting error mentioned in the $Subject. > This is a intermittent behavior which occurs when generating a user token. > As I went through the code, IS side, it's

[Dev] [APIM] [IS] IS as KM Error Caused by: java.lang.ClassNotFoundException: org.wso2.carbon.apimgt.keymgt.util.APIManagerOAuthCallbackHandler

2016-06-09 Thread Harsha Kumara
Hi All, In the IS as KM setup, we are getting error mentioned in the $Subject. This is a intermittent behavior which occurs when generating a user token. As I went through the code, IS side, it's initialize the handlers configured in the identity.xml when the first token request has made to the

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-09 Thread Asantha Thilina
Hi Tharindu, i rearranged the UM_USER_ATTRIBUTE collection now when ever user update his profile, claim values will save in the collection the way we discussed in hangout i updated my repo[1] with latest modification [1] https://github.com/asanthamax/mongodbuserstore Thanks, Asantha On Wed,

Re: [Dev] Where is MSF4J product?

2016-06-09 Thread Afkham Azeez
We have removed the product because we no longer ship it. On Thu, Jun 9, 2016 at 4:17 PM, Isuru Perera wrote: > Hi, > > How should we test MSF4J bundles. For example, see: > https://github.com/wso2/msf4j/tree/master/samples/log-interceptor-bundle > > It says that we can use

Re: [Dev] Checking isDebugEnabled() for formatted debug logs

2016-06-09 Thread Abimaran Kugathasan
I think, it's depends on the framework and their versions. latest versions of slf4j or log4j 2 don't require guard statements. They use a parameterized log statement so that an event can be logged unconditionally, but message formatting only occurs if the event is enabled. Message construction is

Re: [Dev] Where is MSF4J product?

2016-06-09 Thread Niranjan Karunanandham
Hi Isuru, AFAIK, in-order to test MSF4J bundles, you need to install the ms4fj (and dependent) features in the Carbon 5 server and test the bundle. Regards, Nira On Thu, Jun 9, 2016 at 4:17 PM, Isuru Perera wrote: > Hi, > > How should we test MSF4J bundles. For example, see:

[Dev] Where is MSF4J product?

2016-06-09 Thread Isuru Perera
Hi, How should we test MSF4J bundles. For example, see: https://github.com/wso2/msf4j/tree/master/samples/log-interceptor-bundle It says that we can use WSO2 MSF4J product. But where is it? Thanks! Best Regards, -- Isuru Perera Associate Technical Lead | WSO2, Inc. | http://wso2.com/ Lean .

Re: [Dev] SnapshotService info logs to debug mode

2016-06-09 Thread Mohanadarshan Vivekanandalingam
On Thu, Jun 9, 2016 at 2:56 PM, Nirmal Fernando wrote: > Still see these INFO logs. Shall we please remove them? > Yes, we'll check and fix.. Grainer has added to jira [1]. [1] https://wso2.org/jira/browse/CEP-1508 Thanks, Mohan > > On Wed, Apr 13, 2016 at 8:03 AM, Nirmal

Re: [Dev] YAML configuration for HTTP Monitoring Interceptor in MSF4J

2016-06-09 Thread Afkham Azeez
It will be in the kernel. Still wip. On Thu, Jun 9, 2016 at 3:18 PM, Isuru Perera wrote: > On Thu, Jun 9, 2016 at 3:08 PM, Afkham Azeez wrote: > >> We are building a separate util which will take care of loading stuff >> from the env & making it possible to

Re: [Dev] YAML configuration for HTTP Monitoring Interceptor in MSF4J

2016-06-09 Thread Isuru Perera
On Thu, Jun 9, 2016 at 3:08 PM, Afkham Azeez wrote: > We are building a separate util which will take care of loading stuff from > the env & making it possible to override the config using a > deployment.properties file. Ideally you should be using that util. We can > have it

Re: [Dev] Checking isDebugEnabled() for formatted debug logs

2016-06-09 Thread Isuru Perera
I think it's better to use isDebugEnabled for any debug log, even if it is using parameters for a formatted string. If the debug is not enabled, we don't even want to create the String object. No need to assign to a final variable. Checking the condition just before logging should be enough. On

Re: [Dev] YAML configuration for HTTP Monitoring Interceptor in MSF4J

2016-06-09 Thread Afkham Azeez
We are building a separate util which will take care of loading stuff from the env & making it possible to override the config using a deployment.properties file. Ideally you should be using that util. We can have it ready by the end of this week. On Thu, Jun 9, 2016 at 2:40 PM, Isuru Perera

Re: [Dev] [IS 510] Keystore configs required in multiple locations

2016-06-09 Thread Udara Liyanage
Hi Maliti, We removed it from repo/conf, then IS throws errors when starting. On Thu, Jun 9, 2016 at 5:25 AM, Malithi Edirisinghe wrote: > > > On Thu, Jun 9, 2016 at 11:48 AM, Udara Liyanage wrote: > >> Hi, >> >> When migrating from IS 500 to 510 we get

Re: [Dev] Checking isDebugEnabled() for formatted debug logs

2016-06-09 Thread Afkham Azeez
No need to do isDebugEnabled ideally for formatted logs. On Thu, Jun 9, 2016 at 3:01 PM, Jayanga Kaushalya wrote: > Hi, > > Do we need to check whether the isDebugEnabled() for formatted debug logs > without any string concatenations? For example below code: > > if

Re: [Dev] Error while registering UDF method in Spark

2016-06-09 Thread Supun Sethunga
Hi Dharshana/Sachith, We are observing the same error in analytics-esb server as well. Even though the exception is harmless directly, it causes any Test cases which extend *ServerStartupBaseTest*[1] to be failed (coz of the "ERROR" string in the logs). I tried excluding the UDF class in the

[Dev] Checking isDebugEnabled() for formatted debug logs

2016-06-09 Thread Jayanga Kaushalya
Hi, Do we need to check whether the isDebugEnabled() for formatted debug logs without any string concatenations? For example below code: if (log.isDebugEnabled) { log.debug("Test log with var: {} and var: {}", var1, var2); } If we have to check it is, what is the best way to check it? Assign

[Dev] Rest Services in mdm-admin

2016-06-09 Thread First NameTangwe Caleb
Good day all,  I am having problems adding Rest Services to mdm-admin I had some troubles with mdm-android-* I created the service and refrence in the permition.xml file Creating a rest service in mdm-admin it has sefinitin as below @GET @Path("{type}/{id}/logs") public List getDeviceLogs(

Re: [Dev] [IS 510] Keystore configs required in multiple locations

2016-06-09 Thread Malithi Edirisinghe
On Thu, Jun 9, 2016 at 11:48 AM, Udara Liyanage wrote: > Hi, > > When migrating from IS 500 to 510 we get keystore errors while starting up > the server regardless of the fact that all configurations are correct. We > noticed that IS 510 has another configuration file >

Re: [Dev] SnapshotService info logs to debug mode

2016-06-09 Thread Nirmal Fernando
Still see these INFO logs. Shall we please remove them? On Wed, Apr 13, 2016 at 8:03 AM, Nirmal Fernando wrote: > I think I found what's happening. > > * CEP starts to synch from a Snapshot as soon as it got to know that > there's a new member, hence, it complains that there're

[Dev] YAML configuration for HTTP Monitoring Interceptor in MSF4J

2016-06-09 Thread Isuru Perera
Hi, Currently the MSF4J uses environment variables to configure HTTP Monitoring Interceptor and Metrics Interceptor. In Metrics 2.0.0-SNAPSHOT, there is a yaml file for metrics configuration. I'm now integrating Metrics 2.0.0 to MSF4J. Therefore the metrics configurations must be done from the

Re: [Dev] [IS 510] Keystore configs required in multiple locations

2016-06-09 Thread Niranjan Karunanandham
Hi Darshana, On Thu, Jun 9, 2016 at 11:48 AM, Udara Liyanage wrote: > Hi, > > When migrating from IS 500 to 510 we get keystore errors while starting up > the server regardless of the fact that all configurations are correct. We > noticed that IS 510 has another configuration

Re: [Dev] Modifications to the DCR endpoint

2016-06-09 Thread Amila De Silva
Hi, IMO DCR implementation should not depend on/use AMDefaultKeyManagerImpl because; 1. DCR offers a more basic functionality than AMDefaultKeyManagerImpl and it should be KeyManager using DCR not the other way around. 2. Using methods in apimgt bundles will create a dependancy on those

Re: [Dev] Fwd: WSO2 API Manager 2.0.0 BETA Released!

2016-06-09 Thread Kavitha Subramaniyam
Hi Bhathiya, Thanks! On Thu, Jun 9, 2016 at 1:52 PM, Bhathiya Jayasekara wrote: > Hi Kavitha, > > Please download latest p2-repo (for BETA) from here[1]. The issue you have > mentioned is an intermittent one and we have identified the reason. That > needs to be fixed from IS

[Dev] Could not access DNS suffix

2016-06-09 Thread Nifras Ismail
Hi infra, I need to configure DNS on VMware ESxi server. while i ping my machine ipconfig I got the details as follow [image: Inline image 1] >From this there is DNS suffix is already available on private.wso2.com Can't we use this DNS settings to configure a virtual appliance ( in my case

Re: [Dev] Fwd: WSO2 API Manager 2.0.0 BETA Released!

2016-06-09 Thread Bhathiya Jayasekara
Hi Kavitha, Please download latest p2-repo (for BETA) from here[1]. The issue you have mentioned is an intermittent one and we have identified the reason. That needs to be fixed from IS side. We will be doing that soon. [1]

[Dev] [App Cloud] Reproduce the intermittent Malformed JSON Exception when calling tier api

2016-06-09 Thread Sabra Ossen
Hi All, Regarding jira mentioned in [1] I investigated the logs and was able to identify that the issue is from tier API which we call to get details on subscription plans. The stack trace is as follows. org.mozilla.javascript.WrappedException: Wrapped com.google.gson.JsonSyntaxException:

Re: [Dev] [GREG] Invalid value error for REG_CREATED_TIME column in REG_RESOURCE with mysql 5.7

2016-06-09 Thread Thilini Cooray
[+Uvindra] Hi, IMO we need to go for a solution which we do not have to push users to change their database server settings as all the users may not have direct access or their company policies may not allow such. I suppose that we can overcome this issue by removing NOT NULL attribute as we

Re: [Dev] Emm Alpha 2.1.0 first Build Errors Pls Help

2016-06-09 Thread Inosh Perera
Hi Caleb, You can download the alpha pack here[1]. [1]. https://github.com/wso2/product-emm/releases /download/v2.1.0-alpha/wso2emm-2.1.0-alpha.zip Regards, Inosh On Wed, Jun 8, 2016 at 11:42 PM, Darshana Gunawardana wrote: > Hi Caleb, > > Can you specify from where do you

Re: [Dev] Fwd: WSO2 API Manager 2.0.0 BETA Released!

2016-06-09 Thread Kavitha Subramaniyam
Hi Bhathiya, For IS as KM setup I could use the P2 repo shared on 6th-June[1], but observed CNF exception in IS side when up the apim server. We suspect the reason could be the P2 repo I have used. Could you please confirm whether I can use the same repo or please share if you have latest P2 repo

Re: [Dev] [GREG] Invalid value error for REG_CREATED_TIME column in REG_RESOURCE with mysql 5.7

2016-06-09 Thread Sewmini Jayaweera
Hi All, I get "ERROR 1067 (42000): Invalid default value for 'REG_LAST_UPDATED_TIME' error when sourcing '/dbscripts/mysql.sql, even after removing 'DEFAULT 0' Please find further information below. *1. Issue description* CREATE TABLE IF NOT EXISTS REG_RESOURCE( REG_PATH_ID

[Dev] [IS 510] Keystore configs required in multiple locations

2016-06-09 Thread Udara Liyanage
Hi, When migrating from IS 500 to 510 we get keystore errors while starting up the server regardless of the fact that all configurations are correct. We noticed that IS 510 has another configuration file (repository/conf/identity/EndpointConfig.properties.) which requires keystore configurations.

[Dev] [MB] MB 3.1.0 goes OOM with compression enabled with MSSQL as message store

2016-06-09 Thread Pumudu Ruhunage
Hi all, we saw that in MB 3.1.0, for several scenarios (ex: 10KB messages, with compression enabled) servers went OOM half way to 1M messages[1]. Please note that this happens with default flow control settings. AFAIU this is what happened. 1. With MySQL, database was the overall bottleneck in