[Architecture] Caching Support for Analytics Event Tables

Hi, We've added the $subject. Basically, a local cache is now maintained in each event table, where it will store the most recently used data items in the cache, up to a certain given cache size, for a maximum given lifetime. The format is as follows:- @from(eventtable = 'analytics.table' ,

Re: [Architecture] Incremental Processing Support in DAS

DAS deployment might end up collecting data from multiple time zones? Is that supported? How is it handled? Does end users have to issue queries in UTC? thoughts please --Srinath On Wed, Jun 15, 2016 at 2:11 AM, Mohanadarshan Vivekanandalingam < mo...@wso2.com> wrote: > Hi Inosh, > > Thanks

[Architecture] Providing CSV support in Data Mapper

Hi All, We are supporting the schema generation for CSV payloads in visual data mapper and please find the details as follows *Input* : studentID,studentName,class,gender ST001,Mike,10M3,male ST002,Tyson,10B1,male ST003,Alisha,10B2,female *Generated Schema:* { "$schema" :

Re: [Architecture] RSA SecurID Authenticatior for IS

Hi Kathess, On RSA Authentication Manger workflow we are not able to provisioning the users from WSO2 IS. Because the software tokens able to missed use when we allow self user provisioning, Another thing on RSA Authentication Manager workflow : Software tokens buy by the RSA AM System Admin and

Re: [Architecture] Datamapper - Maintaining order in json schema

Hi Susinda, I found this library json-lib [1] and I have tried few XML to JSON conversions. It seems like this library preserves the order. But there are few problems that comes with it. First thing is, it has 5 other library dependencies[1]. Also, the output JSON of this particular library is

Re: [Architecture] Including chart axes types in the analytics portal wizard UI

Hi Dunith, As we have a clear separation in between chart configuration and data provider, what about if we bring this data type logic to data provider level? There we could redefine the data types with current retrieval method and user preferred types. Then pass that schema to the chart drawing

Re: [Architecture] Including chart axes types in the analytics portal wizard UI

@Dunith; Yes we need to get that config when load the schema in draw method @Sajith; I think this not related for the chart configuration as this is a data manipulation. Those mockups should be done in data set. Chart config is not intelligent enough to figure out missing dates and fill these up.

Re: [Architecture] Incremental Processing Support in DAS

Hi Inosh, Thanks for the fix.. We have incorporated this to analytics-is.. Regards, Mohan On Tue, Jun 14, 2016 at 7:33 PM, Inosh Goonewardena wrote: > Hi All, > > We made a modification to incremental data processing syntax and > implementation in order to avoid

Re: [Architecture] Revamping Refactoring Participants for Developer Studio artifacts to prevent corruption of project meta files (artifact.xml and pom.xml files)

Sorry for the delayed replay I am +1 for both solutions On Thu, Jun 9, 2016 at 3:58 AM, Harshana Eranga Martin wrote: > Hi Kavith, > > +1 for Solution 1 and -0 for Solution 2. > > Rationale is as below. > > Solution 1: > > When we implemented the Refactoring Participants

[Architecture] Initial Implementation of content-aware support in Carbon-Gateway

Hi all, We have identified three scenarios when considering content aware support in Next Gen ESB . These can be categorized as a pure pass thru scenario where payload is not touched , reading the content without modifying scenario and reading and modifying the content. So we came up of

Re: [Architecture] [ESB] Can we get rid of the usage of get-property function?

Hi All, Performance issue with get-property() caused by unnecessary registry access is now fixed with https://github.com/wso2/wso2-synapse/pull/570 Thanks. On Tue, Jun 14, 2016 at 10:14 PM, Isuru Udana wrote: > Hi Nadeeshan, > > > On Tue, Jun 14, 2016 at 12:38 AM, Nadeeshaan

Re: [Architecture] [ESB] Can we get rid of the usage of get-property function?

Hi Nadeeshan, On Tue, Jun 14, 2016 at 12:38 AM, Nadeeshaan Gunasinghe wrote: > Hi all, > > After analyzing the possibility of adding the synapse variable for the > registry scope I could come up with a feasible solution. > > >- Here, one of the key concern was to

Re: [Architecture] [DS]Embeddable gadgets feature for Dashboard Server

There are a few ways to get rid of iframe: 1) Ignore security and come up with a way to just embed as divs. But this may break the parent 2) Use Google Caja. We have to feather look into this. It seems they have some compatibility with Shindig as well. 3) Use WebComponents. This approach needs

Re: [Architecture] Incremental Processing Support in DAS

Hi All, We made a modification to incremental data processing syntax and implementation in order to avoid inconsistencies occur with timeWindows. For example, with the previous approach if the timeWindow is specified as 3600 (or 86400) incremental read time is getting set to the hour starting

Re: [Architecture] Including chart axes types in the analytics portal wizard UI

Hi Tharik, There are situations like we have data set with epoch time attribute and we want to plot those data in bar chart under the following two condition : 1 > it should be plot withing the given time periods and scale. 2 > if there is no data for the particular date, it should be shown as

Re: [Architecture] Log Analyzer Tool logs are displayed in GMT

+1 Indeed, showing local (browser) time with clear timezone indication is the best approach for the UI. Dmitry On Jun 13, 2016 9:32 AM, "Ishara Cooray" wrote: > With the workaround provided by Sameera, it shows the local TZ as below. > > *Welcome to the live log viewer.* >

[Architecture] Carbon Security Login Module - JWT 1.0.0 M1 Released

*Carbon Security Login Module - JWT 1.0.0 M1 Released* We are pleased to announce the 1st milestone release of Carbon Security Login Module - JWT 1.0.0. This provides a JAAS based JWT login module for WSO2 Carbon Security CAAS. *Included features/bug fixes*

Re: [Architecture] [DAS] Overhauling the Spark JDBC Connector

Hi product analytics leads, Please make sure that the configuration file spark-jdbc-config.xml is added to the product-analytics packs, especially is you're using the CarbonJDBC provider. Example commit may be found at [1]. [1]

[Architecture] Providing XSD support for Data Mapper

Hello all, We have enabled $subject by using inbuilt Eclipse support to convert XSD to XML. We are using the eclipse bpel implementation of new xml wizard to generate the XML payload from a given XSD and load and then using existing datamapper support to load XML (by generating the json schema)

Re: [Architecture] Securing communication between Hazelcast and WSO2 servers

Yes securing the cluster channel is available only in enterprise Hazelcast & for 4.4 based releases, it requires a kernel patch we have released as well. On Jun 14, 2016 12:22 PM, "Srinath Perera" wrote: > I think it is only for enterprise version. > > Right deployment

Re: [Architecture] Including chart axes types in the analytics portal wizard UI

+1 for letting users to select data types for X,Y axes. We could have a UI partial along with X,Y axes to show available types so that user can select explicitly. Upon selecting the types, they can be persisted in chart-config object. So draw() can read it back when chart is being rendered.

[Architecture] Including chart axes types in the analytics portal wizard UI

Hi All, At the moment in gadget wizard chart config UI we let users to select x axis and y axis, then dimension type will be retrieved by checking stream attribute type. As an example if the attribute type is string it gives ordinal and for long type it gives linear. Currently there are few

Re: [Architecture] Securing communication between Hazelcast and WSO2 servers

I think it is only for enterprise version. Right deployment architecture is to secure it through a firewall. Basically, only designated nodes should be able to connect to the hazelcast cluster. --srinath On Mon, Jun 13, 2016 at 10:36 PM, Hasitha Hiranya wrote: > Hi, > >

Re: [Architecture] [Analytics] Using UTC across all temporal analytics functions

Hi Inosh, In order to do this we might probably need to update the data publishers to send their time zones as meta data to do the time zone conversion. In cases like daylight saving changes this information will be required to correctly map the incoming time to UTC Also, isn't it an option

Re: [Architecture] Securing communication between Hazelcast and WSO2 servers

We need the commercial edition to support this. If someone is interested they need to purchase and use it. On Mon, Jun 13, 2016 at 10:36 PM, Hasitha Hiranya wrote: > Hi, > > When a cluster is setup out of WSO2 servers Hazelcast is configured to > > 1. Make cluster calls

Re: [Architecture] [Analytics] Improvement in-progress for Template Manager (a.k.a Execution Manager)

Hi all, This is to add more context to the stream mapping functionality with reference to the above mail, As mentioned above, stream mapping creates the link between the user-defined Event Streams and the Event Streams defined in the Template. With the improvements done to the Template Manager,

Re: [Architecture] [DAS] Expose some debug level information through MBeans

Gihan and everyone If you use metrics, you get other benefits such as some default charts, ability to send it to DAS, log level control etc, configuration consistency across platform etc. If there is something missing in metrics, let's fix it. But we MUST not create parallel things. --Srinath