[Architecture] [DS] Gadget Generation Framework

2016-04-29 Thread Tanya Madurapperuma
Hi all, *Introduction* The purpose of this feature is to provide a framework to generate gadgets where you can plug datasource providers and chart templates. For an example, you will be able to plug your RDBMS datasource, rest api , csv file , real time datsources etc as pluggable providers. *F

Re: [Architecture] [DS] Gadget Generation Framework

2016-04-29 Thread Sriskandarajah Suhothayan
Please see the comments inline. On Fri, Apr 29, 2016 at 7:52 PM, Tanya Madurapperuma wrote: > Hi all, > > *Introduction* > > The purpose of this feature is to provide a framework to generate gadgets > where you can plug datasource providers and chart templates. > > For an example, you will be ab

Re: [Architecture] [DS] Gadget Generation Framework

2016-05-01 Thread Dunith Dhanushka
Hi Tanya, I too have few comments. 1. Can we add data access mode parameter to the provider config as well? So there can be a parameter named "mode" which will have either "push" or "pull" values. 2. Like Suhu mentioned, we can derive the list of providers by iterating over specific FS directory

Re: [Architecture] [DS] Gadget Generation Framework

2016-05-01 Thread Tanya Madurapperuma
Hi Suho, Please find my comments. On Fri, Apr 29, 2016 at 9:42 PM, Sriskandarajah Suhothayan wrote: > Please see the comments inline. > > On Fri, Apr 29, 2016 at 7:52 PM, Tanya Madurapperuma > wrote: > >> Hi all, >> >> *Introduction* >> >> The purpose of this feature is to provide a framework

Re: [Architecture] [DS] Gadget Generation Framework

2016-05-01 Thread Tanya Madurapperuma
Hi Dunith, On Mon, May 2, 2016 at 6:54 AM, Dunith Dhanushka wrote: > Hi Tanya, > > I too have few comments. > > 1. Can we add data access mode parameter to the provider config as well? > So there can be a parameter named "mode" which will have either "push" or > "pull" > IMO gadget creator doesn

Re: [Architecture] [DS] Gadget Generation Framework

2016-05-02 Thread Manuranga Perera
> > Can't we load this dynamically by scanning the files at server start? > > Yes, we can. But the intention of having this config was to turn off some > providers based on this config. If we load providers dynamically based on > the files then it is not possible to turn them off if required. I th

Re: [Architecture] [DS] Gadget Generation Framework

2016-05-02 Thread Tanya Madurapperuma
Hi all, We had a discussion again regarding this and please find the modified notes below. Provider api (index.js) needs to implement the following functions. - validate(providerConfig) - same as described before - is to validate the user input for provider configuration - getC

Re: [Architecture] [DS] Gadget Generation Framework

2016-05-06 Thread Tanya Madurapperuma
Hi all, This is to provide an update regarding the above framework. We have currently completed a draft version of the wizard up to stage 2 with dynamic partial support and the source can be found at [1]. Please note that we have not paid any attention to fine tuning the UI yet. [1] https://gith

Re: [Architecture] [DS] Gadget Generation Framework

2016-05-24 Thread Tanya Madurapperuma
Hi Suho and all, Seems like we need to do a small modification to the registerCallBackforPush function. Even though we agreed to pass providerConfig and schema, we need to have a callback function as well. Proposed modification is as follows. *provider's index.js* registerCallBackforPush (provide

Re: [Architecture] [DS] Gadget Generation Framework

2016-06-02 Thread Dunith Dhanushka
Hi all, Apart from the default JDBC provider shipped with the wizard, there are other data providers implemented specific to analytical data sources (DAS/CEP). 1. Batch data provider (polls data from tables stored in DAS) 2. Realtime data provider (subscribes to a web socket in DAS/CEP and listen