Hi All, As for the today's offline meeting. We have decided to add a functionality to enable and disable the Health Statistic UI. I will be working on this now onward. And after completing the chart with the tool tip we will going to have the public hangout.
Thank You! Best Regards, Ashan On Sun, Aug 2, 2015 at 8:35 PM, Ashan Dhananjaya <dhananjay...@gmail.com> wrote: > Hi Imesh, > > I will be free for the whole next week. We can have the google hangout any > day.Please give me a time slot to have the hangout. > > Thank You! > Best Regards, > Ashan > > On Sun, Aug 2, 2015 at 5:59 PM, Imesh Gunaratne <im...@apache.org> wrote: > >> Hi Ashan, >> >> Great work! May be we could arrange a public Google Hangout when you are >> available to present the current status of the project. >> >> Thanks >> >> On Thu, Jul 30, 2015 at 11:00 PM, Ashan Dhananjaya < >> dhananjay...@gmail.com> wrote: >> >>> Hi All, >>> >>> I have implemented formatters and did some changes in the cep event flow >>> to change the RDBMS 3 tables in to one table as we discussed last week. And >>> committed it. And id did few changes to the UI according to the feedback i >>> had last week. I finished writing the REST API documentation and sent it to >>> everyone. >>> >>> I have started to write a blog for the marketing aspect for stratos how >>> Health Stat UI works and a documentation for the health statistics UI. >>> >>> [1]= >>> https://github.com/apache/stratos/commit/1490310cae3ba085fbb77d84346dd66fd2b12132 >>> >>> Thank You! >>> Best Regards, >>> Ashan >>> >>> On Fri, Jul 24, 2015 at 11:17 PM, Imesh Gunaratne <im...@apache.org> >>> wrote: >>> >>>> Great work Ashan! >>>> >>>> Actually you don't need to replace MySQL database with H2 rather both >>>> options might be needed. The reason for having H2 is to allow users to see >>>> the statistics when running on Single-JVM mode with embedded H2 database. >>>> >>>> On Thu, Jul 23, 2015 at 12:35 AM, Ashan Dhananjaya < >>>> dhananjay...@gmail.com> wrote: >>>> >>>>> Hi All, >>>>> >>>>> I have implemented the UI for the Health Statistics UI. The git hub >>>>> commits can be find from here [1]. >>>>> >>>>> And im moving forward to replace the MySql database from the embedded >>>>> H2 RDBMS as we discussed offline on 22nd of July. >>>>> >>>>> Thank You! >>>>> Best Regards, >>>>> Ashan >>>>> >>>>> >>>>> [1]= >>>>> https://github.com/ashandk/stratos/commit/310ea343d80d009778f572da12a4098c7d2177ec >>>>> >>>>> >>>>> On Thu, Jul 16, 2015 at 7:29 PM, Ashan Dhananjaya < >>>>> dhananjay...@gmail.com> wrote: >>>>> >>>>>> Hi Imesh, >>>>>> >>>>>> Noted. I will create a documentation for the REST API. >>>>>> >>>>>> Thank You! >>>>>> Best Regards, >>>>>> Ashan >>>>>> >>>>>> On Thu, Jul 16, 2015 at 10:51 AM, Imesh Gunaratne <im...@apache.org> >>>>>> wrote: >>>>>> >>>>>>> >>>>>>> On Tue, Jul 14, 2015 at 9:44 PM, Reka Thirunavukkarasu < >>>>>>> r...@wso2.com> wrote: >>>>>>>> >>>>>>>> >>>>>>>>> 1.getAverageClusterMemoryByClusterId >>>>>>>>> >>>>>>>> >>>>>>>> /cluster/averageMemory/{Id}/{Interval}} >>>>>>>> >>>>>>>> >>>>>>>>> 2.getAverageClusterLoadByClusterId >>>>>>>>> >>>>>>>> >>>>>>>> /cluster/averageLoad/{Id}/{Interval}} >>>>>>>> >>>>>>>> >>>>>>>>> 3.getAverageMemberMemoryByMemberId >>>>>>>>> >>>>>>>> >>>>>>>> /member/averageMemory/{Id}/{Interval}} >>>>>>>> >>>>>>>> 4.getAverageMemberLoadByMemberId >>>>>>>>> >>>>>>>> >>>>>>>> /member/averageLoad/{Id}/{Interval}} >>>>>>>> >>>>>>>> >>>>>>>>> 5.getAverageClusterFlightRequestCountByClusterId >>>>>>>>> >>>>>>>> >>>>>>>> /cluster/flightRequestCount/{Id}/{Interval}} >>>>>>>> >>>>>>> >>>>>>> +1 A great thought! @Ashan: It would be better if you can document >>>>>>> the API methods (may be in a Google doc). >>>>>>> >>>>>>> Thanks >>>>>>> >>>>>>> On Tue, Jul 14, 2015 at 9:44 PM, Reka Thirunavukkarasu < >>>>>>> r...@wso2.com> wrote: >>>>>>> >>>>>>>> Hi Ashan, >>>>>>>> >>>>>>>> Wouldn't it be better to stick with the REST API paths currently >>>>>>>> used by stratos? You can inherit and add more stuffs as you want. >>>>>>>> Please >>>>>>>> see below for some sample paths: >>>>>>>> >>>>>>>> On Tue, Jul 14, 2015 at 1:55 AM, Ashan Dhananjaya < >>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>> >>>>>>>>> Hi All, >>>>>>>>> >>>>>>>>> I have implemented the REST api methods for the health statistics >>>>>>>>> UI in the stratos existing REST API. >>>>>>>>> >>>>>>>>> 1.getAverageClusterMemoryByClusterId >>>>>>>>> >>>>>>>> >>>>>>>> /cluster/averageMemory/{Id}/{Interval}} >>>>>>>> >>>>>>>> >>>>>>>>> 2.getAverageClusterLoadByClusterId >>>>>>>>> >>>>>>>> >>>>>>>> /cluster/averageLoad/{Id}/{Interval}} >>>>>>>> >>>>>>>> >>>>>>>>> 3.getAverageMemberMemoryByMemberId >>>>>>>>> >>>>>>>> >>>>>>>> /member/averageMemory/{Id}/{Interval}} >>>>>>>> >>>>>>>> 4.getAverageMemberLoadByMemberId >>>>>>>>> >>>>>>>> >>>>>>>> /member/averageLoad/{Id}/{Interval}} >>>>>>>> >>>>>>>> >>>>>>>>> 5.getAverageClusterFlightRequestCountByClusterId >>>>>>>>> >>>>>>>> >>>>>>>> /cluster/flightRequestCount/{Id}/{Interval}} >>>>>>>> >>>>>>>> Thanks, >>>>>>>> Reka >>>>>>>> >>>>>>>>> >>>>>>>>> Please find the Github commit here[1]. >>>>>>>>> >>>>>>>>> [1]= >>>>>>>>> https://github.com/apache/stratos/commit/5ab9159744f136e649174f7293adabe5c77fb4bd >>>>>>>>> >>>>>>>>> >>>>>>>>> Thank You! >>>>>>>>> Best Regards, >>>>>>>>> Ashan >>>>>>>>> >>>>>>>>> On Thu, Jul 9, 2015 at 8:30 PM, Ashan Dhananjaya < >>>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>>> >>>>>>>>>> Noted Lahiru. >>>>>>>>>> >>>>>>>>>> On Thu, Jul 9, 2015 at 7:48 PM, Lahiru Sandaruwan < >>>>>>>>>> lahi...@wso2.com> wrote: >>>>>>>>>> >>>>>>>>>>> Hi Ashan, >>>>>>>>>>> >>>>>>>>>>> Good stuff. It is fine to set the time stamp from CEP for now. >>>>>>>>>>> But ultimately we need the timestamp to be sent from Python >>>>>>>>>>> cartridge >>>>>>>>>>> agent. Let's fix that part we proceed. >>>>>>>>>>> >>>>>>>>>>> Thanks. >>>>>>>>>>> >>>>>>>>>>> On Thu, Jul 9, 2015 at 7:38 PM, Ashan Dhananjaya < >>>>>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi All, >>>>>>>>>>>> >>>>>>>>>>>> I was able to get the TimeaStamp to the RDBMS without any >>>>>>>>>>>> conflict AFAIK. I am testing the flow more. Please find the >>>>>>>>>>>> commits [1], >>>>>>>>>>>> [2] for the Formatters. >>>>>>>>>>>> >>>>>>>>>>>> [1]= >>>>>>>>>>>> https://github.com/ashandk/stratos/commit/efa25eb255cadbf2843e5f0d0e13b34c09535f91 >>>>>>>>>>>> [2]= >>>>>>>>>>>> https://github.com/ashandk/stratos/commit/9c0fce9081c299c34031d602c94ea712602c7a6c >>>>>>>>>>>> >>>>>>>>>>>> Thank You! >>>>>>>>>>>> Best Regards, >>>>>>>>>>>> Ashan >>>>>>>>>>>> >>>>>>>>>>>> On Thu, Jul 9, 2015 at 2:41 PM, Lahiru Sandaruwan < >>>>>>>>>>>> lahi...@wso2.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Great work Ashan. >>>>>>>>>>>>> >>>>>>>>>>>>> On Thu, Jul 9, 2015 at 2:39 PM, Ashan Dhananjaya < >>>>>>>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Hi All, >>>>>>>>>>>>>> >>>>>>>>>>>>>> I was able to take the timestamp from the cartridge agent >>>>>>>>>>>>>> (WSO2CEPHealthStatisticsPublisher and >>>>>>>>>>>>>> WSO2CEPInFlightRequestPublisher) to >>>>>>>>>>>>>> CEP PayLoad definition.Git Hub commits can be found here[1], >>>>>>>>>>>>>> [2]. Currently >>>>>>>>>>>>>> working on sending the timestamp to the RDBMS without >>>>>>>>>>>>>> conflicting execution >>>>>>>>>>>>>> plans. >>>>>>>>>>>>>> >>>>>>>>>>>>>> I have included the read-me [2] file to the cep extensions >>>>>>>>>>>>>> how to configure should happen for the Health Stat publishing to >>>>>>>>>>>>>> the RDBMS. >>>>>>>>>>>>>> >>>>>>>>>>>>>> [1]= >>>>>>>>>>>>>> https://github.com/apache/stratos/commit/4c65e705be822fd420b4e48ebafef789c8686b76 >>>>>>>>>>>>>> [2]= >>>>>>>>>>>>>> https://github.com/apache/stratos/commit/e09334cd98f245a4633c992f02db2878ac24d3d0 >>>>>>>>>>>>>> [3]= >>>>>>>>>>>>>> https://github.com/apache/stratos/commit/5ca895ef030f6aaeba56183d982aa5ae95db9337 >>>>>>>>>>>>>> >>>>>>>>>>>>>> Thank You! >>>>>>>>>>>>>> Best Regards, >>>>>>>>>>>>>> Ashan >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Tue, Jul 7, 2015 at 1:13 PM, Lasantha Fernando < >>>>>>>>>>>>>> lasantha....@gmail.com> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Hi Ashan, >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Currently, you would not be able to get the timestamp out of >>>>>>>>>>>>>>> the event >>>>>>>>>>>>>>> unless you use a databridge agent callback. In that case, >>>>>>>>>>>>>>> you can use >>>>>>>>>>>>>>> Java code to simply get by calling event.getTimestamp(). >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> However, if you want to use the timestamp as an attribute >>>>>>>>>>>>>>> while doing >>>>>>>>>>>>>>> processing within CEP, you would have to pass the timestamp >>>>>>>>>>>>>>> as an >>>>>>>>>>>>>>> attribute of the stream. i.e. add it as an attribute of >>>>>>>>>>>>>>> either meta, >>>>>>>>>>>>>>> correlation or payload data. Then you can use that timestamp >>>>>>>>>>>>>>> and >>>>>>>>>>>>>>> format the output event as necessary. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>> Lasantha >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Tue, Jul 7, 2015 at 1:04 PM, Ashan Dhananjaya < >>>>>>>>>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>>>>>>>>> > Hi All, >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> > I applied the above patch and get the timestamp in the >>>>>>>>>>>>>>> Input Adapter. The >>>>>>>>>>>>>>> > formatter i used was >>>>>>>>>>>>>>> "member_average_memory_consumption_stats:1.0.0". I >>>>>>>>>>>>>>> > tried several time to get the timeStamp attribute but >>>>>>>>>>>>>>> failed. Is there any >>>>>>>>>>>>>>> > way to get a data which is outside in the payload? The >>>>>>>>>>>>>>> Input stream is as >>>>>>>>>>>>>>> > below, >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> > 10:40:27,757 [-] [DataBridge-Core-pool-2-thread-1] INFO >>>>>>>>>>>>>>> TenantId=-1234 : >>>>>>>>>>>>>>> > Input Event Adaptor : DefaultWSO2EventInputAdaptor, >>>>>>>>>>>>>>> received >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> > Event{ >>>>>>>>>>>>>>> > streamId='cartridge_agent_health_stats:1.0.0', >>>>>>>>>>>>>>> > timeStamp=1436245827731, >>>>>>>>>>>>>>> > metaData=null, >>>>>>>>>>>>>>> > correlationData=null, >>>>>>>>>>>>>>> > payloadData=[single-cartridge-app.my-php.php.domain, >>>>>>>>>>>>>>> > single-cartridge-app-1, network-partition-1, >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> single-cartridge-app.my-php.php.domaina5598e2b-995f-4620-b652-e66341e24c99, >>>>>>>>>>>>>>> > partition-1, memory_consumption, 20.0], >>>>>>>>>>>>>>> > arbitraryDataMap={}, >>>>>>>>>>>>>>> > } >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> > Any help will be really appreciated. >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> > Thank You! >>>>>>>>>>>>>>> > Best Regards, >>>>>>>>>>>>>>> > Ashan >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> > On Tue, Jul 7, 2015 at 9:32 AM, Chamila De Alwis < >>>>>>>>>>>>>>> chami...@wso2.com> wrote: >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> Hi Ashan, >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> As I've seen from the PCA testing recently, the timestamp >>>>>>>>>>>>>>> is added to >>>>>>>>>>>>>>> >> every ThriftEvent before publishing. Are you working on >>>>>>>>>>>>>>> PCA or the Mock >>>>>>>>>>>>>>> >> IaaS? I took a look at the Mock IaaS and the >>>>>>>>>>>>>>> WSO2CEPStatisticsPublisher as >>>>>>>>>>>>>>> >> well, and found out that the latter indeed doesn't add >>>>>>>>>>>>>>> the timestamp to the >>>>>>>>>>>>>>> >> ThriftEvents. This means that the JCA also publishes >>>>>>>>>>>>>>> Thrift Events with >>>>>>>>>>>>>>> >> empty timestamp fields. >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> Following is the simple fix for that. I've attached the >>>>>>>>>>>>>>> patch herewith. >>>>>>>>>>>>>>> >> Could you quickly verify with the patch applied build >>>>>>>>>>>>>>> also? >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> chamilad@chamilad-ThinkPad-T530:~/dev/stratos[master *]$ >>>>>>>>>>>>>>> git diff >>>>>>>>>>>>>>> >> diff --git >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>>>>>>>>>>>>> >> b/c >>>>>>>>>>>>>>> >> index 653288d..f1fe426 100644 >>>>>>>>>>>>>>> >> --- >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>>>>>>>>>>>>> >> +++ >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> b/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>>>>>>>>>>>>> >> @@ -29,6 +29,7 @@ import >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> org.wso2.carbon.databridge.agent.thrift.exception.AgentException; >>>>>>>>>>>>>>> >> import org.wso2.carbon.databridge.commons.Event; >>>>>>>>>>>>>>> >> import >>>>>>>>>>>>>>> org.wso2.carbon.databridge.commons.StreamDefinition; >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> +import java.util.Date; >>>>>>>>>>>>>>> >> import java.util.HashMap; >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> /** >>>>>>>>>>>>>>> >> @@ -98,6 +99,7 @@ public class WSO2CEPStatisticsPublisher >>>>>>>>>>>>>>> implements >>>>>>>>>>>>>>> >> StatisticsPublisher { >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> Event event = new Event(); >>>>>>>>>>>>>>> >> event.setPayloadData(payload); >>>>>>>>>>>>>>> >> + event.setTimeStamp(new Date().getTime()); >>>>>>>>>>>>>>> >> event.setArbitraryDataMap(new HashMap<String, >>>>>>>>>>>>>>> String>()); >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> try { >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> Regards, >>>>>>>>>>>>>>> >> Chamila de Alwis >>>>>>>>>>>>>>> >> Committer and PMC Member - Apache Stratos >>>>>>>>>>>>>>> >> Software Engineer | WSO2 | +94772207163 >>>>>>>>>>>>>>> >> Blog: code.chamiladealwis.com >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> -- >>>>>>>>>>>>> Lahiru Sandaruwan >>>>>>>>>>>>> Committer and PMC member, Apache Stratos, >>>>>>>>>>>>> Senior Software Engineer, >>>>>>>>>>>>> WSO2 Inc., http://wso2.com >>>>>>>>>>>>> lean.enterprise.middleware >>>>>>>>>>>>> >>>>>>>>>>>>> phone: +94773325954 >>>>>>>>>>>>> email: lahi...@wso2.com blog: >>>>>>>>>>>>> http://lahiruwrites.blogspot.com/ >>>>>>>>>>>>> linked-in: >>>>>>>>>>>>> http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> _______________________________________________ >>>>>>>>>>>>> Dev mailing list >>>>>>>>>>>>> d...@wso2.org >>>>>>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> -- >>>>>>>>>>> Lahiru Sandaruwan >>>>>>>>>>> Committer and PMC member, Apache Stratos, >>>>>>>>>>> Senior Software Engineer, >>>>>>>>>>> WSO2 Inc., http://wso2.com >>>>>>>>>>> lean.enterprise.middleware >>>>>>>>>>> >>>>>>>>>>> phone: +94773325954 >>>>>>>>>>> email: lahi...@wso2.com blog: http://lahiruwrites.blogspot.com/ >>>>>>>>>>> linked-in: >>>>>>>>>>> http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Reka Thirunavukkarasu >>>>>>>> Senior Software Engineer, >>>>>>>> WSO2, Inc.:http://wso2.com, >>>>>>>> Mobile: +94776442007 >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Imesh Gunaratne >>>>>>> >>>>>>> Senior Technical Lead, WSO2 >>>>>>> Committer & PMC Member, Apache Stratos >>>>>>> >>>>>> >>>>>> >>>>> >>>> >>>> >>>> -- >>>> Imesh Gunaratne >>>> >>>> Senior Technical Lead, WSO2 >>>> Committer & PMC Member, Apache Stratos >>>> >>> >>> >> >> >> -- >> Imesh Gunaratne >> >> Senior Technical Lead, WSO2 >> Committer & PMC Member, Apache Stratos >> > >
