Hi All, I wrote a REST api documentation for the methods i implemented in the org.apache.stratos.rest.endpoint. You can find it from here[1].
Please update me on the changes that needed to be done. Any comment will be really appreciated to improve the documentation. [1]= https://docs.google.com/document/d/1kvEExNCv2RYsdk9PIM22RsTXxWX003NQoqKuJ1-Cxck/edit?usp=sharing Thank You! Best Regards, Ashan On Mon, Aug 3, 2015 at 12:40 PM, Ashan Dhananjaya <dhananjay...@gmail.com> wrote: > Hi All, > > As for the today's offline meeting. We have decided to add a functionality > to enable and disable the Health Statistic UI. I will be working on this > now onward. And after completing the chart with the tool tip we will going > to have the public hangout. > > Thank You! > Best Regards, > Ashan > > On Sun, Aug 2, 2015 at 8:35 PM, Ashan Dhananjaya <dhananjay...@gmail.com> > wrote: > >> Hi Imesh, >> >> I will be free for the whole next week. We can have the google hangout >> any day.Please give me a time slot to have the hangout. >> >> Thank You! >> Best Regards, >> Ashan >> >> On Sun, Aug 2, 2015 at 5:59 PM, Imesh Gunaratne <im...@apache.org> wrote: >> >>> Hi Ashan, >>> >>> Great work! May be we could arrange a public Google Hangout when you are >>> available to present the current status of the project. >>> >>> Thanks >>> >>> On Thu, Jul 30, 2015 at 11:00 PM, Ashan Dhananjaya < >>> dhananjay...@gmail.com> wrote: >>> >>>> Hi All, >>>> >>>> I have implemented formatters and did some changes in the cep event >>>> flow to change the RDBMS 3 tables in to one table as we discussed last >>>> week. And committed it. And id did few changes to the UI according to the >>>> feedback i had last week. I finished writing the REST API documentation and >>>> sent it to everyone. >>>> >>>> I have started to write a blog for the marketing aspect for stratos how >>>> Health Stat UI works and a documentation for the health statistics UI. >>>> >>>> [1]= >>>> https://github.com/apache/stratos/commit/1490310cae3ba085fbb77d84346dd66fd2b12132 >>>> >>>> Thank You! >>>> Best Regards, >>>> Ashan >>>> >>>> On Fri, Jul 24, 2015 at 11:17 PM, Imesh Gunaratne <im...@apache.org> >>>> wrote: >>>> >>>>> Great work Ashan! >>>>> >>>>> Actually you don't need to replace MySQL database with H2 rather both >>>>> options might be needed. The reason for having H2 is to allow users to see >>>>> the statistics when running on Single-JVM mode with embedded H2 database. >>>>> >>>>> On Thu, Jul 23, 2015 at 12:35 AM, Ashan Dhananjaya < >>>>> dhananjay...@gmail.com> wrote: >>>>> >>>>>> Hi All, >>>>>> >>>>>> I have implemented the UI for the Health Statistics UI. The git hub >>>>>> commits can be find from here [1]. >>>>>> >>>>>> And im moving forward to replace the MySql database from the embedded >>>>>> H2 RDBMS as we discussed offline on 22nd of July. >>>>>> >>>>>> Thank You! >>>>>> Best Regards, >>>>>> Ashan >>>>>> >>>>>> >>>>>> [1]= >>>>>> https://github.com/ashandk/stratos/commit/310ea343d80d009778f572da12a4098c7d2177ec >>>>>> >>>>>> >>>>>> On Thu, Jul 16, 2015 at 7:29 PM, Ashan Dhananjaya < >>>>>> dhananjay...@gmail.com> wrote: >>>>>> >>>>>>> Hi Imesh, >>>>>>> >>>>>>> Noted. I will create a documentation for the REST API. >>>>>>> >>>>>>> Thank You! >>>>>>> Best Regards, >>>>>>> Ashan >>>>>>> >>>>>>> On Thu, Jul 16, 2015 at 10:51 AM, Imesh Gunaratne <im...@apache.org> >>>>>>> wrote: >>>>>>> >>>>>>>> >>>>>>>> On Tue, Jul 14, 2015 at 9:44 PM, Reka Thirunavukkarasu < >>>>>>>> r...@wso2.com> wrote: >>>>>>>>> >>>>>>>>> >>>>>>>>>> 1.getAverageClusterMemoryByClusterId >>>>>>>>>> >>>>>>>>> >>>>>>>>> /cluster/averageMemory/{Id}/{Interval}} >>>>>>>>> >>>>>>>>> >>>>>>>>>> 2.getAverageClusterLoadByClusterId >>>>>>>>>> >>>>>>>>> >>>>>>>>> /cluster/averageLoad/{Id}/{Interval}} >>>>>>>>> >>>>>>>>> >>>>>>>>>> 3.getAverageMemberMemoryByMemberId >>>>>>>>>> >>>>>>>>> >>>>>>>>> /member/averageMemory/{Id}/{Interval}} >>>>>>>>> >>>>>>>>> 4.getAverageMemberLoadByMemberId >>>>>>>>>> >>>>>>>>> >>>>>>>>> /member/averageLoad/{Id}/{Interval}} >>>>>>>>> >>>>>>>>> >>>>>>>>>> 5.getAverageClusterFlightRequestCountByClusterId >>>>>>>>>> >>>>>>>>> >>>>>>>>> /cluster/flightRequestCount/{Id}/{Interval}} >>>>>>>>> >>>>>>>> >>>>>>>> +1 A great thought! @Ashan: It would be better if you can document >>>>>>>> the API methods (may be in a Google doc). >>>>>>>> >>>>>>>> Thanks >>>>>>>> >>>>>>>> On Tue, Jul 14, 2015 at 9:44 PM, Reka Thirunavukkarasu < >>>>>>>> r...@wso2.com> wrote: >>>>>>>> >>>>>>>>> Hi Ashan, >>>>>>>>> >>>>>>>>> Wouldn't it be better to stick with the REST API paths currently >>>>>>>>> used by stratos? You can inherit and add more stuffs as you want. >>>>>>>>> Please >>>>>>>>> see below for some sample paths: >>>>>>>>> >>>>>>>>> On Tue, Jul 14, 2015 at 1:55 AM, Ashan Dhananjaya < >>>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>>> >>>>>>>>>> Hi All, >>>>>>>>>> >>>>>>>>>> I have implemented the REST api methods for the health statistics >>>>>>>>>> UI in the stratos existing REST API. >>>>>>>>>> >>>>>>>>>> 1.getAverageClusterMemoryByClusterId >>>>>>>>>> >>>>>>>>> >>>>>>>>> /cluster/averageMemory/{Id}/{Interval}} >>>>>>>>> >>>>>>>>> >>>>>>>>>> 2.getAverageClusterLoadByClusterId >>>>>>>>>> >>>>>>>>> >>>>>>>>> /cluster/averageLoad/{Id}/{Interval}} >>>>>>>>> >>>>>>>>> >>>>>>>>>> 3.getAverageMemberMemoryByMemberId >>>>>>>>>> >>>>>>>>> >>>>>>>>> /member/averageMemory/{Id}/{Interval}} >>>>>>>>> >>>>>>>>> 4.getAverageMemberLoadByMemberId >>>>>>>>>> >>>>>>>>> >>>>>>>>> /member/averageLoad/{Id}/{Interval}} >>>>>>>>> >>>>>>>>> >>>>>>>>>> 5.getAverageClusterFlightRequestCountByClusterId >>>>>>>>>> >>>>>>>>> >>>>>>>>> /cluster/flightRequestCount/{Id}/{Interval}} >>>>>>>>> >>>>>>>>> Thanks, >>>>>>>>> Reka >>>>>>>>> >>>>>>>>>> >>>>>>>>>> Please find the Github commit here[1]. >>>>>>>>>> >>>>>>>>>> [1]= >>>>>>>>>> https://github.com/apache/stratos/commit/5ab9159744f136e649174f7293adabe5c77fb4bd >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> Thank You! >>>>>>>>>> Best Regards, >>>>>>>>>> Ashan >>>>>>>>>> >>>>>>>>>> On Thu, Jul 9, 2015 at 8:30 PM, Ashan Dhananjaya < >>>>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>>> Noted Lahiru. >>>>>>>>>>> >>>>>>>>>>> On Thu, Jul 9, 2015 at 7:48 PM, Lahiru Sandaruwan < >>>>>>>>>>> lahi...@wso2.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi Ashan, >>>>>>>>>>>> >>>>>>>>>>>> Good stuff. It is fine to set the time stamp from CEP for now. >>>>>>>>>>>> But ultimately we need the timestamp to be sent from Python >>>>>>>>>>>> cartridge >>>>>>>>>>>> agent. Let's fix that part we proceed. >>>>>>>>>>>> >>>>>>>>>>>> Thanks. >>>>>>>>>>>> >>>>>>>>>>>> On Thu, Jul 9, 2015 at 7:38 PM, Ashan Dhananjaya < >>>>>>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi All, >>>>>>>>>>>>> >>>>>>>>>>>>> I was able to get the TimeaStamp to the RDBMS without any >>>>>>>>>>>>> conflict AFAIK. I am testing the flow more. Please find the >>>>>>>>>>>>> commits [1], >>>>>>>>>>>>> [2] for the Formatters. >>>>>>>>>>>>> >>>>>>>>>>>>> [1]= >>>>>>>>>>>>> https://github.com/ashandk/stratos/commit/efa25eb255cadbf2843e5f0d0e13b34c09535f91 >>>>>>>>>>>>> [2]= >>>>>>>>>>>>> https://github.com/ashandk/stratos/commit/9c0fce9081c299c34031d602c94ea712602c7a6c >>>>>>>>>>>>> >>>>>>>>>>>>> Thank You! >>>>>>>>>>>>> Best Regards, >>>>>>>>>>>>> Ashan >>>>>>>>>>>>> >>>>>>>>>>>>> On Thu, Jul 9, 2015 at 2:41 PM, Lahiru Sandaruwan < >>>>>>>>>>>>> lahi...@wso2.com> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Great work Ashan. >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Thu, Jul 9, 2015 at 2:39 PM, Ashan Dhananjaya < >>>>>>>>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Hi All, >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> I was able to take the timestamp from the cartridge agent >>>>>>>>>>>>>>> (WSO2CEPHealthStatisticsPublisher and >>>>>>>>>>>>>>> WSO2CEPInFlightRequestPublisher) to >>>>>>>>>>>>>>> CEP PayLoad definition.Git Hub commits can be found here[1], >>>>>>>>>>>>>>> [2]. Currently >>>>>>>>>>>>>>> working on sending the timestamp to the RDBMS without >>>>>>>>>>>>>>> conflicting execution >>>>>>>>>>>>>>> plans. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> I have included the read-me [2] file to the cep extensions >>>>>>>>>>>>>>> how to configure should happen for the Health Stat publishing >>>>>>>>>>>>>>> to the RDBMS. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> [1]= >>>>>>>>>>>>>>> https://github.com/apache/stratos/commit/4c65e705be822fd420b4e48ebafef789c8686b76 >>>>>>>>>>>>>>> [2]= >>>>>>>>>>>>>>> https://github.com/apache/stratos/commit/e09334cd98f245a4633c992f02db2878ac24d3d0 >>>>>>>>>>>>>>> [3]= >>>>>>>>>>>>>>> https://github.com/apache/stratos/commit/5ca895ef030f6aaeba56183d982aa5ae95db9337 >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Thank You! >>>>>>>>>>>>>>> Best Regards, >>>>>>>>>>>>>>> Ashan >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Tue, Jul 7, 2015 at 1:13 PM, Lasantha Fernando < >>>>>>>>>>>>>>> lasantha....@gmail.com> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hi Ashan, >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Currently, you would not be able to get the timestamp out >>>>>>>>>>>>>>>> of the event >>>>>>>>>>>>>>>> unless you use a databridge agent callback. In that case, >>>>>>>>>>>>>>>> you can use >>>>>>>>>>>>>>>> Java code to simply get by calling event.getTimestamp(). >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> However, if you want to use the timestamp as an attribute >>>>>>>>>>>>>>>> while doing >>>>>>>>>>>>>>>> processing within CEP, you would have to pass the timestamp >>>>>>>>>>>>>>>> as an >>>>>>>>>>>>>>>> attribute of the stream. i.e. add it as an attribute of >>>>>>>>>>>>>>>> either meta, >>>>>>>>>>>>>>>> correlation or payload data. Then you can use that >>>>>>>>>>>>>>>> timestamp and >>>>>>>>>>>>>>>> format the output event as necessary. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>> Lasantha >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Tue, Jul 7, 2015 at 1:04 PM, Ashan Dhananjaya < >>>>>>>>>>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>>>>>>>>>> > Hi All, >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> > I applied the above patch and get the timestamp in the >>>>>>>>>>>>>>>> Input Adapter. The >>>>>>>>>>>>>>>> > formatter i used was >>>>>>>>>>>>>>>> "member_average_memory_consumption_stats:1.0.0". I >>>>>>>>>>>>>>>> > tried several time to get the timeStamp attribute but >>>>>>>>>>>>>>>> failed. Is there any >>>>>>>>>>>>>>>> > way to get a data which is outside in the payload? The >>>>>>>>>>>>>>>> Input stream is as >>>>>>>>>>>>>>>> > below, >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> > 10:40:27,757 [-] [DataBridge-Core-pool-2-thread-1] INFO >>>>>>>>>>>>>>>> TenantId=-1234 : >>>>>>>>>>>>>>>> > Input Event Adaptor : DefaultWSO2EventInputAdaptor, >>>>>>>>>>>>>>>> received >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> > Event{ >>>>>>>>>>>>>>>> > streamId='cartridge_agent_health_stats:1.0.0', >>>>>>>>>>>>>>>> > timeStamp=1436245827731, >>>>>>>>>>>>>>>> > metaData=null, >>>>>>>>>>>>>>>> > correlationData=null, >>>>>>>>>>>>>>>> > payloadData=[single-cartridge-app.my-php.php.domain, >>>>>>>>>>>>>>>> > single-cartridge-app-1, network-partition-1, >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> single-cartridge-app.my-php.php.domaina5598e2b-995f-4620-b652-e66341e24c99, >>>>>>>>>>>>>>>> > partition-1, memory_consumption, 20.0], >>>>>>>>>>>>>>>> > arbitraryDataMap={}, >>>>>>>>>>>>>>>> > } >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> > Any help will be really appreciated. >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> > Thank You! >>>>>>>>>>>>>>>> > Best Regards, >>>>>>>>>>>>>>>> > Ashan >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> > On Tue, Jul 7, 2015 at 9:32 AM, Chamila De Alwis < >>>>>>>>>>>>>>>> chami...@wso2.com> wrote: >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> Hi Ashan, >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> As I've seen from the PCA testing recently, the >>>>>>>>>>>>>>>> timestamp is added to >>>>>>>>>>>>>>>> >> every ThriftEvent before publishing. Are you working on >>>>>>>>>>>>>>>> PCA or the Mock >>>>>>>>>>>>>>>> >> IaaS? I took a look at the Mock IaaS and the >>>>>>>>>>>>>>>> WSO2CEPStatisticsPublisher as >>>>>>>>>>>>>>>> >> well, and found out that the latter indeed doesn't add >>>>>>>>>>>>>>>> the timestamp to the >>>>>>>>>>>>>>>> >> ThriftEvents. This means that the JCA also publishes >>>>>>>>>>>>>>>> Thrift Events with >>>>>>>>>>>>>>>> >> empty timestamp fields. >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> Following is the simple fix for that. I've attached the >>>>>>>>>>>>>>>> patch herewith. >>>>>>>>>>>>>>>> >> Could you quickly verify with the patch applied build >>>>>>>>>>>>>>>> also? >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> chamilad@chamilad-ThinkPad-T530:~/dev/stratos[master >>>>>>>>>>>>>>>> *]$ git diff >>>>>>>>>>>>>>>> >> diff --git >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>>>>>>>>>>>>>> >> b/c >>>>>>>>>>>>>>>> >> index 653288d..f1fe426 100644 >>>>>>>>>>>>>>>> >> --- >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>>>>>>>>>>>>>> >> +++ >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> b/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>>>>>>>>>>>>>> >> @@ -29,6 +29,7 @@ import >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> org.wso2.carbon.databridge.agent.thrift.exception.AgentException; >>>>>>>>>>>>>>>> >> import org.wso2.carbon.databridge.commons.Event; >>>>>>>>>>>>>>>> >> import >>>>>>>>>>>>>>>> org.wso2.carbon.databridge.commons.StreamDefinition; >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> +import java.util.Date; >>>>>>>>>>>>>>>> >> import java.util.HashMap; >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> /** >>>>>>>>>>>>>>>> >> @@ -98,6 +99,7 @@ public class >>>>>>>>>>>>>>>> WSO2CEPStatisticsPublisher implements >>>>>>>>>>>>>>>> >> StatisticsPublisher { >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> Event event = new Event(); >>>>>>>>>>>>>>>> >> event.setPayloadData(payload); >>>>>>>>>>>>>>>> >> + event.setTimeStamp(new Date().getTime()); >>>>>>>>>>>>>>>> >> event.setArbitraryDataMap(new HashMap<String, >>>>>>>>>>>>>>>> String>()); >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> try { >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> Regards, >>>>>>>>>>>>>>>> >> Chamila de Alwis >>>>>>>>>>>>>>>> >> Committer and PMC Member - Apache Stratos >>>>>>>>>>>>>>>> >> Software Engineer | WSO2 | +94772207163 >>>>>>>>>>>>>>>> >> Blog: code.chamiladealwis.com >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> >> >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> -- >>>>>>>>>>>>>> -- >>>>>>>>>>>>>> Lahiru Sandaruwan >>>>>>>>>>>>>> Committer and PMC member, Apache Stratos, >>>>>>>>>>>>>> Senior Software Engineer, >>>>>>>>>>>>>> WSO2 Inc., http://wso2.com >>>>>>>>>>>>>> lean.enterprise.middleware >>>>>>>>>>>>>> >>>>>>>>>>>>>> phone: +94773325954 >>>>>>>>>>>>>> email: lahi...@wso2.com blog: >>>>>>>>>>>>>> http://lahiruwrites.blogspot.com/ >>>>>>>>>>>>>> linked-in: >>>>>>>>>>>>>> http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> _______________________________________________ >>>>>>>>>>>>>> Dev mailing list >>>>>>>>>>>>>> d...@wso2.org >>>>>>>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> -- >>>>>>>>>>>> Lahiru Sandaruwan >>>>>>>>>>>> Committer and PMC member, Apache Stratos, >>>>>>>>>>>> Senior Software Engineer, >>>>>>>>>>>> WSO2 Inc., http://wso2.com >>>>>>>>>>>> lean.enterprise.middleware >>>>>>>>>>>> >>>>>>>>>>>> phone: +94773325954 >>>>>>>>>>>> email: lahi...@wso2.com blog: http://lahiruwrites.blogspot.com/ >>>>>>>>>>>> linked-in: >>>>>>>>>>>> http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Reka Thirunavukkarasu >>>>>>>>> Senior Software Engineer, >>>>>>>>> WSO2, Inc.:http://wso2.com, >>>>>>>>> Mobile: +94776442007 >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Imesh Gunaratne >>>>>>>> >>>>>>>> Senior Technical Lead, WSO2 >>>>>>>> Committer & PMC Member, Apache Stratos >>>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Imesh Gunaratne >>>>> >>>>> Senior Technical Lead, WSO2 >>>>> Committer & PMC Member, Apache Stratos >>>>> >>>> >>>> >>> >>> >>> -- >>> Imesh Gunaratne >>> >>> Senior Technical Lead, WSO2 >>> Committer & PMC Member, Apache Stratos >>> >> >> >