Hi Ashan, Good stuff. It is fine to set the time stamp from CEP for now. But ultimately we need the timestamp to be sent from Python cartridge agent. Let's fix that part we proceed.
Thanks. On Thu, Jul 9, 2015 at 7:38 PM, Ashan Dhananjaya <dhananjay...@gmail.com> wrote: > Hi All, > > I was able to get the TimeaStamp to the RDBMS without any conflict AFAIK. > I am testing the flow more. Please find the commits [1], [2] for the > Formatters. > > [1]= > https://github.com/ashandk/stratos/commit/efa25eb255cadbf2843e5f0d0e13b34c09535f91 > [2]= > https://github.com/ashandk/stratos/commit/9c0fce9081c299c34031d602c94ea712602c7a6c > > Thank You! > Best Regards, > Ashan > > On Thu, Jul 9, 2015 at 2:41 PM, Lahiru Sandaruwan <lahi...@wso2.com> > wrote: > >> Great work Ashan. >> >> On Thu, Jul 9, 2015 at 2:39 PM, Ashan Dhananjaya <dhananjay...@gmail.com> >> wrote: >> >>> Hi All, >>> >>> I was able to take the timestamp from the cartridge agent >>> (WSO2CEPHealthStatisticsPublisher and WSO2CEPInFlightRequestPublisher) to >>> CEP PayLoad definition.Git Hub commits can be found here[1], [2]. Currently >>> working on sending the timestamp to the RDBMS without conflicting execution >>> plans. >>> >>> I have included the read-me [2] file to the cep extensions how to >>> configure should happen for the Health Stat publishing to the RDBMS. >>> >>> [1]= >>> https://github.com/apache/stratos/commit/4c65e705be822fd420b4e48ebafef789c8686b76 >>> [2]= >>> https://github.com/apache/stratos/commit/e09334cd98f245a4633c992f02db2878ac24d3d0 >>> [3]= >>> https://github.com/apache/stratos/commit/5ca895ef030f6aaeba56183d982aa5ae95db9337 >>> >>> Thank You! >>> Best Regards, >>> Ashan >>> >>> On Tue, Jul 7, 2015 at 1:13 PM, Lasantha Fernando < >>> lasantha....@gmail.com> wrote: >>> >>>> Hi Ashan, >>>> >>>> Currently, you would not be able to get the timestamp out of the event >>>> unless you use a databridge agent callback. In that case, you can use >>>> Java code to simply get by calling event.getTimestamp(). >>>> >>>> However, if you want to use the timestamp as an attribute while doing >>>> processing within CEP, you would have to pass the timestamp as an >>>> attribute of the stream. i.e. add it as an attribute of either meta, >>>> correlation or payload data. Then you can use that timestamp and >>>> format the output event as necessary. >>>> >>>> Thanks, >>>> Lasantha >>>> >>>> On Tue, Jul 7, 2015 at 1:04 PM, Ashan Dhananjaya < >>>> dhananjay...@gmail.com> wrote: >>>> > Hi All, >>>> > >>>> > I applied the above patch and get the timestamp in the Input Adapter. >>>> The >>>> > formatter i used was "member_average_memory_consumption_stats:1.0.0". >>>> I >>>> > tried several time to get the timeStamp attribute but failed. Is >>>> there any >>>> > way to get a data which is outside in the payload? The Input stream >>>> is as >>>> > below, >>>> > >>>> > 10:40:27,757 [-] [DataBridge-Core-pool-2-thread-1] INFO >>>> TenantId=-1234 : >>>> > Input Event Adaptor : DefaultWSO2EventInputAdaptor, received >>>> > >>>> > Event{ >>>> > streamId='cartridge_agent_health_stats:1.0.0', >>>> > timeStamp=1436245827731, >>>> > metaData=null, >>>> > correlationData=null, >>>> > payloadData=[single-cartridge-app.my-php.php.domain, >>>> > single-cartridge-app-1, network-partition-1, >>>> > >>>> single-cartridge-app.my-php.php.domaina5598e2b-995f-4620-b652-e66341e24c99, >>>> > partition-1, memory_consumption, 20.0], >>>> > arbitraryDataMap={}, >>>> > } >>>> > >>>> > Any help will be really appreciated. >>>> > >>>> > Thank You! >>>> > Best Regards, >>>> > Ashan >>>> > >>>> > On Tue, Jul 7, 2015 at 9:32 AM, Chamila De Alwis <chami...@wso2.com> >>>> wrote: >>>> >> >>>> >> Hi Ashan, >>>> >> >>>> >> As I've seen from the PCA testing recently, the timestamp is added to >>>> >> every ThriftEvent before publishing. Are you working on PCA or the >>>> Mock >>>> >> IaaS? I took a look at the Mock IaaS and the >>>> WSO2CEPStatisticsPublisher as >>>> >> well, and found out that the latter indeed doesn't add the timestamp >>>> to the >>>> >> ThriftEvents. This means that the JCA also publishes Thrift Events >>>> with >>>> >> empty timestamp fields. >>>> >> >>>> >> Following is the simple fix for that. I've attached the patch >>>> herewith. >>>> >> Could you quickly verify with the patch applied build also? >>>> >> >>>> >> chamilad@chamilad-ThinkPad-T530:~/dev/stratos[master *]$ git diff >>>> >> diff --git >>>> >> >>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>> >> b/c >>>> >> index 653288d..f1fe426 100644 >>>> >> --- >>>> >> >>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>> >> +++ >>>> >> >>>> b/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>> >> @@ -29,6 +29,7 @@ import >>>> >> org.wso2.carbon.databridge.agent.thrift.exception.AgentException; >>>> >> import org.wso2.carbon.databridge.commons.Event; >>>> >> import org.wso2.carbon.databridge.commons.StreamDefinition; >>>> >> >>>> >> +import java.util.Date; >>>> >> import java.util.HashMap; >>>> >> >>>> >> /** >>>> >> @@ -98,6 +99,7 @@ public class WSO2CEPStatisticsPublisher implements >>>> >> StatisticsPublisher { >>>> >> >>>> >> Event event = new Event(); >>>> >> event.setPayloadData(payload); >>>> >> + event.setTimeStamp(new Date().getTime()); >>>> >> event.setArbitraryDataMap(new HashMap<String, String>()); >>>> >> >>>> >> try { >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> Regards, >>>> >> Chamila de Alwis >>>> >> Committer and PMC Member - Apache Stratos >>>> >> Software Engineer | WSO2 | +94772207163 >>>> >> Blog: code.chamiladealwis.com >>>> >> >>>> >> >>>> > >>>> >>> >>> >> >> >> -- >> -- >> Lahiru Sandaruwan >> Committer and PMC member, Apache Stratos, >> Senior Software Engineer, >> WSO2 Inc., http://wso2.com >> lean.enterprise.middleware >> >> phone: +94773325954 >> email: lahi...@wso2.com blog: http://lahiruwrites.blogspot.com/ >> linked-in: http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 >> >> >> _______________________________________________ >> Dev mailing list >> d...@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > -- -- Lahiru Sandaruwan Committer and PMC member, Apache Stratos, Senior Software Engineer, WSO2 Inc., http://wso2.com lean.enterprise.middleware phone: +94773325954 email: lahi...@wso2.com blog: http://lahiruwrites.blogspot.com/ linked-in: http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146
