Noted Lahiru. On Thu, Jul 9, 2015 at 7:48 PM, Lahiru Sandaruwan <lahi...@wso2.com> wrote:
> Hi Ashan, > > Good stuff. It is fine to set the time stamp from CEP for now. But > ultimately we need the timestamp to be sent from Python cartridge agent. > Let's fix that part we proceed. > > Thanks. > > On Thu, Jul 9, 2015 at 7:38 PM, Ashan Dhananjaya <dhananjay...@gmail.com> > wrote: > >> Hi All, >> >> I was able to get the TimeaStamp to the RDBMS without any conflict AFAIK. >> I am testing the flow more. Please find the commits [1], [2] for the >> Formatters. >> >> [1]= >> https://github.com/ashandk/stratos/commit/efa25eb255cadbf2843e5f0d0e13b34c09535f91 >> [2]= >> https://github.com/ashandk/stratos/commit/9c0fce9081c299c34031d602c94ea712602c7a6c >> >> Thank You! >> Best Regards, >> Ashan >> >> On Thu, Jul 9, 2015 at 2:41 PM, Lahiru Sandaruwan <lahi...@wso2.com> >> wrote: >> >>> Great work Ashan. >>> >>> On Thu, Jul 9, 2015 at 2:39 PM, Ashan Dhananjaya <dhananjay...@gmail.com >>> > wrote: >>> >>>> Hi All, >>>> >>>> I was able to take the timestamp from the cartridge agent >>>> (WSO2CEPHealthStatisticsPublisher and WSO2CEPInFlightRequestPublisher) to >>>> CEP PayLoad definition.Git Hub commits can be found here[1], [2]. Currently >>>> working on sending the timestamp to the RDBMS without conflicting execution >>>> plans. >>>> >>>> I have included the read-me [2] file to the cep extensions how to >>>> configure should happen for the Health Stat publishing to the RDBMS. >>>> >>>> [1]= >>>> https://github.com/apache/stratos/commit/4c65e705be822fd420b4e48ebafef789c8686b76 >>>> [2]= >>>> https://github.com/apache/stratos/commit/e09334cd98f245a4633c992f02db2878ac24d3d0 >>>> [3]= >>>> https://github.com/apache/stratos/commit/5ca895ef030f6aaeba56183d982aa5ae95db9337 >>>> >>>> Thank You! >>>> Best Regards, >>>> Ashan >>>> >>>> On Tue, Jul 7, 2015 at 1:13 PM, Lasantha Fernando < >>>> lasantha....@gmail.com> wrote: >>>> >>>>> Hi Ashan, >>>>> >>>>> Currently, you would not be able to get the timestamp out of the event >>>>> unless you use a databridge agent callback. In that case, you can use >>>>> Java code to simply get by calling event.getTimestamp(). >>>>> >>>>> However, if you want to use the timestamp as an attribute while doing >>>>> processing within CEP, you would have to pass the timestamp as an >>>>> attribute of the stream. i.e. add it as an attribute of either meta, >>>>> correlation or payload data. Then you can use that timestamp and >>>>> format the output event as necessary. >>>>> >>>>> Thanks, >>>>> Lasantha >>>>> >>>>> On Tue, Jul 7, 2015 at 1:04 PM, Ashan Dhananjaya < >>>>> dhananjay...@gmail.com> wrote: >>>>> > Hi All, >>>>> > >>>>> > I applied the above patch and get the timestamp in the Input >>>>> Adapter. The >>>>> > formatter i used was >>>>> "member_average_memory_consumption_stats:1.0.0". I >>>>> > tried several time to get the timeStamp attribute but failed. Is >>>>> there any >>>>> > way to get a data which is outside in the payload? The Input stream >>>>> is as >>>>> > below, >>>>> > >>>>> > 10:40:27,757 [-] [DataBridge-Core-pool-2-thread-1] INFO >>>>> TenantId=-1234 : >>>>> > Input Event Adaptor : DefaultWSO2EventInputAdaptor, received >>>>> > >>>>> > Event{ >>>>> > streamId='cartridge_agent_health_stats:1.0.0', >>>>> > timeStamp=1436245827731, >>>>> > metaData=null, >>>>> > correlationData=null, >>>>> > payloadData=[single-cartridge-app.my-php.php.domain, >>>>> > single-cartridge-app-1, network-partition-1, >>>>> > >>>>> single-cartridge-app.my-php.php.domaina5598e2b-995f-4620-b652-e66341e24c99, >>>>> > partition-1, memory_consumption, 20.0], >>>>> > arbitraryDataMap={}, >>>>> > } >>>>> > >>>>> > Any help will be really appreciated. >>>>> > >>>>> > Thank You! >>>>> > Best Regards, >>>>> > Ashan >>>>> > >>>>> > On Tue, Jul 7, 2015 at 9:32 AM, Chamila De Alwis <chami...@wso2.com> >>>>> wrote: >>>>> >> >>>>> >> Hi Ashan, >>>>> >> >>>>> >> As I've seen from the PCA testing recently, the timestamp is added >>>>> to >>>>> >> every ThriftEvent before publishing. Are you working on PCA or the >>>>> Mock >>>>> >> IaaS? I took a look at the Mock IaaS and the >>>>> WSO2CEPStatisticsPublisher as >>>>> >> well, and found out that the latter indeed doesn't add the >>>>> timestamp to the >>>>> >> ThriftEvents. This means that the JCA also publishes Thrift Events >>>>> with >>>>> >> empty timestamp fields. >>>>> >> >>>>> >> Following is the simple fix for that. I've attached the patch >>>>> herewith. >>>>> >> Could you quickly verify with the patch applied build also? >>>>> >> >>>>> >> chamilad@chamilad-ThinkPad-T530:~/dev/stratos[master *]$ git diff >>>>> >> diff --git >>>>> >> >>>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>>> >> b/c >>>>> >> index 653288d..f1fe426 100644 >>>>> >> --- >>>>> >> >>>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>>> >> +++ >>>>> >> >>>>> b/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>>> >> @@ -29,6 +29,7 @@ import >>>>> >> org.wso2.carbon.databridge.agent.thrift.exception.AgentException; >>>>> >> import org.wso2.carbon.databridge.commons.Event; >>>>> >> import org.wso2.carbon.databridge.commons.StreamDefinition; >>>>> >> >>>>> >> +import java.util.Date; >>>>> >> import java.util.HashMap; >>>>> >> >>>>> >> /** >>>>> >> @@ -98,6 +99,7 @@ public class WSO2CEPStatisticsPublisher implements >>>>> >> StatisticsPublisher { >>>>> >> >>>>> >> Event event = new Event(); >>>>> >> event.setPayloadData(payload); >>>>> >> + event.setTimeStamp(new Date().getTime()); >>>>> >> event.setArbitraryDataMap(new HashMap<String, String>()); >>>>> >> >>>>> >> try { >>>>> >> >>>>> >> >>>>> >> >>>>> >> >>>>> >> >>>>> >> Regards, >>>>> >> Chamila de Alwis >>>>> >> Committer and PMC Member - Apache Stratos >>>>> >> Software Engineer | WSO2 | +94772207163 >>>>> >> Blog: code.chamiladealwis.com >>>>> >> >>>>> >> >>>>> > >>>>> >>>> >>>> >>> >>> >>> -- >>> -- >>> Lahiru Sandaruwan >>> Committer and PMC member, Apache Stratos, >>> Senior Software Engineer, >>> WSO2 Inc., http://wso2.com >>> lean.enterprise.middleware >>> >>> phone: +94773325954 >>> email: lahi...@wso2.com blog: http://lahiruwrites.blogspot.com/ >>> linked-in: http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 >>> >>> >>> _______________________________________________ >>> Dev mailing list >>> d...@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> > > > -- > -- > Lahiru Sandaruwan > Committer and PMC member, Apache Stratos, > Senior Software Engineer, > WSO2 Inc., http://wso2.com > lean.enterprise.middleware > > phone: +94773325954 > email: lahi...@wso2.com blog: http://lahiruwrites.blogspot.com/ > linked-in: http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 > >
