Caused by: InvalidTopologyException(msg:Component: [query6] subscribes from non-existent stream: [outputEmailStream] of component [EventPublisherBolt])
To add my two cents. This seems to be a bug in storm component wiring logic. Event publishers are terminal bolts. Therefore, there can't be any storm output streams for them and apparently query6 bolt is trying to a ssubscribe to stream which does not exists. Thanks *,Sajith Ravindra* Senior Software Engineer WSO2 Inc.; http://wso2.com lean.enterprise.middleware mobile: +94 77 2273550 blog: http://sajithr.blogspot.com/ <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab> On Wed, May 6, 2015 at 5:08 PM, Miyuru Dayarathna <miyu...@wso2.com> wrote: > Hi, > > I tested the CEP+Storm functionality of the CEP pack which I received > today from Sachini. I was able to run the Email processor benchmark > (without the metric collection branch) in the CEP on Storm implementation. > See the attached image for details of the query network. However, the > metric collection branch of the query network cannot be deployed in the > latest CEP pack. The management console says "Queries are valid!" when I > click the Validate Query Expressions button of "Create a New Execution > Plan" form. But when I try to add the query network by clicking "Add > Execution Plan" button I get an error message saying, > > "Failed to add execution plan, Exception: Invalid Execution Plan > EmailProcessor for tenant -1234" > > Listed below is part of the exception I received on the CEP server's > command line, > > Caused by: > org.wso2.carbon.event.processor.core.exception.ExecutionPlanConfigurationException: > Invalid Execution Plan EmailProcessor for tenant -1234 > at > org.wso2.carbon.event.processor.core.internal.storm.TopologyManager.submitTopology(TopologyManager.java:171) > at > org.wso2.carbon.event.processor.core.internal.CarbonEventProcessorService.addExecutionPlan(CarbonEventProcessorService.java:307) > at > org.wso2.carbon.event.processor.core.EventProcessorDeployer.processDeploy(EventProcessorDeployer.java:123) > ... 69 more > Caused by: InvalidTopologyException(msg:Component: [query6] subscribes > from non-existent stream: [outputEmailStream] of component > [EventPublisherBolt]) > at > backtype.storm.generated.Nimbus$submitTopology_result.read(Nimbus.java:2466) > > Therefore, at the moment I can run only the trunk of the query network. I > will try to find an alternative for implementing the metrics collection > feature. It would be great if someone from CEP team could investigate the > reason for such error. I have mentioned some important tips that are useful > for deploying CEP on Storm queries. > > During the meeting I had with Srinath today we discussed that we should > compare performance of CEP on Storm implementation with naive storm > implementation of the Email Processor benchmark. As the immediate next step > I will attach the custom event producer and consumers to the EmailProcessor > benchmark and do performance tests. > > Thanks, > Miyuru > > > Some tips: > 1) We have to make sure that we copy the CEP standard/custom extensions > (e.g., regex-3.0.0-SNAPSHOT.jar) to the $STORM_HOME/lib directory before > running any CEP on Storm applications which need to use such extensions. > > 2) The syntax "@info(name = 'query1')" is not valid for CEP on Storm. In > order to set the names for each bolt created for each query operator, we > have to use the syntax "@name('query1')" instead. > > > On Tue, May 5, 2015 at 9:59 AM, Miyuru Dayarathna <miyu...@wso2.com> > wrote: > >> Hi Srinath, >> >> Yes, I received the latest CEP pack from Sachini in today's morning. Now >> I am testing whether the sample 2001 can be run on this pack. Once I get >> confirmed that the sample 2001 works properly, I will resume the >> benchmarking task of CEP+Storm implementation. >> >> Thanks, >> Miyuru >> >> On Tue, May 5, 2015 at 9:27 AM, Srinath Perera <srin...@wso2.com> wrote: >> >>> Did you get the packs? update please. >>> >>> On Sun, Apr 26, 2015 at 9:10 PM, Miyuru Dayarathna <miyu...@wso2.com> >>> wrote: >>> >>>> Hi Srinath, >>>> >>>> The benchmarking experiments of the CEP+Storm version got somewhat >>>> delayed because there were some query plan validation issues with the CEP >>>> management console. I faced these issues when I was trying to deploy >>>> queries with custom CEP extensions. I worked with Suho about this on last >>>> week's Thursday and Friday. The latest CEP pack which I received from Suho >>>> solves the query validation issue. But the query network does not get >>>> deployed on Storm in this version of the pack. We are working on to solve >>>> this issue at the moment. In the mean time I will do a performance test of >>>> the CEP server with the EmailProcessor benchmark, without use of Storm >>>> until I receive an updated pack from CEP team. >>>> >>>> Thanks, >>>> Miyuru >>>> >>>> On Wed, Apr 22, 2015 at 12:53 PM, Miyuru Dayarathna <miyu...@wso2.com> >>>> wrote: >>>> >>>>> Hi Sajith, >>>>> >>>>> Yes, we should use the @dist(parallel='n') annotation when we develop >>>>> the benchmark for WSO2 CEP on Storm implementation. However, currently >>>>> I am working on developing that version of the application. The Siddhi >>>>> queries mentioned in my previous email were developed using Siddhi 3.0.0 >>>>> and were run on single computer without using Storm. Thanks for reminding >>>>> me about this important point. >>>>> >>>>> Thanks, >>>>> Miyuru >>>>> >>>>> On Wed, Apr 22, 2015 at 12:34 PM, Sajith Ravindra <saji...@wso2.com> >>>>> wrote: >>>>> >>>>>> Hi Miyuru, >>>>>> >>>>>> Shouldn't we have the @dist(parallel='n') annotation to have multiple >>>>>> instances of Siddhi bolts who executes a given query ? >>>>>> >>>>>> Thanks >>>>>> *,Sajith Ravindra* >>>>>> Senior Software Engineer >>>>>> WSO2 Inc.; http://wso2.com >>>>>> lean.enterprise.middleware >>>>>> >>>>>> mobile: +94 77 2273550 >>>>>> blog: http://sajithr.blogspot.com/ >>>>>> <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab> >>>>>> >>>>>> On Wed, Apr 22, 2015 at 1:47 PM, Lasantha Fernando <lasan...@wso2.com >>>>>> > wrote: >>>>>> >>>>>>> Thanks Miyuru! >>>>>>> >>>>>>> On 22 April 2015 at 12:01, Miyuru Dayarathna <miyu...@wso2.com> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi Lasantha, >>>>>>>> >>>>>>>> Ok, I have prepared some slides on the EmailProcessing benchmark >>>>>>>> which can be accessed from [1 >>>>>>>> <https://docs.google.com/a/wso2.com/presentation/d/1suBs8mhtw1sLobptqCN_N9bWXBStHVR8NhMlzCkjvNY/edit?usp=sharing>]. >>>>>>>> The slides describe the benchmark scenario. I have mentioned the Siddhi >>>>>>>> queries below as well. >>>>>>>> >>>>>>>> Thanks, >>>>>>>> Miyuru >>>>>>>> >>>>>>>> [1] >>>>>>>> https://docs.google.com/a/wso2.com/presentation/d/1suBs8mhtw1sLobptqCN_N9bWXBStHVR8NhMlzCkjvNY/edit?usp=sharing >>>>>>>> >>>>>>>> String inputEmailStream = "define stream inputEmailsStream ( >>>>>>>> iij_timestamp float, fromAddress string, toAddresses string," >>>>>>>> + "ccAddresses string, bccAddresses >>>>>>>> string, subject string, body string, regexstr string); "; >>>>>>>> >>>>>>>> //The following two queries (query 1 and query2) are used to filter >>>>>>>> the emails that do not originate from enron.com domain. >>>>>>>> String query1 = "@info(name = 'query1') from inputEmailsStream >>>>>>>> select iij_timestamp, regex:find(fromAddress, regexstr) as >>>>>>>> isValidFromAddress, fromAddress, toAddresses, ccAddresses, >>>>>>>> bccAddresses, >>>>>>>> subject, body insert into filteredEmailStream1;"; >>>>>>>> >>>>>>>> String query2 = "@info(name = 'query2') from >>>>>>>> filteredEmailStream1[isValidFromAddress == true] select * insert into >>>>>>>> filteredEmailStream2;"; >>>>>>>> >>>>>>>> String query3 = "@info(name = 'query3') from filteredEmailStream2 >>>>>>>> select iij_timestamp, fromAddress, >>>>>>>> emailProcessorBenchmark:filter(toAddresses) as toAdds, >>>>>>>> emailProcessorBenchmark:filter(ccAddresses) as ccAdds, >>>>>>>> emailProcessorBenchmark:filter(bccAddresses) as bccAdds, subject, body >>>>>>>> insert into filteredEmailStream3;"; >>>>>>>> >>>>>>>> String query4 = "@info(name = 'query4') from filteredEmailStream3 >>>>>>>> select iij_timestamp, fromAddress, toAdds, ccAdds, bccAdds, subject, >>>>>>>> emailProcessorBenchmark:modify(body) as bodyObfuscated insert into >>>>>>>> modifiedEmailStream;"; >>>>>>>> >>>>>>>> String query5 = "@info(name = 'query5') from modifiedEmailStream >>>>>>>> select iij_timestamp, fromAddress, toAdds, ccAdds, bccAdds, >>>>>>>> emailProcessorBenchmark:mostFrequentWord(bodyObfuscated, subject) as >>>>>>>> updatedSubject, bodyObfuscated insert into outputEmailStream;"; >>>>>>>> >>>>>>>> String query6 = "@info(name = 'query6') from outputEmailStream >>>>>>>> select iij_timestamp, emailProcessorBenchmark:metrics(bodyObfuscated) >>>>>>>> as >>>>>>>> metrics insert into emailMetricsNonFilteredStream;"; >>>>>>>> >>>>>>>> String query7 = "@info(name = 'query7') from >>>>>>>> emailMetricsNonFilteredStream select iij_timestamp, metrics output last >>>>>>>> every 10 sec insert into emailMetricsStream;"; >>>>>>>> >>>>>>>> >>>>>>>> CEP on Storm Performance Testing >>>>>>>> <https://docs.google.com/a/wso2.com/presentation/d/1suBs8mhtw1sLobptqCN_N9bWXBStHVR8NhMlzCkjvNY/edit?usp=drive_web> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Wed, Apr 22, 2015 at 11:36 AM, Lasantha Fernando < >>>>>>>> lasan...@wso2.com> wrote: >>>>>>>> >>>>>>>>> Hi Miyuru, >>>>>>>>> >>>>>>>>> Would it be possible to share the Siddhi queries that were run as >>>>>>>>> well just to get an idea the type of queries that were run? (e.g. >>>>>>>>> Window >>>>>>>>> queries, Filter queries etc.) >>>>>>>>> >>>>>>>>> Thanks, >>>>>>>>> Lasantha >>>>>>>>> >>>>>>>>> On 22 April 2015 at 10:48, Miyuru Dayarathna <miyu...@wso2.com> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> Hi Srinath, >>>>>>>>>> >>>>>>>>>> I have shared the performance numbers of the Siddhi 3.0.0 version >>>>>>>>>> of the EmailProcessing Benchmark on [1 >>>>>>>>>> <https://docs.google.com/a/wso2.com/spreadsheets/d/1coow1_jyv50vwAuLIL92mCzn72iwOM9B8yxFgDHNS4Y/edit?usp=sharing>]. >>>>>>>>>> As per the discussion we had during the meeting, I will port the >>>>>>>>>> Siddhi >>>>>>>>>> queries to CEP+Storm implementation today and will update this email >>>>>>>>>> thread >>>>>>>>>> with the performance numbers from my local WSO2 CEP + Storm cluster. >>>>>>>>>> >>>>>>>>>> [1] >>>>>>>>>> https://docs.google.com/a/wso2.com/spreadsheets/d/1coow1_jyv50vwAuLIL92mCzn72iwOM9B8yxFgDHNS4Y/edit?usp=sharing >>>>>>>>>> >>>>>>>>>> Thanks, >>>>>>>>>> Miyuru >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> EmailProcessing Benchmark Stats >>>>>>>>>> <https://docs.google.com/a/wso2.com/spreadsheets/d/1coow1_jyv50vwAuLIL92mCzn72iwOM9B8yxFgDHNS4Y/edit?usp=drive_web> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Tue, Apr 21, 2015 at 9:58 AM, Praneesha Chandrasiri < >>>>>>>>>> pranee...@wso2.com> wrote: >>>>>>>>>> >>>>>>>>>>> Hi Miyuru, >>>>>>>>>>> >>>>>>>>>>> +1. Thanks for the feedback. Will work with you to improve the >>>>>>>>>>> docs. >>>>>>>>>>> >>>>>>>>>>> On Mon, Apr 20, 2015 at 11:18 AM, Miyuru Dayarathna < >>>>>>>>>>> miyu...@wso2.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi Praneesha, >>>>>>>>>>>> >>>>>>>>>>>> As I mentioned earlier I was able to run the WSO2 CEP sample >>>>>>>>>>>> 2001 after going through the documentation of sample 2001 [1 >>>>>>>>>>>> <https://docs.wso2.com/display/CEP400/Sample+2001+-+Simple+filter+query+with+Apache+Storm+deployment>]. >>>>>>>>>>>> I had to seek support from Tishan, Lasantha during this process. >>>>>>>>>>>> There are >>>>>>>>>>>> several places in the documentation which I think could be >>>>>>>>>>>> improved which I >>>>>>>>>>>> have mentioned below. >>>>>>>>>>>> >>>>>>>>>>>> I would like if the documentation could provide some more >>>>>>>>>>>> details on setting up a storm cluster (i.e., a local Storm >>>>>>>>>>>> cluster) or at >>>>>>>>>>>> least provide some pointers. The statement "2. Apache Storm >>>>>>>>>>>> deployment." is >>>>>>>>>>>> not informative. I think we need more description of what we mean >>>>>>>>>>>> by Apache >>>>>>>>>>>> Storm deployment. For example, we can point the reader to some of >>>>>>>>>>>> the >>>>>>>>>>>> existing tutorials on setting up a storm cluster such as [3 >>>>>>>>>>>> <http://www.michael-noll.com/tutorials/running-multi-node-storm-cluster/> >>>>>>>>>>>> ][4 >>>>>>>>>>>> <https://storm.apache.org/documentation/Setting-up-development-environment.html>]. >>>>>>>>>>>> The Storm's documentation [4 >>>>>>>>>>>> <https://storm.apache.org/documentation/Setting-up-development-environment.html>] >>>>>>>>>>>> on setting up Storm development environment provides only part of >>>>>>>>>>>> the >>>>>>>>>>>> required information. For example, to get my local Storm cluster >>>>>>>>>>>> run >>>>>>>>>>>> properly, I had to use the default Storm configuration information >>>>>>>>>>>> listed >>>>>>>>>>>> in "defaults.yaml" [5 >>>>>>>>>>>> <https://github.com/apache/storm/blob/master/conf/defaults.yaml>] >>>>>>>>>>>> rather than using the configurations on "storm.yaml.example" [6 >>>>>>>>>>>> <https://github.com/apache/storm/blob/master/conf/storm.yaml.example> >>>>>>>>>>>> ]. >>>>>>>>>>>> >>>>>>>>>>>> After setting up a local Storm cluster, I used the following >>>>>>>>>>>> set of commands on three different terminals on Ubuntu to get the >>>>>>>>>>>> sample >>>>>>>>>>>> 2001 running. >>>>>>>>>>>> >>>>>>>>>>>> #(1): Thrift server >>>>>>>>>>>> on >>>>>>>>>>>> "~/software/wso2cep-4.0.0-SNAPSHOT/samples/consumers/wso2-event" >>>>>>>>>>>> run ant >>>>>>>>>>>> -Dhost=localhost -Dprotocol=thrift -Dsn=2001 >>>>>>>>>>>> >>>>>>>>>>>> #(2): cep-server >>>>>>>>>>>> on "~/software/wso2cep-4.0.0-SNAPSHOT/bin" run >>>>>>>>>>>> ./wso2cep-samples.sh -sn 2001 >>>>>>>>>>>> >>>>>>>>>>>> #(3): client >>>>>>>>>>>> on >>>>>>>>>>>> "~/software/wso2cep-4.0.0-SNAPSHOT/samples/producers/analytics-stats" >>>>>>>>>>>> run >>>>>>>>>>>> ant -Devents=10 -Dhost=localhost -Dport=7611 >>>>>>>>>>>> >>>>>>>>>>>> I did not find a particular difference due to the execution >>>>>>>>>>>> order of the (1) thrift server and the (2) WSO2 CEP server. Either >>>>>>>>>>>> one >>>>>>>>>>>> could be started first. >>>>>>>>>>>> >>>>>>>>>>>> Note that (1) and (3) can be executed just by running ant >>>>>>>>>>>> without any parameters. However, the parameters provided to ant >>>>>>>>>>>> are very >>>>>>>>>>>> important in (1) and (3) if we are providing any. For example, the >>>>>>>>>>>> port >>>>>>>>>>>> 7611 in (3) is very important. This is the Thrift port on which >>>>>>>>>>>> the CEP >>>>>>>>>>>> server is listening. The producer needs to send events to this >>>>>>>>>>>> port rather >>>>>>>>>>>> than 7661 on which the producer listens. In a local deployment >>>>>>>>>>>> this may >>>>>>>>>>>> confuse the reader since the events will be directly sent to the >>>>>>>>>>>> producer >>>>>>>>>>>> process rather than getting directed through CEP server and Storm >>>>>>>>>>>> if the >>>>>>>>>>>> reader uses -Dport=7661 accidentally. Furthermore, there is no >>>>>>>>>>>> information >>>>>>>>>>>> on use of port 7611 in the current documentation. Hence, it becomes >>>>>>>>>>>> difficult for first time users to figure out such parameters if >>>>>>>>>>>> they try >>>>>>>>>>>> them out. >>>>>>>>>>>> >>>>>>>>>>>> IMO the documentation should say that once the WSO2 CEP server >>>>>>>>>>>> starts there should be a topology named "PreprocessStats[-1234]" >>>>>>>>>>>> appearing >>>>>>>>>>>> on the Storm UI page. If the sample runs correctly, we should find >>>>>>>>>>>> non-zero >>>>>>>>>>>> topology stats values of this topology listed on Storm UI. >>>>>>>>>>>> >>>>>>>>>>>> Minor comments on English mistakes and the content of CEP Storm >>>>>>>>>>>> documentation >>>>>>>>>>>> >>>>>>>>>>>> 1) "Filters events from analyticsStats stream and insert >>>>>>>>>>>> results into filteredStatStream."-->"insert results" needs to be >>>>>>>>>>>> changed to >>>>>>>>>>>> "inserts results" >>>>>>>>>>>> 2) On [2 >>>>>>>>>>>> <https://docs.wso2.com/display/CEP400/Setting+up+CEP+Samples#SettingupCEPSamples-Prerequisites>], >>>>>>>>>>>> "artefacts" needs to be changed to "artifacts" >>>>>>>>>>>> 3) Under the thrid point of "Prerequisites" what do we mean by >>>>>>>>>>>> "wka" of the following setting? >>>>>>>>>>>> <parameter name="membershipScheme">wka</parameter> >>>>>>>>>>>> 4) what do we mean by >>>>>>>>>>>> To enable CEP to talk to Apache Storm add the Nimbus, >>>>>>>>>>>> Zookeeper, etc information at >>>>>>>>>>>> <CEP_HOME>/repository/conf/cep/storm/storm.yaml file on both >>>>>>>>>>>> nodes. ? >>>>>>>>>>>> "both nodes"? >>>>>>>>>>>> >>>>>>>>>>>> We can work on improving the documentation on at least some of >>>>>>>>>>>> these aspects. >>>>>>>>>>>> >>>>>>>>>>>> Thanks, >>>>>>>>>>>> Miyuru >>>>>>>>>>>> >>>>>>>>>>>> [1] >>>>>>>>>>>> https://docs.wso2.com/display/CEP400/Sample+2001+-+Simple+filter+query+with+Apache+Storm+deployment >>>>>>>>>>>> [2] >>>>>>>>>>>> https://docs.wso2.com/display/CEP400/Setting+up+CEP+Samples#SettingupCEPSamples-Prerequisites >>>>>>>>>>>> [3] >>>>>>>>>>>> http://www.michael-noll.com/tutorials/running-multi-node-storm-cluster/ >>>>>>>>>>>> [4] >>>>>>>>>>>> https://storm.apache.org/documentation/Setting-up-development-environment.html >>>>>>>>>>>> [5] >>>>>>>>>>>> https://github.com/apache/storm/blob/master/conf/defaults.yaml >>>>>>>>>>>> [6] >>>>>>>>>>>> https://github.com/apache/storm/blob/master/conf/storm.yaml.example >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Apr 20, 2015 at 10:11 AM, Praneesha Chandrasiri < >>>>>>>>>>>> pranee...@wso2.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi Miyuru/Iranga, >>>>>>>>>>>>> >>>>>>>>>>>>> Noted. Thanks for the feedback. >>>>>>>>>>>>> >>>>>>>>>>>>> Let's work on improving the doc. >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, Apr 20, 2015 at 9:17 AM, Miyuru Dayarathna < >>>>>>>>>>>>> miyu...@wso2.com> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Hi Srinath, >>>>>>>>>>>>>> >>>>>>>>>>>>>> Last Friday (16th April) I was able to run the sample 2001 >>>>>>>>>>>>>> with the local Storm cluster setup on my laptop. I completed >>>>>>>>>>>>>> implementing a >>>>>>>>>>>>>> sample Java application which implements the "Email Processing >>>>>>>>>>>>>> Benchmark" >>>>>>>>>>>>>> scenario described in [1 >>>>>>>>>>>>>> <https://developer.ibm.com/streamsdev/wp-content/uploads/sites/15/2014/04/Streams-and-Storm-April-2014-Final.pdf>]. >>>>>>>>>>>>>> At the moment I am porting that application to WSO2 CEP on >>>>>>>>>>>>>> Apache Storm >>>>>>>>>>>>>> implementation. I have several suggestions for improving the >>>>>>>>>>>>>> documentation [ >>>>>>>>>>>>>> 2 >>>>>>>>>>>>>> <https://docs.wso2.com/display/CEP400/Sample+2001+-+Simple+filter+query+with+Apache+Storm+deployment>] >>>>>>>>>>>>>> on setting up and running the sample 2001, which I will send >>>>>>>>>>>>>> later via this >>>>>>>>>>>>>> email thread. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>> Miyuru >>>>>>>>>>>>>> >>>>>>>>>>>>>> [1] https://developer.ibm.com/streamsdev/wp >>>>>>>>>>>>>> -content/uploads/sites/15/2014/04/Streams-and-Storm-April-2014-Final. >>>>>>>>>>>>>> pdf >>>>>>>>>>>>>> [2] >>>>>>>>>>>>>> https://docs.wso2.com/display/CEP400/Sample+2001+-+Simple+filter+query+with+Apache+Storm+deployment >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Thu, Apr 9, 2015 at 11:58 AM, Miyuru Dayarathna < >>>>>>>>>>>>>> miyu...@wso2.com> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Hi, >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> @ Iranga >>>>>>>>>>>>>>> Thank you for sharing the information. They are useful. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> @ Srinath >>>>>>>>>>>>>>> I will talk to Praneesha if I find anything that needs to be >>>>>>>>>>>>>>> updated on the CEP documentation. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>> Miyuru >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Thu, Apr 9, 2015 at 11:34 AM, Iranga Muthuthanthri < >>>>>>>>>>>>>>> ira...@wso2.com> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Thu, Apr 9, 2015 at 11:23 AM, Srinath Perera < >>>>>>>>>>>>>>>> srin...@wso2.com> wrote: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Can Miyuru update the Doc? Miyuru can u update doc while >>>>>>>>>>>>>>>>> you are at it. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Documented some steps on the setup[1] hope it helps. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> [1] >>>>>>>>>>>>>>>> https://docs.google.com/a/wso2.com/document/d/1l_qewhLiY2cPLoBcz9TXr2i-m583A2qkZwYcGj_lDfc/edit# >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> --Srinath >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> On Thu, Apr 9, 2015 at 10:46 AM, Miyuru Dayarathna < >>>>>>>>>>>>>>>>> miyu...@wso2.com> wrote: >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Hi Tishan, >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Thank you for providing me the information. I will work >>>>>>>>>>>>>>>>>> on setting up the environment based on these guidelines and >>>>>>>>>>>>>>>>>> will get in >>>>>>>>>>>>>>>>>> touch with you/Lasantha if I face any problems. >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>> Miyuru >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> On Thu, Apr 9, 2015 at 10:31 AM, Tishan Dahanayakage < >>>>>>>>>>>>>>>>>> tis...@wso2.com> wrote: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Hi Miyuru, >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> For starters try out this[1] sample. But please note >>>>>>>>>>>>>>>>>>> that storm-deployment-config.xml is now part of >>>>>>>>>>>>>>>>>>> event-processing.xml which >>>>>>>>>>>>>>>>>>> is at <CARBON_HOME>/repository/conf. So steps may vary >>>>>>>>>>>>>>>>>>> slightly. AFAIK >>>>>>>>>>>>>>>>>>> separate effort is there to enrich storm documentation. You >>>>>>>>>>>>>>>>>>> can contribute >>>>>>>>>>>>>>>>>>> to that as well with your experience on setting this as a >>>>>>>>>>>>>>>>>>> fresh user. :) >>>>>>>>>>>>>>>>>>> Also when setting the local storm cluster follow >>>>>>>>>>>>>>>>>>> installing storm release locally section on [2]. You need >>>>>>>>>>>>>>>>>>> to have Apache >>>>>>>>>>>>>>>>>>> Zookeeper running also to run Apache Storm. >>>>>>>>>>>>>>>>>>> After you have a working sample you can use the same >>>>>>>>>>>>>>>>>>> setup to deploy different query plans into storm and test. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Feel free to reach out to myself or Lasantha if there is >>>>>>>>>>>>>>>>>>> any problem. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> [1] >>>>>>>>>>>>>>>>>>> https://docs.wso2.com/display/CEP400/Sample+2001+-+Simple+filter+query+with+Apache+Storm+deployment >>>>>>>>>>>>>>>>>>> [2] >>>>>>>>>>>>>>>>>>> https://storm.apache.org/documentation/Setting-up-development-environment.html >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>>> Tishan >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> On Wed, Apr 8, 2015 at 8:35 PM, Miyuru Dayarathna < >>>>>>>>>>>>>>>>>>> miyu...@wso2.com> wrote: >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> Hi, >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> Is there any setup instructions document for setting up >>>>>>>>>>>>>>>>>>>> the software environment for carbon-event-processing >>>>>>>>>>>>>>>>>>>> project (In particular >>>>>>>>>>>>>>>>>>>> to get the following code running?). >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> https://github.com/wso2/carbon-event-processing/tree/master/components/event-processor/org.wso2.carbon.event.processor.common/src/main/java/org/wso2/carbon/event/processor/common/storm/component >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>>>> Miyuru >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> On Wed, Apr 8, 2015 at 8:05 AM, Miyuru Dayarathna < >>>>>>>>>>>>>>>>>>>> miyu...@wso2.com> wrote: >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> Hi Srinath, >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> Ok,I will work on finding a good benchmark for these >>>>>>>>>>>>>>>>>>>>> performance tests. Also I will talk with Suho and some >>>>>>>>>>>>>>>>>>>>> other team member >>>>>>>>>>>>>>>>>>>>> from CEP team as you mentioned. >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>>>>> Miyuru >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> On Wed, Apr 8, 2015 at 7:58 AM, Srinath Perera < >>>>>>>>>>>>>>>>>>>>> srin...@wso2.com> wrote: >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Miyuru, can you try this out and run a bench mark. >>>>>>>>>>>>>>>>>>>>>> Please find a good benchmark and respond to this thread >>>>>>>>>>>>>>>>>>>>>> so we can discuss. >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> Suho, can someone from CEP point him to details and >>>>>>>>>>>>>>>>>>>>>> help. >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> --Srinath >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>>>>>>>> ============================ >>>>>>>>>>>>>>>>>>>>>> Blog: http://srinathsview.blogspot.com >>>>>>>>>>>>>>>>>>>>>> twitter:@srinath_perera >>>>>>>>>>>>>>>>>>>>>> Site: http://people.apache.org/~hemapani/ >>>>>>>>>>>>>>>>>>>>>> Photos: http://www.flickr.com/photos/hemapani/ >>>>>>>>>>>>>>>>>>>>>> Phone: 0772360902 >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>>>>> Miyuru Dayarathna >>>>>>>>>>>>>>>>>>>>> Senior Technical Lead >>>>>>>>>>>>>>>>>>>>> Mobile: +94713527783 >>>>>>>>>>>>>>>>>>>>> Blog: http://miyurublog.blogspot.com >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>>>> Miyuru Dayarathna >>>>>>>>>>>>>>>>>>>> Senior Technical Lead >>>>>>>>>>>>>>>>>>>> Mobile: +94713527783 >>>>>>>>>>>>>>>>>>>> Blog: http://miyurublog.blogspot.com >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>>>>> Tishan Dahanayakage >>>>>>>>>>>>>>>>>>> Software Engineer >>>>>>>>>>>>>>>>>>> WSO2, Inc. >>>>>>>>>>>>>>>>>>> Mobile:+94 716481328 >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Disclaimer: This communication may contain privileged or >>>>>>>>>>>>>>>>>>> other confidential information and is intended exclusively >>>>>>>>>>>>>>>>>>> for the >>>>>>>>>>>>>>>>>>> addressee/s. If you are not the intended recipient/s, or >>>>>>>>>>>>>>>>>>> believe that you >>>>>>>>>>>>>>>>>>> may have received this communication in error, please reply >>>>>>>>>>>>>>>>>>> to the sender >>>>>>>>>>>>>>>>>>> indicating that fact and delete the copy you received and >>>>>>>>>>>>>>>>>>> in addition, you >>>>>>>>>>>>>>>>>>> should not print, copy, re-transmit, disseminate, or >>>>>>>>>>>>>>>>>>> otherwise use the >>>>>>>>>>>>>>>>>>> information contained in this communication. Internet >>>>>>>>>>>>>>>>>>> communications cannot >>>>>>>>>>>>>>>>>>> be guaranteed to be timely, secure, error or virus-free. >>>>>>>>>>>>>>>>>>> The sender does >>>>>>>>>>>>>>>>>>> not accept liability for any errors or omissions. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>> Miyuru Dayarathna >>>>>>>>>>>>>>>>>> Senior Technical Lead >>>>>>>>>>>>>>>>>> Mobile: +94713527783 >>>>>>>>>>>>>>>>>> Blog: http://miyurublog.blogspot.com >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>>> ============================ >>>>>>>>>>>>>>>>> Blog: http://srinathsview.blogspot.com >>>>>>>>>>>>>>>>> twitter:@srinath_perera >>>>>>>>>>>>>>>>> Site: http://people.apache.org/~hemapani/ >>>>>>>>>>>>>>>>> Photos: http://www.flickr.com/photos/hemapani/ >>>>>>>>>>>>>>>>> Phone: 0772360902 >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> _______________________________________________ >>>>>>>>>>>>>>>>> Architecture mailing list >>>>>>>>>>>>>>>>> Architecture@wso2.org >>>>>>>>>>>>>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>> Thanks & Regards >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Iranga Muthuthanthri >>>>>>>>>>>>>>>> (M) -0777-255773 >>>>>>>>>>>>>>>> Team Product Management >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>> Miyuru Dayarathna >>>>>>>>>>>>>>> Senior Technical Lead >>>>>>>>>>>>>>> Mobile: +94713527783 >>>>>>>>>>>>>>> Blog: http://miyurublog.blogspot.com >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> -- >>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>> Miyuru Dayarathna >>>>>>>>>>>>>> Senior Technical Lead >>>>>>>>>>>>>> Mobile: +94713527783 >>>>>>>>>>>>>> Blog: http://miyurublog.blogspot.com >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> Thanks & Best Regards, >>>>>>>>>>>>> *Praneesha Chandrasiri* >>>>>>>>>>>>> *Technical Writer* >>>>>>>>>>>>> *WSO2 Inc. * >>>>>>>>>>>>> *Mobile: +(94) 718156888 <%2B%2894%29%20718156888>* >>>>>>>>>>>>> *E-mail: pranee...@wso2.com <pranee...@wso2.com>* >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> Thanks, >>>>>>>>>>>> Miyuru Dayarathna >>>>>>>>>>>> Senior Technical Lead >>>>>>>>>>>> Mobile: +94713527783 >>>>>>>>>>>> Blog: http://miyurublog.blogspot.com >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> Thanks & Best Regards, >>>>>>>>>>> *Praneesha Chandrasiri* >>>>>>>>>>> *Technical Writer* >>>>>>>>>>> *WSO2 Inc. * >>>>>>>>>>> *Mobile: +(94) 718156888 <%2B%2894%29%20718156888>* >>>>>>>>>>> *E-mail: pranee...@wso2.com <pranee...@wso2.com>* >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Thanks, >>>>>>>>>> Miyuru Dayarathna >>>>>>>>>> Senior Technical Lead >>>>>>>>>> Mobile: +94713527783 >>>>>>>>>> Blog: http://miyurublog.blogspot.com >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> *Lasantha Fernando* >>>>>>>>> Software Engineer - Data Technologies Team >>>>>>>>> WSO2 Inc. http://wso2.com >>>>>>>>> >>>>>>>>> email: lasan...@wso2.com >>>>>>>>> mobile: (+94) 71 5247551 >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Thanks, >>>>>>>> Miyuru Dayarathna >>>>>>>> Senior Technical Lead >>>>>>>> Mobile: +94713527783 >>>>>>>> Blog: http://miyurublog.blogspot.com >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> *Lasantha Fernando* >>>>>>> Software Engineer - Data Technologies Team >>>>>>> WSO2 Inc. http://wso2.com >>>>>>> >>>>>>> email: lasan...@wso2.com >>>>>>> mobile: (+94) 71 5247551 >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Architecture mailing list >>>>>>> Architecture@wso2.org >>>>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>>>> >>>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Thanks, >>>>> Miyuru Dayarathna >>>>> Senior Technical Lead >>>>> Mobile: +94713527783 >>>>> Blog: http://miyurublog.blogspot.com >>>>> >>>> >>>> >>>> >>>> -- >>>> Thanks, >>>> Miyuru Dayarathna >>>> Senior Technical Lead >>>> Mobile: +94713527783 >>>> Blog: http://miyurublog.blogspot.com >>>> >>> >>> >>> >>> -- >>> ============================ >>> Blog: http://srinathsview.blogspot.com twitter:@srinath_perera >>> Site: http://people.apache.org/~hemapani/ >>> Photos: http://www.flickr.com/photos/hemapani/ >>> Phone: 0772360902 >>> >> >> >> >> -- >> Thanks, >> Miyuru Dayarathna >> Senior Technical Lead >> Mobile: +94713527783 >> Blog: http://miyurublog.blogspot.com >> > > > > -- > Thanks, > Miyuru Dayarathna > Senior Technical Lead > Mobile: +94713527783 > Blog: http://miyurublog.blogspot.com >
_______________________________________________ Architecture mailing list Architecture@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
