RE: drools on spark, how to reload rule file?

2016-04-18 Thread yaoxiaohua
the drools doc now. Best Regards, Evan From: Jason Nerothin [mailto:jasonnerot...@gmail.com] Sent: 2016年4月18日 21:42 To: yaoxiaohua Cc: user@spark.apache.org Subject: Re: drools on spark, how to reload rule file? The limitation is in the drools implementation. Changing a rule in a stateful

drools on spark, how to reload rule file?

2016-04-18 Thread yaoxiaohua
Hi bros, I am trying using drools on spark to parse log and do some rule match and derived some fields. Now I refer one blog on cloudera, http://blog.cloudera.com/blog/2015/11/how-to-build-a-complex-event-processin g-app-on-apache-spark-and-drools/

how to use custom properties in spark app

2016-04-05 Thread yaoxiaohua
Hi bro, I am new in spark application develop, I need develop two app running on spark cluster. Now I have some arguments for the application. I can pass them as the program arguments when spark-submit, I want to find a new way. I

what is the best practice to read configure file in spark streaming

2016-03-15 Thread yaoxiaohua
Hi guys, I'm using kafka+spark streaming do log analysis. Now my requirement is that the log alarm rules may change sometimes. Rules maybe like this: App=Hadoop,keywords=oom|Exception|error,threshold=10 The

Client session timed out, have not heard from server in

2015-12-22 Thread yaoxiaohua
Hi, I encounter a similar question, spark1.4 Master2 run some days , then give a timeout exception, then shutdown. I found a bug : https://issues.apache.org/jira/browse/SPARK-9629 INFO ClientCnxn: Client session timed out, have not heard from server in 40015ms for sessionid

RE: Client session timed out, have not heard from server in

2015-12-22 Thread yaoxiaohua
er process shut down. I don’t see any zookeeper timeout setting . Best From: Yash Sharma [mailto:yash...@gmail.com] Sent: 2015年12月22日 19:55 To: yaoxiaohua Cc: user@spark.apache.org Subject: Re: Client session timed out, have not heard from server in Hi Evan, SPARK-9629 referred to

spark master process shutdown for timeout

2015-12-16 Thread yaoxiaohua
Hi guys, I have two nodes used as spark master, spark1,spark2 Spark1.4.0 Jdk 1.7 sunjdk Now these days I found that spark2 master process may shutdown , I found that in log file: 15/12/17 13:09:58 INFO ClientCnxn: Client session timed out, have not heard from server in