回复:Structured Streaming with Kafka source,, does it work??????

2016-11-06 Thread (木艮)
docs:  https://github.com/apache/spark/blob/master/docs/structured-streaming-kafka-integration.md--发件人:shyla deshpande 发送时间:2016年11月7日(星期一) 09:15收件人:user 主 题:Structured Streaming with Kafka source,, does it work?? I am trying to

many fetch failure in "BlockManager"

2014-08-25 Thread
*HI ALL:* *My job is cpu intensive, and its resource configuration is 400 worker * 1 core * 3G. There are many fetch failure, like:* 14-08-23 08:34:52 WARN [Result resolver thread-3] TaskSetManager: Loss was due to fetch failure from BlockManagerId(slave1:33500) 14-08-23 08:34:52 INFO [spark-

答复: LiveListenerBus throws exception and weird web UI bug

2014-07-21 Thread (木艮)
Hi all, Here is my fix https://github.com/apache/spark/pull/1356, although not handsome, but work well. Any Suggestions? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/LiveListenerBus-throws-exception-and-weird-web-UI-bug-tp8330p10324.html Sen