Re: Re: Re: spark2.1 kafka0.10

2017-06-22 Thread lk_spark
thank you Kumar , I will try it later. 2017-06-22 lk_spark 发件人:Pralabh Kumar 发送时间:2017-06-22 20:20 主题:Re: Re: spark2.1 kafka0.10 收件人:"lk_spark" 抄送:"user.spark" It looks like your replicas for partition are getting failed. If u have more brokers , can u try increasin

Re: Re: spark2.1 kafka0.10

2017-06-21 Thread Pralabh Kumar
017-06-22 > -- > lk_spark > -- > > *发件人:*Pralabh Kumar > *发送时间:*2017-06-22 17:23 > *主题:*Re: spark2.1 kafka0.10 > *收件人:*"lk_spark" > *抄送:*"user.spark" > > How many replicas ,you have for thi

Re: Re: spark2.1 kafka0.10

2017-06-21 Thread lk_spark
each topic have 5 partition , 2 replicas . 2017-06-22 lk_spark 发件人:Pralabh Kumar 发送时间:2017-06-22 17:23 主题:Re: spark2.1 kafka0.10 收件人:"lk_spark" 抄送:"user.spark" How many replicas ,you have for this topic . On Thu, Jun 22, 2017 at 9:19

Re: spark2.1 kafka0.10

2017-06-21 Thread Pralabh Kumar
ming.scheduler.JobGenerator$$anon$ > 1.onReceive(JobGenerator.scala:89) > at org.apache.spark.streaming.scheduler.JobGenerator$$anon$ > 1.onReceive(JobGenerator.scala:88) > at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48) > > 2017-06-22 > -- > lk_spark &g

Re: spark2.1 kafka0.10

2017-06-21 Thread lk_spark
org.apache.spark.streaming.scheduler.JobGenerator$$anon$1.onReceive(JobGenerator.scala:88) at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48) 2017-06-22 lk_spark 发件人:"lk_spark" 发送时间:2017-06-22 11:13 主题:spark2.1 kafka0.10 收件人:"user.spark" 抄送: hi,all: when I run stream application for a few minut

spark2.1 kafka0.10

2017-06-21 Thread lk_spark
hi,all: when I run stream application for a few minutes ,I got this error : 17/06/22 10:34:56 INFO ConsumerCoordinator: Revoking previously assigned partitions [comment-0, profile-1, profile-3, cwb-3, bizs-1, cwb-1, weibocomment-0, bizs-2, pages-0, bizs-4, pages-2, weibo-0, pages-4, weibo-4,