Sure, Thanks Tathagata!
bit1...@163.com
From: Tathagata Das
Date: 2015-02-26 14:47
To: bit1...@163.com
CC: Akhil Das; user
Subject: Re: Re: Many Receiver vs. Many threads per Receiver
Spark Streaming has a new Kafka direct stream, to be release as experimental
feature with 1.3. That uses
...@sigmoidanalytics.com; user user@spark.apache.org
*Subject:* Re: Re: Many Receiver vs. Many threads per Receiver
Spark Streaming has a new Kafka direct stream, to be release as
experimental feature with 1.3. That uses a low level consumer. Not sure if
it satisfies your purpose.
If you want more
.
--
bit1...@163.com
*From:* Akhil Das ak...@sigmoidanalytics.com
*Date:* 2015-02-24 16:21
*To:* bit1...@163.com
*CC:* user user@spark.apache.org
*Subject:* Re: Many Receiver vs. Many threads per Receiver
I believe when you go with 1, it will distribute the consumer across your
Receiver vs. Many threads per Receiver
I believe when you go with 1, it will distribute the consumer across your
cluster (possibly on 6 machines), but still it i don't see a away to tell from
which partition it will consume etc. If you are looking to have a consumer
where you can specify
