Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/6829#issuecomment-113656100
I see. So the Kafka is present only through the flume-kafka-source
http://mvnrepository.com/artifact/org.apache.flume.flume-ng-sources/flume-kafka-source/1.6.0
Furthermore this is not available for Flume 1.4.0 as kafka source was added
only in 1.6.0
So here are two questions
1. Do installations of Flume always have all the sources loaded? If not,
then its an incorrect assumption that Scala will always be present.
2. Even if 1 is true, we have to upgrade Flume in Spark Streaming to
version 1.6.0 for this to be feasible. That;s a whole different issue.
I dont know enough about Flume, but I will be very surprised if the kafka
source is always loaded in the classpath in all flume installations.
@harishreedharan please comment.
On Fri, Jun 19, 2015 at 2:50 PM, Sean Owen <notificati...@github.com> wrote:
> That looks like just the API module. I suspect it comes via the actual
> implementation such as in
> http://mvnrepository.com/artifact/org.apache.flume/flume-ng-sources/1.6.0
> but I don't know Flume well.
>
> â
> Reply to this email directly or view it on GitHub
> <https://github.com/apache/spark/pull/6829#issuecomment-113653289>.
>
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
