Re: Reading kafka stream and writing to hdfs

[Akhil Das]

Like:

counts.saveAsTestFiles("hdfs://host:port/some/location")


Thanks
Best Regards

On Tue, Sep 29, 2015 at 2:15 AM, Chengi Liu  wrote:

> Hi,
>   I am going thru this example here:
>
> https://github.com/apache/spark/blob/master/examples/src/main/python/streaming/kafka_wordcount.py
> If I want to write this data on hdfs.
> Whats the right way to do this?
> Thanks
>

Reading kafka stream and writing to hdfs

[Chengi Liu]

Hi,
  I am going thru this example here:
https://github.com/apache/spark/blob/master/examples/src/main/python/streaming/kafka_wordcount.py
If I want to write this data on hdfs.
Whats the right way to do this?
Thanks