bject: Re: What is the best way to write Kafka data into HDFS?
Check out Kafka Connect:
http://www.confluent.io/blog/how-to-build-a-scalable-etl-pipeline-with-kafka-connect
-Jay
On Wed, Feb 10, 2016 at 5:09 PM, R P wrote:
> Hello All,
> New Kafka user here. What is the best way to write
Check out Kafka Connect:
http://www.confluent.io/blog/how-to-build-a-scalable-etl-pipeline-with-kafka-connect
-Jay
On Wed, Feb 10, 2016 at 5:09 PM, R P wrote:
> Hello All,
> New Kafka user here. What is the best way to write Kafka data into HDFS?
> I have looked into following op
May be you can try Apache NiFi its quicker as well. Give a try good luck
-Original Message-
From: R P [mailto:hadoo...@outlook.com]
Sent: 11 February 2016 16:09
To: users@kafka.apache.org
Subject: Re: What is the best way to write Kafka data into HDFS?
Hello Steve, Thanks for the
Steve Morin
Sent: Wednesday, February 10, 2016 6:36 PM
To: users@kafka.apache.org
Subject: Re: What is the best way to write Kafka data into HDFS?
R P, happy to walk you through https://github.com/DemandCube/Scribengin if
your interested
On Wed, Feb 10, 2016 at 5:09 PM, R P wrote:
> Hello
-Adam
On Wed, Feb 10, 2016 at 5:09 PM, R P wrote:
> Hello All,
> New Kafka user here. What is the best way to write Kafka data into HDFS?
> I have looked into following options and found that Flume is quickest and
> easiest to setup.
>
> 1. Flume
> 2. KaBoom
>
R P, happy to walk you through https://github.com/DemandCube/Scribengin if
your interested
On Wed, Feb 10, 2016 at 5:09 PM, R P wrote:
> Hello All,
> New Kafka user here. What is the best way to write Kafka data into HDFS?
> I have looked into following options and found that
Hello All,
New Kafka user here. What is the best way to write Kafka data into HDFS?
I have looked into following options and found that Flume is quickest and
easiest to setup.
1. Flume
2. KaBoom
3. Kafka Hadoop Loader
4. Camus -> Gobblin
Although Flume can result into small file problems w
