Seigal selek...@yahoo.com
Sender: saurabh@gmail.com
Date: Sat, 1 Oct 2011 15:50:46
To: common-user@hadoop.apache.org
Reply-To: common-user@hadoop.apache.org
Subject: Re: incremental loads into hadoop
Hi Bejoy,
Thanks for the response.
While reading about Hadoop, I have come across
be
incrementally loaded and processed into Hadoop ?
Thank you,
Sam
--
If you reply to this email, your message will be added to the discussion
below:
http://lucene.472066.n3.nabble.com/incremental-loads-into-hadoop-tp3383949p3383949.html
To unsubscribe from
--
If you reply to this email, your message will be added to the discussion
below:
http://lucene.472066.n3.nabble.com/incremental-loads-into-hadoop-tp3383949p3383949.html
To unsubscribe from Lucene, click
herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro
@hadoop.apache.org
Subject: Re: incremental loads into hadoop
Hi Bejoy,
Thanks for the response.
While reading about Hadoop, I have come across threads where people
claim that Hadoop is not a good fit for a large amount of small files.
It is good for files that are gigabyes/petabytes in size.
If I am doing
Sam
Try looking into Flume if you need to load incremental data into hdfs
. If the source data is present on some JDBC compliant data bases then you
can use SQOOP to get in the data directly into hdfs or hive incrementally.
For Big Data Aggregation and Analytics Hadoop is definitely a good
Hi Bejoy,
Thanks for the response.
While reading about Hadoop, I have come across threads where people
claim that Hadoop is not a good fit for a large amount of small files.
It is good for files that are gigabyes/petabytes in size.
If I am doing incremental loads, let's say every hour. Do I
Hi,
I am relatively new to Hadoop and was wondering how to do incremental
loads into HDFS.
I have a continuous stream of data flowing into a service which is
writing to an OLTP store. Due to the high volume of data, we cannot do
aggregations on the OLTP store, since this starts affecting the
