ll-files-problem/
>
> http://blog.rapleaf.com/dev/2008/11/20/give-me-liberty-or-give-me-death-but-dont-give-me-small-files/
>
> In general, you would like your file sizes to be atleast of HDFS block
> size, most likely a small multiple of the block size. If you do find that
> you
are
running into the small files problem, there are other ways to get around like
bucketing.
Good luck!
Mark
----- Original Message -----
From: "Edward Capriolo"
To: user@hive.apache.org
Sent: Tuesday, June 19, 2012 11:12:48 AM
Subject: Re: Please HELP: HIVE alter table add new parti
You can not change the partition columns. I would use a dynamic
partition insert to select all the data from the original table into
the new table.
On 6/19/12, Tim Havens wrote:
> So...I have a table that has thousands of files, and Billions of rows
> related it.
>
> Lets make this a simple table
So...I have a table that has thousands of files, and Billions of rows
related it.
Lets make this a simple table:
CREATE TABLE test_table (
ts BIGINT,
exec_time DOUBLE,
domain_id BIGINT,
domain_name STRING,
)
PARTITIONED BY (logdate STRING, source STRING, datacenter STRING,
hostnam
