RE: set reduced block size for a specific file

2011-08-30 Thread Ben Clay
Ben Clay rbc...@ncsu.edu -Original Message- From: Todd Lipcon [mailto:t...@cloudera.com] Sent: Tuesday, August 30, 2011 10:45 AM To: hdfs-user@hadoop.apache.org Subject: Re: set reduced block size for a specific file 0.21 has some bugs with config option deprecation that you're running

Re: set reduced block size for a specific file

2011-08-27 Thread Ted Dunning
- Original Message - From: Ben Clay rbc...@ncsu.edu Date: Saturday, August 27, 2011 10:03 pm Subject: set reduced block size for a specific file To: hdfs-user@hadoop.apache.org I'd like to set a lowered block size for a specific file. IE, if HDFS is configured to use 64mb blocks, I'd like

Re: set reduced block size for a specific file

2011-08-27 Thread Allen Wittenauer
On Aug 27, 2011, at 12:42 PM, Ted Dunning wrote: There is no way to do this for standard Apache Hadoop. Sure there is. You can build a custom conf dir and point it to that. You *always* have that option for client settable options as a work around for lack of features/bugs.

RE: set reduced block size for a specific file

2011-08-27 Thread Ben Clay
I didn't even think of overriding the config dir. Thanks for the tip! -Ben -Original Message- From: Allen Wittenauer [mailto:a...@apache.org] Sent: Saturday, August 27, 2011 6:42 PM To: hdfs-user@hadoop.apache.org Cc: rbc...@ncsu.edu Subject: Re: set reduced block size for a specific

Re: set reduced block size for a specific file

2011-08-27 Thread Aaron T. Myers
...@ncsu.edu wrote: I didn't even think of overriding the config dir. Thanks for the tip! -Ben -Original Message- From: Allen Wittenauer [mailto:a...@apache.org] Sent: Saturday, August 27, 2011 6:42 PM To: hdfs-user@hadoop.apache.org Cc: rbc...@ncsu.edu Subject: Re: set reduced block

Re: set reduced block size for a specific file

2011-08-27 Thread Praveen Sripati
! -Ben -Original Message- From: Allen Wittenauer [mailto:a...@apache.org] Sent: Saturday, August 27, 2011 6:42 PM To: hdfs-user@hadoop.apache.org Cc: rbc...@ncsu.edu Subject: Re: set reduced block size for a specific file On Aug 27, 2011, at 12:42 PM, Ted Dunning wrote