Cleaning up files in HDFS?

Hi! We would like to run a delete script that deletes all files older than x days that are stored in lib l in hdfs, what is the best way of doing that? Regards Erik

Re: Cleaning up files in HDFS?

A Python script that queried HDFS through the command line (use hadoop fs -lsr) would definitely suffice. I don't know of any toolsets of frameworks for pruning HDFS, other than this: Alex On Fri, Nov 14, 2008 at 5:08 PM, Erik Holstad <[EMAIL PR

Re: Cleaning up files in HDFS?

From: Erik Holstad <[EMAIL PROTECTED]> To: core-user@hadoop.apache.org Sent: Friday, November 14, 2008 5:08:03 PM Subject: Cleaning up files in HDFS? Hi! We would like to run a delete script that deletes all files older than x days that are stored in lib l in hdfs, what is the best way of doin

RE: Cleaning up files in HDFS?

-user@hadoop.apache.org Subject: Re: Cleaning up files in HDFS? Have you tried fs.trash.interval fs.trash.interval 0 Number of minutes between trash checkpoints. If zero, the trash feature is disabled. more info about trash feature here. http://hadoop.apache.org/core/docs/cu

Re: Cleaning up files in HDFS?

gt; > Thanks, > Lohit > > - Original Message > From: Erik Holstad <[EMAIL PROTECTED]> > To: core-user@hadoop.apache.org > Sent: Friday, November 14, 2008 5:08:03 PM > Subject: Cleaning up files in HDFS? > > Hi! > We would like to run a delete script t