http://docs.amazonwebservices.com/ElasticMapReduce/latest/DeveloperGuide/UsingEMR_s3distcp.html
On Fri, Jun 8, 2012 at 4:40 AM, James Newhaven <james.newha...@gmail.com>wrote: > I want to copy 26,000 HDFS files generated by a pig script to Amazon S3. > > I am using the copyToLocal command, but I noticed the copy throughput is > only one file per second - so it is going to take about 7 hours to copy all > the files. > > The command I am using is: copyToLocal /tmp/files/ s3://my-bucket/ > > Does anyone have any ideas how I could speed this up? > > Thanks, > James > -- "...:::Aniket:::... Quetzalco@tl"
