Unnecessary file copying during the bulkload: should we backport the fix in 0.96?

In HBase 0.94, bulkload would always copy the files: // Move the file if it's on another filesystem FileSystem srcFs = srcPath.getFileSystem(conf); if (!srcFs.equals(fs)) { LOG.info("File " + srcPath + " on different filesystem than " + "destination store - moving to this filesystem.");

Re: Unnecessary file copying during the bulkload: should we backport the fix in 0.96?

On Thu, Sep 6, 2012 at 5:30 PM, pig user wrote: > In HBase 0.94, bulkload would always copy the files: > > // Move the file if it's on another filesystem > FileSystem srcFs = srcPath.getFileSystem(conf); > if (!srcFs.equals(fs)) { >LOG.info("File " + srcPath + " on different filesystem than "

Re: Unnecessary file copying during the bulkload: should we backport the fix in 0.96?

The fix, HBASE-6529, would be in 0.94.2 Expect 0.94.2 RC0 next week. Thanks On Thu, Sep 6, 2012 at 5:30 PM, pig user wrote: > In HBase 0.94, bulkload would always copy the files: > > // Move the file if it's on another filesystem > FileSystem srcFs = srcPath.getFileSystem(conf); > if (!srcFs.e

Re: Unnecessary file copying during the bulkload: should we backport the fix in 0.96?

Thanks Ted. It's great that the fix is already backported. On Thu, Sep 6, 2012 at 7:19 PM, Ted Yu wrote: > The fix, HBASE-6529, would be in 0.94.2 > > Expect 0.94.2 RC0 next week. > > Thanks > > On Thu, Sep 6, 2012 at 5:30 PM, pig user wrote: > >> In HBase 0.94, bulkload would always copy the fi