Author: gates Date: Fri Jul 31 18:49:21 2009 New Revision: 799694 URL: http://svn.apache.org/viewvc?rev=799694&view=rev Log: PIG-878: Pig is returning too many blocks in the input split. (arunc via gates).
Modified: hadoop/pig/branches/branch-0.3/CHANGES.txt hadoop/pig/branches/branch-0.3/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java Modified: hadoop/pig/branches/branch-0.3/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/pig/branches/branch-0.3/CHANGES.txt?rev=799694&r1=799693&r2=799694&view=diff ============================================================================== --- hadoop/pig/branches/branch-0.3/CHANGES.txt (original) +++ hadoop/pig/branches/branch-0.3/CHANGES.txt Fri Jul 31 18:49:21 2009 @@ -20,6 +20,10 @@ Pig Change Log +BUG FIXES + +PIG-878: Pig is returning too many blocks in the input split. (arunc via gates). + Release 0.3.0 - 06/16/09 INCOMPATIBLE CHANGES Modified: hadoop/pig/branches/branch-0.3/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java URL: http://svn.apache.org/viewvc/hadoop/pig/branches/branch-0.3/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java?rev=799694&r1=799693&r2=799694&view=diff ============================================================================== --- hadoop/pig/branches/branch-0.3/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java (original) +++ hadoop/pig/branches/branch-0.3/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java Fri Jul 31 18:49:21 2009 @@ -92,7 +92,7 @@ for (String loc : wrapped.getLocations()) { Path path = new Path(loc); FileStatus status = fs.getFileStatus(path); - BlockLocation[] b = fs.getFileBlockLocations(status, 0, status.getLen()); + BlockLocation[] b = fs.getFileBlockLocations(status, wrapped.getStart(), wrapped.getLength()); int total = 0; for (int i = 0; i < b.length; i++) { total += b[i].getHosts().length;