[jira] [Commented] (HADOOP-9124) SortedMapWritable violates contract of Map interface for equals() and hashCode()

2013-02-02 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569501#comment-13569501
 ] 

Hudson commented on HADOOP-9124:


Integrated in Hadoop-Yarn-trunk #115 (See 
[https://builds.apache.org/job/Hadoop-Yarn-trunk/115/])
HADOOP-9124. SortedMapWritable violates contract of Map interface for 
equals() and hashCode(). Contributed by Surenkumar Nihalani (Revision 1441475)

 Result = SUCCESS
tomwhite : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1441475
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/SortedMapWritable.java
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/TestSortedMapWritable.java


 SortedMapWritable violates contract of Map interface for equals() and 
 hashCode()
 

 Key: HADOOP-9124
 URL: https://issues.apache.org/jira/browse/HADOOP-9124
 Project: Hadoop Common
  Issue Type: Bug
  Components: io
Affects Versions: 1.1.1, 2.0.2-alpha
Reporter: Patrick Hunt
Assignee: Surenkumar Nihalani
Priority: Minor
 Fix For: 2.0.3-alpha, 0.23.7

 Attachments: hadoop-9124-branch1.patch, HADOOP-9124.patch, 
 HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, 
 HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, 
 HADOOP-9124.patch


 This issue is similar to HADOOP-7153. It was found when using MRUnit - see 
 MRUNIT-158, specifically 
 https://issues.apache.org/jira/browse/MRUNIT-158?focusedCommentId=13501985page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13501985
 --
 o.a.h.io.SortedMapWritable implements the java.util.Map interface, however it 
 does not define an implementation of the equals() or hashCode() methods; 
 instead the default implementations in java.lang.Object are used.
 This violates the contract of the Map interface which defines different 
 behaviour for equals() and hashCode() than Object does. More information 
 here: 
 http://download.oracle.com/javase/6/docs/api/java/util/Map.html#equals(java.lang.Object)
 The practical consequence is that SortedMapWritables containing equal entries 
 cannot be compared properly. We were bitten by this when trying to write an 
 MRUnit test for a Mapper that outputs MapWritables; the MRUnit driver cannot 
 test the equality of the expected and actual MapWritable objects.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9067) provide test for method org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, FSDataInputStream, long, FSDataInputStream, long)

2013-02-02 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569502#comment-13569502
 ] 

Hudson commented on HADOOP-9067:


Integrated in Hadoop-Yarn-trunk #115 (See 
[https://builds.apache.org/job/Hadoop-Yarn-trunk/115/])
HADOOP-9067. provide test for LocalFileSystem.reportChecksumFailure (Ivan 
A. Veselovsky via bobby) (Revision 1441628)

 Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1441628
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestLocalFileSystem.java


 provide test for method 
 org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, 
 FSDataInputStream, long, FSDataInputStream, long)
 --

 Key: HADOOP-9067
 URL: https://issues.apache.org/jira/browse/HADOOP-9067
 Project: Hadoop Common
  Issue Type: Test
Reporter: Ivan A. Veselovsky
Assignee: Ivan A. Veselovsky
Priority: Minor
 Fix For: 3.0.0, 2.0.3-alpha, 0.23.7

 Attachments: HADOOP-9067--b.patch, HADOOP-9067.patch


 this method is not covered by the existing unit tests. Provide a test to 
 cover it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-8214) make hadoop script recognize a full set of deprecated commands

2013-02-02 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569521#comment-13569521
 ] 

Hudson commented on HADOOP-8214:


Integrated in Hadoop-Hdfs-0.23-Build #513 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/513/])
HADOOP-8214. make hadoop script recognize a full set of deprecated 
commands(rvs via tgraves) (Revision 1441502)

 Result = SUCCESS
tgraves : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1441502
Files : 
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop


 make hadoop script recognize a full set of deprecated commands
 --

 Key: HADOOP-8214
 URL: https://issues.apache.org/jira/browse/HADOOP-8214
 Project: Hadoop Common
  Issue Type: Improvement
  Components: scripts
Affects Versions: 0.23.1
Reporter: Roman Shaposhnik
Assignee: Roman Shaposhnik
 Fix For: 2.0.0-alpha, 0.23.7

 Attachments: HADOOP-8214.patch.txt


 bin/hadoop launcher script does a nice job of recognizing deprecated usage 
 and vectoring users towards the proper command line tools (hdfs, mapred). It 
 would be nice if we can take care of the following deprecated commands that 
 don't get the same special treatment:
 {noformat}
   oiv  apply the offline fsimage viewer to an fsimage
   dfsgroupsget the groups which users belong to on the Name Node
   mrgroups get the groups which users belong to on the Job Tracker
   mradmin  run a Map-Reduce admin client
   jobtracker   run the MapReduce job Tracker node
   tasktracker  run a MapReduce task Tracker node
 {noformat}
 Here's what I propos to do with them:
   # oiv-- issue DEPRECATED warning and run hdfs oiv
   # dfsgroups  -- issue DEPRECATED warning and run hdfs groups
   # mrgroups   -- issue DEPRECATED warning and run mapred groups
   # mradmin-- issue DEPRECATED warning and run yarn rmadmin
   # jobtracker -- issue DEPRECATED warning and do nothing
   # tasktracker-- issue DEPRECATED warning and do nothing
 Thoughts?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9231) Parametrize staging URL for the uniformity of distributionManagement

2013-02-02 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569522#comment-13569522
 ] 

Hudson commented on HADOOP-9231:


Integrated in Hadoop-Hdfs-0.23-Build #513 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/513/])
HADOOP-9231. Parametrize staging URL for the uniformity of 
distributionManagement. (Konstantin Boudnik via tgraves) (Revision 1441569)

 Result = SUCCESS
tgraves : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1441569
Files : 
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/pom.xml


 Parametrize staging URL for the uniformity of distributionManagement
 

 Key: HADOOP-9231
 URL: https://issues.apache.org/jira/browse/HADOOP-9231
 Project: Hadoop Common
  Issue Type: Bug
  Components: build
Affects Versions: 3.0.0, 2.0.3-alpha
Reporter: Konstantin Boudnik
Assignee: Konstantin Boudnik
 Fix For: 2.0.3-alpha, 0.23.7

 Attachments: HADOOP-9231.patch, HADOOP-9231.patch


 The build's {{distributionManagement}} section currently uses parametrization 
 for the snapshot repository. It is convenient and allows to override the 
 value from a developer's custom profile.
 The same isn't available for release artifacts to make the parametrization 
 symmetric for both types.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9124) SortedMapWritable violates contract of Map interface for equals() and hashCode()

2013-02-02 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569520#comment-13569520
 ] 

Hudson commented on HADOOP-9124:


Integrated in Hadoop-Hdfs-0.23-Build #513 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/513/])
HADOOP-9124. SortedMapWritable violates contract of Map interface for 
equals() and hashCode(). (Surenkumar Nihalani via tgraves) (Revision 1441575)

 Result = SUCCESS
tgraves : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1441575
Files : 
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/SortedMapWritable.java
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/TestSortedMapWritable.java


 SortedMapWritable violates contract of Map interface for equals() and 
 hashCode()
 

 Key: HADOOP-9124
 URL: https://issues.apache.org/jira/browse/HADOOP-9124
 Project: Hadoop Common
  Issue Type: Bug
  Components: io
Affects Versions: 1.1.1, 2.0.2-alpha
Reporter: Patrick Hunt
Assignee: Surenkumar Nihalani
Priority: Minor
 Fix For: 2.0.3-alpha, 0.23.7

 Attachments: hadoop-9124-branch1.patch, HADOOP-9124.patch, 
 HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, 
 HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, 
 HADOOP-9124.patch


 This issue is similar to HADOOP-7153. It was found when using MRUnit - see 
 MRUNIT-158, specifically 
 https://issues.apache.org/jira/browse/MRUNIT-158?focusedCommentId=13501985page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13501985
 --
 o.a.h.io.SortedMapWritable implements the java.util.Map interface, however it 
 does not define an implementation of the equals() or hashCode() methods; 
 instead the default implementations in java.lang.Object are used.
 This violates the contract of the Map interface which defines different 
 behaviour for equals() and hashCode() than Object does. More information 
 here: 
 http://download.oracle.com/javase/6/docs/api/java/util/Map.html#equals(java.lang.Object)
 The practical consequence is that SortedMapWritables containing equal entries 
 cannot be compared properly. We were bitten by this when trying to write an 
 MRUnit test for a Mapper that outputs MapWritables; the MRUnit driver cannot 
 test the equality of the expected and actual MapWritable objects.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9067) provide test for method org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, FSDataInputStream, long, FSDataInputStream, long)

2013-02-02 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569523#comment-13569523
 ] 

Hudson commented on HADOOP-9067:


Integrated in Hadoop-Hdfs-0.23-Build #513 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/513/])
svn merge -c 1441628 FIXES: HADOOP-9067. provide test for 
LocalFileSystem.reportChecksumFailure (Ivan A. Veselovsky via bobby) (Revision 
1441638)

 Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1441638
Files : 
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestLocalFileSystem.java


 provide test for method 
 org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, 
 FSDataInputStream, long, FSDataInputStream, long)
 --

 Key: HADOOP-9067
 URL: https://issues.apache.org/jira/browse/HADOOP-9067
 Project: Hadoop Common
  Issue Type: Test
Reporter: Ivan A. Veselovsky
Assignee: Ivan A. Veselovsky
Priority: Minor
 Fix For: 3.0.0, 2.0.3-alpha, 0.23.7

 Attachments: HADOOP-9067--b.patch, HADOOP-9067.patch


 this method is not covered by the existing unit tests. Provide a test to 
 cover it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9193) hadoop script can inadvertently expand wildcard arguments when delegating to hdfs script

2013-02-02 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569525#comment-13569525
 ] 

Hudson commented on HADOOP-9193:


Integrated in Hadoop-Hdfs-0.23-Build #513 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/513/])
HADOOP-9193. hadoop script can inadvertently expand wildcard arguments when 
delegating to hdfs script. (Andy Isaacson via tgraves) (Revision 1441499)

 Result = SUCCESS
tgraves : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1441499
Files : 
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop


 hadoop script can inadvertently expand wildcard arguments when delegating to 
 hdfs script
 

 Key: HADOOP-9193
 URL: https://issues.apache.org/jira/browse/HADOOP-9193
 Project: Hadoop Common
  Issue Type: Bug
  Components: scripts
Affects Versions: 2.0.2-alpha, 0.23.5
Reporter: Jason Lowe
Assignee: Andy Isaacson
Priority: Minor
 Fix For: 3.0.0, 2.0.3-alpha, 0.23.7

 Attachments: hadoop9193.diff


 The hadoop front-end script will print a deprecation warning and defer to the 
 hdfs front-end script for certain commands, like fsck, dfs.  If a wildcard 
 appears as an argument then it can be inadvertently expanded by the shell to 
 match a local filesystem path before being sent to the hdfs script, which can 
 be very confusing to the end user.
 For example, the following two commands usually perform very different 
 things, even though they should be equivalent:
 {code}
 hadoop fs -ls /tmp/\*
 hadoop dfs -ls /tmp/\*
 {code}
 The former lists everything in the default filesystem under /tmp, while the 
 latter expands /tmp/\* into everything in the *local* filesystem under /tmp 
 and passes those as arguments to try to list in the default filesystem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9124) SortedMapWritable violates contract of Map interface for equals() and hashCode()

2013-02-02 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569536#comment-13569536
 ] 

Hudson commented on HADOOP-9124:


Integrated in Hadoop-Hdfs-trunk #1304 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1304/])
HADOOP-9124. SortedMapWritable violates contract of Map interface for 
equals() and hashCode(). Contributed by Surenkumar Nihalani (Revision 1441475)

 Result = SUCCESS
tomwhite : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1441475
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/SortedMapWritable.java
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/TestSortedMapWritable.java


 SortedMapWritable violates contract of Map interface for equals() and 
 hashCode()
 

 Key: HADOOP-9124
 URL: https://issues.apache.org/jira/browse/HADOOP-9124
 Project: Hadoop Common
  Issue Type: Bug
  Components: io
Affects Versions: 1.1.1, 2.0.2-alpha
Reporter: Patrick Hunt
Assignee: Surenkumar Nihalani
Priority: Minor
 Fix For: 2.0.3-alpha, 0.23.7

 Attachments: hadoop-9124-branch1.patch, HADOOP-9124.patch, 
 HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, 
 HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, 
 HADOOP-9124.patch


 This issue is similar to HADOOP-7153. It was found when using MRUnit - see 
 MRUNIT-158, specifically 
 https://issues.apache.org/jira/browse/MRUNIT-158?focusedCommentId=13501985page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13501985
 --
 o.a.h.io.SortedMapWritable implements the java.util.Map interface, however it 
 does not define an implementation of the equals() or hashCode() methods; 
 instead the default implementations in java.lang.Object are used.
 This violates the contract of the Map interface which defines different 
 behaviour for equals() and hashCode() than Object does. More information 
 here: 
 http://download.oracle.com/javase/6/docs/api/java/util/Map.html#equals(java.lang.Object)
 The practical consequence is that SortedMapWritables containing equal entries 
 cannot be compared properly. We were bitten by this when trying to write an 
 MRUnit test for a Mapper that outputs MapWritables; the MRUnit driver cannot 
 test the equality of the expected and actual MapWritable objects.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9067) provide test for method org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, FSDataInputStream, long, FSDataInputStream, long)

2013-02-02 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569537#comment-13569537
 ] 

Hudson commented on HADOOP-9067:


Integrated in Hadoop-Hdfs-trunk #1304 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1304/])
HADOOP-9067. provide test for LocalFileSystem.reportChecksumFailure (Ivan 
A. Veselovsky via bobby) (Revision 1441628)

 Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1441628
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestLocalFileSystem.java


 provide test for method 
 org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, 
 FSDataInputStream, long, FSDataInputStream, long)
 --

 Key: HADOOP-9067
 URL: https://issues.apache.org/jira/browse/HADOOP-9067
 Project: Hadoop Common
  Issue Type: Test
Reporter: Ivan A. Veselovsky
Assignee: Ivan A. Veselovsky
Priority: Minor
 Fix For: 3.0.0, 2.0.3-alpha, 0.23.7

 Attachments: HADOOP-9067--b.patch, HADOOP-9067.patch


 this method is not covered by the existing unit tests. Provide a test to 
 cover it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9124) SortedMapWritable violates contract of Map interface for equals() and hashCode()

2013-02-02 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569553#comment-13569553
 ] 

Hudson commented on HADOOP-9124:


Integrated in Hadoop-Mapreduce-trunk #1332 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1332/])
HADOOP-9124. SortedMapWritable violates contract of Map interface for 
equals() and hashCode(). Contributed by Surenkumar Nihalani (Revision 1441475)

 Result = SUCCESS
tomwhite : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1441475
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/SortedMapWritable.java
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/TestSortedMapWritable.java


 SortedMapWritable violates contract of Map interface for equals() and 
 hashCode()
 

 Key: HADOOP-9124
 URL: https://issues.apache.org/jira/browse/HADOOP-9124
 Project: Hadoop Common
  Issue Type: Bug
  Components: io
Affects Versions: 1.1.1, 2.0.2-alpha
Reporter: Patrick Hunt
Assignee: Surenkumar Nihalani
Priority: Minor
 Fix For: 2.0.3-alpha, 0.23.7

 Attachments: hadoop-9124-branch1.patch, HADOOP-9124.patch, 
 HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, 
 HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, HADOOP-9124.patch, 
 HADOOP-9124.patch


 This issue is similar to HADOOP-7153. It was found when using MRUnit - see 
 MRUNIT-158, specifically 
 https://issues.apache.org/jira/browse/MRUNIT-158?focusedCommentId=13501985page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13501985
 --
 o.a.h.io.SortedMapWritable implements the java.util.Map interface, however it 
 does not define an implementation of the equals() or hashCode() methods; 
 instead the default implementations in java.lang.Object are used.
 This violates the contract of the Map interface which defines different 
 behaviour for equals() and hashCode() than Object does. More information 
 here: 
 http://download.oracle.com/javase/6/docs/api/java/util/Map.html#equals(java.lang.Object)
 The practical consequence is that SortedMapWritables containing equal entries 
 cannot be compared properly. We were bitten by this when trying to write an 
 MRUnit test for a Mapper that outputs MapWritables; the MRUnit driver cannot 
 test the equality of the expected and actual MapWritable objects.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9067) provide test for method org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, FSDataInputStream, long, FSDataInputStream, long)

2013-02-02 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569554#comment-13569554
 ] 

Hudson commented on HADOOP-9067:


Integrated in Hadoop-Mapreduce-trunk #1332 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1332/])
HADOOP-9067. provide test for LocalFileSystem.reportChecksumFailure (Ivan 
A. Veselovsky via bobby) (Revision 1441628)

 Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1441628
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestLocalFileSystem.java


 provide test for method 
 org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, 
 FSDataInputStream, long, FSDataInputStream, long)
 --

 Key: HADOOP-9067
 URL: https://issues.apache.org/jira/browse/HADOOP-9067
 Project: Hadoop Common
  Issue Type: Test
Reporter: Ivan A. Veselovsky
Assignee: Ivan A. Veselovsky
Priority: Minor
 Fix For: 3.0.0, 2.0.3-alpha, 0.23.7

 Attachments: HADOOP-9067--b.patch, HADOOP-9067.patch


 this method is not covered by the existing unit tests. Provide a test to 
 cover it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9252) StringUtils.limitDecimalTo2(..) is unnecessarily synchronized

2013-02-02 Thread Tsz Wo (Nicholas), SZE (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569626#comment-13569626
 ] 

Tsz Wo (Nicholas), SZE commented on HADOOP-9252:


Chris, thanks for checking the tests.  Before the patch, the methods 
humanReadableInt and limitDecimalTo2 are very similar but they have minor 
difference such as one uses upper case 'M' and the other uses lower cases 'm'.  
Let's decide the best format here and then change the individual tests 
accordingly (and in separated JIRAs.)

In the patch, I choose uppercase letter for the prefix K, M, G, T, P, E since 
it seems a standard according to http://en.wikipedia.org/wiki/Binary_prefix .  
Then, I put a space between the number and the prefix; otherwise, values like 
2.091MB seem not very readable.  I don't really have a strong preference 
about the space.  What do you think?

 StringUtils.limitDecimalTo2(..) is unnecessarily synchronized
 -

 Key: HADOOP-9252
 URL: https://issues.apache.org/jira/browse/HADOOP-9252
 Project: Hadoop Common
  Issue Type: Improvement
  Components: util
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Tsz Wo (Nicholas), SZE
Priority: Minor
 Attachments: c9252_20130127.patch, c9252_20130128.patch


 limitDecimalTo2(double) currently uses decimalFormat, which is a static 
 field, so that it is synchronized.  Synchronization is unnecessary since it 
 can simply uses String.format(..).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9271) revert Python build scripts from branch-trunk-win

2013-02-02 Thread Suresh Srinivas (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569647#comment-13569647
 ] 

Suresh Srinivas commented on HADOOP-9271:
-

Thanks for the explanation. I compared the changed files with the counterparts 
in trunk and saw only the changes of nature you have described above. +1 for 
the patch.

 revert Python build scripts from branch-trunk-win
 -

 Key: HADOOP-9271
 URL: https://issues.apache.org/jira/browse/HADOOP-9271
 Project: Hadoop Common
  Issue Type: Bug
  Components: build
Affects Versions: trunk-win
Reporter: Chris Nauroth
Assignee: Chris Nauroth
 Attachments: HADOOP-9271-branch-trunk-win.1.patch


 On branch-trunk-win, some work was committed to convert custom build 
 scripting to Python as a cross-platform solution to support builds on both 
 Linux and Windows.  The community has since rejected this solution.  This 
 issue tracks removal of the Python build code from branch-trunk-win.
 This will restore branch-trunk-win to the same state as trunk, which uses 
 shell for custom build scripting.  This means that developers working on 
 branch-trunk-win will once again need sh.exe on the PATH to build the 
 distribution.  This will be a temporary state.  A subsequent jira will add 
 build scripts specific to Windows, using a language more common in a Windows 
 development environment.  The community has approved minimal use of multiple 
 platform-specific scripting languages.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Resolved] (HADOOP-9271) revert Python build scripts from branch-trunk-win

2013-02-02 Thread Suresh Srinivas (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suresh Srinivas resolved HADOOP-9271.
-

   Resolution: Fixed
Fix Version/s: trunk-win
 Hadoop Flags: Reviewed

I committed the patch to branch-trunk-win.

Thank you Chris!

 revert Python build scripts from branch-trunk-win
 -

 Key: HADOOP-9271
 URL: https://issues.apache.org/jira/browse/HADOOP-9271
 Project: Hadoop Common
  Issue Type: Bug
  Components: build
Affects Versions: trunk-win
Reporter: Chris Nauroth
Assignee: Chris Nauroth
 Fix For: trunk-win

 Attachments: HADOOP-9271-branch-trunk-win.1.patch


 On branch-trunk-win, some work was committed to convert custom build 
 scripting to Python as a cross-platform solution to support builds on both 
 Linux and Windows.  The community has since rejected this solution.  This 
 issue tracks removal of the Python build code from branch-trunk-win.
 This will restore branch-trunk-win to the same state as trunk, which uses 
 shell for custom build scripting.  This means that developers working on 
 branch-trunk-win will once again need sh.exe on the PATH to build the 
 distribution.  This will be a temporary state.  A subsequent jira will add 
 build scripts specific to Windows, using a language more common in a Windows 
 development environment.  The community has approved minimal use of multiple 
 platform-specific scripting languages.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HADOOP-9253) Capture ulimit info in the logs at service start time

2013-02-02 Thread Suresh Srinivas (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569661#comment-13569661
 ] 

Suresh Srinivas commented on HADOOP-9253:
-

Folks, any further comments?

I am +1 for this patch. I will commit this by next Monday/Tuesday, if there are 
no further comments.

 Capture ulimit info in the logs at service start time
 -

 Key: HADOOP-9253
 URL: https://issues.apache.org/jira/browse/HADOOP-9253
 Project: Hadoop Common
  Issue Type: Improvement
Affects Versions: 1.1.1, 2.0.2-alpha
Reporter: Arpit Gupta
Assignee: Arpit Gupta
 Attachments: HADOOP-9253.branch-1.patch, HADOOP-9253.branch-1.patch, 
 HADOOP-9253.branch-1.patch, HADOOP-9253.patch, HADOOP-9253.patch


 output of ulimit -a is helpful while debugging issues on the system.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira