[jira] [Created] (HADOOP-9074) Hadoop install scripts for Windows

2012-11-20 Thread Ivan Mitic (JIRA) 
Ivan Mitic created HADOOP-9074:
--

 Summary: Hadoop install scripts for Windows
 Key: HADOOP-9074
 URL: https://issues.apache.org/jira/browse/HADOOP-9074
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 1-win
Reporter: Ivan Mitic
Assignee: Ivan Mitic


Tracking Jira to post Hadoop install scripts for Windows. Scripts will provide 
means for Windows users/developers to install/uninstall Hadoop on a single-node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-9073) Migrate saveVersion.sh script to python

2012-11-20 Thread Radim Kolar (JIRA) 
Radim Kolar created HADOOP-9073:
---

 Summary: Migrate saveVersion.sh script to python
 Key: HADOOP-9073
 URL: https://issues.apache.org/jira/browse/HADOOP-9073
 Project: Hadoop Common
  Issue Type: Improvement
 Environment: Work based on HADOOP-8924. Changes build system to use 
python script instead of sh script for generating hadoop package version. 
Changes hadoop-common and yarn-common.
Reporter: Radim Kolar




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[VOTE] Hadoop Release 1.1.1

2012-11-20 Thread Matt Foley 
Hello,
Hadoop-1.1.1-rc0 is now available for evaluation and vote:
http://people.apache.org/~mattf/hadoop-1.1.1-rc0/
or in the Nexus repository.

The release notes are available at
http://people.apache.org/~mattf/hadoop-1.1.1-rc0/releasenotes.html

20 bugs have been fixed, compared to release 1.1.0, with no backward
incompatibilities.
I took the opportunity to assure that all branch-1.0 changes are in 1.1.1,
and all branch-1.1 changes are in branch-1.
The jira database has been made consistent.

Please vote.  Voting will end on Tuesday 27 Nov., at 2:05pm PST.

Thank you,
--Matt Foley
release manager

Jenkins build is back to normal : Hadoop-Common-0.23-Build #440

2012-11-20 Thread Apache Jenkins Server 
See

[jira] [Resolved] (HADOOP-6453) Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH

2012-11-20 Thread Matt Foley (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matt Foley resolved HADOOP-6453.


Resolution: Fixed

> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> 
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: scripts
>Affects Versions: 0.20.2, 0.21.0, 0.22.0
>Reporter: Chad Metcalf
>Priority: Minor
> Fix For: 0.22.1
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, 
> HADOOP-6453-0.20v3.patch, HADOOP-6453.trunk.patch, HADOOP-6453-trunkv2.patch, 
> HADOOP-6453-trunkv3.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses 
> JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say 
> hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native 
> libs like normal. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

lifecycle support for Partitioner and RawComparator

2012-11-20 Thread Radim Kolar 

I would like to have lifesupport in partitioner and comparator see:

https://issues.apache.org/jira/browse/MAPREDUCE-4594

my proposed change is to make both classes, not interfaces.

[jira] [Created] (HADOOP-9072) Hadoop-Common-0.23-Build Fails to build in Jenkins

2012-11-20 Thread Robert Parker (JIRA) 
Robert Parker created HADOOP-9072:
-

 Summary: Hadoop-Common-0.23-Build Fails to build in Jenkins
 Key: HADOOP-9072
 URL: https://issues.apache.org/jira/browse/HADOOP-9072
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 0.23.4
Reporter: Robert Parker
Assignee: Robert Parker


[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile 
(default-testCompile) on project hadoop-common: Compilation failure: 
Compilation failure:
[ERROR] 
/home/jenkins/jenkins-slave/workspace/Hadoop-Common-0.23-Build/trunk/hadoop-common-project/hadoop-common/target/clover/src-test-instrumented/org/apache/hadoop/record/RecInt.java:[4,7]
 duplicate class: org.apache.hadoop.record.RecInt
[ERROR] 
/home/jenkins/jenkins-slave/workspace/Hadoop-Common-0.23-Build/trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java/org/apache/hadoop/record/RecRecordOld.java:[4,7]
 duplicate class: org.apache.hadoop.record.RecRecordOld
[ERROR] 
/home/jenkins/jenkins-slave/workspace/Hadoop-Common-0.23-Build/trunk/hadoop-common-project/hadoop-common/target/clover/src-test-instrumented/org/apache/hadoop/record/RecString.java:[4,7]
 duplicate class: org.apache.hadoop.record.RecString
[ERROR] 
/home/jenkins/jenkins-slave/workspace/Hadoop-Common-0.23-Build/trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java/org/apache/hadoop/record/RecBuffer.java:[4,7]
 duplicate class: org.apache.hadoop.record.RecBuffer
[ERROR] 
/home/jenkins/jenkins-slave/workspace/Hadoop-Common-0.23-Build/trunk/hadoop-common-project/hadoop-common/target/clover/src-test-instrumented/org/apache/hadoop/record/RecRecord1.java:[4,7]
 duplicate class: org.apache.hadoop.record.RecRecord1
[ERROR] 
/home/jenkins/jenkins-slave/workspace/Hadoop-Common-0.23-Build/trunk/hadoop-common-project/hadoop-common/target/clover/src-test-instrumented/org/apache/hadoop/record/RecRecordNew.java:[4,7]
 duplicate class: org.apache.hadoop.record.RecRecordNew
[ERROR] 
/home/jenkins/jenkins-slave/workspace/Hadoop-Common-0.23-Build/trunk/hadoop-common-project/hadoop-common/target/clover/src-test-instrumented/org/apache/hadoop/record/RecRecord0.java:[4,7]
 duplicate class: org.apache.hadoop.record.RecRecord0



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-9071) configure ivy log levels for resolve/retrieve

2012-11-20 Thread Giridharan Kesavan (JIRA) 
Giridharan Kesavan created HADOOP-9071:
--

 Summary: configure ivy log levels for resolve/retrieve
 Key: HADOOP-9071
 URL: https://issues.apache.org/jira/browse/HADOOP-9071
 Project: Hadoop Common
  Issue Type: Improvement
  Components: build
Affects Versions: 1.1.0
Reporter: Giridharan Kesavan
Assignee: Giridharan Kesavan




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HADOOP-9055) POM files for hadoop-core 1.x should depend on Jackson 1.8.8

2012-11-20 Thread Giridharan Kesavan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Giridharan Kesavan resolved HADOOP-9055.


Resolution: Duplicate

duplicate of HADOOP-8745

> POM files for hadoop-core 1.x should depend on Jackson 1.8.8
> 
>
> Key: HADOOP-9055
> URL: https://issues.apache.org/jira/browse/HADOOP-9055
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: 1.0.0, 1.1.0
>Reporter: Gunther Hagleitner
>Assignee: Giridharan Kesavan
>
> According to this: https://issues.apache.org/jira/browse/HADOOP-7470
> Jackson has been upgraded to 1.8.8, but the POMs on the apache maven repo for 
> the hadoop 1.x line still specify 1.0.1 for the library. That's causing build 
> problems for hive (which uses 1.0.0 to build its 20S shim).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HADOOP-8860) Split MapReduce and YARN sections in documentation navigation

2012-11-20 Thread Tom White (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-8860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tom White resolved HADOOP-8860.
---

   Resolution: Fixed
Fix Version/s: 0.23.5

I just pulled this into 0.23 too after discussing with Bobby and Tom.

> Split MapReduce and YARN sections in documentation navigation
> -
>
> Key: HADOOP-8860
> URL: https://issues.apache.org/jira/browse/HADOOP-8860
> Project: Hadoop Common
>  Issue Type: Task
>  Components: documentation
>Affects Versions: 2.0.1-alpha
>Reporter: Tom White
>Assignee: Tom White
> Fix For: 2.0.3-alpha, 0.23.5
>
> Attachments: HADOOP-8860-23.patch, HADOOP-8860-23.sh, 
> HADOOP-8860.patch, HADOOP-8860.patch, HADOOP-8860.sh, HADOOP-8860.sh
>
>
> This JIRA is to change the navigation on 
> http://hadoop.apache.org/docs/r2.0.1-alpha/ to reflect the fact that 
> MapReduce and YARN are separate modules/sub-projects.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-9070) Kerberos SASL server cannot find kerberos key

2012-11-20 Thread Daryn Sharp (JIRA) 
Daryn Sharp created HADOOP-9070:
---

 Summary: Kerberos SASL server cannot find kerberos key
 Key: HADOOP-9070
 URL: https://issues.apache.org/jira/browse/HADOOP-9070
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: ipc
Affects Versions: 3.0.0, 2.0.3-alpha
Reporter: Daryn Sharp
Assignee: Daryn Sharp
Priority: Blocker


HADOOP-9015 inadvertently removed a {{doAs}} block around instantiation of the 
sasl server which renders a server incapable of accepting kerberized 
connections.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-9069) FileSystem.get leads to stack overflow if default FS is not configured with a scheme

2012-11-20 Thread Jason Lowe (JIRA) 
Jason Lowe created HADOOP-9069:
--

 Summary: FileSystem.get leads to stack overflow if default FS is 
not configured with a scheme
 Key: HADOOP-9069
 URL: https://issues.apache.org/jira/browse/HADOOP-9069
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Affects Versions: 2.0.1-alpha, 0.23.3
Reporter: Jason Lowe
Priority: Minor


If fs.defaultFS is configured without a scheme, e.g.: "/", then FileSystem.get 
will infinitely recurse and lead to a stack overflow.  An example stacktrace 
from 0.23:

{noformat}
java.lang.StackOverflowError
at java.util.AbstractCollection.(AbstractCollection.java:66)
at java.util.AbstractList.(AbstractList.java:76)
at java.util.ArrayList.(ArrayList.java:128)
at java.util.ArrayList.(ArrayList.java:139)
at 
org.apache.hadoop.conf.Configuration.handleDeprecation(Configuration.java:430)
at org.apache.hadoop.conf.Configuration.get(Configuration.java:852)
at org.apache.hadoop.fs.FileSystem.getDefaultUri(FileSystem.java:171)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:163)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:290)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:163)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:290)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:163)
...
{noformat}


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-9068) Reuse (and not duplicate) globbing logic between FileSystem and FileContext

2012-11-20 Thread Harsh J (JIRA) 
Harsh J created HADOOP-9068:
---

 Summary: Reuse (and not duplicate) globbing logic between 
FileSystem and FileContext
 Key: HADOOP-9068
 URL: https://issues.apache.org/jira/browse/HADOOP-9068
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Affects Versions: 2.0.0-alpha
Reporter: Harsh J


FileSystem's globbing code is currently duplicated in FileContext.Util class. 
We should reuse the implementation rather than maintain two pieces of it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-9067) provide test for method org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, FSDataInputStream, long, FSDataInputStream, long)

2012-11-20 Thread Ivan A. Veselovsky (JIRA) 
Ivan A. Veselovsky created HADOOP-9067:
--

 Summary: provide test for method 
org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, 
FSDataInputStream, long, FSDataInputStream, long)
 Key: HADOOP-9067
 URL: https://issues.apache.org/jira/browse/HADOOP-9067
 Project: Hadoop Common
  Issue Type: Test
Reporter: Ivan A. Veselovsky
Assignee: Ivan A. Veselovsky
Priority: Minor


this method is not covered by the existing unit tests. Provide a test to cover 
it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Hadoop-Common-0.23-Build #439

2012-11-20 Thread Apache Jenkins Server 
See 

Changes:

[tgraves] Fixing CHANGES.txt to show jiras in re-branched 0.23.5 release

--
[...truncated 20313 lines...]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.111 sec
Running org.apache.hadoop.fs.s3.TestS3Credentials
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.197 sec
Running org.apache.hadoop.fs.s3.TestS3FileSystem
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.22 sec
Running org.apache.hadoop.fs.TestDU
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.219 sec
Running org.apache.hadoop.record.TestBuffer
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.116 sec
Running org.apache.hadoop.record.TestRecordVersioning
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.198 sec
Running org.apache.hadoop.record.TestRecordIO
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.223 sec
Running org.apache.hadoop.metrics2.source.TestJvmMetrics
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.431 sec
Running org.apache.hadoop.metrics2.util.TestSampleStat
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.14 sec
Running org.apache.hadoop.metrics2.util.TestMetricsCache
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.194 sec
Running org.apache.hadoop.metrics2.lib.TestInterns
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.276 sec
Running org.apache.hadoop.metrics2.lib.TestMetricsAnnotations
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.573 sec
Running org.apache.hadoop.metrics2.lib.TestMutableMetrics
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.454 sec
Running org.apache.hadoop.metrics2.lib.TestUniqNames
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.146 sec
Running org.apache.hadoop.metrics2.lib.TestMetricsRegistry
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.523 sec
Running org.apache.hadoop.metrics2.impl.TestMetricsCollectorImpl
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.287 sec
Running org.apache.hadoop.metrics2.impl.TestGangliaMetrics
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.512 sec
Running org.apache.hadoop.metrics2.impl.TestSinkQueue
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.627 sec
Running org.apache.hadoop.metrics2.impl.TestMetricsVisitor
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.426 sec
Running org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.693 sec
Running org.apache.hadoop.metrics2.impl.TestMetricsConfig
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.349 sec
Running org.apache.hadoop.metrics2.filter.TestPatternFilter
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.316 sec
Running org.apache.hadoop.io.TestWritableName
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.222 sec
Running org.apache.hadoop.io.TestBloomMapFile
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.926 sec
Running org.apache.hadoop.io.TestEnumSetWritable
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.499 sec
Running org.apache.hadoop.io.TestSequenceFileSerialization
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.634 sec
Running org.apache.hadoop.io.TestSequenceFileSync
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.827 sec
Running org.apache.hadoop.io.TestBooleanWritable
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.145 sec
Running org.apache.hadoop.io.TestText
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.901 sec
Running org.apache.hadoop.io.TestMapWritable
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.234 sec
Running org.apache.hadoop.io.compress.TestCodecFactory
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.38 sec
Running org.apache.hadoop.io.compress.TestBlockDecompressorStream
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.142 sec
Running org.apache.hadoop.io.compress.TestCodec
Tests run: 21, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 69.988 sec
Running org.apache.hadoop.io.TestObjectWritableProtos
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.43 sec
Running org.apache.hadoop.io.TestDataByteBuffers
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.596 sec
Running org.apache.hadoop.io.TestWritable
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.145 sec
Running org.apache.hadoop.io.TestSecureIOUtils
Tests run: 4, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.574 sec
Running org.apache.hadoop.io.retry.TestFailoverProxy
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.283 sec
Running org.a

[jira] [Created] (HADOOP-9066) Sorting for FileStatus[]

2012-11-20 Thread david king (JIRA) 
david king created HADOOP-9066:
--

 Summary: Sorting for FileStatus[]
 Key: HADOOP-9066
 URL: https://issues.apache.org/jira/browse/HADOOP-9066
 Project: Hadoop Common
  Issue Type: Improvement
 Environment: java7 , RedHat9 , Hadoop 0.20.2
Reporter: david king


  I will submit a batch of FileStatusTool that used to sort FileStatus by the 
Comparator

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira