[jira] [Reopened] (HADOOP-8972) Move winutils tests from bat to Java

2012-11-06 Thread Ivan Mitic (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ivan Mitic reopened HADOOP-8972:



I missed to delete some files with the original patch, reactivating.

> Move winutils tests from bat to Java
> 
>
> Key: HADOOP-8972
> URL: https://issues.apache.org/jira/browse/HADOOP-8972
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: 1-win
>Reporter: Ivan Mitic
>Assignee: Ivan Mitic
> Fix For: 1-win
>
> Attachments: HADOOP-8972.branch-1-win.winutilstests.patch
>
>
> This Jira tracks the work needed to move existing winutils tests from bat 
> files to Java. We decided to go with Java for the following reasons:
> 1. It showed to be quite hard to modify bat scripts and add new test cases 
> (people are generally not comfortable writing bat scripts)
> 2. Debugging a test case failure in bat script is not trivial
> 3. It turned that we are not running the test scripts frequently
> Cons:
> One now needs JDK and Hadoop jar to compile and run winutils tests. However, 
> in the context of Hadoop this is not an issue so we decided to go with 
> something we all feel more comfortable with.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-9015) Standardize creation of SaslRpcServers

2012-11-06 Thread Daryn Sharp (JIRA) 
Daryn Sharp created HADOOP-9015:
---

 Summary: Standardize creation of SaslRpcServers
 Key: HADOOP-9015
 URL: https://issues.apache.org/jira/browse/HADOOP-9015
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: ipc
Affects Versions: 2.0.0-alpha, 0.23.0, 3.0.0
Reporter: Daryn Sharp
Assignee: Daryn Sharp


To ease adding additional SASL support, need to merge the multiple switches for 
mechanism type and server creation into a single switch with a single call to 
createSaslServer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-9014) Standardize creation of SaslRpcClients

2012-11-06 Thread Daryn Sharp (JIRA) 
Daryn Sharp created HADOOP-9014:
---

 Summary: Standardize creation of SaslRpcClients
 Key: HADOOP-9014
 URL: https://issues.apache.org/jira/browse/HADOOP-9014
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: ipc
Affects Versions: 0.23.0, 3.0.0, 2.0.3-alpha
Reporter: Daryn Sharp
Assignee: Daryn Sharp


To ease adding additional SASL support, need to change the chained conditionals 
into a switch and make one standard call to createSaslClient.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Reopened] (HADOOP-9004) Allow security unit tests to use external KDC

2012-11-06 Thread Suresh Srinivas (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suresh Srinivas reopened HADOOP-9004:
-


> Allow security unit tests to use external KDC
> -
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: security, test
>Affects Versions: 2.0.0-alpha
>Reporter: Stephen Chu
>Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch.007, 
> HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an 
> external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for 
> security-related unit tests. It would be good to allow users to validate the 
> use of their own KDC, keytabs, and principals and to test different KDCs and 
> not rely on the ApacheDS KDC.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-9013) UGI should not hardcode loginUser's authenticationType

2012-11-06 Thread Daryn Sharp (JIRA) 
Daryn Sharp created HADOOP-9013:
---

 Summary: UGI should not hardcode loginUser's authenticationType
 Key: HADOOP-9013
 URL: https://issues.apache.org/jira/browse/HADOOP-9013
 Project: Hadoop Common
  Issue Type: Sub-task
Affects Versions: 2.0.0-alpha, 3.0.0
Reporter: Daryn Sharp
Assignee: Daryn Sharp


{{UGI.loginUser}} assumes that the user's auth type for security on = kerberos, 
security off = simple.  It should instead use the configured auth type.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Hadoop-Common-0.23-Build #424

2012-11-06 Thread Apache Jenkins Server 
See 

Changes:

[bobby] svn merge -c 1405975. FIXES: MAPREDUCE-4771. KeyFieldBasedPartitioner 
not partitioning properly when configured (jlowe via bobby)

[bobby] svn merge -c 1405846. Localization Update

--
[...truncated 11014 lines...]

[INFO] 
[INFO] --- maven-clover2-plugin:3.0.5:clover (clover) @ hadoop-auth ---
[INFO] Using /default-clover-report descriptor.
[INFO] Using Clover report descriptor: /tmp/mvn1897449478592491370resource
[INFO] Clover Version 3.0.2, built on April 13 2010 (build-790)
[INFO] Loaded from: 
/home/jenkins/.m2/repository/com/cenqua/clover/clover/3.0.2/clover-3.0.2.jar
[INFO] Clover: Open Source License registered to Apache.
[INFO] Clover is enabled with initstring 
'
[WARNING] Clover historical directory 
[
 does not exist, skipping Clover historical report generation 
([
[INFO] Clover Version 3.0.2, built on April 13 2010 (build-790)
[INFO] Loaded from: 
/home/jenkins/.m2/repository/com/cenqua/clover/clover/3.0.2/clover-3.0.2.jar
[INFO] Clover: Open Source License registered to Apache.
[INFO] Loading coverage database from: 
'
[INFO] Writing HTML report to 
'
[INFO] Done. Processed 4 packages in 1072ms (268ms per package).
[INFO] Clover Version 3.0.2, built on April 13 2010 (build-790)
[INFO] Loaded from: 
/home/jenkins/.m2/repository/com/cenqua/clover/clover/3.0.2/clover-3.0.2.jar
[INFO] Clover: Open Source License registered to Apache.
[INFO] Clover is enabled with initstring 
'
[WARNING] Clover historical directory 
[
 does not exist, skipping Clover historical report generation 
([
[INFO] Clover Version 3.0.2, built on April 13 2010 (build-790)
[INFO] Loaded from: 
/home/jenkins/.m2/repository/com/cenqua/clover/clover/3.0.2/clover-3.0.2.jar
[INFO] Clover: Open Source License registered to Apache.
[INFO] Loading coverage database from: 
'
[INFO] Writing report to 
'
[INFO] 
[INFO] 
[INFO] Building Apache Hadoop Auth Examples 0.23.5-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-auth-examples 
---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:build-classpath (build-classpath) @ 
hadoop-auth-examples ---
[INFO] Wrote classpath file 
'
[INFO] 
[INFO] --- maven-clover2-plugin:3.0.5:setup (setup) @ hadoop-auth-examples ---
[INFO] Clover Version 3.0.2, built on April 13 2010 (build-790)
[INFO] Loaded from: 
/home/jenkins/.m2/repository/com/cenqua/clover/clover/3.0.2/clover-3.0.2.jar
[INFO] Clover: Open Source License registered to Apache.
[INFO] Creating new database at 
'
[INFO] Processing files at 1.6 source level.
[INFO] Clover all over. Instrumented 3 files (1 package).
[INFO] Elapsed time = 0.018 secs. (166.667 files/sec, 15,722.223 srclines/sec)
[INFO] No Clover instrumentation done on source files in: 
[
 as no matching sources files found
[INFO] 
[INFO] --- maven-resources-plugin:2.2:resources (default-resources) @ 
hadoop-auth-examples ---
[INFO] Using default encoding to copy filtered resources.
[INFO] 
[INFO] ---

Re: Hadoop version layout error

2012-11-06 Thread Harsh J 
What version of Hadoop are you/were you on? And did you run an NN
upgrade recently?

Can you also pastebin the full logs somewhere?

On Tue, Nov 6, 2012 at 11:34 AM, chendaya  wrote:
> Hi, everyone
> I am getting this error in one or two nodes in a hadoop cluster where rest of 
> the nodes are running fine:
> ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: 
> * Upgrade is not supported from this older version of storage to the 
> current version. Please upgrade to Hadoop-0.14 or a later version and then 
> upgrade to current version. Old layout version is 'too old' and latest layout 
> version this software version can upgrade from is -7.
> Any idea how to fix this prob. without losing the data.
>
> Many Thanks!!
>
> Daya Chen



-- 
Harsh J