Re: Mailing list admin?

2012-10-23 Thread Harsh J
Ping?

On Thu, Oct 18, 2012 at 5:25 PM, Harsh J  wrote:
> Hey project devs,
>
> Can someone let me know who the MLs admin is? INFRA suggested that
> instead of going to them, I could reach out to the admin group local
> to the project itself (I didn't know we had admins locally).
>
> P.s. Happy to volunteer to administrate as well.
>
> Please ping me directly,
> Thanks,
> Harsh J



-- 
Harsh J


[jira] [Resolved] (HADOOP-8959) TestUserGroupInformation fails on Windows due to "id" executable not found

2012-10-23 Thread Suresh Srinivas (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suresh Srinivas resolved HADOOP-8959.
-

   Resolution: Fixed
Fix Version/s: trunk-win
 Hadoop Flags: Reviewed

+1 for the patch. I have committed this to branch-trunk-win.

Thank you Bikas and Chuan for the patch. Thank you Chris for porting it from 
branch-1-win.

> TestUserGroupInformation fails on Windows due to "id" executable not found
> --
>
> Key: HADOOP-8959
> URL: https://issues.apache.org/jira/browse/HADOOP-8959
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: security
>Affects Versions: trunk-win
>Reporter: Chris Nauroth
>Assignee: Chris Nauroth
> Fix For: trunk-win
>
> Attachments: HADOOP-8959-branch-trunk-win.patch
>
>
> TestUserGroupInformation.testGetServerSideGroups contains a hard-coded call 
> to "id", which isn't present on Windows.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Resolved] (HADOOP-8954) "stat" executable not found on Windows

2012-10-23 Thread Suresh Srinivas (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-8954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suresh Srinivas resolved HADOOP-8954.
-

   Resolution: Fixed
Fix Version/s: trunk-win
 Hadoop Flags: Reviewed

+1 for the patch. Thank you Bikas and Ivan. Thank you Chris for backporting it.

> "stat" executable not found on Windows
> --
>
> Key: HADOOP-8954
> URL: https://issues.apache.org/jira/browse/HADOOP-8954
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: fs
>Affects Versions: trunk-win
>Reporter: Chris Nauroth
>Assignee: Chris Nauroth
> Fix For: trunk-win
>
> Attachments: HADOOP-8954-branch-trunk-win.patch
>
>
> Hadoop Common attempts to call the "stat" executable, which isn't available 
> on Windows.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Resolved] (HADOOP-8540) Compression with non-default codec's fail on Windows

2012-10-23 Thread Ivan Mitic (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-8540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ivan Mitic resolved HADOOP-8540.


Resolution: Fixed

Support for zlib compression library was added with HADOOP-8564. 

To enable zlib compression codecs on Windows:
 - Download zlib sources and set ZLIB_HOME in the environment before building 
Hadoop on Windows (this step is needed for build to generate the corresponding 
stubs in hadoop.dll)
 - Install zlib1.dll to system32 (with HADOOP-8907 you can also install it next 
to hadoop.dll)

> Compression with non-default codec's fail on Windows
> 
>
> Key: HADOOP-8540
> URL: https://issues.apache.org/jira/browse/HADOOP-8540
> Project: Hadoop Common
>  Issue Type: Bug
>Reporter: Trupti Dhavle
>
> I was trying to run the compression test case with GZipCodec. However the 
> test fails with NPE. It is running fine with DefaultCodec.
> With text input
> c:\Workspace\winhadoopqe>c:\hdp\branch-1-win\bin\hadoop jar 
> c:\hdp\branch-1-win\
> build\hadoop-examples-1.1.0-SNAPSHOT.jar sort 
> "-Dmapred.compress.map.output=true
> " 
> "-Dmapred.map.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec
> " "-Dmapred.output.compress=true"  "-Dmapred.output.compression.type=NONE"  
> "-Dm
> apred.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec" 
> -outKey
> org.apache.hadoop.io.Text -outValue org.apache.hadoop.io.Text  
> Compression/texti
> nput Compression/textoutput-123
> Running on 1 nodes to sort from 
> hdfs://localhost:8020/user/Administrator/Compres
> sion/textinput into 
> hdfs://localhost:8020/user/Administrator/Compression/textout
> put-123 with 1 reduces.
> Job started: Thu Jun 28 10:02:18 PDT 2012
> 12/06/28 10:02:18 INFO mapred.FileInputFormat: Total input paths to process : 
> 1
> 12/06/28 10:02:18 INFO mapred.JobClient: Running job: job_201206271409_0045
> 12/06/28 10:02:19 INFO mapred.JobClient:  map 0% reduce 0%
> 12/06/28 10:02:36 INFO mapred.JobClient: Task Id : 
> attempt_201206271409_0045_m_0
> 0_0, Status : FAILED
> java.lang.NullPointerException
> at org.apache.hadoop.mapred.IFile$Writer.(IFile.java:102)
> at 
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask
> .java:1407)
> at 
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1
> 298)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:437)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:271)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma
> tion.java:1103)
> at org.apache.hadoop.mapred.Child.main(Child.java:265)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-8969) In TestIFile, testIFileReaderWithCodec relies on testIFileWriterWithCodec

2012-10-23 Thread Sandy Ryza (JIRA)
Sandy Ryza created HADOOP-8969:
--

 Summary: In TestIFile, testIFileReaderWithCodec relies on 
testIFileWriterWithCodec
 Key: HADOOP-8969
 URL: https://issues.apache.org/jira/browse/HADOOP-8969
 Project: Hadoop Common
  Issue Type: Improvement
Affects Versions: 2.0.2-alpha
Reporter: Sandy Ryza
Assignee: Sandy Ryza
Priority: Minor


The file used to test reading is expected to have been created by the file used 
to test writing

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-8968) TaskTracker and DataNode relaxed version check is not working

2012-10-23 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created HADOOP-8968:
--

 Summary: TaskTracker and DataNode relaxed version check is not 
working
 Key: HADOOP-8968
 URL: https://issues.apache.org/jira/browse/HADOOP-8968
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 1.1.0
Reporter: Alejandro Abdelnur
 Fix For: 1.2.0


The logic in the TaskTracker and the DataNode to allow a relax version check 
with the JobTracker and NameNode is not working.

The relaxed check is done after the strict check, thus no chance for the 
relaxed check to ever happen.

The relaxed check is hardcoded to require exact same versions (allowing 
different builds). The relaxed check should be able to work with a prefix of 
the full version (i.e. to handle patch releases).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-8967) Reported source for config property can be misleading

2012-10-23 Thread Jason Lowe (JIRA)
Jason Lowe created HADOOP-8967:
--

 Summary: Reported source for config property can be misleading
 Key: HADOOP-8967
 URL: https://issues.apache.org/jira/browse/HADOOP-8967
 Project: Hadoop Common
  Issue Type: Bug
  Components: conf
Affects Versions: 0.23.3
Reporter: Jason Lowe
Priority: Minor


Configuration.set tries to track the source of a property being set, but it 
mistakenly reports properties as being deprecated when they are not.  This is 
misleading and confusing for users examining a job's configuration.

For example, run a sleep job and check the job configuration on the job UI.  
The source for the "mapreduce.job.maps" property will be reported as "job.xml ⬅ 
because mapreduce.job.maps is deprecated".  This leads users to think 
mapreduce.job.maps is now a deprecated property and wonder what other property 
they should use instead.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-8966) Change dfsadmin and haadmin commands to be case insenitive

2012-10-23 Thread Brandon Li (JIRA)
Brandon Li created HADOOP-8966:
--

 Summary: Change dfsadmin and haadmin commands to be case 
insenitive 
 Key: HADOOP-8966
 URL: https://issues.apache.org/jira/browse/HADOOP-8966
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Brandon Li
Priority: Trivial


It can be easier to use when these commands are case insensitive.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HADOOP-8965) Allow client to specify internal authentication

2012-10-23 Thread Daryn Sharp (JIRA)
Daryn Sharp created HADOOP-8965:
---

 Summary: Allow client to specify internal authentication
 Key: HADOOP-8965
 URL: https://issues.apache.org/jira/browse/HADOOP-8965
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: ipc
Affects Versions: 2.0.0-alpha, 0.23.0, 1.0.0, 3.0.0
Reporter: Daryn Sharp
Assignee: Daryn Sharp


The RPC client currently uses a token if present, else it falls back to 
authentication.  This creates an ambiguity in the client if SIMPLE auth is 
allowed to use tokens.  A task will continue to run if the task loses its 
tokens because it will fallback to SIMPLE auth - this would be a bug.  There 
should be a means to specify that tasks must use tokens to avoid the ambiguity.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Reopened] (HADOOP-8901) GZip and Snappy support may not work without unversioned libraries

2012-10-23 Thread Radim Kolar (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Radim Kolar reopened HADOOP-8901:
-


> GZip and Snappy support may not work without unversioned libraries
> --
>
> Key: HADOOP-8901
> URL: https://issues.apache.org/jira/browse/HADOOP-8901
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: native
>Affects Versions: 2.0.3-alpha
>Reporter: Colin Patrick McCabe
>Assignee: Colin Patrick McCabe
>Priority: Minor
> Fix For: 3.0.0, 2.0.3-alpha
>
> Attachments: HADOOP-8901.001.patch, HADOOP-8901.002.patch, 
> HADOOP-8901.003.patch
>
>
> Currently, we use {{dlopen}} to open {{libz.so}} and {{libsnappy.so}}, to get 
> Gzip and Snappy support, respectively.
> However, this is not correct; we should be dlopening {{libsnappy.so.1}} 
> instead.  The versionless form of the shared library is not commonly 
> installed except by development packages.  Also, we may run into subtle 
> compatibility problems if a new version of libsnappy comes out.
> Thanks to Brandon Vargo for reporting this bug.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


Build failed in Jenkins: Hadoop-Common-0.23-Build #410

2012-10-23 Thread Apache Jenkins Server
See 

Changes:

[vinodkv] YARN-174. Modify NodeManager to pass the user's configuration even 
when rebooting. Contributed by Vinod Kumar Vavilapalli.
svn merge --ignore-ancestry -c 1401086 ../../trunk/

[jlowe] svn merge -c 1401054 FIXES: MAPREDUCE-4740. only .jars can be added to 
the Distributed Cache classpath. Contributed by Robert Joseph Evans

--
[...truncated 11007 lines...]

[INFO] 
[INFO] --- maven-clover2-plugin:3.0.5:clover (clover) @ hadoop-auth ---
[INFO] Using /default-clover-report descriptor.
[INFO] Using Clover report descriptor: /tmp/mvn2698523356993079337resource
[INFO] Clover Version 3.0.2, built on April 13 2010 (build-790)
[INFO] Loaded from: 
/home/jenkins/.m2/repository/com/cenqua/clover/clover/3.0.2/clover-3.0.2.jar
[INFO] Clover: Open Source License registered to Apache.
[INFO] Clover is enabled with initstring 
'
[WARNING] Clover historical directory 
[
 does not exist, skipping Clover historical report generation 
([
[INFO] Clover Version 3.0.2, built on April 13 2010 (build-790)
[INFO] Loaded from: 
/home/jenkins/.m2/repository/com/cenqua/clover/clover/3.0.2/clover-3.0.2.jar
[INFO] Clover: Open Source License registered to Apache.
[INFO] Loading coverage database from: 
'
[INFO] Writing HTML report to 
'
[INFO] Done. Processed 4 packages in 956ms (239ms per package).
[INFO] Clover Version 3.0.2, built on April 13 2010 (build-790)
[INFO] Loaded from: 
/home/jenkins/.m2/repository/com/cenqua/clover/clover/3.0.2/clover-3.0.2.jar
[INFO] Clover: Open Source License registered to Apache.
[INFO] Clover is enabled with initstring 
'
[WARNING] Clover historical directory 
[
 does not exist, skipping Clover historical report generation 
([
[INFO] Clover Version 3.0.2, built on April 13 2010 (build-790)
[INFO] Loaded from: 
/home/jenkins/.m2/repository/com/cenqua/clover/clover/3.0.2/clover-3.0.2.jar
[INFO] Clover: Open Source License registered to Apache.
[INFO] Loading coverage database from: 
'
[INFO] Writing report to 
'
[INFO] 
[INFO] 
[INFO] Building Apache Hadoop Auth Examples 0.23.5-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-auth-examples 
---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:build-classpath (build-classpath) @ 
hadoop-auth-examples ---
[INFO] Wrote classpath file 
'
[INFO] 
[INFO] --- maven-clover2-plugin:3.0.5:setup (setup) @ hadoop-auth-examples ---
[INFO] Clover Version 3.0.2, built on April 13 2010 (build-790)
[INFO] Loaded from: 
/home/jenkins/.m2/repository/com/cenqua/clover/clover/3.0.2/clover-3.0.2.jar
[INFO] Clover: Open Source License registered to Apache.
[INFO] Creating new database at 
'
[INFO] Processing files at 1.6 source level.
[INFO] Clover all over. Instrumented 3 files (1 package).
[INFO] Elapsed time = 0.014 secs. (214.286 files/sec, 20,214.285 srclines/sec)
[INFO] No Clover instrumentation done on source files in: 
[
 as no matching sources files found
[INFO] 
[INFO] --- maven-resources-pl