[jira] [Assigned] (MAPREDUCE-3578) starting nodemanager as 'root' gives "Unknown -jvm option"

2012-03-08 Thread Alejandro Abdelnur (Assigned) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Abdelnur reassigned MAPREDUCE-3578:
-

Assignee: Tom White

> starting nodemanager as 'root' gives "Unknown -jvm option"
> --
>
> Key: MAPREDUCE-3578
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3578
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: nodemanager
>Affects Versions: 0.23.0
> Environment: jdk 1.6.0.26, ubuntu 11.04
>Reporter: Gilad Wolff
>Assignee: Tom White
> Attachments: MAPREDUCE-3578.patch
>
>
> running "sudo HADOOP_ROOT/bin/yarn-daemon.sh start nodemanager" I get 
> "unknown -jvm option" (jdk version 1.6.0.26). The problem seems to be with 
> line 204 in yarn:
> elif [ "$COMMAND" = "nodemanager" ] ; then
> CLASSPATH=${CLASSPATH}:$YARN_CONF_DIR/nm-config/log4j.properties
> CLASS='org.apache.hadoop.yarn.server.nodemanager.NodeManager'
> if [[ $EUID -eq 0 ]]; then
> YARN_OPTS="$YARN_OPTS -jvm server $YARN_NODEMANAGER_OPTS"
> else
> YARN_OPTS="$YARN_OPTS -server $YARN_NODEMANAGER_OPTS"
> fi
> using -server seems to solve the problem for me.
> I tested using build 929 from 
> https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Mapreduce-trunk/.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (MAPREDUCE-3952) In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split.

2012-03-05 Thread Alejandro Abdelnur (Assigned) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Abdelnur reassigned MAPREDUCE-3952:
-

Assignee: Bhallamudi Venkata Siva Kamesh  (was: Bhallamudi Venkata Siva 
Kamesh)

> In MR2, when Total input paths to process == 1, 
> CombinefileInputFormat.getSplits() returns 0 split.
> ---
>
> Key: MAPREDUCE-3952
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3952
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: mrv2
>Affects Versions: 0.24.0, 0.23.3
>Reporter: Zhenxiao Luo
>Assignee: Bhallamudi Venkata Siva Kamesh
> Fix For: 0.23.3
>
> Attachments: MAPREDUCE-3952-1.patch, MAPREDUCE-3952.patch
>
>
> Hive get unexpected result when using MR2(When using MR1, always get expected 
> result).
> In MR2, when Total input paths to process == 1, 
> CombinefileInputFormat.getSplits() returns 0 split.
> The calling code in Hive, in Hadoop23Shims.java:
> InputSplit[] splits = super.getSplits(job, numSplits);
> this get splits.length == 0.
> In MR1, everything goes fine, the calling code in Hive, in Hadoop20Shims.java:
> CombineFileSplit[] splits = (CombineFileSplit[]) super.getSplits(job, 
> numSplits);
> this get splits.length == 1.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (MAPREDUCE-3952) In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split.

2012-03-05 Thread Alejandro Abdelnur (Assigned) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Abdelnur reassigned MAPREDUCE-3952:
-

Assignee: Bhallamudi Venkata Siva Kamesh  (was: Zhenxiao Luo)

by mistake I've assigned to the reporter, assigning it to Bhallamudi

> In MR2, when Total input paths to process == 1, 
> CombinefileInputFormat.getSplits() returns 0 split.
> ---
>
> Key: MAPREDUCE-3952
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3952
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: mrv2
>Affects Versions: 0.24.0, 0.23.3
>Reporter: Zhenxiao Luo
>Assignee: Bhallamudi Venkata Siva Kamesh
> Fix For: 0.23.3
>
> Attachments: MAPREDUCE-3952-1.patch, MAPREDUCE-3952.patch
>
>
> Hive get unexpected result when using MR2(When using MR1, always get expected 
> result).
> In MR2, when Total input paths to process == 1, 
> CombinefileInputFormat.getSplits() returns 0 split.
> The calling code in Hive, in Hadoop23Shims.java:
> InputSplit[] splits = super.getSplits(job, numSplits);
> this get splits.length == 0.
> In MR1, everything goes fine, the calling code in Hive, in Hadoop20Shims.java:
> CombineFileSplit[] splits = (CombineFileSplit[]) super.getSplits(job, 
> numSplits);
> this get splits.length == 1.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (MAPREDUCE-3952) In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split.

2012-03-05 Thread Alejandro Abdelnur (Assigned) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Abdelnur reassigned MAPREDUCE-3952:
-

Assignee: Zhenxiao Luo

> In MR2, when Total input paths to process == 1, 
> CombinefileInputFormat.getSplits() returns 0 split.
> ---
>
> Key: MAPREDUCE-3952
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3952
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: mrv2
>Reporter: Zhenxiao Luo
>Assignee: Zhenxiao Luo
> Attachments: MAPREDUCE-3952-1.patch, MAPREDUCE-3952.patch
>
>
> Hive get unexpected result when using MR2(When using MR1, always get expected 
> result).
> In MR2, when Total input paths to process == 1, 
> CombinefileInputFormat.getSplits() returns 0 split.
> The calling code in Hive, in Hadoop23Shims.java:
> InputSplit[] splits = super.getSplits(job, numSplits);
> this get splits.length == 0.
> In MR1, everything goes fine, the calling code in Hive, in Hadoop20Shims.java:
> CombineFileSplit[] splits = (CombineFileSplit[]) super.getSplits(job, 
> numSplits);
> this get splits.length == 1.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (MAPREDUCE-3884) PWD should be first in the classpath of MR tasks

2012-02-21 Thread Alejandro Abdelnur (Assigned) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Abdelnur reassigned MAPREDUCE-3884:
-

Assignee: Alejandro Abdelnur

> PWD should be first in the classpath of MR tasks
> 
>
> Key: MAPREDUCE-3884
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3884
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: mrv2
>Affects Versions: 0.23.2
>Reporter: Alejandro Abdelnur
>Assignee: Alejandro Abdelnur
>Priority: Critical
> Attachments: MAPREDUCE-3884.patch
>
>
> Currently the current directory is not part of the classpath, this is a 
> regression from MR1 and existing applications assuming this fail to work 
> properly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (MAPREDUCE-1744) DistributedCache creates its own FileSytem instance when adding a file/archive to the path

2012-01-04 Thread Alejandro Abdelnur (Assigned) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Abdelnur reassigned MAPREDUCE-1744:
-

Assignee: Dick King  (was: Alejandro Abdelnur)

reassigning to original author, I've just forward port it.

> DistributedCache creates its own FileSytem instance when adding a 
> file/archive to the path
> --
>
> Key: MAPREDUCE-1744
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1744
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>Reporter: Dick King
>Assignee: Dick King
> Attachments: BZ-3503564--2010-05-06.patch, 
> MAPREDUCE-1744-0.23-trunk.patch, MAPREDUCE-1744-0.23-trunk.patch, 
> MAPREDUCE-1744.patch, h1744.patch, mapred-1744-1.patch, mapred-1744-2.patch, 
> mapred-1744-3.patch, mapred-1744.patch
>
>
> According to the contract of {{UserGroupInformation.doAs()}} the only 
> required operations within the {{doAs()}} block are the
> creation of a {{JobClient}} or getting a {{FileSystem}} .
> The {{DistributedCache.add(File/Archive)ToClasspath()}} methods create a 
> {{FileSystem}} instance outside of the {{doAs()}} block,
> this {{FileSystem}} instance is not in the scope of the proxy user but of the 
> superuser and permissions may make the method
> fail.
> One option is to overload the methods above to receive a filesystem.
> Another option is to do obtain the {{FileSystem}} within a {{doAs()}} block, 
> for this it would be required to have the proxy
> user set in the passed configuration.
> The second option seems nicer, but I don't know if the proxy user is as a 
> property in the jobconf.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (MAPREDUCE-3204) mvn site:site fails on MapReduce

2011-10-20 Thread Alejandro Abdelnur (Assigned) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Abdelnur reassigned MAPREDUCE-3204:
-

Assignee: Alejandro Abdelnur

> mvn site:site fails on MapReduce
> 
>
> Key: MAPREDUCE-3204
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3204
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: build
>Affects Versions: 0.23.0, 0.24.0
>Reporter: Suresh Srinivas
>Assignee: Alejandro Abdelnur
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3204.patch
>
>
> This problem does not happen on 0.23. See details in the next comment.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (MAPREDUCE-3177) mapreduce tar layout does not conform new layout

2011-10-13 Thread Alejandro Abdelnur (Assigned) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Abdelnur reassigned MAPREDUCE-3177:
-

Assignee: Mahadev konar

> mapreduce tar layout does not conform new layout
> 
>
> Key: MAPREDUCE-3177
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3177
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: build
>Affects Versions: 0.23.0, 0.24.0
>Reporter: Alejandro Abdelnur
>Assignee: Mahadev konar
>Priority: Critical
> Fix For: 0.23.0, 0.24.0
>
>
> The tar generated by MR does not follow the layout of common & hdfs, instead, 
> it uses a arbitrary layout which is also different from the old legacy layout 
> (there is a modules/ directory with all the MR jars)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (MAPREDUCE-3183) hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml missing license header

2011-10-13 Thread Alejandro Abdelnur (Assigned) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Abdelnur reassigned MAPREDUCE-3183:
-

Assignee: Hitesh Shah  (was: Alejandro Abdelnur)

reassigning it to Hitesh as it is done already.

> hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml 
> missing license header
> 
>
> Key: MAPREDUCE-3183
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3183
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>Reporter: Hitesh Shah
>Assignee: Hitesh Shah
>Priority: Trivial
> Attachments: MR-3183.patch
>
>
> Re-assigning as this is part of the mavenization related changes and requires 
> a delayed merge to the 23 branch. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (MAPREDUCE-3003) Publish Yarn and MapReduce artifacts to Maven snapshot repository

2011-10-07 Thread Alejandro Abdelnur (Assigned) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Abdelnur reassigned MAPREDUCE-3003:
-

Assignee: Alejandro Abdelnur  (was: Tom White)

> Publish Yarn and MapReduce artifacts to Maven snapshot repository
> -
>
> Key: MAPREDUCE-3003
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3003
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: build
>Reporter: Tom White
>Assignee: Alejandro Abdelnur
> Attachments: MAPREDUCE-3003-0.23.patch, MAPREDUCE-3003.patch, 
> MAPREDUCE-3003.patch, MAPREDUCE-3003.patch, MAPREDUCE-3003.patch, 
> MAPREDUCE-3003.patch
>
>
> Currently this is failing since no distribution management section is defined 
> in the POM.
> https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Common-trunk-Commit/883/consoleFull

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira