[jira] [Created] (HADOOP-8467) hadoop-client module should have testcases that ensure no client dependencies are missing

[Alejandro Abdelnur (JIRA)]

Alejandro Abdelnur created HADOOP-8467:
--

 Summary: hadoop-client module should have testcases that ensure no 
client dependencies are missing
 Key: HADOOP-8467
 URL: https://issues.apache.org/jira/browse/HADOOP-8467
 Project: Hadoop Common
  Issue Type: Improvement
  Components: test
Affects Versions: 2.0.1-alpha
Reporter: Alejandro Abdelnur


As Eli suggested in HADOOP-8466 there should be a set of tests that help ensure 
all dependencies for using hadoop as a client are defined in the hadoop-client 
POM.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-8466) hadoop-client POM incorrectly excludes avro

[JIRA]

Bruno Mahé created HADOOP-8466:
--

 Summary: hadoop-client POM incorrectly excludes avro
 Key: HADOOP-8466
 URL: https://issues.apache.org/jira/browse/HADOOP-8466
 Project: Hadoop Common
  Issue Type: Bug
  Components: build
Affects Versions: 2.0.0-alpha
Reporter: Bruno Mahé
Assignee: Bruno Mahé


avro is used by Serializers initialization, thus it must be there

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-8465) hadoop-auth should support ephemeral authentication

[Alejandro Abdelnur (JIRA)]

Alejandro Abdelnur created HADOOP-8465:
--

 Summary: hadoop-auth should support ephemeral authentication
 Key: HADOOP-8465
 URL: https://issues.apache.org/jira/browse/HADOOP-8465
 Project: Hadoop Common
  Issue Type: New Feature
  Components: security
Affects Versions: 2.0.1-alpha
Reporter: Alejandro Abdelnur
Assignee: Alejandro Abdelnur
 Fix For: 2.0.1-alpha


Currently, once a client is authenticated the generated authentication-token (& 
cookie) are valid for a given (service configurable) lifespan.

Once the authentication-token (& cookie) is issued, the authentication logic 
will not be triggered until the authentication-token expires.

This behavior does not work well with delegation tokens expected behavior where 
delegation tokens can be canceled at any time.

Having ephemeral authentication (which is check on every request) would address 
this issue.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Reopened] (HADOOP-8463) hadoop.security.auth_to_local needs a key definition and doc

[Aaron T. Myers (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HADOOP-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aaron T. Myers reopened HADOOP-8463:



> hadoop.security.auth_to_local needs a key definition and doc 
> -
>
> Key: HADOOP-8463
> URL: https://issues.apache.org/jira/browse/HADOOP-8463
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: security
>Affects Versions: 2.0.0-alpha
>Reporter: Eli Collins
>Assignee: madhukara phatak
>  Labels: newbie
> Attachments: HADOOP-8463.patch
>
>
> hadoop.security.auth_to_local should be defined in 
> CommonConfigurationKeysPublic.java, and update the uses of the raw string in 
> common and hdfs with the key. 
> It's definition in core-site.xml should also be updated with a description.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HADOOP-8463) hadoop.security.auth_to_local needs a key definition and doc

[Aaron T. Myers (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HADOOP-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aaron T. Myers resolved HADOOP-8463.


Resolution: Unresolved

> hadoop.security.auth_to_local needs a key definition and doc 
> -
>
> Key: HADOOP-8463
> URL: https://issues.apache.org/jira/browse/HADOOP-8463
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: security
>Affects Versions: 2.0.0-alpha
>Reporter: Eli Collins
>Assignee: madhukara phatak
>  Labels: newbie
> Attachments: HADOOP-8463.patch
>
>
> hadoop.security.auth_to_local should be defined in 
> CommonConfigurationKeysPublic.java, and update the uses of the raw string in 
> common and hdfs with the key. 
> It's definition in core-site.xml should also be updated with a description.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-8464) hadoop-env.sh is included twice: once via hadoop-config.sh the again explicitly via scripts

[Jay Finger (JIRA)]

Jay Finger created HADOOP-8464:
--

 Summary: hadoop-env.sh is included twice: once via 
hadoop-config.sh the again explicitly via scripts
 Key: HADOOP-8464
 URL: https://issues.apache.org/jira/browse/HADOOP-8464
 Project: Hadoop Common
  Issue Type: Bug
  Components: conf
Affects Versions: 2.0.0-alpha
Reporter: Jay Finger


Many (most? all?) scripts include hadoop-env.sh twice.  The first time is 
indirectly:  scripts do ". hadoop-config.sh" and hadoop-config.sh then does ". 
hadoop-env.sh".  Then scripts will later directly do ". hadoop-env.sh".

This double-include is error prone.

Note several Jira's reporting issues with HADOOP_LOG_DIR set to /user/user 
(e.g. /root/root, /hadoop/hadop, etc).  This is because hadoop-env.sh has done 
"HADOOP_LOG_DIR=$HADOOP_LOG_DIR/$user".  Many fixes for those issues are around 
addressing that one line, but it seems that this is going to be a recurring 
theme of breakages.  It's probably also why services are routinely started with 
many command line arguments repeated multiple times.

I'm not familiar enough with the "design" of all the scripts, so not sure what 
the solution should be.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

Re: Using test-patch.sh

[madhu phatak]

Update on the issue. The issue was that mvn was not in path. Now able to
use test-patch successfully.

On Wed, May 30, 2012 at 10:48 AM, madhu phatak  wrote:

> I done the mvn install and it works fine. I will looking into log under
> tmp and let you know.
> On May 30, 2012 10:24 AM, "Harsh J"  wrote:
>
>> Hi,
>>
>> Does 'mvn compile' pass, outside of test-patch? Try rebasing/svn-up,
>> in case your copy of trunk had its build broken for some reason. You
>> can also check the logs test-patch writes to (usually under /tmp) for
>> the reasons.
>>
>> On Wed, May 30, 2012 at 10:16 AM, madhu phatak 
>> wrote:
>> > Hi Harsh,
>> >  If I run test-patch after mvn clean it shows following error
>> >
>> >   Pre-build trunk to verify trunk stability and javac warnings
>> >
>> >  Trunk compilation is broken?
>> >
>> >
>> > On Tue, May 29, 2012 at 11:19 PM, Harsh J  wrote:
>> >
>> >> Hi,
>> >>
>> >> Run an {{mvn clean}} before you invoke test-patch. This error should
>> >> go away then.
>> >>
>> >> We may also need to add these target directories to svnignore (they
>> >> appear to be newly mavenized modules). Please file a HADOOP jira for
>> >> that.
>> >>
>> >> On Tue, May 29, 2012 at 11:15 PM, madhu phatak 
>> >> wrote:
>> >> > Hi,
>> >> >  I am trying to use test-patch.sh to test my patch but getting
>> following
>> >> > error
>> >> >
>> >> >  ERROR: can't run in a workspace that contains the following
>> >> modifications
>> >> > ?   hadoop-tools/hadoop-datajoin/target
>> >> > ?   hadoop-tools/hadoop-gridmix/target
>> >> >
>> >> > I am trying to apply test patch on fresh svn checkout . Can anyone
>> advice
>> >> > on  how to get rid of this error?
>> >> >
>> >> > --
>> >> > https://github.com/zinnia-phatak-dev/Nectar
>> >>
>> >>
>> >>
>> >> --
>> >> Harsh J
>> >>
>> >
>> >
>> >
>> > --
>> > https://github.com/zinnia-phatak-dev/Nectar
>>
>>
>>
>> --
>> Harsh J
>>
>


-- 
https://github.com/zinnia-phatak-dev/Nectar

Build failed in Jenkins: Hadoop-Common-0.23-Build #270

[Apache Jenkins Server]

See 

Changes:

[bobby] svn merge -c 1344763 FIXES: MAPREDUCE-4297. Usersmap file in gridmix 
should not fail on empty lines (Ravi Prakash via bobby)

--
[...truncated 12429 lines...]
  [javadoc] Loading source files for package org.apache.hadoop.fs.ftp...
  [javadoc] Loading source files for package org.apache.hadoop.fs.kfs...
  [javadoc] Loading source files for package org.apache.hadoop.fs.local...
  [javadoc] Loading source files for package org.apache.hadoop.fs.permission...
  [javadoc] Loading source files for package org.apache.hadoop.fs.s3...
  [javadoc] Loading source files for package org.apache.hadoop.fs.s3native...
  [javadoc] Loading source files for package org.apache.hadoop.fs.shell...
  [javadoc] Loading source files for package org.apache.hadoop.fs.viewfs...
  [javadoc] Loading source files for package org.apache.hadoop.http...
  [javadoc] Loading source files for package org.apache.hadoop.http.lib...
  [javadoc] Loading source files for package org.apache.hadoop.io...
  [javadoc] Loading source files for package org.apache.hadoop.io.compress...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.bzip2...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.lz4...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.snappy...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.zlib...
  [javadoc] Loading source files for package org.apache.hadoop.io.file.tfile...
  [javadoc] Loading source files for package org.apache.hadoop.io.nativeio...
  [javadoc] Loading source files for package org.apache.hadoop.io.retry...
  [javadoc] Loading source files for package org.apache.hadoop.io.serializer...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.serializer.avro...
  [javadoc] Loading source files for package org.apache.hadoop.ipc...
  [javadoc] Loading source files for package org.apache.hadoop.ipc.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.jmx...
  [javadoc] Loading source files for package org.apache.hadoop.log...
  [javadoc] Loading source files for package org.apache.hadoop.log.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.file...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics.ganglia...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.jvm...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.spi...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.util...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.annotation...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.filter...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.impl...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.lib...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.sink...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.sink.ganglia...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.source...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.util...
  [javadoc] Loading source files for package org.apache.hadoop.net...
  [javadoc] Loading source files for package org.apache.hadoop.record...
  [javadoc] Loading source files for package 
org.apache.hadoop.record.compiler...
  [javadoc] Loading source files for package 
org.apache.hadoop.record.compiler.ant...
  [javadoc] Loading source files for package 
org.apache.hadoop.record.compiler.generated...
  [javadoc] Loading source files for package org.apache.hadoop.record.meta...
  [javadoc] Loading source files for package org.apache.hadoop.security...
  [javadoc] Loading source files for package 
org.apache.hadoop.security.authorize...
  [javadoc] Loading source files for package org.apache.hadoop.security.token...
  [javadoc] Loading source files for package 
org.apache.hadoop.security.token.delegation...
  [javadoc] Loading source files for package org.apache.hadoop.tools...
  [javadoc] Loading source files for package org.apache.hadoop.util...
  [javadoc] Loading source files for package org.apache.hadoop.util.bloom...
  [javadoc] Loading source files for package org.apache.hadoop.util.hash...
  [javadoc] 2 errors
 [xslt] Processing 

 to 

 [xslt] Loading stylesheet 
/home/jenkins/tools/findbugs/latest/src/xsl/default.