[jira] [Created] (HADOOP-7294) FileUtil uses wrong stat command for FreeBSD

2011-05-16 Thread Vitalii Tymchyshyn (JIRA)
FileUtil uses wrong stat command for FreeBSD


 Key: HADOOP-7294
 URL: https://issues.apache.org/jira/browse/HADOOP-7294
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Affects Versions: 0.21.0
 Environment: FreeBSD 8.0-STABLE
Reporter: Vitalii Tymchyshyn


I get next exception when try to use append:

2011-05-16 17:07:54,648 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: 
DatanodeRegistration(10.112.0.207:50010, storageID=DS-1047171559-
10.112.0.207-50010-1302796304164, infoPort=50075, ipcPort=50020):DataXceiver
java.io.IOException: Failed to get link count on file 
/var/data/hdfs/data/current/finalized/subdir26/subdir17/subdir55/blk_-1266943884751786595:
 message=null; error=stat: illegal option -- c; exit value=1
at org.apache.hadoop.fs.FileUtil.createIOException(FileUtil.java:709)
at org.apache.hadoop.fs.FileUtil.access$000(FileUtil.java:42)
at 
org.apache.hadoop.fs.FileUtil$HardLink.getLinkCount(FileUtil.java:682)
at 
org.apache.hadoop.hdfs.server.datanode.ReplicaInfo.unlinkBlock(ReplicaInfo.java:215)
at 
org.apache.hadoop.hdfs.server.datanode.FSDataset.append(FSDataset.java:1116)

It seems that FreeBSD is treated like UNIX and so calls 'stat -c%h', while 
FreeBSD is much more like Mac (since they have same BSD roots):

$ stat --help
stat: illegal option -- -
usage: stat [-FlLnqrsx] [-f format] [-t timefmt] [file ...]

$ stat -f%l a_file
1


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


Hadoop-Common-trunk-Commit - Build # 600 - Still Failing

2011-05-16 Thread Apache Jenkins Server
See https://builds.apache.org/hudson/job/Hadoop-Common-trunk-Commit/600/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 2141 lines...]
[artifact:install-provider] for artifact: 
[artifact:install-provider]   unspecified:unspecified:jar:0.0
[artifact:install-provider] 
[artifact:install-provider] from the specified remote repositories:
[artifact:install-provider]   central (http://repo1.maven.org/maven2)
[artifact:install-provider] 
[artifact:install-provider] 

BUILD FAILED
/grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk-Commit/trunk/build.xml:1353:
 Error downloading wagon provider from the remote repository: Missing:
--
1) org.apache.maven.wagon:wagon-http:jar:1.0-beta-2

  Try downloading the file manually from the project website.

  Then, install it using the command: 
  mvn install:install-file -DgroupId=org.apache.maven.wagon 
-DartifactId=wagon-http -Dversion=1.0-beta-2 -Dpackaging=jar 
-Dfile=/path/to/file

  Alternatively, if you host your own repository you can deploy the file there: 
  mvn deploy:deploy-file -DgroupId=org.apache.maven.wagon 
-DartifactId=wagon-http -Dversion=1.0-beta-2 -Dpackaging=jar 
-Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]

  Path to dependency: 
1) unspecified:unspecified:jar:0.0
2) org.apache.maven.wagon:wagon-http:jar:1.0-beta-2

--
1 required artifact is missing.

for artifact: 
  unspecified:unspecified:jar:0.0

from the specified remote repositories:
  central (http://repo1.maven.org/maven2)



Total time: 1 minute 5 seconds


==
==
STORE: saving artifacts
==
==


mv: cannot stat `build/*.tar.gz': No such file or directory
mv: cannot stat `build/test/findbugs': No such file or directory
mv: cannot stat `build/docs/api': No such file or directory
Build Failed
[FINDBUGS] Skipping publisher since build result is FAILURE
Recording fingerprints
Archiving artifacts
Recording test results
Publishing Javadoc
Publishing Clover coverage report...
No Clover report will be published due to a Build Failure
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
No tests ran.


[jira] [Created] (HADOOP-7295) Create a test-patch script for Hudson

2011-05-16 Thread Eli Collins (JIRA)
Create a test-patch script for Hudson
-

 Key: HADOOP-7295
 URL: https://issues.apache.org/jira/browse/HADOOP-7295
 Project: Hadoop Common
  Issue Type: Task
Reporter: Eli Collins


We should create a script that Hudson uses to execute test-patch that is in 
source control so modifications to test-patch.sh arguments can be done w/o 
updating Hudson.

The script would execute the following, and take just the password as an 
argument.

{noformat}
${ANT_HOME}/bin/ant \
-Dpatch.file=foobar \
-Dscratch.dir=${WORKSPACE}/patchprocess \
-Dsupport.dir=/homes/hudson/buildSupport  \
-Dps.cmd=/bin/ps \
-Dwget.cmd=/usr/bin/wget \
-Djiracli.cmd=/homes/hudson/tools/jiracli-1.5/jira \
-Dsvn.cmd=/usr/bin/svn \
-Dgrep.cmd=/bin/grep \
-Dpatch.cmd=/usr/bin/patch \
-Dfindbugs.home=/homes/hudson/tools/findbugs/latest \
-Dforrest.home=/homes/hudson/tools/forrest/latest \
-Declipse.home=/homes/hudson/tools/eclipse/latest \
-Dpython.home=/homes/hudson/tools/python/latest \
-Djira.passwd= \
-Dcurl.cmd=/usr/bin/curl \
-Ddefect=HADOOP-${ISSUE_NUM} \
hudson-test-patch
{noformat}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


Re: Hadoop-Mapreduce-trunk-Commit - Build # 672 - Still Failing

2011-05-16 Thread Todd Lipcon
I think I tracked this down - somehow "~/.m2" had gotten replaced with an
empty file on the build servers. Nigel has since fixed that. We'll see if it
fixes itself.

-Todd

On Fri, May 13, 2011 at 3:28 PM, Todd Lipcon  wrote:

> Does anyone understand what's up with our wagon-http? MR and HDFS builds
> have been failing recently because of this.
>
> -Todd
>
>
> On Fri, May 13, 2011 at 3:14 PM, Apache Jenkins Server <
> hud...@hudson.apache.org> wrote:
>
>> See
>> https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/672/
>>
>>
>> ###
>> ## LAST 60 LINES OF THE CONSOLE
>> ###
>> [...truncated 4532 lines...]
>> [artifact:install-provider] for artifact:
>> [artifact:install-provider]   unspecified:unspecified:jar:0.0
>> [artifact:install-provider]
>> [artifact:install-provider] from the specified remote repositories:
>> [artifact:install-provider]   central (http://repo1.maven.org/maven2)
>> [artifact:install-provider]
>> [artifact:install-provider]
>>
>> BUILD FAILED
>> /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/build.xml:1540:
>> Error downloading wagon provider from the remote repository: Missing:
>> --
>> 1) org.apache.maven.wagon:wagon-http:jar:1.0-beta-2
>>
>>  Try downloading the file manually from the project website.
>>
>>  Then, install it using the command:
>>  mvn install:install-file -DgroupId=org.apache.maven.wagon
>> -DartifactId=wagon-http -Dversion=1.0-beta-2 -Dpackaging=jar
>> -Dfile=/path/to/file
>>
>>  Alternatively, if you host your own repository you can deploy the file
>> there:
>>  mvn deploy:deploy-file -DgroupId=org.apache.maven.wagon
>> -DartifactId=wagon-http -Dversion=1.0-beta-2 -Dpackaging=jar
>> -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
>>
>>  Path to dependency:
>>1) unspecified:unspecified:jar:0.0
>>2) org.apache.maven.wagon:wagon-http:jar:1.0-beta-2
>>
>> --
>> 1 required artifact is missing.
>>
>> for artifact:
>>  unspecified:unspecified:jar:0.0
>>
>> from the specified remote repositories:
>>  central (http://repo1.maven.org/maven2)
>>
>>
>>
>> Total time: 3 minutes 31 seconds
>>
>>
>> ==
>> ==
>> STORE: saving artifacts
>> ==
>> ==
>>
>>
>> mv: cannot stat `build/*.tar.gz': No such file or directory
>> mv: cannot stat `build/test/findbugs': No such file or directory
>> mv: cannot stat `build/docs/api': No such file or directory
>> Build Failed
>> [FINDBUGS] Skipping publisher since build result is FAILURE
>> Recording fingerprints
>> Archiving artifacts
>> Recording test results
>> Publishing Javadoc
>> Publishing Clover coverage report...
>> No Clover report will be published due to a Build Failure
>> Email was triggered for: Failure
>> Sending email for trigger: Failure
>>
>>
>>
>>
>> ###
>> ## FAILED TESTS (if any)
>> ##
>> No tests ran.
>>
>
>
>
> --
> Todd Lipcon
> Software Engineer, Cloudera
>



-- 
Todd Lipcon
Software Engineer, Cloudera


[jira] [Created] (HADOOP-7296) The FsPermission(FsPermission) constructor does not use the sticky bit

2011-05-16 Thread Siddharth Seth (JIRA)
The FsPermission(FsPermission) constructor does not use the sticky bit
--

 Key: HADOOP-7296
 URL: https://issues.apache.org/jira/browse/HADOOP-7296
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Reporter: Siddharth Seth
Priority: Minor


The FsPermission(FsPermission) constructor copies u, g, o from the supplied 
FsPermission object but ignores the sticky bit.


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira