[jira] [Created] (HADOOP-7294) FileUtil uses wrong stat command for FreeBSD
FileUtil uses wrong stat command for FreeBSD Key: HADOOP-7294 URL: https://issues.apache.org/jira/browse/HADOOP-7294 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 0.21.0 Environment: FreeBSD 8.0-STABLE Reporter: Vitalii Tymchyshyn I get next exception when try to use append: 2011-05-16 17:07:54,648 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(10.112.0.207:50010, storageID=DS-1047171559- 10.112.0.207-50010-1302796304164, infoPort=50075, ipcPort=50020):DataXceiver java.io.IOException: Failed to get link count on file /var/data/hdfs/data/current/finalized/subdir26/subdir17/subdir55/blk_-1266943884751786595: message=null; error=stat: illegal option -- c; exit value=1 at org.apache.hadoop.fs.FileUtil.createIOException(FileUtil.java:709) at org.apache.hadoop.fs.FileUtil.access$000(FileUtil.java:42) at org.apache.hadoop.fs.FileUtil$HardLink.getLinkCount(FileUtil.java:682) at org.apache.hadoop.hdfs.server.datanode.ReplicaInfo.unlinkBlock(ReplicaInfo.java:215) at org.apache.hadoop.hdfs.server.datanode.FSDataset.append(FSDataset.java:1116) It seems that FreeBSD is treated like UNIX and so calls 'stat -c%h', while FreeBSD is much more like Mac (since they have same BSD roots): $ stat --help stat: illegal option -- - usage: stat [-FlLnqrsx] [-f format] [-t timefmt] [file ...] $ stat -f%l a_file 1 -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
Hadoop-Common-trunk-Commit - Build # 600 - Still Failing
See https://builds.apache.org/hudson/job/Hadoop-Common-trunk-Commit/600/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2141 lines...] [artifact:install-provider] for artifact: [artifact:install-provider] unspecified:unspecified:jar:0.0 [artifact:install-provider] [artifact:install-provider] from the specified remote repositories: [artifact:install-provider] central (http://repo1.maven.org/maven2) [artifact:install-provider] [artifact:install-provider] BUILD FAILED /grid/0/hudson/hudson-slave/workspace/Hadoop-Common-trunk-Commit/trunk/build.xml:1353: Error downloading wagon provider from the remote repository: Missing: -- 1) org.apache.maven.wagon:wagon-http:jar:1.0-beta-2 Try downloading the file manually from the project website. Then, install it using the command: mvn install:install-file -DgroupId=org.apache.maven.wagon -DartifactId=wagon-http -Dversion=1.0-beta-2 -Dpackaging=jar -Dfile=/path/to/file Alternatively, if you host your own repository you can deploy the file there: mvn deploy:deploy-file -DgroupId=org.apache.maven.wagon -DartifactId=wagon-http -Dversion=1.0-beta-2 -Dpackaging=jar -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] Path to dependency: 1) unspecified:unspecified:jar:0.0 2) org.apache.maven.wagon:wagon-http:jar:1.0-beta-2 -- 1 required artifact is missing. for artifact: unspecified:unspecified:jar:0.0 from the specified remote repositories: central (http://repo1.maven.org/maven2) Total time: 1 minute 5 seconds == == STORE: saving artifacts == == mv: cannot stat `build/*.tar.gz': No such file or directory mv: cannot stat `build/test/findbugs': No such file or directory mv: cannot stat `build/docs/api': No such file or directory Build Failed [FINDBUGS] Skipping publisher since build result is FAILURE Recording fingerprints Archiving artifacts Recording test results Publishing Javadoc Publishing Clover coverage report... No Clover report will be published due to a Build Failure Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
[jira] [Created] (HADOOP-7295) Create a test-patch script for Hudson
Create a test-patch script for Hudson - Key: HADOOP-7295 URL: https://issues.apache.org/jira/browse/HADOOP-7295 Project: Hadoop Common Issue Type: Task Reporter: Eli Collins We should create a script that Hudson uses to execute test-patch that is in source control so modifications to test-patch.sh arguments can be done w/o updating Hudson. The script would execute the following, and take just the password as an argument. {noformat} ${ANT_HOME}/bin/ant \ -Dpatch.file=foobar \ -Dscratch.dir=${WORKSPACE}/patchprocess \ -Dsupport.dir=/homes/hudson/buildSupport \ -Dps.cmd=/bin/ps \ -Dwget.cmd=/usr/bin/wget \ -Djiracli.cmd=/homes/hudson/tools/jiracli-1.5/jira \ -Dsvn.cmd=/usr/bin/svn \ -Dgrep.cmd=/bin/grep \ -Dpatch.cmd=/usr/bin/patch \ -Dfindbugs.home=/homes/hudson/tools/findbugs/latest \ -Dforrest.home=/homes/hudson/tools/forrest/latest \ -Declipse.home=/homes/hudson/tools/eclipse/latest \ -Dpython.home=/homes/hudson/tools/python/latest \ -Djira.passwd= \ -Dcurl.cmd=/usr/bin/curl \ -Ddefect=HADOOP-${ISSUE_NUM} \ hudson-test-patch {noformat} -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Hadoop-Mapreduce-trunk-Commit - Build # 672 - Still Failing
I think I tracked this down - somehow "~/.m2" had gotten replaced with an empty file on the build servers. Nigel has since fixed that. We'll see if it fixes itself. -Todd On Fri, May 13, 2011 at 3:28 PM, Todd Lipcon wrote: > Does anyone understand what's up with our wagon-http? MR and HDFS builds > have been failing recently because of this. > > -Todd > > > On Fri, May 13, 2011 at 3:14 PM, Apache Jenkins Server < > hud...@hudson.apache.org> wrote: > >> See >> https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/672/ >> >> >> ### >> ## LAST 60 LINES OF THE CONSOLE >> ### >> [...truncated 4532 lines...] >> [artifact:install-provider] for artifact: >> [artifact:install-provider] unspecified:unspecified:jar:0.0 >> [artifact:install-provider] >> [artifact:install-provider] from the specified remote repositories: >> [artifact:install-provider] central (http://repo1.maven.org/maven2) >> [artifact:install-provider] >> [artifact:install-provider] >> >> BUILD FAILED >> /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/build.xml:1540: >> Error downloading wagon provider from the remote repository: Missing: >> -- >> 1) org.apache.maven.wagon:wagon-http:jar:1.0-beta-2 >> >> Try downloading the file manually from the project website. >> >> Then, install it using the command: >> mvn install:install-file -DgroupId=org.apache.maven.wagon >> -DartifactId=wagon-http -Dversion=1.0-beta-2 -Dpackaging=jar >> -Dfile=/path/to/file >> >> Alternatively, if you host your own repository you can deploy the file >> there: >> mvn deploy:deploy-file -DgroupId=org.apache.maven.wagon >> -DartifactId=wagon-http -Dversion=1.0-beta-2 -Dpackaging=jar >> -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] >> >> Path to dependency: >>1) unspecified:unspecified:jar:0.0 >>2) org.apache.maven.wagon:wagon-http:jar:1.0-beta-2 >> >> -- >> 1 required artifact is missing. >> >> for artifact: >> unspecified:unspecified:jar:0.0 >> >> from the specified remote repositories: >> central (http://repo1.maven.org/maven2) >> >> >> >> Total time: 3 minutes 31 seconds >> >> >> == >> == >> STORE: saving artifacts >> == >> == >> >> >> mv: cannot stat `build/*.tar.gz': No such file or directory >> mv: cannot stat `build/test/findbugs': No such file or directory >> mv: cannot stat `build/docs/api': No such file or directory >> Build Failed >> [FINDBUGS] Skipping publisher since build result is FAILURE >> Recording fingerprints >> Archiving artifacts >> Recording test results >> Publishing Javadoc >> Publishing Clover coverage report... >> No Clover report will be published due to a Build Failure >> Email was triggered for: Failure >> Sending email for trigger: Failure >> >> >> >> >> ### >> ## FAILED TESTS (if any) >> ## >> No tests ran. >> > > > > -- > Todd Lipcon > Software Engineer, Cloudera > -- Todd Lipcon Software Engineer, Cloudera
[jira] [Created] (HADOOP-7296) The FsPermission(FsPermission) constructor does not use the sticky bit
The FsPermission(FsPermission) constructor does not use the sticky bit -- Key: HADOOP-7296 URL: https://issues.apache.org/jira/browse/HADOOP-7296 Project: Hadoop Common Issue Type: Bug Components: fs Reporter: Siddharth Seth Priority: Minor The FsPermission(FsPermission) constructor copies u, g, o from the supplied FsPermission object but ignores the sticky bit. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira