Re: (Very) newbie questions
Do you mind listing the unit tests that failed on your computer ? Cheers On Tue, Jun 3, 2014 at 3:31 PM, Christian Convey wrote: > I'm completely new to Hadoop, and I'm trying to build it for the first > time. I cloned the Git repository and I'm building the tag version > release-2.4.0. > > I get a clean "mvn compile -Pnative", but I'm getting a few unit tests > failing when I run "mvn test". > > Does anyone know to what extent Hadoop (Common) 's unit tests failing is a > serious issue? I.e., can I have a healthy Hadoop build, while still having > had a few unit tests fail? >
Re: (Very) newbie questions
On Tue, Jun 3, 2014 at 6:37 PM, Ted Yu wrote: > Do you mind listing the unit tests that failed on your computer ? > > Cheers > > > On Tue, Jun 3, 2014 at 3:31 PM, Christian Convey < > christian.con...@gmail.com> wrote: > >> I'm completely new to Hadoop, and I'm trying to build it for the first >> time. I cloned the Git repository and I'm building the tag version >> release-2.4.0. >> >> I get a clean "mvn compile -Pnative", but I'm getting a few unit tests >> failing when I run "mvn test". >> >> Does anyone know to what extent Hadoop (Common) 's unit tests failing is >> a serious issue? I.e., can I have a healthy Hadoop build, while still >> having had a few unit tests fail? >> > > The one that jumped out me is "org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem". There may be others, but I haven't noticed them.
Re: (Very) newbie questions
On Tue, Jun 3, 2014 at 8:19 PM, Christian Convey wrote: > > > On Tue, Jun 3, 2014 at 6:37 PM, Ted Yu wrote: > >> Do you mind listing the unit tests that failed on your computer ? >> >> Cheers >> >> >> On Tue, Jun 3, 2014 at 3:31 PM, Christian Convey < >> christian.con...@gmail.com> wrote: >> >>> I'm completely new to Hadoop, and I'm trying to build it for the first >>> time. I cloned the Git repository and I'm building the tag version >>> release-2.4.0. >>> >>> I get a clean "mvn compile -Pnative", but I'm getting a few unit tests >>> failing when I run "mvn test". >>> >>> Does anyone know to what extent Hadoop (Common) 's unit tests failing is >>> a serious issue? I.e., can I have a healthy Hadoop build, while still >>> having had a few unit tests fail? >>> >> >> > The one that jumped out me is > "org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem". There may be others, > but I haven't noticed them. > Actually, I believe this is the pertinent output: Tests in error: TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testDanglingLink:163 » IO Pat... TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 » IO TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 » IO TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testDanglingLink:163 » IO Path... TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 » IO TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 » IO Tests run: 2285, Failures: 24, Errors: 6, Skipped: 41
Re: (Very) newbie questions
TestSymlinkLocalFS is an abstract class. The actual test is in TestSymlinkLocalFSFileContext / TestSymlinkLocalFSFileSystem. Do they pass on your computer ? On Tue, Jun 3, 2014 at 5:21 PM, Christian Convey wrote: > > On Tue, Jun 3, 2014 at 8:19 PM, Christian Convey < > christian.con...@gmail.com> wrote: > >> >> >> On Tue, Jun 3, 2014 at 6:37 PM, Ted Yu wrote: >> >>> Do you mind listing the unit tests that failed on your computer ? >>> >>> Cheers >>> >>> >>> On Tue, Jun 3, 2014 at 3:31 PM, Christian Convey < >>> christian.con...@gmail.com> wrote: >>> I'm completely new to Hadoop, and I'm trying to build it for the first time. I cloned the Git repository and I'm building the tag version release-2.4.0. I get a clean "mvn compile -Pnative", but I'm getting a few unit tests failing when I run "mvn test". Does anyone know to what extent Hadoop (Common) 's unit tests failing is a serious issue? I.e., can I have a healthy Hadoop build, while still having had a few unit tests fail? >>> >>> >> The one that jumped out me is >> "org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem". There may be others, >> but I haven't noticed them. >> > > Actually, I believe this is the pertinent output: > > > Tests in error: > TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testDanglingLink:163 » > IO Pat... > > TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 > » IO > > TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 > » IO > TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testDanglingLink:163 » > IO Path... > > TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 > » IO > > TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 > » IO > > Tests run: 2285, Failures: 24, Errors: 6, Skipped: 41 > > >
Re: (Very) newbie questions
Hi Ted and Christian, In fact, the problem is filed as HADOOP-10510. https://issues.apache.org/jira/browse/HADOOP-10510 This problem is also reproduced on my local, but not on the other environment. Maybe it's environment-dependent problem. However, I cannot understand the condition this problem occurs correctly. Thanks, - Tsuyoshi On Tue, Jun 3, 2014 at 5:49 PM, Ted Yu wrote: > TestSymlinkLocalFS is an abstract class. > > The actual test is in TestSymlinkLocalFSFileContext / > TestSymlinkLocalFSFileSystem. > Do they pass on your computer ? > > > > On Tue, Jun 3, 2014 at 5:21 PM, Christian Convey > wrote: >> >> >> On Tue, Jun 3, 2014 at 8:19 PM, Christian Convey >> wrote: >>> >>> >>> >>> On Tue, Jun 3, 2014 at 6:37 PM, Ted Yu wrote: Do you mind listing the unit tests that failed on your computer ? Cheers On Tue, Jun 3, 2014 at 3:31 PM, Christian Convey wrote: > > I'm completely new to Hadoop, and I'm trying to build it for the first > time. I cloned the Git repository and I'm building the tag version > release-2.4.0. > > I get a clean "mvn compile -Pnative", but I'm getting a few unit tests > failing when I run "mvn test". > > Does anyone know to what extent Hadoop (Common) 's unit tests failing > is a serious issue? I.e., can I have a healthy Hadoop build, while still > having had a few unit tests fail? >>> >>> The one that jumped out me is >>> "org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem". There may be others, >>> but I haven't noticed them. >> >> >> Actually, I believe this is the pertinent output: >> >> >> Tests in error: >> TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testDanglingLink:163 » >> IO Pat... >> >> TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 >> » IO >> >> TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 >> » IO >> TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testDanglingLink:163 » >> IO Path... >> >> TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 >> » IO >> >> TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 >> » IO >> >> Tests run: 2285, Failures: 24, Errors: 6, Skipped: 41 >> >> > -- - Tsuyoshi
Re: (Very) newbie questions
Thanks for the pointer, Tsuyoshi. I ran TestSymlinkLocalFSFileContext on Mac and Linux - the test passed. I think wrapper.getFileLinkStatus() should be added to assertion message when assertTrue(wrapper.isSymlink(linkAbs)) fails. This would give us more information. Cheers On Tue, Jun 3, 2014 at 5:53 PM, Tsuyoshi OZAWA wrote: > Hi Ted and Christian, > > In fact, the problem is filed as HADOOP-10510. > https://issues.apache.org/jira/browse/HADOOP-10510 > This problem is also reproduced on my local, but not on the other > environment. Maybe it's environment-dependent problem. However, I > cannot understand the condition this problem occurs correctly. > > Thanks, > - Tsuyoshi > > > On Tue, Jun 3, 2014 at 5:49 PM, Ted Yu wrote: > > TestSymlinkLocalFS is an abstract class. > > > > The actual test is in TestSymlinkLocalFSFileContext / > > TestSymlinkLocalFSFileSystem. > > Do they pass on your computer ? > > > > > > > > On Tue, Jun 3, 2014 at 5:21 PM, Christian Convey > > wrote: > >> > >> > >> On Tue, Jun 3, 2014 at 8:19 PM, Christian Convey > >> wrote: > >>> > >>> > >>> > >>> On Tue, Jun 3, 2014 at 6:37 PM, Ted Yu wrote: > > Do you mind listing the unit tests that failed on your computer ? > > Cheers > > > On Tue, Jun 3, 2014 at 3:31 PM, Christian Convey > wrote: > > > > I'm completely new to Hadoop, and I'm trying to build it for the > first > > time. I cloned the Git repository and I'm building the tag version > > release-2.4.0. > > > > I get a clean "mvn compile -Pnative", but I'm getting a few unit > tests > > failing when I run "mvn test". > > > > Does anyone know to what extent Hadoop (Common) 's unit tests failing > > is a serious issue? I.e., can I have a healthy Hadoop build, while > still > > having had a few unit tests fail? > > > >>> > >>> The one that jumped out me is > >>> "org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem". There may be > others, > >>> but I haven't noticed them. > >> > >> > >> Actually, I believe this is the pertinent output: > >> > >> > >> Tests in error: > >> TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testDanglingLink:163 > » > >> IO Pat... > >> > >> > TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 > >> » IO > >> > >> > TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 > >> » IO > >> TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testDanglingLink:163 » > >> IO Path... > >> > >> > TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 > >> » IO > >> > >> > TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 > >> » IO > >> > >> Tests run: 2285, Failures: 24, Errors: 6, Skipped: 41 > >> > >> > > > > > > -- > - Tsuyoshi >
Re: (Very) newbie questions
I'm going to try looking into it today, although I'm not sure how quickly I'll figure it out since I'm new to Maven. FYI, I'm getting this using Linux Mint 17 32-bit MATE edition, inside a VirtualBox VM, on OS X. On Wed, Jun 4, 2014 at 11:59 AM, Ted Yu wrote: > Thanks for the pointer, Tsuyoshi. > > I ran TestSymlinkLocalFSFileContext on Mac and Linux - the test passed. > > I think wrapper.getFileLinkStatus() should be added to assertion message > when assertTrue(wrapper.isSymlink(linkAbs)) fails. This would give us > more information. > > Cheers > > > On Tue, Jun 3, 2014 at 5:53 PM, Tsuyoshi OZAWA > wrote: > >> Hi Ted and Christian, >> >> In fact, the problem is filed as HADOOP-10510. >> https://issues.apache.org/jira/browse/HADOOP-10510 >> This problem is also reproduced on my local, but not on the other >> environment. Maybe it's environment-dependent problem. However, I >> cannot understand the condition this problem occurs correctly. >> >> Thanks, >> - Tsuyoshi >> >> >> On Tue, Jun 3, 2014 at 5:49 PM, Ted Yu wrote: >> > TestSymlinkLocalFS is an abstract class. >> > >> > The actual test is in TestSymlinkLocalFSFileContext / >> > TestSymlinkLocalFSFileSystem. >> > Do they pass on your computer ? >> > >> > >> > >> > On Tue, Jun 3, 2014 at 5:21 PM, Christian Convey >> > wrote: >> >> >> >> >> >> On Tue, Jun 3, 2014 at 8:19 PM, Christian Convey >> >> wrote: >> >>> >> >>> >> >>> >> >>> On Tue, Jun 3, 2014 at 6:37 PM, Ted Yu wrote: >> >> Do you mind listing the unit tests that failed on your computer ? >> >> Cheers >> >> >> On Tue, Jun 3, 2014 at 3:31 PM, Christian Convey >> wrote: >> > >> > I'm completely new to Hadoop, and I'm trying to build it for the >> first >> > time. I cloned the Git repository and I'm building the tag version >> > release-2.4.0. >> > >> > I get a clean "mvn compile -Pnative", but I'm getting a few unit >> tests >> > failing when I run "mvn test". >> > >> > Does anyone know to what extent Hadoop (Common) 's unit tests >> failing >> > is a serious issue? I.e., can I have a healthy Hadoop build, while >> still >> > having had a few unit tests fail? >> >> >> >>> >> >>> The one that jumped out me is >> >>> "org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem". There may be >> others, >> >>> but I haven't noticed them. >> >> >> >> >> >> Actually, I believe this is the pertinent output: >> >> >> >> >> >> Tests in error: >> >> >> TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testDanglingLink:163 » >> >> IO Pat... >> >> >> >> >> TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 >> >> » IO >> >> >> >> >> TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 >> >> » IO >> >> TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testDanglingLink:163 >> » >> >> IO Path... >> >> >> >> >> TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 >> >> » IO >> >> >> >> >> TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 >> >> » IO >> >> >> >> Tests run: 2285, Failures: 24, Errors: 6, Skipped: 41 >> >> >> >> >> > >> >> >> >> -- >> - Tsuyoshi >> > >
Re: (Very) newbie questions
To run a single test, you can use: mvn test -Dtest=TestSymlinkLocalFSFileContext Adding the assertion message shown below would give more information: Index: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/SymlinkBaseTest.java === --- hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/SymlinkBaseTest.java (revision 1599851) +++ hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/SymlinkBaseTest.java (working copy) @@ -374,7 +374,7 @@ assertEquals(fileSize, wrapper.getFileStatus(linkAbs).getLen()); // Check getFileLinkStatus -assertTrue(wrapper.isSymlink(linkAbs)); +assertTrue(linkAbs + ": " + wrapper.getFileLinkStatus(linkAbs), wrapper.isSymlink(linkAbs)); assertFalse(wrapper.getFileLinkStatus(linkAbs).isDirectory()); // Check getSymlink always returns a qualified target, except On Wed, Jun 4, 2014 at 9:08 AM, Christian Convey wrote: > I'm going to try looking into it today, although I'm not sure how quickly > I'll figure it out since I'm new to Maven. FYI, I'm getting this using > Linux Mint 17 32-bit MATE edition, inside a VirtualBox VM, on OS X. > > > On Wed, Jun 4, 2014 at 11:59 AM, Ted Yu wrote: > >> Thanks for the pointer, Tsuyoshi. >> >> I ran TestSymlinkLocalFSFileContext on Mac and Linux - the test passed. >> >> I think wrapper.getFileLinkStatus() should be added to assertion message >> when assertTrue(wrapper.isSymlink(linkAbs)) fails. This would give us >> more information. >> >> Cheers >> >> >> On Tue, Jun 3, 2014 at 5:53 PM, Tsuyoshi OZAWA >> wrote: >> >>> Hi Ted and Christian, >>> >>> In fact, the problem is filed as HADOOP-10510. >>> https://issues.apache.org/jira/browse/HADOOP-10510 >>> This problem is also reproduced on my local, but not on the other >>> environment. Maybe it's environment-dependent problem. However, I >>> cannot understand the condition this problem occurs correctly. >>> >>> Thanks, >>> - Tsuyoshi >>> >>> >>> On Tue, Jun 3, 2014 at 5:49 PM, Ted Yu wrote: >>> > TestSymlinkLocalFS is an abstract class. >>> > >>> > The actual test is in TestSymlinkLocalFSFileContext / >>> > TestSymlinkLocalFSFileSystem. >>> > Do they pass on your computer ? >>> > >>> > >>> > >>> > On Tue, Jun 3, 2014 at 5:21 PM, Christian Convey >>> > wrote: >>> >> >>> >> >>> >> On Tue, Jun 3, 2014 at 8:19 PM, Christian Convey >>> >> wrote: >>> >>> >>> >>> >>> >>> >>> >>> On Tue, Jun 3, 2014 at 6:37 PM, Ted Yu wrote: >>> >>> Do you mind listing the unit tests that failed on your computer ? >>> >>> Cheers >>> >>> >>> On Tue, Jun 3, 2014 at 3:31 PM, Christian Convey >>> wrote: >>> > >>> > I'm completely new to Hadoop, and I'm trying to build it for the >>> first >>> > time. I cloned the Git repository and I'm building the tag version >>> > release-2.4.0. >>> > >>> > I get a clean "mvn compile -Pnative", but I'm getting a few unit >>> tests >>> > failing when I run "mvn test". >>> > >>> > Does anyone know to what extent Hadoop (Common) 's unit tests >>> failing >>> > is a serious issue? I.e., can I have a healthy Hadoop build, >>> while still >>> > having had a few unit tests fail? >>> >>> >>> >>> >>> >>> The one that jumped out me is >>> >>> "org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem". There may be >>> others, >>> >>> but I haven't noticed them. >>> >> >>> >> >>> >> Actually, I believe this is the pertinent output: >>> >> >>> >> >>> >> Tests in error: >>> >> >>> TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testDanglingLink:163 » >>> >> IO Pat... >>> >> >>> >> >>> TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 >>> >> » IO >>> >> >>> >> >>> TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 >>> >> » IO >>> >> >>> TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testDanglingLink:163 » >>> >> IO Path... >>> >> >>> >> >>> TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 >>> >> » IO >>> >> >>> >> >>> TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 >>> >> » IO >>> >> >>> >> Tests run: 2285, Failures: 24, Errors: 6, Skipped: 41 >>> >> >>> >> >>> > >>> >>> >>> >>> -- >>> - Tsuyoshi >>> >> >> >
Re: (Very) newbie questions
are you able to compile it using mvn compile -Pnative -Dmaven.test.skip=true? Raj K Singh http://in.linkedin.com/in/rajkrrsingh http://www.rajkrrsingh.blogspot.com Mobile Tel: +91 (0)9899821370 On Wed, Jun 4, 2014 at 4:01 AM, Christian Convey wrote: > I'm completely new to Hadoop, and I'm trying to build it for the first > time. I cloned the Git repository and I'm building the tag version > release-2.4.0. > > I get a clean "mvn compile -Pnative", but I'm getting a few unit tests > failing when I run "mvn test". > > Does anyone know to what extent Hadoop (Common) 's unit tests failing is a > serious issue? I.e., can I have a healthy Hadoop build, while still having > had a few unit tests fail? >
