[jira] [Commented] (HADOOP-16771) Update checkstyle to 8.26 and maven-checkstyle-plugin to 3.1.0
[ https://issues.apache.org/jira/browse/HADOOP-16771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000762#comment-17000762 ] Andras Bokor commented on HADOOP-16771: --- Thanks, [~aajisaka]! > Update checkstyle to 8.26 and maven-checkstyle-plugin to 3.1.0 > -- > > Key: HADOOP-16771 > URL: https://issues.apache.org/jira/browse/HADOOP-16771 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Affects Versions: 3.3.0 >Reporter: Andras Bokor >Assignee: Andras Bokor >Priority: Major > Fix For: 3.3.0, 3.1.4, 3.2.2 > > Attachments: HADOOP-16771.001.patch > > > After upgrading to the latest IDEA the IDE throws error message when I try to > load the checkstyle xml > {code:java} > TreeWalker is not allowed as a parent of LineLength Please review 'Parent > Module' section for this Check in web documentation if Check is > standard.{code} > [This is caused by some backward incompatible changes in checkstyle source > code|https://github.com/checkstyle/checkstyle/issues/2116] > IDEA uses checkstyle 8.26 > We should upgrade our checkstyle version to be compatible with IDEA's > checkstyle plugin which is the latest. > Also it's a good time to upgrade maven-checkstyle-plugin as well to 3.1. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] olegbonar commented on issue #1746: YARN-10014. Refactor boolean flag based approach in SchedConfCLI#run.
olegbonar commented on issue #1746: YARN-10014. Refactor boolean flag based approach in SchedConfCLI#run. URL: https://github.com/apache/hadoop/pull/1746#issuecomment-567898291 @ZhengZhenyu, could you help me to get it verified? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] iwasakims commented on issue #1772: YARN-10036. Install yarnpkg in Dockerfile
iwasakims commented on issue #1772: YARN-10036. Install yarnpkg in Dockerfile URL: https://github.com/apache/hadoop/pull/1772#issuecomment-567902328 +1 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] iwasakims opened a new pull request #1775: HDFS-15072. HDFS MiniCluster fails to start when run in directory path with a %.
iwasakims opened a new pull request #1775: HDFS-15072. HDFS MiniCluster fails to start when run in directory path with a %. URL: https://github.com/apache/hadoop/pull/1775 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16774) TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests
Vinayakumar B created HADOOP-16774: -- Summary: TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests Key: HADOOP-16774 URL: https://issues.apache.org/jira/browse/HADOOP-16774 Project: Hadoop Common Issue Type: Bug Reporter: Vinayakumar B {noformat} $ mvn test -Pparallel-tests -Dtest=TestReadWriteDiskValidator,TestDiskChecker -Pnative {noformat} {noformat} [INFO] Results: [INFO] [ERROR] Errors: [ERROR] TestDiskChecker.testCheckDir_normal:111->_checkDirs:158->createTempDir:153 » NoSuchFile [ERROR] TestDiskChecker.testCheckDir_normal_local:180->checkDirs:205->createTempDir:153 » NoSuchFile [ERROR] TestDiskChecker.testCheckDir_notDir:116->_checkDirs:158->createTempFile:142 » NoSuchFile [ERROR] TestDiskChecker.testCheckDir_notDir_local:185->checkDirs:205->createTempFile:142 » NoSuchFile [ERROR] TestDiskChecker.testCheckDir_notListable:131->_checkDirs:158->createTempDir:153 » NoSuchFile [ERROR] TestDiskChecker.testCheckDir_notListable_local:200->checkDirs:205->createTempDir:153 » NoSuchFile [ERROR] TestDiskChecker.testCheckDir_notReadable:121->_checkDirs:158->createTempDir:153 » NoSuchFile [ERROR] TestDiskChecker.testCheckDir_notReadable_local:190->checkDirs:205->createTempDir:153 » NoSuchFile [ERROR] TestDiskChecker.testCheckDir_notWritable:126->_checkDirs:158->createTempDir:153 » NoSuchFile [ERROR] TestDiskChecker.testCheckDir_notWritable_local:195->checkDirs:205->createTempDir:153 » NoSuchFile [ERROR] TestReadWriteDiskValidator.testCheckFailures:114 » NoSuchFile /usr1/code/hadoo... [ERROR] TestReadWriteDiskValidator.testReadWriteDiskValidator:62 » DiskError Disk Chec... [INFO] [ERROR] Tests run: 16, Failures: 0, Errors: 12, Skipped: 0 {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-16774) TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests
[ https://issues.apache.org/jira/browse/HADOOP-16774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B reassigned HADOOP-16774: -- Assignee: Vinayakumar B > TestDiskChecker and TestReadWriteDiskValidator fails when run with > -Pparallel-tests > --- > > Key: HADOOP-16774 > URL: https://issues.apache.org/jira/browse/HADOOP-16774 > Project: Hadoop Common > Issue Type: Bug >Reporter: Vinayakumar B >Assignee: Vinayakumar B >Priority: Major > > {noformat} > $ mvn test -Pparallel-tests > -Dtest=TestReadWriteDiskValidator,TestDiskChecker -Pnative > {noformat} > {noformat} > [INFO] Results: > [INFO] > [ERROR] Errors: > [ERROR] > TestDiskChecker.testCheckDir_normal:111->_checkDirs:158->createTempDir:153 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_normal_local:180->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir:116->_checkDirs:158->createTempFile:142 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir_local:185->checkDirs:205->createTempFile:142 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable:131->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable_local:200->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable:121->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable_local:190->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable:126->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable_local:195->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] TestReadWriteDiskValidator.testCheckFailures:114 » NoSuchFile > /usr1/code/hadoo... > [ERROR] TestReadWriteDiskValidator.testReadWriteDiskValidator:62 » > DiskError Disk Chec... > [INFO] > [ERROR] Tests run: 16, Failures: 0, Errors: 12, Skipped: 0 > {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] vinayakumarb opened a new pull request #1776: HADOOP-16774. TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests
vinayakumarb opened a new pull request #1776: HADOOP-16774. TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests URL: https://github.com/apache/hadoop/pull/1776 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16774) TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests
[ https://issues.apache.org/jira/browse/HADOOP-16774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-16774: --- Status: Patch Available (was: Open) > TestDiskChecker and TestReadWriteDiskValidator fails when run with > -Pparallel-tests > --- > > Key: HADOOP-16774 > URL: https://issues.apache.org/jira/browse/HADOOP-16774 > Project: Hadoop Common > Issue Type: Bug >Reporter: Vinayakumar B >Assignee: Vinayakumar B >Priority: Major > > {noformat} > $ mvn test -Pparallel-tests > -Dtest=TestReadWriteDiskValidator,TestDiskChecker -Pnative > {noformat} > {noformat} > [INFO] Results: > [INFO] > [ERROR] Errors: > [ERROR] > TestDiskChecker.testCheckDir_normal:111->_checkDirs:158->createTempDir:153 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_normal_local:180->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir:116->_checkDirs:158->createTempFile:142 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir_local:185->checkDirs:205->createTempFile:142 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable:131->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable_local:200->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable:121->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable_local:190->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable:126->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable_local:195->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] TestReadWriteDiskValidator.testCheckFailures:114 » NoSuchFile > /usr1/code/hadoo... > [ERROR] TestReadWriteDiskValidator.testReadWriteDiskValidator:62 » > DiskError Disk Chec... > [INFO] > [ERROR] Tests run: 16, Failures: 0, Errors: 12, Skipped: 0 > {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16774) TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests
[ https://issues.apache.org/jira/browse/HADOOP-16774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000988#comment-17000988 ] Vinayakumar B commented on HADOOP-16774: Created the PR. Please review. Rootcause: These tests will not create the parent dirs for tests. If test dir is not available, then fails as above In parallel-tests separate dirs needs to be created for each fork thread. # {{parallel-tests-createdir}} goal was not configured with {{test.build.data}} configuration. It was creating default dirs, but tests expect different dir. # {{parallel-tests-createdir}} also should be configured to run after {{create-log-dirs}} to avoid deletion of test dirs. Right now, {{parallel-tests-createdir}} runs first and creates some dirs and {{create-log-dirs }} deletes the {{target/test/data}} itself. Before recreating only {{target/test/data}} > TestDiskChecker and TestReadWriteDiskValidator fails when run with > -Pparallel-tests > --- > > Key: HADOOP-16774 > URL: https://issues.apache.org/jira/browse/HADOOP-16774 > Project: Hadoop Common > Issue Type: Bug >Reporter: Vinayakumar B >Assignee: Vinayakumar B >Priority: Major > > {noformat} > $ mvn test -Pparallel-tests > -Dtest=TestReadWriteDiskValidator,TestDiskChecker -Pnative > {noformat} > {noformat} > [INFO] Results: > [INFO] > [ERROR] Errors: > [ERROR] > TestDiskChecker.testCheckDir_normal:111->_checkDirs:158->createTempDir:153 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_normal_local:180->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir:116->_checkDirs:158->createTempFile:142 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir_local:185->checkDirs:205->createTempFile:142 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable:131->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable_local:200->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable:121->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable_local:190->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable:126->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable_local:195->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] TestReadWriteDiskValidator.testCheckFailures:114 » NoSuchFile > /usr1/code/hadoo... > [ERROR] TestReadWriteDiskValidator.testReadWriteDiskValidator:62 » > DiskError Disk Chec... > [INFO] > [ERROR] Tests run: 16, Failures: 0, Errors: 12, Skipped: 0 > {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16774) TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests
[ https://issues.apache.org/jira/browse/HADOOP-16774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000990#comment-17000990 ] Ayush Saxena commented on HADOOP-16774: --- Thanx [~vinayakumarb] for the analysis. The analysis and the fix LGTM +1 > TestDiskChecker and TestReadWriteDiskValidator fails when run with > -Pparallel-tests > --- > > Key: HADOOP-16774 > URL: https://issues.apache.org/jira/browse/HADOOP-16774 > Project: Hadoop Common > Issue Type: Bug >Reporter: Vinayakumar B >Assignee: Vinayakumar B >Priority: Major > > {noformat} > $ mvn test -Pparallel-tests > -Dtest=TestReadWriteDiskValidator,TestDiskChecker -Pnative > {noformat} > {noformat} > [INFO] Results: > [INFO] > [ERROR] Errors: > [ERROR] > TestDiskChecker.testCheckDir_normal:111->_checkDirs:158->createTempDir:153 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_normal_local:180->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir:116->_checkDirs:158->createTempFile:142 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir_local:185->checkDirs:205->createTempFile:142 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable:131->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable_local:200->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable:121->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable_local:190->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable:126->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable_local:195->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] TestReadWriteDiskValidator.testCheckFailures:114 » NoSuchFile > /usr1/code/hadoo... > [ERROR] TestReadWriteDiskValidator.testReadWriteDiskValidator:62 » > DiskError Disk Chec... > [INFO] > [ERROR] Tests run: 16, Failures: 0, Errors: 12, Skipped: 0 > {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] hadoop-yetus commented on issue #1776: HADOOP-16774. TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests
hadoop-yetus commented on issue #1776: HADOOP-16774. TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests URL: https://github.com/apache/hadoop/pull/1776#issuecomment-568024375 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 23m 35s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 1s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -1 :x: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ trunk Compile Tests _ | | +1 :green_heart: | mvninstall | 21m 50s | trunk passed | | +1 :green_heart: | compile | 20m 9s | trunk passed | | +1 :green_heart: | mvnsite | 1m 25s | trunk passed | | +1 :green_heart: | shadedclient | 57m 47s | branch has no errors when building and testing our client artifacts. | | +1 :green_heart: | javadoc | 1m 24s | trunk passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 0m 50s | the patch passed | | +1 :green_heart: | compile | 16m 39s | the patch passed | | +1 :green_heart: | javac | 16m 39s | the patch passed | | +1 :green_heart: | mvnsite | 1m 22s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 2s | The patch has no ill-formed XML file. | | +1 :green_heart: | shadedclient | 13m 59s | patch has no errors when building and testing our client artifacts. | | +1 :green_heart: | javadoc | 1m 27s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 9m 41s | hadoop-common in the patch failed. | | +1 :green_heart: | asflicense | 0m 45s | The patch does not generate ASF License warnings. | | | | 130m 28s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.ha.TestZKFailoverControllerStress | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1776/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/1776 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml | | uname | Linux 0666fcacd4b3 4.15.0-66-generic #75-Ubuntu SMP Tue Oct 1 05:24:09 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | trunk / f777cd3 | | Default Java | 1.8.0_232 | | unit | https://builds.apache.org/job/hadoop-multibranch/job/PR-1776/1/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt | | Test Results | https://builds.apache.org/job/hadoop-multibranch/job/PR-1776/1/testReport/ | | Max. process+thread count | 1378 (vs. ulimit of 5500) | | modules | C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common | | Console output | https://builds.apache.org/job/hadoop-multibranch/job/PR-1776/1/console | | versions | git=2.7.4 maven=3.3.9 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] hadoop-yetus commented on issue #1775: HDFS-15072. HDFS MiniCluster fails to start when run in directory path with a %.
hadoop-yetus commented on issue #1775: HDFS-15072. HDFS MiniCluster fails to start when run in directory path with a %. URL: https://github.com/apache/hadoop/pull/1775#issuecomment-568033382 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 30m 18s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | +1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. | ||| _ trunk Compile Tests _ | | +1 :green_heart: | mvninstall | 18m 25s | trunk passed | | +1 :green_heart: | compile | 1m 5s | trunk passed | | +1 :green_heart: | checkstyle | 0m 49s | trunk passed | | +1 :green_heart: | mvnsite | 1m 11s | trunk passed | | +1 :green_heart: | shadedclient | 14m 43s | branch has no errors when building and testing our client artifacts. | | +1 :green_heart: | javadoc | 1m 22s | trunk passed | | +0 :ok: | spotbugs | 2m 47s | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 :green_heart: | findbugs | 2m 45s | trunk passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 1m 4s | the patch passed | | +1 :green_heart: | compile | 0m 59s | the patch passed | | +1 :green_heart: | javac | 0m 59s | the patch passed | | +1 :green_heart: | checkstyle | 0m 39s | the patch passed | | +1 :green_heart: | mvnsite | 1m 4s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | shadedclient | 13m 13s | patch has no errors when building and testing our client artifacts. | | +1 :green_heart: | javadoc | 1m 20s | the patch passed | | +1 :green_heart: | findbugs | 2m 50s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 122m 41s | hadoop-hdfs in the patch failed. | | +1 :green_heart: | asflicense | 0m 47s | The patch does not generate ASF License warnings. | | | | 216m 23s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hdfs.server.namenode.ha.TestBootstrapAliasmap | | | hadoop.hdfs.TestFileChecksum | | | hadoop.hdfs.TestFileChecksumCompositeCrc | | | hadoop.hdfs.TestDecommissionWithStriped | | | hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy | | | hadoop.hdfs.TestDeadNodeDetection | | | hadoop.hdfs.TestDecommissionWithStripedBackoffMonitor | | | hadoop.hdfs.server.namenode.TestRedudantBlocks | | | hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots | | | hadoop.hdfs.server.datanode.TestBpServiceActorScheduler | | | hadoop.hdfs.TestCrcCorruption | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1775/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/1775 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle | | uname | Linux 3e1638baa5ca 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | trunk / f777cd3 | | Default Java | 1.8.0_232 | | unit | https://builds.apache.org/job/hadoop-multibranch/job/PR-1775/1/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt | | Test Results | https://builds.apache.org/job/hadoop-multibranch/job/PR-1775/1/testReport/ | | Max. process+thread count | 3623 (vs. ulimit of 5500) | | modules | C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs | | Console output | https://builds.apache.org/job/hadoop-multibranch/job/PR-1775/1/console | | versions | git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] vinayakumarb commented on issue #1776: HADOOP-16774. TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests
vinayakumarb commented on issue #1776: HADOOP-16774. TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests URL: https://github.com/apache/hadoop/pull/1776#issuecomment-568038892 Test failure is unrelated. This will fix test failures itself, so no need of extra tests. Thanks @ayushtkn for review. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] vinayakumarb merged pull request #1776: HADOOP-16774. TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests
vinayakumarb merged pull request #1776: HADOOP-16774. TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests URL: https://github.com/apache/hadoop/pull/1776 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16774) TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests
[ https://issues.apache.org/jira/browse/HADOOP-16774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17001081#comment-17001081 ] Vinayakumar B commented on HADOOP-16774: thanks [~ayushtkn] for review. > TestDiskChecker and TestReadWriteDiskValidator fails when run with > -Pparallel-tests > --- > > Key: HADOOP-16774 > URL: https://issues.apache.org/jira/browse/HADOOP-16774 > Project: Hadoop Common > Issue Type: Bug >Reporter: Vinayakumar B >Assignee: Vinayakumar B >Priority: Major > Fix For: 3.3.0 > > > {noformat} > $ mvn test -Pparallel-tests > -Dtest=TestReadWriteDiskValidator,TestDiskChecker -Pnative > {noformat} > {noformat} > [INFO] Results: > [INFO] > [ERROR] Errors: > [ERROR] > TestDiskChecker.testCheckDir_normal:111->_checkDirs:158->createTempDir:153 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_normal_local:180->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir:116->_checkDirs:158->createTempFile:142 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir_local:185->checkDirs:205->createTempFile:142 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable:131->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable_local:200->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable:121->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable_local:190->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable:126->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable_local:195->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] TestReadWriteDiskValidator.testCheckFailures:114 » NoSuchFile > /usr1/code/hadoo... > [ERROR] TestReadWriteDiskValidator.testReadWriteDiskValidator:62 » > DiskError Disk Chec... > [INFO] > [ERROR] Tests run: 16, Failures: 0, Errors: 12, Skipped: 0 > {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16774) TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests
[ https://issues.apache.org/jira/browse/HADOOP-16774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-16774: --- Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Available) PR is merged. > TestDiskChecker and TestReadWriteDiskValidator fails when run with > -Pparallel-tests > --- > > Key: HADOOP-16774 > URL: https://issues.apache.org/jira/browse/HADOOP-16774 > Project: Hadoop Common > Issue Type: Bug >Reporter: Vinayakumar B >Assignee: Vinayakumar B >Priority: Major > Fix For: 3.3.0 > > > {noformat} > $ mvn test -Pparallel-tests > -Dtest=TestReadWriteDiskValidator,TestDiskChecker -Pnative > {noformat} > {noformat} > [INFO] Results: > [INFO] > [ERROR] Errors: > [ERROR] > TestDiskChecker.testCheckDir_normal:111->_checkDirs:158->createTempDir:153 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_normal_local:180->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir:116->_checkDirs:158->createTempFile:142 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir_local:185->checkDirs:205->createTempFile:142 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable:131->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable_local:200->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable:121->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable_local:190->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable:126->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable_local:195->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] TestReadWriteDiskValidator.testCheckFailures:114 » NoSuchFile > /usr1/code/hadoo... > [ERROR] TestReadWriteDiskValidator.testReadWriteDiskValidator:62 » > DiskError Disk Chec... > [INFO] > [ERROR] Tests run: 16, Failures: 0, Errors: 12, Skipped: 0 > {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16774) TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests
[ https://issues.apache.org/jira/browse/HADOOP-16774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17001089#comment-17001089 ] Hudson commented on HADOOP-16774: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17785 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/17785/]) HADOOP-16774. TestDiskChecker and TestReadWriteDiskValidator fails when (GitHub: rev e2a5448d2b02b40ea7d5cc09787f995fe0d253d0) * (edit) hadoop-common-project/hadoop-common/pom.xml > TestDiskChecker and TestReadWriteDiskValidator fails when run with > -Pparallel-tests > --- > > Key: HADOOP-16774 > URL: https://issues.apache.org/jira/browse/HADOOP-16774 > Project: Hadoop Common > Issue Type: Bug >Reporter: Vinayakumar B >Assignee: Vinayakumar B >Priority: Major > Fix For: 3.3.0 > > > {noformat} > $ mvn test -Pparallel-tests > -Dtest=TestReadWriteDiskValidator,TestDiskChecker -Pnative > {noformat} > {noformat} > [INFO] Results: > [INFO] > [ERROR] Errors: > [ERROR] > TestDiskChecker.testCheckDir_normal:111->_checkDirs:158->createTempDir:153 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_normal_local:180->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir:116->_checkDirs:158->createTempFile:142 » > NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notDir_local:185->checkDirs:205->createTempFile:142 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable:131->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notListable_local:200->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable:121->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notReadable_local:190->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable:126->_checkDirs:158->createTempDir:153 > » NoSuchFile > [ERROR] > TestDiskChecker.testCheckDir_notWritable_local:195->checkDirs:205->createTempDir:153 > » NoSuchFile > [ERROR] TestReadWriteDiskValidator.testCheckFailures:114 » NoSuchFile > /usr1/code/hadoo... > [ERROR] TestReadWriteDiskValidator.testReadWriteDiskValidator:62 » > DiskError Disk Chec... > [INFO] > [ERROR] Tests run: 16, Failures: 0, Errors: 12, Skipped: 0 > {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] c-w commented on issue #452: HADOOP-16005: Add XAttr support to WASB and ABFS
c-w commented on issue #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#issuecomment-568076587 @DadanielZ Any chance you could take another look at this and provide some guidance on @virajith's question regarding encodings https://github.com/apache/hadoop/pull/452#discussion_r352263050? Would love to get this wrapped up and merged soon. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] sahilTakiar commented on issue #1764: HADOOP-16346: Stabilize S3A OpenSSL support
sahilTakiar commented on issue #1764: HADOOP-16346: Stabilize S3A OpenSSL support URL: https://github.com/apache/hadoop/pull/1764#issuecomment-568135576 New Testing: * Ran a set of 90 TPC-DS queries against Impala on a 3 node cluster against a 1 TB Parquet TPC-DS dataset stored on S3 * Set `fs.s3a.ssl.channel.mode` to `openssl` and confirmed using jstacks that OpenSSL is being used * Ran two full runs of the 90 query TPC-DS set, no errors or failures This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-16773) Fix duplicate assertj-core dependency in hadoop-common module.
[ https://issues.apache.org/jira/browse/HADOOP-16773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li reassigned HADOOP-16773: --- Assignee: Xieming Li > Fix duplicate assertj-core dependency in hadoop-common module. > -- > > Key: HADOOP-16773 > URL: https://issues.apache.org/jira/browse/HADOOP-16773 > Project: Hadoop Common > Issue Type: Bug > Components: build >Reporter: Akira Ajisaka >Assignee: Xieming Li >Priority: Minor > Labels: newbie > > {noformat} > [WARNING] Some problems were encountered while building the effective model > for org.apache.hadoop:hadoop-common:jar:3.3.0-SNAPSHOT > [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must > be unique: org.assertj:assertj-core:jar -> duplicate declaration of version > (?) @ line 351, column 17 > {noformat} > There are two assertj dependencies in pom.xml. We should fix it. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16358) Add an ARM CI for Hadoop
[ https://issues.apache.org/jira/browse/HADOOP-16358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17001627#comment-17001627 ] Ayush Saxena commented on HADOOP-16358: --- Seems like done, ARM build is there at: [https://builds.apache.org/view/H-L/view/Hadoop/job/Hadoop-qbt-linux-ARM-trunk/] If nothing remaining here we can close this ticket. > Add an ARM CI for Hadoop > > > Key: HADOOP-16358 > URL: https://issues.apache.org/jira/browse/HADOOP-16358 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Reporter: Zhenyu Zheng >Priority: Major > > Now the CI of Hadoop is handled by jenkins. While the tests are running under > x86 ARCH, the ARM arch has not being considered. This leads an problem that > we don't have a way to test every pull request that if it'll break the Hadoop > deployment on ARM or not. > We should add a CI system that support ARM arch. Using it, Hadoop can > officially support arm release in the future. Here I'd like to introduce > OpenLab to the community. [OpenLab|https://openlabtesting.org/] is a open > source CI system that can test any open source software on either x86 or arm > ARCH, it's mainly used by github projects. Now some > [projects|https://github.com/theopenlab/openlab-zuul-jobs/blob/master/zuul.d/jobs.yaml] > has integrated it already. Such as containerd (a graduated CNCF project, the > arm build will be triggerd in every PR, > [https://github.com/containerd/containerd/pulls]), terraform and so on. > OpenLab uses the open source CI software [Zuul > |https://github.com/openstack-infra/zuul] for CI system. Zuul is used by > OpenStack community as well. integrating with OpneLab is quite easy using its > github app. All config info is open source as well. > If apache Hadoop community has interested with it, we can help for the > integration. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org