[jira] [Work logged] (HDDS-1952) TestMiniChaosOzoneCluster may run until OOME
[ https://issues.apache.org/jira/browse/HDDS-1952?focusedWorklogId=293399&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293399 ] ASF GitHub Bot logged work on HDDS-1952: Author: ASF GitHub Bot Created on: 12/Aug/19 21:23 Start Date: 12/Aug/19 21:23 Worklog Time Spent: 10m Work Description: adoroszlai commented on pull request #1284: HDDS-1952. Disable TestMiniChaosOzoneCluster in integration.sh URL: https://github.com/apache/hadoop/pull/1284 ## What changes were proposed in this pull request? Disable `TestMiniChaosOzoneCluster` in integration test (`integration.sh`) run by CI and nightly builds, since it always crashes after running for a long time. It can still be run manually. https://issues.apache.org/jira/browse/HDDS-1952 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 293399) Time Spent: 10m Remaining Estimate: 0h > TestMiniChaosOzoneCluster may run until OOME > > > Key: HDDS-1952 > URL: https://issues.apache.org/jira/browse/HDDS-1952 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: test >Reporter: Doroszlai, Attila >Priority: Critical > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > {{TestMiniChaosOzoneCluster}} runs load generator on a cluster for supposedly > 1 minute, but it may run indefinitely until JVM crashes due to > OutOfMemoryError. > In 0.4.1 nightly build it crashed 29/30 times (and no tests were executed in > the remaining one run due to some other error). > Latest: > https://github.com/elek/ozone-ci/blob/3f553ed6ad358ba61a302967617de737d7fea01a/byscane/byscane-nightly-wggqd/integration/output.log#L5661-L5662 > When it crashes, it leaves GBs of data lying around. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDDS-1952) TestMiniChaosOzoneCluster may run until OOME
[ https://issues.apache.org/jira/browse/HDDS-1952?focusedWorklogId=293400&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293400 ] ASF GitHub Bot logged work on HDDS-1952: Author: ASF GitHub Bot Created on: 12/Aug/19 21:24 Start Date: 12/Aug/19 21:24 Worklog Time Spent: 10m Work Description: adoroszlai commented on issue #1284: HDDS-1952. Disable TestMiniChaosOzoneCluster in integration.sh URL: https://github.com/apache/hadoop/pull/1284#issuecomment-520601381 /label ozone This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 293400) Time Spent: 20m (was: 10m) > TestMiniChaosOzoneCluster may run until OOME > > > Key: HDDS-1952 > URL: https://issues.apache.org/jira/browse/HDDS-1952 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: test >Reporter: Doroszlai, Attila >Priority: Critical > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > {{TestMiniChaosOzoneCluster}} runs load generator on a cluster for supposedly > 1 minute, but it may run indefinitely until JVM crashes due to > OutOfMemoryError. > In 0.4.1 nightly build it crashed 29/30 times (and no tests were executed in > the remaining one run due to some other error). > Latest: > https://github.com/elek/ozone-ci/blob/3f553ed6ad358ba61a302967617de737d7fea01a/byscane/byscane-nightly-wggqd/integration/output.log#L5661-L5662 > When it crashes, it leaves GBs of data lying around. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDDS-1952) TestMiniChaosOzoneCluster may run until OOME
[ https://issues.apache.org/jira/browse/HDDS-1952?focusedWorklogId=293449&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293449 ] ASF GitHub Bot logged work on HDDS-1952: Author: ASF GitHub Bot Created on: 12/Aug/19 22:36 Start Date: 12/Aug/19 22:36 Worklog Time Spent: 10m Work Description: hadoop-yetus commented on issue #1284: HDDS-1952. Disable TestMiniChaosOzoneCluster in integration.sh URL: https://github.com/apache/hadoop/pull/1284#issuecomment-520620317 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 | reexec | 110 | Docker mode activated. | ||| _ Prechecks _ | | +1 | dupname | 0 | No case conflicting files found. | | 0 | shelldocs | 0 | Shelldocs was not available. | | +1 | @author | 0 | The patch does not contain any @author tags. | | -1 | test4tests | 0 | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ trunk Compile Tests _ | | +1 | mvninstall | 757 | trunk passed | | +1 | mvnsite | 0 | trunk passed | | +1 | shadedclient | 1081 | branch has no errors when building and testing our client artifacts. | ||| _ Patch Compile Tests _ | | +1 | mvninstall | 688 | the patch passed | | +1 | mvnsite | 0 | the patch passed | | +1 | shellcheck | 1 | There were no new shellcheck issues. | | +1 | whitespace | 0 | The patch has no whitespace issues. | | +1 | shadedclient | 852 | patch has no errors when building and testing our client artifacts. | ||| _ Other Tests _ | | +1 | unit | 129 | hadoop-hdds in the patch passed. | | +1 | unit | 336 | hadoop-ozone in the patch passed. | | +1 | asflicense | 61 | The patch does not generate ASF License warnings. | | | | 4260 | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1284/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/1284 | | Optional Tests | dupname asflicense mvnsite unit shellcheck shelldocs | | uname | Linux 020854b254e5 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | trunk / e4b538b | | Test Results | https://builds.apache.org/job/hadoop-multibranch/job/PR-1284/1/testReport/ | | Max. process+thread count | 306 (vs. ulimit of 5500) | | modules | C: hadoop-ozone U: hadoop-ozone | | Console output | https://builds.apache.org/job/hadoop-multibranch/job/PR-1284/1/console | | versions | git=2.7.4 maven=3.3.9 shellcheck=0.4.6 | | Powered by | Apache Yetus 0.10.0 http://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 293449) Time Spent: 0.5h (was: 20m) > TestMiniChaosOzoneCluster may run until OOME > > > Key: HDDS-1952 > URL: https://issues.apache.org/jira/browse/HDDS-1952 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: test >Reporter: Doroszlai, Attila >Priority: Critical > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > {{TestMiniChaosOzoneCluster}} runs load generator on a cluster for supposedly > 1 minute, but it may run indefinitely until JVM crashes due to > OutOfMemoryError. > In 0.4.1 nightly build it crashed 29/30 times (and no tests were executed in > the remaining one run due to some other error). > Latest: > https://github.com/elek/ozone-ci/blob/3f553ed6ad358ba61a302967617de737d7fea01a/byscane/byscane-nightly-wggqd/integration/output.log#L5661-L5662 > When it crashes, it leaves GBs of data lying around. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDDS-1952) TestMiniChaosOzoneCluster may run until OOME
[ https://issues.apache.org/jira/browse/HDDS-1952?focusedWorklogId=293681&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293681 ] ASF GitHub Bot logged work on HDDS-1952: Author: ASF GitHub Bot Created on: 13/Aug/19 07:22 Start Date: 13/Aug/19 07:22 Worklog Time Spent: 10m Work Description: hadoop-yetus commented on issue #1284: HDDS-1952. Disable TestMiniChaosOzoneCluster in integration.sh URL: https://github.com/apache/hadoop/pull/1284#issuecomment-520720481 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 | reexec | 41 | Docker mode activated. | ||| _ Prechecks _ | | +1 | dupname | 0 | No case conflicting files found. | | 0 | shelldocs | 0 | Shelldocs was not available. | | +1 | @author | 0 | The patch does not contain any @author tags. | | -1 | test4tests | 0 | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ trunk Compile Tests _ | | +1 | mvninstall | 640 | trunk passed | | +1 | mvnsite | 0 | trunk passed | | +1 | shadedclient | 783 | branch has no errors when building and testing our client artifacts. | ||| _ Patch Compile Tests _ | | +1 | mvninstall | 574 | the patch passed | | +1 | mvnsite | 0 | the patch passed | | +1 | shellcheck | 0 | There were no new shellcheck issues. | | +1 | whitespace | 0 | The patch has no whitespace issues. | | +1 | shadedclient | 678 | patch has no errors when building and testing our client artifacts. | ||| _ Other Tests _ | | +1 | unit | 103 | hadoop-hdds in the patch passed. | | +1 | unit | 286 | hadoop-ozone in the patch passed. | | +1 | asflicense | 50 | The patch does not generate ASF License warnings. | | | | 3341 | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1284/2/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/1284 | | Optional Tests | dupname asflicense mvnsite unit shellcheck shelldocs | | uname | Linux e67b550e84a9 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | trunk / 454420e | | Test Results | https://builds.apache.org/job/hadoop-multibranch/job/PR-1284/2/testReport/ | | Max. process+thread count | 447 (vs. ulimit of 5500) | | modules | C: hadoop-ozone U: hadoop-ozone | | Console output | https://builds.apache.org/job/hadoop-multibranch/job/PR-1284/2/console | | versions | git=2.7.4 maven=3.3.9 shellcheck=0.4.6 | | Powered by | Apache Yetus 0.10.0 http://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 293681) Time Spent: 40m (was: 0.5h) > TestMiniChaosOzoneCluster may run until OOME > > > Key: HDDS-1952 > URL: https://issues.apache.org/jira/browse/HDDS-1952 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: test >Reporter: Doroszlai, Attila >Priority: Critical > Labels: pull-request-available > Time Spent: 40m > Remaining Estimate: 0h > > {{TestMiniChaosOzoneCluster}} runs load generator on a cluster for supposedly > 1 minute, but it may run indefinitely until JVM crashes due to > OutOfMemoryError. > In 0.4.1 nightly build it crashed 29/30 times (and no tests were executed in > the remaining one run due to some other error). > Latest: > https://github.com/elek/ozone-ci/blob/3f553ed6ad358ba61a302967617de737d7fea01a/byscane/byscane-nightly-wggqd/integration/output.log#L5661-L5662 > When it crashes, it leaves GBs of data lying around. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDDS-1952) TestMiniChaosOzoneCluster may run until OOME
[ https://issues.apache.org/jira/browse/HDDS-1952?focusedWorklogId=293781&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293781 ] ASF GitHub Bot logged work on HDDS-1952: Author: ASF GitHub Bot Created on: 13/Aug/19 09:53 Start Date: 13/Aug/19 09:53 Worklog Time Spent: 10m Work Description: adoroszlai commented on issue #1284: HDDS-1952. Disable TestMiniChaosOzoneCluster in integration.sh URL: https://github.com/apache/hadoop/pull/1284#issuecomment-520769904 Thanks @mukul1987 for reviewing it. Unfortunately `excludes` only works in `pom.xml`, not in the command-line. The updated patch successfully excluded `TestMiniChaosOzoneCluster` in the [CI run](https://ci.anzix.net/job/ozone/17657/consoleText). As a side-effect, it also ran all tests in `hadoop-ozone-filesystem` (see #1235 for a more complete fix for [HDDS-1916](https://issues.apache.org/jira/browse/HDDS-1916)). Acceptance test failure is unrelated ([HDDS-1936](https://issues.apache.org/jira/browse/HDDS-1936)). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 293781) Time Spent: 50m (was: 40m) > TestMiniChaosOzoneCluster may run until OOME > > > Key: HDDS-1952 > URL: https://issues.apache.org/jira/browse/HDDS-1952 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: test >Reporter: Doroszlai, Attila >Priority: Critical > Labels: pull-request-available > Time Spent: 50m > Remaining Estimate: 0h > > {{TestMiniChaosOzoneCluster}} runs load generator on a cluster for supposedly > 1 minute, but it may run indefinitely until JVM crashes due to > OutOfMemoryError. > In 0.4.1 nightly build it crashed 29/30 times (and no tests were executed in > the remaining one run due to some other error). > Latest: > https://github.com/elek/ozone-ci/blob/3f553ed6ad358ba61a302967617de737d7fea01a/byscane/byscane-nightly-wggqd/integration/output.log#L5661-L5662 > When it crashes, it leaves GBs of data lying around. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDDS-1952) TestMiniChaosOzoneCluster may run until OOME
[ https://issues.apache.org/jira/browse/HDDS-1952?focusedWorklogId=293896&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293896 ] ASF GitHub Bot logged work on HDDS-1952: Author: ASF GitHub Bot Created on: 13/Aug/19 13:40 Start Date: 13/Aug/19 13:40 Worklog Time Spent: 10m Work Description: nandakumar131 commented on pull request #1284: HDDS-1952. Disable TestMiniChaosOzoneCluster in integration.sh URL: https://github.com/apache/hadoop/pull/1284 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 293896) Time Spent: 1h (was: 50m) > TestMiniChaosOzoneCluster may run until OOME > > > Key: HDDS-1952 > URL: https://issues.apache.org/jira/browse/HDDS-1952 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: test >Reporter: Doroszlai, Attila >Assignee: Doroszlai, Attila >Priority: Critical > Labels: pull-request-available > Time Spent: 1h > Remaining Estimate: 0h > > {{TestMiniChaosOzoneCluster}} runs load generator on a cluster for supposedly > 1 minute, but it may run indefinitely until JVM crashes due to > OutOfMemoryError. > In 0.4.1 nightly build it crashed 29/30 times (and no tests were executed in > the remaining one run due to some other error). > Latest: > https://github.com/elek/ozone-ci/blob/3f553ed6ad358ba61a302967617de737d7fea01a/byscane/byscane-nightly-wggqd/integration/output.log#L5661-L5662 > When it crashes, it leaves GBs of data lying around. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDDS-1952) TestMiniChaosOzoneCluster may run until OOME
[ https://issues.apache.org/jira/browse/HDDS-1952?focusedWorklogId=293899&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293899 ] ASF GitHub Bot logged work on HDDS-1952: Author: ASF GitHub Bot Created on: 13/Aug/19 13:42 Start Date: 13/Aug/19 13:42 Worklog Time Spent: 10m Work Description: adoroszlai commented on issue #1284: HDDS-1952. Disable TestMiniChaosOzoneCluster in integration.sh URL: https://github.com/apache/hadoop/pull/1284#issuecomment-520839636 Thank you @nandakumar131 for reviewing and merging it. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 293899) Time Spent: 1h 10m (was: 1h) > TestMiniChaosOzoneCluster may run until OOME > > > Key: HDDS-1952 > URL: https://issues.apache.org/jira/browse/HDDS-1952 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: test >Reporter: Doroszlai, Attila >Assignee: Doroszlai, Attila >Priority: Critical > Labels: pull-request-available > Fix For: 0.4.1, 0.5.0 > > Time Spent: 1h 10m > Remaining Estimate: 0h > > {{TestMiniChaosOzoneCluster}} runs load generator on a cluster for supposedly > 1 minute, but it may run indefinitely until JVM crashes due to > OutOfMemoryError. > In 0.4.1 nightly build it crashed 29/30 times (and no tests were executed in > the remaining one run due to some other error). > Latest: > https://github.com/elek/ozone-ci/blob/3f553ed6ad358ba61a302967617de737d7fea01a/byscane/byscane-nightly-wggqd/integration/output.log#L5661-L5662 > When it crashes, it leaves GBs of data lying around. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org