[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel().

2020-04-01 Thread GitBox
bharatviswa504 commented on a change in pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel(). URL: https://github.com/apache/hadoop-ozone/pull/752#discussion_r402058366 ## File path:

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel().

2020-04-01 Thread GitBox
bharatviswa504 commented on a change in pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel(). URL: https://github.com/apache/hadoop-ozone/pull/752#discussion_r402057401 ## File path:

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel().

2020-04-01 Thread GitBox
bharatviswa504 commented on a change in pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel(). URL: https://github.com/apache/hadoop-ozone/pull/752#discussion_r402056499 ## File path:

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel().

2020-04-01 Thread GitBox
bharatviswa504 commented on a change in pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel(). URL: https://github.com/apache/hadoop-ozone/pull/752#discussion_r402049821 ## File path:

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel().

2020-04-01 Thread GitBox
bharatviswa504 commented on a change in pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel(). URL: https://github.com/apache/hadoop-ozone/pull/752#discussion_r402050759 ## File path:

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel().

2020-04-01 Thread GitBox
bharatviswa504 commented on a change in pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel(). URL: https://github.com/apache/hadoop-ozone/pull/752#discussion_r402056499 ## File path:

[GitHub] [hadoop-ozone] runzhiwang commented on issue #709: HDDS-3244. Improve write efficiency by opening RocksDB only once

2020-04-01 Thread GitBox
runzhiwang commented on issue #709: HDDS-3244. Improve write efficiency by opening RocksDB only once URL: https://github.com/apache/hadoop-ozone/pull/709#issuecomment-607597854 @bharatviswa504 Could you help review it again.

[GitHub] [hadoop-ozone] runzhiwang commented on issue #645: HDDS-3130. Add jaeger trace span in s3gateway

2020-04-01 Thread GitBox
runzhiwang commented on issue #645: HDDS-3130. Add jaeger trace span in s3gateway URL: https://github.com/apache/hadoop-ozone/pull/645#issuecomment-607597555 @elek CI passed. This is an automated message from the Apache Git

[jira] [Updated] (HDDS-3283) Improve write efficiency by decreasing the number of force sync to disk

2020-04-01 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3283: - Description: The whole write cost about 140ms, and 110ms was cost by force sync to disk. The force sync

[jira] [Updated] (HDDS-3283) Improve write efficiency by decreasing the number of force sync to disk

2020-04-01 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3283: - Attachment: (was: screenshot-1.png) > Improve write efficiency by decreasing the number of force sync

[jira] [Assigned] (HDDS-3133) Add export objectIds in Ozone as FileIds to allow LLAP to cache the files

2020-04-01 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-3133: - Assignee: (was: Siddharth Wagle) > Add export objectIds in Ozone as FileIds to allow

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #723: HDDS-3281. Add timeouts to all robot tests

2020-04-01 Thread GitBox
hanishakoneru commented on issue #723: HDDS-3281. Add timeouts to all robot tests URL: https://github.com/apache/hadoop-ozone/pull/723#issuecomment-607572973 Just saw that there is an option to list the timestamp of each message. The last test to run is _ozone-topology-basic/Check webui

[GitHub] [hadoop-ozone] xiaoyuyao opened a new pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel().

2020-04-01 Thread GitBox
xiaoyuyao opened a new pull request #752: HDDS-3319. Handle HA for BasicOzoneClientAdapterImpl#renew/cancel(). URL: https://github.com/apache/hadoop-ozone/pull/752 ## What changes were proposed in this pull request? Fix the token renew and cancel logic in the Renewer class. By adding

[jira] [Updated] (HDDS-3319) Handle HA for BasicOzoneClientAdapterImpl$Renewer#renew/cancel()

2020-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3319: - Labels: pull-request-available (was: ) > Handle HA for

[jira] [Assigned] (HDDS-3324) OM Client fails with StringIndexOutOfBoundsException

2020-04-01 Thread Namit Maheshwari (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Maheshwari reassigned HDDS-3324: -- Assignee: Bharat Viswanadham > OM Client fails with StringIndexOutOfBoundsException >

[jira] [Created] (HDDS-3324) OM Client fails with StringIndexOutOfBoundsException

2020-04-01 Thread Namit Maheshwari (Jira)
Namit Maheshwari created HDDS-3324: -- Summary: OM Client fails with StringIndexOutOfBoundsException Key: HDDS-3324 URL: https://issues.apache.org/jira/browse/HDDS-3324 Project: Hadoop Distributed Data

[jira] [Created] (HDDS-3323) Hive fails to work with OM HA

2020-04-01 Thread Namit Maheshwari (Jira)
Namit Maheshwari created HDDS-3323: -- Summary: Hive fails to work with OM HA Key: HDDS-3323 URL: https://issues.apache.org/jira/browse/HDDS-3323 Project: Hadoop Distributed Data Store Issue

[jira] [Assigned] (HDDS-3323) Hive fails to work with OM HA

2020-04-01 Thread Namit Maheshwari (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Maheshwari reassigned HDDS-3323: -- Assignee: Bharat Viswanadham > Hive fails to work with OM HA >

[jira] [Updated] (HDDS-3321) Prometheus endpoint should not have Authentication filter enabled on it.

2020-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3321: - Labels: pull-request-available (was: ) > Prometheus endpoint should not have Authentication

[GitHub] [hadoop-ozone] avijayanhwx opened a new pull request #751: HDDS-3321. Prometheus endpoint should not have Authentication filter …

2020-04-01 Thread GitBox
avijayanhwx opened a new pull request #751: HDDS-3321. Prometheus endpoint should not have Authentication filter … URL: https://github.com/apache/hadoop-ozone/pull/751 …enabled on it. ## What changes were proposed in this pull request? Prometheus does not support targets which

[GitHub] [hadoop-ozone] swagle commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time.

2020-04-01 Thread GitBox
swagle commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time. URL: https://github.com/apache/hadoop-ozone/pull/718#issuecomment-607503154 > OM bucket generator fails even in single OM environment: > > ``` > Freon OM Bucket Generator

[jira] [Updated] (HDDS-3309) Add timeout to all integration tests

2020-04-01 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3309: - Summary: Add timeout to all integration tests (was: Add timeout to freon integration tests) > Add

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #696: HDDS-3056. Allow users to list volumes they have access to, and optionally allow all users to list all volumes

2020-04-01 Thread GitBox
smengcl commented on a change in pull request #696: HDDS-3056. Allow users to list volumes they have access to, and optionally allow all users to list all volumes URL: https://github.com/apache/hadoop-ozone/pull/696#discussion_r401885363 ## File path:

[jira] [Updated] (HDDS-3309) Add timeout to freon integration tests

2020-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3309: - Labels: pull-request-available (was: ) > Add timeout to freon integration tests >

[GitHub] [hadoop-ozone] smengcl opened a new pull request #750: HDDS-3309. Add timeout to freon integration tests

2020-04-01 Thread GitBox
smengcl opened a new pull request #750: HDDS-3309. Add timeout to freon integration tests URL: https://github.com/apache/hadoop-ozone/pull/750 ## What changes were proposed in this pull request? Add timeout to freon integration tests. This helps ruling out flaky long-running

[GitHub] [hadoop-ozone] smengcl edited a comment on issue #582: HDDS-3047. ObjectStore#listVolumesByUser and CreateVolumeHandler#call should get principal name by default

2020-04-01 Thread GitBox
smengcl edited a comment on issue #582: HDDS-3047. ObjectStore#listVolumesByUser and CreateVolumeHandler#call should get principal name by default URL: https://github.com/apache/hadoop-ozone/pull/582#issuecomment-605130860 Rebased to latest master to include (unrelated) test failure fix

[GitHub] [hadoop-ozone] smengcl merged pull request #582: HDDS-3047. ObjectStore#listVolumesByUser and CreateVolumeHandler#call should get principal name by default

2020-04-01 Thread GitBox
smengcl merged pull request #582: HDDS-3047. ObjectStore#listVolumesByUser and CreateVolumeHandler#call should get principal name by default URL: https://github.com/apache/hadoop-ozone/pull/582 This is an automated message

[GitHub] [hadoop-ozone] smengcl commented on issue #582: HDDS-3047. ObjectStore#listVolumesByUser and CreateVolumeHandler#call should get principal name by default

2020-04-01 Thread GitBox
smengcl commented on issue #582: HDDS-3047. ObjectStore#listVolumesByUser and CreateVolumeHandler#call should get principal name by default URL: https://github.com/apache/hadoop-ozone/pull/582#issuecomment-607457359 Thanks @xiaoyuyao for the review!

[jira] [Updated] (HDDS-3322) StandAlone Pipelines are created in an infinite loop

2020-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3322: - Labels: pull-request-available (was: ) > StandAlone Pipelines are created in an infinite loop >

[GitHub] [hadoop-ozone] hanishakoneru opened a new pull request #749: HDDS-3322. StandAlone Pipelines are created in an infinite loop

2020-04-01 Thread GitBox
hanishakoneru opened a new pull request #749: HDDS-3322. StandAlone Pipelines are created in an infinite loop URL: https://github.com/apache/hadoop-ozone/pull/749 ## What changes were proposed in this pull request? BackgroundPipelineCreator keeps creating pipelines of configured

[jira] [Created] (HDDS-3322) StandAlone Pipelines are created in an infinite loop

2020-04-01 Thread Hanisha Koneru (Jira)
Hanisha Koneru created HDDS-3322: Summary: StandAlone Pipelines are created in an infinite loop Key: HDDS-3322 URL: https://issues.apache.org/jira/browse/HDDS-3322 Project: Hadoop Distributed Data

[GitHub] [hadoop-ozone] swagle closed pull request #718: HDDS-3224. Enforce volume and bucket name rule at create time.

2020-04-01 Thread GitBox
swagle closed pull request #718: HDDS-3224. Enforce volume and bucket name rule at create time. URL: https://github.com/apache/hadoop-ozone/pull/718 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop-ozone] swagle commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time.

2020-04-01 Thread GitBox
swagle commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time. URL: https://github.com/apache/hadoop-ozone/pull/718#issuecomment-607420879 > HDDS-2934 I am actually getting this failure on

[GitHub] [hadoop-ozone] swagle opened a new pull request #718: HDDS-3224. Enforce volume and bucket name rule at create time.

2020-04-01 Thread GitBox
swagle opened a new pull request #718: HDDS-3224. Enforce volume and bucket name rule at create time. URL: https://github.com/apache/hadoop-ozone/pull/718 ## What changes were proposed in this pull request? Validations performed by RpcClient are not done when using OzoneManager client

[GitHub] [hadoop-ozone] adoroszlai commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time.

2020-04-01 Thread GitBox
adoroszlai commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time. URL: https://github.com/apache/hadoop-ozone/pull/718#issuecomment-607418093 OM bucket generator fails even in single OM environment: ``` Freon OM Bucket Generator

[GitHub] [hadoop-ozone] adoroszlai commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time.

2020-04-01 Thread GitBox
adoroszlai commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time. URL: https://github.com/apache/hadoop-ozone/pull/718#issuecomment-607404123 > The same test seems to fail every time: ozone-om-ha-s3, I see HDDS-3313 is opened to address this.

[jira] [Updated] (HDDS-2934) OM HA S3 test failure

2020-04-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-2934: --- Description: OM HA S3 test ({{ozone-om-ha-s3}}) failed in one CI run at the following test

[jira] [Commented] (HDDS-3313) OM HA acceptance test is flaky

2020-04-01 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073030#comment-17073030 ] Siddharth Wagle commented on HDDS-3313: --- ozone-om-ha-s3, also fails for me with timeout. > OM HA

[GitHub] [hadoop-ozone] swagle commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time.

2020-04-01 Thread GitBox
swagle commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time. URL: https://github.com/apache/hadoop-ozone/pull/718#issuecomment-607397247 > Changes look good @swagle, however, there are multiple acceptance test failures for OM HA and Freon. Could you

[GitHub] [hadoop-ozone] sodonnel commented on issue #668: HDDS-3139 Pipeline placement should max out pipeline usage

2020-04-01 Thread GitBox
sodonnel commented on issue #668: HDDS-3139 Pipeline placement should max out pipeline usage URL: https://github.com/apache/hadoop-ozone/pull/668#issuecomment-607397167 [example.txt](https://github.com/apache/hadoop-ozone/files/4416772/example.txt)

[GitHub] [hadoop-ozone] sodonnel commented on issue #668: HDDS-3139 Pipeline placement should max out pipeline usage

2020-04-01 Thread GitBox
sodonnel commented on issue #668: HDDS-3139 Pipeline placement should max out pipeline usage URL: https://github.com/apache/hadoop-ozone/pull/668#issuecomment-607396397 @timmylicheng I did some more experimenting and I have attached a patch file that should apply on your latest PR. In

[jira] [Created] (HDDS-3321) Prometheus endpoint should not have Authentication filter enabled on it.

2020-04-01 Thread Aravindan Vijayan (Jira)
Aravindan Vijayan created HDDS-3321: --- Summary: Prometheus endpoint should not have Authentication filter enabled on it. Key: HDDS-3321 URL: https://issues.apache.org/jira/browse/HDDS-3321 Project:

[jira] [Commented] (HDDS-3301) Freon is hanging if started when pipelines are not yet available

2020-04-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072985#comment-17072985 ] Attila Doroszlai commented on HDDS-3301: I tried to [apply this to integration

[GitHub] [hadoop-ozone] arp7 commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads

2020-04-01 Thread GitBox
arp7 commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads URL: https://github.com/apache/hadoop-ozone/pull/578#issuecomment-607358494 Let's hold off committing this until we can discuss it further. 20 threads will be insufficient if the number of disks is

[jira] [Updated] (HDDS-3165) Integrate Recon missing containers UI with endpoint.

2020-04-01 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-3165: Resolution: Fixed Status: Resolved (was: Patch Available) Merged the PR. >

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #735: HDDS-3165. Integrate Recon missing containers UI with endpoint.

2020-04-01 Thread GitBox
avijayanhwx merged pull request #735: HDDS-3165. Integrate Recon missing containers UI with endpoint. URL: https://github.com/apache/hadoop-ozone/pull/735 This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop-ozone] avijayanhwx commented on issue #735: HDDS-3165. Integrate Recon missing containers UI with endpoint.

2020-04-01 Thread GitBox
avijayanhwx commented on issue #735: HDDS-3165. Integrate Recon missing containers UI with endpoint. URL: https://github.com/apache/hadoop-ozone/pull/735#issuecomment-607348467 Thank you for the contribution @vivekratnavel.

[jira] [Reopened] (HDDS-3234) Fix retry interval default in Ozone client

2020-04-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDDS-3234: - This was reverted by [~elek] as it was making CI runs unstable. > Fix retry interval default in

[jira] [Reopened] (HDDS-3064) Get Key is hung when READ delay is injected in chunk file path

2020-04-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDDS-3064: - This was reverted by [~elek] as it was making CI runs unstable. > Get Key is hung when READ delay is

[jira] [Updated] (HDDS-3064) Get Key is hung when READ delay is injected in chunk file path

2020-04-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3064: Fix Version/s: (was: 0.6.0) > Get Key is hung when READ delay is injected in chunk file path >

[jira] [Assigned] (HDDS-3313) OM HA acceptance test is flaky

2020-04-01 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDDS-3313: Assignee: Hanisha Koneru > OM HA acceptance test is flaky > --

[jira] [Updated] (HDDS-3234) Fix retry interval default in Ozone client

2020-04-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3234: Fix Version/s: (was: 0.6.0) > Fix retry interval default in Ozone client >

[jira] [Assigned] (HDDS-3238) Fix Error Message for incorrect OM service ID in client url

2020-04-01 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDDS-3238: Assignee: (was: Hanisha Koneru) > Fix Error Message for incorrect OM service ID in

[GitHub] [hadoop-ozone] sodonnel commented on issue #668: HDDS-3139 Pipeline placement should max out pipeline usage

2020-04-01 Thread GitBox
sodonnel commented on issue #668: HDDS-3139 Pipeline placement should max out pipeline usage URL: https://github.com/apache/hadoop-ozone/pull/668#issuecomment-607342420 > @sodonnel I rebase the code with minor conflicts in test class, but the test won't pass. I took a close look and made

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #265: HDDS-2621. Enable OM HA acceptance tests.

2020-04-01 Thread GitBox
hanishakoneru commented on issue #265: HDDS-2621. Enable OM HA acceptance tests. URL: https://github.com/apache/hadoop-ozone/pull/265#issuecomment-607341012 Thanks @elek for disabling this test. These OM HA failures are very elusive. I tested multiple times before merging and they didnt

[GitHub] [hadoop-ozone] elek commented on a change in pull request #746: HDDS-3316. Checkstyle check fails silently in case of mvn related errors

2020-04-01 Thread GitBox
elek commented on a change in pull request #746: HDDS-3316. Checkstyle check fails silently in case of mvn related errors URL: https://github.com/apache/hadoop-ozone/pull/746#discussion_r401730547 ## File path:

[jira] [Commented] (HDDS-3313) OM HA acceptance test is flaky

2020-04-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072905#comment-17072905 ] Attila Doroszlai commented on HDDS-3313: [~hanishakoneru], I have attached acceptance.zip

[jira] [Updated] (HDDS-3313) OM HA acceptance test is flaky

2020-04-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3313: --- Attachment: acceptance.zip > OM HA acceptance test is flaky > --

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #723: HDDS-3281. Add timeouts to all robot tests

2020-04-01 Thread GitBox
hanishakoneru commented on issue #723: HDDS-3281. Add timeouts to all robot tests URL: https://github.com/apache/hadoop-ozone/pull/723#issuecomment-607328861 @adoroszlai , @elek how about we print a start and end time (or duration) for each test suit.

[GitHub] [hadoop-ozone] elek commented on issue #265: HDDS-2621. Enable OM HA acceptance tests.

2020-04-01 Thread GitBox
elek commented on issue #265: HDDS-2621. Enable OM HA acceptance tests. URL: https://github.com/apache/hadoop-ozone/pull/265#issuecomment-607327491 If I didn't do any mistake, the om-ha tests (and only them) will be executed twice per hour here:

[GitHub] [hadoop-ozone] sodonnel commented on issue #745: HDDS-3315. Use EventQueue for delayed/immediate safe mode notifications

2020-04-01 Thread GitBox
sodonnel commented on issue #745: HDDS-3315. Use EventQueue for delayed/immediate safe mode notifications URL: https://github.com/apache/hadoop-ozone/pull/745#issuecomment-607323990 I stand by my earlier comment that this style of code is much harder to follow. Events are registered far

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #748: HDDS-3318. Support /close command in the Github comments

2020-04-01 Thread GitBox
adoroszlai commented on a change in pull request #748: HDDS-3318. Support /close command in the Github comments URL: https://github.com/apache/hadoop-ozone/pull/748#discussion_r401706397 ## File path: .github/comment-commands/close.sh ## @@ -0,0 +1,44 @@ +#!/usr/bin/env

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #748: HDDS-3318. Support /close command in the Github comments

2020-04-01 Thread GitBox
adoroszlai commented on a change in pull request #748: HDDS-3318. Support /close command in the Github comments URL: https://github.com/apache/hadoop-ozone/pull/748#discussion_r401704076 ## File path: .github/comment-commands/close.sh ## @@ -0,0 +1,44 @@ +#!/usr/bin/env

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #748: HDDS-3318. Support /close command in the Github comments

2020-04-01 Thread GitBox
adoroszlai commented on a change in pull request #748: HDDS-3318. Support /close command in the Github comments URL: https://github.com/apache/hadoop-ozone/pull/748#discussion_r401698697 ## File path: .github/comment-commands/close.sh ## @@ -0,0 +1,44 @@ +#!/usr/bin/env

[GitHub] [hadoop-ozone] elek commented on issue #265: HDDS-2621. Enable OM HA acceptance tests.

2020-04-01 Thread GitBox
elek commented on issue #265: HDDS-2621. Enable OM HA acceptance tests. URL: https://github.com/apache/hadoop-ozone/pull/265#issuecomment-607320713 I will create a separated github action to make it easier to run only one acceptance test multiple times...

[GitHub] [hadoop-ozone] elek commented on issue #265: HDDS-2621. Enable OM HA acceptance tests.

2020-04-01 Thread GitBox
elek commented on issue #265: HDDS-2621. Enable OM HA acceptance tests. URL: https://github.com/apache/hadoop-ozone/pull/265#issuecomment-607319528 Ok. Instead of revert, I just excluded the tests from the pr / daily build. We can create an other pull request and start to test it

[GitHub] [hadoop-ozone] elek commented on issue #265: HDDS-2621. Enable OM HA acceptance tests.

2020-04-01 Thread GitBox
elek commented on issue #265: HDDS-2621. Enable OM HA acceptance tests. URL: https://github.com/apache/hadoop-ozone/pull/265#issuecomment-607316682 Two more failures: * https://github.com/apache/hadoop-ozone/actions/runs/68224789 *

[jira] [Moved] (HDDS-3320) Add read only based load generator to MiniOzoneChaosCluster

2020-04-01 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh moved RATIS-837 to HDDS-3320: --- Key: HDDS-3320 (was: RATIS-837) Workflow: patch-available,

[jira] [Created] (HDDS-3319) Handle HA for BasicOzoneClientAdapterImpl$Renewer#renew/cancel()

2020-04-01 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-3319: Summary: Handle HA for BasicOzoneClientAdapterImpl$Renewer#renew/cancel() Key: HDDS-3319 URL: https://issues.apache.org/jira/browse/HDDS-3319 Project: Hadoop Distributed

[GitHub] [hadoop-ozone] elek commented on issue #748: HDDS-3318. Support /close command in the Github comments

2020-04-01 Thread GitBox
elek commented on issue #748: HDDS-3318. Support /close command in the Github comments URL: https://github.com/apache/hadoop-ozone/pull/748#issuecomment-607307473 > But I will try to test it on this pr. It's not working. But it's tested on this PR:

[GitHub] [hadoop-ozone] github-actions[bot] commented on issue #748: HDDS-3318. Support /close command in the Github comments

2020-04-01 Thread GitBox
github-actions[bot] commented on issue #748: HDDS-3318. Support /close command in the Github comments URL: https://github.com/apache/hadoop-ozone/pull/748#issuecomment-607303211 Available commands: * /**help** : Show all the available comment commands * /**label** : add new label

[jira] [Updated] (HDDS-3318) Support /close command in the Github comments

2020-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3318: - Labels: pull-request-available (was: ) > Support /close command in the Github comments >

[GitHub] [hadoop-ozone] elek opened a new pull request #748: HDDS-3318. Support /close command in the Github comments

2020-04-01 Thread GitBox
elek opened a new pull request #748: HDDS-3318. Support /close command in the Github comments URL: https://github.com/apache/hadoop-ozone/pull/748 ## What changes were proposed in this pull request? As it's discussed during the last community meeting we can close pending pull

[GitHub] [hadoop-ozone] elek commented on issue #748: HDDS-3318. Support /close command in the Github comments

2020-04-01 Thread GitBox
elek commented on issue #748: HDDS-3318. Support /close command in the Github comments URL: https://github.com/apache/hadoop-ozone/pull/748#issuecomment-607303018 /help This is an automated message from the Apache Git

[jira] [Created] (HDDS-3318) Support /close command in the Github comments

2020-04-01 Thread Marton Elek (Jira)
Marton Elek created HDDS-3318: - Summary: Support /close command in the Github comments Key: HDDS-3318 URL: https://issues.apache.org/jira/browse/HDDS-3318 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] elek commented on issue #724: HDDS-3282. ozone.http.filter.initializers can't be set properly for S…

2020-04-01 Thread GitBox
elek commented on issue #724: HDDS-3282. ozone.http.filter.initializers can't be set properly for S… URL: https://github.com/apache/hadoop-ozone/pull/724#issuecomment-607283157 Thanks the patch @xiaoyuyao Not clear what is the exact problem with forking? I would like to remove the

[jira] [Updated] (HDDS-3311) OM logs not available for OM HA acceptance test

2020-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3311: - Labels: pull-request-available (was: ) > OM logs not available for OM HA acceptance test >

[jira] [Updated] (HDDS-3311) OM logs not available for OM HA acceptance test

2020-04-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3311: --- Status: Patch Available (was: In Progress) > OM logs not available for OM HA acceptance test

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #747: HDDS-3311. OM logs not available for OM HA acceptance test

2020-04-01 Thread GitBox
adoroszlai opened a new pull request #747: HDDS-3311. OM logs not available for OM HA acceptance test URL: https://github.com/apache/hadoop-ozone/pull/747 ## What changes were proposed in this pull request? OM logs are redirected to files in OM HA test, because OM is run as daemon.

[jira] [Updated] (HDDS-3313) OM HA acceptance test is flaky

2020-04-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3313: --- Description: {{ozone-om-ha}} test is failing intermittently. Example on master:

[GitHub] [hadoop-ozone] elek closed pull request #743: HDDS-3281. (Addendum) add missing timeouts to the topology robot files.

2020-04-01 Thread GitBox
elek closed pull request #743: HDDS-3281. (Addendum) add missing timeouts to the topology robot files. URL: https://github.com/apache/hadoop-ozone/pull/743 This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] elek commented on issue #743: HDDS-3281. (Addendum) add missing timeouts to the topology robot files.

2020-04-01 Thread GitBox
elek commented on issue #743: HDDS-3281. (Addendum) add missing timeouts to the topology robot files. URL: https://github.com/apache/hadoop-ozone/pull/743#issuecomment-607223669 Thanks the review @adoroszlai As it's a small change based on the approach where we already agreed, I am

[jira] [Assigned] (HDDS-3316) Checkstyle check fails silently in case of mvn related errors

2020-04-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai reassigned HDDS-3316: -- Assignee: Marton Elek > Checkstyle check fails silently in case of mvn related errors

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #746: HDDS-3316. Checkstyle check fails silently in case of mvn related errors

2020-04-01 Thread GitBox
adoroszlai commented on a change in pull request #746: HDDS-3316. Checkstyle check fails silently in case of mvn related errors URL: https://github.com/apache/hadoop-ozone/pull/746#discussion_r401555415 ## File path:

[jira] [Assigned] (HDDS-3231) Cleanup KeyManagerImpl

2020-04-01 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-3231: --- Assignee: Rakesh Radhakrishnan > Cleanup KeyManagerImpl > -- > >

[jira] [Created] (HDDS-3317) replication manager failing to re-replicate under replicated containers

2020-04-01 Thread Nilotpal Nandi (Jira)
Nilotpal Nandi created HDDS-3317: Summary: replication manager failing to re-replicate under replicated containers Key: HDDS-3317 URL: https://issues.apache.org/jira/browse/HDDS-3317 Project: Hadoop

[GitHub] [hadoop-ozone] elek opened a new pull request #746: HDDS-3316. Checkstyle check fails silently in case of mvn related errors

2020-04-01 Thread GitBox
elek opened a new pull request #746: HDDS-3316. Checkstyle check fails silently in case of mvn related errors URL: https://github.com/apache/hadoop-ozone/pull/746 ## What changes were proposed in this pull request? rom the last master build:

[jira] [Updated] (HDDS-3316) Checkstyle check fails silently in case of mvn related errors

2020-04-01 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3316: -- Description: >From the last master build:

[jira] [Updated] (HDDS-3315) Use EventQueue for delayed/immediate safe mode rule notification

2020-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3315: - Labels: pull-request-available (was: ) > Use EventQueue for delayed/immediate safe mode rule

[GitHub] [hadoop-ozone] elek opened a new pull request #745: HDDS-3315. Use EventQueue for delayed/immediate safe mode notifications

2020-04-01 Thread GitBox
elek opened a new pull request #745: HDDS-3315. Use EventQueue for delayed/immediate safe mode notifications URL: https://github.com/apache/hadoop-ozone/pull/745 SCM is built from loosely coupled components which communicate with async event with each other. Using the same

[jira] [Created] (HDDS-3315) Use EventQueue for delayed/immediate safe mode rule notification

2020-04-01 Thread Marton Elek (Jira)
Marton Elek created HDDS-3315: - Summary: Use EventQueue for delayed/immediate safe mode rule notification Key: HDDS-3315 URL: https://issues.apache.org/jira/browse/HDDS-3315 Project: Hadoop Distributed

[jira] [Commented] (HDDS-3241) Invalid container reported to SCM should be deleted

2020-04-01 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072660#comment-17072660 ] Yiqun Lin commented on HDDS-3241: - {quote} Fix me if I am wrong, but in this case the containers are not

[GitHub] [hadoop-ozone] linyiqun commented on issue #702: HDDS-3241. Invalid container reported to SCM should be deleted.

2020-04-01 Thread GitBox
linyiqun commented on issue #702: HDDS-3241. Invalid container reported to SCM should be deleted. URL: https://github.com/apache/hadoop-ozone/pull/702#issuecomment-607186184 Addressed your comments now, @elek . This is an

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #734: HDDS-3240. Improve write efficiency by creating container in parallel

2020-04-01 Thread GitBox
adoroszlai commented on a change in pull request #734: HDDS-3240. Improve write efficiency by creating container in parallel URL: https://github.com/apache/hadoop-ozone/pull/734#discussion_r401527564 ## File path:

[GitHub] [hadoop-ozone] lokeshj1703 commented on a change in pull request #683: HDDS-3149. Make o3fs support set and get acl

2020-04-01 Thread GitBox
lokeshj1703 commented on a change in pull request #683: HDDS-3149. Make o3fs support set and get acl URL: https://github.com/apache/hadoop-ozone/pull/683#discussion_r401505439 ## File path:

[jira] [Created] (HDDS-3314) scmcli container info command failing intermittently

2020-04-01 Thread Nilotpal Nandi (Jira)
Nilotpal Nandi created HDDS-3314: Summary: scmcli container info command failing intermittently Key: HDDS-3314 URL: https://issues.apache.org/jira/browse/HDDS-3314 Project: Hadoop Distributed Data

[jira] [Created] (HDDS-3313) OM HA acceptance test is flaky

2020-04-01 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-3313: -- Summary: OM HA acceptance test is flaky Key: HDDS-3313 URL: https://issues.apache.org/jira/browse/HDDS-3313 Project: Hadoop Distributed Data Store Issue

[jira] [Assigned] (HDDS-3311) OM logs not available for OM HA acceptance test

2020-04-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai reassigned HDDS-3311: -- Assignee: Attila Doroszlai > OM logs not available for OM HA acceptance test >

[jira] [Commented] (HDDS-3311) OM logs not available for OM HA acceptance test

2020-04-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072615#comment-17072615 ] Attila Doroszlai commented on HDDS-3311: The problem is that OM logs are redirected to file

[GitHub] [hadoop-ozone] bshashikant commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads

2020-04-01 Thread GitBox
bshashikant commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads URL: https://github.com/apache/hadoop-ozone/pull/578#issuecomment-607157966 > > I feel with more no of disks per datanode for write, we may need more threads depending upon the load. > >

  1   2   >