[jira] [Updated] (HDDS-3288) Update default RPC handler SCM/OM count to 100

2020-03-27 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-3288: Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch

[GitHub] [hadoop-ozone] mukul1987 merged pull request #729: HDDS-3288: Update default RPC handler SCM/OM count to 100

2020-03-27 Thread GitBox
mukul1987 merged pull request #729: HDDS-3288: Update default RPC handler SCM/OM count to 100 URL: https://github.com/apache/hadoop-ozone/pull/729 This is an automated message from the Apache Git Service. To respond to the

[jira] [Comment Edited] (HDDS-3241) Invalid container reported to SCM should be deleted

2020-03-27 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069198#comment-17069198 ] Yiqun Lin edited comment on HDDS-3241 at 3/28/20, 2:55 AM: --- Thanks for the

[jira] [Commented] (HDDS-3241) Invalid container reported to SCM should be deleted

2020-03-27 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069198#comment-17069198 ] Yiqun Lin commented on HDDS-3241: - Thanks for the comments, [~elek] / [~msingh]. Actually current SCM

[jira] [Updated] (HDDS-3291) Write operation when both OM followers are shutdown

2020-03-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3291: - Labels: pull-request-available (was: ) > Write operation when both OM followers are shutdown >

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #733: HDDS-3291. Write operation when both OM followers are shutdown.

2020-03-27 Thread GitBox
bharatviswa504 opened a new pull request #733: HDDS-3291. Write operation when both OM followers are shutdown. URL: https://github.com/apache/hadoop-ozone/pull/733 ## What changes were proposed in this pull request? Add IPC client time out, so that the client will fail with socket

[GitHub] [hadoop-ozone] vivekratnavel commented on issue #732: HDDS-3295. Ozone admins getting Permission Denied error while creating volume

2020-03-27 Thread GitBox
vivekratnavel commented on issue #732: HDDS-3295. Ozone admins getting Permission Denied error while creating volume URL: https://github.com/apache/hadoop-ozone/pull/732#issuecomment-605341527 @bharatviswa504 @xiaoyuyao Please review

[jira] [Updated] (HDDS-3295) Ozone admins getting Permission Denied error while creating volume

2020-03-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3295: - Labels: pull-request-available (was: ) > Ozone admins getting Permission Denied error while

[GitHub] [hadoop-ozone] vivekratnavel opened a new pull request #732: HDDS-3295. Ozone admins getting Permission Denied error while creating volume

2020-03-27 Thread GitBox
vivekratnavel opened a new pull request #732: HDDS-3295. Ozone admins getting Permission Denied error while creating volume URL: https://github.com/apache/hadoop-ozone/pull/732 ## What changes were proposed in this pull request? - get user information from om request instead of

[jira] [Created] (HDDS-3295) Ozone admins getting Permission Denied error while creating volume

2020-03-27 Thread Vivek Ratnavel Subramanian (Jira)
Vivek Ratnavel Subramanian created HDDS-3295: Summary: Ozone admins getting Permission Denied error while creating volume Key: HDDS-3295 URL: https://issues.apache.org/jira/browse/HDDS-3295

[jira] [Commented] (HDDS-3266) Intermittent integration test failure due to DEADLINE_EXCEEDED

2020-03-27 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069067#comment-17069067 ] Attila Doroszlai commented on HDDS-3266:

[GitHub] [hadoop-ozone] hanishakoneru commented on a change in pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit

2020-03-27 Thread GitBox
hanishakoneru commented on a change in pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit URL: https://github.com/apache/hadoop-ozone/pull/625#discussion_r399554295 ## File path:

[jira] [Updated] (HDDS-3266) Intermittent integration test failure due to DEADLINE_EXCEEDED

2020-03-27 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3266: --- Summary: Intermittent integration test failure due to DEADLINE_EXCEEDED (was: Intermittent

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #728: Master stable

2020-03-27 Thread GitBox
bharatviswa504 commented on issue #728: Master stable URL: https://github.com/apache/hadoop-ozone/pull/728#issuecomment-605312146 > @bharatviswa504 There are multiple problems. The space issue is fixed thanks to @adoroszlai (and I forget to merge it originally as he wrote). But the space

[GitHub] [hadoop-ozone] elek commented on issue #728: Master stable

2020-03-27 Thread GitBox
elek commented on issue #728: Master stable URL: https://github.com/apache/hadoop-ozone/pull/728#issuecomment-605301043 @bharatviswa504 There are multiple problems. The space issue is fixed thanks to @adoroszlai (and I forget to merge it originally as he wrote). But the space issue is

[jira] [Commented] (HDDS-2011) TestRandomKeyGenerator fails due to timeout

2020-03-27 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069020#comment-17069020 ] Siyao Meng commented on HDDS-2011: -- Also found in:

[jira] [Created] (HDDS-3294) Flaky test TestContainerStateMachineFailureOnRead#testReadStateMachineFailureClosesPipeline

2020-03-27 Thread Siyao Meng (Jira)
Siyao Meng created HDDS-3294: Summary: Flaky test TestContainerStateMachineFailureOnRead#testReadStateMachineFailureClosesPipeline Key: HDDS-3294 URL: https://issues.apache.org/jira/browse/HDDS-3294

[jira] [Resolved] (HDDS-3281) Add timeouts to all robot tests

2020-03-27 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru resolved HDDS-3281. -- Resolution: Fixed > Add timeouts to all robot tests > --- > >

[GitHub] [hadoop-ozone] hanishakoneru merged pull request #723: HDDS-3281. Add timeouts to all robot tests

2020-03-27 Thread GitBox
hanishakoneru merged pull request #723: HDDS-3281. Add timeouts to all robot tests URL: https://github.com/apache/hadoop-ozone/pull/723 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #723: HDDS-3281. Add timeouts to all robot tests

2020-03-27 Thread GitBox
hanishakoneru commented on issue #723: HDDS-3281. Add timeouts to all robot tests URL: https://github.com/apache/hadoop-ozone/pull/723#issuecomment-605255750 Thank you all for the reviews. Will merge this PR. This is an

[GitHub] [hadoop-ozone] aryangupta1998 opened a new pull request #730: HDDS-3289. Add a freon generator to create nested directories.

2020-03-27 Thread GitBox
aryangupta1998 opened a new pull request #730: HDDS-3289. Add a freon generator to create nested directories. URL: https://github.com/apache/hadoop-ozone/pull/730 ## What changes were proposed in this pull request? This Jira proposes to add a functionality to freon to create nested

[GitHub] [hadoop-ozone] aryangupta1998 closed pull request #730: HDDS-3289. Add a freon generator to create nested directories.

2020-03-27 Thread GitBox
aryangupta1998 closed pull request #730: HDDS-3289. Add a freon generator to create nested directories. URL: https://github.com/apache/hadoop-ozone/pull/730 This is an automated message from the Apache Git Service. To

[jira] [Updated] (HDDS-3047) ObjectStore#listVolumesByUser and CreateVolumeHandler#call should get full principal name by default

2020-03-27 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3047: - Summary: ObjectStore#listVolumesByUser and CreateVolumeHandler#call should get full principal name by

[GitHub] [hadoop-ozone] aryangupta1998 opened a new pull request #730: HDDS-3289. Add a freon generator to create nested directories.

2020-03-27 Thread GitBox
aryangupta1998 opened a new pull request #730: HDDS-3289. Add a freon generator to create nested directories. URL: https://github.com/apache/hadoop-ozone/pull/730 ## What changes were proposed in this pull request? This Jira proposes to add a functionality to freon to create nested

[jira] [Assigned] (HDDS-2976) Recon throws error while trying to get snapshot in secure environment

2020-03-27 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-2976: - Assignee: Prashant Pogde (was: Siddharth Wagle) > Recon throws error while trying to

[GitHub] [hadoop-ozone] aryangupta1998 closed pull request #730: HDDS-3289. Add a freon generator to create nested directories.

2020-03-27 Thread GitBox
aryangupta1998 closed pull request #730: HDDS-3289. Add a freon generator to create nested directories. URL: https://github.com/apache/hadoop-ozone/pull/730 This is an automated message from the Apache Git Service. To

[jira] [Created] (HDDS-3293) read operation failing when two container replicas are corrupted

2020-03-27 Thread Nilotpal Nandi (Jira)
Nilotpal Nandi created HDDS-3293: Summary: read operation failing when two container replicas are corrupted Key: HDDS-3293 URL: https://issues.apache.org/jira/browse/HDDS-3293 Project: Hadoop

[GitHub] [hadoop-ozone] smengcl edited a comment on issue #731: HDDS-3279. Rebase OFS branch

2020-03-27 Thread GitBox
smengcl edited a comment on issue #731: HDDS-3279. Rebase OFS branch URL: https://github.com/apache/hadoop-ozone/pull/731#issuecomment-605202481 Unrelated flaky test `org.apache.hadoop.ozone.client.rpc.TestContainerStateMachineFailureOnRead`. Will commit in a min.

[GitHub] [hadoop-ozone] smengcl commented on issue #731: HDDS-3279. Rebase OFS branch

2020-03-27 Thread GitBox
smengcl commented on issue #731: HDDS-3279. Rebase OFS branch URL: https://github.com/apache/hadoop-ozone/pull/731#issuecomment-605202481 Unrelated flaky test `org.apache.hadoop.ozone.client.rpc.TestContainerStateMachineFailureOnRead`. Will merge in a min.

[GitHub] [hadoop-ozone] xiaoyuyao commented on issue #665: HDDS-3160. Disable index and filter block cache for RocksDB.

2020-03-27 Thread GitBox
xiaoyuyao commented on issue #665: HDDS-3160. Disable index and filter block cache for RocksDB. URL: https://github.com/apache/hadoop-ozone/pull/665#issuecomment-605189323 Note even we don't put the filter/index into the block cache after this change, they will still be put into off-heap

[GitHub] [hadoop-ozone] adoroszlai commented on issue #723: HDDS-3281. Add timeouts to all robot tests

2020-03-27 Thread GitBox
adoroszlai commented on issue #723: HDDS-3281. Add timeouts to all robot tests URL: https://github.com/apache/hadoop-ozone/pull/723#issuecomment-605153928 > @adoroszlai, @elek are we good to merge this patch? Yes, thanks.

[GitHub] [hadoop-ozone] adoroszlai commented on issue #728: Master stable

2020-03-27 Thread GitBox
adoroszlai commented on issue #728: Master stable URL: https://github.com/apache/hadoop-ozone/pull/728#issuecomment-605148945 > Downloaded tarball and see that it failed due to no disk space. Disk space issue was fixed after `master-stable` branch had been created, so fix was

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on issue #728: Master stable

2020-03-27 Thread GitBox
bharatviswa504 edited a comment on issue #728: Master stable URL: https://github.com/apache/hadoop-ozone/pull/728#issuecomment-605143568 @elek Even for a revert of HDDS-3234 mr jobs failed. So, HDDS-3234 is not a real issue I think, our underlying CI has some issue. Downloaded tarball

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on issue #728: Master stable

2020-03-27 Thread GitBox
bharatviswa504 edited a comment on issue #728: Master stable URL: https://github.com/apache/hadoop-ozone/pull/728#issuecomment-605143568 @elek Even for a revert of HDDS-3234 mr jobs failed. So, HDDS-3234 is not a real issue I think, our underlying CI has some issue. Downloaded tarball

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #728: Master stable

2020-03-27 Thread GitBox
bharatviswa504 commented on issue #728: Master stable URL: https://github.com/apache/hadoop-ozone/pull/728#issuecomment-605143568 @elek Even for revert of HDDS-3234 mr jobs failed. Downloaded tarball and see that it failed due to no disk space.

[GitHub] [hadoop-ozone] smengcl opened a new pull request #731: HDDS-3279. Rebase OFS branch

2020-03-27 Thread GitBox
smengcl opened a new pull request #731: HDDS-3279. Rebase OFS branch URL: https://github.com/apache/hadoop-ozone/pull/731 ## What changes were proposed in this pull request? Get the necessary changes in OFS dev branch after the rebase to master branch. See the description and

[GitHub] [hadoop-ozone] smengcl edited a comment on issue #721: HDDS-3279. Rebase OFS branch (Draft)

2020-03-27 Thread GitBox
smengcl edited a comment on issue #721: HDDS-3279. Rebase OFS branch (Draft) URL: https://github.com/apache/hadoop-ozone/pull/721#issuecomment-605136056 Thanks @xiaoyuyao . I am going to do the following: 1. Close this PR; 2. Merge master commits to OFS dev branch manually; 3.

[jira] [Assigned] (HDDS-3285) MiniOzoneChaosCluster exits because of deadline exceeding

2020-03-27 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-3285: --- Assignee: Shashikant Banerjee > MiniOzoneChaosCluster exits because of deadline

[GitHub] [hadoop-ozone] smengcl commented on issue #721: HDDS-3279. Rebase OFS branch

2020-03-27 Thread GitBox
smengcl commented on issue #721: HDDS-3279. Rebase OFS branch URL: https://github.com/apache/hadoop-ozone/pull/721#issuecomment-605136056 Thanks @xiaoyuyao . I am going to do the following: 1. Close this PR; 2. Merge master commits to OFS dev branch manually; 3. Create a new PR

[jira] [Updated] (HDDS-3291) Write operation when both OM followers are shutdown

2020-03-27 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-3291: Reporter: Nilotpal Nandi (was: Bharat Viswanadham) > Write operation when both OM

[GitHub] [hadoop-ozone] smengcl closed pull request #721: HDDS-3279. Rebase OFS branch

2020-03-27 Thread GitBox
smengcl closed pull request #721: HDDS-3279. Rebase OFS branch URL: https://github.com/apache/hadoop-ozone/pull/721 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Updated] (HDDS-2964) Fix @Ignore-d integration tests

2020-03-27 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-2964: -- Status: Open (was: Patch Available) > Fix @Ignore-d integration tests >

[GitHub] [hadoop-ozone] smengcl commented on issue #582: HDDS-3047. ObjectStore#listVolumesByUser and CreateVolumeHandler#call should get user's full principal name instead of login name by default

2020-03-27 Thread GitBox
smengcl commented on issue #582: HDDS-3047. ObjectStore#listVolumesByUser and CreateVolumeHandler#call should get user's full principal name instead of login name by default URL: https://github.com/apache/hadoop-ozone/pull/582#issuecomment-605130860 Rebased to latest master to include

[GitHub] [hadoop-ozone] smengcl edited a comment on issue #582: HDDS-3047. ObjectStore#listVolumesByUser and CreateVolumeHandler#call should get user's full principal name instead of login name by def

2020-03-27 Thread GitBox
smengcl edited a comment on issue #582: HDDS-3047. ObjectStore#listVolumesByUser and CreateVolumeHandler#call should get user's full principal name instead of login name by default URL: https://github.com/apache/hadoop-ozone/pull/582#issuecomment-605130860 Rebased to latest master to

[GitHub] [hadoop-ozone] smengcl commented on issue #696: HDDS-3056. Allow users to list volumes they have access to, and optionally allow all users to list all volumes

2020-03-27 Thread GitBox
smengcl commented on issue #696: HDDS-3056. Allow users to list volumes they have access to, and optionally allow all users to list all volumes URL: https://github.com/apache/hadoop-ozone/pull/696#issuecomment-605129354 Rebased onto latest master to include the acceptance test failure fix

[jira] [Created] (HDDS-3292) Support Hadoop 3.3

2020-03-27 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDDS-3292: - Summary: Support Hadoop 3.3 Key: HDDS-3292 URL: https://issues.apache.org/jira/browse/HDDS-3292 Project: Hadoop Distributed Data Store Issue Type: Task

[jira] [Updated] (HDDS-3291) Write operation when both OM followers are shutdown

2020-03-27 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3291: - Description: steps taken : -- 1. In OM HA environment, shutdown both OM

[jira] [Created] (HDDS-3291) Write operation when both OM followers are shutdown

2020-03-27 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-3291: Summary: Write operation when both OM followers are shutdown Key: HDDS-3291 URL: https://issues.apache.org/jira/browse/HDDS-3291 Project: Hadoop Distributed

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #723: HDDS-3281. Add timeouts to all robot tests

2020-03-27 Thread GitBox
hanishakoneru commented on issue #723: HDDS-3281. Add timeouts to all robot tests URL: https://github.com/apache/hadoop-ozone/pull/723#issuecomment-605096549 > Note: originally I suggested to put the Timeout to the commonlib.robot to avoid code duplication, but I tested it and doesn't

[GitHub] [hadoop-ozone] hanishakoneru edited a comment on issue #723: HDDS-3281. Add timeouts to all robot tests

2020-03-27 Thread GitBox
hanishakoneru edited a comment on issue #723: HDDS-3281. Add timeouts to all robot tests URL: https://github.com/apache/hadoop-ozone/pull/723#issuecomment-605096549 > Note: originally I suggested to put the Timeout to the commonlib.robot to avoid code duplication, but I tested it and

[jira] [Updated] (HDDS-3288) Update default RPC handler SCM/OM count to 100

2020-03-27 Thread Rakesh Radhakrishnan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Radhakrishnan updated HDDS-3288: --- Status: Patch Available (was: Open) > Update default RPC handler SCM/OM count to 100

[GitHub] [hadoop-ozone] elek commented on issue #687: HDDS-2184. Rename ozone scmcli to ozone admin

2020-03-27 Thread GitBox
elek commented on issue #687: HDDS-2184. Rename ozone scmcli to ozone admin URL: https://github.com/apache/hadoop-ozone/pull/687#issuecomment-605047108 Base branch is changed. Please merge it manually instead of using github UI button.

[jira] [Created] (HDDS-3290) Remove deprecated RandomKeyGenerator

2020-03-27 Thread Marton Elek (Jira)
Marton Elek created HDDS-3290: - Summary: Remove deprecated RandomKeyGenerator Key: HDDS-3290 URL: https://issues.apache.org/jira/browse/HDDS-3290 Project: Hadoop Distributed Data Store Issue

[GitHub] [hadoop-ozone] elek commented on issue #710: HDDS-3173. Provide better default JVM options

2020-03-27 Thread GitBox
elek commented on issue #710: HDDS-3173. Provide better default JVM options URL: https://github.com/apache/hadoop-ozone/pull/710#issuecomment-605005247 > What do you think? I think it's a very good idea to print out the flags when we touch them, but not sure what is your suggestion

[jira] [Updated] (HDDS-3289) Add a freon generator to create nested directories

2020-03-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3289: - Labels: pull-request-available (was: ) > Add a freon generator to create nested directories >

[GitHub] [hadoop-ozone] elek commented on issue #713: HDDS-3251. Bump version to 0.6.0-SNAPSHOT

2020-03-27 Thread GitBox
elek commented on issue #713: HDDS-3251. Bump version to 0.6.0-SNAPSHOT URL: https://github.com/apache/hadoop-ozone/pull/713#issuecomment-604995537 BTW, I changed the base branch to master-stable, please don't merge it with Github UI, just manually...

[GitHub] [hadoop-ozone] aryangupta1998 opened a new pull request #730: HDDS-3289. Add a freon generator to create nested directories.

2020-03-27 Thread GitBox
aryangupta1998 opened a new pull request #730: HDDS-3289. Add a freon generator to create nested directories. URL: https://github.com/apache/hadoop-ozone/pull/730 ## What changes were proposed in this pull request? This Jira proposes to add a functionality to freon to create nested

[GitHub] [hadoop-ozone] elek commented on issue #713: HDDS-3251. Bump version to 0.6.0-SNAPSHOT

2020-03-27 Thread GitBox
elek commented on issue #713: HDDS-3251. Bump version to 0.6.0-SNAPSHOT URL: https://github.com/apache/hadoop-ozone/pull/713#issuecomment-604995129 Thanks the review @dineshchitlangia > @elek the failures are unrelated to your proposed change. I am -1 to merge anything

[GitHub] [hadoop-ozone] elek commented on issue #665: HDDS-3160. Disable index and filter block cache for RocksDB.

2020-03-27 Thread GitBox
elek commented on issue #665: HDDS-3160. Disable index and filter block cache for RocksDB. URL: https://github.com/apache/hadoop-ozone/pull/665#issuecomment-604992384 Base branch is changed. Please don't merge it from github ui, only manually.

[GitHub] [hadoop-ozone] elek commented on issue #714: HDDS-3164. Add Recon endpoint to serve missing containers and its metadata.

2020-03-27 Thread GitBox
elek commented on issue #714: HDDS-3164. Add Recon endpoint to serve missing containers and its metadata. URL: https://github.com/apache/hadoop-ozone/pull/714#issuecomment-604987204 If you see a flaky test, please disable it (without and issue) + create a new open issue and repeat the

[GitHub] [hadoop-ozone] elek commented on issue #722: HDDS-3074. Make the configuration of container scrub consistent.

2020-03-27 Thread GitBox
elek commented on issue #722: HDDS-3074. Make the configuration of container scrub consistent. URL: https://github.com/apache/hadoop-ozone/pull/722#issuecomment-604986683 If you see a flaky test, please disable it (without and issue) + create a new open issue and repeat the build. There

[GitHub] [hadoop-ozone] elek commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-27 Thread GitBox
elek commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#issuecomment-604986545 If you see a flaky test, please disable it (without and issue) + create a new open issue and repeat the build.

[GitHub] [hadoop-ozone] elek commented on issue #665: HDDS-3160. Disable index and filter block cache for RocksDB.

2020-03-27 Thread GitBox
elek commented on issue #665: HDDS-3160. Disable index and filter block cache for RocksDB. URL: https://github.com/apache/hadoop-ozone/pull/665#issuecomment-604982534 > Given this does not happen during the key creation earlier. This seems very likely from a RocksDB compaction, which

[GitHub] [hadoop-ozone] elek commented on issue #708: HDDS-3239. Provide message-level metrics from the generic protocol dispatch.

2020-03-27 Thread GitBox
elek commented on issue #708: HDDS-3239. Provide message-level metrics from the generic protocol dispatch. URL: https://github.com/apache/hadoop-ozone/pull/708#issuecomment-604981594 Base branch is changed. Please don't merge it from the github web ui, only manually.

[jira] [Created] (HDDS-3289) Add a freon generator to create nested directories

2020-03-27 Thread Aryan Gupta (Jira)
Aryan Gupta created HDDS-3289: - Summary: Add a freon generator to create nested directories Key: HDDS-3289 URL: https://issues.apache.org/jira/browse/HDDS-3289 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3288) Update default RPC handler SCM/OM count to 100

2020-03-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3288: - Labels: pull-request-available (was: ) > Update default RPC handler SCM/OM count to 100 >

[GitHub] [hadoop-ozone] rakeshadr opened a new pull request #729: HDDS-3288: Update default RPC handler SCM/OM count to 100

2020-03-27 Thread GitBox
rakeshadr opened a new pull request #729: HDDS-3288: Update default RPC handler SCM/OM count to 100 URL: https://github.com/apache/hadoop-ozone/pull/729 ## What changes were proposed in this pull request? Presently, default PC handler count of ozone.scm.handler.count.key=10 and

[GitHub] [hadoop-ozone] runzhiwang closed pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once

2020-03-27 Thread GitBox
runzhiwang closed pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once URL: https://github.com/apache/hadoop-ozone/pull/709 This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop-ozone] runzhiwang opened a new pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once

2020-03-27 Thread GitBox
runzhiwang opened a new pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once URL: https://github.com/apache/hadoop-ozone/pull/709 ## What changes were proposed in this pull request? What's the problem ? 1. This happens when datanode create

[GitHub] [hadoop-ozone] elek commented on a change in pull request #700: HDDS-3172 Use DBStore instead of MetadataStore in SCM

2020-03-27 Thread GitBox
elek commented on a change in pull request #700: HDDS-3172 Use DBStore instead of MetadataStore in SCM URL: https://github.com/apache/hadoop-ozone/pull/700#discussion_r399153032 ## File path:

[GitHub] [hadoop-ozone] elek commented on a change in pull request #700: HDDS-3172 Use DBStore instead of MetadataStore in SCM

2020-03-27 Thread GitBox
elek commented on a change in pull request #700: HDDS-3172 Use DBStore instead of MetadataStore in SCM URL: https://github.com/apache/hadoop-ozone/pull/700#discussion_r399152379 ## File path: hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/scm/ReconNodeManager.java

[GitHub] [hadoop-ozone] elek commented on issue #723: HDDS-3281. Add timeouts to all robot tests

2020-03-27 Thread GitBox
elek commented on issue #723: HDDS-3281. Add timeouts to all robot tests URL: https://github.com/apache/hadoop-ozone/pull/723#issuecomment-604911971 > @adoroszlai, I think even with that limitation the timeout will help us isolate the problem. Let's say the acceptance suit is cancelled, we

[GitHub] [hadoop-ozone] elek commented on issue #720: HDDS-3185 Construct a standalone ratis server for SCM.

2020-03-27 Thread GitBox
elek commented on issue #720: HDDS-3185 Construct a standalone ratis server for SCM. URL: https://github.com/apache/hadoop-ozone/pull/720#issuecomment-604904324 Speaking about the code in the patch: I would suggest to use the new config based annotation model for new code:

[GitHub] [hadoop-ozone] elek commented on issue #720: HDDS-3185 Construct a standalone ratis server for SCM.

2020-03-27 Thread GitBox
elek commented on issue #720: HDDS-3185 Construct a standalone ratis server for SCM. URL: https://github.com/apache/hadoop-ozone/pull/720#issuecomment-604901383 @timmylicheng Thanks the explain it. I will add your explanation to the next Community Meeting minutes. ```

[GitHub] [hadoop-ozone] ChenSammi commented on issue #720: HDDS-3185 Construct a standalone ratis server for SCM.

2020-03-27 Thread GitBox
ChenSammi commented on issue #720: HDDS-3185 Construct a standalone ratis server for SCM. URL: https://github.com/apache/hadoop-ozone/pull/720#issuecomment-604899459 +1 This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] ChenSammi merged pull request #720: HDDS-3185 Construct a standalone ratis server for SCM.

2020-03-27 Thread GitBox
ChenSammi merged pull request #720: HDDS-3185 Construct a standalone ratis server for SCM. URL: https://github.com/apache/hadoop-ozone/pull/720 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop-ozone] elek opened a new pull request #728: Master stable

2020-03-27 Thread GitBox
elek opened a new pull request #728: Master stable URL: https://github.com/apache/hadoop-ozone/pull/728 ## What changes were proposed in this pull request? Recently we have seen a lot of timeout errors in integrations tests and acceptance tests. My theory is that it caused by the

[GitHub] [hadoop-ozone] elek commented on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface

2020-03-27 Thread GitBox
elek commented on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface URL: https://github.com/apache/hadoop-ozone/pull/690#issuecomment-604894837 I am not full happy that my suggestion is ignored. I think it would be better to switch to the EventQueue

[jira] [Updated] (HDDS-3257) Intermittent timeout in integration tests

2020-03-27 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3257: --- Attachment: org.apache.hadoop.fs.ozone.contract.ITestOzoneContractMkdir-output.txt >

[jira] [Commented] (HDDS-3257) Intermittent timeout in integration tests

2020-03-27 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068434#comment-17068434 ] Attila Doroszlai commented on HDDS-3257:

[jira] [Updated] (HDDS-3284) ozonesecure-mr test fails due to lack of disk space

2020-03-27 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3284: --- Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HDDS-3287) keyLocationVersions become bigger and bigger when upload the same file many times.

2020-03-27 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3287: - Summary: keyLocationVersions become bigger and bigger when upload the same file many times. (was:

[jira] [Updated] (HDDS-3287) keyLocationVersions become bigger and bigger when upload the same file many times.

2020-03-27 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3287: - Description: Add a config to define keep how many versions. (was: Because keyLocationVersions get biger

[jira] [Updated] (HDDS-3287) OmKeyInfo become bigger and bigger when upload the same file many times.

2020-03-27 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3287: - Description: Because keyLocationVersions get biger and gi > OmKeyInfo become bigger and bigger when

[jira] [Commented] (HDDS-3287) OmKeyInfo become bigger and bigger when upload the same file many times.

2020-03-27 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068422#comment-17068422 ] runzhiwang commented on HDDS-3287: -- I'm working on it > OmKeyInfo become bigger and bigger when upload

[jira] [Updated] (HDDS-3287) OmKeyInfo become bigger and bigger when upload the same file many times.

2020-03-27 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3287: - Issue Type: Improvement (was: Bug) > OmKeyInfo become bigger and bigger when upload the same file many

[jira] [Created] (HDDS-3287) OmKeyInfo become bigger and bigger when upload the same file many times.

2020-03-27 Thread runzhiwang (Jira)
runzhiwang created HDDS-3287: Summary: OmKeyInfo become bigger and bigger when upload the same file many times. Key: HDDS-3287 URL: https://issues.apache.org/jira/browse/HDDS-3287 Project: Hadoop

[jira] [Resolved] (HDDS-3179) Pipeline placement based on Topology does not have fall back protection

2020-03-27 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDDS-3179. - Resolution: Fixed > Pipeline placement based on Topology does not have fall back

[GitHub] [hadoop-ozone] sodonnel merged pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-27 Thread GitBox
sodonnel merged pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678 This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-27 Thread GitBox
sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#issuecomment-604854734 All tests are green except this one, which I have seen fail in several other PRs, so it is flaky: ```

[GitHub] [hadoop-ozone] swagle commented on a change in pull request #727: HDDS-3273. getConf does not return all OM addresses.

2020-03-27 Thread GitBox
swagle commented on a change in pull request #727: HDDS-3273. getConf does not return all OM addresses. URL: https://github.com/apache/hadoop-ozone/pull/727#discussion_r399053289 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OmUtils.java ## @@