[jira] [Work logged] (HADOOP-17414) Magic committer files don't have the count of bytes written collected by spark

2021-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17414?focusedWorklogId=534137&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-534137 ] ASF GitHub Bot logged work on HADOOP-17414: --- Author: ASF GitHub B

[GitHub] [hadoop] liuml07 commented on a change in pull request #2530: HADOOP-17414. Magic committer files don't have the count of bytes written collected by spark

2021-01-10 Thread GitBox
liuml07 commented on a change in pull request #2530: URL: https://github.com/apache/hadoop/pull/2530#discussion_r554779575 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java ## @@ -1048,4 +1048,10 @@ private Constants() { public stat

[jira] [Updated] (HADOOP-16947) Stale record should be remove when MutableRollingAverages generating aggregate data.

2021-01-10 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HADOOP-16947: -- Attachment: (was: HDFS-14783) > Stale record should be remove when MutableRollingAverages

[jira] [Commented] (HADOOP-16947) Stale record should be remove when MutableRollingAverages generating aggregate data.

2021-01-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262442#comment-17262442 ] Hadoop QA commented on HADOOP-16947: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Commented] (HADOOP-16492) Support HuaweiCloud Object Storage as a Hadoop Backend File System

2021-01-10 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262434#comment-17262434 ] Brahma Reddy Battula commented on HADOOP-16492: --- Ok. [~junping_du].. I wi

[GitHub] [hadoop] hadoop-yetus commented on pull request #2548: DRAFT PR: Implementing ListStatusRemoteIterator

2021-01-10 Thread GitBox
hadoop-yetus commented on pull request #2548: URL: https://github.com/apache/hadoop/pull/2548#issuecomment-757644429 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #2548: DRAFT PR: Implementing ListStatusRemoteIterator

2021-01-10 Thread GitBox
hadoop-yetus commented on pull request #2548: URL: https://github.com/apache/hadoop/pull/2548#issuecomment-757641569 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] vinaysbadami commented on a change in pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-01-10 Thread GitBox
vinaysbadami commented on a change in pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#discussion_r554757241 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ContentSummaryProcessor.java ## @@ -0,0 +1,119 @@ +/** +

[GitHub] [hadoop] vinaysbadami commented on a change in pull request #2548: DRAFT PR: Implementing ListStatusRemoteIterator

2021-01-10 Thread GitBox
vinaysbadami commented on a change in pull request #2548: URL: https://github.com/apache/hadoop/pull/2548#discussion_r554734179 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java ## @@ -982,6 +984,14 @@ public boolean e

[GitHub] [hadoop] vinaysbadami commented on a change in pull request #2548: DRAFT PR: Implementing ListStatusRemoteIterator

2021-01-10 Thread GitBox
vinaysbadami commented on a change in pull request #2548: URL: https://github.com/apache/hadoop/pull/2548#discussion_r554727915 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ListStatusRemoteIterator.java ## @@ -0,0 +1,149 @@ +/**

[GitHub] [hadoop] vinaysbadami commented on a change in pull request #2548: DRAFT PR: Implementing ListStatusRemoteIterator

2021-01-10 Thread GitBox
vinaysbadami commented on a change in pull request #2548: URL: https://github.com/apache/hadoop/pull/2548#discussion_r550179046 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ListStatusRemoteIterator.java ## @@ -0,0 +1,129 @@ +/**

[GitHub] [hadoop] vinaysbadami commented on a change in pull request #2548: DRAFT PR: Implementing ListStatusRemoteIterator

2021-01-10 Thread GitBox
vinaysbadami commented on a change in pull request #2548: URL: https://github.com/apache/hadoop/pull/2548#discussion_r554726041 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ListStatusRemoteIterator.java ## @@ -0,0 +1,149 @@ +/**

[GitHub] [hadoop] bshashikant commented on a change in pull request #2595: HDFS-15619 Add snapshot related metrics

2021-01-10 Thread GitBox
bshashikant commented on a change in pull request #2595: URL: https://github.com/apache/hadoop/pull/2595#discussion_r554708986 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/metrics/NameNodeMetrics.java ## @@ -26,13 +26,7 @@

[jira] [Updated] (HADOOP-16947) Stale record should be remove when MutableRollingAverages generating aggregate data.

2021-01-10 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HADOOP-16947: -- Attachment: HADOOP-16947-012.patch > Stale record should be remove when MutableRollingAverage

[jira] [Commented] (HADOOP-16947) Stale record should be remove when MutableRollingAverages generating aggregate data.

2021-01-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262304#comment-17262304 ] Hadoop QA commented on HADOOP-16947: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2021-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=534035&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-534035 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2597: HADOOP-17191. ABFS: Run the tests with various combinations of configurations and publish a consolidated results

2021-01-10 Thread GitBox
hadoop-yetus commented on pull request #2597: URL: https://github.com/apache/hadoop/pull/2597#issuecomment-757514175 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 29m 55

[GitHub] [hadoop] hadoop-yetus commented on pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-01-10 Thread GitBox
hadoop-yetus commented on pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#issuecomment-757509492 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-01-10 Thread GitBox
hadoop-yetus commented on pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#issuecomment-757508813 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Updated] (HADOOP-16947) Stale record should be remove when MutableRollingAverages generating aggregate data.

2021-01-10 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HADOOP-16947: -- Attachment: HADOOP-16947-011.patch > Stale record should be remove when MutableRollingAverage

[jira] [Work logged] (HADOOP-17272) ABFS Streams to support IOStatistics API

2021-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17272?focusedWorklogId=534014&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-534014 ] ASF GitHub Bot logged work on HADOOP-17272: --- Author: ASF GitHub B

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2604: HADOOP-17272. ABFS Streams to support IOStatistics API

2021-01-10 Thread GitBox
mehakmeet commented on a change in pull request #2604: URL: https://github.com/apache/hadoop/pull/2604#discussion_r554590481 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsOutputStream.java ## @@ -144,6 +151,7 @@ public AbfsOut

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-01-10 Thread GitBox
sumangala-patki commented on a change in pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#discussion_r554586230 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ContentSummaryProcessor.java ## @@ -0,0 +1,107 @@ +/*

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-01-10 Thread GitBox
sumangala-patki commented on a change in pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#discussion_r554586230 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ContentSummaryProcessor.java ## @@ -0,0 +1,107 @@ +/*

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-01-10 Thread GitBox
sumangala-patki commented on a change in pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#discussion_r554585923 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ContentSummaryProcessor.java ## @@ -0,0 +1,107 @@ +/*

[jira] [Commented] (HADOOP-16947) Stale record should be remove when MutableRollingAverages generating aggregate data.

2021-01-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262179#comment-17262179 ] Hadoop QA commented on HADOOP-16947: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] hadoop-yetus commented on pull request #2605: HDFS-15423 RBF: WebHDFS create shouldn't choose DN from all sub-clusters

2021-01-10 Thread GitBox
hadoop-yetus commented on pull request #2605: URL: https://github.com/apache/hadoop/pull/2605#issuecomment-757443971 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok