[jira] [Commented] (HADOOP-17214) Allow file system caching to be disabled for all file systems

2020-09-02 Thread Haibo Chen (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17189846#comment-17189846 ] Haibo Chen commented on HADOOP-17214: - Linked https://issues.apache.org/jira/browse

[jira] [Work logged] (HADOOP-17166) ABFS: Add configs for maxConcurrentRequestCount and threadpool queue size

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17166?focusedWorklogId=478276&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478276 ] ASF GitHub Bot logged work on HADOOP-17166: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2179: HADOOP-17166. ABFS: making max concurrent requests and max requests that can be que…

2020-09-02 Thread GitBox
hadoop-yetus commented on pull request #2179: URL: https://github.com/apache/hadoop/pull/2179#issuecomment-686248502 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 25

[jira] [Work logged] (HADOOP-17166) ABFS: Add configs for maxConcurrentRequestCount and threadpool queue size

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17166?focusedWorklogId=478266&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478266 ] ASF GitHub Bot logged work on HADOOP-17166: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17166) ABFS: Add configs for maxConcurrentRequestCount and threadpool queue size

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17166?focusedWorklogId=478267&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478267 ] ASF GitHub Bot logged work on HADOOP-17166: --- Author: ASF GitHub B

[GitHub] [hadoop] bilaharith commented on a change in pull request #2179: HADOOP-17166. ABFS: making max concurrent requests and max requests that can be que…

2020-09-02 Thread GitBox
bilaharith commented on a change in pull request #2179: URL: https://github.com/apache/hadoop/pull/2179#discussion_r482685347 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/ITestAbfsOutputStream.java ## @@ -0,0 +1,77 @@ +/** + * Li

[GitHub] [hadoop] bilaharith commented on a change in pull request #2179: HADOOP-17166. ABFS: making max concurrent requests and max requests that can be que…

2020-09-02 Thread GitBox
bilaharith commented on a change in pull request #2179: URL: https://github.com/apache/hadoop/pull/2179#discussion_r482685168 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/constants/ConfigurationKeys.java ## @@ -52,6 +52,8 @@ public sta

[jira] [Commented] (HADOOP-17188) Support for AWS STSAssumeRoleWithWebIdentitySessionCredentialsProvider based credential provider to support use of IRSA on deployments on AWS EKS Cluster

2020-09-02 Thread Arun Ravi M V (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17189791#comment-17189791 ] Arun Ravi M V commented on HADOOP-17188: Here is the Jira ticket and pull reque

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=478248&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478248 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub B

[GitHub] [hadoop] JohnZZGithub commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread GitBox
JohnZZGithub commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-686183399 Thanks @umamaheswararao @umamaheswararao Thanks for the comments. Please see the reply inline. > Hi @JohnZZGithub, I got few other points to discuss. >

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=478247&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478247 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub B

[GitHub] [hadoop] JohnZZGithub edited a comment on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread GitBox
JohnZZGithub edited a comment on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-686183399 Thanks @umamaheswararao @umamaheswararao Thanks for the comments. Please see the reply inline. > Hi @JohnZZGithub, I got few other points to discuss

[GitHub] [hadoop] hadoop-yetus commented on pull request #2271: YARN-10419. Javadoc error in hadoop-yarn-server-common module.

2020-09-02 Thread GitBox
hadoop-yetus commented on pull request #2271: URL: https://github.com/apache/hadoop/pull/2271#issuecomment-686159100 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 9

[jira] [Work logged] (HADOOP-17165) Implement service-user feature in DecayRPCScheduler

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17165?focusedWorklogId=478228&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478228 ] ASF GitHub Bot logged work on HADOOP-17165: --- Author: ASF GitHub B

[GitHub] [hadoop] tasanuma commented on a change in pull request #2240: HADOOP-17165. Implement service-user feature in DecayRPCScheduler.

2020-09-02 Thread GitBox
tasanuma commented on a change in pull request #2240: URL: https://github.com/apache/hadoop/pull/2240#discussion_r482607435 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/DecayRpcScheduler.java ## @@ -483,6 +501,12 @@ private void recompu

[GitHub] [hadoop] iwasakims opened a new pull request #2271: YARN-10419. Javadoc error in hadoop-yarn-server-common module.

2020-09-02 Thread GitBox
iwasakims opened a new pull request #2271: URL: https://github.com/apache/hadoop/pull/2271 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] Gaurangi94 opened a new pull request #2270: HADOOP-16984 Add support to read history files from the done directory

2020-09-02 Thread GitBox
Gaurangi94 opened a new pull request #2270: URL: https://github.com/apache/hadoop/pull/2270 Currently history server implementation moves files from intermediate to done directory. We would like to add an additional server that can function as an alternate read only history server. To supp

[jira] [Updated] (HADOOP-16984) Add support to read history files from the done directory

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-16984: Labels: pull-request-available (was: ) > Add support to read history files from the done

[jira] [Work logged] (HADOOP-16984) Add support to read history files from the done directory

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16984?focusedWorklogId=478190&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478190 ] ASF GitHub Bot logged work on HADOOP-16984: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17199) Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers to 3.2.x

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17199?focusedWorklogId=478113&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478113 ] ASF GitHub Bot logged work on HADOOP-17199: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2269: HADOOP-17199. S3A Directory Marker HADOOP-13230 backport to branch-2

2020-09-02 Thread GitBox
hadoop-yetus commented on pull request #2269: URL: https://github.com/apache/hadoop/pull/2269#issuecomment-685980634 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 32

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=478092&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478092 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub B

[GitHub] [hadoop] umamaheswararao commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread GitBox
umamaheswararao commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-685959366 ``` As for porting into FileContext, do you mean fix the APIs which are not implemented in ViewFileSystem so FileContext could find the right path? E.g. createMultip

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=478089&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478089 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub B

[GitHub] [hadoop] umamaheswararao commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread GitBox
umamaheswararao commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-685957079 Hi @JohnZZGithub, I got few other points to discuss. 1. We have exposed getMountPoints API. It seems we can't return any mount points from REGEX based because you would

[GitHub] [hadoop] Gaurangi94 commented on a change in pull request #2028: MAPREDUCE-7279. Adds RM host name to history server web page

2020-09-02 Thread GitBox
Gaurangi94 commented on a change in pull request #2028: URL: https://github.com/apache/hadoop/pull/2028#discussion_r482344898 ## File path: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/jobhistory/JobHistoryEvent

[GitHub] [hadoop] liuml07 commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-02 Thread GitBox
liuml07 commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r482341228 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StorageType.java ## @@ -34,28 +34,35 @@ @InterfaceStability.Unstable

[jira] [Work logged] (HADOOP-17199) Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers to 3.2.x

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17199?focusedWorklogId=478070&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478070 ] ASF GitHub Bot logged work on HADOOP-17199: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2269: HADOOP-17199. S3A Directory Marker HADOOP-13230 backport to branch-2

2020-09-02 Thread GitBox
hadoop-yetus commented on pull request #2269: URL: https://github.com/apache/hadoop/pull/2269#issuecomment-685933544 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 11m 10

[jira] [Work logged] (HADOOP-17227) improve s3guard markers command line tool

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17227?focusedWorklogId=478064&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478064 ] ASF GitHub Bot logged work on HADOOP-17227: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #2254: HADOOP-17227. Marker Tool tuning

2020-09-02 Thread GitBox
steveloughran commented on pull request #2254: URL: https://github.com/apache/hadoop/pull/2254#issuecomment-685928379 + for testing, it'd be good if we could count objects -minobjects, -maxobjects, which would be for all objects, markers included, under a path. Helps verify rename &c, even

[GitHub] [hadoop] sunchao commented on a change in pull request #2240: HADOOP-17165. Implement service-user feature in DecayRPCScheduler.

2020-09-02 Thread GitBox
sunchao commented on a change in pull request #2240: URL: https://github.com/apache/hadoop/pull/2240#discussion_r482275899 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/DecayRpcScheduler.java ## @@ -483,6 +501,12 @@ private void recomput

[jira] [Work logged] (HADOOP-17165) Implement service-user feature in DecayRPCScheduler

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17165?focusedWorklogId=478037&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478037 ] ASF GitHub Bot logged work on HADOOP-17165: --- Author: ASF GitHub B

[GitHub] [hadoop] brahmareddybattula commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-02 Thread GitBox
brahmareddybattula commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r482249623 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StorageType.java ## @@ -34,28 +34,35 @@ @InterfaceStabili

[GitHub] [hadoop] brahmareddybattula commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-02 Thread GitBox
brahmareddybattula commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r482248330 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StorageType.java ## @@ -34,28 +34,35 @@ @InterfaceStabili

[GitHub] [hadoop] goiri commented on a change in pull request #2266: [RBF] HDFS-15554 Force router check file existence in destinations before adding/updating mount points

2020-09-02 Thread GitBox
goiri commented on a change in pull request #2266: URL: https://github.com/apache/hadoop/pull/2266#discussion_r482245829 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterAdminServer.java ## @@ -562,11 +595,35

[jira] [Work logged] (HADOOP-17199) Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers to 3.2.x

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17199?focusedWorklogId=477987&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477987 ] ASF GitHub Bot logged work on HADOOP-17199: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran opened a new pull request #2269: HADOOP-17199. S3A Directory Marker HADOOP-13230 backport #2210

2020-09-02 Thread GitBox
steveloughran opened a new pull request #2269: URL: https://github.com/apache/hadoop/pull/2269 This backports the listing-side changes of HADOOP-13230. With this patch in, this branch of Hadoop is compatible with S3A clients which do not delete directory markers when files are crea

[jira] [Work logged] (HADOOP-17227) improve s3guard markers command line tool

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17227?focusedWorklogId=477980&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477980 ] ASF GitHub Bot logged work on HADOOP-17227: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #2254: HADOOP-17227. Marker Tool tuning

2020-09-02 Thread GitBox
steveloughran commented on pull request #2254: URL: https://github.com/apache/hadoop/pull/2254#issuecomment-685873527 aah, the builder API raises checkstyles ``` ./hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/s3guard/S3GuardTool.java:762: public static final

[jira] [Work logged] (HADOOP-17227) improve s3guard markers command line tool

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17227?focusedWorklogId=477966&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477966 ] ASF GitHub Bot logged work on HADOOP-17227: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2254: HADOOP-17227. Marker Tool tuning

2020-09-02 Thread GitBox
hadoop-yetus commented on pull request #2254: URL: https://github.com/apache/hadoop/pull/2254#issuecomment-68582 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 28m 2

[jira] [Commented] (HADOOP-17239) ViewFs#getDelegationTokens should include fallback fs tokens as well.

2020-09-02 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17189314#comment-17189314 ] Uma Maheswara Rao G commented on HADOOP-17239: -- Thank you [~ste...@apache.

[jira] [Commented] (HADOOP-17241) s3a: bucket names which aren't parseable hostnames unsupported

2020-09-02 Thread Ondrej Kokes (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17189310#comment-17189310 ] Ondrej Kokes commented on HADOOP-17241: --- [~ste...@apache.org] excellent stuff, th

[jira] [Work logged] (HADOOP-17199) Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers to 3.2.x

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17199?focusedWorklogId=477944&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477944 ] ASF GitHub Bot logged work on HADOOP-17199: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran closed pull request #2262: HADOOP-17199. S3A Directory Marker HADOOP-13230 backport to branch-3.0

2020-09-02 Thread GitBox
steveloughran closed pull request #2262: URL: https://github.com/apache/hadoop/pull/2262 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Commented] (HADOOP-17188) Support for AWS STSAssumeRoleWithWebIdentitySessionCredentialsProvider based credential provider to support use of IRSA on deployments on AWS EKS Cluster

2020-09-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17189283#comment-17189283 ] Steve Loughran commented on HADOOP-17188: - ok, so it was some spark setup chang

[jira] [Commented] (HADOOP-17239) ViewFs#getDelegationTokens should include fallback fs tokens as well.

2020-09-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17189282#comment-17189282 ] Steve Loughran commented on HADOOP-17239: - you should be returning them in getA

[jira] [Resolved] (HADOOP-17241) s3a: bucket names which aren't parseable hostnames unsupported

2020-09-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17241. - Resolution: Duplicate I'm afraid you've just discovered the harsh truth which is the AW

[jira] [Updated] (HADOOP-17241) s3a: bucket names which aren't parseable hostnames unsupported

2020-09-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17241: Summary: s3a: bucket names which aren't parseable hostnames unsupported (was: s3a: dots

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=477830&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477830 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread GitBox
hadoop-yetus commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-685704174 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 30

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=477829&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477829 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub B

[GitHub] [hadoop] mehakmeet commented on pull request #2264: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-02 Thread GitBox
mehakmeet commented on pull request #2264: URL: https://github.com/apache/hadoop/pull/2264#issuecomment-685703493 I was testing after the single-line comment, turns out the read() method is returning the bytes with HTTP-206(Partial Content) status code. So, should I check for only 206 for

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=477823&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477823 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #2264: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-02 Thread GitBox
steveloughran commented on pull request #2264: URL: https://github.com/apache/hadoop/pull/2264#issuecomment-685699945 LGTM, one minor change which is only count 200 responses, so as to make clear it is only successful GETs which are measured ---

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=477795&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477795 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=477794&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477794 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on a change in pull request #2264: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-02 Thread GitBox
steveloughran commented on a change in pull request #2264: URL: https://github.com/apache/hadoop/pull/2264#discussion_r481992260 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java ## @@ -248,8 +248,10 @@ private

[GitHub] [hadoop] steveloughran commented on a change in pull request #2264: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-02 Thread GitBox
steveloughran commented on a change in pull request #2264: URL: https://github.com/apache/hadoop/pull/2264#discussion_r481992260 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java ## @@ -248,8 +248,10 @@ private

[jira] [Updated] (HADOOP-17241) s3a: dots not allowed in bucket names

2020-09-02 Thread Ondrej Kokes (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ondrej Kokes updated HADOOP-17241: -- Description: Hi there, I'm using Spark to read some data from S3 and I encountered an error

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=477699&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477699 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub B

[jira] [Created] (HADOOP-17241) s3a: dots not allowed in bucket names

2020-09-02 Thread Ondrej Kokes (Jira)
Ondrej Kokes created HADOOP-17241: - Summary: s3a: dots not allowed in bucket names Key: HADOOP-17241 URL: https://issues.apache.org/jira/browse/HADOOP-17241 Project: Hadoop Common Issue Type:

[GitHub] [hadoop] umamaheswararao commented on a change in pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread GitBox
umamaheswararao commented on a change in pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#discussion_r481883237 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/RegexMountPointResolvedDstPathReplaceInterceptor.java

[GitHub] [hadoop] goiri commented on a change in pull request #2267: HDFS-15555. RBF: Refresh cacheNS when SocketException occurs.

2020-09-02 Thread GitBox
goiri commented on a change in pull request #2267: URL: https://github.com/apache/hadoop/pull/2267#discussion_r481808142 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterRpcClient.java ## @@ -582,9 +583,9 @@

[GitHub] [hadoop] huangtianhua commented on pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-02 Thread GitBox
huangtianhua commented on pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#issuecomment-685405577 @liuml07 and @brahmareddybattula please help to review the latest code again? thanks very much. This is an

[GitHub] [hadoop] hadoop-yetus commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread GitBox
hadoop-yetus commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-685399208 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 28m 35

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=477679&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477679 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub B