[GitHub] [hadoop] fengnanli commented on pull request #2954: HDFS-15561. RBF: Remove NPE when local namenode is not configured

2021-04-28 Thread GitBox
fengnanli commented on pull request #2954: URL: https://github.com/apache/hadoop/pull/2954#issuecomment-828952579 @Hexiaoqiao I fixed the tests and it is not related with this jira though. Let me know if want me to create a separate task or just piggyback here since it is a one-liner

[jira] [Work logged] (HADOOP-17657) SequeneFile.Writer should implement StreamCapabilities

2021-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17657?focusedWorklogId=590716=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-590716 ] ASF GitHub Bot logged work on HADOOP-17657: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-17657) SequeneFile.Writer should implement StreamCapabilities

2021-04-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17335037#comment-17335037 ] Hadoop QA commented on HADOOP-17657: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] hadoop-yetus commented on pull request #2949: HADOOP-17657: implement StreamCapabilities in SequenceFile.Writer and fall back to flush, if hflush is not supported

2021-04-28 Thread GitBox
hadoop-yetus commented on pull request #2949: URL: https://github.com/apache/hadoop/pull/2949#issuecomment-828815804 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17657) SequeneFile.Writer should implement StreamCapabilities

2021-04-28 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17335035#comment-17335035 ] Hadoop QA commented on HADOOP-17657: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Work logged] (HADOOP-17657) SequeneFile.Writer should implement StreamCapabilities

2021-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17657?focusedWorklogId=590713=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-590713 ] ASF GitHub Bot logged work on HADOOP-17657: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2949: HADOOP-17657: implement StreamCapabilities in SequenceFile.Writer and fall back to flush, if hflush is not supported

2021-04-28 Thread GitBox
hadoop-yetus commented on pull request #2949: URL: https://github.com/apache/hadoop/pull/2949#issuecomment-828814785 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] smengcl commented on a change in pull request #2927: HDFS-15982. Deleted data using HTTP API should be saved to the trash

2021-04-28 Thread GitBox
smengcl commented on a change in pull request #2927: URL: https://github.com/apache/hadoop/pull/2927#discussion_r622590087 ## File path: hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/FSOperations.java ## @@ -743,6 +748,15 @@ public

[jira] [Updated] (HADOOP-16083) DistCp shouldn't always overwrite the target file when checksums match

2021-04-28 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HADOOP-16083: Target Version/s: (was: 3.3.1) > DistCp shouldn't always overwrite the target file when

[GitHub] [hadoop] hadoop-yetus commented on pull request #2964: HDFS-16000. Rename performance optimization

2021-04-28 Thread GitBox
hadoop-yetus commented on pull request #2964: URL: https://github.com/apache/hadoop/pull/2964#issuecomment-828726036 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17198) Support S3 Access Points

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334962#comment-17334962 ] Steve Loughran commented on HADOOP-17198: - Well volunteered! Initial step: check out hadoop

[jira] [Resolved] (HADOOP-14765) AdlFsInputStream should implement unbuffer

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14765. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-14175) NPE when ADL store URI contains underscore

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14175. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-14258) Verify and document ADLS client mount table feature

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14258. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-12877) Add ADLS telemetry instrumentation

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-12877. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-14259) Verify viewfs works with ADLS

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14259. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-12876) [Azure Data Lake] Support for process level FileStatus cache to optimize GetFileStatus frequent operations

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-12876. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-14234) ADLS to implement FileSystemContractBaseTest

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14234. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-13982) ADL To map container 403 to AccessDeniedException

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13982. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-14304) AdlStoreClient#getExceptionFromResponse should not swallow defaultMessage

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14304. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-14294) Rename ADLS mountpoint properties

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14294. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-13983) Print better error when accessing a non-existent ADL store

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13983. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-15089) ADLS to implement AbstractContractDistCpTest

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15089. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-14579) Add Kerberos and Delegation token support to ADLS client

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14579. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-14039) ADLS should differentiate integration tests from contract tests

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14039. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-14917) AdlFileSystem should support getStorageStatistics

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14917. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-15405) adl:// to stop using Configuration.getPassword() to look up fs.adl.oauth2.refresh.url

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15405. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-15131) ADL TestAdlContractRenameLive.testRenameFileUnderFile failing

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15131. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-14437) AdlFileSystem.getAclStatus() returns unexpected ACL information

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14437. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Resolved] (HADOOP-14862) Metrics for AdlFileSystem

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14862. - Resolution: Won't Fix resolving as WONTFIX; if feature is needed it should be done in

[jira] [Work logged] (HADOOP-17511) Add an Audit plugin point for S3A auditing/context

2021-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17511?focusedWorklogId=590618=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-590618 ] ASF GitHub Bot logged work on HADOOP-17511: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-11794) Enable distcp to copy blocks in parallel

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334942#comment-17334942 ] Steve Loughran commented on HADOOP-11794: - [~sahilnagpal]: is this HADOOP-16049 ? if not: file

[jira] [Resolved] (HADOOP-14764) Über-jira adl:// Azure Data Lake Phase II: Performance, Resilience and Testing

2021-04-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14764. - Resolution: Won't Fix > Über-jira adl:// Azure Data Lake Phase II: Performance,

[GitHub] [hadoop] hadoop-yetus commented on pull request #2807: HADOOP-17511. Add audit/telemetry logging to S3A connector

2021-04-28 Thread GitBox
hadoop-yetus commented on pull request #2807: URL: https://github.com/apache/hadoop/pull/2807#issuecomment-828721301 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17657) SequeneFile.Writer should implement StreamCapabilities

2021-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17657?focusedWorklogId=590598=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-590598 ] ASF GitHub Bot logged work on HADOOP-17657: --- Author: ASF GitHub Bot

[GitHub] [hadoop] kishendas commented on a change in pull request #2949: HADOOP-17657: implement StreamCapabilities in SequenceFile.Writer and fall back to flush, if hflush is not supported

2021-04-28 Thread GitBox
kishendas commented on a change in pull request #2949: URL: https://github.com/apache/hadoop/pull/2949#discussion_r622460440 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/TestSequenceFile.java ## @@ -730,6 +732,33 @@ public void

[jira] [Work logged] (HADOOP-17657) SequeneFile.Writer should implement StreamCapabilities

2021-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17657?focusedWorklogId=590597=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-590597 ] ASF GitHub Bot logged work on HADOOP-17657: --- Author: ASF GitHub Bot

[GitHub] [hadoop] kishendas commented on a change in pull request #2949: HADOOP-17657: implement StreamCapabilities in SequenceFile.Writer and fall back to flush, if hflush is not supported

2021-04-28 Thread GitBox
kishendas commented on a change in pull request #2949: URL: https://github.com/apache/hadoop/pull/2949#discussion_r622460197 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/TestSequenceFile.java ## @@ -730,6 +732,33 @@ public void

[jira] [Work logged] (HADOOP-17511) Add an Audit plugin point for S3A auditing/context

2021-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17511?focusedWorklogId=590565=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-590565 ] ASF GitHub Bot logged work on HADOOP-17511: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2807: HADOOP-17511. Add audit/telemetry logging to S3A connector

2021-04-28 Thread GitBox
hadoop-yetus commented on pull request #2807: URL: https://github.com/apache/hadoop/pull/2807#issuecomment-828664945 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17250) ABFS: Random read perf improvement

2021-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17250?focusedWorklogId=590498=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-590498 ] ASF GitHub Bot logged work on HADOOP-17250: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2307: HADOOP-17250 ABFS short reads can be merged with readahead.

2021-04-28 Thread GitBox
steveloughran commented on pull request #2307: URL: https://github.com/apache/hadoop/pull/2307#issuecomment-828597966 @mukund-thakur : can you bring this up to date? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] hadoop-yetus commented on pull request #2964: HDFS. Rename performance optimization

2021-04-28 Thread GitBox
hadoop-yetus commented on pull request #2964: URL: https://github.com/apache/hadoop/pull/2964#issuecomment-828449726 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] zhuxiangyi opened a new pull request #2964: HDFS. Rename performance optimization

2021-04-28 Thread GitBox
zhuxiangyi opened a new pull request #2964: URL: https://github.com/apache/hadoop/pull/2964 [https://issues.apache.org/jira/browse/HDFS-16000](HDFS-16000) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] virajjasani edited a comment on pull request #2927: HDFS-15982. Deleted data using HTTP API should be saved to the trash

2021-04-28 Thread GitBox
virajjasani edited a comment on pull request #2927: URL: https://github.com/apache/hadoop/pull/2927#issuecomment-828221673 @smengcl @steveloughran would you like to take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] virajjasani edited a comment on pull request #2927: HDFS-15982. Deleted data using HTTP API should be saved to the trash

2021-04-28 Thread GitBox
virajjasani edited a comment on pull request #2927: URL: https://github.com/apache/hadoop/pull/2927#issuecomment-828221673 @smengcl @steveloughran would you like to take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-17653) Do not use guava's Files.createTempDir()

2021-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17653?focusedWorklogId=590252=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-590252 ] ASF GitHub Bot logged work on HADOOP-17653: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2945: HADOOP-17653. Do not use guava's Files.createTempDir().

2021-04-28 Thread GitBox
steveloughran commented on pull request #2945: URL: https://github.com/apache/hadoop/pull/2945#issuecomment-828306071 Do we know if any of the test failures are related or is this just highlighting all tests with issues because the patch spans the code? -- This is an automated message

[GitHub] [hadoop] virajjasani commented on pull request #2927: HDFS-15982. Deleted data using HTTP API should be saved to the trash

2021-04-28 Thread GitBox
virajjasani commented on pull request #2927: URL: https://github.com/apache/hadoop/pull/2927#issuecomment-828221673 @smengcl would you like to take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] smengcl edited a comment on pull request #2946: YARN-10747. Bump YARN CSI protobuf version to 3.7.1

2021-04-28 Thread GitBox
smengcl edited a comment on pull request #2946: URL: https://github.com/apache/hadoop/pull/2946#issuecomment-828205946 @aajisaka Thanks for reviewing and merging this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] smengcl commented on pull request #2946: YARN-10747. Bump YARN CSI protobuf version to 3.7.1

2021-04-28 Thread GitBox
smengcl commented on pull request #2946: URL: https://github.com/apache/hadoop/pull/2946#issuecomment-828205946 @aajisaka Thanks for the reviewing and merging this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the