[jira] [Commented] (HADOOP-18173) S3a copyFromLocalOperation doesn't support single file

2022-03-25 Thread qian (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512656#comment-17512656 ] qian commented on HADOOP-18173: --- Hi [~ste...@apache.org]  Thanks for your help. Maybe I confused s3 and

[jira] [Updated] (HADOOP-18173) S3a copyFromLocalOperation doesn't support single file

2022-03-25 Thread qian (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qian updated HADOOP-18173: -- Attachment: minio.yaml > S3a copyFromLocalOperation doesn't support single file >

[GitHub] [hadoop] hadoop-yetus commented on pull request #4073: [Test] Run full build for 3.2.3 RC

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #4073: URL: https://github.com/apache/hadoop/pull/4073#issuecomment-1079556484 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #4107: HDFS-16521. DFS API to retrieve slow datanodes

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #4107: URL: https://github.com/apache/hadoop/pull/4107#issuecomment-1079556487 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #4108: HDFS-16522. Set Http and Ipc ports for Datanodes in MiniDFSCluster

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #4108: URL: https://github.com/apache/hadoop/pull/4108#issuecomment-1079534165 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3938: YARN-11069. Dynamic Queue ACL handling in Legacy and Flexible Auto Created Queues

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #3938: URL: https://github.com/apache/hadoop/pull/3938#issuecomment-1079494474 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] brumi1024 closed pull request #3938: YARN-11069. Dynamic Queue ACL handling in Legacy and Flexible Auto Created Queues

2022-03-25 Thread GitBox
brumi1024 closed pull request #3938: URL: https://github.com/apache/hadoop/pull/3938 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] brumi1024 commented on pull request #3938: YARN-11069. Dynamic Queue ACL handling in Legacy and Flexible Auto Created Queues

2022-03-25 Thread GitBox
brumi1024 commented on pull request #3938: URL: https://github.com/apache/hadoop/pull/3938#issuecomment-1079484116 Thanks @tomicooler for working on this, and @9uapaw for the review. Committed to trunk. -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Work logged] (HADOOP-12760) sun.misc.Cleaner has moved to a new location in OpenJDK 9

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12760?focusedWorklogId=748044=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-748044 ] ASF GitHub Bot logged work on HADOOP-12760: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4080: HADOOP-12760. sun.misc.Cleaner has moved to a new location in OpenJDK…

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #4080: URL: https://github.com/apache/hadoop/pull/4080#issuecomment-1079478689 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-03-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512605#comment-17512605 ] Hadoop QA commented on HADOOP-18167: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] hadoop-yetus commented on pull request #4073: [Test] Run full build for 3.2.3 RC

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #4073: URL: https://github.com/apache/hadoop/pull/4073#issuecomment-1079473538 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?focusedWorklogId=748036=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-748036 ] ASF GitHub Bot logged work on HADOOP-18028: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4109: HADOOP-18028. High performance S3A input stream

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #4109: URL: https://github.com/apache/hadoop/pull/4109#issuecomment-1079461106 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?focusedWorklogId=748010=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-748010 ] ASF GitHub Bot logged work on HADOOP-18167: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4092: HADOOP-18167. Add metrics to track delegation token secret manager op…

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #4092: URL: https://github.com/apache/hadoop/pull/4092#issuecomment-1079438433 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #4085: HDFS-16511. Change some frequent method lock type in ReplicaMap.

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #4085: URL: https://github.com/apache/hadoop/pull/4085#issuecomment-1079431908 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Created] (HADOOP-18177) document use and design of prefetching s3a input stream

2022-03-25 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18177: --- Summary: document use and design of prefetching s3a input stream Key: HADOOP-18177 URL: https://issues.apache.org/jira/browse/HADOOP-18177 Project: Hadoop

[jira] [Work logged] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?focusedWorklogId=747986=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747986 ] ASF GitHub Bot logged work on HADOOP-18167: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hchaverri commented on a change in pull request #4092: HADOOP-18167. Add metrics to track delegation token secret manager op…

2022-03-25 Thread GitBox
hchaverri commented on a change in pull request #4092: URL: https://github.com/apache/hadoop/pull/4092#discussion_r835596557 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/token/delegation/AbstractDelegationTokenSecretManager.java

[jira] [Commented] (HADOOP-18175) test failures with prefetching s3a input stream

2022-03-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512578#comment-17512578 ] Steve Loughran commented on HADOOP-18175: - h3. ITestS3AContractUnbuffer fix: getPos() on a

[jira] [Updated] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-03-25 Thread Hector Sandoval Chaverri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hector Sandoval Chaverri updated HADOOP-18167: -- Attachment: HADOOP-18167-branch-2.10-2.patch > Add metrics to track

[jira] [Updated] (HADOOP-18175) test failures with prefetching s3a input stream

2022-03-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18175: Description: identify and fix all test regressions from the prefetching s3a input stream

[jira] [Created] (HADOOP-18176) s3a prefetching stream to move off twitter FuturePool

2022-03-25 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18176: --- Summary: s3a prefetching stream to move off twitter FuturePool Key: HADOOP-18176 URL: https://issues.apache.org/jira/browse/HADOOP-18176 Project: Hadoop Common

[jira] [Created] (HADOOP-18175) test failures with prefetching s3a input stream

2022-03-25 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18175: --- Summary: test failures with prefetching s3a input stream Key: HADOOP-18175 URL: https://issues.apache.org/jira/browse/HADOOP-18175 Project: Hadoop Common

[jira] [Assigned] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-03-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18028: --- Assignee: Bhalchandra Pandit > High performance S3A input stream with prefetching

[jira] [Updated] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-03-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18028: Summary: High performance S3A input stream with prefetching & caching (was: improve S3

[jira] [Commented] (HADOOP-18028) improve S3 read speed using prefetching & caching

2022-03-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512573#comment-17512573 ] Steve Loughran commented on HADOOP-18028: - we need a good name for this feature "prefetching"?

[jira] [Work logged] (HADOOP-18028) improve S3 read speed using prefetching & caching

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?focusedWorklogId=747977=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747977 ] ASF GitHub Bot logged work on HADOOP-18028: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3736: HADOOP-18028. improve S3 read speed using prefetching & caching

2022-03-25 Thread GitBox
steveloughran commented on pull request #3736: URL: https://github.com/apache/hadoop/pull/3736#issuecomment-1079407424 I've created a feature branch for this and a PR which takes this change (with test file renames & some other small changes) as an initial PR to apply to it: #4109

[GitHub] [hadoop] steveloughran closed pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2022-03-25 Thread GitBox
steveloughran closed pull request #2971: URL: https://github.com/apache/hadoop/pull/2971 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-18028) improve S3 read speed using prefetching & caching

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?focusedWorklogId=747971=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747971 ] ASF GitHub Bot logged work on HADOOP-18028: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-18028) improve S3 read speed using prefetching & caching

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?focusedWorklogId=747972=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747972 ] ASF GitHub Bot logged work on HADOOP-18028: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3736: HADOOP-18028. improve S3 read speed using prefetching & caching

2022-03-25 Thread GitBox
hadoop-yetus removed a comment on pull request #3736: URL: https://github.com/apache/hadoop/pull/3736#issuecomment-1036981660 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3736: HADOOP-18028. improve S3 read speed using prefetching & caching

2022-03-25 Thread GitBox
hadoop-yetus removed a comment on pull request #3736: URL: https://github.com/apache/hadoop/pull/3736#issuecomment-985081348 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-18028) improve S3 read speed using prefetching & caching

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?focusedWorklogId=747970=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747970 ] ASF GitHub Bot logged work on HADOOP-18028: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran opened a new pull request #4109: HADOOP-18028. High performance S3A input stream

2022-03-25 Thread GitBox
steveloughran opened a new pull request #4109: URL: https://github.com/apache/hadoop/pull/4109 ### Description of PR This is the PR of #3736 applied to a dedicated feature branch, with some minor pre-merge tuning with all subsequent changes to be their own PR * rename test

[GitHub] [hadoop] hadoop-yetus commented on pull request #3938: YARN-11069. Dynamic Queue ACL handling in Legacy and Flexible Auto Created Queues

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #3938: URL: https://github.com/apache/hadoop/pull/3938#issuecomment-1079402027 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-18164) Backport HADOOP-12760 to 2.10

2022-03-25 Thread Tom McCormick (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom McCormick updated HADOOP-18164: --- Attachment: HADOOP-18164.01.patch > Backport HADOOP-12760 to 2.10 >

[GitHub] [hadoop] virajjasani commented on pull request #4107: HDFS-16521. DFS API to retrieve slow datanodes

2022-03-25 Thread GitBox
virajjasani commented on pull request #4107: URL: https://github.com/apache/hadoop/pull/4107#issuecomment-1079369473 @ayushtkn While I agree that JMX metric for slownode is already available, not every downstreamer might have access to it directly, for instance in K8S managed clusters,

[jira] [Work logged] (HADOOP-18028) improve S3 read speed using prefetching & caching

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?focusedWorklogId=747920=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747920 ] ASF GitHub Bot logged work on HADOOP-18028: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #3736: HADOOP-18028. improve S3 read speed using prefetching & caching

2022-03-25 Thread GitBox
steveloughran commented on a change in pull request #3736: URL: https://github.com/apache/hadoop/pull/3736#discussion_r835515328 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/read/S3EInputStream.java ## @@ -0,0 +1,240 @@ +/* + * Licensed to the

[jira] [Commented] (HADOOP-14965) s3a input stream "normal" fadvise mode to be adaptive

2022-03-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512529#comment-17512529 ] Steve Loughran commented on HADOOP-14965: - [~yzhangal] what is the application reading the data

[jira] [Work logged] (HADOOP-18028) improve S3 read speed using prefetching & caching

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?focusedWorklogId=747918=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747918 ] ASF GitHub Bot logged work on HADOOP-18028: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3736: HADOOP-18028. improve S3 read speed using prefetching & caching

2022-03-25 Thread GitBox
hadoop-yetus removed a comment on pull request #3736: URL: https://github.com/apache/hadoop/pull/3736#issuecomment-1026648916 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3736: HADOOP-18028. improve S3 read speed using prefetching & caching

2022-03-25 Thread GitBox
hadoop-yetus removed a comment on pull request #3736: URL: https://github.com/apache/hadoop/pull/3736#issuecomment-1005283237 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Work logged] (HADOOP-18028) improve S3 read speed using prefetching & caching

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?focusedWorklogId=747915=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747915 ] ASF GitHub Bot logged work on HADOOP-18028: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-18028) improve S3 read speed using prefetching & caching

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?focusedWorklogId=747914=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747914 ] ASF GitHub Bot logged work on HADOOP-18028: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3736: HADOOP-18028. improve S3 read speed using prefetching & caching

2022-03-25 Thread GitBox
hadoop-yetus removed a comment on pull request #3736: URL: https://github.com/apache/hadoop/pull/3736#issuecomment-990537861 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Work logged] (HADOOP-18028) improve S3 read speed using prefetching & caching

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?focusedWorklogId=747913=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747913 ] ASF GitHub Bot logged work on HADOOP-18028: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3736: HADOOP-18028. improve S3 read speed using prefetching & caching

2022-03-25 Thread GitBox
hadoop-yetus removed a comment on pull request #3736: URL: https://github.com/apache/hadoop/pull/3736#issuecomment-989436895 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-14661) S3A to support Requester Pays Buckets

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14661?focusedWorklogId=747877=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747877 ] ASF GitHub Bot logged work on HADOOP-14661: --- Author: ASF GitHub Bot

[GitHub] [hadoop] dannycjones commented on pull request #250: HADOOP-14661. Added support for AWS S3 Requester Pays Buckets

2022-03-25 Thread GitBox
dannycjones commented on pull request #250: URL: https://github.com/apache/hadoop/pull/250#issuecomment-1079230574 Requester pays support was added in 9edfe30a60f4c43405301927a8f4014d1dd3842d. Can we close this, @mandusm? -- This is an automated message from the Apache Git

[GitHub] [hadoop] virajjasani opened a new pull request #4107: HDFS-16521. DFS API to retrieve slow datanodes

2022-03-25 Thread GitBox
virajjasani opened a new pull request #4107: URL: https://github.com/apache/hadoop/pull/4107 ### Description of PR In order to build some automation around slow datanodes that regularly show up in the slow peer tracking report, e.g. decommission such nodes and queue them up for

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=747849=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747849 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #3445: HADOOP-15566 Opentelemetry changes using java agent

2022-03-25 Thread GitBox
steveloughran commented on a change in pull request #3445: URL: https://github.com/apache/hadoop/pull/3445#discussion_r835412200 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/tracing/Span.java ## @@ -21,32 +21,36 @@ import

[GitHub] [hadoop] hadoop-yetus commented on pull request #3938: YARN-11069. Dynamic Queue ACL handling in Legacy and Flexible Auto Created Queues

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #3938: URL: https://github.com/apache/hadoop/pull/3938#issuecomment-1079154229 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-18173) S3a copyFromLocalOperation doesn't support single file

2022-03-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18173: Summary: S3a copyFromLocalOperation doesn't support single file (was: AWS S3

[jira] [Commented] (HADOOP-18173) AWS S3 copyFromLocalOperation doesn't support single file

2022-03-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512412#comment-17512412 ] Steve Loughran commented on HADOOP-18173: - afraid bogdan has moved from aws to meta and won't

[jira] [Updated] (HADOOP-18173) AWS S3 copyFromLocalOperation doesn't support single file

2022-03-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18173: Component/s: fs/s3 > AWS S3 copyFromLocalOperation doesn't support single file >

[jira] [Commented] (HADOOP-18174) IBM Java detected while running on OpenJDK class library

2022-03-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512409#comment-17512409 ] Steve Loughran commented on HADOOP-18174: - think it's only done in UGI code, so something which

[jira] [Work logged] (HADOOP-13386) Upgrade Avro to 1.8.x or later

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13386?focusedWorklogId=747800=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747800 ] ASF GitHub Bot logged work on HADOOP-13386: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3990: [HADOOP-13386] upgrade to avro 1.9.2

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #3990: URL: https://github.com/apache/hadoop/pull/3990#issuecomment-1079065719 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18145) Fileutil's unzip method causes unzipped files to lose their original permissions

2022-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18145?focusedWorklogId=747798=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-747798 ] ASF GitHub Bot logged work on HADOOP-18145: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #4036: HADOOP-18145.Decompress the ZIP file and retain the original file per…

2022-03-25 Thread GitBox
steveloughran commented on a change in pull request #4036: URL: https://github.com/apache/hadoop/pull/4036#discussion_r835272119 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileUtil.java ## @@ -677,6 +683,31 @@ public static void

[GitHub] [hadoop] MingXiangLi commented on a change in pull request #4085: HDFS-16511. Change some frequent method lock type in ReplicaMap.

2022-03-25 Thread GitBox
MingXiangLi commented on a change in pull request #4085: URL: https://github.com/apache/hadoop/pull/4085#discussion_r835261407 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java ## @@ -602,6

[GitHub] [hadoop] tomicooler commented on pull request #3938: YARN-11069. Dynamic Queue ACL handling in Legacy and Flexible Auto Created Queues

2022-03-25 Thread GitBox
tomicooler commented on pull request #3938: URL: https://github.com/apache/hadoop/pull/3938#issuecomment-1078969179 @brumi1024 I rebased to trunk and resolved the conflicts. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] brumi1024 commented on pull request #3938: YARN-11069. Dynamic Queue ACL handling in Legacy and Flexible Auto Created Queues

2022-03-25 Thread GitBox
brumi1024 commented on pull request #3938: URL: https://github.com/apache/hadoop/pull/3938#issuecomment-1078932846 @tomicooler there seems to be a conflict, can you please resolve it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] tomscut commented on pull request #3915: HDFS-16434. Add opname to read/write lock for remaining operations

2022-03-25 Thread GitBox
tomscut commented on pull request #3915: URL: https://github.com/apache/hadoop/pull/3915#issuecomment-1078928108 Thanks @tasanuma for your review and merging this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] tasanuma commented on pull request #3915: HDFS-16434. Add opname to read/write lock for remaining operations

2022-03-25 Thread GitBox
tasanuma commented on pull request #3915: URL: https://github.com/apache/hadoop/pull/3915#issuecomment-1078922059 Thanks for your contribution, @tomscut! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop] tasanuma merged pull request #3915: HDFS-16434. Add opname to read/write lock for remaining operations

2022-03-25 Thread GitBox
tasanuma merged pull request #3915: URL: https://github.com/apache/hadoop/pull/3915 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HADOOP-18174) IBM Java detected while running on OpenJDK class library

2022-03-25 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-18174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mateusz Łyczek updated HADOOP-18174: Description: In our project we are using hadoop-client library and everything works fine

[jira] [Comment Edited] (HADOOP-18171) NameNode Access Time Precision

2022-03-25 Thread Doug (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512231#comment-17512231 ] Doug edited comment on HADOOP-18171 at 3/25/22, 10:16 AM: -- Hey Akira will you

[GitHub] [hadoop] hadoop-yetus commented on pull request #4001: HDFS-16460. [SPS]: Handle failure retries for moving tasks

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #4001: URL: https://github.com/apache/hadoop/pull/4001#issuecomment-1078820910 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Created] (HADOOP-18174) IBM Java detected while running on OpenJDK class library

2022-03-25 Thread Jira
Mateusz Łyczek created HADOOP-18174: --- Summary: IBM Java detected while running on OpenJDK class library Key: HADOOP-18174 URL: https://issues.apache.org/jira/browse/HADOOP-18174 Project: Hadoop

[jira] [Updated] (HADOOP-18174) IBM Java detected while running on OpenJDK class library

2022-03-25 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-18174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mateusz Łyczek updated HADOOP-18174: Description: In our project we are using hadoop-client library and everything works fine

[GitHub] [hadoop] hadoop-yetus commented on pull request #4106: Changed scope for isRootInternalDir/getRootFallbackLink for InodeTree

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #4106: URL: https://github.com/apache/hadoop/pull/4106#issuecomment-1078795605 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] tomscut commented on a change in pull request #4085: HDFS-16511. Change some frequent method lock type in ReplicaMap.

2022-03-25 Thread GitBox
tomscut commented on a change in pull request #4085: URL: https://github.com/apache/hadoop/pull/4085#discussion_r835043287 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java ## @@ -602,6

[jira] [Commented] (HADOOP-18171) NameNode Access Time Precision

2022-03-25 Thread Doug (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512231#comment-17512231 ] Doug commented on HADOOP-18171: --- Hey Akira will you please explain how current setting is working now ?

[GitHub] [hadoop] hadoop-yetus commented on pull request #3915: HDFS-16434. Add opname to read/write lock for remaining operations

2022-03-25 Thread GitBox
hadoop-yetus commented on pull request #3915: URL: https://github.com/apache/hadoop/pull/3915#issuecomment-1078703073 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0