[jira] [Work logged] (HADOOP-18069) CVE-2021-0341 in okhttp@2.7.5 detected in hdfs-client

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18069?focusedWorklogId=763301=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763301 ] ASF GitHub Bot logged work on HADOOP-18069: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on a diff in pull request #4229: HADOOP-18069. okhttp@2.7.5 to 4.9.3

2022-04-27 Thread GitBox
aajisaka commented on code in PR #4229: URL: https://github.com/apache/hadoop/pull/4229#discussion_r860506970 ## hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/oauth2/ConfRefreshTokenBasedAccessTokenProvider.java: ## @@ -103,36 +104,39 @@ public

[jira] [Work logged] (HADOOP-18069) CVE-2021-0341 in okhttp@2.7.5 detected in hdfs-client

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18069?focusedWorklogId=763300=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763300 ] ASF GitHub Bot logged work on HADOOP-18069: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on a diff in pull request #4229: HADOOP-18069. okhttp@2.7.5 to 4.9.3

2022-04-27 Thread GitBox
aajisaka commented on code in PR #4229: URL: https://github.com/apache/hadoop/pull/4229#discussion_r860506282 ## LICENSE-binary: ## @@ -242,6 +242,7 @@ com.google.guava:listenablefuture:.0-empty-to-avoid-conflict-with-guava com.microsoft.azure:azure-storage:7.0.0

[GitHub] [hadoop] aajisaka commented on a diff in pull request #4242: YARN-11116. Migrate Times util from SimpleDateFormat to thread-safe D…

2022-04-27 Thread GitBox
aajisaka commented on code in PR #4242: URL: https://github.com/apache/hadoop/pull/4242#discussion_r860503837 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/util/TestTimes.java: ## @@ -61,4 +67,15 @@ public void

[jira] [Resolved] (HADOOP-13332) Remove jackson 1.9.13 and switch all jackson code to 2.x code line

2022-04-27 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HADOOP-13332. Assignee: (was: Akira Ajisaka) Resolution: Done All the sub-tasks completed.

[jira] [Resolved] (HADOOP-18195) make jackson v1 a runtime scope dependency

2022-04-27 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HADOOP-18195. Resolution: Duplicate The jackson v1 dependency has been removed by HADOOP-15983.

[jira] [Resolved] (HADOOP-15983) Use jersey-json that is built to use jackson2

2022-04-27 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HADOOP-15983. Fix Version/s: 3.4.0 Hadoop Flags: Incompatible change Release Note: Use

[jira] [Updated] (HADOOP-15983) Use jersey-json that is built to use jackson2

2022-04-27 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15983: --- Summary: Use jersey-json that is built to use jackson2 (was: Remove the usage of

[jira] [Assigned] (HADOOP-15983) Use jersey-json that is built to use jackson2

2022-04-27 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HADOOP-15983: -- Assignee: PJ Fanning > Use jersey-json that is built to use jackson2 >

[jira] [Work logged] (HADOOP-15983) Remove the usage of jersey-json to remove jackson 1.x dependency.

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15983?focusedWorklogId=763295=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763295 ] ASF GitHub Bot logged work on HADOOP-15983: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-15983) Remove the usage of jersey-json to remove jackson 1.x dependency.

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15983?focusedWorklogId=763294=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763294 ] ASF GitHub Bot logged work on HADOOP-15983: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #3988: [HADOOP-15983] use jersey-json that is built to use jackson2

2022-04-27 Thread GitBox
aajisaka commented on PR #3988: URL: https://github.com/apache/hadoop/pull/3988#issuecomment-756150 Merged into trunk. Thank you @pjfanning and @steveloughran -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] aajisaka merged pull request #3988: [HADOOP-15983] use jersey-json that is built to use jackson2

2022-04-27 Thread GitBox
aajisaka merged PR #3988: URL: https://github.com/apache/hadoop/pull/3988 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] Hexiaoqiao commented on pull request #4241: HDFS-16563. Namenode WebUI prints sensitive information on Token expiry

2022-04-27 Thread GitBox
Hexiaoqiao commented on PR #4241: URL: https://github.com/apache/hadoop/pull/4241#issuecomment-754159 @prasad-acit Thanks for involving me here. IMO, the key and sensitive information is DelegationKey/Password for DelegationToken, the output message here does not include this

[GitHub] [hadoop] hadoop-yetus commented on pull request #4228: HDFS-16468. Define ssize_t for Windows

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4228: URL: https://github.com/apache/hadoop/pull/4228#issuecomment-750932 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hemanthboyina commented on pull request #4241: HDFS-16563. Namenode WebUI prints sensitive information on Token expiry

2022-04-27 Thread GitBox
hemanthboyina commented on PR #4241: URL: https://github.com/apache/hadoop/pull/4241#issuecomment-746697 thank you @prasad-acit for the PR, looks the test case failures are related, can you have a look once -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] hadoop-yetus commented on pull request #4242: YARN-11116. Migrate Times util from SimpleDateFormat to thread-safe D…

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4242: URL: https://github.com/apache/hadoop/pull/4242#issuecomment-739842 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4241: HDFS-16563. Namenode WebUI prints sensitive information on Token expiry

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4241: URL: https://github.com/apache/hadoop/pull/4241#issuecomment-739690 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] skysiders opened a new pull request, #4243: YARN-11117 check permission for LeveldbRMStateStore

2022-04-27 Thread GitBox
skysiders opened a new pull request, #4243: URL: https://github.com/apache/hadoop/pull/4243 YARN-7 check permission for LeveldbRMStateStore ### Description of PR LeveldbRMStateStore use fs.mkdirs(root,new FsPermission((short)0700)); to create root directory with permission

[jira] [Work logged] (HADOOP-16965) Introduce StreamContext for Abfs Input and Output streams.

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16965?focusedWorklogId=763273=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763273 ] ASF GitHub Bot logged work on HADOOP-16965: --- Author: ASF GitHub Bot

[GitHub] [hadoop] arjun4084346 commented on pull request #4171: HADOOP-16965. Refactor abfs stream configuration. (#1956)

2022-04-27 Thread GitBox
arjun4084346 commented on PR #4171: URL: https://github.com/apache/hadoop/pull/4171#issuecomment-706441 > Yetus still failing with unit tests. Please fix those https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4171/3/artifact/out/patch-unit-hadoop-tools_hadoop-azure.txt

[GitHub] [hadoop] jteagles opened a new pull request, #4242: YARN-11116. Migrate Times util from SimpleDateFormat to thread-safe D…

2022-04-27 Thread GitBox
jteagles opened a new pull request, #4242: URL: https://github.com/apache/hadoop/pull/4242 …ateTimeFormatter class ### Description of PR Upgrading to the recommended thread safe java.time libraries for formatting and parsing with a little better performance ### How

[GitHub] [hadoop] virajjasani commented on a diff in pull request #4107: HDFS-16521. DFS API to retrieve slow datanodes

2022-04-27 Thread GitBox
virajjasani commented on code in PR #4107: URL: https://github.com/apache/hadoop/pull/4107#discussion_r860405718 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodePeerMetrics.java: ## @@ -142,14 +144,28 @@ public void

[GitHub] [hadoop] yuanboliu commented on pull request #4230: HDFS-16558 Consider changing the lock of delegation token from write …

2022-04-27 Thread GitBox
yuanboliu commented on PR #4230: URL: https://github.com/apache/hadoop/pull/4230#issuecomment-680424 @Hexiaoqiao Thanks for your comments. We will apply this patch to our test env, and give feedback here. This is the code from trunk to prove that read lock is good enough:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4228: HDFS-16468. Define ssize_t for Windows

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4228: URL: https://github.com/apache/hadoop/pull/4228#issuecomment-652665 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-18079) Upgrade Netty to 4.1.74

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18079?focusedWorklogId=763219=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763219 ] ASF GitHub Bot logged work on HADOOP-18079: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang commented on pull request #3977: HADOOP-18079. Upgrade Netty to 4.1.74.

2022-04-27 Thread GitBox
jojochuang commented on PR #3977: URL: https://github.com/apache/hadoop/pull/3977#issuecomment-619185 Ok pushed a change to update to netty 4.1.75. Basically other than version change, the only difference is that tcnative is no longer in the classpath. -- This is an automated

[GitHub] [hadoop] hadoop-yetus commented on pull request #4228: HDFS-16468. Define ssize_t for Windows

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4228: URL: https://github.com/apache/hadoop/pull/4228#issuecomment-535508 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-17833) Improve Magic Committer Performance

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17833?focusedWorklogId=763168=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763168 ] ASF GitHub Bot logged work on HADOOP-17833: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3289: HADOOP-17833. Improve Magic Committer performance

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #3289: URL: https://github.com/apache/hadoop/pull/3289#issuecomment-522287 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-18069) CVE-2021-0341 in okhttp@2.7.5 detected in hdfs-client

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18069?focusedWorklogId=763139=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763139 ] ASF GitHub Bot logged work on HADOOP-18069: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4229: HADOOP-18069. okhttp@2.7.5 to 4.9.3

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4229: URL: https://github.com/apache/hadoop/pull/4229#issuecomment-443765 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-16965) Introduce StreamContext for Abfs Input and Output streams.

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16965?focusedWorklogId=763122=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763122 ] ASF GitHub Bot logged work on HADOOP-16965: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on pull request #4171: HADOOP-16965. Refactor abfs stream configuration. (#1956)

2022-04-27 Thread GitBox
mukund-thakur commented on PR #4171: URL: https://github.com/apache/hadoop/pull/4171#issuecomment-386850 Yetus still failing with unit tests. Please fix those https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4171/3/artifact/out/patch-unit-hadoop-tools_hadoop-azure.txt --

[GitHub] [hadoop] hadoop-yetus commented on pull request #4228: HDFS-16468. Define ssize_t for Windows

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4228: URL: https://github.com/apache/hadoop/pull/4228#issuecomment-377475 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-16965) Introduce StreamContext for Abfs Input and Output streams.

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16965?focusedWorklogId=763118=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763118 ] ASF GitHub Bot logged work on HADOOP-16965: --- Author: ASF GitHub Bot

[GitHub] [hadoop] virajith commented on pull request #4171: HADOOP-16965. Refactor abfs stream configuration. (#1956)

2022-04-27 Thread GitBox
virajith commented on PR #4171: URL: https://github.com/apache/hadoop/pull/4171#issuecomment-371455 Thanks for checking the skipped tests and confirming @arjun4084346! @mukund-thakur / @steveloughran unless you have any objections, I'd like to commit this. -- This is an automated

[GitHub] [hadoop] hadoop-yetus commented on pull request #4240: HDFS-16562. Upgrade moment.min.js to 2.29.2

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4240: URL: https://github.com/apache/hadoop/pull/4240#issuecomment-350767 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-16202) Enhance openFile() for better read performance against object stores

2022-04-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528961#comment-17528961 ] Steve Loughran commented on HADOOP-16202: - this is in branch&3.3. going to reopen and pull

[jira] [Updated] (HADOOP-16202) Enhance openFile() for better read performance against object stores

2022-04-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16202: Fix Version/s: 3.3.4 > Enhance openFile() for better read performance against object

[jira] [Updated] (HADOOP-16202) Enhance openFile() for better read performance against object stores

2022-04-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16202: Issue Type: Improvement (was: Bug) > Enhance openFile() for better read performance

[jira] [Resolved] (HADOOP-17682) ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2022-04-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17682. - Resolution: Fixed > ABFS: Support FileStatus input to OpenFileWithOptions() via

[jira] [Updated] (HADOOP-17682) ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2022-04-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17682: Fix Version/s: 3.3.4 > ABFS: Support FileStatus input to OpenFileWithOptions() via

[GitHub] [hadoop] jclarysse commented on pull request #4049: Hadoop 18154 branch 2.10.1

2022-04-27 Thread GitBox
jclarysse commented on PR #4049: URL: https://github.com/apache/hadoop/pull/4049#issuecomment-336256 PR replaced by https://github.com/apache/hadoop/pull/4070 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] jclarysse closed pull request #4049: Hadoop 18154 branch 2.10.1

2022-04-27 Thread GitBox
jclarysse closed pull request #4049: Hadoop 18154 branch 2.10.1 URL: https://github.com/apache/hadoop/pull/4049 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[GitHub] [hadoop] prasad-acit commented on pull request #4241: HDFS-16563. Namenode WebUI prints sensitive information on Token expiry

2022-04-27 Thread GitBox
prasad-acit commented on PR #4241: URL: https://github.com/apache/hadoop/pull/4241#issuecomment-316742 @hemanthboyina @Hexiaoqiao Can you please review the PR when you get time? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] prasad-acit opened a new pull request, #4241: HDFS-16563. Namenode WebUI prints sensitive information on Token expiry

2022-04-27 Thread GitBox
prasad-acit opened a new pull request, #4241: URL: https://github.com/apache/hadoop/pull/4241 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

[GitHub] [hadoop] dmmkr opened a new pull request, #4240: HDFS-16562. Upgrade moment.min.js to 2.29.2

2022-04-27 Thread GitBox
dmmkr opened a new pull request, #4240: URL: https://github.com/apache/hadoop/pull/4240 ### Description of PR Upgrade moment.min.js to 2.29.2 to resolve https://nvd.nist.gov/vuln/detail/CVE-2022-24785 -- This is an automated message from the Apache Git

[jira] [Work logged] (HADOOP-16202) Enhance openFile() for better read performance against object stores

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=763044=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763044 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4238: HADOOP-16202. Enhanced openFile() -branch-3.3 backport

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4238: URL: https://github.com/apache/hadoop/pull/4238#issuecomment-234099 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing due to most of bucket content purged

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?focusedWorklogId=763040=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763040 ] ASF GitHub Bot logged work on HADOOP-18168: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4140: HADOOP-18168. Fix S3A ITestMarkerTool dependency on purged public bucket

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4140: URL: https://github.com/apache/hadoop/pull/4140#issuecomment-223043 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] saintstack commented on a diff in pull request #4107: HDFS-16521. DFS API to retrieve slow datanodes

2022-04-27 Thread GitBox
saintstack commented on code in PR #4107: URL: https://github.com/apache/hadoop/pull/4107#discussion_r860008767 ## hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md: ## @@ -394,7 +394,7 @@ Usage: | COMMAND\_OPTION | Description | |: |: | -| `-report`

[jira] [Work logged] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?focusedWorklogId=763032=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763032 ] ASF GitHub Bot logged work on HADOOP-18198: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran merged pull request #4239: HADOOP-18198. add -mvnargs option to create-release command line

2022-04-27 Thread GitBox
steveloughran merged PR #4239: URL: https://github.com/apache/hadoop/pull/4239 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?focusedWorklogId=763028=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763028 ] ASF GitHub Bot logged work on HADOOP-18198: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #4239: HADOOP-18198. add -mvnargs option to create-release command line

2022-04-27 Thread GitBox
steveloughran commented on PR #4239: URL: https://github.com/apache/hadoop/pull/4239#issuecomment-210333 this works! ```

[jira] [Work logged] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing due to most of bucket content purged

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?focusedWorklogId=763023=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-763023 ] ASF GitHub Bot logged work on HADOOP-18168: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4140: HADOOP-18168. Fix S3A ITestMarkerTool dependency on purged public bucket

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4140: URL: https://github.com/apache/hadoop/pull/4140#issuecomment-199931 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] GauthamBanasandra commented on a diff in pull request #4228: HDFS-16468. Define ssize_t for Windows

2022-04-27 Thread GitBox
GauthamBanasandra commented on code in PR #4228: URL: https://github.com/apache/hadoop/pull/4228#discussion_r859962108 ## hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/types.h: ## @@ -0,0 +1,39 @@ +/** + * Licensed to the Apache Software

[jira] [Work logged] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?focusedWorklogId=762980=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-762980 ] ASF GitHub Bot logged work on HADOOP-18198: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4239: HADOOP-18198. add -mvnargs option to create-release command line

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4239: URL: https://github.com/apache/hadoop/pull/4239#issuecomment-148667 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18187) Convert s3a prefetching to use JavaDoc for fields and enums

2022-04-27 Thread Bhalchandra Pandit (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528853#comment-17528853 ] Bhalchandra Pandit commented on HADOOP-18187: - Thanks for the links. I will take care of

[GitHub] [hadoop] saintstack commented on pull request #4170: HDFS-16540 Data locality is lost when DataNode pod restarts in kubern…

2022-04-27 Thread GitBox
saintstack commented on PR #4170: URL: https://github.com/apache/hadoop/pull/4170#issuecomment-106375 I'll merge later today (unless someone else beats me to it). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Work logged] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing due to most of bucket content purged

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?focusedWorklogId=762940=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-762940 ] ASF GitHub Bot logged work on HADOOP-18168: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4140: HADOOP-18168. Fix S3A ITestMarkerTool dependency on purged public bucket

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4140: URL: https://github.com/apache/hadoop/pull/4140#issuecomment-104577 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] skysiders commented on pull request #4237: MAPREDUCE-7375 JobSubmissionFiles don't set right permission after mkdirs

2022-04-27 Thread GitBox
skysiders commented on PR #4237: URL: https://github.com/apache/hadoop/pull/4237#issuecomment-088682 Hi,@eddyxu @phunt ,could you please take a look? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Work logged] (HADOOP-18216) Document "io.file.buffer.size" must be greater than zero

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18216?focusedWorklogId=762919=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-762919 ] ASF GitHub Bot logged work on HADOOP-18216: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #4220: HADOOP-18216. io.file.buffer.size must be greater than zero

2022-04-27 Thread GitBox
steveloughran commented on PR #4220: URL: https://github.com/apache/hadoop/pull/4220#issuecomment-084200 oh, and the ioutil code would be easy to test, wouldn't it, pass in null stream values and a negative offset and expect the precondition failures, not any null pointer exception

[jira] [Work logged] (HADOOP-18216) Document "io.file.buffer.size" must be greater than zero

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18216?focusedWorklogId=762918=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-762918 ] ASF GitHub Bot logged work on HADOOP-18216: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #4220: HADOOP-18216. io.file.buffer.size must be greater than zero

2022-04-27 Thread GitBox
steveloughran commented on PR #4220: URL: https://github.com/apache/hadoop/pull/4220#issuecomment-082405 could have some private method in ioutils to get and validate the value, use from both places it is called. filesystem could have its own copy of the check -- This is an automated

[jira] [Work logged] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?focusedWorklogId=762907=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-762907 ] ASF GitHub Bot logged work on HADOOP-18198: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran opened a new pull request, #4239: HADOOP-18198. add -mvnargs option to create-release command line

2022-04-27 Thread GitBox
steveloughran opened a new pull request, #4239: URL: https://github.com/apache/hadoop/pull/4239 This allows for release builds to be run with options like --mvnargs="-Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false" Contributed by Ayush Saxena. -- This is an

[jira] [Commented] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-04-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528825#comment-17528825 ] Steve Loughran commented on HADOOP-18198: - i'm going with your script patch; it is better for

[jira] [Work logged] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing due to most of bucket content purged

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?focusedWorklogId=762867=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-762867 ] ASF GitHub Bot logged work on HADOOP-18168: --- Author: ASF GitHub Bot

[GitHub] [hadoop] dannycjones commented on pull request #4140: HADOOP-18168. Fix S3A ITestMarkerTool dependency on purged public bucket

2022-04-27 Thread GitBox
dannycjones commented on PR #4140: URL: https://github.com/apache/hadoop/pull/4140#issuecomment-1110990869 Tests passing against `eu-west-1` bucket. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Work logged] (HADOOP-18216) Document "io.file.buffer.size" must be greater than zero

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18216?focusedWorklogId=762839=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-762839 ] ASF GitHub Bot logged work on HADOOP-18216: --- Author: ASF GitHub Bot

[GitHub] [hadoop] liever18 commented on pull request #4220: HADOOP-18216. io.file.buffer.size must be greater than zero

2022-04-27 Thread GitBox
liever18 commented on PR #4220: URL: https://github.com/apache/hadoop/pull/4220#issuecomment-1110948706 > Hi @steveloughran and @liever18 Sorry for late comments. I found that this pr just update comments, right? Is it better to improve the logic to guard the illegal configuration? Thanks.

[jira] [Work logged] (HADOOP-16202) Enhance openFile() for better read performance against object stores

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=762814=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-762814 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran opened a new pull request, #4238: HADOOP-16202. Enhanced openFile() -branch-3.3 backport

2022-04-27 Thread GitBox
steveloughran opened a new pull request, #4238: URL: https://github.com/apache/hadoop/pull/4238 ### Description of PR backport of HADOOP-16202. Enhanced openFile() to branch-3.3, plus a couple of other cherrypicks from trunk to ease the backporting. if yetus is happy i wil

[GitHub] [hadoop] hadoop-yetus commented on pull request #4237: MAPREDUCE-7375 JobSubmissionFiles don't set right permission after mkdirs

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4237: URL: https://github.com/apache/hadoop/pull/4237#issuecomment-1110873442 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Comment Edited] (HADOOP-18187) Convert s3a prefetching to use JavaDoc for fields and enums

2022-04-27 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528611#comment-17528611 ] Daniel Carl Jones edited comment on HADOOP-18187 at 4/27/22 9:52 AM:

[jira] [Commented] (HADOOP-18182) S3File to store reference to active S3Object in a field.

2022-04-27 Thread Ahmar Suhail (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528695#comment-17528695 ] Ahmar Suhail commented on HADOOP-18182: --- I'm still a bit confused about this one and am maybe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4107: HDFS-16521. DFS API to retrieve slow datanodes

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4107: URL: https://github.com/apache/hadoop/pull/4107#issuecomment-1110789635 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-17956) Replace all default Charset usage with UTF-8

2022-04-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528688#comment-17528688 ] Steve Loughran commented on HADOOP-17956: - backported to branch 3 to avoid conflicts with other

[jira] [Updated] (HADOOP-17956) Replace all default Charset usage with UTF-8

2022-04-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17956: Fix Version/s: 3.3.4 > Replace all default Charset usage with UTF-8 >

[GitHub] [hadoop] skysiders opened a new pull request, #4237: Mapreduce 7375 JobSubmissionFiles don't set right permission after mkdirs

2022-04-27 Thread GitBox
skysiders opened a new pull request, #4237: URL: https://github.com/apache/hadoop/pull/4237 Mapreduce 7375 JobSubmissionFiles don't set right permission after mkdirs ### Description of PR JobSubmissionFiles provide getStagingDir to get Staging Directory.If stagingArea missing,

[GitHub] [hadoop] skysiders closed pull request #4236: MAPREDUCE-7375 set permission for JobSubmissionFiles

2022-04-27 Thread GitBox
skysiders closed pull request #4236: MAPREDUCE-7375 set permission for JobSubmissionFiles URL: https://github.com/apache/hadoop/pull/4236 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (HADOOP-18182) S3File to store reference to active S3Object in a field.

2022-04-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528664#comment-17528664 ] Steve Loughran commented on HADOOP-18182: - before HADOOP-17338 the code was something like

[jira] [Work logged] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing due to most of bucket content purged

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?focusedWorklogId=762757=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-762757 ] ASF GitHub Bot logged work on HADOOP-18168: --- Author: ASF GitHub Bot

[GitHub] [hadoop] dannycjones commented on pull request #4140: HADOOP-18168. Fix S3A ITestMarkerTool dependency on purged public bucket

2022-04-27 Thread GitBox
dannycjones commented on PR #4140: URL: https://github.com/apache/hadoop/pull/4140#issuecomment-1110735715 Integration tests not currently passing with this commit, diving deeper here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-18104) Add configs to configure minSeekForVectorReads and maxReadSizeForVectorReads

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18104?focusedWorklogId=762754=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-762754 ] ASF GitHub Bot logged work on HADOOP-18104: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3964: HADOOP-18104: S3A: Add configs to configure minSeekForVectorReads and maxReadSizeForVectorReads

2022-04-27 Thread GitBox
steveloughran commented on PR #3964: URL: https://github.com/apache/hadoop/pull/3964#issuecomment-1110718632 +1 merge at your leisure. you will also need to rebase the branch. you don't need to do a pr for that, just rebase/fix/retest locally and then do a force push with the update.

[jira] [Assigned] (HADOOP-18184) s3a prefetching stream to support unbuffer()

2022-04-27 Thread Ahmar Suhail (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmar Suhail reassigned HADOOP-18184: - Assignee: Ahmar Suhail > s3a prefetching stream to support unbuffer() >

[jira] [Commented] (HADOOP-18187) Convert s3a prefetching to use JavaDoc for fields and enums

2022-04-27 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528611#comment-17528611 ] Daniel Carl Jones commented on HADOOP-18187: Here's an example of a file with good JavaDoc.

[jira] [Work logged] (HADOOP-18069) CVE-2021-0341 in okhttp@2.7.5 detected in hdfs-client

2022-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18069?focusedWorklogId=762745=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-762745 ] ASF GitHub Bot logged work on HADOOP-18069: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4229: HADOOP-18069. okhttp@2.7.5 to 4.9.3

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4229: URL: https://github.com/apache/hadoop/pull/4229#issuecomment-1110663481 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4228: HDFS-16468. Define ssize_t for Windows

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4228: URL: https://github.com/apache/hadoop/pull/4228#issuecomment-1110627735 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4236: MAPREDUCE-7375 set permission for JobSubmissionFiles

2022-04-27 Thread GitBox
hadoop-yetus commented on PR #4236: URL: https://github.com/apache/hadoop/pull/4236#issuecomment-1110622337 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

  1   2   >