Last-remote11 closed pull request #6929: HDFS-17573. Add test code for FSImage
parallelization and compression
URL: https://github.com/apache/hadoop/pull/6929
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
[
https://issues.apache.org/jira/browse/HADOOP-19220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinay Devadiga updated HADOOP-19220:
Issue Type: Test (was: Bug)
> S3A : S3AInputStream positioned readFully Expectation
> --
[
https://issues.apache.org/jira/browse/HADOOP-19220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864001#comment-17864001
]
Vinay Devadiga commented on HADOOP-19220:
-
Apologies for the vague description
[
https://issues.apache.org/jira/browse/HADOOP-19220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863999#comment-17863999
]
Vinay Devadiga commented on HADOOP-19220:
-
thank [~ste...@apache.org] for the g
zhengchenyu commented on code in PR #6928:
URL: https://github.com/apache/hadoop/pull/6928#discussion_r1669606660
##
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java:
##
@@ -1079,6 +1084,22 @@ private String
reconfSlowIoWarningT
kokon191 commented on code in PR #6909:
URL: https://github.com/apache/hadoop/pull/6909#discussion_r1669552985
##
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java:
##
@@ -89,6 +89,8 @@ public class DatanodeManager {
slfan1989 commented on PR #6914:
URL: https://github.com/apache/hadoop/pull/6914#issuecomment-2215675835
> need help to run test with Java 17, maybe cc @steveloughran @slfan1989
@pan3793 Sorry for the delayed response, I've been quite busy lately as we
are in the process of rolling ou
slfan1989 commented on PR #6919:
URL: https://github.com/apache/hadoop/pull/6919#issuecomment-2215644248
@zhengchenyu Thank you for your contributions and for inviting me to review
the pr. I agree with @Hexiaoqiao opinion that he should be more knowledgeable
in this area.
--
This is an a
slfan1989 commented on code in PR #6890:
URL: https://github.com/apache/hadoop/pull/6890#discussion_r1669463377
##
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/common/AutoCloseDataSetLock.java:
##
@@ -30,17 +33,39 @@
* use a try-with-resource syn
slfan1989 commented on code in PR #6890:
URL: https://github.com/apache/hadoop/pull/6890#discussion_r1669463377
##
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/common/AutoCloseDataSetLock.java:
##
@@ -30,17 +33,39 @@
* use a try-with-resource syn
slfan1989 commented on code in PR #6890:
URL: https://github.com/apache/hadoop/pull/6890#discussion_r1669463377
##
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/common/AutoCloseDataSetLock.java:
##
@@ -30,17 +33,39 @@
* use a try-with-resource syn
hadoop-yetus commented on PR #6929:
URL: https://github.com/apache/hadoop/pull/6929#issuecomment-2215475683
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexe
[
https://issues.apache.org/jira/browse/HADOOP-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863949#comment-17863949
]
ASF GitHub Bot commented on HADOOP-19161:
-
hadoop-yetus commented on PR #6789:
hadoop-yetus commented on PR #6789:
URL: https://github.com/apache/hadoop/pull/6789#issuecomment-2215403995
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reex
[
https://issues.apache.org/jira/browse/HADOOP-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863933#comment-17863933
]
ASF GitHub Bot commented on HADOOP-19161:
-
hadoop-yetus commented on PR #6789:
hadoop-yetus commented on PR #6789:
URL: https://github.com/apache/hadoop/pull/6789#issuecomment-2215296682
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reex
[
https://issues.apache.org/jira/browse/HADOOP-19220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863895#comment-17863895
]
Steve Loughran commented on HADOOP-19220:
-
+side issue: always label as "fs/s3"
[
https://issues.apache.org/jira/browse/HADOOP-19220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-19220.
-
Resolution: Works for Me
it works for me and for the people who support calls would rui
steveloughran commented on code in PR #6631:
URL: https://github.com/apache/hadoop/pull/6631#discussion_r1669017356
##
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/hdfs/protocol/datatransfer/IOStreamPair.java:
##
@@ -23,10 +23,12 @@
import java.io.OutputS
[
https://issues.apache.org/jira/browse/HADOOP-18562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863870#comment-17863870
]
ASF GitHub Bot commented on HADOOP-18562:
-
steveloughran commented on code in P
steveloughran commented on code in PR #6550:
URL: https://github.com/apache/hadoop/pull/6550#discussion_r1669005552
##
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java:
##
@@ -775,6 +775,29 @@ private Constants() {
"fs.s3a." + Constants.AWS_SE
[
https://issues.apache.org/jira/browse/HADOOP-19148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863860#comment-17863860
]
ASF GitHub Bot commented on HADOOP-19148:
-
steveloughran commented on PR #6830:
steveloughran commented on PR #6830:
URL: https://github.com/apache/hadoop/pull/6830#issuecomment-2214718500
if this goes near yarn then someone from the yarn team is needed to review
this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log o
[
https://issues.apache.org/jira/browse/HADOOP-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863859#comment-17863859
]
ASF GitHub Bot commented on HADOOP-19161:
-
steveloughran commented on PR #6789:
steveloughran commented on PR #6789:
URL: https://github.com/apache/hadoop/pull/6789#issuecomment-2214711644
@virajjasani done your comments; had to rebase for what turned out to be a
spurious merge conflict (adjacent methods in s3afs), so you can't see exactly
what changed in the final com
[
https://issues.apache.org/jira/browse/HADOOP-18708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863855#comment-17863855
]
ASF GitHub Bot commented on HADOOP-18708:
-
hadoop-yetus commented on PR #6884:
hadoop-yetus commented on PR #6884:
URL: https://github.com/apache/hadoop/pull/6884#issuecomment-2214611654
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexe
[
https://issues.apache.org/jira/browse/HADOOP-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863853#comment-17863853
]
ASF GitHub Bot commented on HADOOP-19161:
-
steveloughran commented on code in P
steveloughran commented on code in PR #6789:
URL: https://github.com/apache/hadoop/pull/6789#discussion_r1668938331
##
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestConfigurationHelper.java:
##
@@ -0,0 +1,149 @@
+/*
+ * Licensed to the Apache Softw
[
https://issues.apache.org/jira/browse/HADOOP-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863852#comment-17863852
]
ASF GitHub Bot commented on HADOOP-19161:
-
steveloughran commented on code in P
steveloughran commented on code in PR #6789:
URL: https://github.com/apache/hadoop/pull/6789#discussion_r1668934899
##
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/impl/FlagSet.java:
##
@@ -0,0 +1,278 @@
+/*
+ * Licensed to the Apache Software Foundatio
Steve Loughran created HADOOP-19221:
---
Summary: S3a: retry on 400 +ErrorCode RequestTimeout
Key: HADOOP-19221
URL: https://issues.apache.org/jira/browse/HADOOP-19221
Project: Hadoop Common
I
[
https://issues.apache.org/jira/browse/HADOOP-19221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-19221:
Summary: S3A: retry on AWS 400 Response +ErrorCode RequestTimeout (was:
S3a: retry on 40
Last-remote11 opened a new pull request, #6929:
URL: https://github.com/apache/hadoop/pull/6929
### Description of PR
The feature added
[HDFS-14617](https://issues.apache.org/jira/browse/HDFS-14617)(in Improve
FSImage load time by writing sub-sections to the FSImage index. by
zeekling commented on code in PR #6928:
URL: https://github.com/apache/hadoop/pull/6928#discussion_r1668889545
##
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java:
##
@@ -1079,6 +1084,22 @@ private String
reconfSlowIoWarningThre
[
https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863816#comment-17863816
]
ASF GitHub Bot commented on HADOOP-19120:
-
steveloughran commented on code in P
steveloughran commented on code in PR #6633:
URL: https://github.com/apache/hadoop/pull/6633#discussion_r1668758494
##
hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/KeepAliveCache.java:
##
@@ -96,6 +97,8 @@ class KeepAliveCache extends
Stack
[
https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863812#comment-17863812
]
ASF GitHub Bot commented on HADOOP-19120:
-
steveloughran commented on PR #6633:
steveloughran commented on PR #6633:
URL: https://github.com/apache/hadoop/pull/6633#issuecomment-2214233797
i was on vacation for a week. it was a july4 week and its always quiet
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHu
zhengchenyu closed pull request #6919: HDFS-17566. Got wrong sorted block order
when StorageType is considered.
URL: https://github.com/apache/hadoop/pull/6919
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
[
https://issues.apache.org/jira/browse/HADOOP-18708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863800#comment-17863800
]
ASF GitHub Bot commented on HADOOP-18708:
-
steveloughran commented on code in P
steveloughran commented on code in PR #6884:
URL: https://github.com/apache/hadoop/pull/6884#discussion_r1668510834
##
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/AWSHeaders.java:
##
@@ -83,6 +83,11 @@ public interface AWSHeaders {
*/
String CRYPTO
hadoop-yetus commented on PR #6928:
URL: https://github.com/apache/hadoop/pull/6928#issuecomment-2214072385
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexe
VicoWu closed pull request #6921: HDFS-17568 Refined Log for Decommissioning
Nodes and Reason for Not Finding Src Node
URL: https://github.com/apache/hadoop/pull/6921
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
UR
[
https://issues.apache.org/jira/browse/HADOOP-19139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863751#comment-17863751
]
ASF GitHub Bot commented on HADOOP-19139:
-
hadoop-yetus commented on PR #6699:
hadoop-yetus commented on PR #6699:
URL: https://github.com/apache/hadoop/pull/6699#issuecomment-2213690948
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reex
[
https://issues.apache.org/jira/browse/HADOOP-19211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863743#comment-17863743
]
ASF GitHub Bot commented on HADOOP-19211:
-
steveloughran commented on PR #6904:
steveloughran commented on PR #6904:
URL: https://github.com/apache/hadoop/pull/6904#issuecomment-2213633311
Raising an java.io.EOFException when passing down an offset/range > file
length is what is required, so all is good.
s3a and abfs support the openFileWithOptions so they can sa
[
https://issues.apache.org/jira/browse/HADOOP-19187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863738#comment-17863738
]
ASF GitHub Bot commented on HADOOP-19187:
-
hadoop-yetus commented on PR #6879:
hadoop-yetus commented on PR #6879:
URL: https://github.com/apache/hadoop/pull/6879#issuecomment-2213582338
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reex
[
https://issues.apache.org/jira/browse/HADOOP-19195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-19195.
-
Fix Version/s: 3.4.1
Resolution: Fixed
merged to 3.4 and trunk branches
Harshit
[
https://issues.apache.org/jira/browse/HADOOP-19216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863724#comment-17863724
]
ASF GitHub Bot commented on HADOOP-19216:
-
steveloughran commented on PR #6913:
steveloughran commented on PR #6913:
URL: https://github.com/apache/hadoop/pull/6913#issuecomment-2213499279
@pan3793 can you do a PR for branch-3.4; if yetus is happy you can merge
without needing any upvotes
--
This is an automated message from the Apache Git Service.
To respond to the
steveloughran commented on PR #6900:
URL: https://github.com/apache/hadoop/pull/6900#issuecomment-2213489392
merged, will cherrypick and retest on branch-3.4.
@singhpk234 over to you for the followup.
--
This is an automated message from the Apache Git Service.
To respond to the messag
steveloughran merged PR #6900:
URL: https://github.com/apache/hadoop/pull/6900
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscr...
hadoop-yetus commented on PR #6921:
URL: https://github.com/apache/hadoop/pull/6921#issuecomment-2213486118
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexe
[
https://issues.apache.org/jira/browse/HADOOP-19195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863720#comment-17863720
]
ASF GitHub Bot commented on HADOOP-19195:
-
steveloughran commented on PR #6900:
steveloughran commented on PR #6900:
URL: https://github.com/apache/hadoop/pull/6900#issuecomment-2213486405
@singhpk234 how about we merge this and you do the followup JIRA for the new
update with a full qualification as per
[testing.md](https://hadoop.apache.org/docs/stable/hadoop-aws/too
hadoop-yetus commented on PR #6927:
URL: https://github.com/apache/hadoop/pull/6927#issuecomment-2213464718
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexe
[
https://issues.apache.org/jira/browse/HADOOP-18708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863715#comment-17863715
]
ASF GitHub Bot commented on HADOOP-18708:
-
hadoop-yetus commented on PR #6884:
hadoop-yetus commented on PR #6884:
URL: https://github.com/apache/hadoop/pull/6884#issuecomment-2213463378
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexe
zhengchenyu opened a new pull request, #6928:
URL: https://github.com/apache/hadoop/pull/6928
### Description of PR
dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured,
then we can adjust the speed of ec block copy. Especially
[HDFS-17550](https://issues.apache
[
https://issues.apache.org/jira/browse/HADOOP-18708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863691#comment-17863691
]
ASF GitHub Bot commented on HADOOP-18708:
-
shameersss1 commented on PR #6884:
U
shameersss1 commented on PR #6884:
URL: https://github.com/apache/hadoop/pull/6884#issuecomment-2213254270
@steveloughran @ahmarsuhail I have rebased the changes on top of
https://github.com/apache/hadoop/pull/6892 .
Please review the changes
Thanks
--
This is an automated mes
Hexiaoqiao commented on PR #6840:
URL: https://github.com/apache/hadoop/pull/6840#issuecomment-2213192104
@ayushtkn Thanks for your reminder.
https://github.com/apache/hadoop/pull/6919 try to follow and fix it.
--
This is an automated message from the Apache Git Service.
To respond to the
65 matches
Mail list logo
