cndaimin opened a new pull request #4077:
URL: https://github.com/apache/hadoop/pull/4077
We encountered an `UnsupportedOperationException: Remove unsupported` error
when some datanodes were in decommission. The reason of the exception is that
`datanode.getBlockIterator()` returns an
ferhui commented on pull request #4058:
URL: https://github.com/apache/hadoop/pull/4058#issuecomment-1070302020
@tomscut Thanks for your contribution. @umamaheswararao Thanks for your
review! Merged
--
This is an automated message from the Apache Git Service.
To respond to the message,
ferhui merged pull request #4058:
URL: https://github.com/apache/hadoop/pull/4058
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
whbing commented on a change in pull request #2918:
URL: https://github.com/apache/hadoop/pull/2918#discussion_r828729417
##
File path:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/OfflineImageViewerPB.java
##
@@ -132,6 +133,7
hadoop-yetus commented on pull request #4076:
URL: https://github.com/apache/hadoop/pull/4076#issuecomment-1070092172
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0
tomscut commented on pull request #4071:
URL: https://github.com/apache/hadoop/pull/4071#issuecomment-1069992175
Hi @jojochuang @ayushtkn @Hexiaoqiao @ferhui , could you please take a look?
Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message,
[
https://issues.apache.org/jira/browse/HADOOP-18164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507959#comment-17507959
]
Masatake Iwasaki commented on HADOOP-18164:
---
You can not use lambda in branch-2.10 which
[
https://issues.apache.org/jira/browse/HADOOP-18164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom McCormick updated HADOOP-18164:
---
Attachment: HADOOP-18164.00.patch
> Backport HADOOP-12760 to 2.10
>
tomscut commented on pull request #4058:
URL: https://github.com/apache/hadoop/pull/4058#issuecomment-1069843435
Hi @umamaheswararao , could you please help merge this? Thank you.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
Tom McCormick created HADOOP-18164:
--
Summary: Backport HADOOP-12760 to 2.10
Key: HADOOP-18164
URL: https://issues.apache.org/jira/browse/HADOOP-18164
Project: Hadoop Common
Issue Type:
hadoop-yetus commented on pull request #4076:
URL: https://github.com/apache/hadoop/pull/4076#issuecomment-1069805073
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0
hadoop-yetus commented on pull request #4076:
URL: https://github.com/apache/hadoop/pull/4076#issuecomment-1069727667
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0
hadoop-yetus commented on pull request #4075:
URL: https://github.com/apache/hadoop/pull/4075#issuecomment-1069645855
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0
hadoop-yetus commented on pull request #4076:
URL: https://github.com/apache/hadoop/pull/4076#issuecomment-1069628049
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0
[
https://issues.apache.org/jira/browse/HADOOP-15245?focusedWorklogId=742762=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742762
]
ASF GitHub Bot logged work on HADOOP-15245:
---
Author: ASF GitHub Bot
hadoop-yetus commented on pull request #3927:
URL: https://github.com/apache/hadoop/pull/3927#issuecomment-1069612492
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0
[
https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=742680=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742680
]
ASF GitHub Bot logged work on HADOOP-18160:
---
Author: ASF GitHub Bot
hadoop-yetus commented on pull request #4074:
URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1069468112
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0
hadoop-yetus commented on pull request #2971:
URL: https://github.com/apache/hadoop/pull/2971#issuecomment-1069400546
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0
GauthamBanasandra opened a new pull request #4076:
URL: https://github.com/apache/hadoop/pull/4076
### Description of PR
The source files for hdfs_find uses getopt for parsing the command line
arguments. getopt is available only on Linux and thus, isn't cross platform. We
need
[
https://issues.apache.org/jira/browse/HADOOP-18129?focusedWorklogId=742639=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742639
]
ASF GitHub Bot logged work on HADOOP-18129:
---
Author: ASF GitHub Bot
abhishekdas99 commented on pull request #3996:
URL: https://github.com/apache/hadoop/pull/3996#issuecomment-1069402467
> What do the numbers look like for the memory usage before and after this
change?
For 40k mount points, the size of ViewFileSystem reduced from 62MB to 28MB.
--
[
https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=742614=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742614
]
ASF GitHub Bot logged work on HADOOP-18160:
---
Author: ASF GitHub Bot
steveloughran commented on pull request #4074:
URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1069391316
thanks.
will have to raise this with on the hadoop common list to discuss what to do
here.
i don't see any uses of the library other than hadoop azure and hadoop
[
https://issues.apache.org/jira/browse/HADOOP-18161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-18161:
Component/s: (was: hadoop-thirdparty)
> [WASB] Retry not getting implemented when
[
https://issues.apache.org/jira/browse/HADOOP-18161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-18161:
Priority: Minor (was: Major)
> [WASB] Retry not getting implemented when using wasb
[
https://issues.apache.org/jira/browse/HADOOP-18161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507765#comment-17507765
]
Steve Loughran commented on HADOOP-18161:
-
hadoop 2.7 is six years old
please upgrade to
[
https://issues.apache.org/jira/browse/HADOOP-18129?focusedWorklogId=742566=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742566
]
ASF GitHub Bot logged work on HADOOP-18129:
---
Author: ASF GitHub Bot
omalley commented on pull request #3996:
URL: https://github.com/apache/hadoop/pull/3996#issuecomment-1069353101
What do the numbers look like for the memory usage before and after this
change?
--
This is an automated message from the Apache Git Service.
To respond to the message,
[
https://issues.apache.org/jira/browse/HADOOP-15245?focusedWorklogId=742550=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742550
]
ASF GitHub Bot logged work on HADOOP-15245:
---
Author: ASF GitHub Bot
hadoop-yetus commented on pull request #3927:
URL: https://github.com/apache/hadoop/pull/3927#issuecomment-1069321823
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0
steveloughran opened a new pull request #4075:
URL: https://github.com/apache/hadoop/pull/4075
this is the patch of #2971 spilt into three subcommits on top of trunk for
merging, one per module, to be applied in order
1. HADOOP-18162. hadoop-common support for MAPREDUCE-7341
[
https://issues.apache.org/jira/browse/HADOOP-15245?focusedWorklogId=742511=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742511
]
ASF GitHub Bot logged work on HADOOP-15245:
---
Author: ASF GitHub Bot
ahmarsuhail commented on pull request #3927:
URL: https://github.com/apache/hadoop/pull/3927#issuecomment-1069313450
Thanks for clarifying @mehakmeet, I've updated the test, and made changes in
`skip()` to update `nextReadPos` and use `getPos()`
--
This is an automated message from the
[
https://issues.apache.org/jira/browse/HADOOP-15245?focusedWorklogId=742508=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742508
]
ASF GitHub Bot logged work on HADOOP-15245:
---
Author: ASF GitHub Bot
ahmarsuhail commented on a change in pull request #3927:
URL: https://github.com/apache/hadoop/pull/3927#discussion_r828203561
##
File path:
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AInputStream.java
##
@@ -781,6 +781,46 @@ public void readFully(long
[
https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=742497=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742497
]
ASF GitHub Bot logged work on HADOOP-18160:
---
Author: ASF GitHub Bot
hadoop-yetus commented on pull request #4074:
URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1069297089
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0
Steve Loughran created HADOOP-18163:
---
Summary: hadoop-azure support for the Manifest Committer of
MAPREDUCE-7341
Key: HADOOP-18163
URL: https://issues.apache.org/jira/browse/HADOOP-18163
Project:
[
https://issues.apache.org/jira/browse/HADOOP-18162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-18162:
Summary: hadoop-common enhancements for the Manifest Committer of
MAPREDUCE-7341 (was:
[
https://issues.apache.org/jira/browse/HADOOP-18162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507666#comment-17507666
]
Steve Loughran commented on HADOOP-18162:
-
patch is in the main manifest committer pr; just
[
https://issues.apache.org/jira/browse/HADOOP-18162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reassigned HADOOP-18162:
---
Assignee: Steve Loughran
> Hadoop common enhancements for the Manifest Committer
Steve Loughran created HADOOP-18162:
---
Summary: Hadoop common enhancements for the Manifest Committer
ofMAPREDUCE-7341
Key: HADOOP-18162
URL: https://issues.apache.org/jira/browse/HADOOP-18162
[
https://issues.apache.org/jira/browse/HADOOP-18162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-18162:
Summary: Hadoop common enhancements for the Manifest Committer of
MAPREDUCE-7341 (was:
[
https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=742396=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-742396
]
ASF GitHub Bot logged work on HADOOP-18160:
---
Author: ASF GitHub Bot
[
https://issues.apache.org/jira/browse/HADOOP-18160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HADOOP-18160:
Labels: pull-request-available (was: )
> `org.wildfly.openssl` should not be shaded by
andreAmorimF opened a new pull request #4074:
URL: https://github.com/apache/hadoop/pull/4074
### Description of PR
`org.wildfly.openssl` is a runtime library and its references are being
shaded on Hadoop, breaking the integration with other frameworks like Spark,
whenever the
[
https://issues.apache.org/jira/browse/HADOOP-18160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507653#comment-17507653
]
André F. commented on HADOOP-18160:
---
I just created this [https://github.com/apache/hadoop/pull/4074]
[
https://issues.apache.org/jira/browse/HADOOP-18159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
André F. updated HADOOP-18159:
--
Environment:
hadoop 3.3.1
httpclient 4.5.13
JDK8
was:
hadoop 3.3.1
JDK8
> Certificate
tomscut commented on pull request #4057:
URL: https://github.com/apache/hadoop/pull/4057#issuecomment-1069166429
Hi @ayushtkn , please take a look. Thank you.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
hadoop-yetus removed a comment on pull request #2971:
URL: https://github.com/apache/hadoop/pull/2971#issuecomment-1068567747
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
steveloughran commented on a change in pull request #2971:
URL: https://github.com/apache/hadoop/pull/2971#discussion_r828003326
##
File path:
steveloughran commented on pull request #2971:
URL: https://github.com/apache/hadoop/pull/2971#issuecomment-1069116615
@mehakmeet thanks for your comments. make sure you aren't VPN'd to a vpn
which redirects all azure/aws/gcs io, otherwise all your requests go round the
world. i have hit
steveloughran commented on a change in pull request #2971:
URL: https://github.com/apache/hadoop/pull/2971#discussion_r827994725
##
File path:
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/commit/AbstractAbfsClusterITest.java
##
@@ -0,0 +1,268 @@
+/*
+
steveloughran commented on a change in pull request #2971:
URL: https://github.com/apache/hadoop/pull/2971#discussion_r827994226
##
File path:
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/commit/AbstractAbfsClusterITest.java
##
@@ -0,0 +1,268 @@
+/*
+
steveloughran commented on a change in pull request #2971:
URL: https://github.com/apache/hadoop/pull/2971#discussion_r827991594
##
File path:
[
https://issues.apache.org/jira/browse/HADOOP-15864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507580#comment-17507580
]
Hadoop QA commented on HADOOP-15864:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote ||
steveloughran commented on a change in pull request #2971:
URL: https://github.com/apache/hadoop/pull/2971#discussion_r827986651
##
File path:
[
https://issues.apache.org/jira/browse/HADOOP-15864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507576#comment-17507576
]
Yuanbo Liu commented on HADOOP-15864:
-
how about rerty resolving the ip address instead of returing
hadoop-yetus commented on pull request #4057:
URL: https://github.com/apache/hadoop/pull/4057#issuecomment-1069091685
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0
Hexiaoqiao commented on pull request #4048:
URL: https://github.com/apache/hadoop/pull/4048#issuecomment-1069088113
Committed to trunk. Thanks @jianghuazhu for your contributions! Thanks
@tomscut reviews!
--
This is an automated message from the Apache Git Service.
To respond to the
Hexiaoqiao closed pull request #4048:
URL: https://github.com/apache/hadoop/pull/4048
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
steveloughran commented on a change in pull request #2971:
URL: https://github.com/apache/hadoop/pull/2971#discussion_r827957630
##
File path:
Hexiaoqiao commented on a change in pull request #2918:
URL: https://github.com/apache/hadoop/pull/2918#discussion_r827957606
##
File path:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/OfflineImageViewerPB.java
##
@@ -132,6
steveloughran commented on a change in pull request #2971:
URL: https://github.com/apache/hadoop/pull/2971#discussion_r827957400
##
File path:
steveloughran commented on a change in pull request #2971:
URL: https://github.com/apache/hadoop/pull/2971#discussion_r827956606
##
File path:
Hexiaoqiao commented on a change in pull request #4068:
URL: https://github.com/apache/hadoop/pull/4068#discussion_r827955269
##
File path: hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
##
@@ -4119,6 +4119,14 @@
Mover, and StoragePolicySatisfier.
[
https://issues.apache.org/jira/browse/HADOOP-18161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aryan updated HADOOP-18161:
---
Description:
I am using prestodb to read data from blob.
Presto is using hadoop-azure-2.7.4 jar.
I'm
[
https://issues.apache.org/jira/browse/HADOOP-18160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507553#comment-17507553
]
Steve Loughran commented on HADOOP-18160:
-
got a PR?
the other possibility would be for that
Aryan created HADOOP-18161:
--
Summary: [WASB] Retry not getting implemented when using wasb
scheme in hadoop-azure 2.7.4
Key: HADOOP-18161
URL: https://issues.apache.org/jira/browse/HADOOP-18161
Project:
hadoop-yetus commented on pull request #4069:
URL: https://github.com/apache/hadoop/pull/4069#issuecomment-1069019143
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0
mehakmeet commented on a change in pull request #2971:
URL: https://github.com/apache/hadoop/pull/2971#discussion_r827831884
##
File path:
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/commit/AbstractAbfsClusterITest.java
##
@@ -0,0 +1,268 @@
+/*
+ *
André F. created HADOOP-18160:
-
Summary: `wildfly.openssl` should not be shaded by Hadoop build
Key: HADOOP-18160
URL: https://issues.apache.org/jira/browse/HADOOP-18160
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-18160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
André F. updated HADOOP-18160:
--
Summary: `org.wildfly.openssl` should not be shaded by Hadoop build (was:
`wildfly.openssl` should
André F. created HADOOP-18159:
-
Summary: Certificate doesn't match any of the subject alternative
names: [*.s3.amazonaws.com, s3.amazonaws.com]
Key: HADOOP-18159
URL:
mukund-thakur commented on a change in pull request #2971:
URL: https://github.com/apache/hadoop/pull/2971#discussion_r827666030
##
File path:
76 matches
Mail list logo