tasanuma opened a new pull request, #4138:
URL: https://github.com/apache/hadoop/pull/4138
### Description of PR
NameNode should not send a reconstruction work when the source datanodes are
insufficient.
Otherwise, DataNodes receive the order and throw the following
[
https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=752610=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752610
]
ASF GitHub Bot logged work on HADOOP-18088:
---
Author: ASF GitHub Bot
iwasakims commented on code in PR #4052:
URL: https://github.com/apache/hadoop/pull/4052#discussion_r842267546
##
hadoop-project/pom.xml:
##
@@ -81,8 +81,8 @@
4.4.13
-1.7.30
-1.2.17
+1.7.35
Review Comment:
The diff from 1.7.35 looks safe and good to
[
https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=752609=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752609
]
ASF GitHub Bot logged work on HADOOP-18088:
---
Author: ASF GitHub Bot
iwasakims commented on code in PR #4052:
URL: https://github.com/apache/hadoop/pull/4052#discussion_r842267113
##
hadoop-client-modules/hadoop-client-check-test-invariants/pom.xml:
##
@@ -89,7 +89,7 @@
commons-logging:commons-logging
[
https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=752592=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752592
]
ASF GitHub Bot logged work on HADOOP-18088:
---
Author: ASF GitHub Bot
Apache9 commented on code in PR #4052:
URL: https://github.com/apache/hadoop/pull/4052#discussion_r842251722
##
hadoop-project/pom.xml:
##
@@ -81,8 +81,8 @@
4.4.13
-1.7.30
-1.2.17
+1.7.35
Review Comment:
1.7.36 is out?
##
[
https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=752589=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752589
]
ASF GitHub Bot logged work on HADOOP-18088:
---
Author: ASF GitHub Bot
iwasakims commented on PR #4052:
URL: https://github.com/apache/hadoop/pull/4052#issuecomment-1088166829
```
$ bin/hadoop org.apache.hadoop.util.FindClass load org.apache.log4j.Logger
Loaded org.apache.log4j.Logger as class org.apache.log4j.Logger
org.apache.log4j.Logger:
hadoop-yetus commented on PR #4132:
URL: https://github.com/apache/hadoop/pull/4132#issuecomment-1088151170
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-18192:
--
Priority: Major (was: Minor)
> Fix multiple_bindings warning about slf4j-reload4j
>
[
https://issues.apache.org/jira/browse/HADOOP-18188?focusedWorklogId=752539=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752539
]
ASF GitHub Bot logged work on HADOOP-18188:
---
Author: ASF GitHub Bot
hadoop-yetus commented on PR #4135:
URL: https://github.com/apache/hadoop/pull/4135#issuecomment-1088085683
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=752527=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752527
]
ASF GitHub Bot logged work on HADOOP-18088:
---
Author: ASF GitHub Bot
steveloughran commented on PR #4052:
URL: https://github.com/apache/hadoop/pull/4052#issuecomment-1088068878
good catch about assemblies. i think you can use findclass to identify which
jar a log4j or slf4j class is loaded from,just as i have done for the 1.2
classes
steveloughran commented on PR #4134:
URL: https://github.com/apache/hadoop/pull/4134#issuecomment-1088062871
ok, the nuances of hdfs xml parsing break one of the new tests
```
hadoop-yetus commented on PR #4134:
URL: https://github.com/apache/hadoop/pull/4134#issuecomment-1088045393
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-18167?focusedWorklogId=752499=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752499
]
ASF GitHub Bot logged work on HADOOP-18167:
---
Author: ASF GitHub Bot
hadoop-yetus commented on PR #4092:
URL: https://github.com/apache/hadoop/pull/4092#issuecomment-1087984787
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-16104?focusedWorklogId=752456=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752456
]
ASF GitHub Bot logged work on HADOOP-16104:
---
Author: ASF GitHub Bot
hadoop-yetus commented on PR #4137:
URL: https://github.com/apache/hadoop/pull/4137#issuecomment-1087926870
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-16104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HADOOP-16104:
Labels: pull-request-available (was: )
> Wasb tests to downgrade to skip when test a/c
arjun4084346 opened a new pull request, #4137:
URL: https://github.com/apache/hadoop/pull/4137
…ace enabled. Contributed by Masatake Iwasaki.
(cherry picked from commit aa3ad3660506382884324c4b8997973f5a68e29a)
### Description of PR
### How was this patch
[
https://issues.apache.org/jira/browse/HADOOP-16104?focusedWorklogId=752439=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752439
]
ASF GitHub Bot logged work on HADOOP-16104:
---
Author: ASF GitHub Bot
[
https://issues.apache.org/jira/browse/HADOOP-18192?focusedWorklogId=752417=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752417
]
ASF GitHub Bot logged work on HADOOP-18192:
---
Author: ASF GitHub Bot
hadoop-yetus commented on PR #4136:
URL: https://github.com/apache/hadoop/pull/4136#issuecomment-1087854512
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-18167?focusedWorklogId=752410=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752410
]
ASF GitHub Bot logged work on HADOOP-18167:
---
Author: ASF GitHub Bot
hchaverri commented on code in PR #4092:
URL: https://github.com/apache/hadoop/pull/4092#discussion_r841996722
##
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/token/delegation/AbstractDelegationTokenSecretManager.java:
##
@@ -429,11 +446,18 @@
[
https://issues.apache.org/jira/browse/HADOOP-18167?focusedWorklogId=752409=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752409
]
ASF GitHub Bot logged work on HADOOP-18167:
---
Author: ASF GitHub Bot
hchaverri commented on code in PR #4092:
URL: https://github.com/apache/hadoop/pull/4092#discussion_r841995262
##
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/token/delegation/AbstractDelegationTokenSecretManager.java:
##
@@ -825,4 +867,78 @@
[
https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=752384=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752384
]
ASF GitHub Bot logged work on HADOOP-18088:
---
Author: ASF GitHub Bot
iwasakims commented on PR #4052:
URL: https://github.com/apache/hadoop/pull/4052#issuecomment-1087807982
```
$ mvn clean install -DskipTests -DskipShade -Pdist
$ find hadoop-dist/target/hadoop-3.3.3-SNAPSHOT -name 'slf4j-*.jar'
[
https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=752378=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752378
]
ASF GitHub Bot logged work on HADOOP-18088:
---
Author: ASF GitHub Bot
iwasakims commented on PR #4052:
URL: https://github.com/apache/hadoop/pull/4052#issuecomment-1087800128
I found that we need to update assembly definition under hadoop-assemblies
too. I filed
[HADOOP-18192](https://issues.apache.org/jira/browse/HADOOP-18192)(#4136) for
branch-3.2. I
[
https://issues.apache.org/jira/browse/HADOOP-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-18192:
--
Status: Patch Available (was: Open)
> Fix multiple_bindings warning about
[
https://issues.apache.org/jira/browse/HADOOP-18192?focusedWorklogId=752369=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752369
]
ASF GitHub Bot logged work on HADOOP-18192:
---
Author: ASF GitHub Bot
iwasakims commented on PR #4136:
URL: https://github.com/apache/hadoop/pull/4136#issuecomment-1087788893
The patch removed duplicate slf4j-reload4j-1.7.35.jar in dist layout on my
local.
```
$ mvn clean install -DskipTests -DskipShade -Pdist
$ find
[
https://issues.apache.org/jira/browse/HADOOP-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HADOOP-18192:
Labels: pull-request-available (was: )
> Fix multiple_bindings warning about
[
https://issues.apache.org/jira/browse/HADOOP-18192?focusedWorklogId=752367=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752367
]
ASF GitHub Bot logged work on HADOOP-18192:
---
Author: ASF GitHub Bot
iwasakims opened a new pull request, #4136:
URL: https://github.com/apache/hadoop/pull/4136
https://issues.apache.org/jira/browse/HADOOP-18192
Jar of slf4j-relad4j exists in libdirs of both common and hdfs.
```
$ ~/dist/hadoop-3.2.4-SNAPSHOT/bin/hdfs dfs -ls /
SLF4J:
[
https://issues.apache.org/jira/browse/HADOOP-18188?focusedWorklogId=752318=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752318
]
ASF GitHub Bot logged work on HADOOP-18188:
---
Author: ASF GitHub Bot
aajisaka commented on PR #4135:
URL: https://github.com/apache/hadoop/pull/4135#issuecomment-1087697220
Thank you @virajjasani for the PR. +1 for the src change. That's exactly the
change what I was thinking. I'll review the test classes later.
--
This is an automated message from the
[
https://issues.apache.org/jira/browse/HADOOP-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-18136:
Fix Version/s: 3.2.4
> Verify FileUtils.unTar() handling of missing .tar files
>
[
https://issues.apache.org/jira/browse/HADOOP-18191?focusedWorklogId=752311=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752311
]
ASF GitHub Bot logged work on HADOOP-18191:
---
Author: ASF GitHub Bot
hadoop-yetus commented on PR #4133:
URL: https://github.com/apache/hadoop/pull/4133#issuecomment-1087659921
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-18175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516870#comment-17516870
]
Steve Loughran commented on HADOOP-18175:
-
code}
[ERROR]
[
https://issues.apache.org/jira/browse/HADOOP-18180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-18180:
Summary: Remove use of scala jar twitter util-core with java futures in S3A
prefetching
[
https://issues.apache.org/jira/browse/HADOOP-18180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-18180.
-
Fix Version/s: 3.4.0
Resolution: Fixed
merged to the HADOOP-18028 feature
[
https://issues.apache.org/jira/browse/HADOOP-18180?focusedWorklogId=752307=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752307
]
ASF GitHub Bot logged work on HADOOP-18180:
---
Author: ASF GitHub Bot
steveloughran commented on PR #4115:
URL: https://github.com/apache/hadoop/pull/4115#issuecomment-1087649737
+1 merged.
only thought after i'd hit the merge that i should include a reference to
the HADOOP-18028 jira in the message; I will do that in the others, so a log
grep will
[
https://issues.apache.org/jira/browse/HADOOP-18180?focusedWorklogId=752306=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752306
]
ASF GitHub Bot logged work on HADOOP-18180:
---
Author: ASF GitHub Bot
steveloughran merged PR #4115:
URL: https://github.com/apache/hadoop/pull/4115
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
[
https://issues.apache.org/jira/browse/HADOOP-18180?focusedWorklogId=752305=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752305
]
ASF GitHub Bot logged work on HADOOP-18180:
---
Author: ASF GitHub Bot
steveloughran commented on PR #4115:
URL: https://github.com/apache/hadoop/pull/4115#issuecomment-1087645575
stack of the failure
```
[ERROR]
testStatistics(org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContextStatistics)
Time elapsed: 1.591 s <<< ERROR!
[
https://issues.apache.org/jira/browse/HADOOP-16415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516858#comment-17516858
]
Steve Loughran commented on HADOOP-16415:
-
turns out the fix for this is an M1 MBP
> Speed up
[
https://issues.apache.org/jira/browse/HADOOP-18180?focusedWorklogId=752284=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752284
]
ASF GitHub Bot logged work on HADOOP-18180:
---
Author: ASF GitHub Bot
steveloughran commented on PR #4115:
URL: https://github.com/apache/hadoop/pull/4115#issuecomment-1087615845
unbuffer happens on some networks, marker is known. let me try locally.
this is a feature branch and I'm not too worried about patches introducing
failures, especially this
[
https://issues.apache.org/jira/browse/HADOOP-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-18192:
--
Summary: Fix multiple_bindings warning about slf4j-reload4j (was: Fix
[
https://issues.apache.org/jira/browse/HADOOP-18180?focusedWorklogId=752275=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752275
]
ASF GitHub Bot logged work on HADOOP-18180:
---
Author: ASF GitHub Bot
dannycjones commented on PR #4115:
URL: https://github.com/apache/hadoop/pull/4115#issuecomment-1087586934
Looking at the test results shared by Monthon...
> ```
> [INFO] Results:
> [INFO]
> [ERROR] Failures:
> [ERROR]
[
https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516821#comment-17516821
]
Daniel Carl Jones commented on HADOOP-18028:
Hey [~pj.fanning], the AWS SDK V1 -> V2
[
https://issues.apache.org/jira/browse/HADOOP-18188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HADOOP-18188:
Labels: pull-request-available (was: )
> Support touch command for directory
>
[
https://issues.apache.org/jira/browse/HADOOP-18188?focusedWorklogId=752232=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752232
]
ASF GitHub Bot logged work on HADOOP-18188:
---
Author: ASF GitHub Bot
virajjasani opened a new pull request, #4135:
URL: https://github.com/apache/hadoop/pull/4135
### Description of PR
Currently hadoop fs -touch command cannot update the mtime and the atime of
directory. The feature would be useful when we check whether the filesystem is
ready to write
Masatake Iwasaki created HADOOP-18192:
-
Summary: Fix multiple_bindings warning about slf4j-relad4j
Key: HADOOP-18192
URL: https://issues.apache.org/jira/browse/HADOOP-18192
Project: Hadoop Common
steveloughran opened a new pull request, #4134:
URL: https://github.com/apache/hadoop/pull/4134
cherrypick all the changes in hadoop 3.2.4 on top of branch 3.3.2, so they
are in sync.
This avoids us having a 3.2.x release which is ahead of the 3.3.x release
line.
1. all the
[
https://issues.apache.org/jira/browse/HADOOP-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-18136.
-
Fix Version/s: 3.3.3
Resolution: Fixed
> Verify FileUtils.unTar() handling of
[
https://issues.apache.org/jira/browse/HADOOP-18137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-18137.
-
Resolution: Duplicate
> Verify FileUtils.unTar() handling of missing .tgz files
>
[
https://issues.apache.org/jira/browse/HADOOP-18191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HADOOP-18191:
Labels: pull-request-available (was: )
> Log retry count while handling exceptions in
[
https://issues.apache.org/jira/browse/HADOOP-18191?focusedWorklogId=752199=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752199
]
ASF GitHub Bot logged work on HADOOP-18191:
---
Author: ASF GitHub Bot
virajjasani opened a new pull request, #4133:
URL: https://github.com/apache/hadoop/pull/4133
### Description of PR
As part of failure handling in RetryInvocationHandler, we log details of the
Exception details with which API was invoked, failover attempts, delay.
For the purpose
Viraj Jasani created HADOOP-18191:
-
Summary: Log retry count while handling exceptions in
RetryInvocationHandler
Key: HADOOP-18191
URL: https://issues.apache.org/jira/browse/HADOOP-18191
Project:
[
https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=752190=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752190
]
ASF GitHub Bot logged work on HADOOP-18088:
---
Author: ASF GitHub Bot
hadoop-yetus commented on PR #4052:
URL: https://github.com/apache/hadoop/pull/4052#issuecomment-1087409523
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=752189=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752189
]
ASF GitHub Bot logged work on HADOOP-18088:
---
Author: ASF GitHub Bot
iwasakims commented on code in PR #4052:
URL: https://github.com/apache/hadoop/pull/4052#discussion_r841610075
##
hadoop-client-modules/hadoop-client-check-invariants/pom.xml:
##
@@ -85,7 +85,7 @@
commons-logging:commons-logging
[
https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=752186=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752186
]
ASF GitHub Bot logged work on HADOOP-16202:
---
Author: ASF GitHub Bot
steveloughran commented on PR #2584:
URL: https://github.com/apache/hadoop/pull/2584#issuecomment-1087397803
```
./hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java:29:import
java.util.concurrent.CompletableFuture;:8: Unused import -
[
https://issues.apache.org/jira/browse/HADOOP-18154?focusedWorklogId=752174=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752174
]
ASF GitHub Bot logged work on HADOOP-18154:
---
Author: ASF GitHub Bot
steveloughran commented on PR #4070:
URL: https://github.com/apache/hadoop/pull/4070#issuecomment-1087358960
+ @mehakmeet
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
[
https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=752159=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752159
]
ASF GitHub Bot logged work on HADOOP-18088:
---
Author: ASF GitHub Bot
steveloughran commented on code in PR #4052:
URL: https://github.com/apache/hadoop/pull/4052#discussion_r841532497
##
hadoop-client-modules/hadoop-client-runtime/pom.xml:
##
@@ -151,7 +151,7 @@
commons-logging:commons-logging
[
https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=752158=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752158
]
ASF GitHub Bot logged work on HADOOP-18088:
---
Author: ASF GitHub Bot
steveloughran commented on PR #4052:
URL: https://github.com/apache/hadoop/pull/4052#issuecomment-1087314270
@Apache9 looking at this in 3.3.x too, FYI
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
[
https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516689#comment-17516689
]
Daniel Carl Jones commented on HADOOP-14837:
FYI, Glacier recently introduced a new
85 matches
Mail list logo
