jchanggg commented on PR #6481:
URL: https://github.com/apache/hadoop/pull/6481#issuecomment-1943201285
Gentle ping @slfan1989 , thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp
[
https://issues.apache.org/jira/browse/HADOOP-19072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817227#comment-17817227
]
ASF GitHub Bot commented on HADOOP-19072:
-
virajjasani commented on PR #6543:
U
virajjasani commented on PR #6543:
URL: https://github.com/apache/hadoop/pull/6543#issuecomment-1943188871
Tested against `us-west-2`:
`mvn clean verify -Dparallel-tests -DtestsThreadCount=8 -Dscale -Dprefetch`
--
This is an automated message from the Apache Git Service.
To resp
virajjasani commented on PR #6525:
URL: https://github.com/apache/hadoop/pull/6525#issuecomment-1943184939
Addendum PR to cover corner cases: #6546
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
hadoop-yetus commented on PR #6550:
URL: https://github.com/apache/hadoop/pull/6550#issuecomment-1943173216
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexe
[
https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817209#comment-17817209
]
ASF GitHub Bot commented on HADOOP-14837:
-
hadoop-yetus commented on PR #6407:
hadoop-yetus commented on PR #6407:
URL: https://github.com/apache/hadoop/pull/6407#issuecomment-1943092389
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reex
PradhanPrerak opened a new pull request, #6550:
URL: https://github.com/apache/hadoop/pull/6550
### Description of PR
- Support to add custom headers to s3a s3 and sts client
Introducing new custom.headers config for each client type, Upon setting
this header each s3/sts request wi
simbadzina merged PR #6498:
URL: https://github.com/apache/hadoop/pull/6498
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscr...@ha
szetszwo opened a new pull request, #6549:
URL: https://github.com/apache/hadoop/pull/6549
### Description of PR
If a fsimage is corrupted, it may have inaccessible nodes. The
FsImageValidation tool currently is able to identify the inaccessible nodes
when validating the INodeMap. Th
bbeaudreault commented on PR #6514:
URL: https://github.com/apache/hadoop/pull/6514#issuecomment-1942232124
@zhangshuyan0 Thank you for looking!
I followed the existing pattern of hedged read and striped thread pools.
Both of those are only used in DFSInputStream but are configured an
[
https://issues.apache.org/jira/browse/HADOOP-18930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-18930.
-
Fix Version/s: 3.4.0
(was: 3.3.7-aws)
Resolution: Fixed
>
[
https://issues.apache.org/jira/browse/HADOOP-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817062#comment-17817062
]
ASF GitHub Bot commented on HADOOP-18088:
-
steveloughran merged PR #6547:
URL:
steveloughran merged PR #6547:
URL: https://github.com/apache/hadoop/pull/6547
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscr...
[
https://issues.apache.org/jira/browse/HADOOP-15984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817057#comment-17817057
]
ASF GitHub Bot commented on HADOOP-15984:
-
virajjasani closed pull request #576
virajjasani closed pull request #5768: HADOOP-15984. Jersey 2.x upgrade
URL: https://github.com/apache/hadoop/pull/5768
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsub
[
https://issues.apache.org/jira/browse/HADOOP-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817037#comment-17817037
]
ASF GitHub Bot commented on HADOOP-18088:
-
steveloughran commented on code in P
steveloughran commented on code in PR #6547:
URL: https://github.com/apache/hadoop/pull/6547#discussion_r1488049327
##
LICENSE-binary:
##
@@ -489,11 +489,10 @@ org.checkerframework:checker-qual:2.5.2
org.codehaus.mojo:animal-sniffer-annotations:1.21
org.jruby.jcodings:jcodings
[
https://issues.apache.org/jira/browse/HADOOP-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817031#comment-17817031
]
ASF GitHub Bot commented on HADOOP-18088:
-
iwasakims commented on code in PR #6
iwasakims commented on code in PR #6547:
URL: https://github.com/apache/hadoop/pull/6547#discussion_r1488029533
##
LICENSE-binary:
##
@@ -489,11 +489,10 @@ org.checkerframework:checker-qual:2.5.2
org.codehaus.mojo:animal-sniffer-annotations:1.21
org.jruby.jcodings:jcodings:1.0
[
https://issues.apache.org/jira/browse/HADOOP-15984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817023#comment-17817023
]
Shilun Fan edited comment on HADOOP-15984 at 2/13/24 3:01 PM:
---
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817026#comment-17817026
]
ASF GitHub Bot commented on HADOOP-19057:
-
hadoop-yetus commented on PR #6548:
hadoop-yetus commented on PR #6548:
URL: https://github.com/apache/hadoop/pull/6548#issuecomment-1941665287
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reex
[
https://issues.apache.org/jira/browse/HADOOP-15984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817023#comment-17817023
]
Shilun Fan commented on HADOOP-15984:
-
[~iwasakims] [~fanningpj] Thank you for the
[
https://issues.apache.org/jira/browse/HADOOP-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816992#comment-17816992
]
ASF GitHub Bot commented on HADOOP-18088:
-
steveloughran commented on PR #6547:
steveloughran commented on PR #6547:
URL: https://github.com/apache/hadoop/pull/6547#issuecomment-1941502210
Incidentally, as this is a backport I don't need a vote from anyone but
myself :-)
just making sure it is good
--
This is an automated message from the Apache Git Service.
T
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816991#comment-17816991
]
ASF GitHub Bot commented on HADOOP-19057:
-
steveloughran commented on PR #6548:
steveloughran commented on PR #6548:
URL: https://github.com/apache/hadoop/pull/6548#issuecomment-1941491465
this is the cherrypick of #6515 to branch-3.3, moving to the v1 sdk.
a couple of places I left the variables as csvPath as is simplified the
test, cut some methods and a whole
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816989#comment-17816989
]
ASF GitHub Bot commented on HADOOP-19057:
-
steveloughran opened a new pull requ
steveloughran opened a new pull request, #6548:
URL: https://github.com/apache/hadoop/pull/6548
The AWS landsat data previously used in some S3A tests is no longer
accessible
This PR moves to the new external file
s3a://noaa-cors-pds/raw/2024/001/akse/AKSE001x.24_.gz
* L
pjfanning commented on code in PR #33:
URL: https://github.com/apache/hadoop-thirdparty/pull/33#discussion_r1487691552
##
pom.xml:
##
@@ -126,6 +132,7 @@
hadoop-shaded-protobuf_3_21
hadoop-shaded-guava
hadoop-shaded-avro_1_11
+hadoop-shaded-jersery
Review Com
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816959#comment-17816959
]
ASF GitHub Bot commented on HADOOP-19057:
-
hadoop-yetus commented on PR #6515:
hadoop-yetus commented on PR #6515:
URL: https://github.com/apache/hadoop/pull/6515#issuecomment-1941210426
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexe
[
https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816958#comment-17816958
]
ASF GitHub Bot commented on HADOOP-14837:
-
hadoop-yetus commented on PR #6407:
hadoop-yetus commented on PR #6407:
URL: https://github.com/apache/hadoop/pull/6407#issuecomment-1941195431
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexe
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-19057:
Description:
The s3 test bucket used in hadoop-aws tests of S3 select and large file read
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-19057:
Description:
The s3 test bucket used in hadoop-aws tests of S3 select and large file read
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-19057:
Fix Version/s: 3.5.0
> S3 public test bucket landsat-pds unreadable -needs replacement
>
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816956#comment-17816956
]
ASF GitHub Bot commented on HADOOP-19057:
-
steveloughran commented on PR #6515:
steveloughran merged PR #6515:
URL: https://github.com/apache/hadoop/pull/6515
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscr...
steveloughran commented on PR #6515:
URL: https://github.com/apache/hadoop/pull/6515#issuecomment-1941157296
@virajjasani i want something with anonymous access; this is the only place
we can validate this.
--
This is an automated message from the Apache Git Service.
To respond to the mes
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816955#comment-17816955
]
ASF GitHub Bot commented on HADOOP-19057:
-
steveloughran merged PR #6515:
URL:
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816953#comment-17816953
]
ASF GitHub Bot commented on HADOOP-19057:
-
steveloughran commented on PR #6515:
steveloughran commented on PR #6515:
URL: https://github.com/apache/hadoop/pull/6515#issuecomment-1941122988
@ahmarsuhail yes, those two failures are outstanding and covered in separate
JIRAs.
* TestS3ACommitterFactory.testEverything. This tries to dynamically alter
the fs instance t
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816950#comment-17816950
]
ASF GitHub Bot commented on HADOOP-19057:
-
steveloughran commented on PR #6515:
steveloughran commented on PR #6515:
URL: https://github.com/apache/hadoop/pull/6515#issuecomment-1941117215
@virajjasani if this goes away we can deal with it again...there's more
resilience this time.
--
This is an automated message from the Apache Git Service.
To respond to the message
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816949#comment-17816949
]
ASF GitHub Bot commented on HADOOP-19057:
-
steveloughran commented on code in P
steveloughran commented on code in PR #6515:
URL: https://github.com/apache/hadoop/pull/6515#discussion_r1487574359
##
hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/connecting.md:
##
@@ -289,9 +289,8 @@ for buckets in the central and EU/Ireland endpoints.
```xml
[
https://issues.apache.org/jira/browse/HADOOP-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816948#comment-17816948
]
ASF GitHub Bot commented on HADOOP-18088:
-
steveloughran commented on PR #6547:
steveloughran commented on PR #6547:
URL: https://github.com/apache/hadoop/pull/6547#issuecomment-1941110038
full clean build with this and there are no log4j jars on the classpath
```
> find hadoop-dist/target/hadoop-3.5.0-SNAPSHOT -print | grep log
hadoop-dist/target/hadoop-3.5
[
https://issues.apache.org/jira/browse/HADOOP-15984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816897#comment-17816897
]
PJ Fanning commented on HADOOP-15984:
-
Jersey 1 uses jsr311 jar and Jersey2 uses rs
[
https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816892#comment-17816892
]
ASF GitHub Bot commented on HADOOP-14837:
-
bpahuja commented on code in PR #640
bpahuja commented on code in PR #6407:
URL: https://github.com/apache/hadoop/pull/6407#discussion_r1487377659
##
hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/list/ITestS3AReadRestoredGlacierObjects.java:
##
@@ -0,0 +1,181 @@
+/*
+ * Licensed to the Apache Softw
[
https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816890#comment-17816890
]
ASF GitHub Bot commented on HADOOP-14837:
-
bpahuja commented on code in PR #640
bpahuja commented on code in PR #6407:
URL: https://github.com/apache/hadoop/pull/6407#discussion_r1487376391
##
hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/index.md:
##
@@ -1309,6 +1309,20 @@ The switch to turn S3A auditing on or off.
+
[
https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816887#comment-17816887
]
ASF GitHub Bot commented on HADOOP-14837:
-
bpahuja commented on code in PR #640
bpahuja commented on code in PR #6407:
URL: https://github.com/apache/hadoop/pull/6407#discussion_r1487363104
##
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java:
##
@@ -577,6 +583,11 @@ public void initialize(URI name, Configuration
originalCon
57 matches
Mail list logo