[
https://issues.apache.org/jira/browse/HADOOP-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Akira Ajisaka resolved HADOOP-15338.
Resolution: Done
Closed. Thank you all for your contribution!
The remaining tasks
[
https://issues.apache.org/jira/browse/HADOOP-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026490#comment-17026490
]
Akira Ajisaka commented on HADOOP-15338:
YARN-9743 has been fixed. Closing.
> Java 11 runtime
aajisaka commented on issue #1824: YARN-9743. [JDK11]
TestTimelineWebServices.testContextFactory fails.
URL: https://github.com/apache/hadoop/pull/1824#issuecomment-580125822
Thank you @tasanuma
This is an automated message
tasanuma merged pull request #1824: YARN-9743. [JDK11]
TestTimelineWebServices.testContextFactory fails.
URL: https://github.com/apache/hadoop/pull/1824
This is an automated message from the Apache Git Service.
To respond
aajisaka commented on issue #1824: YARN-9743. [JDK11]
TestTimelineWebServices.testContextFactory fails.
URL: https://github.com/apache/hadoop/pull/1824#issuecomment-580075979
Thanks @ndimiduk for your review.
Hi @tasanuma , would you check this?
hadoop-yetus commented on issue #1635: HADOOP-16596. [pb-upgrade] Use shaded
protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#issuecomment-580035255
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime |
smengcl commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade]
Use shaded protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#discussion_r372698795
##
File path: Jenkinsfile
##
@@ -23,7 +23,8 @@ pipeline {
hadoop-yetus commented on issue #1814: HADOOP-16823. Manage S3 Throttling
exclusively in S3A client.
URL: https://github.com/apache/hadoop/pull/1814#issuecomment-580001843
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Comment |
avijayanhwx commented on a change in pull request #1819: HDFS-14989. Add a
'swapBlockList' operation to Namenode.
URL: https://github.com/apache/hadoop/pull/1819#discussion_r372649126
##
File path:
hadoop-yetus commented on issue #1814: HADOOP-16823. Manage S3 Throttling
exclusively in S3A client.
URL: https://github.com/apache/hadoop/pull/1814#issuecomment-579956366
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Comment |
vinayakumarb commented on a change in pull request #1635: HADOOP-16596.
[pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#discussion_r372589112
##
File path: Jenkinsfile
##
@@ -23,7 +23,8 @@ pipeline
steveloughran commented on issue #1814: HADOOP-16823. Manage S3 Throttling
exclusively in S3A client.
URL: https://github.com/apache/hadoop/pull/1814#issuecomment-579910544
My "little" fix to turn off retries in the AWS client causes issues in the
DDB clients where there's a
hadoop-yetus removed a comment on issue #1814: HADOOP-16823. Manage S3
Throttling exclusively in S3A client.
URL: https://github.com/apache/hadoop/pull/1814#issuecomment-579894182
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
[
https://issues.apache.org/jira/browse/HADOOP-16823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026111#comment-17026111
]
Steve Loughran commented on HADOOP-16823:
-
between prepaid IO and load;
hadoop-yetus commented on issue #1814: HADOOP-16823. Manage S3 Throttling
exclusively in S3A client.
URL: https://github.com/apache/hadoop/pull/1814#issuecomment-579894182
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
smengcl commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade]
Use shaded protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#discussion_r372541753
##
File path: Jenkinsfile
##
@@ -23,7 +23,8 @@ pipeline {
steveloughran commented on issue #1814: HADOOP-16823. Manage S3 Throttling
exclusively in S3A client.
URL: https://github.com/apache/hadoop/pull/1814#issuecomment-579868765
With retries on the scans in the test teardown (and dump/purge DDB), getting
a failure in queryVersionMarker()
Stephen O'Donnell created HADOOP-16833:
--
Summary: InstrumentedLock should log lock queue time
Key: HADOOP-16833
URL: https://issues.apache.org/jira/browse/HADOOP-16833
Project: Hadoop Common
mustafaiman commented on issue #1815: HADOOP-16801: S3Guard-listFiles will not
query s3 if all listings are…
URL: https://github.com/apache/hadoop/pull/1815#issuecomment-579847413
hey @steveloughran do you have any more comments? Can you merge?
steveloughran commented on issue #1814: HADOOP-16823. Manage S3 Throttling
exclusively in S3A client.
URL: https://github.com/apache/hadoop/pull/1814#issuecomment-579838804
...oh, and note that failure was in the SCAN operation. I'm not sure we have
enough wrapping there
steveloughran commented on issue #1814: HADOOP-16823. Manage S3 Throttling
exclusively in S3A client.
URL: https://github.com/apache/hadoop/pull/1814#issuecomment-579838332
Did manage to overload one of the DDB scale tests here -those throttling
values are clearly too low to recover from
steveloughran commented on issue #1823: HADOOP-16794 S3 Encryption key is not
getting set properly during put operation.
URL: https://github.com/apache/hadoop/pull/1823#issuecomment-579837188
How to test?
What are we trying to do? Our goal should be
* the final file is
[
https://issues.apache.org/jira/browse/HADOOP-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025960#comment-17025960
]
Mukund Thakur commented on HADOOP-16794:
Debugging details:
When a put operation is performed
hadoop-yetus commented on issue #1820: HADOOP-16830. Add public IOStatistics
API + S3A implementation
URL: https://github.com/apache/hadoop/pull/1820#issuecomment-579765329
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus commented on issue #1822: HADOOP-16832 Update S3Guard testing doc.
URL: https://github.com/apache/hadoop/pull/1822#issuecomment-579740898
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
steveloughran commented on issue #1820: HADOOP-16830. Add public IOStatistics
API + S3A implementation
URL: https://github.com/apache/hadoop/pull/1820#issuecomment-579729446
Checkstyle is all about unread stats names; I need to make sure they are in
use in S3A then change checkstyle to
bgaborg commented on issue #1822: HADOOP-16832 Update S3Guard testing doc.
URL: https://github.com/apache/hadoop/pull/1822#issuecomment-579724742
@steveloughran what do you think about adding this to the doc? It may help
people who are starting to contribute set things up more easily.
[
https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mukund Thakur updated HADOOP-16832:
---
Description:
When I tried running the S3 guard tests using my IDE, they were getting
[
https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mukund Thakur updated HADOOP-16832:
---
Affects Version/s: 3.2.1
> Add required parameters to be set in testing doc for S3Guard
bgaborg commented on a change in pull request #1815: HADOOP-16801:
S3Guard-listFiles will not query s3 if all listings are…
URL: https://github.com/apache/hadoop/pull/1815#discussion_r372317870
##
File path:
bgaborg commented on issue #1823: HADOOP-16794 S3 Encryption key is not getting
set properly during put operation.
URL: https://github.com/apache/hadoop/pull/1823#issuecomment-579683383
Please describe the steps of how to set up an env to test this: what to
configure on AWS and how.
[
https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025762#comment-17025762
]
Gabor Bota commented on HADOOP-16832:
-
Please describe what are these parameters required for, and
[
https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Bota updated HADOOP-16832:
Summary: Add required parameters to be set in testing doc for S3Guard
testing. (was: Add
bgaborg commented on issue #1822: HADOOP-16832 Update S3Guard testing doc.
URL: https://github.com/apache/hadoop/pull/1822#issuecomment-579679507
Please add this that you should set this just locally If you want to run
tests in your IDE and don't want to play with parameters passed in the
bgaborg removed a comment on issue #1822: HADOOP-16832 Update S3Guard testing
doc.
URL: https://github.com/apache/hadoop/pull/1822#issuecomment-579677549
Do not add this to the core-site.xml! It will be committed!
What I suggest is to add it to the auth-keys. That won't be committed.
bgaborg commented on issue #1822: HADOOP-16832 Update S3Guard testing doc.
URL: https://github.com/apache/hadoop/pull/1822#issuecomment-579677549
Do not add this to the core-site.xml! It will be committed!
What I suggest is to add it to the auth-keys. That won't be committed.
Please
mukund-thakur commented on issue #1822: HADOOP-16832 Update S3Guard testing doc.
URL: https://github.com/apache/hadoop/pull/1822#issuecomment-579676737
@steveloughran Yes i can use these option while running the tests using
command line. But I was trying to run using Intellij idea and i
vinayakumarb commented on issue #1635: HADOOP-16596. [pb-upgrade] Use shaded
protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#issuecomment-579666586
Thanks @aajisaka and @ayushtkn for reviews.
I have rebased and updated.
38 matches
Mail list logo
