toddlipcon commented on a change in pull request #595: HDFS-14304: High lock
contention on hdfsHashMutex in libhdfs
URL: https://github.com/apache/hadoop/pull/595#discussion_r267629514
##
File path:
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs/hdfs.c
toddlipcon commented on a change in pull request #595: HDFS-14304: High lock
contention on hdfsHashMutex in libhdfs
URL: https://github.com/apache/hadoop/pull/595#discussion_r267629008
##
File path:
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs/jni_helper.c
toddlipcon commented on a change in pull request #595: HDFS-14304: High lock
contention on hdfsHashMutex in libhdfs
URL: https://github.com/apache/hadoop/pull/595#discussion_r267629452
##
File path:
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs/hdfs.c
toddlipcon commented on a change in pull request #595: HDFS-14304: High lock
contention on hdfsHashMutex in libhdfs
URL: https://github.com/apache/hadoop/pull/595#discussion_r267628850
##
File path:
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs/jni_helper.c
toddlipcon commented on a change in pull request #595: HDFS-14304: High lock
contention on hdfsHashMutex in libhdfs
URL: https://github.com/apache/hadoop/pull/595#discussion_r267629084
##
File path:
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs/jclasses.c
toddlipcon commented on a change in pull request #595: HDFS-14304: High lock
contention on hdfsHashMutex in libhdfs
URL: https://github.com/apache/hadoop/pull/595#discussion_r267629746
##
File path:
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs/jclasses.c
arp7 commented on issue #620: HDDS-1205. Refactor ReplicationManager to handle
QUASI_CLOSED contain…
URL: https://github.com/apache/hadoop/pull/620#issuecomment-475115955
+1 LGTM.
This is an automated message from the Apache
toddlipcon commented on a change in pull request #600: HDFS-14348: Fix JNI
exception handling issues in libhdfs
URL: https://github.com/apache/hadoop/pull/600#discussion_r267627222
##
File path:
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs/hdfs.c
nandakumar131 commented on a change in pull request #620: HDDS-1205. Refactor
ReplicationManager to handle QUASI_CLOSED contain…
URL: https://github.com/apache/hadoop/pull/620#discussion_r267625595
##
File path:
[
https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797793#comment-16797793
]
Hadoop QA commented on HADOOP-16158:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote ||
[
https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kai Xie updated HADOOP-16158:
-
Attachment: HADOOP-16158-003.patch
> DistCp supports checksum validation when copy blocks in parallel
[
https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kai Xie updated HADOOP-16158:
-
Status: Patch Available (was: Open)
> DistCp supports checksum validation when copy blocks in
[
https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kai Xie updated HADOOP-16158:
-
Status: Open (was: Patch Available)
> DistCp supports checksum validation when copy blocks in
hadoop-yetus commented on issue #626: HDDS-1262. In OM HA OpenKey call Should
happen only leader OM.
URL: https://github.com/apache/hadoop/pull/626#issuecomment-475094834
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus commented on issue #626: HDDS-1262. In OM HA OpenKey call Should
happen only leader OM.
URL: https://github.com/apache/hadoop/pull/626#issuecomment-475070390
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
arp7 commented on a change in pull request #620: HDDS-1205. Refactor
ReplicationManager to handle QUASI_CLOSED contain…
URL: https://github.com/apache/hadoop/pull/620#discussion_r267588783
##
File path:
arp7 commented on a change in pull request #620: HDDS-1205. Refactor
ReplicationManager to handle QUASI_CLOSED contain…
URL: https://github.com/apache/hadoop/pull/620#discussion_r267587317
##
File path:
arp7 commented on a change in pull request #620: HDDS-1205. Refactor
ReplicationManager to handle QUASI_CLOSED contain…
URL: https://github.com/apache/hadoop/pull/620#discussion_r267578782
##
File path:
hadoop-yetus commented on issue #626: HDDS-1262. In OM HA OpenKey call Should
happen only leader OM.
URL: https://github.com/apache/hadoop/pull/626#issuecomment-475068755
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus commented on issue #630: HADOOP-15999 improve test resilience and
probes
URL: https://github.com/apache/hadoop/pull/630#issuecomment-475066452
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus commented on issue #627: HDDS-1299. Support TokenIssuer interface
for running jobs with OzoneFileSystem.
URL: https://github.com/apache/hadoop/pull/627#issuecomment-475064798
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
steveloughran commented on issue #630: HADOOP-15999 improve test resilience and
probes
URL: https://github.com/apache/hadoop/pull/630#issuecomment-475038919
Tested: S3 ireland w/ DDB in both parallel and standalone runs, DDB set up
for PAYG.
```
-Dparallel-tests
steveloughran commented on issue #624: HADOOP-15999. S3Guard: Better support
for out-of-band operations
URL: https://github.com/apache/hadoop/pull/624#issuecomment-475037885
Given I've seen the failure in a standalone run, it's not FS caching somehow
meaning raw has picked up a DDB table.
steveloughran opened a new pull request #630: HADOOP-15999 improve test
resilience and probes
URL: https://github.com/apache/hadoop/pull/630
HADOOP-15999 improve test resilience and probes
* Add delays long enough for timestamps to be different
* Add delays for S3 to stabilize
[
https://issues.apache.org/jira/browse/HADOOP-15978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797579#comment-16797579
]
Hadoop QA commented on HADOOP-15978:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote ||
[
https://issues.apache.org/jira/browse/HADOOP-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797576#comment-16797576
]
Daryn Sharp commented on HADOOP-16144:
--
Thanks [~anu]! The abysmal scalability is impacting
[
https://issues.apache.org/jira/browse/HADOOP-15978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797573#comment-16797573
]
Daryn Sharp commented on HADOOP-15978:
--
If all goes well in this/next week's deploy, I'll begin
[
https://issues.apache.org/jira/browse/HADOOP-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797572#comment-16797572
]
Anu Engineer commented on HADOOP-16144:
---
[~daryn] I thought someone like [~jojochuang] was
[
https://issues.apache.org/jira/browse/HADOOP-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anu Engineer reassigned HADOOP-16144:
-
Assignee: Anu Engineer
> Create a Hadoop RPC based KMS client
>
[
https://issues.apache.org/jira/browse/HADOOP-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797566#comment-16797566
]
Daryn Sharp commented on HADOOP-16144:
--
[~anu], at the LinkedIn meetup I believe you said it would
[
https://issues.apache.org/jira/browse/HADOOP-16130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797558#comment-16797558
]
Daryn Sharp commented on HADOOP-16130:
--
The problem was accumulation of tokens not being
hadoop-yetus commented on issue #627: HDDS-1299. Support TokenIssuer interface
for running jobs with OzoneFileSystem.
URL: https://github.com/apache/hadoop/pull/627#issuecomment-475019326
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus commented on issue #627: HDDS-1299. Support TokenIssuer interface
for running jobs with OzoneFileSystem.
URL: https://github.com/apache/hadoop/pull/627#issuecomment-475001007
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus commented on issue #620: HDDS-1205. Refactor ReplicationManager to
handle QUASI_CLOSED contain…
URL: https://github.com/apache/hadoop/pull/620#issuecomment-474998376
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
steveloughran commented on issue #624: HADOOP-15999. S3Guard: Better support
for out-of-band operations
URL: https://github.com/apache/hadoop/pull/624#issuecomment-474985340
and I've managed to do it in a single test run. There's some intermittent
issue going on here. It could just be
hadoop-yetus commented on issue #629: HDDS-1302. Fix SCM CLI does not list
container with id 1
URL: https://github.com/apache/hadoop/pull/629#issuecomment-474979550
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
[
https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797402#comment-16797402
]
Hadoop QA commented on HADOOP-16158:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote ||
[
https://issues.apache.org/jira/browse/HADOOP-15482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-15482:
Component/s: build
> Upgrade jackson-databind to version 2.9.5
>
[
https://issues.apache.org/jira/browse/HADOOP-15482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-15482:
Affects Version/s: 3.1.0
> Upgrade jackson-databind to version 2.9.5
>
[
https://issues.apache.org/jira/browse/HADOOP-15960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Bota updated HADOOP-15960:
Affects Version/s: 3.3.0
> Update guava to 27.0-jre in hadoop-common
>
[
https://issues.apache.org/jira/browse/HADOOP-15960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Bota updated HADOOP-15960:
Priority: Critical (was: Major)
> Update guava to 27.0-jre in hadoop-common
>
[
https://issues.apache.org/jira/browse/HADOOP-15960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HADOOP-15960 started by Gabor Bota.
---
> Update guava to 27.0-jre in hadoop-common
>
ajfabbri commented on issue #577: HADOOP-16058 S3A to support terasort
URL: https://github.com/apache/hadoop/pull/577#issuecomment-474952523
Yep +1 for you to commit it with a local re-test. Thanks for the
contribution. Also thanks for the smart-apply-patch tip!
vivekratnavel opened a new pull request #629: HDDS-1302. Fix SCM CLI does not
list container with id 1
URL: https://github.com/apache/hadoop/pull/629
This PR aims to avoid the contradiction with JavaDoc after the fix in
HDDS-1263.
https://issues.apache.org/jira/browse/HDDS-1302
[
https://issues.apache.org/jira/browse/HADOOP-16203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797378#comment-16797378
]
Gabor Bota commented on HADOOP-16203:
-
I've seen these errors. We have a failure tracker to track
[
https://issues.apache.org/jira/browse/HADOOP-16203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797355#comment-16797355
]
Steve Loughran commented on HADOOP-16203:
-
{code}
[ERROR]
[
https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kai Xie updated HADOOP-16158:
-
Status: Open (was: Patch Available)
> DistCp supports checksum validation when copy blocks in
[
https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kai Xie updated HADOOP-16158:
-
Attachment: HADOOP-16158-002.patch
> DistCp supports checksum validation when copy blocks in parallel
[
https://issues.apache.org/jira/browse/HADOOP-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kai Xie updated HADOOP-16158:
-
Status: Patch Available (was: Open)
> DistCp supports checksum validation when copy blocks in
Steve Loughran created HADOOP-16203:
---
Summary: ITestS3AContractGetFileStatusV1List may have consistency
issues
Key: HADOOP-16203
URL: https://issues.apache.org/jira/browse/HADOOP-16203
Project:
[
https://issues.apache.org/jira/browse/HADOOP-16138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797327#comment-16797327
]
Gabor Bota commented on HADOOP-16138:
-
So the issue is that in fs.shell.Command.java:250 we call
steveloughran commented on issue #624: HADOOP-15999. S3Guard: Better support
for out-of-band operations
URL: https://github.com/apache/hadoop/pull/624#issuecomment-474916844
This test is working for me standalone, but when run in a parallel set, its
failing
```
[INFO] Tests run: 12,
[
https://issues.apache.org/jira/browse/HADOOP-16138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797191#comment-16797191
]
Gabor Bota commented on HADOOP-16138:
-
Some update on this: I managed to reproduce the issue via
[
https://issues.apache.org/jira/browse/HADOOP-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797184#comment-16797184
]
Gabor Bota commented on HADOOP-16132:
-
I tried to apply your latest patch (v005) to trunk, but it
[
https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797173#comment-16797173
]
Gabor Bota commented on HADOOP-16085:
-
Hi [~ben.roling]! Thanks for working on this.
h3.
[
https://issues.apache.org/jira/browse/HADOOP-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797181#comment-16797181
]
Gabor Bota commented on HADOOP-16132:
-
Hi [~justin.uang] it turned out that *you can create and
hadoop-yetus commented on issue #628: HADOOP-16186. NPE in
ITestS3AFileSystemContract teardown in DynamoDBMetadataStore.lambda$listChildren
URL: https://github.com/apache/hadoop/pull/628#issuecomment-474802018
:broken_heart: **-1 overall**
| Vote | Subsystem |
[
https://issues.apache.org/jira/browse/HADOOP-16156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797092#comment-16797092
]
Daniel Templeton commented on HADOOP-16156:
---
The latest patch LGTM. I'll do a more careful
[
https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-16201:
Summary: S3AFileSystem#innerMkdirs builds needless lists (was:
[
https://issues.apache.org/jira/browse/HADOOP-16186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797053#comment-16797053
]
Gabor Bota commented on HADOOP-16186:
-
I've just put up a new pr with my proposed solution.
> NPE
bgaborg opened a new pull request #628: HADOOP-16186. NPE in
ITestS3AFileSystemContract teardown in DynamoDBMetadataStore.lambda$listChildren
URL: https://github.com/apache/hadoop/pull/628
This is an automated message from
[
https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796999#comment-16796999
]
Gabor Bota commented on HADOOP-16201:
-
Thanks [~ste...@apache.org] for clarifying this.
[~ljain]
[
https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797001#comment-16797001
]
Lokesh Jain commented on HADOOP-16201:
--
[~ste...@apache.org] [~gabor.bota] I will submit a PR
[
https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796999#comment-16796999
]
Gabor Bota edited comment on HADOOP-16201 at 3/20/19 10:08 AM:
---
Thanks
[
https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-16201:
Summary: S3AFileSystem#innerMkdirs does not create parent directories;
builds needless
[
https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-16201:
Issue Type: Sub-task (was: Bug)
Parent: HADOOP-15620
>
[
https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-16201:
Priority: Minor (was: Major)
> S3AFileSystem#innerMkdirs does not create parent
[
https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reopened HADOOP-16201:
-
> S3AFileSystem#innerMkdirs does not create parent directories
>
[
https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796989#comment-16796989
]
Steve Loughran commented on HADOOP-16201:
-
Looks like you are both right
* the dir stuff is
[
https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Bota resolved HADOOP-16201.
-
Resolution: Invalid
> S3AFileSystem#innerMkdirs does not create parent directories
>
[
https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796964#comment-16796964
]
Lokesh Jain commented on HADOOP-16201:
--
[~gabor.bota] Thanks for providing the link! I agree with
Steve Loughran created HADOOP-16202:
---
Summary: S3A openFile() operation to support explicit versionID,
etag parameters
Key: HADOOP-16202
URL: https://issues.apache.org/jira/browse/HADOOP-16202
[
https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796950#comment-16796950
]
Gabor Bota commented on HADOOP-16201:
-
Closing this as invalid.
> S3AFileSystem#innerMkdirs does
[
https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796947#comment-16796947
]
Gabor Bota commented on HADOOP-16201:
-
That's because there's no such thing as directory in S3.
Lokesh Jain created HADOOP-16201:
Summary: S3AFileSystem#innerMkdirs does not create parent
directories
Key: HADOOP-16201
URL: https://issues.apache.org/jira/browse/HADOOP-16201
Project: Hadoop
hadoop-yetus commented on issue #627: HDDS-1299. Support TokenIssuer interface
for running jobs with OzoneFileSystem.
URL: https://github.com/apache/hadoop/pull/627#issuecomment-474749634
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus commented on issue #627: HDDS-1299. Support TokenIssuer interface
for running jobs with OzoneFileSystem.
URL: https://github.com/apache/hadoop/pull/627#issuecomment-474699109
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
77 matches
Mail list logo
