steveloughran commented on a change in pull request #1208: HADOOP-16423.
S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#discussion_r316658728
##
File path:
hadoop-tools/hadoop-aws/src/main/java/org/apache/
steveloughran commented on a change in pull request #1208: HADOOP-16423.
S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#discussion_r316661259
##
File path:
hadoop-tools/hadoop-aws/src/main/java/org/apache/
steveloughran commented on a change in pull request #1208: HADOOP-16423.
S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#discussion_r321797720
##
File path:
hadoop-tools/hadoop-aws/src/main/java/org/apache/
steveloughran commented on a change in pull request #1208: HADOOP-16423.
S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#discussion_r316658314
##
File path:
hadoop-tools/hadoop-aws/src/test/java/org/apache/
steveloughran commented on a change in pull request #1208: HADOOP-16423.
S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#discussion_r31480
##
File path:
hadoop-tools/hadoop-aws/src/test/java/org/apache/
steveloughran commented on a change in pull request #1208: HADOOP-16423.
S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#discussion_r316662402
##
File path:
hadoop-tools/hadoop-aws/src/main/java/org/apache/
steveloughran commented on a change in pull request #1208: HADOOP-16423.
S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#discussion_r316658848
##
File path:
hadoop-tools/hadoop-aws/src/main/java/org/apache/
steveloughran commented on a change in pull request #1208: HADOOP-16423.
S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#discussion_r316663381
##
File path:
hadoop-tools/hadoop-aws/src/main/java/org/apache/
steveloughran commented on a change in pull request #1208: HADOOP-16423.
S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#discussion_r316668834
##
File path:
hadoop-tools/hadoop-aws/src/test/java/org/apache/
steveloughran commented on a change in pull request #1208: HADOOP-16423.
S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#discussion_r316665134
##
File path:
hadoop-tools/hadoop-aws/src/main/java/org/apache/
steveloughran commented on a change in pull request #1208: HADOOP-16423.
S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#discussion_r316660993
##
File path:
hadoop-tools/hadoop-aws/src/main/java/org/apache/
hadoop-yetus removed a comment on issue #1208: HADOOP-16423. S3Guard fsck:
Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-519328085
:broken_heart: **-1 overall**
| Vote | Subsystem | Runti
hadoop-yetus removed a comment on issue #1208: HADOOP-16423. S3Guard fsck:
Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-519066905
:broken_heart: **-1 overall**
| Vote | Subsystem | Runti
hadoop-yetus removed a comment on issue #1208: HADOOP-16423. S3Guard fsck:
Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-519107957
:broken_heart: **-1 overall**
| Vote | Subsystem | Runti
hadoop-yetus removed a comment on issue #1208: HADOOP-16423. S3Guard fsck:
Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-517485581
:broken_heart: **-1 overall**
| Vote | Subsystem | Runti
hadoop-yetus removed a comment on issue #1208: HADOOP-16423. S3Guard fsck:
Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-523021479
:broken_heart: **-1 overall**
| Vote | Subsystem | Runti
hadoop-yetus removed a comment on issue #1208: HADOOP-16423. S3Guard fsck:
Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-522066549
:broken_heart: **-1 overall**
| Vote | Subsystem | Runti
steveloughran commented on issue #1208: HADOOP-16423. S3Guard fsck: Check
metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528905689
Overall then, last iteration has a working CLI
* One of the tests is brittle in paralle
hadoop-yetus commented on issue #1208: HADOOP-16423. S3Guard fsck: Check
metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528899723
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Co
hadoop-yetus commented on issue #1208: HADOOP-16423. S3Guard fsck: Check
metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528896491
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Co
steveloughran edited a comment on issue #1208: HADOOP-16423. S3Guard fsck:
Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528894617
OK, latest review is good with etags; modtime is something we can worry
about as a
steveloughran commented on issue #1208: HADOOP-16423. S3Guard fsck: Check
metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528894617
OK, latest review is good with etags; modtime is something we can worry
about as an extra
hadoop-yetus commented on issue #1208: HADOOP-16423. S3Guard fsck: Check
metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528884183
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Co
steveloughran commented on issue #1208: HADOOP-16423. S3Guard fsck: Check
metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528883425
The testCLIFsckWithParam test works standalone. Looks to me like a race
condition -the fs
steveloughran commented on issue #1208: HADOOP-16423. S3Guard fsck: Check
metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528873116
and
```
[ERROR] Tests run: 12, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
25
hadoop-yetus commented on issue #1410: HDDS-2076. Read fails because the block
cannot be located in the container
URL: https://github.com/apache/hadoop/pull/1410#issuecomment-528872753
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
|:---
steveloughran commented on issue #1208: HADOOP-16423. S3Guard fsck: Check
metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528871326
got a test run failure in a new test
```
testCLIFsckWithParam(org.apache.hadoop.fs.
steveloughran commented on issue #1208: HADOOP-16423. S3Guard fsck: Check
metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528867021
Did another test run on an unversioned bucket where the the DDB table was
built up with a
steveloughran commented on issue #1208: HADOOP-16423. S3Guard fsck: Check
metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528866219
e.g
```
bin/hadoop s3guard fsck -check
s3a://hwdev-steve-ireland-new/etc/hadoop/she
steveloughran commented on issue #1208: HADOOP-16423. S3Guard fsck: Check
metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528864203
OK, latest patch is better.
* still warns of no etag on a dir;
* when you pass a pa
steveloughran edited a comment on issue #1208: HADOOP-16423. S3Guard fsck:
Check metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528858428
working on the CLI, but overreporting errors, especially on versioning
Scan
steveloughran commented on issue #1208: HADOOP-16423. S3Guard fsck: Check
metadata consistency between S3 and metadatastore (log)
URL: https://github.com/apache/hadoop/pull/1208#issuecomment-528858428
working on the CLI, but overreporting errors, especially on versioning
Warns of no
hadoop-yetus commented on issue #1364: HDDS-1843. Undetectable corruption after
restart of a datanode.
URL: https://github.com/apache/hadoop/pull/1364#issuecomment-528848045
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
|::|
bshashikant opened a new pull request #1410: HDDS-2076. Read fails because the
block cannot be located in the container
URL: https://github.com/apache/hadoop/pull/1410
This is an automated message from the Apache Git Service
[
https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924193#comment-16924193
]
Vinayakumar B commented on HADOOP-13363:
It took > 2hrs to come to stage of ver
bshashikant opened a new pull request #1364: HDDS-1843. Undetectable corruption
after restart of a datanode.
URL: https://github.com/apache/hadoop/pull/1364
This is an automated message from the Apache Git Service.
To respon
[
https://issues.apache.org/jira/browse/HADOOP-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924149#comment-16924149
]
Steve Loughran commented on HADOOP-16552:
-
I don't see that much in terms of me
bshashikant closed pull request #1364: HDDS-1843. Undetectable corruption after
restart of a datanode.
URL: https://github.com/apache/hadoop/pull/1364
This is an automated message from the Apache Git Service.
To respond to t
[
https://issues.apache.org/jira/browse/HADOOP-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-16552:
Parent: HADOOP-15763
Issue Type: Sub-task (was: Task)
> ABFS: Send ReadAhead fea
[
https://issues.apache.org/jira/browse/HADOOP-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924119#comment-16924119
]
Zhankun Tang commented on HADOOP-15958:
---
[~aajisaka], Thanks for the great work!
nandakumar131 commented on issue #1364: HDDS-1843. Undetectable corruption
after restart of a datanode.
URL: https://github.com/apache/hadoop/pull/1364#issuecomment-528781001
@bshashikant you might need to rebase the changes on top of HDDS-1561. Even
though there is no conflict, the compil
Sneha Vijayarajan created HADOOP-16552:
--
Summary: ABFS: Send ReadAhead feature utilization metrics to server
Key: HADOOP-16552
URL: https://issues.apache.org/jira/browse/HADOOP-16552
Project: Hado
nandakumar131 commented on a change in pull request #1364: HDDS-1843.
Undetectable corruption after restart of a datanode.
URL: https://github.com/apache/hadoop/pull/1364#discussion_r321645502
##
File path:
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/contain
nandakumar131 commented on issue #1356: HADOOP-16534. Exclude submarine from
hadoop source build.
URL: https://github.com/apache/hadoop/pull/1356#issuecomment-528775787
@sunilgovind Jenkins ran for this PR, but the result wasn't published. Not
sure why.
PR build: https://builds.apac
sunilgovind commented on issue #1356: HADOOP-16534. Exclude submarine from
hadoop source build.
URL: https://github.com/apache/hadoop/pull/1356#issuecomment-528771577
@nandakumar131 do u know why jenkins is not running ?
Th
[
https://issues.apache.org/jira/browse/HADOOP-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924058#comment-16924058
]
Gabor Bota commented on HADOOP-16550:
-
Merged PR #9
> Spark config name error on t
[
https://issues.apache.org/jira/browse/HADOOP-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Bota resolved HADOOP-16550.
-
Resolution: Fixed
> Spark config name error on the Launching Applications Using Docker Containe
nandakumar131 commented on a change in pull request #1344: HDDS-1982 Extend
SCMNodeManager to support decommission and maintenance states
URL: https://github.com/apache/hadoop/pull/1344#discussion_r321626983
##
File path:
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/
nandakumar131 commented on a change in pull request #1344: HDDS-1982 Extend
SCMNodeManager to support decommission and maintenance states
URL: https://github.com/apache/hadoop/pull/1344#discussion_r321626983
##
File path:
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/
[
https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924038#comment-16924038
]
Vinayakumar B commented on HADOOP-13363:
{quote}[~anu] about the build failure,
[
https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924033#comment-16924033
]
Vinayakumar B commented on HADOOP-13363:
Initial commit I forgot about updatin
sodonnel commented on a change in pull request #1344: HDDS-1982 Extend
SCMNodeManager to support decommission and maintenance states
URL: https://github.com/apache/hadoop/pull/1344#discussion_r321616777
##
File path:
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/n
nandakumar131 merged pull request #1401: HDDS-1561: Mark OPEN containers as
QUASI_CLOSED as part of Ratis groupRemove
URL: https://github.com/apache/hadoop/pull/1401
This is an automated message from the Apache Git Service.
nandakumar131 commented on issue #1401: HDDS-1561: Mark OPEN containers as
QUASI_CLOSED as part of Ratis groupRemove
URL: https://github.com/apache/hadoop/pull/1401#issuecomment-528749936
Test failures are not related.
This i
101 - 154 of 154 matches
Mail list logo