swagle commented on a change in pull request #46: HDDS-2286. Add a log info in
ozone client and scm to print the exclus…
URL: https://github.com/apache/hadoop-ozone/pull/46#discussion_r335818232
##
File path:
adoroszlai commented on a change in pull request #46: HDDS-2286. Add a log info
in ozone client and scm to print the exclus…
URL: https://github.com/apache/hadoop-ozone/pull/46#discussion_r335815224
##
File path:
swagle opened a new pull request #46: HDDS-2286. Add a log info in ozone client
and scm to print the exclus…
URL: https://github.com/apache/hadoop-ozone/pull/46
## What changes were proposed in this pull request?
Added additional logging to print exclude lists on client and SCM
szetszwo opened a new pull request #45: HDDS-2275. In
BatchOperation.SingleOperation, do not clone byte[].
URL: https://github.com/apache/hadoop-ozone/pull/45
See https://issues.apache.org/jira/browse/HDDS-2275
This is an
szetszwo merged pull request #44: HDDS-2271. Avoid buffer copying in
KeyValueHandler.
URL: https://github.com/apache/hadoop-ozone/pull/44
This is an automated message from the Apache Git Service.
To respond to the message,
szetszwo opened a new pull request #44: HDDS-2271. Avoid buffer copying in
KeyValueHandler.
URL: https://github.com/apache/hadoop-ozone/pull/44
Migrated from https://github.com/apache/hadoop/pull/1625
See https://issues.apache.org/jira/browse/HDDS-2271
timmylicheng commented on a change in pull request #28: HDDS-1569 Support
creating multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335793351
##
File path:
timmylicheng commented on a change in pull request #28: HDDS-1569 Support
creating multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335793270
##
File path:
timmylicheng commented on a change in pull request #28: HDDS-1569 Support
creating multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335792538
##
File path:
timmylicheng commented on a change in pull request #28: HDDS-1569 Support
creating multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335792254
##
File path:
timmylicheng commented on a change in pull request #28: HDDS-1569 Support
creating multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335792190
##
File path:
timmylicheng commented on a change in pull request #28: HDDS-1569 Support
creating multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335791972
##
File path: hadoop-hdds/common/src/main/resources/ozone-default.xml
##
@@
timmylicheng commented on a change in pull request #28: HDDS-1569 Support
creating multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335785884
##
File path:
Hi folks,
This is the first release candidate for the first release of Apache Hadoop
2.10 line. It contains 361 fixes/improvements since 2.9 [1]. It includes
features such as:
- User-defined resource types
- Native GPU support as a schedulable resource type
- Consistent reads from standby node
-
I've moved all jiras with target version 2.10.0 to 2.10.1. Also I've
created branch-2.10 and branch-2.10.0, please commit any 2.10.x bug fixes
to branch-2.10.
I'll send out a vote thread for 2.10.0-RC0 shortly.
Jonathan Hung
On Fri, Oct 11, 2019 at 10:32 AM Jonathan Hung wrote:
> Edit: seems
vivekratnavel commented on issue #43: HDDS-2181. Ozone Manager should send
correct ACL type in ACL requests…
URL: https://github.com/apache/hadoop-ozone/pull/43#issuecomment-542942274
@xiaoyuyao Pls review
This is an
vivekratnavel opened a new pull request #43: HDDS-2181. Ozone Manager should
send correct ACL type in ACL requests…
URL: https://github.com/apache/hadoop-ozone/pull/43
… to Authorizer
## What changes were proposed in this pull request?
The ACL types sent to authorizers is
[
https://issues.apache.org/jira/browse/HDDS-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anu Engineer resolved HDDS-2302.
Fix Version/s: 0.5.0
Resolution: Fixed
> Manage common pom versions in one common place
>
anuengineer commented on issue #21: HDDS-2302. Manage common pom versions in
one common place
URL: https://github.com/apache/hadoop-ozone/pull/21#issuecomment-542933249
Thank you for the contribution. I have committed this patch to the master.
anuengineer closed pull request #21: HDDS-2302. Manage common pom versions in
one common place
URL: https://github.com/apache/hadoop-ozone/pull/21
This is an automated message from the Apache Git Service.
To respond to the
[
https://issues.apache.org/jira/browse/HDDS-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anu Engineer resolved HDDS-2289.
Resolution: Fixed
> Put testing information and a problem description to the github PR template
>
anuengineer merged pull request #5: HDDS-2289. Put testing information and a
problem description to the g…
URL: https://github.com/apache/hadoop-ozone/pull/5
This is an automated message from the Apache Git Service.
To
vivekratnavel commented on issue #5: HDDS-2289. Put testing information and a
problem description to the g…
URL: https://github.com/apache/hadoop-ozone/pull/5#issuecomment-542889844
+1 LGTM
This is an automated message from
avijayanhwx closed pull request #42: Update pull_request_template.md
URL: https://github.com/apache/hadoop-ozone/pull/42
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
avijayanhwx commented on issue #42: Update pull_request_template.md
URL: https://github.com/apache/hadoop-ozone/pull/42#issuecomment-542889556
Thanks @adoroszlai. I will close this.
This is an automated message from the
vivekratnavel commented on issue #42: Update pull_request_template.md
URL: https://github.com/apache/hadoop-ozone/pull/42#issuecomment-542889407
Yes, #5 is not merged yet. We can close this PR and merge #5.
This is an
adoroszlai edited a comment on issue #42: Update pull_request_template.md
URL: https://github.com/apache/hadoop-ozone/pull/42#issuecomment-542887995
This ~was~ is already being done in #5.
This is an automated message from
adoroszlai commented on issue #42: Update pull_request_template.md
URL: https://github.com/apache/hadoop-ozone/pull/42#issuecomment-542887995
This was already done in #5, was it lost during the forced update?
This is an
anuengineer commented on issue #42: Update pull_request_template.md
URL: https://github.com/apache/hadoop-ozone/pull/42#issuecomment-542885560
We need a JIRA number to commit anything into the branch. So you will have
to file a JIRA and refer to that in the pull request. and it might be a
avijayanhwx opened a new pull request #42: Update pull_request_template.md
URL: https://github.com/apache/hadoop-ozone/pull/42
Update Pull Request Template
This is an automated message from the Apache Git Service.
To respond
anuengineer commented on issue #41: HDDS-2283. Container Creation on datanodes
take around 300ms due to rocksdb creation.
URL: https://github.com/apache/hadoop-ozone/pull/41#issuecomment-542881435
Can we please use the Ambari inspired template?
With info like -- a link to the HDDS
swagle commented on issue #23: HDDS-1868. Ozone pipelines should be marked as
ready only after the leader election is complete.
URL: https://github.com/apache/hadoop-ozone/pull/23#issuecomment-542869954
Thank you @mukul1987 and @nandakumar131 for the reviews.
swagle commented on a change in pull request #23: HDDS-1868. Ozone pipelines
should be marked as ready only after the leader election is complete.
URL: https://github.com/apache/hadoop-ozone/pull/23#discussion_r335654846
##
File path:
swagle commented on a change in pull request #23: HDDS-1868. Ozone pipelines
should be marked as ready only after the leader election is complete.
URL: https://github.com/apache/hadoop-ozone/pull/23#discussion_r335654846
##
File path:
swagle commented on a change in pull request #23: HDDS-1868. Ozone pipelines
should be marked as ready only after the leader election is complete.
URL: https://github.com/apache/hadoop-ozone/pull/23#discussion_r335654012
##
File path:
avijayanhwx commented on issue #41: HDDS-2283. Container Creation on datanodes
take around 300ms due to rocksdb creation.
URL: https://github.com/apache/hadoop-ozone/pull/41#issuecomment-542818462
A good find. LGTM +1
This
Siddharth Wagle created HDDS-2317:
-
Summary: Change rocksDB per Container model to have table per
container on RocksDb per disk
Key: HDDS-2317
URL: https://issues.apache.org/jira/browse/HDDS-2317
Here's today's notes for future reference:
https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit?usp=sharing
10/16/2019
Attendee:
Weichiu, Cynthia, Craig, Stephen, Akira, David
Stephen introduced upgrade domain, which was developed at Twitter. Cloudera
is going to
swagle opened a new pull request #41: HDDS-2283. Container Creation on
datanodes take around 300ms due to rocksdb creation.
URL: https://github.com/apache/hadoop-ozone/pull/41
Container Creation on datanodes take around 300ms due to rocksdb creation.
Rocksdb creation is taking a
hanishakoneru opened a new pull request #40: HDDS-2285. GetBlock and ReadChunk
command from the client should be s…
URL: https://github.com/apache/hadoop-ozone/pull/40
It can be observed that the GetBlock and ReadChunk command is sent to 2
different datanodes. It should be sent to the
bharatviswa504 commented on issue #27: HDDS-2278. Run S3 test suite on OM HA
cluster.
URL: https://github.com/apache/hadoop-ozone/pull/27#issuecomment-542800119
> +1 thanks the patch @bharatviswa504
>
> Note: While I am happy to have more and more environments, I feel that
it's
bharatviswa504 commented on issue #27: HDDS-2278. Run S3 test suite on OM HA
cluster.
URL: https://github.com/apache/hadoop-ozone/pull/27#issuecomment-542799585
Thank You @elek for the review.
I see newly acceptance tests are passing. Let me know if you still see
errors in your local
avijayanhwx opened a new pull request #31: HDDS-2254. Fix flaky unit test
TestContainerStateMachine#testRatisSn…
URL: https://github.com/apache/hadoop-ozone/pull/31
…apshotRetention.
## What changes were proposed in this pull request?
On locally trying out repeated runs of the
avijayanhwx commented on issue #31: HDDS-2254. Fix flaky unit test
TestContainerStateMachine#testRatisSn…
URL: https://github.com/apache/hadoop-ozone/pull/31#issuecomment-542797782
> Thanks the PR @avijayanhwx. As far as I see it includes additional
commits. Can you please try to rebase
avijayanhwx closed pull request #31: HDDS-2254. Fix flaky unit test
TestContainerStateMachine#testRatisSn…
URL: https://github.com/apache/hadoop-ozone/pull/31
This is an automated message from the Apache Git Service.
To
[
https://issues.apache.org/jira/browse/HDDS-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jitendra Nath Pandey reopened HDDS-2181:
The pull request is still open.
> Ozone Manager should send correct ACL type in ACL
nandakumar131 commented on a change in pull request #23: HDDS-1868. Ozone
pipelines should be marked as ready only after the leader election is complete.
URL: https://github.com/apache/hadoop-ozone/pull/23#discussion_r335543661
##
File path:
nandakumar131 commented on a change in pull request #23: HDDS-1868. Ozone
pipelines should be marked as ready only after the leader election is complete.
URL: https://github.com/apache/hadoop-ozone/pull/23#discussion_r335553429
##
File path:
nandakumar131 commented on a change in pull request #23: HDDS-1868. Ozone
pipelines should be marked as ready only after the leader election is complete.
URL: https://github.com/apache/hadoop-ozone/pull/23#discussion_r335533998
##
File path:
cxorm commented on issue #2: HDDS-1737. Add Volume check in KeyManager and File
Operations.
URL: https://github.com/apache/hadoop-ozone/pull/2#issuecomment-542723039
Thanks @bharatviswa504 and @jojochuang for the review.
Thanks @elek for the commit.
Gentle reminder: community sync happening in 3 hours.
On Mon, Oct 14, 2019 at 9:07 AM Wei-Chiu Chuang wrote:
> Hadoop devs,
>
> This Wednesday (PDT 10am, EDT 1pm, BST 6pm, CEST 7pm), @Stephen O'Donnell
> is going to share with us the projects he's
> spent most time on recently, DataNode
[
https://issues.apache.org/jira/browse/HDDS-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anu Engineer resolved HDDS-2316.
Fix Version/s: 0.5.0
Resolution: Fixed
Committed to the master.
> Support to skip recon
anuengineer merged pull request #39: HDDS-2316. Support to skip recon and/or
ozonefs during the build
URL: https://github.com/apache/hadoop-ozone/pull/39
This is an automated message from the Apache Git Service.
To respond
anuengineer commented on issue #39: HDDS-2316. Support to skip recon and/or
ozonefs during the build
URL: https://github.com/apache/hadoop-ozone/pull/39#issuecomment-542712298
Thank you for getting this done. Appreciate it.
elek commented on issue #31: HDDS-2254. Fix flaky unit test
TestContainerStateMachine#testRatisSn…
URL: https://github.com/apache/hadoop-ozone/pull/31#issuecomment-542694071
Thanks the PR @avijayanhwx. As far as I see it includes additional commits.
Can you please try to rebase it to
For more details, see
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/476/
[Oct 15, 2019 3:52:25 PM] (ericp) YARN-8750. Refactor TestQueueMetrics.
(Contributed by Szilard Nemeth)
[Oct 15, 2019 5:01:45 PM] (jhung) Preparing for 2.11.0 development
[Oct 16, 2019 12:40:29 AM]
elek closed pull request #2: HDDS-1737. Add Volume check in KeyManager and File
Operations.
URL: https://github.com/apache/hadoop-ozone/pull/2
This is an automated message from the Apache Git Service.
To respond to the
elek commented on issue #27: HDDS-2278. Run S3 test suite on OM HA cluster.
URL: https://github.com/apache/hadoop-ozone/pull/27#issuecomment-542677287
UPDATE: it's failing during my local test all the time. the ozones3 is
working but not the new tests. Let's try to request a new test
elek commented on issue #27: HDDS-2278. Run S3 test suite on OM HA cluster.
URL: https://github.com/apache/hadoop-ozone/pull/27#issuecomment-542677319
/retest
This is an automated message from the Apache Git Service.
To
elek opened a new pull request #39: HDDS-2316. Support to skip recon and/or
ozonefs during the build
URL: https://github.com/apache/hadoop-ozone/pull/39
## What changes were proposed in this pull request?
The two slowest part of Ozone build as of now:
* The (multiple)
Marton Elek created HDDS-2316:
-
Summary: Support to skip recon and/or ozonefs during the build
Key: HDDS-2316
URL: https://issues.apache.org/jira/browse/HDDS-2316
Project: Hadoop Distributed Data Store
[
https://issues.apache.org/jira/browse/HDDS-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Doroszlai resolved HDDS-2313.
Resolution: Invalid
Fixed by revert: https://github.com/apache/hadoop-ozone/commit/17081c2e
[
https://issues.apache.org/jira/browse/HDDS-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Doroszlai resolved HDDS-2315.
Resolution: Invalid
Fixed by revert: https://github.com/apache/hadoop-ozone/commit/17081c2e
adoroszlai commented on issue #35: HDDS-2313. Duplicate release of lock in
OMKeyCommitRequest
URL: https://github.com/apache/hadoop-ozone/pull/35#issuecomment-542666371
Fixed by revert: 17081c2e
This is an automated message
adoroszlai closed pull request #35: HDDS-2313. Duplicate release of lock in
OMKeyCommitRequest
URL: https://github.com/apache/hadoop-ozone/pull/35
This is an automated message from the Apache Git Service.
To respond to the
[
https://issues.apache.org/jira/browse/HDDS-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marton Elek resolved HDDS-2312.
---
Fix Version/s: 0.5.0
Resolution: Fixed
> Fix typo in ozone command
> -
elek closed pull request #34: HDDS-2312. Fix typo in ozone command
URL: https://github.com/apache/hadoop-ozone/pull/34
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
adoroszlai commented on issue #8: HDDS-2267. Container metadata scanner
interval mismatch
URL: https://github.com/apache/hadoop-ozone/pull/8#issuecomment-542651011
Thanks @xiaoyuyao for the review. Thanks @elek for reviewing and committing
it. I like your idea about using type-safe time
elek commented on issue #33: HDDS-1985. Fix listVolumes API
URL: https://github.com/apache/hadoop-ozone/pull/33#issuecomment-542650306
Oh, sorry I am confused. This is the listVolume. I accidentally close it.
This is an
bharatviswa504 opened a new pull request #33: HDDS-1985. Fix listVolumes API
URL: https://github.com/apache/hadoop-ozone/pull/33
https://issues.apache.org/jira/browse/HDDS-1985
No fix is required for this, as the information is retrieved from the MPU
Key table, this information is
elek closed pull request #33: HDDS-1985. Fix listVolumes API
URL: https://github.com/apache/hadoop-ozone/pull/33
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
elek commented on issue #33: HDDS-1985. Fix listVolumes API
URL: https://github.com/apache/hadoop-ozone/pull/33#issuecomment-542650094
Merged in 5adf6a1e3175e2a583eea0d2384ed1f8e11da57b
This is an automated message from the
elek removed a comment on issue #33: HDDS-1985. Fix listVolumes API
URL: https://github.com/apache/hadoop-ozone/pull/33#issuecomment-542650094
Merged in 5adf6a1e3175e2a583eea0d2384ed1f8e11da57b
This is an automated message
elek closed pull request #8: HDDS-2267. Container metadata scanner interval
mismatch
URL: https://github.com/apache/hadoop-ozone/pull/8
This is an automated message from the Apache Git Service.
To respond to the message,
elek commented on issue #8: HDDS-2267. Container metadata scanner interval
mismatch
URL: https://github.com/apache/hadoop-ozone/pull/8#issuecomment-542646488
My previous comments are not addressed but it was an optional suggestion. I
commit it right now as it's better than the current
Attila Doroszlai created HDDS-2315:
--
Summary: bucket creation fails because bucket does not exist
Key: HDDS-2315
URL: https://issues.apache.org/jira/browse/HDDS-2315
Project: Hadoop Distributed Data
ChenSammi commented on a change in pull request #28: HDDS-1569 Support creating
multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335399857
##
File path:
ChenSammi commented on a change in pull request #28: HDDS-1569 Support creating
multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335323752
##
File path:
ChenSammi commented on a change in pull request #28: HDDS-1569 Support creating
multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335307601
##
File path:
ChenSammi commented on a change in pull request #28: HDDS-1569 Support creating
multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335305877
##
File path:
ChenSammi commented on a change in pull request #28: HDDS-1569 Support creating
multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335377568
##
File path:
elek closed pull request #38: github-actions
URL: https://github.com/apache/hadoop-ozone/pull/38
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
ChenSammi commented on a change in pull request #28: HDDS-1569 Support creating
multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335382664
##
File path:
ChenSammi commented on a change in pull request #28: HDDS-1569 Support creating
multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335399342
##
File path:
ChenSammi commented on a change in pull request #28: HDDS-1569 Support creating
multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335379816
##
File path:
ChenSammi commented on a change in pull request #28: HDDS-1569 Support creating
multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335304602
##
File path:
ChenSammi commented on a change in pull request #28: HDDS-1569 Support creating
multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335401278
##
File path:
ChenSammi commented on a change in pull request #28: HDDS-1569 Support creating
multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335326566
##
File path:
ChenSammi commented on a change in pull request #28: HDDS-1569 Support creating
multiple pipelines with same datanode
URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335305442
##
File path: hadoop-hdds/common/src/main/resources/ozone-default.xml
##
@@
elek opened a new pull request #38: github-actions
URL: https://github.com/apache/hadoop-ozone/pull/38
github actions test
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
elek closed pull request #30: HDDS-1988. Fix listParts API.
URL: https://github.com/apache/hadoop-ozone/pull/30
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
sodonnel opened a new pull request #37: HDDS-2197 Extend SCMCLI Topology
command to print node Operational States
URL: https://github.com/apache/hadoop-ozone/pull/37
The scmcli topology command only consider the node health (healthy, stale or
dead). With decommission and maintenance
mukul1987 commented on a change in pull request #23: HDDS-1868. Ozone pipelines
should be marked as ready only after the leader election is complete.
URL: https://github.com/apache/hadoop-ozone/pull/23#discussion_r335387189
##
File path:
mukul1987 commented on a change in pull request #23: HDDS-1868. Ozone pipelines
should be marked as ready only after the leader election is complete.
URL: https://github.com/apache/hadoop-ozone/pull/23#discussion_r335388484
##
File path:
[
https://issues.apache.org/jira/browse/HDDS-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YiSheng Lien resolved HDDS-2314.
Resolution: Duplicate
> Fix TestOMKeyCommitRequest Error
>
>
>
[
https://issues.apache.org/jira/browse/HDDS-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YiSheng Lien reopened HDDS-2314:
> Fix TestOMKeyCommitRequest Error
>
>
> Key:
cxorm closed pull request #36: HDDS-2314. Fix TestOMKeyCommitRequest Error.
URL: https://github.com/apache/hadoop-ozone/pull/36
This is an automated message from the Apache Git Service.
To respond to the message, please log
[
https://issues.apache.org/jira/browse/HDDS-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YiSheng Lien resolved HDDS-2314.
Resolution: Duplicate
> Fix TestOMKeyCommitRequest Error
>
>
>
cxorm opened a new pull request #36: HDDS-2314. Fix TestOMKeyCommitRequest
Error.
URL: https://github.com/apache/hadoop-ozone/pull/36
**### What changes were proposed in this pull request?**
Fix the acquire/release lock in OMKeyCommitRequest.java
YiSheng Lien created HDDS-2314:
--
Summary: Fix TestOMKeyCommitRequest failure
Key: HDDS-2314
URL: https://issues.apache.org/jira/browse/HDDS-2314
Project: Hadoop Distributed Data Store
Issue
1 - 100 of 101 matches
Mail list logo
