lokeshj1703 edited a comment on issue #673: HDDS-3064. Get Key is hung when
READ delay is injected in chunk file path.
URL: https://github.com/apache/hadoop-ozone/pull/673#issuecomment-599001121
@adoroszlai @bshashikant I am not saying we wait for the entire block to be
read. The client
lokeshj1703 commented on issue #673: HDDS-3064. Get Key is hung when READ delay
is injected in chunk file path.
URL: https://github.com/apache/hadoop-ozone/pull/673#issuecomment-599001121
@adoroszlai @bshashikant I am not saying we wait for the entire block to be
read. The client will be
[
https://issues.apache.org/jira/browse/HDDS-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059156#comment-17059156
]
Lokesh Jain commented on HDDS-3175:
---
[~avijayan] the state machine moved to SHUTDOWN state in register
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Cheng reassigned HDDS-1933:
--
Assignee: runzhiwang (was: runzhiwang)
> Datanode should use hostname in place of ip addresses to
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Cheng reassigned HDDS-1933:
--
Assignee: runzhiwang
> Datanode should use hostname in place of ip addresses to allow DN's to work
>
[
https://issues.apache.org/jira/browse/HDDS-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3179:
-
Labels: pull-request-available (was: )
> Pipeline placement based on Topology does not have fall
timmylicheng opened a new pull request #678: HDDS-3179 Pipeline placement based
on Topology does not have fallback
URL: https://github.com/apache/hadoop-ozone/pull/678
## What changes were proposed in this pull request?
When rack awareness and topology is enabled, pipeline placement can
Li Cheng created HDDS-3179:
--
Summary: Pipeline placement based on Topology does not have fall
back protection
Key: HDDS-3179
URL: https://issues.apache.org/jira/browse/HDDS-3179
Project: Hadoop Distributed
[
https://issues.apache.org/jira/browse/HDDS-3138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Cheng updated HDDS-3138:
---
Description:
Deployed on cluster with 8 datanodes and rack awareness enabled. (2/3/3).
Pipeline limit on
[
https://issues.apache.org/jira/browse/HDDS-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059134#comment-17059134
]
Wei-Chiu Chuang commented on HDDS-3177:
---
Forgot to attach the OSWAP dependency check report.
>
[
https://issues.apache.org/jira/browse/HDDS-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated HDDS-3177:
--
Attachment: dependency-check-report.html
> Periodic dependency update (Java)
>
[
https://issues.apache.org/jira/browse/HDDS-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Doroszlai reassigned HDDS-3177:
--
Assignee: Attila Doroszlai
> Periodic dependency update (Java)
>
[
https://issues.apache.org/jira/browse/HDDS-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Doroszlai updated HDDS-3174:
---
Status: Patch Available (was: Open)
> Rebalance integration tests
>
[
https://issues.apache.org/jira/browse/HDDS-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3174:
-
Labels: pull-request-available (was: )
> Rebalance integration tests
>
adoroszlai opened a new pull request #677: HDDS-3174. Rebalance integration
tests
URL: https://github.com/apache/hadoop-ozone/pull/677
## What changes were proposed in this pull request?
1. Group `hdds` integration tests with `om` instead of `client`, because the
latter takes the
[
https://issues.apache.org/jira/browse/HDDS-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hanisha Koneru updated HDDS-3178:
-
Target Version/s: 0.6.0
> Add unit tests for OMGetDelegationToken Request and Response
>
[
https://issues.apache.org/jira/browse/HDDS-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hanisha Koneru updated HDDS-3178:
-
Labels: OMHATest (was: )
> Add unit tests for OMGetDelegationToken Request and Response
>
[
https://issues.apache.org/jira/browse/HDDS-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hanisha Koneru updated HDDS-3178:
-
Parent: HDDS-505
Issue Type: Sub-task (was: Improvement)
> Add unit tests for
[
https://issues.apache.org/jira/browse/HDDS-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hanisha Koneru updated HDDS-3137:
-
Parent: HDDS-505
Issue Type: Sub-task (was: Bug)
> OM RpcClient fail with
Hanisha Koneru created HDDS-3178:
Summary: Add unit tests for OMGetDelegationToken Request and
Response
Key: HDDS-3178
URL: https://issues.apache.org/jira/browse/HDDS-3178
Project: Hadoop Distributed
[
https://issues.apache.org/jira/browse/HDDS-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-1995:
-
Labels: pull-request-available (was: )
> Generate renewTime on OMLeader for GetDelegationToken
>
hanishakoneru opened a new pull request #676: HDDS-1995. Generate renewTime on
OMLeader for GetDelegationToken
URL: https://github.com/apache/hadoop-ozone/pull/676
## What changes were proposed in this pull request?
Use renewTimeInterval of the OM leader across quorum of OM's.
[
https://issues.apache.org/jira/browse/HDDS-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059054#comment-17059054
]
Aravindan Vijayan commented on HDDS-3175:
-
[~ljain] Any idea why the Datanode State machine moved
swagle commented on a change in pull request #675: HDDS-3170. Fix issues in
File count by size task.
URL: https://github.com/apache/hadoop-ozone/pull/675#discussion_r392439126
##
File path:
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/tasks/FileSizeCountTask.java
swagle commented on a change in pull request #675: HDDS-3170. Fix issues in
File count by size task.
URL: https://github.com/apache/hadoop-ozone/pull/675#discussion_r392438979
##
File path:
avijayanhwx commented on issue #675: HDDS-3170. Fix issues in File count by
size task.
URL: https://github.com/apache/hadoop-ozone/pull/675#issuecomment-598883906
@vivekratnavel / @shwetayakkali / @swagle Please review.
This
[
https://issues.apache.org/jira/browse/HDDS-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3170:
-
Labels: pull-request-available (was: )
> Fix issues in File count by size task.
>
avijayanhwx opened a new pull request #675: HDDS-3170. Fix issues in File count
by size task.
URL: https://github.com/apache/hadoop-ozone/pull/675
## What changes were proposed in this pull request?
- Handle DELETE key operation correctly.
- Handle PUT key operation for an existing
[
https://issues.apache.org/jira/browse/HDDS-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aravindan Vijayan updated HDDS-3170:
Summary: Fix issues in File count by size task. (was: File count by size
task does not
[
https://issues.apache.org/jira/browse/HDDS-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aravindan Vijayan updated HDDS-3170:
Description:
* Handle DELETE key operation correctly.
* Handle PUT key operation for an
bshashikant commented on issue #672: HDDS-3154. Intermittent failure in
Test2WayCommitInRatis.
URL: https://github.com/apache/hadoop-ozone/pull/672#issuecomment-598870255
> There was only 1 failure out of [50
runs](https://github.com/adoroszlai/hadoop-ozone/runs/505645020) + 20x earlier.
bshashikant commented on issue #673: HDDS-3064. Get Key is hung when READ delay
is injected in chunk file path.
URL: https://github.com/apache/hadoop-ozone/pull/673#issuecomment-598866295
> The changes look good to me. But I think setting a deadline on stub sets
an absolute deadline.
[
https://issues.apache.org/jira/browse/HDDS-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058995#comment-17058995
]
Siddharth Wagle commented on HDDS-3148:
---
Hi Mukul, yes we only got rid of half of them, consensus on
[
https://issues.apache.org/jira/browse/HDDS-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hanisha Koneru reassigned HDDS-1995:
Assignee: Hanisha Koneru
> Generate renewTime on OMLeader for GetDelegationToken
>
[
https://issues.apache.org/jira/browse/HDDS-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058979#comment-17058979
]
Mukul Kumar Singh commented on HDDS-3148:
-
The log lines can still be seen in unit tests, do we
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058958#comment-17058958
]
Lokesh Jain commented on HDDS-3173:
---
[~msingh] These were the configs which we had used in the tests.
adoroszlai commented on issue #673: HDDS-3064. Get Key is hung when READ delay
is injected in chunk file path.
URL: https://github.com/apache/hadoop-ozone/pull/673#issuecomment-598842127
> After 30s, the stub will error out even if we have other chunks to read.
We rather need a deadline
Wei-Chiu Chuang created HDDS-3177:
-
Summary: Periodic dependency update (Java)
Key: HDDS-3177
URL: https://issues.apache.org/jira/browse/HDDS-3177
Project: Hadoop Distributed Data Store
[
https://issues.apache.org/jira/browse/HDDS-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated HDDS-3176:
--
Labels: newbie (was: )
> Remove unused dependency version strings
>
[
https://issues.apache.org/jira/browse/HDDS-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated HDDS-3176:
--
Description:
After the repo was split from hadoop, there are a few unused
dependencies/version
Wei-Chiu Chuang created HDDS-3176:
-
Summary: Remove unused dependency version strings
Key: HDDS-3176
URL: https://issues.apache.org/jira/browse/HDDS-3176
Project: Hadoop Distributed Data Store
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058935#comment-17058935
]
Mukul Kumar Singh commented on HDDS-3173:
-
[~ljain] had earlier looked into GC configs for the
[
https://issues.apache.org/jira/browse/HDDS-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arpit Agarwal updated HDDS-3116:
Fix Version/s: (was: 0.6.0)
0.5.0
Target Version/s: (was: 0.5.0,
[
https://issues.apache.org/jira/browse/HDDS-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058846#comment-17058846
]
Lokesh Jain commented on HDDS-3175:
---
The datanode state machine moves to SHUTDOWN state which causes the
lokeshj1703 opened a new pull request #674: Healthy datanodes are marked as
stale
URL: https://github.com/apache/hadoop-ozone/pull/674
## What changes were proposed in this pull request?
The datanode state machine stops as the state moves to SHUTDOWN. As a result
datanode stops
[
https://issues.apache.org/jira/browse/HDDS-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marton Elek reassigned HDDS-3172:
-
Assignee: Marton Elek
> Deprecate MetadataStore interface
> -
>
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058754#comment-17058754
]
Arpit Agarwal edited comment on HDDS-3173 at 3/13/20, 2:10 PM:
---
The other
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058754#comment-17058754
]
Arpit Agarwal commented on HDDS-3173:
-
The other option is we spend time testing with G1GC to arrive
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arpit Agarwal updated HDDS-3173:
Target Version/s: 0.6.0
Affects Version/s: 0.5.0
> Provide better default JVM options
>
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arpit Agarwal updated HDDS-3173:
Affects Version/s: (was: 0.6.0)
> Provide better default JVM options
>
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arpit Agarwal updated HDDS-3173:
Affects Version/s: 0.6.0
> Provide better default JVM options
> --
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arpit Agarwal updated HDDS-3173:
Priority: Blocker (was: Major)
> Provide better default JVM options
>
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058743#comment-17058743
]
Arpit Agarwal commented on HDDS-3173:
-
Let's use the options you listed above, CMS GC while officially
[
https://issues.apache.org/jira/browse/HDDS-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lokesh Jain reassigned HDDS-3175:
-
Assignee: Lokesh Jain
> Healthy datanodes are marked as stale
>
[
https://issues.apache.org/jira/browse/HDDS-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Doroszlai updated HDDS-3154:
---
Attachment:
org.apache.hadoop.ozone.client.rpc.Test2WayCommitInRatis-output.txt
>
adoroszlai commented on issue #672: HDDS-3154. Intermittent failure in
Test2WayCommitInRatis.
URL: https://github.com/apache/hadoop-ozone/pull/672#issuecomment-598721072
There was only 1 failure out of [50
runs](https://github.com/adoroszlai/hadoop-ozone/runs/505645020) + 20x earlier.
Nilotpal Nandi created HDDS-3175:
Summary: Healthy datanodes are marked as stale
Key: HDDS-3175
URL: https://issues.apache.org/jira/browse/HDDS-3175
Project: Hadoop Distributed Data Store
Attila Doroszlai created HDDS-3174:
--
Summary: Rebalance integration tests
Key: HDDS-3174
URL: https://issues.apache.org/jira/browse/HDDS-3174
Project: Hadoop Distributed Data Store
Issue
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058681#comment-17058681
]
Attila Doroszlai commented on HDDS-1933:
One more note: our docker-compose samples won't work with
bshashikant commented on a change in pull request #671: HDDS-3086. Failure
running integration test it-freon.
URL: https://github.com/apache/hadoop-ozone/pull/671#discussion_r392150148
##
File path:
bshashikant commented on a change in pull request #671: HDDS-3086. Failure
running integration test it-freon.
URL: https://github.com/apache/hadoop-ozone/pull/671#discussion_r392150148
##
File path:
[
https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mingchao zhao reassigned HDDS-3155:
---
Assignee: mingchao zhao
> Improved ozone client flush implementation to make it faster.
>
adoroszlai commented on a change in pull request #671: HDDS-3086. Failure
running integration test it-freon.
URL: https://github.com/apache/hadoop-ozone/pull/671#discussion_r392123166
##
File path:
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058543#comment-17058543
]
runzhiwang edited comment on HDDS-1933 at 3/13/20, 9:23 AM:
I change
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058543#comment-17058543
]
runzhiwang edited comment on HDDS-1933 at 3/13/20, 9:23 AM:
I change
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058543#comment-17058543
]
runzhiwang edited comment on HDDS-1933 at 3/13/20, 9:18 AM:
I change
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058543#comment-17058543
]
runzhiwang commented on HDDS-1933:
--
I change getIpAddress at the following links to getHostName, it works
[
https://issues.apache.org/jira/browse/HDDS-3064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3064:
-
Labels: fault_injection pull-request-available (was: fault_injection)
> Get Key is hung when
bshashikant opened a new pull request #673: HDDS-3064. Get Key is hung when
READ delay is injected in chunk file path.
URL: https://github.com/apache/hadoop-ozone/pull/673
## What changes were proposed in this pull request?
Added a deadline for rpc stub in the read path. It will
[
https://issues.apache.org/jira/browse/HDDS-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3154:
-
Labels: pull-request-available (was: )
> Intermittent failure in Test2WayCommitInRatis
>
bshashikant opened a new pull request #672: HDDS-3154. Intermittent failure in
Test2WayCommitInRatis.
URL: https://github.com/apache/hadoop-ozone/pull/672
## What changes were proposed in this pull request?
Ensure that create container transaction succeeds on all nodes of a ring
before
Marton Elek created HDDS-3173:
-
Summary: Provide better default JVM options
Key: HDDS-3173
URL: https://issues.apache.org/jira/browse/HDDS-3173
Project: Hadoop Distributed Data Store
Issue Type:
Marton Elek created HDDS-3172:
-
Summary: Deprecate MetadataStore interface
Key: HDDS-3172
URL: https://issues.apache.org/jira/browse/HDDS-3172
Project: Hadoop Distributed Data Store
Issue Type:
[
https://issues.apache.org/jira/browse/HDDS-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058513#comment-17058513
]
Shashikant Banerjee commented on HDDS-3086:
---
Thanks [~adoroszlai] for the update. Can you please
[
https://issues.apache.org/jira/browse/HDDS-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3086:
-
Labels: pull-request-available (was: )
> Failure running integration test it-freon
>
bshashikant opened a new pull request #671: HDDS-3086. Failure running
integration test it-freon.
URL: https://github.com/apache/hadoop-ozone/pull/671
## What changes were proposed in this pull request?
Added configs for rpc and watch timeouts for ratis clent and server.
Also, added
[
https://issues.apache.org/jira/browse/HDDS-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mingchao zhao updated HDDS-3149:
Attachment: (was: image-2020-03-09-23-29-28-905.png)
> Make o3fs support acl operations
>
[
https://issues.apache.org/jira/browse/HDDS-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mingchao zhao updated HDDS-3149:
Description:
Currently, ozone supports acl operations, but FileSystem through the hadoop API
does
[
https://issues.apache.org/jira/browse/HDDS-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mingchao zhao updated HDDS-3149:
Description:
Currently, ozone supports acl operations, but FileSystem through the hadoop API
does
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058476#comment-17058476
]
runzhiwang commented on HDDS-1933:
--
[~swagle] Hi, I think the following code use the ipaddress of
[
https://issues.apache.org/jira/browse/HDDS-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mingchao zhao updated HDDS-3149:
Attachment: image-2020-03-13-15-14-44-840.png
> Make o3fs support acl operations
>
[
https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058462#comment-17058462
]
mingchao zhao edited comment on HDDS-3155 at 3/13/20, 7:03 AM:
---
By
[
https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058462#comment-17058462
]
mingchao zhao edited comment on HDDS-3155 at 3/13/20, 6:57 AM:
---
By
[
https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058462#comment-17058462
]
mingchao zhao edited comment on HDDS-3155 at 3/13/20, 6:55 AM:
---
By
[
https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058462#comment-17058462
]
mingchao zhao edited comment on HDDS-3155 at 3/13/20, 6:52 AM:
---
By
[
https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058462#comment-17058462
]
mingchao zhao commented on HDDS-3155:
-
By tested HDDS-2717 , I found that this PR did not solve my
[
https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058462#comment-17058462
]
mingchao zhao edited comment on HDDS-3155 at 3/13/20, 6:49 AM:
---
By
[
https://issues.apache.org/jira/browse/HDDS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
runzhiwang updated HDDS-3168:
-
Description: Read a 100MB object which has 25 chunks, the jaeger trace
information as the image shows.
88 matches
Mail list logo