lokeshj1703 edited a comment on issue #673: HDDS-3064. Get Key is hung when
READ delay is injected in chunk file path.
URL: https://github.com/apache/hadoop-ozone/pull/673#issuecomment-599001121
@adoroszlai @bshashikant I am not saying we wait for the entire block to be
read. The client wi
lokeshj1703 commented on issue #673: HDDS-3064. Get Key is hung when READ delay
is injected in chunk file path.
URL: https://github.com/apache/hadoop-ozone/pull/673#issuecomment-599001121
@adoroszlai @bshashikant I am not saying we wait for the entire block to be
read. The client will be r
[
https://issues.apache.org/jira/browse/HDDS-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059156#comment-17059156
]
Lokesh Jain commented on HDDS-3175:
---
[~avijayan] the state machine moved to SHUTDOWN sta
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Cheng reassigned HDDS-1933:
--
Assignee: runzhiwang (was: runzhiwang)
> Datanode should use hostname in place of ip addresses to allo
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Cheng reassigned HDDS-1933:
--
Assignee: runzhiwang
> Datanode should use hostname in place of ip addresses to allow DN's to work
> w
[
https://issues.apache.org/jira/browse/HDDS-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3179:
-
Labels: pull-request-available (was: )
> Pipeline placement based on Topology does not have fall
timmylicheng opened a new pull request #678: HDDS-3179 Pipeline placement based
on Topology does not have fallback
URL: https://github.com/apache/hadoop-ozone/pull/678
## What changes were proposed in this pull request?
When rack awareness and topology is enabled, pipeline placement can
Li Cheng created HDDS-3179:
--
Summary: Pipeline placement based on Topology does not have fall
back protection
Key: HDDS-3179
URL: https://issues.apache.org/jira/browse/HDDS-3179
Project: Hadoop Distributed D
[
https://issues.apache.org/jira/browse/HDDS-3138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Cheng updated HDDS-3138:
---
Description:
Deployed on cluster with 8 datanodes and rack awareness enabled. (2/3/3).
Pipeline limit on data
[
https://issues.apache.org/jira/browse/HDDS-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059134#comment-17059134
]
Wei-Chiu Chuang commented on HDDS-3177:
---
Forgot to attach the OSWAP dependency check
[
https://issues.apache.org/jira/browse/HDDS-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated HDDS-3177:
--
Attachment: dependency-check-report.html
> Periodic dependency update (Java)
> -
[
https://issues.apache.org/jira/browse/HDDS-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Doroszlai reassigned HDDS-3177:
--
Assignee: Attila Doroszlai
> Periodic dependency update (Java)
> --
[
https://issues.apache.org/jira/browse/HDDS-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Doroszlai updated HDDS-3174:
---
Status: Patch Available (was: Open)
> Rebalance integration tests
> -
[
https://issues.apache.org/jira/browse/HDDS-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3174:
-
Labels: pull-request-available (was: )
> Rebalance integration tests
> --
adoroszlai opened a new pull request #677: HDDS-3174. Rebalance integration
tests
URL: https://github.com/apache/hadoop-ozone/pull/677
## What changes were proposed in this pull request?
1. Group `hdds` integration tests with `om` instead of `client`, because the
latter takes the mo
[
https://issues.apache.org/jira/browse/HDDS-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hanisha Koneru updated HDDS-3178:
-
Target Version/s: 0.6.0
> Add unit tests for OMGetDelegationToken Request and Response
> -
[
https://issues.apache.org/jira/browse/HDDS-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hanisha Koneru updated HDDS-3178:
-
Labels: OMHATest (was: )
> Add unit tests for OMGetDelegationToken Request and Response
> ---
[
https://issues.apache.org/jira/browse/HDDS-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hanisha Koneru updated HDDS-3178:
-
Parent: HDDS-505
Issue Type: Sub-task (was: Improvement)
> Add unit tests for OMGetDelega
[
https://issues.apache.org/jira/browse/HDDS-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hanisha Koneru updated HDDS-3137:
-
Parent: HDDS-505
Issue Type: Sub-task (was: Bug)
> OM RpcClient fail with java.lang.Illeg
Hanisha Koneru created HDDS-3178:
Summary: Add unit tests for OMGetDelegationToken Request and
Response
Key: HDDS-3178
URL: https://issues.apache.org/jira/browse/HDDS-3178
Project: Hadoop Distributed
[
https://issues.apache.org/jira/browse/HDDS-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-1995:
-
Labels: pull-request-available (was: )
> Generate renewTime on OMLeader for GetDelegationToken
>
hanishakoneru opened a new pull request #676: HDDS-1995. Generate renewTime on
OMLeader for GetDelegationToken
URL: https://github.com/apache/hadoop-ozone/pull/676
## What changes were proposed in this pull request?
Use renewTimeInterval of the OM leader across quorum of OM's.
[
https://issues.apache.org/jira/browse/HDDS-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059054#comment-17059054
]
Aravindan Vijayan commented on HDDS-3175:
-
[~ljain] Any idea why the Datanode Stat
swagle commented on a change in pull request #675: HDDS-3170. Fix issues in
File count by size task.
URL: https://github.com/apache/hadoop-ozone/pull/675#discussion_r392439126
##
File path:
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/tasks/FileSizeCountTask.java
swagle commented on a change in pull request #675: HDDS-3170. Fix issues in
File count by size task.
URL: https://github.com/apache/hadoop-ozone/pull/675#discussion_r392438979
##
File path:
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/tasks/OMDBUpdatesHandler.java
avijayanhwx commented on issue #675: HDDS-3170. Fix issues in File count by
size task.
URL: https://github.com/apache/hadoop-ozone/pull/675#issuecomment-598883906
@vivekratnavel / @shwetayakkali / @swagle Please review.
This
[
https://issues.apache.org/jira/browse/HDDS-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3170:
-
Labels: pull-request-available (was: )
> Fix issues in File count by size task.
> ---
avijayanhwx opened a new pull request #675: HDDS-3170. Fix issues in File count
by size task.
URL: https://github.com/apache/hadoop-ozone/pull/675
## What changes were proposed in this pull request?
- Handle DELETE key operation correctly.
- Handle PUT key operation for an existing ke
[
https://issues.apache.org/jira/browse/HDDS-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aravindan Vijayan updated HDDS-3170:
Summary: Fix issues in File count by size task. (was: File count by size
task does not hand
[
https://issues.apache.org/jira/browse/HDDS-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aravindan Vijayan updated HDDS-3170:
Description:
* Handle DELETE key operation correctly.
* Handle PUT key operation for an exis
bshashikant commented on issue #672: HDDS-3154. Intermittent failure in
Test2WayCommitInRatis.
URL: https://github.com/apache/hadoop-ozone/pull/672#issuecomment-598870255
> There was only 1 failure out of [50
runs](https://github.com/adoroszlai/hadoop-ozone/runs/505645020) + 20x earlier.
bshashikant commented on issue #673: HDDS-3064. Get Key is hung when READ delay
is injected in chunk file path.
URL: https://github.com/apache/hadoop-ozone/pull/673#issuecomment-598866295
> The changes look good to me. But I think setting a deadline on stub sets
an absolute deadline. Since
[
https://issues.apache.org/jira/browse/HDDS-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058995#comment-17058995
]
Siddharth Wagle commented on HDDS-3148:
---
Hi Mukul, yes we only got rid of half of th
[
https://issues.apache.org/jira/browse/HDDS-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hanisha Koneru reassigned HDDS-1995:
Assignee: Hanisha Koneru
> Generate renewTime on OMLeader for GetDelegationToken
>
[
https://issues.apache.org/jira/browse/HDDS-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058979#comment-17058979
]
Mukul Kumar Singh commented on HDDS-3148:
-
The log lines can still be seen in unit
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058958#comment-17058958
]
Lokesh Jain commented on HDDS-3173:
---
[~msingh] These were the configs which we had used
adoroszlai commented on issue #673: HDDS-3064. Get Key is hung when READ delay
is injected in chunk file path.
URL: https://github.com/apache/hadoop-ozone/pull/673#issuecomment-598842127
> After 30s, the stub will error out even if we have other chunks to read.
We rather need a deadline pe
Wei-Chiu Chuang created HDDS-3177:
-
Summary: Periodic dependency update (Java)
Key: HDDS-3177
URL: https://issues.apache.org/jira/browse/HDDS-3177
Project: Hadoop Distributed Data Store
Issue
[
https://issues.apache.org/jira/browse/HDDS-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated HDDS-3176:
--
Labels: newbie (was: )
> Remove unused dependency version strings
> ---
[
https://issues.apache.org/jira/browse/HDDS-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated HDDS-3176:
--
Description:
After the repo was split from hadoop, there are a few unused
dependencies/version
Wei-Chiu Chuang created HDDS-3176:
-
Summary: Remove unused dependency version strings
Key: HDDS-3176
URL: https://issues.apache.org/jira/browse/HDDS-3176
Project: Hadoop Distributed Data Store
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058935#comment-17058935
]
Mukul Kumar Singh commented on HDDS-3173:
-
[~ljain] had earlier looked into GC con
[
https://issues.apache.org/jira/browse/HDDS-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arpit Agarwal updated HDDS-3116:
Fix Version/s: (was: 0.6.0)
0.5.0
Target Version/s: (was: 0.5.0, 0
[
https://issues.apache.org/jira/browse/HDDS-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058846#comment-17058846
]
Lokesh Jain commented on HDDS-3175:
---
The datanode state machine moves to SHUTDOWN state
lokeshj1703 opened a new pull request #674: Healthy datanodes are marked as
stale
URL: https://github.com/apache/hadoop-ozone/pull/674
## What changes were proposed in this pull request?
The datanode state machine stops as the state moves to SHUTDOWN. As a result
datanode stops send
[
https://issues.apache.org/jira/browse/HDDS-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marton Elek reassigned HDDS-3172:
-
Assignee: Marton Elek
> Deprecate MetadataStore interface
> -
>
>
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058754#comment-17058754
]
Arpit Agarwal edited comment on HDDS-3173 at 3/13/20, 2:10 PM:
-
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058754#comment-17058754
]
Arpit Agarwal commented on HDDS-3173:
-
The other option is we spend time testing with
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arpit Agarwal updated HDDS-3173:
Target Version/s: 0.6.0
Affects Version/s: 0.5.0
> Provide better default JVM options
> ---
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arpit Agarwal updated HDDS-3173:
Affects Version/s: (was: 0.6.0)
> Provide better default JVM options
> -
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arpit Agarwal updated HDDS-3173:
Affects Version/s: 0.6.0
> Provide better default JVM options
> --
>
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arpit Agarwal updated HDDS-3173:
Priority: Blocker (was: Major)
> Provide better default JVM options
> -
[
https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058743#comment-17058743
]
Arpit Agarwal commented on HDDS-3173:
-
Let's use the options you listed above, CMS GC
[
https://issues.apache.org/jira/browse/HDDS-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lokesh Jain reassigned HDDS-3175:
-
Assignee: Lokesh Jain
> Healthy datanodes are marked as stale
> -
[
https://issues.apache.org/jira/browse/HDDS-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Doroszlai updated HDDS-3154:
---
Attachment:
org.apache.hadoop.ozone.client.rpc.Test2WayCommitInRatis-output.txt
> Intermitten
adoroszlai commented on issue #672: HDDS-3154. Intermittent failure in
Test2WayCommitInRatis.
URL: https://github.com/apache/hadoop-ozone/pull/672#issuecomment-598721072
There was only 1 failure out of [50
runs](https://github.com/adoroszlai/hadoop-ozone/runs/505645020) + 20x earlier.
Se
Nilotpal Nandi created HDDS-3175:
Summary: Healthy datanodes are marked as stale
Key: HDDS-3175
URL: https://issues.apache.org/jira/browse/HDDS-3175
Project: Hadoop Distributed Data Store
Iss
Attila Doroszlai created HDDS-3174:
--
Summary: Rebalance integration tests
Key: HDDS-3174
URL: https://issues.apache.org/jira/browse/HDDS-3174
Project: Hadoop Distributed Data Store
Issue Typ
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058681#comment-17058681
]
Attila Doroszlai commented on HDDS-1933:
One more note: our docker-compose samples
bshashikant commented on a change in pull request #671: HDDS-3086. Failure
running integration test it-freon.
URL: https://github.com/apache/hadoop-ozone/pull/671#discussion_r392150148
##
File path:
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/freon/TestDataV
bshashikant commented on a change in pull request #671: HDDS-3086. Failure
running integration test it-freon.
URL: https://github.com/apache/hadoop-ozone/pull/671#discussion_r392150148
##
File path:
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/freon/TestDataV
[
https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mingchao zhao reassigned HDDS-3155:
---
Assignee: mingchao zhao
> Improved ozone client flush implementation to make it faster.
> ---
adoroszlai commented on a change in pull request #671: HDDS-3086. Failure
running integration test it-freon.
URL: https://github.com/apache/hadoop-ozone/pull/671#discussion_r392123166
##
File path:
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/freon/TestDataVa
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058543#comment-17058543
]
runzhiwang edited comment on HDDS-1933 at 3/13/20, 9:23 AM:
I
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058543#comment-17058543
]
runzhiwang edited comment on HDDS-1933 at 3/13/20, 9:23 AM:
I
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058543#comment-17058543
]
runzhiwang edited comment on HDDS-1933 at 3/13/20, 9:18 AM:
I
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058543#comment-17058543
]
runzhiwang commented on HDDS-1933:
--
I change getIpAddress at the following links to getHo
[
https://issues.apache.org/jira/browse/HDDS-3064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3064:
-
Labels: fault_injection pull-request-available (was: fault_injection)
> Get Key is hung when READ
bshashikant opened a new pull request #673: HDDS-3064. Get Key is hung when
READ delay is injected in chunk file path.
URL: https://github.com/apache/hadoop-ozone/pull/673
## What changes were proposed in this pull request?
Added a deadline for rpc stub in the read path. It will
[
https://issues.apache.org/jira/browse/HDDS-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3154:
-
Labels: pull-request-available (was: )
> Intermittent failure in Test2WayCommitInRatis
>
bshashikant opened a new pull request #672: HDDS-3154. Intermittent failure in
Test2WayCommitInRatis.
URL: https://github.com/apache/hadoop-ozone/pull/672
## What changes were proposed in this pull request?
Ensure that create container transaction succeeds on all nodes of a ring
before
Marton Elek created HDDS-3173:
-
Summary: Provide better default JVM options
Key: HDDS-3173
URL: https://issues.apache.org/jira/browse/HDDS-3173
Project: Hadoop Distributed Data Store
Issue Type:
Marton Elek created HDDS-3172:
-
Summary: Deprecate MetadataStore interface
Key: HDDS-3172
URL: https://issues.apache.org/jira/browse/HDDS-3172
Project: Hadoop Distributed Data Store
Issue Type: I
[
https://issues.apache.org/jira/browse/HDDS-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058513#comment-17058513
]
Shashikant Banerjee commented on HDDS-3086:
---
Thanks [~adoroszlai] for the update
[
https://issues.apache.org/jira/browse/HDDS-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3086:
-
Labels: pull-request-available (was: )
> Failure running integration test it-freon
> ---
bshashikant opened a new pull request #671: HDDS-3086. Failure running
integration test it-freon.
URL: https://github.com/apache/hadoop-ozone/pull/671
## What changes were proposed in this pull request?
Added configs for rpc and watch timeouts for ratis clent and server.
Also, added a
[
https://issues.apache.org/jira/browse/HDDS-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mingchao zhao updated HDDS-3149:
Attachment: (was: image-2020-03-09-23-29-28-905.png)
> Make o3fs support acl operations
> --
[
https://issues.apache.org/jira/browse/HDDS-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mingchao zhao updated HDDS-3149:
Description:
Currently, ozone supports acl operations, but FileSystem through the hadoop API
does n
[
https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058476#comment-17058476
]
runzhiwang commented on HDDS-1933:
--
[~swagle] Hi, I think the following code use the ipad
[
https://issues.apache.org/jira/browse/HDDS-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mingchao zhao updated HDDS-3149:
Attachment: image-2020-03-13-15-14-44-840.png
> Make o3fs support acl operations
> -
[
https://issues.apache.org/jira/browse/HDDS-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mingchao zhao updated HDDS-3149:
Description:
Currently, ozone supports acl operations, but FileSystem through the hadoop API
does n
[
https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058462#comment-17058462
]
mingchao zhao edited comment on HDDS-3155 at 3/13/20, 7:03 AM:
-
82 matches
Mail list logo