[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14216091#comment-14216091
]
Hudson commented on HDFS-6982:
--
FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #9 (See
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14216104#comment-14216104
]
Hudson commented on HDFS-6982:
--
SUCCESS: Integrated in Hadoop-Yarn-trunk #747 (See
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14216203#comment-14216203
]
Hudson commented on HDFS-6982:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk #1937 (See
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14216217#comment-14216217
]
Hudson commented on HDFS-6982:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #9 (See
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14216277#comment-14216277
]
Hudson commented on HDFS-6982:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk #1961 (See
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14216298#comment-14216298
]
Hudson commented on HDFS-6982:
--
SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #9 (See
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215179#comment-14215179
]
Andrew Wang commented on HDFS-6982:
---
The TestDistributedFileSystem failure looks valid,
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215551#comment-14215551
]
Hadoop QA commented on HDFS-6982:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215563#comment-14215563
]
Andrew Wang commented on HDFS-6982:
---
Test failures look unrelated, the encryption stuff
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215570#comment-14215570
]
Maysam Yabandeh commented on HDFS-6982:
---
[~andrew.wang], Thanks for the reviews and
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215581#comment-14215581
]
Hudson commented on HDFS-6982:
--
FAILURE: Integrated in Hadoop-trunk-Commit #6564 (See
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14212825#comment-14212825
]
Maysam Yabandeh commented on HDFS-6982:
---
[~andrew.wang] I do not see any relation
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14213177#comment-14213177
]
Andrew Wang commented on HDFS-6982:
---
Hi Maysam, took a look at the latest patch, I think
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14213436#comment-14213436
]
Hadoop QA commented on HDFS-6982:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14211410#comment-14211410
]
Maysam Yabandeh commented on HDFS-6982:
---
Note sure what is the problem with Hadoop
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14211634#comment-14211634
]
Andrew Wang commented on HDFS-6982:
---
I triggered another run manually, haven't looked at
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14211755#comment-14211755
]
Hadoop QA commented on HDFS-6982:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14211778#comment-14211778
]
Maysam Yabandeh commented on HDFS-6982:
---
The findbugs warning seems unrelated:
{code}
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14211844#comment-14211844
]
Hadoop QA commented on HDFS-6982:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208866#comment-14208866
]
Maysam Yabandeh commented on HDFS-6982:
---
Thanks for well-detailed review. Some
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208879#comment-14208879
]
Andrew Wang commented on HDFS-6982:
---
bq. The configuration keys are already there. I have
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208942#comment-14208942
]
Haohui Mai commented on HDFS-6982:
--
Please correct me if I'm wrong. Let's say we have a
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208944#comment-14208944
]
Haohui Mai commented on HDFS-6982:
--
For the UI part I think it is fine to report only the
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208968#comment-14208968
]
Andrew Wang commented on HDFS-6982:
---
Haohui, IIUC your suggestion here is to use an
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208995#comment-14208995
]
Haohui Mai commented on HDFS-6982:
--
bq. However, my understanding is that there's no
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209024#comment-14209024
]
Andrew Wang commented on HDFS-6982:
---
How would this behave to a sudden, large spike in
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209205#comment-14209205
]
Hadoop QA commented on HDFS-6982:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207528#comment-14207528
]
Andrew Wang commented on HDFS-6982:
---
Hi Maysam, I did another round of review. Mostly
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205240#comment-14205240
]
Maysam Yabandeh commented on HDFS-6982:
---
[~andrew.wang] do you have more comments
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196620#comment-14196620
]
Haohui Mai commented on HDFS-6982:
--
{code}
+if (bucket.isStaleNow(time)) {
+
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196632#comment-14196632
]
Maysam Yabandeh commented on HDFS-6982:
---
Thanks [~wheat9] for the comment. Let me
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196644#comment-14196644
]
Haohui Mai commented on HDFS-6982:
--
bq. Before we start adding events to that (which will
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196664#comment-14196664
]
Maysam Yabandeh commented on HDFS-6982:
---
Let me take an example.
Time period: 60
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192418#comment-14192418
]
Maysam Yabandeh commented on HDFS-6982:
---
ping...
nntop: top-like tool for name
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192553#comment-14192553
]
Haohui Mai commented on HDFS-6982:
--
Sorry for the delay. Too busy these weeks. I'll try to
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182621#comment-14182621
]
Hadoop QA commented on HDFS-6982:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182841#comment-14182841
]
Maysam Yabandeh commented on HDFS-6982:
---
the failed test does not seem to be related.
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181804#comment-14181804
]
Andrew Wang commented on HDFS-6982:
---
Hey Maysam, I haven't looked at the new patch yet,
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182368#comment-14182368
]
Hadoop QA commented on HDFS-6982:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173030#comment-14173030
]
Hadoop QA commented on HDFS-6982:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173288#comment-14173288
]
Hadoop QA commented on HDFS-6982:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173303#comment-14173303
]
Maysam Yabandeh commented on HDFS-6982:
---
The unit test failures does seem relevant to
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169779#comment-14169779
]
Maysam Yabandeh commented on HDFS-6982:
---
Thanks [~andrew.wang] for the well-detailed
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169944#comment-14169944
]
Andrew Wang commented on HDFS-6982:
---
Hi Maysam,
It seems like without the HTML / JMX
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167851#comment-14167851
]
Andrew Wang commented on HDFS-6982:
---
Hi Maysam, thanks for sticking with this, and again
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155288#comment-14155288
]
Andrew Wang commented on HDFS-6982:
---
Yea, I think we should. I'm kinda slammed right now,
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155429#comment-14155429
]
Haohui Mai commented on HDFS-6982:
--
Thanks for the ping. I'll try to get to this patch as
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152457#comment-14152457
]
Maysam Yabandeh commented on HDFS-6982:
---
Should we proceed with the current patch
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132282#comment-14132282
]
Lohit Vijayarenu commented on HDFS-6982:
To add to what [~maysamyabandeh] already
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14130474#comment-14130474
]
Andrew Wang commented on HDFS-6982:
---
Sorry for coming late to this discussion. Big +1
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14131039#comment-14131039
]
Maysam Yabandeh commented on HDFS-6982:
---
Thanks [~andrew.wang]. Yeah the main reason
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128806#comment-14128806
]
Haohui Mai commented on HDFS-6982:
--
Given that the second architecture has been proven in
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128844#comment-14128844
]
Maysam Yabandeh commented on HDFS-6982:
---
bq. Given that the second architecture has
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125849#comment-14125849
]
Haohui Mai commented on HDFS-6982:
--
bq. The minimal change is a couple of lines to
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125893#comment-14125893
]
Maysam Yabandeh commented on HDFS-6982:
---
bq. If this is the case, maybe we can
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125909#comment-14125909
]
Haohui Mai commented on HDFS-6982:
--
bq. This plan will still place the rolling window
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126018#comment-14126018
]
Maysam Yabandeh commented on HDFS-6982:
---
bq. I anticipate that one use case is to
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126160#comment-14126160
]
Haohui Mai commented on HDFS-6982:
--
Thanks for the explanation.
bq. In the second
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126180#comment-14126180
]
Maysam Yabandeh commented on HDFS-6982:
---
bq. Just to make sure I understand, does it
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126198#comment-14126198
]
Haohui Mai commented on HDFS-6982:
--
bq. ... the attached patch was for the first
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126226#comment-14126226
]
Maysam Yabandeh commented on HDFS-6982:
---
bq. Which architecture did you guys run in
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123750#comment-14123750
]
Haohui Mai commented on HDFS-6982:
--
This is a nice feature, thanks for [~maysamyabandeh]!
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123852#comment-14123852
]
Maysam Yabandeh commented on HDFS-6982:
---
Thanks [~wheat9].
bq. What are the minimal
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123880#comment-14123880
]
Hadoop QA commented on HDFS-6982:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122119#comment-14122119
]
Suresh Srinivas commented on HDFS-6982:
---
[~maysamyabandeh], +1 for this feature!
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122267#comment-14122267
]
Hadoop QA commented on HDFS-6982:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118786#comment-14118786
]
Philip Zeyliger commented on HDFS-6982:
---
Looks neat!
Since you're proposing this for
[
https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118971#comment-14118971
]
Maysam Yabandeh commented on HDFS-6982:
---
Thanks [~philip]. I agree with you. I
68 matches
Mail list logo