[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067254#comment-14067254
]
Zesheng Wu commented on HDFS-6382:
--
Thanks [~cutting]
I will move the trash emptier into T
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066507#comment-14066507
]
Doug Cutting commented on HDFS-6382:
bq. But the trash emptier runs inside NN as a daem
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14040683#comment-14040683
]
Zesheng Wu commented on HDFS-6382:
--
Hi guys, I've uploaded an initial implementation on HD
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033079#comment-14033079
]
Steve Loughran commented on HDFS-6382:
--
{quote}
It's sort of ridiculous to require YAR
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032964#comment-14032964
]
Colin Patrick McCabe commented on HDFS-6382:
bq. Plus, in the places that need
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032082#comment-14032082
]
Zesheng Wu commented on HDFS-6382:
--
[~ste...@apache.org] Thanks for your feedback.
We have
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031762#comment-14031762
]
Allen Wittenauer commented on HDFS-6382:
Let's take a step back and give a more con
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031018#comment-14031018
]
Steve Loughran commented on HDFS-6382:
--
My comments
# this can be done as an MR job.
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030366#comment-14030366
]
Zesheng Wu commented on HDFS-6382:
--
I filed two sub-tasks to track the development of this
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028768#comment-14028768
]
Zesheng Wu commented on HDFS-6382:
--
[~szetszwo], Thanks for your valuable suggestions.
bq.
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028729#comment-14028729
]
Tsz Wo Nicholas Sze commented on HDFS-6382:
---
> How about supporting symbolic ttl
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028682#comment-14028682
]
Tsz Wo Nicholas Sze commented on HDFS-6382:
---
Checked the design doc. It looks go
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14027325#comment-14027325
]
Zesheng Wu commented on HDFS-6382:
--
bq. Even if it's not implemented at first, we should t
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026772#comment-14026772
]
Colin Patrick McCabe commented on HDFS-6382:
bq. You mean that we scan the whol
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026047#comment-14026047
]
Zesheng Wu commented on HDFS-6382:
--
Thanks [~cmccabe] for your feedback.
bq. For the MR st
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025585#comment-14025585
]
Colin Patrick McCabe commented on HDFS-6382:
For the MR strategy, it seems like
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14018506#comment-14018506
]
Hangjun Ye commented on HDFS-6382:
--
Thanks Colin. We would start to draft a design doc and
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14017992#comment-14017992
]
Colin Patrick McCabe commented on HDFS-6382:
The xattrs branch was merged to tr
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14017427#comment-14017427
]
Hangjun Ye commented on HDFS-6382:
--
Thanks Colin! That's exactly what we want. Seems it's
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14016805#comment-14016805
]
Colin Patrick McCabe commented on HDFS-6382:
bq. So just wondering if possible
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14016335#comment-14016335
]
Hangjun Ye commented on HDFS-6382:
--
Thanks Haohui and Colin.
The balancer or a balancer-l
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14015922#comment-14015922
]
Colin Patrick McCabe commented on HDFS-6382:
I'm -1 on the idea of putting this
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14015678#comment-14015678
]
Haohui Mai commented on HDFS-6382:
--
I think the comments against implementing it in NN are
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14015535#comment-14015535
]
Hangjun Ye commented on HDFS-6382:
--
Thanks Colin for your summarization, I'd like to try t
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14014030#comment-14014030
]
Colin Patrick McCabe commented on HDFS-6382:
Chris, Andrew, and I have brought
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14013624#comment-14013624
]
Hangjun Ye commented on HDFS-6382:
--
BTW: TTL is one of applications that could benefit fro
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14013411#comment-14013411
]
Hangjun Ye commented on HDFS-6382:
--
I think we have two discussions here now: a TTL cleanu
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012591#comment-14012591
]
Andrew Wang commented on HDFS-6382:
---
Even if implementing security was a major hurdle (an
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012551#comment-14012551
]
Colin Patrick McCabe commented on HDFS-6382:
bq. One approach, as you suggested
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012480#comment-14012480
]
Hangjun Ye commented on HDFS-6382:
--
bq. This logic is subject to time of check/time of use
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012442#comment-14012442
]
Chris Nauroth commented on HDFS-6382:
-
bq. The implemented mechanism inside the NameNod
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012008#comment-14012008
]
Hangjun Ye commented on HDFS-6382:
--
Thanks Chris and Colin for your valuable comments, I'd
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011357#comment-14011357
]
Colin Patrick McCabe commented on HDFS-6382:
I agree with Chris' comments here.
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011305#comment-14011305
]
Chris Nauroth commented on HDFS-6382:
-
bq. ...run a job (maybe periodically) over the n
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14010891#comment-14010891
]
Hangjun Ye commented on HDFS-6382:
--
Thanks Haohui, that's clear to us now.
That's interest
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14010879#comment-14010879
]
Haohui Mai commented on HDFS-6382:
--
bq. Your suggestion is that we'd better have a general
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14010841#comment-14010841
]
Hangjun Ye commented on HDFS-6382:
--
Thanks Haohui for your reply.
Let me confirm I got yo
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14010820#comment-14010820
]
Haohui Mai commented on HDFS-6382:
--
bq. TTL is a very simple (but general) policy and we m
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14010734#comment-14010734
]
Hangjun Ye commented on HDFS-6382:
--
Implementing it outside NN is definitely another optio
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14010657#comment-14010657
]
Jian Wang commented on HDFS-6382:
-
I think it is better for you to provide a (backup & cle
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14010632#comment-14010632
]
Colin Patrick McCabe commented on HDFS-6382:
bq. Why do you think that putting
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14010520#comment-14010520
]
Zesheng Wu commented on HDFS-6382:
--
bq. Like I said, we should write such a tool and add i
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14010053#comment-14010053
]
Colin Patrick McCabe commented on HDFS-6382:
bq. But if there's no internal cle
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14004242#comment-14004242
]
Zesheng Wu commented on HDFS-6382:
--
Thanks [~cmccabe], it's sure that an outside cleanup t
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14003783#comment-14003783
]
Colin Patrick McCabe commented on HDFS-6382:
I don't think a nightly (or weekly
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13999746#comment-13999746
]
Zesheng Wu commented on HDFS-6382:
--
Thanks [~cnauroth], I agree with your example MapReduc
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13998933#comment-13998933
]
Chris Nauroth commented on HDFS-6382:
-
I agree with Andrew's opinion that this is bette
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13998374#comment-13998374
]
Zesheng Wu commented on HDFS-6382:
--
Thanks [~andrew.wang]. Of course a nightly cron job ca
[
https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997794#comment-13997794
]
Andrew Wang commented on HDFS-6382:
---
This is just my opinion, but isn't this something be
49 matches
Mail list logo
