[
https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16178872#comment-16178872
]
Surendra Singh Lilhore commented on HDFS-12291:
-----------------------------------------------
Hi [~xiaochen],
I have one doubt. In my current patch {{TestReencryption}} is failing and this
is because I am submitting the current batch after releasing read locks.
{code}
+ final String parentPath = parent.getFullPathName();
+ lockReleased = true;
+ readUnlock();
+ submitCurrentBatch(startId);
+ try {
+ throttle();
{code}
In {{ReencryptionHandler}} before submitting the current batch checking the
read lock. My doubt is why we need lock to submit current batch ?
{code}
@Override
protected void submitCurrentBatch(final long zoneId) throws IOException,
InterruptedException {
assert dir.hasReadLock();
if (currentBatch.isEmpty()) {
return;
}
{code}
> [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy
> of all the files under the given dir
> -----------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-12291
> URL: https://issues.apache.org/jira/browse/HDFS-12291
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: datanode, namenode
> Reporter: Rakesh R
> Assignee: Surendra Singh Lilhore
> Attachments: HDFS-12291-HDFS-10285-01.patch,
> HDFS-12291-HDFS-10285-02.patch, HDFS-12291-HDFS-10285-03.patch,
> HDFS-12291-HDFS-10285-04.patch, HDFS-12291-HDFS-10285-05.patch,
> HDFS-12291-HDFS-10285-06.patch
>
>
> For the given source path directory, presently SPS consider only the files
> immediately under the directory(only one level of scanning) for satisfying
> the policy. It WON’T do recursive directory scanning and then schedules SPS
> tasks to satisfy the storage policy of all the files till the leaf node.
> The idea of this jira is to discuss & implement an efficient recursive
> directory iteration mechanism and satisfies storage policy for all the files
> under the given directory.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
