[ 
https://issues.apache.org/jira/browse/HBASE-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168150#comment-13168150
 ] 

ramkrishna.s.vasudevan commented on HBASE-5009:
-----------------------------------------------

@Stack
After analysis, it was found that spitStoreFiles() is done by a different 
thread pool. 
These threads take more time to complete > fileSplitTimeout(30secs).  In that 
case we shut down the thread pool.  But by the time the request to create the 
split files has reached NN but not yet processed.

By  the time we go with roll back and delete the splitDir.  Just after this 
deletion is done the creation of splitfiles is successful in the NN.  So the 
deleted dir is created again. 
Hence subsequent splits are failing.  Correct me if am wrong.
                
> Failure of creating split dir if it already exists prevents splits from 
> happening further
> -----------------------------------------------------------------------------------------
>
>                 Key: HBASE-5009
>                 URL: https://issues.apache.org/jira/browse/HBASE-5009
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.6
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: ramkrishna.s.vasudevan
>
> The scenario is
> -> The split of a region takes a long time
> -> The deletion of the splitDir fails due to HDFS problems.
> -> Subsequent splits also fail after that.
> {code}
> private static void createSplitDir(final FileSystem fs, final Path splitdir)
>   throws IOException {
>     if (fs.exists(splitdir)) throw new IOException("Splitdir already exits? " 
> + splitdir);
>     if (!fs.mkdirs(splitdir)) throw new IOException("Failed create of " + 
> splitdir);
>   }
> {code}
> Correct me if am wrong? If it is an issue can we change the behaviour of 
> throwing exception?
> Pls suggest.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to