[ 
https://issues.apache.org/jira/browse/HDFS-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776560#comment-13776560
 ] 

Chris Nauroth commented on HDFS-5191:
-------------------------------------

Great, thank you for incorporating the feedback.

bq. even if there is an overall test timeout, it's nicer to use 
GenericTestUtils#waitFor.

Agreed, it helps narrow the problem down to a specific point in the test code.  
Thanks for making that change.

libhdfs looks good too.  Just a couple of minor things:

{code}
     * You must free all options structures allocated with this function using
     * readZeroOptionsFree.
{code}

Change readZeroOptionsFree to hadoopRzOptionsFree.

{code}
     *                   This buffer will continue to be valid and readable
     *                   until it is released by readZeroBufferFree.  Failure to
{code}

Change readZeroBufferFree to hadoopRzBufferFree.

{code}
    hadoopRzOptionsClearCached(env, opts);
    opts->cachedEnumSet = NULL;
{code}

Setting {{cachedEnumSet}} to {{NULL}} isn't required here, because 
{{hadoopRzOptionsClearCached}} already does it.

I'll be +1 for the whole patch after this.  I'm also interested in getting the 
zero-copy API and client-side mmap'ing changes merged to trunk and branch-2 
(but not the additional datanode caching/mlock'ing that's in the HDFS-4949 
branch).  This will make it easier for clients like ORC to start coding against 
the APIs.  If necessary, I can volunteer to put together a merge patch with 
just the zero-copy changes.
                
> revisit zero-copy API in FSDataInputStream to make it more intuitive
> --------------------------------------------------------------------
>
>                 Key: HDFS-5191
>                 URL: https://issues.apache.org/jira/browse/HDFS-5191
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: hdfs-client, libhdfs
>    Affects Versions: HDFS-4949
>            Reporter: Colin Patrick McCabe
>            Assignee: Colin Patrick McCabe
>         Attachments: HDFS-5191-caching.001.patch, 
> HDFS-5191-caching.003.patch, HDFS-5191-caching.006.patch, 
> HDFS-5191-caching.007.patch, HDFS-5191-caching.008.patch, 
> HDFS-5191-caching.009.patch
>
>
> As per the discussion on HDFS-4953, we should revisit the zero-copy API to 
> make it more intuitive for new users.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to