Re: Read or Save specific blocks of a file

2018-04-23 Thread Jim Clampffer
If you want to read replicas from a specific DN after determining the block bounds via getFileBlockLocations you could abuse the rack locality infrastructure by generating a dummy topology script to get the NN to order replicas such that the client tries to read from the DNs you prefer first. It's

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-28 Thread Jim Clampffer
er <aengin...@hortonworks.com> wrote: > Would it be possible to add a maven flag like –skipShade, that helps in > reducing the compile time for people who does not need to build libhdfs++ ? > > > > Thanks > Anu > > > > > > *From: *Jim Clampffer <james.cl

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-27 Thread Jim Clampffer
h > 200 >> sub-tasks) in James! >> >> On Fri, Mar 16, 2018 at 12:05 PM, Jim Clampffer < >> james.clampf...@gmail.com> >> wrote: >> >> > With 6 +1s, 0 0s, and 0 -1s the vote passes. I'll be merging this into >> > trunk shortly. >

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-16 Thread Jim Clampffer
; +1 (binding) > > .. Owen > > On Sun, Mar 11, 2018 at 6:20 PM, Chris Douglas < > cdoug...@apache.org> wrote: > > > +1 (binding) -C > > > > On Thu, Mar 8, 2018 at 9:31 AM, Jim C

[VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-08 Thread Jim Clampffer
Hi Everyone, The feedback was generally positive on the discussion thread [1] so I'd like to start a formal vote for merging HDFS-8707 (libhdfs++) into trunk. The vote will be open for 7 days and end 6PM EST on 3/15/18. This branch includes a C++ implementation of an HDFS client for use in

Re: [DISCUSS] Merging HDFS-8707 (C++ HDFS client) to trunk

2018-03-01 Thread Jim Clampffer
read supported? > > Thanks. > > > Regards, > Kai > > -- > 发件人:Chris Douglas <cdoug...@apache.org> > 发送时间:2018年3月1日(星期四) 05:08 > 收件人:Jim Clampffer <james.clampf...@gmail.com> > 抄 送:Hdfs-dev <hdfs-dev@hadoop.apache.org> > 主 题:Re: [D

[DISCUSS] Merging HDFS-8707 (C++ HDFS client) to trunk

2018-02-28 Thread Jim Clampffer
Hi everyone, I'd like to start a thread to discuss merging the HDFS-8707 aka libhdfs++ into trunk. I sent originally sent a similar email out last October but it sounds like it was buried by discussions about other feature merges that were going on at the time. libhdfs++ is an HDFS client

[DISCUSS] Merging libhdfs++ (HDFS-8707) into trunk

2017-10-25 Thread Jim Clampffer
Hi everyone, I'd like to start a thread to discuss merging the HDFS-8707 aka libhdfs++ into trunk (as a beta release). libhdfs++ is an HDFS client written in C++ designed to be used in applications that are written in non-JVM based languages. In its current state it supports kerberos