HDFS Client

2025-08-28 Thread David
Hello Group, I haven't been much involved with Hadoop these days, but I decided to take another swing at it as a project to experiment with GenAI. The output of that work was a slimmed-down Java HDFS client. Would be great if you could take a peek: https://github.com/valier-io/hdfs-c

Re: Question about Compatibility of HDFS Client Version 3.2.4 with HDFS Server 2.10.2

2025-08-18 Thread Xiaoqiao He
enges have prompted me to > investigate whether the HDFS client 3.2.4 can be compatible with the HDFS > server 2.10.2. > > I have reviewed the code for client 3.2.4 and found that almost all RPC > methods remain the same. For the new RPC methods, as long as we avoid > calling the new me

[jira] [Resolved] (HDFS-17718) Upgrade JUnit from 4 to 5 in hadoop-hdfs-client.

2025-04-08 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17718. --- Hadoop Flags: Reviewed Resolution: Fixed > Upgrade JUnit from 4 to 5 in hadoop-hdfs-cli

[jira] [Resolved] (HDFS-17159) Can't decode Identifier HDFS tokens with only the hdfs client jar

2025-03-27 Thread Wei-Chiu Chuang (Jira)
Hadoop 2 release, but if it ever would, let's include this fix. Thanks [~zilong zhu] > Can't decode Identifier HDFS tokens with only the hdfs client jar > - > > Key: HDFS-17159 >

[jira] [Created] (HDFS-17718) Upgrade JUnit from 4 to 5 in hadoop-hdfs-client.

2025-01-29 Thread Shilun Fan (Jira)
Shilun Fan created HDFS-17718: - Summary: Upgrade JUnit from 4 to 5 in hadoop-hdfs-client. Key: HDFS-17718 URL: https://issues.apache.org/jira/browse/HDFS-17718 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-17647) Datanodeid attribute ipAddr not use hostname resolve when hdfs client use hostname

2024-10-20 Thread dncba (Jira)
dncba created HDFS-17647: Summary: Datanodeid attribute ipAddr not use hostname resolve when hdfs client use hostname Key: HDFS-17647 URL: https://issues.apache.org/jira/browse/HDFS-17647 Project: Hadoop

[jira] [Created] (HDFS-17159) Can't decode Identifier HDFS tokens with only the hdfs client jar

2023-08-14 Thread Zilong Zhu (Jira)
Zilong Zhu created HDFS-17159: - Summary: Can't decode Identifier HDFS tokens with only the hdfs client jar Key: HDFS-17159 URL: https://issues.apache.org/jira/browse/HDFS-17159 Project: Hadoop

[jira] [Created] (HDFS-17018) Normalizes log records on the hdfs client

2023-05-18 Thread Xianming Lei (Jira)
Xianming Lei created HDFS-17018: --- Summary: Normalizes log records on the hdfs client Key: HDFS-17018 URL: https://issues.apache.org/jira/browse/HDFS-17018 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-16896) HDFS Client hedged read has increased failure rate than without hedged read

2023-03-01 Thread Tom McCormick (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom McCormick resolved HDFS-16896. -- Resolution: Fixed > HDFS Client hedged read has increased failure rate than without hed

[jira] [Created] (HDFS-16896) HDFS Client hedged read has increased failure rate than without hedged read

2023-01-23 Thread Tom McCormick (Jira)
Tom McCormick created HDFS-16896: Summary: HDFS Client hedged read has increased failure rate than without hedged read Key: HDFS-16896 URL: https://issues.apache.org/jira/browse/HDFS-16896 Project

[jira] [Resolved] (HDFS-14969) Fix HDFS client unnecessary failover log printing

2022-04-11 Thread Takanobu Asanuma (Jira)
DFS client unnecessary failover log printing > - > > Key: HDFS-14969 > URL: https://issues.apache.org/jira/browse/HDFS-14969 > Project: Hadoop HDFS > Issue Type: Improvement >

Re: [jira] [Created] (HADOOP-18069) CVE-2021-0341 in okhttp@2.7.5 detected in hdfs-client

2022-01-07 Thread Duo Zhang
Forwarded message - > From: Eugene Shinn (Truveta) (Jira) > Date: Wed, 5 Jan 2022 at 19:48 > Subject: [jira] [Created] (HADOOP-18069) CVE-2021-0341 in okhttp@2.7.5 > detected in hdfs-client > To: > >

Fwd: [jira] [Created] (HADOOP-18069) CVE-2021-0341 in okhttp@2.7.5 detected in hdfs-client

2022-01-07 Thread Steve Loughran
] (HADOOP-18069) CVE-2021-0341 in okhttp@2.7.5 detected in hdfs-client To: Eugene Shinn (Truveta) created HADOOP-18069: --- Summary: CVE-2021-0341 in okhttp@2.7.5 detected in hdfs-client Key: HADOOP-18069

[jira] [Created] (HDFS-15957) The ignored IOException in the RPC response sent by FSEditLogAsync can cause the HDFS client to hang

2021-04-08 Thread Haoze Wu (Jira)
Haoze Wu created HDFS-15957: --- Summary: The ignored IOException in the RPC response sent by FSEditLogAsync can cause the HDFS client to hang Key: HDFS-15957 URL: https://issues.apache.org/jira/browse/HDFS-15957

[jira] [Created] (HDFS-15925) The lack of packet-level mirrorError state synchronization in BlockReceiver$PacketResponder can cause the HDFS client to hang

2021-03-26 Thread Haoze Wu (Jira)
Haoze Wu created HDFS-15925: --- Summary: The lack of packet-level mirrorError state synchronization in BlockReceiver$PacketResponder can cause the HDFS client to hang Key: HDFS-15925 URL: https://issues.apache.org/jira

[jira] [Created] (HDFS-15639) [JDK 11] Fix Javadoc errors in hadoop-hdfs-client

2020-10-18 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-15639: --- Summary: [JDK 11] Fix Javadoc errors in hadoop-hdfs-client Key: HDFS-15639 URL: https://issues.apache.org/jira/browse/HDFS-15639 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

2020-05-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15202. Fix Version/s: 3.4.0 Resolution: Fixed > HDFS-client: boost ShortCircuit Ca

[jira] [Created] (HDFS-14969) Fix HDFS client unnecessary failover log printing

2019-11-07 Thread Xudong Cao (Jira)
Xudong Cao created HDFS-14969: - Summary: Fix HDFS client unnecessary failover log printing Key: HDFS-14969 URL: https://issues.apache.org/jira/browse/HDFS-14969 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-14809) Make a new BlockReader for hdfs client lib

2019-08-31 Thread KenCao (Jira)
KenCao created HDFS-14809: - Summary: Make a new BlockReader for hdfs client lib Key: HDFS-14809 URL: https://issues.apache.org/jira/browse/HDFS-14809 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-14520) client-side configs from hdfs-default.xml missing in hadoop-hdfs-client

2019-05-29 Thread Kaitlyn Johnson (JIRA)
Kaitlyn Johnson created HDFS-14520: -- Summary: client-side configs from hdfs-default.xml missing in hadoop-hdfs-client Key: HDFS-14520 URL: https://issues.apache.org/jira/browse/HDFS-14520 Project

[jira] [Resolved] (HDFS-8707) Implement an async pure c++ HDFS client

2018-10-26 Thread James Clampffer (JIRA)
work under HDFS-14032. > Implement an async pure c++ HDFS client > --- > > Key: HDFS-8707 > URL: https://issues.apache.org/jira/browse/HDFS-8707 > Project: Hadoop HDFS > Is

[jira] [Created] (HDFS-13943) [JDK10] Fix javadoc errors in hadoop-hdfs-client module

2018-09-26 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-13943: Summary: [JDK10] Fix javadoc errors in hadoop-hdfs-client module Key: HDFS-13943 URL: https://issues.apache.org/jira/browse/HDFS-13943 Project: Hadoop HDFS

[jira] [Created] (HDFS-13850) Migrate logging to slf4j in hadoop-hdfs-client

2018-08-22 Thread Ian Pickering (JIRA)
Ian Pickering created HDFS-13850: Summary: Migrate logging to slf4j in hadoop-hdfs-client Key: HDFS-13850 URL: https://issues.apache.org/jira/browse/HDFS-13850 Project: Hadoop HDFS Issue

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-28 Thread Eric Badger
;> >> >> >> >> >> *From: *Jim Clampffer >> *Date: *Tuesday, March 27, 2018 at 11:09 AM >> *To: *Eric Badger >> *Cc: *Deepak Majeti , Jitendra Pandey < >> jiten...@hortonworks.com>, Anu Engineer , >> Mukul Kumar Singh , Owen O'Mall

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-28 Thread Jim Clampffer
y, March 27, 2018 at 11:09 AM > *To: *Eric Badger > *Cc: *Deepak Majeti , Jitendra Pandey < > jiten...@hortonworks.com>, Anu Engineer , > Mukul Kumar Singh , Owen O'Malley < > owen.omal...@gmail.com>, Chris Douglas , Hdfs-dev < > hdfs-dev@hadoop.apache.org> > *

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-27 Thread Anu Engineer
, Mukul Kumar Singh , Owen O'Malley , Chris Douglas , Hdfs-dev Subject: Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk Hi Eric, There isn't a way to completely skip compiling libhdfs++ as part of the native build. You could pass -Dnative_cmake_args="-DHDFSPP_LI

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-27 Thread Jim Clampffer
+1 (binding) >> > > >> > > .. Owen >> > > >> > > On Sun, Mar 11, 2018 at 6:20 PM, Chris Douglas < >> > > cdoug...@apache.org> wrote: >> > > >> > &g

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-27 Thread Eric Badger
> On Thu, Mar 8, 2018 at 9:31 AM, Jim Clampffer < > > > james.clampf...@gmail.com> > > > > wrote: > > > > > Hi Everyone, > > > > > > > > > > The feedback was generally positive on the discussion > > &

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-16 Thread Deepak Majeti
gt; > > wrote: > > > > Hi Everyone, > > > > > > > > The feedback was generally positive on the discussion > > thread [1] so I'd > > > > like to start a formal vote for mergin

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-16 Thread Jim Clampffer
t; > > > > > The feedback was generally positive on the discussion > thread [1] so I'd > > > like to start a formal vote for merging HDFS-8707 > (libhdfs++) into trunk. > > > The vote will be open for 7 days and end 6P

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-14 Thread Jitendra Pandey
1] so I'd > > like to start a formal vote for merging HDFS-8707 (libhdfs++) into trunk. > > The vote will be open for 7 days and end 6PM EST on 3/15/18. > > > > This branch includes a C++ implementation of an HDFS cl

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-14 Thread Anu Engineer
15/18. > > > > This branch includes a C++ implementation of an HDFS client for use in > > applications that don't run an in-process JVM. Right now the branch only > > supports reads and metadata calls. > > > &

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-13 Thread Mukul Kumar Singh
> > > > This branch includes a C++ implementation of an HDFS client for use in > > applications that don't run an in-process JVM. Right now the branch only > > supports reads and metadata calls. > > > > Features (paraphrasing th

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-13 Thread Owen O'Malley
; like to start a formal vote for merging HDFS-8707 (libhdfs++) into trunk. > > The vote will be open for 7 days and end 6PM EST on 3/15/18. > > > > This branch includes a C++ implementation of an HDFS client for use in > > applications that don't run an in-process

Re: [VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-11 Thread Chris Douglas
end 6PM EST on 3/15/18. > > This branch includes a C++ implementation of an HDFS client for use in > applications that don't run an in-process JVM. Right now the branch only > supports reads and metadata calls. > > Features (paraphrasing the list from the discussion thread):

[jira] [Resolved] (HDFS-12928) Shaded jar for hadoop-hdfs-client

2018-03-09 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDFS-12928. --- Resolution: Won't Fix > Shaded jar for hadoop-hdf

[VOTE] Merging branch HDFS-8707 (native HDFS client) to trunk

2018-03-08 Thread Jim Clampffer
Hi Everyone, The feedback was generally positive on the discussion thread [1] so I'd like to start a formal vote for merging HDFS-8707 (libhdfs++) into trunk. The vote will be open for 7 days and end 6PM EST on 3/15/18. This branch includes a C++ implementation of an HDFS client for u

Re: [DISCUSS] Merging HDFS-8707 (C++ HDFS client) to trunk

2018-03-01 Thread Chris Douglas
gt; Regards, > James > > > > > On Thu, Mar 1, 2018 at 4:28 AM, 郑锴(铁杰) wrote: >> >> The work sounds solid and great! + to have this. >> >> Is there any quick doc to take a glance at? Some quick questions to be >> familiar with: >> 1. Seems the cl

Re: [DISCUSS] Merging HDFS-8707 (C++ HDFS client) to trunk

2018-03-01 Thread Owen O'Malley
Regards, > > James > > > > > > > > > > On Thu, Mar 1, 2018 at 4:28 AM, 郑锴(铁杰) > > wrote: > > > > > The work sounds solid and great! + to have this. > > > > > > Is there any quick doc to take a glance at? Some quick questi

Re: [DISCUSS] Merging HDFS-8707 (C++ HDFS client) to trunk

2018-03-01 Thread Vinayakumar B
> > Is there any quick doc to take a glance at? Some quick questions to be > > familiar with: > > 1. Seems the client is all implemented in c++ without any Java codes (so > > no JVM overhead), which means lots of work, rewriting HDFS client. Right? > > 2. Guess erasur

Re: [DISCUSS] Merging HDFS-8707 (C++ HDFS client) to trunk

2018-03-01 Thread Jim Clampffer
plemented in c++ without any Java codes (so > no JVM overhead), which means lots of work, rewriting HDFS client. Right? > 2. Guess erasure coding feature isn't supported, as it'd involve > significant development, right? If yes, what will it say when read erasure > coded file? &

回复:[DISCUSS] Merging HDFS-8707 (C++ HDFS client) to trunk

2018-03-01 Thread 郑锴(铁杰)
The work sounds solid and great! + to have this. Is there any quick doc to take a glance at? Some quick questions to be familiar with:1. Seems the client is all implemented in c++ without any Java codes (so no JVM overhead), which means lots of work, rewriting HDFS client. Right?2.   Guess

Re: [DISCUSS] Merging HDFS-8707 (C++ HDFS client) to trunk

2018-02-28 Thread Chris Douglas
+1 Let's get this done. We've had many false starts on a native HDFS client. This is a good base to build on. -C On Wed, Feb 28, 2018 at 9:55 AM, Jim Clampffer wrote: > Hi everyone, > > I'd like to start a thread to discuss merging the HDFS-8707 aka libhdfs++ > int

[DISCUSS] Merging HDFS-8707 (C++ HDFS client) to trunk

2018-02-28 Thread Jim Clampffer
Hi everyone, I'd like to start a thread to discuss merging the HDFS-8707 aka libhdfs++ into trunk. I sent originally sent a similar email out last October but it sounds like it was buried by discussions about other feature merges that were going on at the time. libhdfs++ is an HDFS c

[jira] [Created] (HDFS-13185) Refactor DistCpSync to bring code into hadoop-hdfs-client project

2018-02-23 Thread Ewan Higgs (JIRA)
Ewan Higgs created HDFS-13185: - Summary: Refactor DistCpSync to bring code into hadoop-hdfs-client project Key: HDFS-13185 URL: https://issues.apache.org/jira/browse/HDFS-13185 Project: Hadoop HDFS

[jira] [Created] (HDFS-13103) HDFS Client write acknowledgement timeout should not depend on read timeout

2018-02-02 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-13103: -- Summary: HDFS Client write acknowledgement timeout should not depend on read timeout Key: HDFS-13103 URL: https://issues.apache.org/jira/browse/HDFS-13103

[jira] [Created] (HDFS-12928) Shaded jar for hadoop-hdfs-client

2017-12-14 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-12928: - Summary: Shaded jar for hadoop-hdfs-client Key: HDFS-12928 URL: https://issues.apache.org/jira/browse/HDFS-12928 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Nanda kumar (JIRA)
Nanda kumar created HDFS-12774: -- Summary: Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client Key: HDFS-12774 URL: https://issues.apache.org/jira/browse/HDFS-12774 Project

[jira] [Created] (HDFS-12670) can't renew HDFS tokens with only the hdfs client jar

2017-10-16 Thread Thomas Graves (JIRA)
Thomas Graves created HDFS-12670: Summary: can't renew HDFS tokens with only the hdfs client jar Key: HDFS-12670 URL: https://issues.apache.org/jira/browse/HDFS-12670 Project: Hadoop

[jira] [Created] (HDFS-12259) Ozone: OzoneClient: Refactor ozone client code and move it from hadoop-hdfs to hadoop-hdfs-client project

2017-08-04 Thread Nandakumar (JIRA)
Nandakumar created HDFS-12259: - Summary: Ozone: OzoneClient: Refactor ozone client code and move it from hadoop-hdfs to hadoop-hdfs-client project Key: HDFS-12259 URL: https://issues.apache.org/jira/browse/HDFS-12259

[jira] [Resolved] (HDFS-11819) HDFS client with hedged read, handle exceptions from callable when the hedged read thread pool is exhausted

2017-05-16 Thread huaxiang sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huaxiang sun resolved HDFS-11819. - Resolution: Invalid The exception is handled, close it as invalid. > HDFS client with hed

[jira] [Created] (HDFS-11819) HDFS client with hedged read, handle exceptions from callable when the hedged read thread pool is exhausted

2017-05-12 Thread huaxiang sun (JIRA)
huaxiang sun created HDFS-11819: --- Summary: HDFS client with hedged read, handle exceptions from callable when the hedged read thread pool is exhausted Key: HDFS-11819 URL: https://issues.apache.org/jira/browse

[jira] [Resolved] (HDFS-11629) Revert HDFS-11431 hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider.

2017-04-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-11629. Resolution: Fixed Fix Version/s: 2.8.1 > Revert HDFS-11431 hadoop-hdfs-client JAR does

[jira] [Created] (HDFS-11629) Revert HDFS-11431 hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider.

2017-04-05 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11629: -- Summary: Revert HDFS-11431 hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider. Key: HDFS-11629 URL: https://issues.apache.org/jira/browse/HDFS-11629

[jira] [Reopened] (HDFS-11538) Move ClientProtocol HA proxies into hadoop-hdfs-client

2017-04-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-11538: > Move ClientProtocol HA proxies into hadoop-hdfs-cli

[jira] [Created] (HDFS-11596) hadoop-hdfs-client jar is in the wrong directory in release tarball

2017-03-29 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11596: -- Summary: hadoop-hdfs-client jar is in the wrong directory in release tarball Key: HDFS-11596 URL: https://issues.apache.org/jira/browse/HDFS-11596 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

2017-03-16 Thread Andrew Wang (JIRA)
erted this from branch-2. Filed HDFS-11538 to do the real fix for 2.9 and 3.0. > hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider > --- > > Key: HDFS-11431 >

[jira] [Created] (HDFS-11538) Move ConfiguredFailoverProxyProvider into hadoop-hdfs-client

2017-03-16 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11538: -- Summary: Move ConfiguredFailoverProxyProvider into hadoop-hdfs-client Key: HDFS-11538 URL: https://issues.apache.org/jira/browse/HDFS-11538 Project: Hadoop HDFS

[jira] [Reopened] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

2017-03-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HDFS-11431: --- > hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvi

[jira] [Created] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

2017-02-19 Thread Steven Rand (JIRA)
Steven Rand created HDFS-11431: -- Summary: hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider Key: HDFS-11431 URL: https://issues.apache.org/jira/browse/HDFS-11431 Project: Hadoop

[jira] [Created] (HDFS-11414) Ozone : move StorageContainerLocation protocol to hdfs-client

2017-02-14 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11414: - Summary: Ozone : move StorageContainerLocation protocol to hdfs-client Key: HDFS-11414 URL: https://issues.apache.org/jira/browse/HDFS-11414 Project: Hadoop HDFS

[jira] [Created] (HDFS-11004) Ozone : move Chunk IO and container protocol calls to hdfs-client

2016-10-13 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11004: - Summary: Ozone : move Chunk IO and container protocol calls to hdfs-client Key: HDFS-11004 URL: https://issues.apache.org/jira/browse/HDFS-11004 Project: Hadoop HDFS

[jira] [Created] (HDFS-10995) Ozone : move ozone client to hdfs-client

2016-10-11 Thread Chen Liang (JIRA)
Chen Liang created HDFS-10995: - Summary: Ozone : move ozone client to hdfs-client Key: HDFS-10995 URL: https://issues.apache.org/jira/browse/HDFS-10995 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-10914) Move remnants of oah.hdfs.client to hadoop-hdfs-client

2016-09-27 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-10914: -- Summary: Move remnants of oah.hdfs.client to hadoop-hdfs-client Key: HDFS-10914 URL: https://issues.apache.org/jira/browse/HDFS-10914 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10848) Move hadoop-hdfs-native-client module into hadoop-hdfs-client

2016-09-08 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-10848: Summary: Move hadoop-hdfs-native-client module into hadoop-hdfs-client Key: HDFS-10848 URL: https://issues.apache.org/jira/browse/HDFS-10848 Project: Hadoop HDFS

[jira] [Created] (HDFS-10394) move declaration of okhttp version from hdfs-client to hadoop-project POM

2016-05-12 Thread Steve Loughran (JIRA)
Steve Loughran created HDFS-10394: - Summary: move declaration of okhttp version from hdfs-client to hadoop-project POM Key: HDFS-10394 URL: https://issues.apache.org/jira/browse/HDFS-10394 Project

[jira] [Resolved] (HDFS-9967) CLONE - [umbrella] Data striping support in HDFS client

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9967. -- Resolution: Invalid > CLONE - [umbrella] Data striping support in HDFS cli

[jira] [Created] (HDFS-9967) CLONE - [umbrella] Data striping support in HDFS client

2016-03-15 Thread dragon (JIRA)
dragon created HDFS-9967: Summary: CLONE - [umbrella] Data striping support in HDFS client Key: HDFS-9967 URL: https://issues.apache.org/jira/browse/HDFS-9967 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-9875) HDFS client requires compromising permission when running under JVM security manager

2016-02-29 Thread Costin Leau (JIRA)
Costin Leau created HDFS-9875: - Summary: HDFS client requires compromising permission when running under JVM security manager Key: HDFS-9875 URL: https://issues.apache.org/jira/browse/HDFS-9875 Project

[jira] [Created] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

2016-02-15 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9815: Summary: Move o.a.h.fs.Hdfs to hadoop-hdfs-client Key: HDFS-9815 URL: https://issues.apache.org/jira/browse/HDFS-9815 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-9172) Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-client

2016-02-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-9172. - Resolution: Invalid > Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-cli

[jira] [Created] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

2016-01-19 Thread ade (JIRA)
ade created HDFS-9666: - Summary: Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read Key: HDFS-9666 URL: https://issues.apache.org/jira/browse/HDFS-9666 Project

[jira] [Created] (HDFS-9598) Use heap buffer in PacketReceiver If hdfs client has no enough free direct buffer.

2015-12-23 Thread Yong Zhang (JIRA)
Yong Zhang created HDFS-9598: Summary: Use heap buffer in PacketReceiver If hdfs client has no enough free direct buffer. Key: HDFS-9598 URL: https://issues.apache.org/jira/browse/HDFS-9598 Project

[jira] [Created] (HDFS-9443) Disabling HDFS client socket cache causes logging message printed to console for CLI commands.

2015-11-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9443: --- Summary: Disabling HDFS client socket cache causes logging message printed to console for CLI commands. Key: HDFS-9443 URL: https://issues.apache.org/jira/browse/HDFS-9443

[jira] [Created] (HDFS-9394) branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing.

2015-11-05 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9394: --- Summary: branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing. Key: HDFS-9394 URL: https://issues.apache.org/jira

[jira] [Created] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

2015-11-04 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9378: --- Summary: hadoop-hdfs-client tests do not write logs. Key: HDFS-9378 URL: https://issues.apache.org/jira/browse/HDFS-9378 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-8128) hadoop-hdfs-client dependency convergence error

2015-10-26 Thread Haohui Mai (JIRA)
. > hadoop-hdfs-client dependency convergence error > --- > > Key: HDFS-8128 > URL: https://issues.apache.org/jira/browse/HDFS-8128 > Project: Hadoop HDFS > Issue Type: Sub-task

Re: hadoop-hdfs-client splitoff is going to break code

2015-10-23 Thread Kihwal Lee
4:43 PM Subject: Re: hadoop-hdfs-client splitoff is going to break code All tests that need to spin up a MiniDFSCluster will need to stay in hadoop-hdfs. Other client only tests are being moved to the hadoop-hdfs-client module, which is tracked in HDFS-9168. ~Haohui On Fri, Oct 23, 2015 at

Re: hadoop-hdfs-client splitoff is going to break code

2015-10-23 Thread Haohui Mai
All tests that need to spin up a MiniDFSCluster will need to stay in hadoop-hdfs. Other client only tests are being moved to the hadoop-hdfs-client module, which is tracked in HDFS-9168. ~Haohui On Fri, Oct 23, 2015 at 2:14 PM, Kihwal Lee wrote: > I am not sure whether it was mentioned

Re: hadoop-hdfs-client splitoff is going to break code

2015-10-23 Thread Kihwal Lee
I am not sure whether it was mentioned by anyone before, butI noticed that client only changes do not trigger running anytest in hdfs-precommit. This is because hadoop-hdfs-client does nothave any test. Kihwal From: Colin P. McCabe To: "hdfs-dev@hadoop.apache.org" C

Re: hadoop-hdfs-client splitoff is going to break code

2015-10-20 Thread Steve Loughran
> On 19 Oct 2015, at 22:01, Colin P. McCabe wrote: > > Thanks for being proactive here, Steve. no, just building downstream things. Caught a failure of spark to build against trunk too, but that's a one liner to import the no-deprecated Auth Exception > I think this is a good example of > wh

Re: hadoop-hdfs-client splitoff is going to break code

2015-10-19 Thread Colin P. McCabe
nto client and server is going > to break things. > > I know that, as my code is broken; DFSConfigKeys off the path, > HdfsConfiguration, the class I've been loading to force pickup of > hdfs-site.xml -all missing. > > This is because hadoop-client POM now depends on had

Re: hadoop-hdfs-client splitoff is going to break code

2015-10-14 Thread Mingliang Liu
The jira tracking this issue is: https://issues.apache.org/jira/browse/HDFS-9241 +1 on option 2 I think it makes sense to make hadoop-client directly depend on hadoop-hdfs (which itself depends on hadoop-hdfs-client). Ciao, Mingliang Liu Member of Technical Staff - HDFS, Hortonworks Inc. m

hadoop-hdfs-client splitoff is going to break code

2015-10-14 Thread Steve Loughran
M now depends on hadoop-hdfs-client, not hadoop-hdfs, so the things I'm referencing are gone. I'm particularly sad about DfsConfigKeys, as everybody uses it as the one hard-coded resource of HDFS constants, HDFS-6566 covering the issue of making this public, something that's been sitti

[jira] [Reopened] (HDFS-8707) Implement an async pure c++ HDFS client

2015-10-12 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen reopened HDFS-8707: -- Oops. Closed the wrong issue. > Implement an async pure c++ HDFS cli

[jira] [Resolved] (HDFS-8707) Implement an async pure c++ HDFS client

2015-10-12 Thread Bob Hansen (JIRA)
c pure c++ HDFS client > --- > > Key: HDFS-8707 > URL: https://issues.apache.org/jira/browse/HDFS-8707 > Project: Hadoop HDFS > Issue Type: New Feature > Components: hdfs-clien

[jira] [Created] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client

2015-10-09 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9222: Summary: Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client Key: HDFS-9222 URL: https://issues.apache.org/jira/browse/HDFS-9222 Project: Hadoop HDFS

[jira] [Created] (HDFS-9217) Fix broken findbugsExcludeFile.xml for hadoop-hdfs-client module

2015-10-08 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9217: --- Summary: Fix broken findbugsExcludeFile.xml for hadoop-hdfs-client module Key: HDFS-9217 URL: https://issues.apache.org/jira/browse/HDFS-9217 Project: Hadoop HDFS

[jira] [Created] (HDFS-9202) Deprecation cases are not handled in hadoop-hdfs-client#DistributedFileSystem

2015-10-06 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created HDFS-9202: -- Summary: Deprecation cases are not handled in hadoop-hdfs-client#DistributedFileSystem Key: HDFS-9202 URL: https://issues.apache.org/jira/browse/HDFS-9202

[jira] [Created] (HDFS-9172) Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-client

2015-09-28 Thread Rakesh R (JIRA)
Rakesh R created HDFS-9172: -- Summary: Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-client Key: HDFS-9172 URL: https://issues.apache.org/jira/browse/HDFS-9172 Project: Hadoop HDFS

[jira] [Created] (HDFS-9168) Move client side uni test to hadoop-hdfs-client

2015-09-28 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9168: Summary: Move client side uni test to hadoop-hdfs-client Key: HDFS-9168 URL: https://issues.apache.org/jira/browse/HDFS-9168 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-9167) Update pom.xml in other modules to depend on hdfs-client instead of hdfs

2015-09-28 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9167: Summary: Update pom.xml in other modules to depend on hdfs-client instead of hdfs Key: HDFS-9167 URL: https://issues.apache.org/jira/browse/HDFS-9167 Project: Hadoop HDFS

[jira] [Created] (HDFS-9165) Move the rest of the entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-28 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9165: Summary: Move the rest of the entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client Key: HDFS-9165 URL: https://issues.apache.org/jira/browse/HDFS-9165 Project

[jira] [Created] (HDFS-9131) Move hadoop-hdfs-client related config keys from DFSConfigKeys to HdfsClientConfigKeys

2015-09-23 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9131: --- Summary: Move hadoop-hdfs-client related config keys from DFSConfigKeys to HdfsClientConfigKeys Key: HDFS-9131 URL: https://issues.apache.org/jira/browse/HDFS-9131

[jira] [Resolved] (HDFS-9099) Move DistributedFileSystem to hadoop-hdfs-client

2015-09-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-9099. - Resolution: Duplicate > Move DistributedFileSystem to hadoop-hdfs-cli

[jira] [Reopened] (HDFS-8740) Move DistributedFileSystem to hadoop-hdfs-client

2015-09-18 Thread Yi Liu (JIRA)
related things, such as DFSClient. > Move DistributedFileSystem to hadoop-hdfs-client > > > Key: HDFS-8740 > URL: https://issues.apache.org/jira/browse/HDFS-8740 > Project: Hadoop HDFS >

[jira] [Created] (HDFS-9111) Move hdfs-client side helper methods converting protobuf from PBHelper to PBHelperClient

2015-09-18 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9111: --- Summary: Move hdfs-client side helper methods converting protobuf from PBHelper to PBHelperClient Key: HDFS-9111 URL: https://issues.apache.org/jira/browse/HDFS-9111

[jira] [Created] (HDFS-9099) Move DistributedFileSystem to hadoop-hdfs-client

2015-09-17 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9099: --- Summary: Move DistributedFileSystem to hadoop-hdfs-client Key: HDFS-9099 URL: https://issues.apache.org/jira/browse/HDFS-9099 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-9041) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-09 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9041: Summary: Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client Key: HDFS-9041 URL: https://issues.apache.org/jira/browse/HDFS-9041 Project: Hadoop HDFS

[jira] [Created] (HDFS-9039) Split o.a.h.hdfs.NameNodeProxies class into two classes in hadoop-hdfs-client and hadoop-hdfs modules respectively

2015-09-08 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9039: --- Summary: Split o.a.h.hdfs.NameNodeProxies class into two classes in hadoop-hdfs-client and hadoop-hdfs modules respectively Key: HDFS-9039 URL: https://issues.apache.org/jira

  1   2   >