Hadoop Pipes documentation
Hi experts, I'm going to utilize C++ under Hadoop. Is there any good documentation about Hadoop Pipes? Thanks! -- Sincerely, Yongan
Re: C++ development framework under Hadoop
Thanks!:) Sincerely, Yongan On 10/14/2014 11:38 PM, Azuryy Yu wrote: yes. it always supports hadoop pipe in v2. On Wed, Oct 15, 2014 at 11:33 AM, Y Z <mailto:zhaoyansw...@gmail.com>> wrote: Thanks, Azuryy! I found some examples about Pipes. Is Hadoop Pipes still support in Hadoop 2.2? Sincerely, Yongan On 10/14/2014 11:20 PM, Azuryy Yu wrote: Hadoop streaming is the best option for you. It doesn't has high I/O overhead if you don't add a high I/O in your c++ code. hadoop streaming use buidin MapReduce, it just redirect input/out stream for your c++ application. On Tue, Oct 14, 2014 at 10:33 PM, Y. Z. mailto:zhaoyansw...@gmail.com>> wrote: Hi Experts, I'm going to to do some computation-intensive operation under Hadoop framework. I'm wondering which is the best way to code in C++ under Hadoop framework? I'm aware of three options: Hadoop Streaming, Hadoop Pipes, and Hadoop C++ Extension. I heard that Hadoop Pipes has/would be deprecated in Hadoop 2.*. I'm also not sure if Hadoop C++ Extension is still well maintained. Meanwhile, Hadoop Streaming has high I/O overhead. What are your opinions? Thanks! -- Sincerely, Y. Z.
Re: C++ development framework under Hadoop
Thanks, Azuryy! I found some examples about Pipes. Is Hadoop Pipes still support in Hadoop 2.2? Sincerely, Yongan On 10/14/2014 11:20 PM, Azuryy Yu wrote: Hadoop streaming is the best option for you. It doesn't has high I/O overhead if you don't add a high I/O in your c++ code. hadoop streaming use buidin MapReduce, it just redirect input/out stream for your c++ application. On Tue, Oct 14, 2014 at 10:33 PM, Y. Z. <mailto:zhaoyansw...@gmail.com>> wrote: Hi Experts, I'm going to to do some computation-intensive operation under Hadoop framework. I'm wondering which is the best way to code in C++ under Hadoop framework? I'm aware of three options: Hadoop Streaming, Hadoop Pipes, and Hadoop C++ Extension. I heard that Hadoop Pipes has/would be deprecated in Hadoop 2.*. I'm also not sure if Hadoop C++ Extension is still well maintained. Meanwhile, Hadoop Streaming has high I/O overhead. What are your opinions? Thanks! -- Sincerely, Y. Z.
C++ development framework under Hadoop
Hi Experts, I'm going to to do some computation-intensive operation under Hadoop framework. I'm wondering which is the best way to code in C++ under Hadoop framework? I'm aware of three options: Hadoop Streaming, Hadoop Pipes, and Hadoop C++ Extension. I heard that Hadoop Pipes has/would be deprecated in Hadoop 2.*. I'm also not sure if Hadoop C++ Extension is still well maintained. Meanwhile, Hadoop Streaming has high I/O overhead. What are your opinions? Thanks! -- Sincerely, Y. Z.