Re: Writing to remote HDFS using C# on Windows

2013-12-10 Thread Fengyun RAO
\hostname_or_ip\! > > The downside of using the NFS gateway, is that you may only use NFS for > communicating with Hadoop and not any of the real directories. > > *From:* Marco Shaw [mailto:marco.s...@gmail.com] > *Sent:* Friday, December 06, 2013 11:34 AM > *To:* user > *Sub

Re: Writing to remote HDFS using C# on Windows

2013-12-06 Thread Fengyun RAO
thanks, Marco, the example you showed still operate on file, not filestream. 2013/12/7 Marco Shaw > Does this help? > > http://blogs.msdn.com/b/data_otaku/archive/2013/08/26/hadoop-for-net-developers-programmatically-loading-data-to-hdfs.aspx > > I'm assuming you can use Microsoft's .NET SDK t

RE: Writing to remote HDFS using C# on Windows

2013-12-06 Thread Ian Jackson
communicating with Hadoop and not any of the real directories. From: Marco Shaw [mailto:marco.s...@gmail.com] Sent: Friday, December 06, 2013 11:34 AM To: user Subject: Re: Writing to remote HDFS using C# on Windows Does this help? http://blogs.msdn.com/b/data_otaku/archive/2013/08/26/hadoop-for-net

Re: Writing to remote HDFS using C# on Windows

2013-12-06 Thread Marco Shaw
Does this help? http://blogs.msdn.com/b/data_otaku/archive/2013/08/26/hadoop-for-net-developers-programmatically-loading-data-to-hdfs.aspx I'm assuming you can use Microsoft's .NET SDK to write to a non-HDInsight cluster... Marco On Fri, Dec 6, 2013 at 1:58 AM, Fengyun RAO wrote: > Thanks! >

Re: Writing to remote HDFS using C# on Windows

2013-12-05 Thread Fengyun RAO
Thanks! I tried WebHDFS, which also work well if I copy local files to HDFS, but still can't find a way to open a filestream, and write to it. 2013/12/6 Vinod Kumar Vavilapalli > You can try using WebHDFS. > > Thanks, > +Vinod > > > On Thu, Dec 5, 2013 at 6:04 PM, Fengyun RAO wrote: > >> Hi,

Re: Writing to remote HDFS using C# on Windows

2013-12-05 Thread Vinod Kumar Vavilapalli
You can try using WebHDFS. Thanks, +Vinod On Thu, Dec 5, 2013 at 6:04 PM, Fengyun RAO wrote: > Hi, All > > Is there a way to write files into remote HDFS on Linux using C# on > Windows? We want to use HDFS as data storage. > > We know there is HDFS java API, but not C#. We tried SAMBA for file

Writing to remote HDFS using C# on Windows

2013-12-05 Thread Fengyun RAO
Hi, All Is there a way to write files into remote HDFS on Linux using C# on Windows? We want to use HDFS as data storage. We know there is HDFS java API, but not C#. We tried SAMBA for file sharing and FUSE for mounting HDFS. It worked if we simply copy files to HDFS, but if we open a filestream