Re: Using FUSE for flat file loading

2011-11-26 Thread Linden Hillenbrand
What kind of staging area are they landing in? If you are looking to go direct to HDFS or even from a staging area you can look at Sqoop or Flume. FUSE works just fine, if you want more info on FUSE, I'd check out the following: http://wiki.apache.org/hadoop/MountableHDFS On Mon, Nov 21, 2011 at

Using FUSE for flat file loading

2011-11-21 Thread Edmon Begoli
I have scenario where I am receiving large files from a messaging adapter (think reliable SFTP) and I have to store them into HDFS. What would be a file system interface you would recommend? How is FUSE for this task? Thank you, Edmon