run Talend script on Hadoop

2008-03-29 Thread dito subandono
Hi there everyone I'm still new in Hadoop and would like to ask some question. Here is the situation. Talend is a data integration tool that can extract data from many sources, manipulate them and send the result to the target system (in my example from a CSV file to MySql database). With talend'

RE: DFS get blocked when writing a file.

2008-03-29 Thread Runping Qi
This is a know issue: https://issues.apache.org/jira/browse/HADOOP-3033 Your best bet now is to use 0.16.2 release. Runping > -Original Message- > From: Iván de Prado [mailto:[EMAIL PROTECTED] > Sent: Friday, March 28, 2008 6:08 AM > To: core-user@hadoop.apache.org > Subject: DFS get b

Re: small sized files - how to use MultiInputFileFormat

2008-03-29 Thread Ted Dunning
Small files are a bad idea for high throughput no matter what technology you use. The issue is that you need a larger file in order to avoid disk seeks. On 3/28/08 7:34 PM, "Jason Curtes" <[EMAIL PROTECTED]> wrote: > Hello, > > I have been trying to run Hadoop on a set of small text files, no