RE: DBOutputFormat Speed Issues

2010-02-01 Thread Jones, Nick
apache.org Subject: Re: DBOutputFormat Speed Issues Hi Nick, If you dont mind, can you please share your performance benchmarks of using DataDrivenInputFormat/DBInputFormat and MySQL? Thanks and Regards, Sonal On Mon, Feb 1, 2010 at 3:33 AM, Aaron Kimball wrote: > Nick, > > I'm a

Re: DBOutputFormat Speed Issues

2010-02-01 Thread Sonal Goyal
Hi Nick, If you dont mind, can you please share your performance benchmarks of using DataDrivenInputFormat/DBInputFormat and MySQL? Thanks and Regards, Sonal On Mon, Feb 1, 2010 at 3:33 AM, Aaron Kimball wrote: > Nick, > > I'm afraid that right now the only available OutputFormat for JDBC is

Re: DBOutputFormat Speed Issues

2010-01-31 Thread Aaron Kimball
Nick, I'm afraid that right now the only available OutputFormat for JDBC is that one. You'll note that DBOutputFormat doesn't really include much support for special-casing to MySQL or other targets. Your best bet is to probably copy the code from DBOutputFormat and DBConfiguration into some othe

DBOutputFormat Speed Issues

2010-01-28 Thread Nick Jones
Hi all, I have a use case for collecting several rows from MySQL of compressed/unstructured data (n rows), expanding the data set, and storing the expanded results back into a MySQL DB (100,000n rows). DBInputFormat seems to perform reasonably well but DBOutputFormat is inserting rows one-by-o