Hi Johan,
On Thu, Dec 16, 2010 at 4:03 PM, Johan De Meersman wrote:
> Hmm, interesting. What does this do, exactly ? Can something similar be
> applied to non-jdbc connections, too ?
>
I'm not quite sure... but will try to trace it. Will ask this in another
thread.
FYI, when I try it using FIF
Hmm, interesting. What does this do, exactly ? Can something similar be
applied to non-jdbc connections, too ?
On Thu, Dec 16, 2010 at 8:34 AM, Feris Thia <
milis.datab...@phi-integration.com> wrote:
> Hi Mark,
>
> On Thu, Dec 16, 2010 at 4:50 AM, Mark Matthews
> wrote:
>
> > Feris,
> >
> > I d
Hi Mark,
On Thu, Dec 16, 2010 at 4:50 AM, Mark Matthews
wrote:
> Feris,
>
> I don't know what Kettle is doing under the hood, but if it's doing
> addBatch(), executeBatch(), then adding "rewriteBatchedStatements=true" to
> your MySQL JDBC URL should probably help quite a bit.
>
It works. By ha
On Dec 14, 2010, at 7:21 PM, Feris Thia wrote:
> Hi Mark,
>
> On Wed, Dec 15, 2010 at 8:10 AM, Mark Matthews
> wrote:
> Feris,
>
> *How* are you writing, via batch statements with rewriting, or directly, or
> via LOAD DATA INFILE? It seems you're off by about a factor of 10-20x from
> what
Hi Mark,
On Wed, Dec 15, 2010 at 8:10 AM, Mark Matthews wrote:
> Feris,
>
> *How* are you writing, via batch statements with rewriting, or directly, or
> via LOAD DATA INFILE? It seems you're off by about a factor of 10-20x from
> what I've seen performance-wise for writes.
>
I'm using ETL mean
On Dec 14, 2010, at 6:51 PM, Feris Thia wrote:
> Hi All,
>
> I have a data warehouse infrastructure with following configuration :
> - MySQL 5.0 MyISAM + InndoDB enabled (XAMPP Distribution)
> - Windows 2003 64 bit data center edition
> - Java Runtime 6 - 32 bit version
>
> And have ETL running
Hi All,
I have a data warehouse infrastructure with following configuration :
- MySQL 5.0 MyISAM + InndoDB enabled (XAMPP Distribution)
- Windows 2003 64 bit data center edition
- Java Runtime 6 - 32 bit version
And have ETL running data warehouse process. Reading is impressive, 12,000
rows per s
