Re: How do increase memory allocated to MySQL?
Hi Kevin, On Sat, Feb 5, 2011 at 6:00 AM, Kevin Spencer ke...@kevinspencer.orgwrote: When you use a leading wildcard symbol, MySQL will do a full table scan regardless of any indexes you've created. Is it also apply to regex lookup ? Regards, Feris
Re: Query Stored Index instead of Group By
Hi Johan, On Sun, Dec 19, 2010 at 7:11 PM, Johan De Meersman vegiv...@tuxera.bewrote: You can't query the index directly, but if you select only fields that are in the index, no table lookups will be performed - this is called a covering index. Great.. Thanks for the confirmation. Regards, Feris -- Bier met grenadyn Is als mosterd by den wyn Sy die't drinkt, is eene kwezel Hy die't drinkt, is ras een ezel
Re: Bulk Insertion Performance
Hi Johan, On Thu, Dec 16, 2010 at 4:03 PM, Johan De Meersman vegiv...@tuxera.bewrote: Hmm, interesting. What does this do, exactly ? Can something similar be applied to non-jdbc connections, too ? I'm not quite sure... but will try to trace it. Will ask this in another thread. FYI, when I try it using FIFO mechanism in Linux. It increases into 20,000 rows / second insertion. Regards, Feris
Query Stored Index instead of Group By
Hi Everyone, Is there a way to query values stored in our index instead of using group by selection which will produce same results ? Please advice.. Regards, Feris
Re: Bulk Insertion Performance
Hi Mark, On Thu, Dec 16, 2010 at 4:50 AM, Mark Matthews mark.matth...@oracle.com wrote: Feris, I don't know what Kettle is doing under the hood, but if it's doing addBatch(), executeBatch(), then adding rewriteBatchedStatements=true to your MySQL JDBC URL should probably help quite a bit. It works. By having rewriteBatchedStatements=true in the jdbc url it increases. Now it performs an average 4500 rows / second. Thanks Mark. Regards, Feris
Bulk Insertion Performance
Hi All, I have a data warehouse infrastructure with following configuration : - MySQL 5.0 MyISAM + InndoDB enabled (XAMPP Distribution) - Windows 2003 64 bit data center edition - Java Runtime 6 - 32 bit version And have ETL running data warehouse process. Reading is impressive, 12,000 rows per second. But writing with only 10 columns (integer and varchar combinations) takes 3,000 rows / second. Is there a way to configure writing to have a better performance ? Thanks, Feris
Re: Bulk Insertion Performance
Hi Mark, On Wed, Dec 15, 2010 at 8:10 AM, Mark Matthews mark.matth...@oracle.comwrote: Feris, *How* are you writing, via batch statements with rewriting, or directly, or via LOAD DATA INFILE? It seems you're off by about a factor of 10-20x from what I've seen performance-wise for writes. I'm using ETL mean - for this case, it is a java application name Kettle (Pentaho Data Integration). And it use JDBC connection. Is it a JDBC driver configuration ? -Mark -- Thanks, Feris
Re: Data folder copying problem
Hi Martin, On 1/31/08, Martijn Tonies [EMAIL PROTECTED] wrote: Hi, By default, InnoDB tables aren't stored in the database folder, but rather in it's own table space files. In fact when I try to drop the database, the server recognizes innodb tables. For example, T1 and T2 are INNODB tables in database DB1. Then when I try to drop DB1, it issues error Unknown tables (T1, T2). If InnoDb own its table space... where is it reside ? Thanks Regards, Feris -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Data folder copying problem
Hi all, I have 2 database folder that being copied directly from a remote server and sent to me. That databases contains both MYISAM and INNODB tables. After I received the data, I try to restored it by copying that folders to my server. The problem is, only MYISAM tables are being recognized. How come ? I check mysql server storage engine status and INNODB is being enabled and active. Then I try to drop those databases, but every drop attempt will cause unknown tables ... error. Is my restoration problem has to do with some user permission or it is a bug ? For your information, both the database server use mysql 5.0.45-community-nt version. Regards, Feris -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Data folder copying problem
Hi Rick, Thanks... I think I found the answer from your direction. This article seems the solution to my problem : http://dev.mysql.com/doc/refman/5.1/en/innodb-backup.html Thanks ! Feris On 1/31/08, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: moving an innodb table is trickier than moving a myisam one. you might want to do a search like: moving innodb tables site:mysql.com in google. i think that the first couple of entries will give you hints on what you need to do to accomplish this. - Rick Original Message Date: Thursday, January 31, 2008 09:00:38 PM +0700 From: Feris Thia [EMAIL PROTECTED] To: mysql@lists.mysql.com Subject: Data folder copying problem Hi all, I have 2 database folder that being copied directly from a remote server and sent to me. That databases contains both MYISAM and INNODB tables. After I received the data, I try to restored it by copying that folders to my server. The problem is, only MYISAM tables are being recognized. How come ? I check mysql server storage engine status and INNODB is being enabled and active. Then I try to drop those databases, but every drop attempt will cause unknown tables ... error. Is my restoration problem has to do with some user permission or it is a bug ? For your information, both the database server use mysql 5.0.45-community-nt version. -- End Original Message -- -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Data folder copying problem
Hi Martin, You are correct. That's the same error that I got. Looks like this article is the solution = http://dev.mysql.com/doc/refman/5.1/en/innodb-backup.html Thanks ! Feris On 1/31/08, Martijn Tonies [EMAIL PROTECTED] wrote: Hi, By default, InnoDB tables aren't stored in the database folder, but rather in it's own table space files. In fact when I try to drop the database, the server recognizes innodb tables. For example, T1 and T2 are INNODB tables in database DB1. Then when I try to drop DB1, it issues error Unknown tables (T1, T2). Why do you think it recognizes them? I have a database with only 1 table, but if I type this: drop table foo (foo doesn't exist) I get: #42S02Unknown table 'foo' Same error :-) If InnoDb own its table space... where is it reside ? I believe directly under the \data folder. Martijn Tonies Database Workbench - tool for InterBase, Firebird, MySQL, NexusDB, Oracle MS SQL Server Upscene Productions http://www.upscene.com My thoughts: http://blog.upscene.com/martijn/ Database development questions? Check the forum! http://www.databasedevelopmentforum.com -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]