question on loading data and generating uniq table

Hi, I wanted to ask some more experienced mysql users to give me some advice on a project I am currently planning. I have a text file with three columns: strName(char6), position(integer), str(char36) This file has some 3 billion rows (3,000,000,000). There are some strs that are duplicated

RE: MySQL Performance Analysis tools

sar will give you some basic information about what happens on the system... (see e.g.: http://linux.die.net/man/1/sar)... -B |-Original Message- |From: thomas Armstrong [mailto:[EMAIL PROTECTED] |Sent: Monday, November 19, 2007 6:42 AM |To: mysql@lists.mysql.com |Subject: MySQL

modify default value

Hi, I am mass-importing A LOT of csv tables. In order to distinguish between files I change the default value for the table before doing a load data infile.. from a Perl script: ALTER TABLE `data` MODIFY COLUMN `sample_id` INTEGER UNSIGNED NOT NULL DEFAULT $sample_id[$idx] After importing

Re: Problem with a complex query

what does explain tell you about the query? I also think you should try a combined index with all three columns that are used in one index. As far as I know only one index can be used per query... B On Aug 14, 2007, at 1:26 PM, Hugo Ferreira da Silva wrote: hum... I get it. But in my

Re: Problem with a complex query

From explain you can see that your problem lies within the mensagens table (the first entry from your explain query) where it says type: ALL and rows 68337. This basically means that it is not using any index for this table. MySQL doesn't seem to be very smart about queries involving OR

ERROR 11 (HY000): Can't unlock file (Errcode: 11)

Hi there, Is it true that problems related to error 11 are most likely bugs in MySQL? I have a query involving a union statement with a group and order by statement around it. The total data that has to be handled by the union statement is in the 100,000 or millions rows. I am using Windows

index not used

Hi, I have a problem with a very slow query that should be VERY fast. There are two tables: CREATE TABLE `tfbs_mm`.`tfbs_ecr` ( `tfbs_id` int(10) unsigned NOT NULL, `ecr_id` int(10) unsigned NOT NULL, KEY `tfbs_id` (`tfbs_id`), KEY `ecr_id` (`ecr_id`) ) ENGINE=MyISAM DEFAULT

referencing MySQL

Anybody knows how to reference MySQL in a scientific paper? Thanks Bernd

xml DTD and MySql

Hi everyone, I have XML data with a corresponding DTD, and I want create the necessary tables and load the data. Does anyone has experience with this? Are there any tools to help me? Thanks for your advice. Bernd

no one can log on any more

Hi there, I have some weird sql statements that seem to eat up all resources from mysqld. Once I have two of them running at the same time no one can log on any more. Simple queries involving distinct get a out of memory error. We have tried changing the index buffer size from 256M to 2G, no

Re: no one can log on any more

else can log on to the mysql system. If you or someone could explain or point me to a documentation on this it would be pretty close to what I want. Thanks for your help Bernd - Original Message - From: [EMAIL PROTECTED] To: Bernd Jagla [EMAIL PROTECTED] Cc: mysql [EMAIL PROTECTED] Sent

Re: no one can log on any more

solve this one? Bernd - Original Message - From: [EMAIL PROTECTED] To: Bernd Jagla [EMAIL PROTECTED] Cc: mysql [EMAIL PROTECTED] Sent: Tuesday, March 02, 2004 1:17 PM Subject: Re: no one can log on any more When the queries in question are running, what does top look like

Re: no one can log on any more

table: text_data type: ALL possible_keys: NULL key: NULL key_len: NULL ref: NULL rows 133856002 Extra: Using where No temp tables created, no i/o problem, no swapping. B - Original Message - From: [EMAIL PROTECTED] To: Bernd Jagla [EMAIL PROTECTED] Cc: mysql [EMAIL PROTECTED] Sent

Re: no one can log on any more

server already. B - Original Message - From: [EMAIL PROTECTED] To: Bernd Jagla [EMAIL PROTECTED] Cc: mysql [EMAIL PROTECTED] Sent: Tuesday, March 02, 2004 2:51 PM Subject: Re: no one can log on any more What error message, if any is thrown when someone attempts to log in when the two

Re: no one can log on any more

- Original Message - From: [EMAIL PROTECTED] To: Bernd Jagla [EMAIL PROTECTED] Cc: mysql [EMAIL PROTECTED] Sent: Tuesday, March 02, 2004 3:14 PM Subject: Re: no one can log on any more The database server becomes unresponsive to new threads? What is the result of the following equation

Re: no one can log on any more

- Original Message - From: [EMAIL PROTECTED] To: Bernd Jagla [EMAIL PROTECTED] Cc: mysql [EMAIL PROTECTED] Sent: Tuesday, March 02, 2004 3:43 PM Subject: Re: no one can log on any more Are you sure you allotted 512MB for both read_buffer and sort_buffer_size? Try reducing these values

complicated select statements and out of memory errors

Hi there, I have some rather complicated sql statements that seem to eat up all resources from mysqld. Once I have two of them running at the same time no one can log on any more. Simple queries involving distinct get a out of memory error. We have tried changing the index buffer size from

large insert with load

Hi, we have a big problem with inserting large amounts of data (2GB) into our MyISAM databank (version 4.0.12). The dataset is loaded in using LOAD DATA infile 'bla' ignore into table tab fields terminated by ' ' optionally enclosed by '' (int1, int2, int3, date); The format of the text file

User defined under SGI-IRIS64 6.5

Hi, I wanted to add some new user defined functions (UDF) to mysql 4.0.12-standard-log. I read in the manual that it is possible if you can start with the option --with-mysqld-ldflags=-rdynamic. Then I found that my distribution is most likely build with --disable-shared, which makes me believe

processlist state = null

Dear list, does anyone know what it means when it says state = NULL doing the show processlist? Thanks Bernd = Please note that this e-mail and any files transmitted with it may be privileged,

sort-records

Hi there, I wanted to sort the records in one of my tables (205,000,000 entries) to test if this will give me any speed increase. It is an MyISAM table, and was trying to use myisamchk -R 2 user. But what I get in return is a core dump and that the index file is not working anymore... I am

Fw: sort-records

- Original Message - From: Bernd Jagla [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Thursday, July 03, 2003 1:14 PM Subject: Re: sort-records Yup, I guess I set parameters too high... Thanks Bernd - Original Message - From: [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent

Re: RAID hardware suggestions/experience

Thanks to everybody for the nice discussion. Just to let you know about my (not necessary final) decisions: We will upgrade our SCSI -II controller to an Ultra SCSI 160 controller (always a good idea). Next we are looking into buying a RAID-5 system from RAIDking. While we do this we hope for

Excel(2002) and mysql4

My costomers are using Excel, so I am looking into connecting Excel with MySql. Does anyone know how to do this? Do you have a small example? Thank you very much for your help Bernd = Please note that this

RAID hardware suggestions/experience

Hi there, Our databank with all tables and idices is about 130GB big. The biggest limitations we encounter are on the I/O side. Therefore we are willing to update our data storage system to a RAID system (RAID 0+1, RAID 5, or RAID 10). Has anyone experience with such RAID systems? What should we

RAID hardware suggestions/experience

Sorry I forgot to mention: We are using IRIS on an Origion2000, 7GB memory, 8 CPUs. I was thinking of spending up to $10K. I also wanted the redundant data for speeding up the seeks, I also need to speed up the writes. Bernd