Adding indexes on large tables

2003-10-07 Thread Brendan J Sherar
Greetings to all, and thanks for the excellent resource! I have a question regarding indexing large tables (150M+ rows, 2.6G). The tables in question have a format like this: word_id mediumint unsigned doc_id mediumint unsigned Our indexes are as follows: PRIMARY KEY (word_id, doc_id) INDEX

RE: Adding indexes on large tables

2003-10-07 Thread Dan Greene
: Adding indexes on large tables Greetings to all, and thanks for the excellent resource! I have a question regarding indexing large tables (150M+ rows, 2.6G). The tables in question have a format like this: word_id mediumint unsigned doc_id mediumint unsigned Our indexes

RE: Adding indexes on large tables

2003-10-07 Thread Brad Teale
to another drive like Dan, said. Brad -Original Message- From: Brendan J Sherar [mailto:[EMAIL PROTECTED] Sent: Tuesday, October 07, 2003 6:27 AM To: [EMAIL PROTECTED] Subject: Adding indexes on large tables Greetings to all, and thanks for the excellent resource! I have a question regarding

Recreating indexes on large tables

2003-01-20 Thread Salvesen, Jens-Petter
Hello, everyone I have the following situation: After enjoying problems related to deleting a large portion of a table, subsequent slow selects and such, I decided to do an alternate route when removing data from a table: The table had transactions for one year, and the table really only needs

Re: Recreating indexes on large tables

2003-01-20 Thread Joseph Bueno
Hi, Instead of using separate CREATE INDEX statements, you can build all your index at once with ALTER TABLE: ALTER TABLE my_table ADD INDEX ..., ADD INDEX ... , ADD INDEX ... ; Hope this helps, -- Joseph Bueno Salvesen, Jens-Petter wrote: Hello, everyone I have the following

Creating indexes on large tables -- tmp directory is full

2002-09-05 Thread heath boutwell
Is there a way to change the directory used when mySQL copies the table for creating indexes on large tables? My tmp directory is partitioned for 509 megs and adding an index via ATLER TABLE or CREATE TABLE yields this: ERROR 3: Error writing file '/tmp/STFgNG04' (Errcode: 28) the .MYI file

Re: Creating indexes on large tables

2001-10-04 Thread Alexander Belkin
On Wed, Oct 03, 2001 at 05:39:09PM +, Mike Lucente wrote: I'm also unable to create files 2GB with mysqldump, even after a recompile with gcc 2.96, RH 7.1 w/2.4.2 kernel, glibc 2.2.2. AFIAK, it is limitation of ext2 file sistem. You can't create any file lager then 2GB on ext2. [skip]

Re: Creating indexes on large tables

2001-10-03 Thread Adams, Bill TQO
Perhaps your index file (.MYI) is growing larger than 2GB, the file-size limit on 2.2.x kernels? Or, if you have moved the tables with symlinks, MySQL will put the new file (most of the time?) in the configured data directory and not where the symlink points. --Bill Mike Lucente wrote: I'm

Re: Creating indexes on large tables

2001-10-03 Thread David Turner
If this is the case. What are the steps necessary for index rebuilds? Can I specify where the index file is rebuilt? Any idea when we can specify the location of datafiles and indexfiles? Thanks, Dave On Wed, Oct 03, 2001 at 07:57:35AM -0700, Adams, Bill TQO wrote: Perhaps your index file

Re: Creating indexes on large tables

2001-10-03 Thread Adams, Bill TQO
David Turner wrote: If this is the case. What are the steps necessary for index rebuilds? Can I specify where the index file is rebuilt? Any idea when we can specify the location of datafiles and indexfiles? For the kernel: You either need to upgrade to a later 2.4.x series kernel which, I

Re: Creating indexes on large tables

2001-10-03 Thread Mike Lucente
I'm running 2.4.2 and I'm not using symlinks. On Wed, 3 Oct 2001, Adams, Bill TQO wrote: Perhaps your index file (.MYI) is growing larger than 2GB, the file-size limit on 2.2.x kernels? Or, if you have moved the tables with symlinks, MySQL will put the new file (most of the time?) in the

Re: Creating indexes on large tables

2001-10-03 Thread Mike Lucente
I'm also unable to create files 2GB with mysqldump, even after a recompile with gcc 2.96, RH 7.1 w/2.4.2 kernel, glibc 2.2.2. hmmm ... On Wed, 3 Oct 2001, Adams, Bill TQO wrote: Perhaps your index file (.MYI) is growing larger than 2GB, the file-size limit on 2.2.x kernels? Or, if you

RE: Creating indexes on large tables

2001-10-03 Thread LoPresti, Mark
- From: Mike Lucente [mailto:[EMAIL PROTECTED]] Sent: Wednesday, October 03, 2001 1:25 PM To: Adams, Bill TQO Cc: [EMAIL PROTECTED] Subject: Re: Creating indexes on large tables I'm running 2.4.2 and I'm not using symlinks. On Wed, 3 Oct 2001, Adams, Bill TQO wrote: Perhaps your index file

Re: Creating indexes on large tables

2001-10-03 Thread Sergei Golubchik
Hi! On Oct 03, Mike Lucente wrote: I'm running out of space while creating indexes on some fairly large (1.8 GB) tables, even though I have quite a bit of space available in the partition (utilization is at 30%). I know that the create process works as follows (from the manual): Create

Re: Creating indexes on large tables

2001-10-03 Thread Adams, Bill TQO
Apparently you have to compile for large file support and have glibc 2.1.3. http://www.suse.de/~aj/linux_lfs.html I have not used it so I do not know the real-world limitations. Or (for 100MB files): mysqldump db table |split -b 1 - table --Bill Mike Lucente wrote: I'm also

Re: Creating indexes on large tables

2001-10-03 Thread Mike Lucente
This worked once I recompiled the distribution. Thanks. On Wed, 3 Oct 2001, Adams, Bill TQO wrote: Apparently you have to compile for large file support and have glibc 2.1.3. http://www.suse.de/~aj/linux_lfs.html I have not used it so I do not know the real-world limitations. Or (for

Indexes on large tables

2001-08-23 Thread Scott Chamberlain
When I try to create an index on any table with greater than about 200,000 records, it hangs using show processlist shows the process to have died. I have even tried moving the data out of the table, creating the index on the empty table and moving the data back in again, but the process moving

Re: Indexes on large tables

2001-08-23 Thread joseph . bueno
Scott Chamberlain wrote: When I try to create an index on any table with greater than about 200,000 records, it hangs using show processlist shows the process to have died. I have even tried moving the data out of the table, creating the index on the empty table and moving the data back in