Hi all,
The problem is I am loading and indexing a fairly large dataset (~2GB)
and the mysqld process seems to go into a seemingly infinite loop
after loading and indexing a good bit of the data. Unfortunately I
don't know enough about MySQL to be able to debug the situation
better, or provide you with more insightful information. I want to
note though that the problem does not exist in the Windows (Intel)
version.
I am loading several files and creating indexes for them. Am I
running into a size limitation somewhere?
I am running on a Sun Microsystems Sparc (dual UltraSPARC-II 400MHz
CPUs) running Solaris 2.7 with tons of RAM (1GB) and disk (100+ GB).
The mysqld is the pre-compiled 3.23.30 binary:
./bin/mysqladmin Ver 8.13 Distrib 3.23.30-gamma, for sun-solaris2.7 on sparc
I ran for over 20 hrs once with the CPU pegged at 100% before I had to
interrupt the load process. Here is some idea of the size of the load
files (in chronological order and the time it takes to load and index
them (the bigger tables have a leading *):
1. Table: MRATX, records: 9,264, bytes: 534,759, load time: 0s
*2. TABLE: MRCOC, records: 11,834,900, bytes: 478,002,779, load time: ~2 min
INDEX: MRCOC(CUI(6)), index time: ~5 min
3. Table: MRCOLS, records: 170, bytes: 8,336, load time: 0s
*4. TABLE: MRCON, records: 1,734,706, bytes: 125,090,235, load time: ~30s
INDEX: MRCON(CUI), index time: ~8 min
5. Table: MRCUI, records: 84,573, bytes: 2,098,829, load time: 1s
*6. TABLE: MRCXT, records: 13,460,945, bytes: 1,190,736,699, load time: 5.5 min
INDEX: MRCXT(CUI(6)), index time: ~15 min
7. Table: MRDEF, records: 34,095, bytes: 8,845,869, load time: 2 min
Index: MRDEF(CUI), index time: 2s
8. Table: MRFILES, records: 31, bytes: 2,062, load time: 0s
9. Table: MRLO, records: 70,332, bytes: 2,642,851, load time: 1s
Index: MRLO(CUI), index time: 15s
10. Table: MRRANK, records: 348, bytes: 6,555, load time: 0s
*11. TABLE: MRREL, records: 9,599,838, bytes: 390,676,599, load time: 2.5 min
INDEX: MRREL(CUI1(6)), index time: ~10 min
*12. TABLE: MRSAT, records: 5,466,141, bytes: 258,694,230, load time: 2 min
INDEX: MRSAT(CUI(6)), index time: 5 min
*13. TABLE: MRSO, records: 1,877,059, bytes: 90,962,435, load time: 30s
INDEX: MRSO(CUI), index time: 9 min
*14. TABLE: MRSTY, records: 1,000,078, bytes: 37,740,933, load time: 12s
INDEX: MRSTY(CUI), index time: 4 min
*15. TABLE: MRXNS_ENG, records: 1,811,596, bytes: 120,577,185, load time: 40s
INDEX: MRXNS_ENG(CUI(6)), index time: 2 min
*16. TABLE: MRXNW_ENG, records: 6,538,135, bytes: 262,925,590, load time: 1 min, 40 sec
INDEX: MRXNW_ENG(CUI(6)), index time: ???????
*** 15 more files to go with only one big one - the rest are moderate (< 100K
records),
the one has 6.7 million records.
As you can see, even the big files load and index comfortably until I
get to MRXNW_ENG (not the biggest file). Here I am creating an index
of the 6 leftmost chars of CUI (I tried the full column with the same
results).
Any ideas?
Thanks,
--Suresh
---------------------------------------------------------------------
Before posting, please check:
http://www.mysql.com/manual.php (the manual)
http://lists.mysql.com/ (the list archive)
To request this thread, e-mail <[EMAIL PROTECTED]>
To unsubscribe, e-mail <[EMAIL PROTECTED]>
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
