Re: enable and disable keys
Hi Krishna, Can u please give me example of csplit. regards anandkl On 6/16/08, Krishna Chandra Prajapati [EMAIL PROTECTED] wrote: try csplit to break the files into small chunks On Fri, Jun 13, 2008 at 12:21 PM, Ananda Kumar [EMAIL PROTECTED] wrote: How do i split file during ENABLE KEYS On 6/13/08, Krishna Chandra Prajapati [EMAIL PROTECTED] wrote: increase bulk_insert_buffer_size and if possible split the bigger file into small chunks. It will help you. On Thu, Jun 12, 2008 at 1:51 PM, Ananda Kumar [EMAIL PROTECTED] wrote: Hi All, We are doing load data into a table using LOAD DATA INFILE process. Below is the method we are following. 1. create empty table with all the indexes. 2. disable keys 3. Load data using LOAD DATA INFILE, close to 99 Million records which takes around 3 hrs 4 . Enable keys Table size is around 19.5 gb There is one primary key, 2 non unique indexes and one FULLTEXT INDEX. Enable kyes goes fine for couple of hrs with REPAIR BY TMP, but then switches to REPAIR BY KEYCACHE and writes a log in the error log file Warning: Enabling keys got errno 28, retrying What could be the problem. System has 8 cpu and 16GB RAM I have set myisam_max_sort_file_size=98GB myisam_sort_buffer_size=750MB. /tmp folder has 16GB free space. please let me know, this problem is causing lot of dealy for other process to run. regards anandkl -- Krishna Chandra Prajapati MySQL DBA, Ed Ventures e-Learning Pvt.Ltd. 1-8-303/48/15, Sindhi Colony P.G.Road, Secunderabad. Pin Code: 53 Office Number: 040-66489771 Mob: 9912924044 URL: ed-ventures-online.com Email-id: [EMAIL PROTECTED] -- Krishna Chandra Prajapati MySQL DBA, Ed Ventures e-Learning Pvt.Ltd. 1-8-303/48/15, Sindhi Colony P.G.Road, Secunderabad. Pin Code: 53 Office Number: 040-66489771 Mob: 9912924044 URL: ed-ventures-online.com Email-id: [EMAIL PROTECTED]
Re: enable and disable keys
man csplit
try
csplit filename 10 {10}
On Mon, Jun 16, 2008 at 2:22 PM, Ananda Kumar [EMAIL PROTECTED] wrote:
Hi Krishna,
Can u please give me example of csplit.
regards
anandkl
On 6/16/08, Krishna Chandra Prajapati [EMAIL PROTECTED] wrote:
try csplit to break the files into small chunks
On Fri, Jun 13, 2008 at 12:21 PM, Ananda Kumar [EMAIL PROTECTED] wrote:
How do i split file during ENABLE KEYS
On 6/13/08, Krishna Chandra Prajapati [EMAIL PROTECTED] wrote:
increase bulk_insert_buffer_size and if possible split the bigger file
into small chunks. It will help you.
On Thu, Jun 12, 2008 at 1:51 PM, Ananda Kumar [EMAIL PROTECTED]
wrote:
Hi All,
We are doing load data into a table using LOAD DATA INFILE process.
Below is
the method we are following.
1. create empty table with all the indexes.
2. disable keys
3. Load data using LOAD DATA INFILE, close to 99 Million records which
takes
around 3 hrs
4 . Enable keys
Table size is around 19.5 gb
There is one primary key, 2 non unique indexes and one FULLTEXT INDEX.
Enable kyes goes fine for couple of hrs with REPAIR BY TMP, but then
switches to REPAIR BY KEYCACHE and writes a log in the error log
file Warning:
Enabling keys got errno 28, retrying
What could be the problem.
System has 8 cpu and 16GB RAM
I have set myisam_max_sort_file_size=98GB
myisam_sort_buffer_size=750MB.
/tmp folder has 16GB free space.
please let me know, this problem is causing lot of dealy for other
process
to run.
regards
anandkl
--
Krishna Chandra Prajapati
MySQL DBA,
Ed Ventures e-Learning Pvt.Ltd.
1-8-303/48/15, Sindhi Colony
P.G.Road, Secunderabad.
Pin Code: 53
Office Number: 040-66489771
Mob: 9912924044
URL: ed-ventures-online.com
Email-id: [EMAIL PROTECTED]
--
Krishna Chandra Prajapati
MySQL DBA,
Ed Ventures e-Learning Pvt.Ltd.
1-8-303/48/15, Sindhi Colony
P.G.Road, Secunderabad.
Pin Code: 53
Office Number: 040-66489771
Mob: 9912924044
URL: ed-ventures-online.com
Email-id: [EMAIL PROTECTED]
--
Krishna Chandra Prajapati
MySQL DBA,
Ed Ventures e-Learning Pvt.Ltd.
1-8-303/48/15, Sindhi Colony
P.G.Road, Secunderabad.
Pin Code: 53
Office Number: 040-66489771
Mob: 9912924044
URL: ed-ventures-online.com
Email-id: [EMAIL PROTECTED]
Re: enable and disable keys
try csplit to break the files into small chunks On Fri, Jun 13, 2008 at 12:21 PM, Ananda Kumar [EMAIL PROTECTED] wrote: How do i split file during ENABLE KEYS On 6/13/08, Krishna Chandra Prajapati [EMAIL PROTECTED] wrote: increase bulk_insert_buffer_size and if possible split the bigger file into small chunks. It will help you. On Thu, Jun 12, 2008 at 1:51 PM, Ananda Kumar [EMAIL PROTECTED] wrote: Hi All, We are doing load data into a table using LOAD DATA INFILE process. Below is the method we are following. 1. create empty table with all the indexes. 2. disable keys 3. Load data using LOAD DATA INFILE, close to 99 Million records which takes around 3 hrs 4 . Enable keys Table size is around 19.5 gb There is one primary key, 2 non unique indexes and one FULLTEXT INDEX. Enable kyes goes fine for couple of hrs with REPAIR BY TMP, but then switches to REPAIR BY KEYCACHE and writes a log in the error log file Warning: Enabling keys got errno 28, retrying What could be the problem. System has 8 cpu and 16GB RAM I have set myisam_max_sort_file_size=98GB myisam_sort_buffer_size=750MB. /tmp folder has 16GB free space. please let me know, this problem is causing lot of dealy for other process to run. regards anandkl -- Krishna Chandra Prajapati MySQL DBA, Ed Ventures e-Learning Pvt.Ltd. 1-8-303/48/15, Sindhi Colony P.G.Road, Secunderabad. Pin Code: 53 Office Number: 040-66489771 Mob: 9912924044 URL: ed-ventures-online.com Email-id: [EMAIL PROTECTED] -- Krishna Chandra Prajapati MySQL DBA, Ed Ventures e-Learning Pvt.Ltd. 1-8-303/48/15, Sindhi Colony P.G.Road, Secunderabad. Pin Code: 53 Office Number: 040-66489771 Mob: 9912924044 URL: ed-ventures-online.com Email-id: [EMAIL PROTECTED]
Re: enable and disable keys
How do i split file during ENABLE KEYS On 6/13/08, Krishna Chandra Prajapati [EMAIL PROTECTED] wrote: increase bulk_insert_buffer_size and if possible split the bigger file into small chunks. It will help you. On Thu, Jun 12, 2008 at 1:51 PM, Ananda Kumar [EMAIL PROTECTED] wrote: Hi All, We are doing load data into a table using LOAD DATA INFILE process. Below is the method we are following. 1. create empty table with all the indexes. 2. disable keys 3. Load data using LOAD DATA INFILE, close to 99 Million records which takes around 3 hrs 4 . Enable keys Table size is around 19.5 gb There is one primary key, 2 non unique indexes and one FULLTEXT INDEX. Enable kyes goes fine for couple of hrs with REPAIR BY TMP, but then switches to REPAIR BY KEYCACHE and writes a log in the error log file Warning: Enabling keys got errno 28, retrying What could be the problem. System has 8 cpu and 16GB RAM I have set myisam_max_sort_file_size=98GB myisam_sort_buffer_size=750MB. /tmp folder has 16GB free space. please let me know, this problem is causing lot of dealy for other process to run. regards anandkl -- Krishna Chandra Prajapati MySQL DBA, Ed Ventures e-Learning Pvt.Ltd. 1-8-303/48/15, Sindhi Colony P.G.Road, Secunderabad. Pin Code: 53 Office Number: 040-66489771 Mob: 9912924044 URL: ed-ventures-online.com Email-id: [EMAIL PROTECTED]
enable and disable keys
Hi All, We are doing load data into a table using LOAD DATA INFILE process. Below is the method we are following. 1. create empty table with all the indexes. 2. disable keys 3. Load data using LOAD DATA INFILE, close to 99 Million records which takes around 3 hrs 4 . Enable keys Table size is around 19.5 gb There is one primary key, 2 non unique indexes and one FULLTEXT INDEX. Enable kyes goes fine for couple of hrs with REPAIR BY TMP, but then switches to REPAIR BY KEYCACHE and writes a log in the error log file Warning: Enabling keys got errno 28, retrying What could be the problem. System has 8 cpu and 16GB RAM I have set myisam_max_sort_file_size=98GB myisam_sort_buffer_size=750MB. /tmp folder has 16GB free space. please let me know, this problem is causing lot of dealy for other process to run. regards anandkl
Re: enable and disable keys
Ananda Kumar wrote: Hi All, We are doing load data into a table using LOAD DATA INFILE process. Below is the method we are following. 1. create empty table with all the indexes. 2. disable keys 3. Load data using LOAD DATA INFILE, close to 99 Million records which takes around 3 hrs 4 . Enable keys Table size is around 19.5 gb There is one primary key, 2 non unique indexes and one FULLTEXT INDEX. Enable kyes goes fine for couple of hrs with REPAIR BY TMP, but then switches to REPAIR BY KEYCACHE and writes a log in the error log file Warning: Enabling keys got errno 28, retrying What could be the problem. System has 8 cpu and 16GB RAM I have set myisam_max_sort_file_size=98GB myisam_sort_buffer_size=750MB. /tmp folder has 16GB free space. please let me know, this problem is causing lot of dealy for other process to run. regards anandkl barclay# perror 28 OS error code 28: No space left on device I would say you are running out of space. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: enable and disable keys
We have 200GB of free space on the file system where our database is located. On 6/12/08, Ken Menzel [EMAIL PROTECTED] wrote: Ananda Kumar wrote: Hi All, We are doing load data into a table using LOAD DATA INFILE process. Below is the method we are following. 1. create empty table with all the indexes. 2. disable keys 3. Load data using LOAD DATA INFILE, close to 99 Million records which takes around 3 hrs 4 . Enable keys Table size is around 19.5 gb There is one primary key, 2 non unique indexes and one FULLTEXT INDEX. Enable kyes goes fine for couple of hrs with REPAIR BY TMP, but then switches to REPAIR BY KEYCACHE and writes a log in the error log file Warning: Enabling keys got errno 28, retrying What could be the problem. System has 8 cpu and 16GB RAM I have set myisam_max_sort_file_size=98GB myisam_sort_buffer_size=750MB. /tmp folder has 16GB free space. please let me know, this problem is causing lot of dealy for other process to run. regards anandkl barclay# perror 28 OS error code 28: No space left on device I would say you are running out of space.
Re: enable and disable keys
Ananda Kumar wrote: We have 200GB of free space on the file system where our database is located. On 6/12/08, Ken Menzel [EMAIL PROTECTED] wrote: Ananda Kumar wrote: Hi All, We are doing load data into a table using LOAD DATA INFILE process. Below is the method we are following. 1. create empty table with all the indexes. 2. disable keys 3. Load data using LOAD DATA INFILE, close to 99 Million records which takes around 3 hrs 4 . Enable keys Table size is around 19.5 gb There is one primary key, 2 non unique indexes and one FULLTEXT INDEX. Enable kyes goes fine for couple of hrs with REPAIR BY TMP, but then switches to REPAIR BY KEYCACHE and writes a log in the error log file Warning: Enabling keys got errno 28, retrying What could be the problem. System has 8 cpu and 16GB RAM I have set myisam_max_sort_file_size=98GB myisam_sort_buffer_size=750MB. /tmp folder has 16GB free space. please let me know, this problem is causing lot of dealy for other process to run. regards anandkl barclay# perror 28 OS error code 28: No space left on device I would say you are running out of space. What is the value of - show variables like tmpdir ? If you have not set it it will try to use your system /tmp, which does not appear to be big enough. http://dev.mysql.com/doc/refman/5.0/en/temporary-files.html Hope this helps, Ken -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
RE: enable and disable keys
-Original Message- From: Ananda Kumar [mailto:[EMAIL PROTECTED] Sent: Thursday, June 12, 2008 9:41 AM To: [EMAIL PROTECTED] Cc: mysql Subject: Re: enable and disable keys We have 200GB of free space on the file system where our database is located. ---8--- snip If the system is *nix, there's a high probability that the area used for temporary storage (unless specifically defined by a MySQL configuration) and the area that houses your database files are on different partitions--possibly even different storage devices altogether. Is this the case? Enable kyes goes fine for couple of hrs with REPAIR BY TMP, but then switches to REPAIR BY KEYCACHE and writes a log in the error log file Warning: Enabling keys got errno 28, retrying What could be the problem. System has 8 cpu and 16GB RAM I have set myisam_max_sort_file_size=98GB myisam_sort_buffer_size=750MB. /tmp folder has 16GB free space. ---8--- snip OS error code 28: No space left on device I would say you are running out of space. Todd Boyd Web Programmer -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: enable and disable keys
/tmp has 16GB free space On 6/12/08, Boyd, Todd M. [EMAIL PROTECTED] wrote: -Original Message- From: Ananda Kumar [mailto:[EMAIL PROTECTED] Sent: Thursday, June 12, 2008 9:41 AM To: [EMAIL PROTECTED] Cc: mysql Subject: Re: enable and disable keys We have 200GB of free space on the file system where our database is located. ---8--- snip If the system is *nix, there's a high probability that the area used for temporary storage (unless specifically defined by a MySQL configuration) and the area that houses your database files are on different partitions--possibly even different storage devices altogether. Is this the case? Enable kyes goes fine for couple of hrs with REPAIR BY TMP, but then switches to REPAIR BY KEYCACHE and writes a log in the error log file Warning: Enabling keys got errno 28, retrying What could be the problem. System has 8 cpu and 16GB RAM I have set myisam_max_sort_file_size=98GB myisam_sort_buffer_size=750MB. /tmp folder has 16GB free space. ---8--- snip OS error code 28: No space left on device I would say you are running out of space. Todd Boyd Web Programmer
RE: enable and disable keys
From: Ananda Kumar [mailto:[EMAIL PROTECTED] Sent: Thursday, June 12, 2008 10:27 AM To: Boyd, Todd M. Cc: mysql Subject: Re: enable and disable keys /tmp has 16GB free space On 6/12/08, Boyd, Todd M. [EMAIL PROTECTED] wrote: -Original Message- From: Ananda Kumar [mailto:[EMAIL PROTECTED] Sent: Thursday, June 12, 2008 9:41 AM To: [EMAIL PROTECTED] Cc: mysql Subject: Re: enable and disable keys We have 200GB of free space on the file system where our database is located. ---8--- snip If the system is *nix, there's a high probability that the area used for temporary storage (unless specifically defined by a MySQL configuration) and the area that houses your database files are on different partitions--possibly even different storage devices altogether. Is this the case? Enable kyes goes fine for couple of hrs with REPAIR BY TMP, but then switches to REPAIR BY KEYCACHE and writes a log in the error log file Warning: Enabling keys got errno 28, retrying What could be the problem. System has 8 cpu and 16GB RAM I have set myisam_max_sort_file_size=98GB myisam_sort_buffer_size=750MB. /tmp folder has 16GB free space. ---8--- snip OS error code 28: No space left on device I would say you are running out of space. Sorry if this question is stupid, but... okay, your /tmp folder has 16GB available for use. Is this the folder that MySQL has been configured to use? I understand that it should be by default, but it doesn't hurt to examine every facet of a problem with confusing roots. Todd Boyd Web Programmer -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: enable and disable keys
yes, this is the default folder its configured. On 6/12/08, Boyd, Todd M. [EMAIL PROTECTED] wrote: From: Ananda Kumar [mailto:[EMAIL PROTECTED] Sent: Thursday, June 12, 2008 10:27 AM To: Boyd, Todd M. Cc: mysql Subject: Re: enable and disable keys /tmp has 16GB free space On 6/12/08, Boyd, Todd M. [EMAIL PROTECTED] wrote: -Original Message- From: Ananda Kumar [mailto:[EMAIL PROTECTED] Sent: Thursday, June 12, 2008 9:41 AM To: [EMAIL PROTECTED] Cc: mysql Subject: Re: enable and disable keys We have 200GB of free space on the file system where our database is located. ---8--- snip If the system is *nix, there's a high probability that the area used for temporary storage (unless specifically defined by a MySQL configuration) and the area that houses your database files are on different partitions--possibly even different storage devices altogether. Is this the case? Enable kyes goes fine for couple of hrs with REPAIR BY TMP, but then switches to REPAIR BY KEYCACHE and writes a log in the error log file Warning: Enabling keys got errno 28, retrying What could be the problem. System has 8 cpu and 16GB RAM I have set myisam_max_sort_file_size=98GB myisam_sort_buffer_size=750MB. /tmp folder has 16GB free space. ---8--- snip OS error code 28: No space left on device I would say you are running out of space. Sorry if this question is stupid, but... okay, your /tmp folder has 16GB available for use. Is this the folder that MySQL has been configured to use? I understand that it should be by default, but it doesn't hurt to examine every facet of a problem with confusing roots. Todd Boyd Web Programmer
Re: enable and disable keys
increase bulk_insert_buffer_size and if possible split the bigger file into small chunks. It will help you. On Thu, Jun 12, 2008 at 1:51 PM, Ananda Kumar [EMAIL PROTECTED] wrote: Hi All, We are doing load data into a table using LOAD DATA INFILE process. Below is the method we are following. 1. create empty table with all the indexes. 2. disable keys 3. Load data using LOAD DATA INFILE, close to 99 Million records which takes around 3 hrs 4 . Enable keys Table size is around 19.5 gb There is one primary key, 2 non unique indexes and one FULLTEXT INDEX. Enable kyes goes fine for couple of hrs with REPAIR BY TMP, but then switches to REPAIR BY KEYCACHE and writes a log in the error log file Warning: Enabling keys got errno 28, retrying What could be the problem. System has 8 cpu and 16GB RAM I have set myisam_max_sort_file_size=98GB myisam_sort_buffer_size=750MB. /tmp folder has 16GB free space. please let me know, this problem is causing lot of dealy for other process to run. regards anandkl -- Krishna Chandra Prajapati MySQL DBA, Ed Ventures e-Learning Pvt.Ltd. 1-8-303/48/15, Sindhi Colony P.G.Road, Secunderabad. Pin Code: 53 Office Number: 040-66489771 Mob: 9912924044 URL: ed-ventures-online.com Email-id: [EMAIL PROTECTED]
