Oops, my spell checker got the better of me: it should be "Fibre" Channel.
Regards, Jerry Schwartz The Infoshop by Global Information Incorporated 195 Farmington Ave. Farmington, CT 06032 860.674.8796 / FAX: 860.674.8341 www.the-infoshop.com >-----Original Message----- >From: Jerry Schwartz [mailto:jschwa...@the-infoshop.com] >Sent: Friday, June 26, 2009 10:22 AM >To: 'Moon's Father'; 'mos' >Cc: mysql@lists.mysql.com >Subject: RE: Indexing dynamics in MySQL Community Edition 5.1.34 > > > >>-----Original Message----- >>From: Moon's Father [mailto:yueliangdao0...@gmail.com] >>Sent: Friday, June 26, 2009 4:12 AM >>To: mos >>Cc: mysql@lists.mysql.com >>Subject: Re: Indexing dynamics in MySQL Community Edition 5.1.34 >> >>Who can please tell me what is mean of "The db storage is on fiber >>channel."? >> >[JS] Fiber Channel (and that is the official way it is spelled, even in >the >USA) is an ultra-high-speed network for disk arrays, computers, and >other >devices. Although the physical medium is usual fiber optic, there is a >lot >more to it than that. It is more like an intranet in some ways, in that >devices have addresses and there is intelligence in the network itself. > >>On Fri, Jun 26, 2009 at 1:05 AM, mos <mo...@fastmail.fm> wrote: >> >>> Mike, >>> I re-posted your Show Status to the group to see if anyone can >>offer a >>> way to speed up the indexing for you. >>> >>> BTW, you are adding ALL of the indexes to the table using ONE sql >>statement >>> right? And not a separate SQL statement to build each index? >>> >>> Mike >>> >>> At 02:01 AM 6/25/2009, you wrote: >>> >>> Like I said in the subject line, I am using 5.1.34. I started with >>>> my-huge.cnf, which says "key_buffer" rather than "key_buffer_size"; >>SHOW >>>> GLOBAL VARIABLES confirms, however, that my key_buffer_size is 8GB. >>>> >>>> That indexing operation finally finished after about 1.5 hours; that >>was >>>> about 0.5 hours ago. Now I am on to other things. Here is the >>status you >>>> suggested: >>>> >>>> +-----------------------------------+-----------+ >>>> | Variable_name | Value | >>>> +-----------------------------------+-----------+ >>>> | Aborted_clients | 0 | >>>> | Aborted_connects | 0 | >>>> | Binlog_cache_disk_use | 0 | >>>> | Binlog_cache_use | 0 | >>>> | Bytes_received | 135 | >>>> | Bytes_sent | 1405 | >>>> | Com_admin_commands | 0 | >>>> | Com_assign_to_keycache | 0 | >>>> | Com_alter_db | 0 | >>>> | Com_alter_db_upgrade | 0 | >>>> | Com_alter_event | 0 | >>>> | Com_alter_function | 0 | >>>> | Com_alter_procedure | 0 | >>>> | Com_alter_server | 0 | >>>> | Com_alter_table | 0 | >>>> | Com_alter_tablespace | 0 | >>>> | Com_analyze | 0 | >>>> | Com_backup_table | 0 | >>>> | Com_begin | 0 | >>>> | Com_binlog | 0 | >>>> | Com_call_procedure | 0 | >>>> | Com_change_db | 0 | >>>> | Com_change_master | 0 | >>>> | Com_check | 0 | >>>> | Com_checksum | 0 | >>>> | Com_commit | 0 | >>>> | Com_create_db | 0 | >>>> | Com_create_event | 0 | >>>> | Com_create_function | 0 | >>>> | Com_create_index | 0 | >>>> | Com_create_procedure | 0 | >>>> | Com_create_server | 0 | >>>> | Com_create_table | 0 | >>>> | Com_create_trigger | 0 | >>>> | Com_create_udf | 0 | >>>> | Com_create_user | 0 | >>>> | Com_create_view | 0 | >>>> | Com_dealloc_sql | 0 | >>>> | Com_delete | 0 | >>>> | Com_delete_multi | 0 | >>>> | Com_do | 0 | >>>> | Com_drop_db | 0 | >>>> | Com_drop_event | 0 | >>>> | Com_drop_function | 0 | >>>> | Com_drop_index | 0 | >>>> | Com_drop_procedure | 0 | >>>> | Com_drop_server | 0 | >>>> | Com_drop_table | 0 | >>>> | Com_drop_trigger | 0 | >>>> | Com_drop_user | 0 | >>>> | Com_drop_view | 0 | >>>> | Com_empty_query | 0 | >>>> | Com_execute_sql | 0 | >>>> | Com_flush | 0 | >>>> | Com_grant | 0 | >>>> | Com_ha_close | 0 | >>>> | Com_ha_open | 0 | >>>> | Com_ha_read | 0 | >>>> | Com_help | 0 | >>>> | Com_insert | 0 | >>>> | Com_insert_select | 0 | >>>> | Com_install_plugin | 0 | >>>> | Com_kill | 0 | >>>> | Com_load | 0 | >>>> | Com_load_master_data | 0 | >>>> | Com_load_master_table | 0 | >>>> | Com_lock_tables | 0 | >>>> | Com_optimize | 0 | >>>> | Com_preload_keys | 0 | >>>> | Com_prepare_sql | 0 | >>>> | Com_purge | 0 | >>>> | Com_purge_before_date | 0 | >>>> | Com_release_savepoint | 0 | >>>> | Com_rename_table | 0 | >>>> | Com_rename_user | 0 | >>>> | Com_repair | 0 | >>>> | Com_replace | 0 | >>>> | Com_replace_select | 0 | >>>> | Com_reset | 0 | >>>> | Com_restore_table | 0 | >>>> | Com_revoke | 0 | >>>> | Com_revoke_all | 0 | >>>> | Com_rollback | 0 | >>>> | Com_rollback_to_savepoint | 0 | >>>> | Com_savepoint | 0 | >>>> | Com_select | 1 | >>>> | Com_set_option | 0 | >>>> | Com_show_authors | 0 | >>>> | Com_show_binlog_events | 0 | >>>> | Com_show_binlogs | 0 | >>>> | Com_show_charsets | 0 | >>>> | Com_show_collations | 0 | >>>> | Com_show_column_types | 0 | >>>> | Com_show_contributors | 0 | >>>> | Com_show_create_db | 0 | >>>> | Com_show_create_event | 0 | >>>> | Com_show_create_func | 0 | >>>> | Com_show_create_proc | 0 | >>>> | Com_show_create_table | 0 | >>>> | Com_show_create_trigger | 0 | >>>> | Com_show_databases | 0 | >>>> | Com_show_engine_logs | 0 | >>>> | Com_show_engine_mutex | 0 | >>>> | Com_show_engine_status | 0 | >>>> | Com_show_events | 0 | >>>> | Com_show_errors | 0 | >>>> | Com_show_fields | 0 | >>>> | Com_show_function_status | 0 | >>>> | Com_show_grants | 0 | >>>> | Com_show_keys | 0 | >>>> | Com_show_master_status | 0 | >>>> | Com_show_new_master | 0 | >>>> | Com_show_open_tables | 0 | >>>> | Com_show_plugins | 0 | >>>> | Com_show_privileges | 0 | >>>> | Com_show_procedure_status | 0 | >>>> | Com_show_processlist | 0 | >>>> | Com_show_profile | 0 | >>>> | Com_show_profiles | 0 | >>>> | Com_show_slave_hosts | 0 | >>>> | Com_show_slave_status | 0 | >>>> | Com_show_status | 1 | >>>> | Com_show_storage_engines | 0 | >>>> | Com_show_table_status | 0 | >>>> | Com_show_tables | 0 | >>>> | Com_show_triggers | 0 | >>>> | Com_show_variables | 1 | >>>> | Com_show_warnings | 0 | >>>> | Com_slave_start | 0 | >>>> | Com_slave_stop | 0 | >>>> | Com_stmt_close | 0 | >>>> | Com_stmt_execute | 0 | >>>> | Com_stmt_fetch | 0 | >>>> | Com_stmt_prepare | 0 | >>>> | Com_stmt_reprepare | 0 | >>>> | Com_stmt_reset | 0 | >>>> | Com_stmt_send_long_data | 0 | >>>> | Com_truncate | 0 | >>>> | Com_uninstall_plugin | 0 | >>>> | Com_unlock_tables | 0 | >>>> | Com_update | 0 | >>>> | Com_update_multi | 0 | >>>> | Com_xa_commit | 0 | >>>> | Com_xa_end | 0 | >>>> | Com_xa_prepare | 0 | >>>> | Com_xa_recover | 0 | >>>> | Com_xa_rollback | 0 | >>>> | Com_xa_start | 0 | >>>> | Compression | OFF | >>>> | Connections | 9 | >>>> | Created_tmp_disk_tables | 0 | >>>> | Created_tmp_files | 13 | >>>> | Created_tmp_tables | 1 | >>>> | Delayed_errors | 0 | >>>> | Delayed_insert_threads | 0 | >>>> | Delayed_writes | 0 | >>>> | Flush_commands | 1 | >>>> | Handler_commit | 0 | >>>> | Handler_delete | 0 | >>>> | Handler_discover | 0 | >>>> | Handler_prepare | 0 | >>>> | Handler_read_first | 0 | >>>> | Handler_read_key | 0 | >>>> | Handler_read_next | 0 | >>>> | Handler_read_prev | 0 | >>>> | Handler_read_rnd | 0 | >>>> | Handler_read_rnd_next | 34 | >>>> | Handler_rollback | 0 | >>>> | Handler_savepoint | 0 | >>>> | Handler_savepoint_rollback | 0 | >>>> | Handler_update | 0 | >>>> | Handler_write | 33 | >>>> | Innodb_buffer_pool_pages_data | 19 | >>>> | Innodb_buffer_pool_pages_dirty | 0 | >>>> | Innodb_buffer_pool_pages_flushed | 0 | >>>> | Innodb_buffer_pool_pages_free | 493 | >>>> | Innodb_buffer_pool_pages_misc | 0 | >>>> | Innodb_buffer_pool_pages_total | 512 | >>>> | Innodb_buffer_pool_read_ahead_rnd | 1 | >>>> | Innodb_buffer_pool_read_ahead_seq | 0 | >>>> | Innodb_buffer_pool_read_requests | 77 | >>>> | Innodb_buffer_pool_reads | 12 | >>>> | Innodb_buffer_pool_wait_free | 0 | >>>> | Innodb_buffer_pool_write_requests | 0 | >>>> | Innodb_data_fsyncs | 3 | >>>> | Innodb_data_pending_fsyncs | 0 | >>>> | Innodb_data_pending_reads | 0 | >>>> | Innodb_data_pending_writes | 0 | >>>> | Innodb_data_read | 2494464 | >>>> | Innodb_data_reads | 25 | >>>> | Innodb_data_writes | 3 | >>>> | Innodb_data_written | 1536 | >>>> | Innodb_dblwr_pages_written | 0 | >>>> | Innodb_dblwr_writes | 0 | >>>> | Innodb_log_waits | 0 | >>>> | Innodb_log_write_requests | 0 | >>>> | Innodb_log_writes | 1 | >>>> | Innodb_os_log_fsyncs | 3 | >>>> | Innodb_os_log_pending_fsyncs | 0 | >>>> | Innodb_os_log_pending_writes | 0 | >>>> | Innodb_os_log_written | 512 | >>>> | Innodb_page_size | 16384 | >>>> | Innodb_pages_created | 0 | >>>> | Innodb_pages_read | 19 | >>>> | Innodb_pages_written | 0 | >>>> | Innodb_row_lock_current_waits | 0 | >>>> | Innodb_row_lock_time | 0 | >>>> | Innodb_row_lock_time_avg | 0 | >>>> | Innodb_row_lock_time_max | 0 | >>>> | Innodb_row_lock_waits | 0 | >>>> | Innodb_rows_deleted | 0 | >>>> | Innodb_rows_inserted | 0 | >>>> | Innodb_rows_read | 0 | >>>> | Innodb_rows_updated | 0 | >>>> | Key_blocks_not_flushed | 26 | >>>> | Key_blocks_unused | 6844469 | >>>> | Key_blocks_used | 676158 | >>>> | Key_read_requests | 635624989 | >>>> | Key_reads | 12664 | >>>> | Key_write_requests | 112359740 | >>>> | Key_writes | 689890 | >>>> | Last_query_cost | 10.499000 | >>>> | Max_used_connections | 2 | >>>> | Not_flushed_delayed_rows | 0 | >>>> | Open_files | 70 | >>>> | Open_streams | 0 | >>>> | Open_table_definitions | 38 | >>>> | Open_tables | 37 | >>>> | Opened_files | 312 | >>>> | Opened_table_definitions | 0 | >>>> | Opened_tables | 0 | >>>> | Prepared_stmt_count | 0 | >>>> | Qcache_free_blocks | 1 | >>>> | Qcache_free_memory | 33536880 | >>>> | Qcache_hits | 0 | >>>> | Qcache_inserts | 0 | >>>> | Qcache_lowmem_prunes | 0 | >>>> | Qcache_not_cached | 12 | >>>> | Qcache_queries_in_cache | 0 | >>>> | Qcache_total_blocks | 1 | >>>> | Queries | 98 | >>>> | Questions | 3 | >>>> | Rpl_status | NULL | >>>> | Select_full_join | 0 | >>>> | Select_full_range_join | 0 | >>>> | Select_range | 0 | >>>> | Select_range_check | 0 | >>>> | Select_scan | 1 | >>>> | Slave_open_temp_tables | 0 | >>>> | Slave_retried_transactions | 0 | >>>> | Slave_running | OFF | >>>> | Slow_launch_threads | 0 | >>>> | Slow_queries | 0 | >>>> | Sort_merge_passes | 0 | >>>> | Sort_range | 0 | >>>> | Sort_rows | 0 | >>>> | Sort_scan | 0 | >>>> | Ssl_accept_renegotiates | 0 | >>>> | Ssl_accepts | 0 | >>>> | Ssl_callback_cache_hits | 0 | >>>> | Ssl_cipher | | >>>> | Ssl_cipher_list | | >>>> | Ssl_client_connects | 0 | >>>> | Ssl_connect_renegotiates | 0 | >>>> | Ssl_ctx_verify_depth | 0 | >>>> | Ssl_ctx_verify_mode | 0 | >>>> | Ssl_default_timeout | 0 | >>>> | Ssl_finished_accepts | 0 | >>>> | Ssl_finished_connects | 0 | >>>> | Ssl_session_cache_hits | 0 | >>>> | Ssl_session_cache_misses | 0 | >>>> | Ssl_session_cache_mode | NONE | >>>> | Ssl_session_cache_overflows | 0 | >>>> | Ssl_session_cache_size | 0 | >>>> | Ssl_session_cache_timeouts | 0 | >>>> | Ssl_sessions_reused | 0 | >>>> | Ssl_used_session_cache_entries | 0 | >>>> | Ssl_verify_depth | 0 | >>>> | Ssl_verify_mode | 0 | >>>> | Ssl_version | | >>>> | Table_locks_immediate | 101 | >>>> | Table_locks_waited | 0 | >>>> | Tc_log_max_pages_used | 0 | >>>> | Tc_log_page_size | 0 | >>>> | Tc_log_page_waits | 0 | >>>> | Threads_cached | 0 | >>>> | Threads_connected | 2 | >>>> | Threads_created | 2 | >>>> | Threads_running | 2 | >>>> | Uptime | 6952 | >>>> | Uptime_since_flush_status | 6952 | >>>> +-----------------------------------+-----------+ >>>> >>>> Thanks, >>>> Mike Spreitzer >>>> >>>> >>>> >>>> mos <mo...@fastmail.fm> >>>> >>>> 06/25/09 02:32 AM >>>> To >>>> mysql@lists.mysql.com >>>> cc >>>> Subject >>>> Re: Indexing dynamics in MySQL Community Edition 5.1.34 >>>> >>>> >>>> >>>> >>>> At 12:37 AM 6/25/2009, you wrote: >>>> >Actually, my characterization of the current state is wrong. It >>appears >>>> >that one core is completely busy, I suppose MySQL does this >indexing >>work >>>> >in a single thread. Is it reasonable for indexing to be CPU bound? >>>> > >>>> > >>>> >my.cnf based on my-huge.cnf, expanding key_buffer to 8G, >>>> >myisam_sort_buffer_size to 256M, and putting tmpdir on the fiber >>channel >>>> >disk. >>>> >>>> Mike, >>>> You mean "key_buffer_size" don't you and not "key_buffer"? If you >>are >>>> using MySQL 5.0 then the upper limit is 4gb but 5.1 allows for more >>than >>>> 4gb. >>>> Also try increasing "sort_buffer_size". >>>> >>>> Posting your "Show Status" will help people see where the bottle >neck >>is. >>>> >>>> Mike >>>> >>>> >>>> -- >>>> MySQL General Mailing List >>>> For list archives: http://lists.mysql.com/mysql >>>> To unsubscribe: >>http://lists.mysql.com/mysql?unsub=mspre...@us.ibm.com >>>> >>>> >>> >>> -- >>> MySQL General Mailing List >>> For list archives: http://lists.mysql.com/mysql >>> To unsubscribe: >>> http://lists.mysql.com/mysql?unsub=yueliangdao0...@gmail.com >>> >>> >> >> >>-- >>David Yeung, >>MySQL Senior Support Engineer, >>Sun Gold Partner. >>My Blog:http://yueliangdao0608.cublog.cn > > > > >-- >MySQL General Mailing List >For list archives: http://lists.mysql.com/mysql >To unsubscribe: http://lists.mysql.com/mysql?unsub=jschwa...@the- >infoshop.com -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/mysql?unsub=arch...@jab.org
