Re: Important bug in RAID tables
I can't reproduce the error using a different database configuration and I can't use the same database schema to make my test (the machine is now in production state), so I attached to this mail te sql file used to create the tables, this database is used by ASPseek 1.2.0, you can download it at www.aspseek.org, and the problem occurred indexing http://lanazione.monrif.net (almost 3 millions documents, so there were almost 3 millions records in the table 'urlword') - Patrizio Bruno DADA spa / Special Projects Viale Giovine Italia 50122 Firenze Italy tel +39 055200211 fax +39 0552478143 PGP PublicKey available at: http://www.keyserver.net/en/ - # This SQL script will create the necessary tables for ASPSeek. # It should be used for MySQL only. # To create the tables, use something like # mysql -uasp -pmypassword aspseek tables.sql # #drop table wordurl; #drop table wordurl1; #drop table urlword; #drop table urlwords00; #drop table urlwords01; #drop table urlwords02; #drop table urlwords03; #drop table urlwords04; #drop table urlwords05; #drop table urlwords06; #drop table urlwords07; #drop table urlwords08; #drop table urlwords09; #drop table urlwords10; #drop table urlwords11; #drop table urlwords12; #drop table urlwords13; #drop table urlwords14; #drop table urlwords15; #drop table sites; #drop table stat; #drop table robots; #drop table subsets; #drop table spaces; #drop table tmpurl; #drop table wordsite; #drop table citation; #drop table countries; #drop table cache; create table wordurl(word tinyblob not null, word_id integer auto_increment primary key, urls blob, urlcount integer, totalcount integer, unique index(word(64))) PACK_KEYS=1 DELAY_KEY_WRITE=1; create table wordurl1(word tinyblob not null, word_id integer not null, urls blob, urlcount integer, totalcount integer, unique index(word(64)), unique index(word_id)); create table urlword(url_id integer auto_increment primary key, site_id integer not null, deleted tinyint DEFAULT 0 NOT NULL, url varchar(128) not null, next_index_time INT NOT NULL, status int(11) DEFAULT '0' NOT NULL, crc char(32) DEFAULT '' NOT NULL, last_modified varchar(32) DEFAULT '' NOT NULL, etag varchar(48) DEFAULT '' NOT NULL, last_index_time INT NOT NULL, referrer int(11) DEFAULT '0' NOT NULL, tag int(11) DEFAULT '0' NOT NULL, hops int(11) DEFAULT '0' NOT NULL, redir integer, origin integer, unique index(url), index(next_index_time), index(hops,next_index_time), index crc (site_id,crc(8))) DELAY_KEY_WRITE=1 RAID_TYPE=STRIPED RAID_CHUNKS=8 RAID_CHUNKSIZE=153600 PACK_KEYS=1; create table urlwords00(url_id integer NOT NULL, deleted tinyint DEFAULT 0 NOT NULL, wordcount integer, totalcount integer, content_type varchar(48) DEFAULT '' NOT NULL, charset varchar(32) DEFAULT '' NOT NULL, title varbinary(128) DEFAULT '' NOT NULL, txt varbinary(255) DEFAULT '' NOT NULL, docsize int(11) DEFAULT '0' NOT NULL, keywords varchar(255) DEFAULT '' NOT NULL, description varbinary(100) DEFAULT '' NOT NULL, lang varchar(2) DEFAULT '' NOT NULL, words longblob, hrefs longblob, unique index(url_id)) DELAY_KEY_WRITE=1 RAID_TYPE=STRIPED RAID_CHUNKS=10 RAID_CHUNKSIZE=153600; create table urlwords01(url_id integer NOT NULL, deleted tinyint DEFAULT 0 NOT NULL, wordcount integer, totalcount integer, content_type varchar(48) DEFAULT '' NOT NULL, charset varchar(32) DEFAULT '' NOT NULL, title varbinary(128) DEFAULT '' NOT NULL, txt varbinary(255) DEFAULT '' NOT NULL, docsize int(11) DEFAULT '0' NOT NULL, keywords varchar(255) DEFAULT '' NOT NULL, description varbinary(100) DEFAULT '' NOT NULL, lang varchar(2) DEFAULT '' NOT NULL, words longblob, hrefs longblob, unique index(url_id)) DELAY_KEY_WRITE=1 RAID_TYPE=STRIPED RAID_CHUNKS=10 RAID_CHUNKSIZE=153600; create table urlwords02(url_id integer NOT NULL, deleted tinyint DEFAULT 0 NOT NULL, wordcount integer, totalcount integer, content_type varchar(48) DEFAULT '' NOT NULL, charset varchar(32) DEFAULT '' NOT NULL, title varbinary(128) DEFAULT '' NOT NULL, txt varbinary(255) DEFAULT '' NOT NULL, docsize int(11) DEFAULT '0' NOT NULL, keywords varchar(255) DEFAULT '' NOT NULL, description varbinary(100) DEFAULT '' NOT NULL
Re: Important bug in RAID tables
I can't reproduce the error using a different database configuration and I can't use the same database schema to make my test (the machine is now in production state), so I attached to this mail te sql file used to create the tables, this database is used by ASPseek 1.2.0, you can download it at www.aspseek.org, and the problem occurred indexing http://lanazione.monrif.net (almost 3 millions documents, so there were almost 3 millions records in the table 'urlword') - Patrizio Bruno DADA spa / Special Projects Viale Giovine Italia 50122 Firenze Italy tel +39 055200211 fax +39 0552478143 PGP PublicKey available at: http://www.keyserver.net/en/ - # This SQL script will create the necessary tables for ASPSeek. # It should be used for MySQL only. # To create the tables, use something like # mysql -uasp -pmypassword aspseek tables.sql # #drop table wordurl; #drop table wordurl1; #drop table urlword; #drop table urlwords00; #drop table urlwords01; #drop table urlwords02; #drop table urlwords03; #drop table urlwords04; #drop table urlwords05; #drop table urlwords06; #drop table urlwords07; #drop table urlwords08; #drop table urlwords09; #drop table urlwords10; #drop table urlwords11; #drop table urlwords12; #drop table urlwords13; #drop table urlwords14; #drop table urlwords15; #drop table sites; #drop table stat; #drop table robots; #drop table subsets; #drop table spaces; #drop table tmpurl; #drop table wordsite; #drop table citation; #drop table countries; #drop table cache; create table wordurl(word tinyblob not null, word_id integer auto_increment primary key, urls blob, urlcount integer, totalcount integer, unique index(word(64))) PACK_KEYS=1 DELAY_KEY_WRITE=1; create table wordurl1(word tinyblob not null, word_id integer not null, urls blob, urlcount integer, totalcount integer, unique index(word(64)), unique index(word_id)); create table urlword(url_id integer auto_increment primary key, site_id integer not null, deleted tinyint DEFAULT 0 NOT NULL, url varchar(128) not null, next_index_time INT NOT NULL, status int(11) DEFAULT '0' NOT NULL, crc char(32) DEFAULT '' NOT NULL, last_modified varchar(32) DEFAULT '' NOT NULL, etag varchar(48) DEFAULT '' NOT NULL, last_index_time INT NOT NULL, referrer int(11) DEFAULT '0' NOT NULL, tag int(11) DEFAULT '0' NOT NULL, hops int(11) DEFAULT '0' NOT NULL, redir integer, origin integer, unique index(url), index(next_index_time), index(hops,next_index_time), index crc (site_id,crc(8))) DELAY_KEY_WRITE=1 RAID_TYPE=STRIPED RAID_CHUNKS=8 RAID_CHUNKSIZE=153600 PACK_KEYS=1; create table urlwords00(url_id integer NOT NULL, deleted tinyint DEFAULT 0 NOT NULL, wordcount integer, totalcount integer, content_type varchar(48) DEFAULT '' NOT NULL, charset varchar(32) DEFAULT '' NOT NULL, title varbinary(128) DEFAULT '' NOT NULL, txt varbinary(255) DEFAULT '' NOT NULL, docsize int(11) DEFAULT '0' NOT NULL, keywords varchar(255) DEFAULT '' NOT NULL, description varbinary(100) DEFAULT '' NOT NULL, lang varchar(2) DEFAULT '' NOT NULL, words longblob, hrefs longblob, unique index(url_id)) DELAY_KEY_WRITE=1 RAID_TYPE=STRIPED RAID_CHUNKS=10 RAID_CHUNKSIZE=153600; create table urlwords01(url_id integer NOT NULL, deleted tinyint DEFAULT 0 NOT NULL, wordcount integer, totalcount integer, content_type varchar(48) DEFAULT '' NOT NULL, charset varchar(32) DEFAULT '' NOT NULL, title varbinary(128) DEFAULT '' NOT NULL, txt varbinary(255) DEFAULT '' NOT NULL, docsize int(11) DEFAULT '0' NOT NULL, keywords varchar(255) DEFAULT '' NOT NULL, description varbinary(100) DEFAULT '' NOT NULL, lang varchar(2) DEFAULT '' NOT NULL, words longblob, hrefs longblob, unique index(url_id)) DELAY_KEY_WRITE=1 RAID_TYPE=STRIPED RAID_CHUNKS=10 RAID_CHUNKSIZE=153600; create table urlwords02(url_id integer NOT NULL, deleted tinyint DEFAULT 0 NOT NULL, wordcount integer, totalcount integer, content_type varchar(48) DEFAULT '' NOT NULL, charset varchar(32) DEFAULT '' NOT NULL, title varbinary(128) DEFAULT '' NOT NULL, txt varbinary(255) DEFAULT '' NOT NULL, docsize int(11) DEFAULT '0' NOT NULL, keywords varchar(255) DEFAULT '' NOT NULL, description varbinary(100) DEFAULT '' NOT NULL
crash
Compiling MySQL with --with-bdb the mysql daemon crashes at runtime, the crash occures in /lib/libdb.so, I thought it was a linking problem, so i tried to rename the berkeleydb library (libbdb instead of libdb), but the problem is not that. I removed the source installation and installed the binary one (as the documentation says), but I need to use RAID (mysql one not disk RAID) and binary distributions have not that feature. Now I don't remember which function crashes, but I guess it's gethostbyname() or similar. I experienced the problem on Slackware 7.x and on Stampede 0.89/0.90, I have not a RedHat to try on that, the problem doesn't exist on Sun Solaris. If you can reproduce the problem on Slackware gdb is enough to find the crash point. Thanks in advance (you did a great work). Greetings P. - Patrizio Bruno DADA spa / Special Projects Viale Giovine Italia 50122 Firenze Italy tel +39 055200211 fax +39 0552478143 PGP PublicKey available at: http://www.keyserver.net/en/ - - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
