I know I don't...:) Learning...I hate databases, always have Steve
-----Original Message----- From: Thomas Eckardt [mailto:thomas.ecka...@thockar.com] Sent: Sunday, October 30, 2011 7:38 AM To: ASSP development mailing list Subject: [Assp-test] Antwort: Re: Antwort: Re: Antwort: Re: Antwort: Re: fixed pre version 2.1.2 11301 Read the GUI 'DBdriver'- you don't know what you do! Thomas Von: Steve Moffat <st...@optimum.bm> An: ASSP development mailing list <assp-test@lists.sourceforge.net> Datum: 30.10.2011 11:10 Betreff: Re: [Assp-test] Antwort: Re: Antwort: Re: Antwort: Re: fixed pre version 2.1.2 11301 Thomas Getting further....but still errors.... Oct-30-11 06:56:33 [Worker_1] Whitelist database error: Can't connect to data source 'dbi:InnoDB :database=assp;host=172.16.16.20' because I can't work out what driver to use (it doesn't seem to contain a 'dbi:driver:' prefix and the DBI_DRIVER env var is not set) at C:/Perl/site/lib/Tie/RDBM.pm line 75 thread 3 Oct-30-11 06:56:33 [Worker_1] Worker_1 started Oct-30-11 06:56:48 [init] Whitelist database error: Can't connect to data source 'dbi:InnoDB :database=assp;host=172.16.16.20' because I can't work out what driver to use (it doesn't seem to contain a 'dbi:driver:' prefix and the DBI_DRIVER env var is not set) at C:/Perl/site/lib/Tie/RDBM.pm line 75 Oct-30-11 06:56:48 [init] Warning: can not use defined database - switching over to use files instead of database assp! Thanks Steve -----Original Message----- From: Thomas Eckardt [mailto:thomas.ecka...@thockar.com] Sent: Sunday, October 30, 2011 3:23 AM To: ASSP development mailing list Subject: [Assp-test] Antwort: Re: Antwort: Re: Antwort: Re: fixed pre version 2.1.2 11301 Has you set the spamdb, delaydb .. to 'DB:' to instruct assp to use databes for this lists? It seems not to be the case. GUI: Write only "DB:" to use a database table instead of a local file, in this case you need to edit the database parameters below Thomas Von: Steve Moffat <st...@optimum.bm> An: ASSP development mailing list <assp-test@lists.sourceforge.net> Datum: 29.10.2011 15:32 Betreff: Re: [Assp-test] Antwort: Re: Antwort: Re: fixed pre version 2.1.2 11301 I have set it all up, per the instructions, I have a database called assp, user assp with all privledges, copied & and added the .add to the DB files to the import folder, however, nothing gets imported and no tables get created...I see nothing in any logs as to why. I'll keep trying. Using MySql 5.1.36, on a remote server...which I can telnet to on 3306 no problem. -----Original Message----- From: Thomas Eckardt [mailto:thomas.ecka...@thockar.com] Sent: Saturday, October 29, 2011 3:31 AM To: ASSP development mailing list Subject: [Assp-test] Antwort: Re: Antwort: Re: fixed pre version 2.1.2 11301 Steve, install BerkeleyDB engine and module and set 'useDB4Rebuild' to ON - will solve your problem. how to move to DB: - install a DB engine of your choice - eg MySQL - create a DB and set max connection to 1000 - use InnoDB as default engine - install the DBD-mysql module - copy all flatfiles you want to move to DB to assp/mysql/dbimport (importDBDir) - rename all files to an extension .add or .rpl (read the GUI for importDBDir ff) - set DBdriver, mydb, myuser, mypassword, backupDBInterval, copyDBToOrgLoc - restart assp - this will import all data - after import restart assp again to cleanup temporary data at least read the GUI for DB stuff, and read the file assp_database_readme.txt. assp_database_readme.txt: This should be a short whitepaper to configure and use ASSP with any supported database. This whitepaper assumes, that you have the needed knowledge about databases and there management! To use other databases then MySQL, to have import-,backup- and export functions and to use databases for the penaltybox and spamdb you need a ASSP version 1.3.6 or above! There has to be a file assp_db_import.cfg in ASSP root directory!!!! requirements: - a database / tablespace whith index/key support (like MySQL,Pg,Oracle,MSSQL,Informix,DB2 and others) - a databaseuser with read/write and Create/Alter-Table permission - perl Tie::RDBM module (from CPAN or PPM) - all also required modules will be also installed by default - perl DBD::(your database) driver - you can see the installed drivers in the Webinterface-section "File Path and Database" under DBdriver. If you can not find a perl driver for your database, you can also use ODBC or ADO - if your OS supports that. configuration: you have to define: - myhost: The host (name or ip address) to connect to the database. Some database drivers do not need this parameter - but it must be already set. - DBdriver: The database driver used to access your database - DBD-driver. The following drivers are available on your system: ADO|AnyData|CSV|DBM|ExampleP|File|Gofer|Mock|ODBC|Oracle|Proxy|SQLRelay|SQLite|SQLite2|Sponge|mysql|mysqlPP If you can not find the driver for your database in this list, you should install it via cpan or ppm! - or if you have installed an ODBC-driver for your database and DBD-ODBC, just create a DSN and use ODBC. Usefull are ADO|DB2|Informix|ODBC|Oracle|Pg|Sybase|mysql|mysqlPP - but any other SQL compatible database should also work. syntax examples: driver,option1,option2,...,... ADO,[DSN=mydsn] DB2 Informix ODBC,DSN=mydsn|driver={SQL Server},Server=server_name Oracle,SID=1|INSTANCE_NAME=myinstance|SERVER=myserver|SERVICE_NAME=myservice_name,[PORT=myport] Pg,[PORT=myport] Sybase,SERVER=myserver,[PORT=myport] mysql,[PORT=myport] mysqlPP,[PORT=myport] The options and there possible or required order depending on the used DBD-driver, please read the drivers documentation, if you do not know the needed option. The username, password, host and databasename are always used from this configuration page. - mydb: This database must exist before starting ASSP, necessary tables will be created automatically into this database. - myuser: the database user - mypassword: the password of the database user There are more parameters to set, but this parameters have default values and they are descripted in the configuration screen! Now define a value "DB:" for all lists and caches you want to use a database table for (whitelist,delaydb,pbdb,spamdb,redlist). You do not need to use all of them, you have the choice to select! If you are here - go back to the top and verify all your settings! This is a good time to restart ASSP - you have to do this any time, you have changed any database related parameters listed above! How ever - ASSP should now be ready to work. If you have made an upgrade form an earlyer version, you can import your old files in to the database. To do this, there are two ways: you can use the ImportMysqlDB-option in the webinterface and import will be done by ASSP every time it starts and it finds a import-file in the import-directory. You need to configure "importDBDir" and you have to copy all files you want to import in to this directory. Now rename this files to *.add or *.rpl what ever you want ASSP to do - an ADD or a REPLACE records in to the database. Files can be: - pbdb.black.db.(add|rpl) - pbdb.mxa.db.(add|rpl) - pbdb.ptr.db(add|rpl) - pbdb.rbl.db.(add|rpl) - pbdb.rwl.db.(add|rpl) - pbdb.spf.db.(add|rpl) - pbdb.uribl.db.(add|rpl) - pbdb.white.db.(add|rpl) - redlist.(add|rpl) - whitelist.(add|rpl) - spamdb.(add|rpl) - spamdb.helo.(add|rpl) - delaydb.(add|rpl) - delaydb.white.(add|rpl) Use the extension "add" or "rpl" to add or replace the records to the tables. Only files for database-enabled tables will be imported "pbdb|spamdb|redlist|whitelist|delaydb"! At this time all functions of ASSP are well tested with MySQL(ODBC/direct),MSSQL(ODBC/ADO) and Oracle(ODBC/direct), but it should work with any other database, as long as you have a perl driver for that. Only if you want to use the import function with you database, you may get DBI errors. In this case the file assp_db_import.cfg should be modified for your database. Please change ASSP in to debug mode, stop ASSP, rename the maillog.txt, prepaire the import directory and start ASSP. Please send the following informations to ASSP group: database type and version - and the maillog.txt with the errors. If you have some knowledge in SQL you can try to add a section for your database to the assp_db_import.cfg file! If you want to replicate databases between several ASSP installations, you have to make sure that the replication processes ignoring duplicate records. For MySQL you have to add the following line in to my.ini: slave-skip-errors=1582 1062 1051 If you use any replication mechanism with Microsoft SQL Server: - Add the attribute 'ROWGUIDCOL' to the column PKEY of each table that should be replicated, before you start replication, because some MSSQL versions will create an extra identity column with that attribute, which will lead in to database errors in ASSP. The replication attributes/constraints have been changed by MS from version to version - please read the documentation for your MSSQL Server. - Set 'preventBulkImport' to on - otherwise the import procedure of ASSP will destroy replication attributes/constraints of the DB tables. If you want to use the BulkImport, you must edit the file 'assp_db_import.cfg' by changing the statements for 'drop primary key' and 'add primary key' according to the requirements of your SQL server version. Thomas Von: Steve Moffat <st...@optimum.bm> An: ASSP development mailing list <assp-test@lists.sourceforge.net> Datum: 28.10.2011 14:45 Betreff: Re: [Assp-test] Antwort: Re: fixed pre version 2.1.2 11301 Flat at the moment, can't get the db's to import, (not a DB guy I'm afraid),still trying. rebuildspamdb is ok until :- "Oct-28-11 07:13:03 c:/assp/notspam Oct-28-11 07:13:05 File Count: 13,095 Oct-28-11 07:13:05 Processing... notspam with 13095 files" Then them memory just builds & builds till it uses the whole 2gig then ASSP crashes.. Steve -----Original Message----- From: Thomas Eckardt [mailto:thomas.ecka...@thockar.com] Sent: Friday, October 28, 2011 9:31 AM To: ASSP development mailing list Subject: [Assp-test] Antwort: Re: fixed pre version 2.1.2 11301 Depending on the configuration (DB or flat file) the rebuildspamdb will use between 200 and 800MB memory. Thomas Von: Steve Moffat <st...@optimum.bm> An: ASSP development mailing list <assp-test@lists.sourceforge.net> Datum: 28.10.2011 14:26 Betreff: Re: [Assp-test] fixed pre version 2.1.2 11301 Hi Thomas Just FYI, no difference here while running rebuildspamdb Steve -----Original Message----- From: Thomas Eckardt [mailto:thomas.ecka...@thockar.com] Sent: Friday, October 28, 2011 3:20 AM To: ASSP development mailing list Subject: [Assp-test] fixed pre version 2.1.2 11301 Hi all, just released a pre fixed version 2.1.2 11301, which fixes partly the growing memory usage issue. I'm just low on time. There are also several changes in this release for the HMM - please read the changed GUI for 'DoHMM' if you use it. I'll try to send an update of the change log this evening ~ '18:00:00' UTC. Thomas DISCLAIMER: ******************************************************* This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the individual to whom it is addressed. This email was multiple times scanned for viruses. There should be no known virus in this email! ******************************************************* ------------------------------------------------------------------------------ The demand for IT networking professionals continues to grow, and the demand for specialized networking skills is growing even more rapidly. Take a complimentary Learning@Cisco Self-Assessment and learn about Cisco certifications, training, and career opportunities. http://p.sf.net/sfu/cisco-dev2dev _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test DISCLAIMER: ******************************************************* This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the individual to whom it is addressed. This email was multiple times scanned for viruses. There should be no known virus in this email! ******************************************************* ------------------------------------------------------------------------------ The demand for IT networking professionals continues to grow, and the demand for specialized networking skills is growing even more rapidly. Take a complimentary Learning@Cisco Self-Assessment and learn about Cisco certifications, training, and career opportunities. http://p.sf.net/sfu/cisco-dev2dev _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test DISCLAIMER: ******************************************************* This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the individual to whom it is addressed. This email was multiple times scanned for viruses. There should be no known virus in this email! ******************************************************* ------------------------------------------------------------------------------ Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test DISCLAIMER: ******************************************************* This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the individual to whom it is addressed. This email was multiple times scanned for viruses. There should be no known virus in this email! ******************************************************* ------------------------------------------------------------------------------ Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test DISCLAIMER: ******************************************************* This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the individual to whom it is addressed. This email was multiple times scanned for viruses. There should be no known virus in this email! ******************************************************* ------------------------------------------------------------------------------ Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test
