Re: [firebird-support] FB lock files
Hi Rudi, You did not provide all required information to give you a reasonable answer. At least, post fb_lock_print -d output. Regards, Alexey Kovyazin Try HQbird now! www.hqbird.com ++ Visit http://www.firebirdsql.org and click the Documentation item on the main (top) menu. Try FAQ and other links from the left-side menu there. Also search the knowledgebases at http://www.ibphoenix.com/resources/documents/ ++ Yahoo Groups Links <*> To visit your group on the web, go to: http://groups.yahoo.com/group/firebird-support/ <*> Your email settings: Individual Email | Traditional <*> To change settings online go to: http://groups.yahoo.com/group/firebird-support/join (Yahoo! ID required) <*> To change settings via email: firebird-support-dig...@yahoogroups.com firebird-support-fullfeatu...@yahoogroups.com <*> To unsubscribe from this group, send an email to: firebird-support-unsubscr...@yahoogroups.com <*> Your use of Yahoo Groups is subject to: https://info.yahoo.com/legal/us/yahoo/utos/terms/
Re: [firebird-support] Replication SW experience
Hi, Try IBReplicator. Regards, Alexey Kovyazin IBSurgeon Hi all, we are preparing new project with bidirectional replication. Customer idea is to have master database in head quoter and slave databases on production plant (to solve network performance and availability issues). Witch replication SW you can recommend for this bidirectional replication? What is typical issues and weakness of this SW. Thank you. Slavek -- Ing. Slavomir Skopalik Executive Head Elekt Labs s.r.o. Collection and evaluation of data from machines and laboratories by means of system MASA (http://www.elektlabs.cz/m2demo) -- Address: Elekt Labs s.r.o. Chaloupky 158 783 72 Velky Tynec Czech Republic -- Mobile: +420 724 207 851 icq:199 118 333 skype:skopaliks e-mail:skopa...@elektlabs.cz http://www.elektlabs.cz
Re: [firebird-support] Firebird for a web application
Hi Steve, What kind of monitoring are you doing with Nagios? Do you mean this plugin? http://exchange.nagios.org/directory/Plugins/Databases/check_firebird-2Epy/details Normally, Firebird monitoring should include: 1) Transactions monitoring, including long-running and stuck transactions 2) # of simultaneous connections, statements, transactions, and associated counters (memory, IO) 3) Temp files size and quantity 4) Lock table parameters monitoring 5) Firebird.log monitoring 6) Indices health monitoring: activated/non-activated, non-restored 7) Database files size monitoring, including delta files in case of nbackup lock and some others. Regards, Alexey Kovyazin IBSurgeon www.ib-aid.com Hi Mirco, We have written multiple java EE web applications with Firebird on linux as the database. Usually we will use Glassfish (or Payara) as the app server and run Firebird in classic or superclassic form. We will usually use Nagios to monitor the servers and databases. My only complaint is that sometimes we can get the lock manager bogged down when we are really pounding a database with a large amount of small transactions. Otherwise we are overall pretty happy. Good luck! -steve On Wed, Nov 18, 2015 at 2:42 PM, mirco.malag...@ingeniaonline.it <mailto:mirco.malag...@ingeniaonline.it> [firebird-support] <firebird-support@yahoogroups.com <mailto:firebird-support@yahoogroups.com>> wrote: Hi all here, I want to ask some question about using Firebird in a production environment for a web application. My experience is more then 12 years with Firebird for our client server application and have to say is a very good experience. Now that application is being ported to web by a complete rewrite. From an architectural point the database is single instance and multi-tenant, using logical tenant ids. The application is a rather standard JavaEE one. This means that all of our customers will have all their data together and obviously my main concerns are reliability, availability, performance and maintainability. The application is mostly interactive in an OLTP fashion, with little or no datawarehousing. We expect to have a production database of more or less 200 GB in size. The system will be Linux-based hosted somewhere by our provider. We now have to choose between Firebird and other engines, so I have to asses: - tools available for effective remote monitoring, analysis, tuning and troubleshooting I'm told that here standard names are nagios, cacti, SNMP and others - experience by someone that had worked or is working on system of this kind My intention is to stay with Firebird because my experience is positive and like to stay in an environment that take simplicity as a value, but I want to do what will need to be done well, anyway. Any help is greatly appreciated. Mirco
Re: [firebird-support] Interbase 5.6 (Windows 98) not available on network
Hi Virgo, You should be able to connect to this database with your Firebird (except 3.0). There could be incompatibilities, of course, like reserved words (YEAR, TYPE), but in general it should work for simple SELECT * FROM table. Regards, Alexey Kovyazin IBSurgeon www.ib-aid.com It is offtopic question, but I dont really know where to ask and here are probably people, who know someting about older Interbase versions too. Customer is interested in using data from existing Interbase 5.6 database in our application (it is currently entered manually). But the database is on Windows 98 computer (because specific hardware connected to it) and that Interbase does not seem to be available from network at all. Could it be, that depending of the Interbase licence network connections are not available at all? There was some licence file in Interbase directory, that seemed to indicate 2 user limit, but nothing else. -- Virgo Pärna virgo.pa...@mail.ee
[firebird-support] Firebird Language Reference - Call For Reviewers
Hi All, The Firebird Docs team is calling for people who are fluent in both English and Firebird's SQL to assist with reviewing the English text of the Firebird 2.5 Language Reference manual. Of 10 chapters and 8 Appendices, 4.5 chapters are still untouched by reviewers. It would be good to have the reviewing done to coordinate with the forthcoming 2.5.5 release but correctness takes priority. Still to do are: half of the DDL chapter, DML, PSQL, Functions and Variables, Transactions. If you feel able to help with the review, please subscribe to the [firebird-docs] list (send any email to firebird-docs-requ...@lists.sourceforge.net) and make yourself and your preferred topics known. Regards, Alexey Kovyazin IBSurgeon www.ib-aid.com
Re: [Firebird-docs] Let's move Firebird Langref to public beta
Hi, >We need reviewers who are fluent in English AND SQL. I am more than happy to coordinate so we can avoid covering territory that has already been covered. Please write news item to distribute at firebirdsql.org and through other channels - kind of Call for reviewers. I am sure there will be several volunteers which will satisfy your strict requirements. And, if it will be short and closed list, should we just give your contact email to them? Or suggest to subscribe to firebird-docs? Regards, Alexey -- ___ Firebird-docs mailing list Firebird-docs@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/firebird-docs
Re: [firebird-support] Running gfix and gbak from windows service
Hi, this is a known bug with Services API in 2.5.3 and 2.5.5. We had the same problem with our HQbird FBDataGuard, and with our report it was fixed in 255. Use 2.5.5 - it has this fix, and it is in pre-release state, and in general it's much more stable than 2.5.3 and 2.5.4. Regards, Alexey Kovyazin IBSurgeon www.ib-aid.com We using both gfix and gbak from windows service to perform routine maintenance operations such as moving db to shutdown mode performing check and then backup then online mode This works fine on Firebird 2.5.2 however it does not work on 2.5.3 & 2.5.4 The gfix or gbak just start running then hangs for hours doing nothing till I terminate the process The problem seems to exists on windows 7 & 8.1 don't know about other OS's I tried running the service using user account instead of the system account but it did not help Does anyone has a suggestion or work around ?
Re: [firebird-support] Re: Firebird replication help needed
Hi, Try IBReplicator (commercial) instead. Regards, Alexey Kovyazin IBSurgeon I've downloaded the FB Replicator and tryed it on my database. When I want to add it as a souce database I enter path to the DB user pass and click save, but it gives me the following error: ISC ERROR CODE: 335544323 ERROR MESSAGE: file is not a valid database The problem is that it is ;). After 4-5 attampts it gives me another error with something about a closed DataSet. What should I do? Is there any documentation about it? I googled the error and ... nothing. Thank you
Re: [firebird-support] Securing database against corruption on systems that suddenly get turned off
Hi, In addition to FW On and UPS, I suggest to look at our tool FBDataGuard (http://ib-aid.com/en/fbdataguard), which is specifically designed to protect databases against corruptions (among other features). FBDataGuard stores a copy of raw metadata in the repository outside database, and if corruption happens, this repository will be used to recover database with our recovery tool (FirstAID). In our experience such approach increases chances to recover up to 99%. Regards, Alexey Kovyazin IBSurgeon Hi, We have FirebirdSQL (2.1) running on a client computer (Windows). This client has some problems with his power grid which causes the PC to suddenly and unexpectedly shut down in infrequent intervals (usually once or twice per day). Most of the time this doesn’t cause any problems, but once in a while this causes the database to be corrupted. I’m not at all surprised that the database gets corrupted like this (as turning off a computer without shutting everything down gracefully can have that effect). Are there any options available that can make a database more sturdy against these kinds of corruptions? Cheers Glenn Thomas Denne epost har blitt kontrollert for virus av Comendo Norge AS <http://www.comendo.no> This e-mail has been scanned for viruses by Comendo Norge AS <http://www.comendo.no>
Re: [firebird-support] Firebird 2.5 Language Reference
Hi, Translation was completed several weeks ago, now Helen Borrie performs proof-reading and editing of the text. Recent preview version of LR looks very promising. Regards, Alexey Kovyazin IBSurgeon Hello everybody Do you know what has happened with the translation of the document "Firebird 2.5 Language Reference" from Russian to English? They had requested for donation with the promise that their work would be ready in February 2015. The donation was made, now it is September 2015, but without news about the document translated. I want to translate from English to Spanish (and for free, I don't want to receive money for that). I don't know much Russian and the Google translator is not good from Russian to Spanish. Greetings. Walter.
Re: [firebird-support] Firebird 2.5 Language Reference
Hi, Translation was completed several weeks ago, now Helen Borrie performs proof-reading and editing of the text. Recent preview version of LR looks very promising. Regards, Alexey Kovyazin IBSurgeon Hello everybody Do you know what has happened with the translation of the document "Firebird 2.5 Language Reference" from Russian to English? They had requested for donation with the promise that their work would be ready in February 2015. The donation was made, now it is September 2015, but without news about the document translated. I want to translate from English to Spanish (and for free, I don't want to receive money for that). I don't know much Russian and the Google translator is not good from Russian to Spanish. Greetings. Walter.
Re: [firebird-support] What is better: UPDATE or DELETE + INSERT?
Hi, See page 20-21 here http://ru.scribd.com/doc/20128182/The-InterBase-and-Firebird-Developer-Magazine-Issue-2-2005 Regards, Alexey Kovyazin IBSurgeon Hello Sean, and everybody That's a very interesting and very important theme: "the new record version will only include the updated fields -- not a full copy of the row" Do you know where I can find a document, web-page, book or video that explains that? If it has images or graphics, much better. Thanks in advance. Greetings. Walter.
Re: [firebird-support] HUGE Log File
Hi, Usually such huge log is related with a database corruption. Can you please send here small excerpt from the most recent records of firebird.log (10-15 lines)? Regards, Alexey Kovyazin IBSurgeon
Re: [firebird-support] Growing security2.fdb
Hi Neil, Run DBInfo from IBSurgeon Free tools and check what pages are there. I suppose there are many TIPS, which indicate transactions. Verify it with gstat -h transaction markers values. Regards, Alexey Kovyazin IBSurgeon Hello Something I have noticed with Firebird v2.1 with Windows 32 & 64 bit Superserver & Classic and is that the security2.fdb file grows substantially and keeps on growing. We use just a single user for database access. I have one system at the moment where it is 50Meg but have seen it at 200 meg or 300 meg or even larger. Is this a problem, should it do this, why does it do this? Any ideas? Cheers, Neil Pickles - n...@csy.co.uk <mailto:n...@csy.co.uk>
Re: ODP: Re: [firebird-support] About firebird performance
Hi Karol,
I know it from our experience.
The explanation that big page cache requires extra resources for
synchronization, and experiments shows that combination of 10k buffers
and enabled file cache gives the best performance for SuperServer 2.5.
However, in 3.0 situation is improved, and 100k is normal value (but
still requires cache heating).
Regards,
Alexey Kovyazin
IBSurgeon
Hi,
For superserver this should be as high as possible. Why you
recommended 1 value? I always set it to highest possible value in
current environment compared to size of database. And i always disable
system cache
Regards,
Karol Bieniaszewski
Oryginalna wiadomość
Od: "Alexey Kovyazin a...@ib-aid.com [firebird-support]"
<firebird-support@yahoogroups.com>
Data: 05.09.2015 19:06 (GMT+01:00)
Do: firebird-support@yahoogroups.com
Temat: Re: [firebird-support] About firebird performance
Hi Hector,
I discovered something else quite interesting:
I realized both IB and FB dbs have pagebuffers set to 100.000. I
changed FB to 0 and now it works like I expected!!..Same query now
completes on FB on 50 sec. It seems this is the problem although I
don't understand why.
100 000 is too high for Firebird SuperServer, it should be set to 1.
You can use optimized Firebird configuration files
http://ib-aid.com/en/optimized-firebird-configuration/
Regards,
Alexey Kovyazin
IBSurgeon
Nevertheless, I'll try on a physical machine as you and Carlos
suggest and see how it behaves.
2015-09-05 15:47 GMT+02:00 Alexey Kovyazin a...@ib-aid.com
<mailto:a...@ib-aid.com> [firebird-support]
<firebird-support@yahoogroups.com>:
Hi Hector,
Thanks for statistics, it clarifies situation.
There is 304880 data pages, each is 4kb, so Firebird need to read
1.1Gb of data to count records.
Count uses NATURAL scan, so it's a simple set of disk reads, CPU
is not involved.
Regular SATA3 disk should read 30-70Mb per second (I assume
database is not fragmented, since you told it was freshly
restored), it gives us estimation from 15 to 30 seconds.
So, I think there is a disk IO problem.
Try it on another computer (better not virtual).
Regards,
Alexey
He again Alexey,
As I suspected, my problem is not caused by GC:
gstat over the table reported this:
TABLE1 (503)
Primary pointer page: 9374, Index root page: 9375
Average record length: 317.63, total records: 3261775
Average version length: 0.00, total versions: 0, max versions: 0
Data pages: 304880, data page slots: 304880, average fill: 90%
Also, as you suggested ran the query twice a got exaclty the
same times: 51minutes to complete!!!
I must have something obvious which is killing firebird
performance, but cannot guess it.
Any help would be appretiated.
2015-09-05 11:59 GMT+02:00 Alexey Kovyazin a...@ib-aid.com
[firebird-support] <firebird-support@yahoogroups.com>:
Hi Hector,
So you finally decided to try Firebird - that's good.
I think that you are facing garbage collection problem - if
there are a lot of record versions in the TABLE1 which are
not interested to any transaction, your query will force
garbage collection, and it can take some time.
How to check? run SELECT count(*) twice and compare
execution times, and other query statistics (reads/writes).
Also, run gstat -a -r and check information for
TABLE1 - VERSIONS and MAX VERSIONS, if there are big numbers
there, problem is certainly related with record versions,
with the initial cause in wrong transactions management -
i.e., long-running write transactions or forced rollbacks.
Regards,
Alexey Kovyazin
IBSurgeon
I'm doing some basic tests with Firebird and I'm facing
something I
cannot understand (I'm a newbie to Firebird which has
worked with
IB7.5 for years, so I apologize if I ask something obvious):
- I have a linux server with firebird 2.5.4 Superserver:
multi-core (4), 3GB RAM
- I placed a "huge" database: 1000 tables, 9GB
- When I issue a query like this "select count(*) from
TABLE1" it
takes very long time to complete (>30 min).
- TABLE 1 has 3 million records
As I told you, I'm quite used to IB7.5, but I guess this is
not normal
at all...probably I'm missing something but I couldn't find any
document which gives me an idea of what I'm doing wrong.
With same hardware an IB7.5 same query took 40 sec to
complete (first
time issued, no cache).
Could anyone help?
--
--
Planatec Software S.L. ** <http://www.planatec.es>
telf: +34 964 340 560 <tel:%
Re: [firebird-support] About firebird performance
Hi Hector, I discovered something else quite interesting: I realized both IB and FB dbs have pagebuffers set to 100.000. I changed FB to 0 and now it works like I expected!!..Same query now completes on FB on 50 sec. It seems this is the problem although I don't understand why. 100 000 is too high for Firebird SuperServer, it should be set to 1. You can use optimized Firebird configuration files http://ib-aid.com/en/optimized-firebird-configuration/ Regards, Alexey Kovyazin IBSurgeon Nevertheless, I'll try on a physical machine as you and Carlos suggest and see how it behaves. 2015-09-05 15:47 GMT+02:00 Alexey Kovyazin a...@ib-aid.com <mailto:a...@ib-aid.com> [firebird-support] <firebird-support@yahoogroups.com <mailto:firebird-support@yahoogroups.com>>: Hi Hector, Thanks for statistics, it clarifies situation. There is 304880 data pages, each is 4kb, so Firebird need to read 1.1Gb of data to count records. Count uses NATURAL scan, so it's a simple set of disk reads, CPU is not involved. Regular SATA3 disk should read 30-70Mb per second (I assume database is not fragmented, since you told it was freshly restored), it gives us estimation from 15 to 30 seconds. So, I think there is a disk IO problem. Try it on another computer (better not virtual). Regards, Alexey He again Alexey, As I suspected, my problem is not caused by GC: gstat over the table reported this: TABLE1 (503) Primary pointer page: 9374, Index root page: 9375 Average record length: 317.63, total records: 3261775 Average version length: 0.00, total versions: 0, max versions: 0 Data pages: 304880, data page slots: 304880, average fill: 90% Also, as you suggested ran the query twice a got exaclty the same times: 51minutes to complete!!! I must have something obvious which is killing firebird performance, but cannot guess it. Any help would be appretiated. 2015-09-05 11:59 GMT+02:00 Alexey Kovyazin a...@ib-aid.com <mailto:a...@ib-aid.com> [firebird-support] <firebird-support@yahoogroups.com <mailto:firebird-support@yahoogroups.com>>: Hi Hector, So you finally decided to try Firebird - that's good. I think that you are facing garbage collection problem - if there are a lot of record versions in the TABLE1 which are not interested to any transaction, your query will force garbage collection, and it can take some time. How to check? run SELECT count(*) twice and compare execution times, and other query statistics (reads/writes). Also, run gstat -a -r and check information for TABLE1 - VERSIONS and MAX VERSIONS, if there are big numbers there, problem is certainly related with record versions, with the initial cause in wrong transactions management - i.e., long-running write transactions or forced rollbacks. Regards, Alexey Kovyazin IBSurgeon I'm doing some basic tests with Firebird and I'm facing something I cannot understand (I'm a newbie to Firebird which has worked with IB7.5 for years, so I apologize if I ask something obvious): - I have a linux server with firebird 2.5.4 Superserver: multi-core (4), 3GB RAM - I placed a "huge" database: 1000 tables, 9GB - When I issue a query like this "select count(*) from TABLE1" it takes very long time to complete (>30 min). - TABLE 1 has 3 million records As I told you, I'm quite used to IB7.5, but I guess this is not normal at all...probably I'm missing something but I couldn't find any document which gives me an idea of what I'm doing wrong. With same hardware an IB7.5 same query took 40 sec to complete (first time issued, no cache). Could anyone help? -- -- Planatec Software S.L. ** <http://www.planatec.es> <http://www.planatec.es> telf: +34 964 340 560 <tel:%2B34%20964%20340%20560> ** fax: +34 961 130 921 <tel:%2B34%20961%20130%20921> -- Planatec Software S.L. ** <http://www.planatec.es> telf: +34 964 340 560 <tel:%2B34%20964%20340%20560> ** fax: +34 961 130 921 <tel:%2B34%20961%20130%20921> -- Planatec Software S.L. ** <http://www.planatec.es> telf: +34 964 340 560 ** fax: +34 961 130 921
Re: [firebird-support] Firebird backup on virtual machine
Hi, I can do regular backup with gbak but i look for some smarter solution to. To backup any of the databases with VM snapshots or similar mechanisms a series of special preparation and post-backup steps must be fulfilled, or database should be in archivelog (Oracle) mode. You can use nbackup to lock database before VM snapshot, in this case only delta will be at risk. However, nbackup-only solution is not smart, since it does check an integrity of database, as gbak does. We recommend to use combination of nbackup and gbak. Regards, Alexey Kovyazin IBSurgeon ++ Visit http://www.firebirdsql.org and click the Documentation item on the main (top) menu. Try FAQ and other links from the left-side menu there. Also search the knowledgebases at http://www.ibphoenix.com/resources/documents/ ++ Yahoo Groups Links * To visit your group on the web, go to: http://groups.yahoo.com/group/firebird-support/ * Your email settings: Individual Email | Traditional * To change settings online go to: http://groups.yahoo.com/group/firebird-support/join (Yahoo! ID required) * To change settings via email: firebird-support-dig...@yahoogroups.com firebird-support-fullfeatu...@yahoogroups.com * To unsubscribe from this group, send an email to: firebird-support-unsubscr...@yahoogroups.com * Your use of Yahoo Groups is subject to: https://info.yahoo.com/legal/us/yahoo/utos/terms/
Re: [firebird-support] FB 2.5 Lock conflict on no wait transaction
Hi Hernado, You are the third person during several days with this question. Can you please post the full error text? Otherwise it is not possible to provide any help. Regards, Alexey Hi to all, From several days ago we are having trouble with Lock conflict on no wait transaction on a Firebird 2.5 server thas was working fine since several months ago on a Windows 2008 Server. We use gfix with -list option but it seems not to be any transaction pending. The gfix -commit all command has no efect. The only way to unlock the database is restarting the firebird service. There have not been changes on harware neither software in the server. Any help will be aprreciated. Regards, Hernando.
Re: [firebird-support] Re: DeadLock Conflict
Hi, Please provide full error text and detailed description of the problem. Regards, Alexey Kovyazin IBSurgeon Hi all I experience the same problem. Is there a tutorial to track theese kind of problems? tks Razvan
Re: [firebird-support] DeadLock Conflict
Hi, Probably you mean Lock conflict, not a true deadlock (full error text will help). If you see transaction number in the message, you can track it using MON$ tables, and then find out which connection has started it. Regards, Alexey Kovyazin IBSurgeon Hi All If possible at all, how can I trace which workstation (Firebird Client) is holding a record hostage and thus causing a deadlock conflict? Regards Stef van der Merwe email s...@autotech.co.za [Non-text portions of this message have been removed]
Re: [firebird-support] Problem with FB database that freezes
Hi, OAT is an active transaction. You can see it alive if you analyze MON$ snaphot (you can use trial of our FBMonLogger). So, disconnects are not related with Next-OAT gap - because this gap is caused by some open transaction which you can easily identify. However, disconnects can lead to forced rollback, and as a result, OIT could stuck, and it will lead to increased gap OIT-OST, which is also not good. For more details about OIT, OST and OAT read this ppt http://www.slideshare.net/ibsurgeon/3-how-transactionswork Regards, Alexey Kovyazin IBSurgeon Hi there, Can the connection errors in the log contribute to the increasing gap between the OAT and NT? Regards, -Eduardo
Re: [firebird-support] Corrupted database
Hi, It is a typical corruption usually caused by Firebird abnormal termination due to power outage. You can fix it with IBSurgeon FirstAID more details at www.ib-aid.com Regards, Alexey Kovyazin IBSurgeon 16 июня 2015 г. 6:50 пользователь Nagy Szilveszter nagy_szilvesz...@yahoo.com [firebird-support] firebird-support@yahoogroups.com написал: Hello, one of my firebird databases got corrupt in the last couple of days. It's a pretty big one the FDB file is 8 GB. The error I observed in the applications logfiles. It happens when the users try to run a specific SP. The error message is: # -902 # database file appears corrupt (/data/firebird/vec.fdb) wrong page type page 112600 is of wrong type (expected 5, found 7) At procedure ''SCOR_CANDIDAT'' line: 38, col: 3 The 38th line of this SP is an UPDATE command on a huge table. I tried to fetch that table and it shows the same error at line 115904. (I have 125556 records in the table...at least this is what i calculated from ID value of corrupted line subtracted from generator value) I tried to backup the database to see what happens. The same output comes from gbak: gbak: ERROR:database file appears corrupt (/data/firebird/vec.fdb) gbak: ERROR: wrong page type gbak: ERROR: page 112600 is of wrong type (expected 5, found 7) gbak: ERROR:gds_$receive failed gbak:Exiting before completion due to errors The FireBird Server version is: firebird-superclassic-2.5.2.26539.0-1.el6.x86_64 Running on a 64bit CentOS Linux. Can anyone help me repair it? Thank you, Szilveszter Posted by: Nagy Szilveszter nagy_szilvesz...@yahoo.com table cellspacing=4px style=margin-top: 10px; margin-bottom: 10px; c/blockquote/div
Re: [firebird-support] How do i access firbird database to manipulate the databases
Hi, You can use IBDataPump free tool. It allows data pumping between exact databases or using custom Select queries. Regards, Alexey Kovyazin IBSurgeon Hi there, I am new to firebird and need to manipulate or merge two firebird databases. The tables should be the same format but I need to be able to merge both so it shows both tables data on it. Or is there a way of manipulating the database so i can add the extra patients. Please let me know how I would be able to do so. Please let me know. Thanks Regards, Hasnain Najafi Tel: 07949 037182 [Computer And Data Services Logo 200px][AssuredVendorLogo 200px] Computer Data Services Ltd, Registered 08243376, London EC1V 4PW. This e-mail (including any attachments) is confidential. It may be read, copied and used only by the intended recipient. If you are not the intended recipient you should not copy it or use it for any purpose or disclose its contents to any other person. If you have received this message in error, please notify us and remove it from your system. We cannot accept liability for any damage you incur as a result of virus infection. Boots UK Limited, Registered 928555, Nottingham NG2 3AA This e-mail (including any attachments) is confidential. It may be read, copied and used only by the intended recipient. If you are not the intended recipient you should not copy it or use it for any purpose or disclose its contents to any other person. If you have received this message in error, please notify us and remove it from your system. We cannot accept liability for any damage you incur as a result of virus infection. [Non-text portions of this message have been removed]
Re: [firebird-support] Memory usage excess / leak in FBServer 2.5.4
Hi Jojakim, Can you please do the following - download FBMonLogger trial from http://ib-aid.com/en/fbmonlogger/ install it, run it, connect to the database and make snapshot of MON$. It will grab all information from MON$ tables and store it to the disk (you will be requested to select folder at the first step). Then please zip it and send to supp...@ib-aid.com for the investigation. Regards, Alexey Kovyazin IBSurgeon Hello, I'm facing a problem where the firebird server v2.5.4 on win 2012 server in superserver mode is leaking memory. Currently I'm at ~5GB usage. Don't have any idea how to track down the problem. Thanks for any advice. -- joja select * from mon$memory_usage where mon$stat_group=0; MON$STAT_ID 1 MON$STAT_GROUP 0 MON$MEMORY_USED 4570256632 MON$MEMORY_ALLOCATED 5314478080 MON$MAX_MEMORY_USED 4570448304 MON$MAX_MEMORY_ALLOCATED 5314678784 select * from mon$database; MON$DATABASE_NAME D:\P2_DB\FIREBIRD\DBA9627.FDB MON$PAGE_SIZE 8192 MON$ODS_MAJOR 11 MON$ODS_MINOR 2 MON$OLDEST_TRANSACTION 35186254 MON$OLDEST_ACTIVE 35186255 MON$OLDEST_SNAPSHOT 35186255 MON$NEXT_TRANSACTION 35187662 MON$PAGE_BUFFERS 16384 MON$SQL_DIALECT 3 MON$SHUTDOWN_MODE 0 MON$SWEEP_INTERVAL 2 MON$READ_ONLY 0 MON$FORCED_WRITES 1 MON$RESERVE_SPACE 1 MON$CREATION_DATE 2015-04-15 08:58:37.1050 MON$PAGES 250031 MON$STAT_ID 1 MON$BACKUP_STATE 0 show version; ISQL Version: WI-V2.5.4.26856 Firebird 2.5 Server version: Firebird/x86-64/Windows NT (access method), version WI-V2.5.4.26856 Firebird 2.5 Firebird/x86-64/Windows NT (remote server), version WI-V2.5.4.26856 Firebird 2.5/tcp (SV-W12-L900)/P12 Firebird/x86-64/Windows NT (remote interface), version WI-V2.5.4.26856 Firebird 2.5/tcp (SV-W12-L900)/P12 on disk structure version 11.2
Re: [firebird-support] GBAK - validation error for column X, value *** null ***
Hi Josef, Such error is the consequence of the corruption - in the original database there was a NULL in the field (most likely, all fields in that record are NULL). gbak does not check constraints when reading. The best way to fix it is to find record with NULLs in the original database and delete it, then repeat backup/restore. If you don't have original records, it can be a problem. Try to restore database till the privileges error and then pump data from partially restored database to the new empty database with the same structure - you can use free tool IBDataPump for it. If problems continue, you can export data using our proprietary IBBackupSurgeon tool (http://ib-aid.com/en/ibbackupsurgeon/), which can export data on low-level. Regards, Alexey Kovyazin IBSurgeon Hi! What would be a proper way of dealing with GBAK restore error 'validation error for column X, value *** null ***'? This error appears in one table, where X is the primary key. The database is Firebird 2.5.4 in the superserver mode. 1) How do I properly restore this backup? Neither -INACTIVE nor -NO_VALIDITY (nor both at the same time) help, the restore stops as soon as the first error is encountered. -ONE_AT_A_TIME gets me to the end of table data, but then I get another error at the restoring privilege for user Y action cancelled by trigger (3) to preserve data integrity table/procedure has non-SQL security class defined. 2) Why doesn't GBAK complain during backup? I would expect that if a backup is successfully made, I will be able to restore it. Thanks, Josef
Re: [firebird-support] Re: How to determine size of database structures?
Hi Bruce, To view size of tables and indices you need to use our IBAnalyst tool (http://ib-aid.com/en/ibanalyst/). Regards, Alexey Kovyazin IBSurgeon Thank you Alexey. This is nice tool, however it does not show how much space is taken by given table and its indices... I am sure this can be deduced by reading gstat output file but I don't know how...
Re: [firebird-support] How to determine size of database structures?
Hi Bruce, DBInfo from IBSurgeon Free Tools (http://ib-aid.com/en/ibsurgeon-free-tools/) will give you database pages statistics. Regards, Alexey Kovyazin IBSurgeon Hi guys. I know that I need to use gstat, and I know that I have detailed description about it here: Gstat Examples And Interpretation http://www.firebirdsql.org/manual/gstat-example-header.html image http://www.firebirdsql.org/manual/gstat-example-header.html Gstat Examples And Interpretation http://www.firebirdsql.org/manual/gstat-example-header.html Gstat Examples And Interpretation Database Header Analyse Entire Database Analyse Data Pages Only Analyse Index Pages Only Selecting T... View on www.firebirdsql.org http://www.firebirdsql.org/manual/gstat-example-header.html Preview by Yahoo However, the description does not say how to determine how much space on hard drive is taken by tables and indices. Somewhere I've read that to calculate size of a table I need to multiply the DB page size with data pages reported by gstat for each table. Is that a correct method? Could you tell me how to calculate how much space is taken by indicies based on gstat output file? Regards.
Re: [firebird-support] Profiler for 2.1?
Hi Tim, 2.1 series was discontinued, so nobody will invest in tools for it. Instead of this, consider migration - 2.1 is pretty close to 2.5, where TraceAPI is available. Regards, Alexey Kovyazin IBSurgeon I've just discovered MON$CALL_STACK, and it seems possible that one could use this to produce a Monte Carlo type profiler - query it once every so many seconds, and built up a tree of how often each path through nested procedures has been hit, thus pointing at which paths through the code are taking the time. Do any of the available tools have this feature? - the output I'm after is a graphical drill-down calling tree like the ones you get from profilers for conventional languages. -- Tim Ward
Re: [firebird-support] nbackup problem : Database is already in the physical backup mode
Hi Hugo, So if the computer is shutdown during a nbackup the database is locked in this way indefinelty? Yes, it's one of the most prevalent problems with nbackup. To prevent it you need to monitor delta file age and size - manually, or automatically using our FBDataGuard tool. What do you suggest I should do with JayBird when the exception is thrown? Execute alter database end backup? Yes, it should merge delta file back to the main database and unlock it. Regards, Alexey Kovyazin IBSurgeon
Re: [firebird-support] Re: Awaiting Garbage Collector
Hi Walter, I have just one doubt, and it is with page 46. Do you mean Record versions visibility? Regards, Alexey
Re: [firebird-support] Re: Awaiting Garbage Collector
Hi Walter, On slide 46 of http://www.slideshare.net/ibsurgeon/3-how-transactionswork we consider how transaction 20 view record versions. It's important to note that transaction 20 is a snapshot. Tx16 did the INSERT? Yes, it created original version of Record 1. Tx12 can do a COMMIT although it had started before Tx16 and Tx18 is still active? Sure, why not? Tx25 can change what Tx14 did although Tx14 is still active? Yes, it looks a bit confusing, but this is a snapshot view which highlights that Tx 20 CANNOT see record versions from a) active transactions, b) transactions with Number 20. It means that for snapshot transaction 20 all transactions above its number look like active, and as a result, it cannot view record versions from both from Tx 14, which was active at the moment when snapshot copy of TIP for Tx25 was taken, and it also cannot view record version from Tx 25, which, obviously was created after Tx 14 was committed. But, again, for Tx 20 these both record versions are invisible. Tx20, as a snapshot, thinks that Tx is active, but in reality it was committed. Regards, Alexey Kovyazin IBSurgeon Hi Alexey Yes, that's right, I can not understand well the page 46. I suppose that R1 means record version 1, R2 means record version 2, etc. Tx16 did the INSERT? Tx12 can do a COMMIT although it had started before Tx16 and Tx18 is still active? Tx25 can change what Tx14 did although Tx14 is still active? These things had confused me. Of course, I think that I am not understanding rightly the graph, that's why some words can help to do it clear.
Re: [firebird-support] Re: Awaiting Garbage Collector
Hi, Unfortunately, your experiments are not useful at all, since you are using complex GUI tools, which run background queries in the frames of implicit transactions to get metadata information, etc. If you really want to do clean experiments with Firebird transactions, use only isql.exe, and run queries to your tables and MON$ tables there. Also, look into this presentation http://www.slideshare.net/ibsurgeon/3-how-transactionswork Regards, Alexey Kovyazin IBSurgeon Regarding the Awaiting GC issue I've done another test: 1- Connect to the database in a test environment, isolated from the rest of users from production environment. with IBExpert or another database manager. Only one connection. 2- Monitor tha database with Sinatica Monitor to get number of active transactions, attachments and statements. At this moment only 1 connection is showed in Sinatica. 2 statements that are querys to system tables, I supose form IBExpert connection, 0 awaiting GC and 1 awaiting Sweep. 3- Run a query SELECT * FROM CALENDAR WHERE EVENT_ID=132465 which only returns a record. I did not COMMIT that. 4- Now SINATICA shows how AWAITING GC is increasing by 1 or 2 every second. In a minute it shows more than 100 Awaiting GC. 5- COMMIT and now SINATICA shows AWAITING GC is again 0. I did the same thing with EMS SQL MANAGER and the result is the same. Leaving an interesting transaction on a single record table generates a big amount of garbage. Is that normal?
[firebird-support] ANN Firebird 2015 Tour: SQL optimization
Hi All, We invite all Firebird developers and administrators to 1-day seminar in the frames of Firebird 2015 Tour. Firebird 2015 Tour is devoted to the SQL performance optimization: SQL plans, queries and database statistics, query tuning techniques and deep understanding of undercover work of Firebird. Firebird 2015 Tour is organized by IBSurgeon and IBPhoenix, with support of Firebird Developers core team. Locations and dates of Firebird 2015 Tour (see details in the appropriate sections below): April 24 - Seligenstadt, Germany May 19 – Prague, Czech Republic June 5 – Moscow, Russia Topics of Firebird 2015 Tour seminar: 1)Performance of SELECT queries a.PLANs: what are INDEX, SORT, ORDER, NATURAL and how to manage them b.Execution statistics interpretation, data paths, cache hits c.Tracking slow and resource-consuming resources through MON$ and Trace API d.Firebird configuration parameters e.Best practices, tips and tricks to speed up queries 2)Performance of INSERT queries a.Typical errors which lead to slow INSERTs b.How indices, triggers and database structure affect INSERT performance c.Transactions and INSERTs d.Best practices to speed up INSERTs 3)Performance of UPDATE and DELETE queries a.General approach for updates and deletes b.How indices, triggers and database structure affect UPDATE and DELETE performance c.Update Conflicts, transactions and their resolution, DELETE, SELECT WITH LOCK d.Real-life example of UPDATEs algorithm without conflicts 4)Multi-user performance optimization a.Locks, mutexes and races for resources b.Selecting Firebird architectures and tuning their parameters for multi-user environments Locations details for Firebird 2015 Tour April 24, Seligenstadt, Germany Seminar will take place in Hotel Columbus (www.hotel-columbus.de/contact.php/), April 24, 2015. Important! All topics are presented in English! Seminar's schedule: 9-30-10-00 Registration 10-00 - 17-00 Seminar (with Lunch and Coffee breaks) Attendee's package includes seminar’s materials, lunch and coffee breaks. The early bird registration fee is EUR 49 (till April 5, volume discounts are available). https://secure.shareit.com/shareit/checkout.html?productid=300604679 May 19, Prague, Czech Republic Seminar will take in the Hotel Extoll Inn (http://extolinn.cz/en/contact.htm), May 19, 2015. Important! All topics are presented in English! Seminar's schedule: 9-30-10-00 Registration 10-00 - 17-00 Seminar 10-00 - 17-00 Seminar (with Lunch and Coffee breaks) Attendee's package includes seminar’s materials, lunch and coffee breaks. The early bird registration fee is EUR 39 (till April 25, volume discounts are available) https://secure.shareit.com/shareit/checkout.html?productid=300660565 June 5, Moscow, Russia Seminar will take place in TechnoPark «Slava» (www.technopark-slava.ru/contacts), June 5, 2015. Important! All topics are presented in Russian! Seminar's schedule: 9-30-10-00 Registration 10-00 - 17-00 Seminar (with Lunch and Coffee breaks) Attendee's package includes seminar’s materials and coffee breaks. The early bird registration fee is EUR 39 (roubles 2800) (till April 25). https://secure.shareit.com/shareit/checkout.html?productid=300604678 Для получения российского счета на оплату напишите sa...@ibase.ru Questions? Feel free to ask any questions at firebird2...@ib-aid.com Regards, Alexey Kovyazin IBSurgeon www.ib-aid.com
[Firebird-docs] Fwd: Another translation
It's a copy. Please confirm - do you see it? Regards, Alexey : Another translation : Mon, 09 Mar 2015 15:34:06 +0300 : Alexey Kovyazin a...@ib-aid.com : firebird-docs@lists.sourceforge.net Hi All, I've got another translation sample from another translator (there were some delays): https://yadi.sk/i/7oMVYZ-Tf8GbB Need your feedback. Regards, Alexey Kovyazin IBSurgeon -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ Firebird-docs mailing list Firebird-docs@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/firebird-docs
Re: [firebird-support] Import - slower and slower commits
Hi, There is a fix in 254 snapshot for similar problem. Download fresh 2.5.4 Firebird snapshot and try it. Regards, Alexey Kovyazin IBSurgeon Firebird Recovery service: http://ib-aid.com/en/firebird-interbase-recovery-service/ Database Performance optimization: http://ib-aid.com/en/firebird-interbase-performance-optimization-service/ Hi Group, I have a huge table to import - tens millions of rows. From my experience, it is not good practice to commit job after importing everything, because import of rows can become slower and slower. So, i decided to make commit after every 50.000 rows. So far so good. Now I am at 70.000.000 rows imported. Import of 50.000 rows last about 35 seconds = 1.428 records / second - excellent. Commit of these 50.000 rows now takes about 85 seconds, with tendency to last longer and loner. So my import probably will never finish :( . Before I stop everything, and start again by splitting import process in few steps, can someone explain why this is happening ? Regards, Zoran
Re: [firebird-support] 2.07 SS 32bit, OS 64bit, mem4GB work bad ?
Hi, All architectures of 32 bit Firebird will work bad at 64 bit Windows with mem4GB, fixed in 2.52 only It is fixed in 2.1.5, 2.5.2 and 3.0. 2.0 does not have this fix, end of life was announced. The problem is described here http://dyemanov.blogspot.ru/2012/03/firebird-vs-windows-file-system-caching.html In essence, Windows will try to cache whole database in memory, due to file access flag. Regards, Alexey Kovyazin IBSurgeon Hi to All ! In http://www.slideshare.net/ibsurgeon/resolving-firebird-performance-problems http://www.slideshare.net/ibsurgeon/resolving-firebird-performance-problems � View on www.slideshare.net http://www.slideshare.net/ibsurgeon/resolving-firebird-performance-problems Preview by Yahoo page 7: All architectures of 32 bit Firebird will work bad at 64 bit Windows with mem4GB, fixed in 2.52 only This means database will crash, or only not more/enough speed ? Experiences ? My partner would like to change the server's mem 4 Gb to 8 GB in the next week, but .. ? The 64 bit Firebird not option now, it's only my plans, 4-6 months later. Thanks in advance.
Re: [firebird-support] Bad surprise on performance
Hi Andre, - get some sleep This is the key to find a solution, never optimize anything in a bad mood :) WinSrv2008R2 is a perfect Windows Server, when properly configured. Regards, Alexey ++ Visit http://www.firebirdsql.org and click the Documentation item on the main (top) menu. Try FAQ and other links from the left-side menu there. Also search the knowledgebases at http://www.ibphoenix.com/resources/documents/ ++ Yahoo Groups Links * To visit your group on the web, go to: http://groups.yahoo.com/group/firebird-support/ * Your email settings: Individual Email | Traditional * To change settings online go to: http://groups.yahoo.com/group/firebird-support/join (Yahoo! ID required) * To change settings via email: firebird-support-dig...@yahoogroups.com firebird-support-fullfeatu...@yahoogroups.com * To unsubscribe from this group, send an email to: firebird-support-unsubscr...@yahoogroups.com * Your use of Yahoo Groups is subject to: https://info.yahoo.com/legal/us/yahoo/utos/terms/
Re: [firebird-support] DRBD
Hi All, 1. Does anyone know if Firebird + DRBD is a thing or am I ploughing my own furrow? I have it working flawlessly for 5+ years here. DRBD + XFS + Firebird Databases on 2 Cluster nodes with Heartbeat / Pacemaker. The more interesting question is how database corruption will be distributed in such configuration? How such device will handle careful writes and work of Firebird and OS cache? So, did you make experiments with sudden reboot of one of the nodes with simultaneous high load (inserting or updating a lot of records)? Regards, Alexey Kovyazin IBSurgeon
Re: [firebird-support] DRBD
Ian, My next test, hopefully tomorrow, will be to turn Forced Writes off, and kill the link in the 5 second time between doing stuff and the OS deciding to do anything with it, but I think I'm still on a hiding to nothing unless I can get the packets to drop part way through the splurge of writing. It will be a really interested experiment - please keep us informed. We are not worried about HA, we are just trying to get real-time replication for persistence of data - and I've no idea how to kill it! If you are interested in more ways to kill Firebird - please provide an exact version of your Firebird, and I will try to find a script to kill it or at least freeze. Please contact me: ak at ib-aid.com Regards, Alexey Kovyazin IBSurgeon So, did you make experiments with sudden reboot of one of the nodes with simultaneous high load (inserting or updating a lot of records)? Hi Alexey, That's pretty much the only test that we've tried in several different ways. The problem is that Firebird is just too reliable, so I don't have a mental model of how to break it. We've been using it for 15 years and only ever had problems with the generation of HDDs in the early 00s that reported successful write to the OS but cached forever - specifically Maxtors. Apart from that we had a power supply blow once on a 10GB database that corrupted just a single record at the moment of death, and all that took was a careful extract of the data from that table either side of the bad record. For testing DRBD we've tried pulling power during heavy activity, and then repeated this with iptables dropping all traffic between the nodes to simulate to the secondary the total immediate failure of the primary in a more test friendly way. So far Firebird just shrugs a bit and gets back on with the work on the secondary. My next test, hopefully tomorrow, will be to turn Forced Writes off, and kill the link in the 5 second time between doing stuff and the OS deciding to do anything with it, but I think I'm still on a hiding to nothing unless I can get the packets to drop part way through the splurge of writing. We are not worried about HA, we are just trying to get real-time replication for persistence of data - and I've no idea how to kill it! Ian
Re: [firebird-support] Firebird database seems to influence multi user ability
Hi Benny, Look here http://ib-aid.com/en/articles/cannot-commit-index-or-how-to-pump-data-from-partially-restored-inconsistent-database/ I suggest to insert fake record with ORDERID = 4127, and then try to activate index. Regards, Alexey Kovyazin IBSurgeon Hi, I have been an interbase guy about fifteen years ago and loved to see it go open source. I used to work with Paul Beach (Hello, if you're here,Paul) Now I ran across a problem with firebird and tried to solve it. unfortunately half of the stuff is in the dark because the original software running here is an accounting product (BUHL/Deltra office Software/Germany if you have heard about it). The weird thing is that the software does not connect to the server from a client if there is a specific .fdb file loaded (local access works). I now asked them to run a backup and that had a couple of messages: (gbak:cannot commit index MOV_CALITEMS_ORDERID gbak: ERROR:violation of FOREIGN KEY constraint MOV_CALITEMS_ORDERID on table MOV_CALENDARITEMS gbak: ERROR:Foreign key reference target does not exist gbak: ERROR:Problematic key value is (ORDERID = 4127) gbak:Database is not online due to failure to activate one or more indices. gbak:Run gfix -online to bring database online without active indices.)
Re: [Firebird-docs] Choosing the translation service
Hi All, I have submitted your feedback to translators, and they provided new version https://yadi.sk/i/vavPQbm7cqjK6 Please review it and let's decide - should we give these guys a chance or need to turn to another? I'm in negotiations with another company for test translation too, it should be ready next week. Regards, Alexey Kovyazin -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Firebird-docs mailing list Firebird-docs@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/firebird-docs
Re: [Firebird-docs] Choosing the translation service
Hi Martin, I think so. However, translation requires docx or odp formats. Regards, Alexey Kovyazin IBSurgeon Hi Alexey, will we get the final documentation in DocBook format? Kind regards, Martin it synergy GmbH -Ursprüngliche Nachricht- Von: Alexey Kovyazin [mailto:a...@ib-aid.com] Gesendet: Montag, 10. November 2014 09:38 An: firebird-docs@lists.sourceforge.net Betreff: [Firebird-docs] Choosing the translation service Hi All, As you know, we are going to translate recently completed Firebird Language Reference in Russian into English. For this purpose we are working with translation services. I need input from English speakers (native and not native :) about quality of the following test translation from one of the services: https://yadi.sk/i/uh1WeVY9ccChv Obviously, this translation needs some additional work, and also we can supply translator with some kind of guideline how to translate certain things in better way, but the question is: should we choose them or need to try another one? Regards, Alexey Kovyazin IBSurgeon -- ___ Firebird-docs mailing list Firebird-docs@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/firebird-docs -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://pubads.g.doubleclick.net/gampad/clk?id=154624111iu=/4140/ostg.clktrk ___ Firebird-docs mailing list Firebird-docs@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/firebird-docs -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://pubads.g.doubleclick.net/gampad/clk?id=154624111iu=/4140/ostg.clktrk ___ Firebird-docs mailing list Firebird-docs@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/firebird-docs
[Firebird-docs] Choosing the translation service
Hi All, As you know, we are going to translate recently completed Firebird Language Reference in Russian into English. For this purpose we are working with translation services. I need input from English speakers (native and not native :) about quality of the following test translation from one of the services: https://yadi.sk/i/uh1WeVY9ccChv Obviously, this translation needs some additional work, and also we can supply translator with some kind of guideline how to translate certain things in better way, but the question is: should we choose them or need to try another one? Regards, Alexey Kovyazin IBSurgeon -- ___ Firebird-docs mailing list Firebird-docs@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/firebird-docs
Re: [Firebird-docs] Choosing the translation service
Hi Helen, thank you for feedback. I'll submit more texts for translations and present them here. Certainly we will need to provide some vocabulary for any translator - SQL is pretty narrow topic... Regards, Alexey At 09:37 p.m. 10/11/2014, Alexey Kovyazin wrote: Hi All, As you know, we are going to translate recently completed Firebird Language Reference in Russian into English. For this purpose we are working with translation services. I need input from English speakers (native and not native :) about quality of the following test translation from one of the services: https://yadi.sk/i/uh1WeVY9ccChv Obviously, this translation needs some additional work, and also we can supply translator with some kind of guideline how to translate certain things in better way, but the question is: should we choose them or need to try another one? On a quick read, 1. I sense that this translator does not have a good command of the use of articles in English (the, a/an, some. and constructs with no article). At best, it makes the text awkward to read for an English native speaker; at worst, the misuse of articles can make a difference to meaning, which could be a problem when translating the English version to other languages. It is a tedious editing task to go through text and correct these errors. (Believe me, I'm doing that all the time!!) If the person is being paid to translate, we should not be put in the position of needing to do such basic corrections. 2. Vocabulary choice in some cases needs to be reviewed. Referring to statements as operators is a bad choice in a language reference. The term operator has a distinct meaning in SQL and it is not that one! Similarly, use of the word events when talking about operations will cause confusion, even to native English speakers, given that the word event has a specific meaning in Firebird's procedural language. I found some other examples where vocab choice was inappropriate. Possibly the translator(s) should be given a set vocab of the terms most used in English for the various concepts. 3. Is the merging of keywords into one invalid word intentional? e.g. DROPPROCEDURE and other examples. If so, why? As far as I can tell, this occurs only in the explanatory text, not in the syntax patterns or the examples. I downloaded the sample, in the hope that I will have more time to study it when I get clear of release notes for a while. Helen -- ___ Firebird-docs mailing list Firebird-docs@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/firebird-docs -- ___ Firebird-docs mailing list Firebird-docs@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/firebird-docs
[firebird-support] Firebird Language Reference - Firebird needs your help
Hi All, The Firebird Project is pleased to announce that the Firebird 2.5 Language Reference is now available in Russian. It can be downloaded via the Firebird SQL documentation page http://www.firebirdsql.org/en/reference-manuals/ Why is it only available in Russian? Moscow Exchange (www.moex.com), one of the biggest Firebird users in the world, and IBSurgeon (www.ib-aid.com) sponsored the documentation development in their native language as well as using the Russian speaking Firebird core developers to oversee the work and ensure its quality. The next step is to extend this documentation to cover Firebird 3.0's new features, on which work is already taking place. However this work is also in Russian. In order to translate the Firebird Language Reference into English, the Firebird Documentation Project needs additional funds. It needs approximately $7000 US Dollars to translate almost 500 pages of Firebird documentation into English using a professional translation service, to ensure the quality of translation. To get the Firebird 2.5 and 3.0 Language Reference in English in the first quarter of 2015, please help the Firebird Project now with a donation via PayPal (please use button Fund Docs): http://www.firebirdsql.org/en/donate/ All money donated will be used translate the Firebird documentation and, if the $7000.00 amount is exceeded, the money will then be used for further development of other sections of the documentation e.g. the Firebird Operations Guide etc. Regards, Alexey Kovyazin IBSurgeon
Re: [firebird-support] Migration from Firebird 32 1.5.6 to Firebird 64 2.5.3
Hi, I want to replace my Firebird 32 1.5.6 with the last Firebird 64 2.5.3, http://www.slideshare.net/ibsurgeon/firebird-migration-from-firebird-15-to-firebird-25 Regards, Alexey Kovyazin IBSurgeon
Re: [firebird-support] Firebird performance question
Hi Bill, If your application and database are the same and and you using them in the same manner with the same Firebird configuration (http://ib-aid.com/en/optimized-firebird-configuration/), the difference in performance is always explained by hardware - either hardware problem (like absence of BBU on RAID) or absence of necessary (modern) drivers. Moreover, 2008r2 has the same core as W7, and even can be tuned to look and act like W7: http://www.win2008workstation.com/ If you want more detailed answer, you should provide exact details, according the questions here http://ib-aid.com/required-information-for-firebird-database-performance-optimization Regards, Alexey Kovyazin IBSurgeon Hi, We have been using Firebird Super Server version 1.5.6 on both Windows 7 (64 Bit) and Server 2008 (64 Bit). Both systems are the same except for the OS and they have 2 CPUs and about 4 gig of RAM. We have noticed that any applications, with large multiple writes, is much faster on Windows 7 than on Server 2008. I know there is newer version and we are planning to upgrade the Firebird, but is there something missing on 2008 that would improve the performance. Also, when we upgrade to version 2.5, would we see similar performance between Windows 7 and Server 2008? Thanks, Bill *Bill Newhall | Technical Director | MedAssets* 153 Cordaville Rd., Suite 110 | Southborough, MA, 01772 | Work: 508.460.8524| Mobile: 617.515.3073 | Fax: 508.460.8539 bnewh...@medassets.com mailto:bnewh...@medassets.com Visit us at www.medassets.com http://www.medassets.com Follow us on LinkedIn http://www.linkedin.com/company/medassets, YouTube https://www.youtube.com/user/MedAssetsInc, Twitter https://twitter.com/MedAssets, and Facebook https://www.facebook.com/MedAssets * **Attention*** This electronic transmission may contain confidential, sensitive, proprietary and/or privileged information belonging to the sender. This information, including any attached files, is intended only for the persons or entities to which it is addressed. Authorized recipients of this information are prohibited from disclosing the information to any unauthorized party and are required to properly dispose of the information upon fulfillment of its need/use, unless otherwise required by law. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon this information by any person or entity other than the intended recipient is prohibited. If you have received this electronic transmission in error, please notify the sender and properly dispose of the information immediately. */[Marius Labuschagne] /* */Hi Bill, I don’t have the answer, but will also keep an eye on this question. /* */What I can tell you as that I am running my Client sites on 2.5.3 Superserver, some Clients with 2008 Server, and some using Desktop machines with Windows 7 on it as Server machines./* */And without fail the Windows 7 machines outperforms the 2008 Server machines by magnitudes. There are a lot of discussions you can find about this, but I was not able yet to find a solid solution to this problem./* */Regards/* */Marius/*
Re: [firebird-support] Firebird Embedded corruptions
Jan, Yes that would probably be a better choice for us, but we cannot bundle IBFirstAId together with our application. Will however download it and try it on files to got sent to us. Actually, current version of FirstAID which is available at our web site is a full version, but it requests license every time you are running recovery (not diagnose). So you can (from license and technical points of view) include FirstAID executables into your application, so user will be able to use on demand. Don't hesitate to contact our supp...@ib-aid.com for more details. Regards, Alexey Kovyazin IBSurgeon ++ Visit http://www.firebirdsql.org and click the Documentation item on the main (top) menu. Try FAQ and other links from the left-side menu there. Also search the knowledgebases at http://www.ibphoenix.com/resources/documents/ ++ Yahoo Groups Links * To visit your group on the web, go to: http://groups.yahoo.com/group/firebird-support/ * Your email settings: Individual Email | Traditional * To change settings online go to: http://groups.yahoo.com/group/firebird-support/join (Yahoo! ID required) * To change settings via email: firebird-support-dig...@yahoogroups.com firebird-support-fullfeatu...@yahoogroups.com * To unsubscribe from this group, send an email to: firebird-support-unsubscr...@yahoogroups.com * Your use of Yahoo Groups is subject to: https://info.yahoo.com/legal/us/yahoo/utos/terms/
Re: [firebird-support] nbackup database made database inaccessible
Hello, If you have moved or deleted .delta-file, you got the correct message. If delta file was corrupted, or database was corrupted in the way which prevent merge, there could be various error messages. Check your database with gfix -v -full now, to be sure it's Ok. Is it risky to run a nbackup? If you are using nbackup, you need to understand that you need to watch delta file size and lifetime, and also be aware that nbackup does not detect any errors on page or record level. Regards, Alexey Kovyazin IBSurgeon Hello, I have encountered a serious problem with nbackup. During a automated nbackup something happened with the .delta file and the database was inaccessible until i luckily found the command nbackup.exe -U which addressed the problem. Nothing else worked. The error message was that the .delta file is missing. The nbackup was executed from JayBird. Firebird 2.5.3 on Windows. What causes this? Is it risky to run a nbackup? BR, Hugo
Re: [firebird-support] Firebird Embedded corruptions
Hi Jan, You did not tell what kind of corruption you had (please provide full text of error). There are plenty of them, as well as reasons. You also could use our tool FirstAID (Direct) to analyze database on low level and see where are the problems. Regards, Alexey Kovyazin IBSurgeon (www.ib-aid.com) Hi, We have shipped Firebird Embedded bundled together with our product for a few years now and the system is currently in production at several thousand of our customer's sites. Currently we are using Firebird Embedded 2.5.1 with the latest .NET-driver and a stack consisting of Castle Active Record on top on NHibernate and the system is running on the latest versions of Windows. All is well and Firebird has served us good so far with the exception of database corruptions that gets reported from a new set of customers every week. For some of them it is possible to instruct the customer on how to repair the databases themselves, but some of the databases are unfortunately so heavily corrupted that they need to be sent to us for repairing (which is a tedious work that steals time from other tasks). Most of them corruptions are normally found in the tables that gets the most writes, but I guess that is only natural. We are now at the planning stage for the next major release of our product and we are thus rethinking if Firebird really is a good choice, because of this. Lots of effort has gone into solving this problem on our side, so I think the normal prerequisites has already been put into place (e.g using forced writes and so forth), but our system needs to be up and running 24x7, which means that it is not possible to schedule periodic backup/restore cycles and my personal theory is that Firebird embedded gets corrupted over time if you are not doing this regularly. So I have have a few questions that I would appreciate if someone could answer: 1. Is it feasible to run Firebird Embedded 24x7 in a setup where there are no scheduled backup/restore cycles. If not, how often should this be performed to ensure that the database does not get corrupted. 2. Most of our customers are not using a UPS. From my experiments I have not managed to create a corrupted database by turning of the power while doing a large set of writes (in a session running in VirtualBox). Could someone please confirm that this is indeed safe when you are running with synchronized writes turned on? 3. Are there any operations on a live database that should be avoided to minimize the risk of corruptions? 4. Just read a discussion about whether it is needed or not to call fb_shutdown to stop Firebird Embedded. Could this be the reason why we are getting corruptions? Should we change our service to perform this call when it is stopped? 5. I have also seen discussions of turning of automatic sweeps of the database (and doing them manually instead). Is this a likely source of corruptions for our setup? Thanks in advance. Maybe are there no certain answers to my questions, but any pointers in the right direction would be very appreciated. Firebird has been a real workhorse for us and we would rather like to keep it. Best Regards //Jan Flyborg
Re: [firebird-support] Configuring Firebird for high transaction through put
Hi Russel, Good starting point could be our optimized configuration files: http://ib-aid.com/en/optimized-firebird-configuration/ Regards, Alexey Kovyazin IBSurgeon What type of access (read vs. write mix) are you expecting? Mainly write What mix of small vs. large queries are you expecting? the queries are based on single order ids (primary keys) and about 4 tables involved How many simultaneous connections are you expecting? that's the big question we are looking at a range of 1400 - 13000 orders per hour What page cache number and page size have you tested with? page buffers: 2048; page size: 4096 What type of HDD config and how much RAM will the server have? all on virtual. 2 HDD and 4GB ram - can increase to 16GB What OS? Windows server 2012 *Russell Weetch *SMXi – /the heartbeat of your business/ *T: *+44 (0)20 7100 6010 *M:*+44 (0)7879 816084 *W:*http://smxi.com http://smxi.com/ *E:*russ...@smxi.com mailto:russ...@smxi.com Linked In http://uk.linkedin.com/in/russellweetch/ https://twitter.com/smxsoftware http://www.facebook.com/SystematicMarketing http://smxi.com/blogs/russell.weetch https://plus.google.com/+russellweetch Systematic Marketing, 429-433 Pinner Road, Harrow HA1 4HN, United Kingdom SMX, SMXi, Masque® and Masque Arts are trading names and trade marks of Systematic Marketing Ltd Registration No. 2472380 England / VAT 541 2972 49 This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify me immediately. If you are not the intended recipient of this email, you should not copy it for any purpose, or disclose its contents to any other person. On 11 September 2014 16:35, 'Leyne, Sean' s...@broadviewsoftware.com [firebird-support] firebird-support@yahoogroups.com mailto:firebird-support@yahoogroups.com wrote: We are having to gear up one of our web apps for a potential spike in access next month and have been running some load testing. Overall it seems not to bad but the database is a bit of a bottleneck or so it seems. Without turning off forced rights what else should we look at? We have increased core utilisation. Does page size have an impact? Any ideas would be welcomed. Are there any documents anywhere that cover this? What type of access (read vs. write mix) are you expecting? What mix of small vs. large queries are you expecting? How many simultaneous connections are you expecting? What page cache number and page size have you tested with? What type of HDD config and how much RAM will the server have? What OS? Sean
Re: [firebird-support] Re: TempCacheLimit in Super Classic
Hi, Ï am not sure that Dmitry wins here, since original question is not 100% correct. Cache is always per server process - each server process has own cache, in all architectures, and difference is in connection/server process model. So, SuperClassic is like Classic in terms of usage - the more clients connected the more memory will be consumed. SuperServer has single cache (per database), it will be shared between connected users. Regards, Alexey Kovyazin IBSurgeon Thank you very much. 2 vs 1, but in this case I asume that Dmitry wins. I'll check the optimized configuration files. Jaume 2014-07-07 20:41 GMT+02:00 Dmitry Yemanov dim...@users.sourceforge.net mailto:dim...@users.sourceforge.net [firebird-support] firebird-support@yahoogroups.com mailto:firebird-support@yahoogroups.com: 07.07.2014 21:14, Thomas Steinmaurer wrote: I would like to know if the TempCacheLimit parameter in SuperClassic is like Classic or like SuperServer? So if it's per client connection or it's for server process? As in Classic, thus per connection. Nope, it's per server process. Dmitry
Re: [firebird-support] Unable to repair a corrupt database
Hi, Try to open database with FirstAID Extractor (it's free) and check is there data you are looking inside. Regards, Alexey Kovyazin IBSurgeon I have a Firebird 2.5.2 database (ODS 11.2). The database has corrupted. When I open the database, I receive a message page 1577 is of wrong type (expected 4, found 5) I have tried using gfix, gfix -mend, gbak to attempt backup but it doesn't work. I also try if qli may extract the data, and again, I can't open the database in ready statement. Same corrupt message prompt out. I even try to change the byte at position (1577 * 4096) from 0x05 to 0x04 but it turn out to the following message when I perform gfix or gbak: Reached the end of the file. I think IBSurgeon shall works but the price isn't something I can afford. Is there any other alternate way to fix the database?
Re: [firebird-support] Database Too Large.
Hi Stefano, To decrease database size you need to make backup/restore. Then, to keep its growth under control, you need to perform the following maintenance procedure: 1) stop Firebird server and then start it immediately (less than 3 sec downtime). 2) run gfix -sweep -user SYSDBA -pass masterkey database_path that's all. Regards, Alexey Kovyazin IBSurgeon
Re: [firebird-support] Why different Firebird instances have different read/fetches statistics
Hi Jonathan, Most likely you have different firebird.conf. Align them and check again. Regards, Alexey Kovyazin Hi! I have different Firebird instances/databases, one is running on Windows, another on Linux (the servers have different RAM amount as well). The execution of the same SQL code results in almost the same indexed reads, non-indexed reads statistics, but the numbers of read and fetch operations are incredibly different. E.g. one instance has less than 1000 reads (and a bit more fetches) but the second instance has more than 40.000.000 reads (and more than 40.000.000 fetches) when the same SQL code is executed (this code includes all types of DML statements - inserts, updates, deletes and selects). Namely, so many reads create performance issues. Both databases have the same structure and the same data, including the same active indices. I guess that any performance differences and number of read operations is almost entirely due to the configuration. How to interpret those data? And what can be done to reduce the number of read operations? Thanks in advance!
Re: [firebird-support] Firebird 1.5 on 64bit OS. Newer Hardware but bad performance
Halim, Ok, thank you. 1.5 is really old, upgrade asap. Regards, Alexey Kovyazin Hi Alexey, Here is where I read it. Page 7. PPT Presentation during FDD 2012, Brazil. http://www.slideshare.net/ibsurgeon/resolving-firebird-performance-problems# Keep in mind, we are still using 1.5 FB. Thank you, -Halim To: firebird-support@yahoogroups.com From: firebird-support@yahoogroups.com Date: Fri, 30 May 2014 08:06:04 +0400 Subject: Re: [firebird-support] Firebird 1.5 on 64bit OS. Newer Hardware but bad performance Halim, It is out of context. Recent 2.5.2 has no such problem. Where did you read it? Regards, Alexey Kovyazin IBSurgeon 30.05.2014 4:41 пользователь halim1...@hotmail.com mailto:halim1...@hotmail.com [firebird-support] firebird-support@yahoogroups.com mailto:firebird-support@yahoogroups.com написал: We recently upgraded our database server from Win server 2003 to Win 2008 server. We upgraded hardware as well. The new hardware (IBM x3550 M4) is way more advanced than the old one. 4 times the RAM and CPU speed. We ran some tests on the new hardware(a few select/update queries), the performance was way less than the old server using the same database. I read somewhere on one of IB Surgeon slides that All architectures of 32 bit Firebird will work bad at 64-bit Windows with 4Gb RAM. Since we can't upgrade our Firebird DB to 2.x, Do we need to downgrade our OS to a 32 bit version and install less RAM to gain a little more performance or we missing something else? Thanks, -Halim
Re: [firebird-support] Restore DB with Firebird 1.5 Super Server vs Classic Server
Hi Halim, Try to use optimized configuration file for Firebird 1.5 Classic: http://ib-aid.com/optimized-firebird-configuration Regards, Alexey Kovyazin IBSurgeon Here is the link to the zip file: http://ge.tt/1raCY2i1/v/0?c Thank you, -Halim To: firebird-support@yahoogroups.com From: firebird-support@yahoogroups.com Date: Tue, 27 May 2014 21:30:03 +0400 Subject: Re: [firebird-support] Restore DB with Firebird 1.5 Super Server vs Classic Server Hi Halim, firebird-support does not allow attachments. Please put zip with info to some sharing service like ge.tt, and post link here. Regards, Alexey Kovyazin IBSurgeon Please see attached zip file with questionnaire response regarding our server performance.Also, I have attached restore logs from restore using classic server and restore using super server.Please let me know if you have any question.Thank you,-Halim To: firebird-support@yahoogroups.com From: firebird-support@yahoogroups.com Date: Sun, 25 May 2014 00:17:21 +0400 Subject: Re: [firebird-support] Restore DB with Firebird 1.5 Super Server vs Classic Server Hi, In order to give you a good optimization advice, please answer the following questions: http://ib-aid.com/en/articles/required-information-for-firebird-database-performance-optimization/ Regards, Alexey Kovyazin IBSurgeon Thank you for your reply. I used default restore settings and I got over 8 hours of restore time. Increasing the cache size using gfix -b did not help at all. I got the same result. I don't think it helps during the restore process. -Halim To: firebird-support@yahoogroups.com From: firebird-support@yahoogroups.com Date: Sat, 24 May 2014 09:28:01 +0200 Subject: Re: [firebird-support] Restore DB with Firebird 1.5 Super Server vs Classic Server Guten Tag halim1...@yahoo.com [firebird-support], much too few information for any reasonable answer, so just the standart Cache settings ? ar way too low in staddart classic setup try increasing them Hello All, Our database is about 30 GB. We are using Firebird 1.5. When restoring the database using Super server install, the restore takes about 2.5 Hours but when we use Classic Server mode, the restore takes over 8 hours. Our machine is up to date as far as CPU and RAM(64 GB ). Any idea why this difference of restore speed? Thank you, -Halim -- Mit freundlichen Grьssen Hannes Streicher mailto:hstreic...@gmx.de [Non-text portions of this message have been removed] ++ Visit http://www.firebirdsql.org and click the Resources item on the main (top) menu. Try Knowledgebase and FAQ links ! Also search the knowledgebases at http://www.ibphoenix.com ++ Yahoo Groups Links ++ Visit http://www.firebirdsql.org and click the Resources item on the main (top) menu. Try Knowledgebase and FAQ links ! Also search the knowledgebases at http://www.ibphoenix.com ++ Yahoo Groups Links
Re: [firebird-support] Restore DB with Firebird 1.5 Super Server vs Classic Server
Hi Halim, firebird-support does not allow attachments. Please put zip with info to some sharing service like ge.tt, and post link here. Regards, Alexey Kovyazin IBSurgeon Please see attached zip file with questionnaire response regarding our server performance.Also, I have attached restore logs from restore using classic server and restore using super server.Please let me know if you have any question.Thank you,-Halim To: firebird-support@yahoogroups.com From: firebird-support@yahoogroups.com Date: Sun, 25 May 2014 00:17:21 +0400 Subject: Re: [firebird-support] Restore DB with Firebird 1.5 Super Server vs Classic Server Hi, In order to give you a good optimization advice, please answer the following questions: http://ib-aid.com/en/articles/required-information-for-firebird-database-performance-optimization/ Regards, Alexey Kovyazin IBSurgeon Thank you for your reply. I used default restore settings and I got over 8 hours of restore time. Increasing the cache size using gfix -b did not help at all. I got the same result. I don't think it helps during the restore process. -Halim To: firebird-support@yahoogroups.com From: firebird-support@yahoogroups.com Date: Sat, 24 May 2014 09:28:01 +0200 Subject: Re: [firebird-support] Restore DB with Firebird 1.5 Super Server vs Classic Server Guten Tag halim1...@yahoo.com [firebird-support], much too few information for any reasonable answer, so just the standart Cache settings ? ar way too low in staddart classic setup try increasing them Hello All, Our database is about 30 GB. We are using Firebird 1.5. When restoring the database using Super server install, the restore takes about 2.5 Hours but when we use Classic Server mode, the restore takes over 8 hours. Our machine is up to date as far as CPU and RAM(64 GB ). Any idea why this difference of restore speed? Thank you, -Halim -- Mit freundlichen Grьssen Hannes Streicher mailto:hstreic...@gmx.de [Non-text portions of this message have been removed] ++ Visit http://www.firebirdsql.org and click the Resources item on the main (top) menu. Try Knowledgebase and FAQ links ! Also search the knowledgebases at http://www.ibphoenix.com ++ Yahoo Groups Links ++ Visit http://www.firebirdsql.org and click the Resources item on the main (top) menu. Try Knowledgebase and FAQ links ! Also search the knowledgebases at http://www.ibphoenix.com ++ Yahoo Groups Links * To visit your group on the web, go to: http://groups.yahoo.com/group/firebird-support/ * Your email settings: Individual Email | Traditional * To change settings online go to: http://groups.yahoo.com/group/firebird-support/join (Yahoo! ID required
Re: [firebird-support] Restore DB with Firebird 1.5 Super Server vs Classic Server
Hi, In order to give you a good optimization advice, please answer the following questions: http://ib-aid.com/en/articles/required-information-for-firebird-database-performance-optimization/ Regards, Alexey Kovyazin IBSurgeon Thank you for your reply. I used default restore settings and I got over 8 hours of restore time. Increasing the cache size using gfix -b did not help at all. I got the same result. I don't think it helps during the restore process. -Halim To: firebird-support@yahoogroups.com From: firebird-support@yahoogroups.com Date: Sat, 24 May 2014 09:28:01 +0200 Subject: Re: [firebird-support] Restore DB with Firebird 1.5 Super Server vs Classic Server Guten Tag halim1...@yahoo.com [firebird-support], much too few information for any reasonable answer, so just the standart Cache settings ? ar way too low in staddart classic setup try increasing them Hello All, Our database is about 30 GB. We are using Firebird 1.5. When restoring the database using Super server install, the restore takes about 2.5 Hours but when we use Classic Server mode, the restore takes over 8 hours. Our machine is up to date as far as CPU and RAM(64 GB ). Any idea why this difference of restore speed? Thank you, -Halim -- Mit freundlichen Grüssen Hannes Streicher mailto:hstreic...@gmx.de
Re: [firebird-support] port requirements for Firebird Services API - IBAnalyst
Hi Ann, Unfortunately, we did not receive your email to supp...@ib-aid.com or to ibanal...@ib-aid.com. Services API works through the same port (3050 by default), as all connections. Regarding IBAnalyst connection - most likely you don't have correct version of client library in path, and IBAnalyst loads some old version. The easiest way to fix it is to copy fbclient.dll (it should be 32bit) to its folder C:\Program Files (x86)\IBAnalyst27 Regards, Alexey Kovyazin IBSurgeon PS Our main support email is supp...@ib-aid.com, please feel free to contact us. Hi Firebird users and experts... Which ports need to be open for the Firebird Services API and which settings in firebird.conf control them? In general, I can connect to the database just fine. I wanted to follow up on the recent article ( http://ib-aid.com/en/articles/firebird-performance-degradation-tests-myths-and-truth/ ) so that is why I'm testing the IBAnalyst utility. I have port 3050 open and IBAnalyst gives an error connection rejected by remote interface when I click the [Run] button. I'm guessing the services API uses the randomly assigned RemoteAuxPort. I would like confirmation on that before changing the firewall configuration. I tried writing to support at ibanalyst.com but have not heard back after 2 days. I am thinking that RemoteServicePort defaults to 3050 and that I should configure RemoteAuxPort to the port of my choice, say 3051, and then let that through the firewall for LAN requests. Is that correct? I have *not* yet set RemoteServicePort nor RemoteAuxPort in Firebird.conf, so they are going by the defaults. Server -- running Firebird 2.5.2 on CentOS Linux. Client -- running IBAnalyst on Windows 7. Thank you in advance. Ann Lynnworth HREF Tools Corp. www.href.com
Re: [firebird-support] Strange behaviour error writing data to connection - but after some time connection is back.
Hi, Most likely you did not change default configuration of xinted, which has restriction in number of connections/second. Set it to unlimited or some bigger value. Regards, Alexey Kovyazin IBSurgeon Hi guys, I have problems which I can not explain, nor do I know how to solve it. We have FB 2.5.2 classic on linux. We have like 60 Databases there. From time to time, we can not connect to few of the databases. Simply, when we try to connect, a connection process is hanging (regardles of application which is trying to connect). There is no timeout or any other message. However, when for example Flamerobin is hanging and I try to turn it off there is a windows dialog which asks me whether to try to restore the program. When I chose this, then dialog box appears saying Error writing data to connection. I've read in the FAQ that this means that server crashed. However, after few hours we can connect back to the database and this is what I do not understand. i've not restarted the server. Why suddenly I can connect back to database? firebird.log, does not say me much. I see from time to time this messages, but I do not know if they are correlated to the problem: Shutting down the server with 1 active connection(s) to 1 database(s), 0 active service(s) Error during sweep: operation was cancelled What can cause of this? We have a lot of free ram and disk space and CPU power... Thanks for any advice... https://groups.yahoo.com/neo/groups/firebird-support/conversations/messages/124273;_ylc=X3oDMTJyOGlmYWoxBF9TAzk3MzU5NzE0BGdycElkAzI0NDI0MDYEZ3Jwc3BJZAMxNzA1MTE1Mzg2BG1zZ0lkAzEyNDI3MwRzZWMDZnRyBHNsawNycGx5BHN0aW1lAzEzOTY5NTE4MzE-?act=replymessageNum=124273
Re: [firebird-support] Invalid BLOB ID
Hi, It's missed BLOBs, good that you have this, not critical errors. Perform backup and restore. Regards, Alexey Kovyazin www.ibsurgeon.com Hi all, i have this error repeated about 20 times when backing up my database: gbak:error accessing BLOB column EXPLICATIE -- continuing gbak: ERROR:invalid BLOB ID What should i do? Thank you, Szilveszter
Re: [firebird-support] Invalid BLOB ID
Hi Alan, Missed, orphaned, slightly corrupted - the is no strict term. There will be error while trying to fetch such BLOB field, but gbak [sometimes] can workaround it. Regards, Alexey Kovyazin www.ibsurgeon.com Hi, It's missed BLOBs, good that you have this, not critical errors. Perform backup and restore. Regards, Alexey Kovyazin www.ibsurgeon.com What's a 'missed' BLOB? Alan Hi all, i have this error repeated about 20 times when backing up my database: gbak:error accessing BLOB column EXPLICATIE -- continuing gbak: ERROR:invalid BLOB ID What should i do? Thank you, Szilveszter [Non-text portions of this message have been removed]
Re: [firebird-support] Wrong page type, how to examine/fix?
Hi, No idea, really. But I do know I did some sloppy do before I think ad hoc SQL work when I created the table that has the corruption, and I note that IBSurgeon writes in one of their docs that dropping tables while other transactions might be working (trying to work?) with it, can confuse the engine and cause corruption. If that is the case (which I find a bit scary) it might be what happened to me (although I was alone working with a couple of transactions fiddeling with that table back and If you create many pseuvdo-temporary tables like TMP646474 and then drop them, while users are active, you are on the way to corruption. The simple workaround is to pump all data to the empty database with the same structure, except bad table. It could take several days, but it's free. Regards, Alexey Kovyazin www.ibsurgeon.com
Re: [firebird-support] For those who think they have performance problems
LockHashSlots to 8191. ;-) We have set 31013. Today situation is much better, users are surprised with +30% speed increase, with 700 active connections: LOCK_HEADER BLOCK Version: 145, Active owner: 0, Length: 75440168, Used: 28721584 Flags: 0x0001 Enqs: 3143976306, Converts: 1574782, Rejects: 253168, Blocks: 6607562 Deadlock scans: 0, Deadlocks: 0, Scan interval: 10 Acquires: 3197419523, Acquire blocks:673, Spin count: 0 Mutex wait: 0.0% Hash slots: 31013, Hash lengths (min/avg/max):0/ 2/ 11 Remove node: 0, Insert queue: 0, Insert prior: 0 Owners (736): forward: 1369256, backward: 20828544 Free owners (35): forward: 6090320, backward: 10504960 Free locks (4172): forward: 262208, backward: 20547568 Free requests (14944): forward: 17197144, backward: 3648808 Regards, Alexey Kovyazin IBSurgeon
[firebird-support] For those who think they have performance problems
Hi All, Just got an amazing lock print. This is real performance nightmare :) LOCK_HEADER BLOCK Version: 145, Active owner: 63554144, Length: 210763776, Used: 209783832 Flags: 0x0001 Enqs: 21025066275, Converts: 82460471, Rejects: 64835339, Blocks: 594096759 Deadlock scans: 61, Deadlocks: 0, Scan interval: 10 Acquires: 25476138585, Acquire blocks: 34118657, Spin count: 0 Mutex wait: 0.1% Hash slots: 1009, Hash lengths (min/avg/max): 358/ 403/ 445 Remove node: 0, Insert queue: 0, Insert prior: 0 Owners (728): forward: 14876944, backward: 28924320 Free owners (160): forward: 186465696, backward: 25763912 Free locks (78217): forward: 5469536, backward: 1074360 Free requests (386094): forward: 206130320, backward: 103961080 Lock Ordering: Enabled Regards, Alexey Kovyazin www.IBSurgeon.com
Re: [firebird-support] Very very very slow FB 2.5.2 64bit performance on Windows 2008 R2
Hi, I suppose we all have our opinions. This is not an opinion, this is statement, confirmed by our 12 years experience with Firebird and 5 years with Win 2008. Your problem with Win2008 is lack of knowledge, that's all, sorry for the truth. And I'm not going to offer such technical support for free in this support list, sorry. Try other Firebird service providers: http://www.firebirdsql.org/en/professional-support/ may be they have free time. Regards, Alexey Kovyazin IBSurgeon
Re: [firebird-support] Very very very slow FB 2.5.2 64bit performance on Windows 2008 R2
Hi Marius, Sorry, I don't want to be rude. I just want to point that there is no problem with Windows 2008 R2, and a bit tired with all the same questions (with the same answers). Our largest customers databases are on Win2008R2, and it works just fine - 500+ users and 150Gb, 440Gb with 50 users, etc, etc. And, btw, 440Gb is running at the server in Port Elizabeth. Regarding promotion of our business - there are very few professional service providers listed on the Firebirdsql.org, and they are also Firebird sponsors. Without our sponsorship Firebird would not exists and all users would sit with InterBase 6.0, as it was released by Borland in 2000. Regards, Alexey Kovyazin IBSurgeon Hi, I suppose we all have our opinions. This is not an opinion, this is statement, confirmed by our 12 years experience with Firebird and 5 years with Win 2008. Your problem with Win2008 is lack of knowledge, that's all, sorry for the truth. And I'm not going to offer such technical support for free in this support list, sorry. Try other Firebird service providers: http://www.firebirdsql.org/en/professional-support/ may be they have free time. Regards, Alexey Kovyazin IBSurgeon */[Marius Labuschagne] /* */What you doing in this forum Alexey? As far as I am aware this is a support forum, am I wrong? You promoting your business over here with all your years of experience? (Or at least you must be thinking that 12 is a very high number)/* */Lets leave it at that, I would not dare ask you for any support anyway./* *//* */Regards/* */Marius/*
[firebird-support] Required information for Firebird database performance optimization
Hi All, I am a bit tired of repeated topics regarding database performance, so I decided to publish short version of our performance questionnaire: http://ib-aid.com/articles/item157 I suggest to always ask people who come here with Firebird performance problems to answer these questions and send answers to the list, in order to facilitate performance problems resolution. Regards, Alexey Kovyazin IBSurgeon
Re: [firebird-support] Required information for Firebird database performance optimization
Hi Hannes, Good point, thank you - I added it. Regards, Alexey Kovyazin Guten Tag Alexey Kovyazin, nice Questionaire , i would suggest to add 1 more point if it has a Raid then the size of the Stripe Set The Stripe Set ist the amount of data a raid moves to / from the diskarray for every read/write. Example: a Raid 5 with 3 Disks and a Stripset of 128 KB means that each Read / Write will move 192 KB now add a Database Page Size of 4 KB (Worst Case) then every database page read or written will instead move 192 Kb or a 48 fold overhead
Re: [firebird-support] Very very very slow FB 2.5.2 64bit performance on Windows 2008 R2
Hi All, Hereby I notify everyone that Windows 2008R2 has NO performance issues with Firebird databases till 200Gb in size, and not so many after this size. In all cases when you see performance degradation at Win2008R2 and everything is smooth on Linux/Win7/etc - it is not an OS fault, it's a problem with configuration (incl. version) of Firebird and OS (incl. drivers and domain controllers), or performance problems in your own code (in 80% it's long-running transactions). Regards, Alexey Kovyazin IBSurgeon PS Btw, guys who started the topic already fixed the problem. I hope they will provide more details who they achieved it. */ /*
Re: [firebird-support] Firebird slowdowns while resources are available
Hi Zoltan, this problem is often topic here. Solving this problem is a long boring process, where community will try to explain you basics about transactions and transaction markers meaning, ask you to send gstat statistics, then explain about record versioning and garbage and long-running transactions, about advanced monitoring and so on. In the end you will land with big3 - long-running transactions, bad plans and wrong configuration, each is another big topic . In short, your database size looks pretty serious to afford professional services http://www.firebirdsql.org/en/professional-support/ Regards, Alexey Kovyazin IBSurgeon PS If somebody here wants to go through steps described above, please don't hesitate to do this. Hi, I have a strange slowdown problem with a Firebird database. During the daily use of the database the clients experience significant slowdowns while the system still have lots of resources available. Some information about the environment: - 64 bit Firebird 2.5.2 server running in SuperServer mode - the database is running on a 64 bit Windows 2008 R2 server OS - the server OS is running in a VMware 4.1 VM with 4 CPU cores and 16 GB of RAM - the database size is around 37 GB and the number of concurrent connections to the database is around 150. While observing the slowdowns: - the CPU usage on the machine is between 40-60% without higher spikes and the load is nicely distributed among all 4 cores - the memory usage of the server is around 4-6 GB and the rest of the memory is used as OS cache - the disc queue lenghts almost never go over 0.3 with around 2-5 ms latency - there is almost no network activity on the server. Still, the slowdown seems to be linked to the general load on the server. During the night when no users are connected to the database/no background jobs are running a test query used for reference executes in 4-5 seconds while during the day when all the users are connected to the database executing the same reference query requires 60+ seconds to finish. It should be added though that the slowdown is general in nature, there are no specific queries that are slower while the server is under load, everything gets slower within the specific Firebird database. The server has other databases with a very low number of transactions executed daily and these other databases show no sign of slowdowns. I even created a copy of the live database experiencing slowdowns and executed the same query against both the originaly and the duplicate database - the original did execute the query slow and hte duplicate fast. The only difference between the original and the duplicate I know is the number of connected users/concurrent transactions. As I found no evident reasons of all these in the available OS resources so I tried to fetch statistics from Firebird. The observations: - at peak times the databse has 30-40 transactions running in parallel according to mon$statements (where mon$state == 1 which according to the archives means the transactions are running or are waiting for a lock) - fb_lock_print displays the following about the database: LOCK_HEADER BLOCK Version: 145, Active owner: 0, Length: 2097152, Used: 1335440 Flags: 0x0001 Enqs: 9993237, Converts: 93191, Rejects: 1417230, Blocks: 2 Deadlock scans: 0, Deadlocks: 0, Scan interval: 10 Acquires: 19972846, Acquire blocks: 0, Spin count: 0 Mutex wait: 0.0% Hash slots: 1009, Hash lengths (min/avg/max): 0/ 2/ 7 Remove node: 0, Insert queue: 0, Insert prior: 0 Owners (38): forward: 20824, backward: 872088 Free owners (126): forward: 973360, backward: 728016 Free locks (370): forward: 852200, backward: 195936 Free requests (12425): forward: 614608, backward: 1230536 Lock Ordering: Enabled Here I noted that the rejects field accounts for ~14% of enqs field but unfortunately I don't know the exact meaning of these values. I guess about 14% of the lock requests are rejected for some reason but I might be completely wrong. So the questions: - How should the output of fb_lock_print interpreted in this case? Are these numbers wrong in some sense? Can they be improved by some parameter tuning? - What additional steps should be taken to pinpoint what causes the slowdowns? Thanks, Zoltan
Re: [firebird-support] OT: Vote for Firebird as Database of the Year 2013 at LinuxQuestions
Hi All, I think more than 6000 people here should be more active in terms of Firebird visibility support - this poll received only 29 votes for Firebird. Also, it would be nice to have more testimonials from Firebirders: http://www.firebirdsql.org/en/testimonials/ (submit your testimonial in the end of the page - in any language). Regards, Alexey Kovyazin Vote for Firebird as Database of the Year 2013 at LinuxQuestions (*must be registered user with at least one Linux related post*) http://www.linuxquestions.org/questions/2013-linuxquestions-org-members-choice-awards-109/database-of-the-year-4175488206/ _
Re: [firebird-support] OT: Vote for Firebird as Database of the Year 2013 at LinuxQuestions
Thank you, Maya! Your testimonial is visible now. Regards, Alexey Kovyazin We chose Firebird ourselves, and love Firebird. We use Windows though, not Linux, but we do have a few sites that have chosen to use a Linux server. Haven't voted on the poll, as we really have no Linux related question to ask, so don't qualify to vote on that poll. Have added a testimonial to the Firebird page now though ;-)
Re: [firebird-support] Internal Firebird consistency check (cannot find record back version (291) - how to fix and prevent?
Hi, The nature of errors is the following - one of record's backversions is missing, and Firebird cannot read chain of back versions to build actual (yours) version of this record. The reason wrong transaction management, I think, is not correct, and we will change it - usually this happens due to hardware problem in RAM or disk. I am trying to fix this error by using gfix: gfix.exe -v -f -user SYSDBA -password masterkey MYDB.FDB try gfix -mend ... gbak -b -g -v -ig ... And, IBSurgeon FirstAID should be able to export data from this database for sure. Regards, Alexey Kovyazin www.IBSurgeon.com Hello guys, I have atleast one database on which this problem occurs when I try to backup the database. I do not know what caused this problem. Is it possible to cause this problem by executing DDL/DML statements? On this page: http://ibsurgeon.com/articles/item69; the reason for this problem is explained as: Most probable reason is wrong transaction management. What is the wrong transaction management? How server could allow this problem to happen? I am trying to fix this error by using gfix: gfix.exe -v -f -user SYSDBA -password masterkey MYDB.FDB gfix is returning this: Summary of validation errors Number of record level errors : 8 But it does not fix it, everytime I run this command I get the same response from gfix. I've executed query SELECT COUNT(*) FROM MY_TABLE to scan all records in table and I've got the same message as in backup proccess. So I guess I could manually delete the rows from table? But why gfix does not fix it? Thanks for your time.
Re: [firebird-support] Very very very slow FB 2.5.2 64bit performance on Windows 2008 R2
Hi Roland, I have tried to change this parameter (actually =20), but I don't see any change. 20? It is below all meaningful values. If you are using SuperServer, set 1, if Classic or SuperClassic, set 1024, and _restart_ Firebird. What else can I test? If you are interested in professional optimization (http://ib-aid.com/services/optimization), contact our support. Regards, Alexey Kovyazin www.IBSurgeon.com AFAIK, the parameter DefaultDbCachePages is intended for newly created databases as default size of cache pages. It doesn't have effect on existing databases where its own setting is used. Every database can have own setting about count of cache pages. It seems to be still not solving this problem using by FileSystemCacheSize. What else can I test? Thanks. 22.01.2014 15:05 - Hugo Eyng hugoe...@msn.com Try changing values for DefaultDbCachePages Em 21/01/2014 18:40, Roland Turcan escreveu: I have tried to change this parameter (actually =20), but I don't see any change. My server box is: Hewlett Packard server Intel Xeon CPU E31220 @ 3.10GHx 10GB RAM (8 GB RAM is usable) Firebird 2.5.2 64bit SuperServer single database is being used where its size is about 80GB When I copy any big file to test the performance of disk field then I can see that it can force disk performance, but Firebird is still relaxing. When I try to backup database using gbak no change. CPU core is on 3-6% and disk load is about 1MB/s What can I check else? Thanks in advance. TRoland; 21.01.2014 15:17 - Hugo Eyng hugoe...@msn.com mailto:hugoe...@msn.com I changed the paramter FileSystemCacheSize = 0 to FileSystemCacheSize = 20 in the firebird.conf as suggested in: http://dyemanov.blogspot.com.br/2012/03/firebird-vs-windows-file-system-caching.html Hugo Em 21/01/2014 12:06, Roland Turcan escreveu: Yes, I am interested too. What was the key to get rid of this problem? Thanks in advance. 21.01.2014 15:29 - Fabiano - Desenvolvimento SCI fabi...@sci10.com.br mailto:fabi...@sci10.com.br How you solved your problem? *De: *firebird-support@yahoogroups.com mailto:firebird-support@yahoogroups.com[mailto:firebird-support@yahoogroups.com] *Em nome de *Hugo Eyng *Enviada em:* terça-feira, 21 de janeiro de 2014 10:24 *Para: *firebird-support@yahoogroups.com mailto:firebird-support@yahoogroups.com *Assunto:* Re: [firebird-support] Very very very slow FB 2.5.2 64bit performance on Windows 2008 R2 Hi Helen. Thanks for your answer. You are right. But the Windows 64 file cache performance was a problem, as said Sean. Só 'reserving' 10GB as a RAM DRIVE grant that I would have always available RAM. But now I solved the 'cache performance' and I will not need RAM DRIVE anymore. Even so, the FB performance is not compatible to the hardware used to run it. Em 20/01/2014 23:12, Helen Borrie escreveu: At 02:01 p.m. 21/01/2014, Hugo Eyng wrote: As Firebird do not use available RAM I created a RAM DRIVE with 10GB and pointed parameter 'TempDirectories' (firebird.conf) to this RAM DRIVE, but FB just uses it rarely in very big 'SELECT'. OK, when FB uses the RAM DRIVE it increases a SELECT speed in more than 80%. I expected FB could use this for every SELECTS and so improve the application. Fb uses RAM directly for sorts, if enough is available. It only takes the sort sets to disk if available RAM is insufficient. Helen Borrie, Support Consultant, IBPhoenix (Pacific) Author of The Firebird Book and The Firebird Book Second Edition http://www.firebird-books.net __ -- Atenciosamente, Hugo Eyng How you solved your problem? *De: *firebird-support@yahoogroups.com mailto:firebird-support@yahoogroups.com[mailto:firebird-support@yahoogroups.com] *Em nome de *Hugo Eyng *Enviada em:* terça-feira, 21 de janeiro de 2014 10:24 *Para: *firebird-support@yahoogroups.com mailto:firebird-support@yahoogroups.com *Assunto:* Re: [firebird-support] Very very very slow FB 2.5.2 64bit performance on Windows 2008 R2 Hi Helen. Thanks for your answer. You are right. But the Windows 64 file cache performance was a problem, as said Sean. Só 'reserving' 10GB as a RAM DRIVE grant that I would have always available RAM. But now I solved the 'cache performance' and I will not need RAM DRIVE anymore. Even so, the FB performance is not compatible to the hardware used to run it. Em 20/01/2014 23:12, Helen Borrie escreveu: At 02:01 p.m. 21/01/2014, Hugo Eyng wrote: As Firebird do not use available RAM I created a RAM DRIVE with 10GB and pointed parameter 'TempDirectories' (firebird.conf) to this RAM DRIVE, but FB just uses it rarely in very big 'SELECT'. OK, when FB uses the RAM DRIVE it increases a SELECT speed in more than 80%. I expected FB could use this for every SELECTS and so improve the application. Fb uses RAM directly for sorts, if enough is available. It only takes
Re: [firebird-support] RE: Firebird configuration for better performance
Hi Steve, Value from database header overrides default value from conf file. So I believe this is Ok. Regards, Alexey Kovyazin IBSurgeon Hi Alexey, For the database (Using GBAK restore with options): Page Size = 8192 Buffers = 1 In the firebird.conf file: DefaultDBCachePages = 32768 Is this okay? Bests, Steve
Re: [firebird-support] Firebird configuration for better performance
Hi Steve, This database is very small, you should not have any performance problems (except related with lack of indices or bad design of metadata). Usually we recommend to set 1 buffers for SuperServer - our experiments have shown that 1 is the best # of buffers for SuperServer. Regards, Alexey Kovyazin www.ibsurgeon.com Hi, I'm running Firebird 2.5.2 SuperServer on a Windows 7 Professional 64-bit PC. The PC currently has 4 GB of RAM, but we plan to upgrade to 8 GB soon. The database is a small database used for inventory and stock control with about 30 tables, with about 6 - 8 concurrent users, and relatively moderate workload (INSERTS, UPDATES and SELECTS) throughout the day. The database is currently empty (we're just starting out) and the size currently stands at about 6 MB and is due to grow as data and transactions are added. To increase performance, I've changed the default Firebird memory settings as thus: For the database (Using GBAK restore with options): Page Size = 8192 Buffers = 32768 In the firebird.conf file: DefaultDBCachePages = 32768 Can anybody here explain to me: 1) Whether the given PC specification (RAM) will support this database? 2) Is this a good configuration? If not what are the ideal values I should adjust to? Thanks in advance for any enlightenment. Regards, Steve Faleiro
Re: [firebird-support] Garbage collection / sweep not happening on super classic
Hi, Oldest transaction 15230691 Oldest active 15230692 Oldest snapshot 15230692 Next transaction16644907 You have long-running active transaction. Use MON$ tables to identify who is holding it and stop. Regards, Alexey Kovyazin www.IBSurgeon.com
Re: [firebird-support] RE: Garbage collection / sweep not happening on super classic
Hi Ryan, My understanding is that gbak does a sweep while doing a backup, which happens nightly, so sweep should be happening then (if I understand it correctly that is). You are wrong. Gbak does not do sweep, it runs snapshot transaction and reads all records in all tables - and, with some conditions, it can clear some garbage versions. Restart should fix oldest active stuck - if it's a real restart (Classic processes sometimes remain active). Did you check that all processes are down? Or did you restart hardware? And it also could be another problem, more complex... I can't say more without detailed investigation. Regards, Alexey Kovyazin www.ibsurgeon.com This is Classic, so yes, automatic sweep is disabled. My understanding is that gbak does a sweep while doing a backup, which happens nightly, so sweep should be happening then (if I understand it correctly that is). Also, running a manual sweep hangs indefinitely. As for the active transaction, restarting Firebird doesn't fix the problem. The ONLY thing that fixes the problem is restoring from a backup file to create a fresh file. According to Sinatica, there are no active transactions while the problem is being exhibited. I will check the raw MON tables, but would restarting the Firebird service not terminate any active transactions? Thanks for all the quick responses! Ryan
Re: [firebird-support] Can a Firebird database be hosted on a hosting site?
Hi, Rent VPS or dedicated server and install there all you need (including Firebird). Regards, Alexey Kovyazin IBSurgeon Hello to all, I would like to host my firebird database on a provider, but don't have an idea on where to start. We currently have a firebird database in which is connected via lan. As our company grows, so its needs. We plan to expand on another branch which will be located on a different site, and we plan to have a website so that we can access our database from one branch to another. I tried searching for providers which can host my database, but failed to find one. I was also thinking of hosting it on our own server but don't know where to start also. Thank you very much.
Re: [firebird-support] What happens when nbackup fails
Hi, Usually when nbackup fails you cannot merge delta file with main database. Sometimes database continue to work (and delta file grows), sometimes you cannot connect to database. In this case you need to contact IBSurgeon support for recovery - we have tools to fix it. It's pretty rare situation, more often you can notice that database is corrupted, while nbackup is working normally - it's working on page level and record-level corruptions are out of nbackup scope. To avoid such situation, make usual backup (with gbak) and test restore regularly. Regards, Alexey Kovyazin IBSurgeon (www.ib-aid.com) I hope you are not fed up with my nbackup questions :) I didn't have any nbackup problems other than being slow on the first full backup process but as I write in the subject line, what happens if nbackup fails while taking a full backup, for example if disk space runs out? Can you think of any potential problems if nbackup fails unexpectedly while backing up?
Re: [firebird-support] RE: Why is this setup not working?
Hi, There are some things in the config which could be tuned, but not many - I would increase size of lock table to 10Mb and number of page buffers to 512 pages. But in general it looks like typical problems are not in place here, i.e. your problem is not obvious and it requires professional support, with database statistics investigation, ongoing transaction's markers monitoring, queries audit, locks analysis, etc. Regards, Alexey Kovyazin Hey Mark. Thanks for your reply. The firebird DB is running SuperClassic. The config kan be found on pastebin http://pastebin.com/ZzxL4xVc
Re: [firebird-support] Single Row Table Becomes Unresponsive
Hi Greg, Run gstat -r or IBAnalyst and check number of record versions in this table. I suppose there could be millions of versions. Regards, Alexey Kovyazin IBSurgeon Hi, We're using Firebird 2.1.2.1818 on Centos 5.9. We have a third party replication product SymmetricDS, that accesses a single row table very often to do reads and writes. (It seems to be using the table to manage some sort of locking between SymmetricDS processes.) Very occasionally, this table becomes unresponsive. The SymmetricDS process hangs and IBExpert cannot access the table. Looking at the Firebird server box we can see a connection that we cannot kill, even with kill -9. The only way we can resolve the problem is to reboot the Firebird machine. Does anyone have any ideas on this? Thanks, Greg
Re: [firebird-support] Why is this setup not working?
Hi Ronnie, You did not provide key characteristics of the server, database and transaction statistics, so please don't expect that you will have reasonable answer (load of RAM and CPU are not characteristics of the server. People have various opinions about big' and small). You also did not provide firebird.conf, operation system settings, database size, typical queries and their lifecycle, etc. According to our experience I can suppose that the answer for your question Why is this setup not working? is the following: probably database application design and/or transaction management have problems. Can it be fixed? Sure - with more details. Regards, Alexey Kovyazin www.IBSurgeon.com Hey guys. We have a webcluster consisting of 8 webservers running a PHP application with a firebird DB. The application have a rather hard peak one time a day and firebird are not able to give us the firebird connections quick enough. When the peak start we experience long responses and timeouts from the webservers due to the connection with the firebird DB. We expected the DB connections to be the problem so we then used persistent connections and told Apache2 to keep its threads for 2500 requests. This made a significant performance boost since we would have the connections ready when we hit the peak. At the peak we have 4000 request pr/m. Now letting Apache2 handle the connection pooling is not a nice way of doing things. We have been looking for a connection pool for firebird but haven't been able to find any software that supports firebird(only one but it didn't support the use of stored procedures)? Does anyone know of any software that can make connection pooling with firebird? The next thing is that even though we keep the connections open we still have timeouts due to the rotation of Apache2 processes. Everytime it rotates it needs to make a new persistent connection and this either give a long response time (20-30 sec) or more that resolves in a timeout from the webserver. The firebird database have ~640 connections when the pool have been build. If we restart our cluster and let Apache2 build up its connection pool we see some strange behavior. Everything is fine until the database hits ~400-~450 connections. Then the timeouts begin. Are we really pushing firebird to its limits? Prier we had issues with firebird as well that let us to shard the database into two instances(on separate hardware). Again this gave us a boost because the load was separated. We have around 1.800.000 requests on one day. This leads to around 720 process rotations that the firebird db is not handling well. We are running firebird WI-V2.5.2.26539 Firebird 2.5. on two windows servers. The physical hardware is very potent. We have load of RAM and CPU and have a flash card installed. If we look at the resources on the physical server there is nothing to see. We do see more resources being used on the peak as is expected. But we are not near on depleting the resources of the hardware. ** /Ronnie
[firebird-support] Firebird seminar in Prague, November 25, 2013
Hi All, Firebird Tour is a series of seminars around the world in 2013 and 2014, devoted to Firebird, with members of Firebird Project as speakers. The first seminar will be in Siegburg (Germany), November 22, 2013 (early bird registration is over, few places at regular price still available). The second stop of Firebird Tour will be in Prague (Czech Republic), November 25, 2013. Firebird 2013 Tour will be devoted to all aspects of transactions, from the basic idea, to the internal implementation, best practices and guidance how to effectively use transactions in the applications, and, of course, performance analysis of transactions and related areas. List of topics to be covered: - Transactions from the beginning: isolation levels and specific Firebird parameters (no_rec_version, table locking, read/write, wait/nowait), examples of their usage - How to use effectively isolation levels and parameters in multi-user applications, typical errors in transactions management - Internal implementation of transactions in Firebird, including versioning, locking and multi-generation mechanism - Garbage, sweep, auto-sweep: what are they and how to make them work for you and not against you - Effective management of transactions in various development tools (Delphi, Java, .NET, etc) - Transactions monitoring: transaction markers, MON$ tables, Trace API, third-party tools, how to find bottlenecks in transaction management and optimize database performance with monitoring - Best practices of transaction management, special approaches to optimize transaction in closed sourced applications. - Overview of Firebird 3.0 features The detailed schedule of talks will be published later. Languages at seminar will English and Czech. Organizers of Firebird Tour are IBSurgeon Ltd (www.ib-aid.com) and IBPhoenix (www.ibphoenix.com). Details Firebird seminar in Prague will take place in Hotel Extol Inn (http://www.extolinn.cz/index.php/en/contacts), November 25, 2013, from 09-00 to 18-00. Attendee’s fees Attendee’s fee includes seminar attendance, coffee-breaks, lunch and beverages. Room is not included. Early bird registration is available till November 1, 20, 2013. Early bird registration is EUR 25 (http://www.shareit.com/product.html?cart=1productid=300604678), for group of 3+ attendees - EUR 19/person (http://www.shareit.com/product.html?cart=1productid=300604679). Regular price registration (after November 1, 2013) is EUR 35, for groups 3+ - 29 eur/person. There are limited seats, so please take your chance and register as soon as possible. Please feel free to ask any questions to organizer’s email firebird2...@ib-aid.com Regards, Alexey Kovyazin IBSurgeon
[firebird-support] ANN: Firebird 2013 Tour - seminar in Siegburg, Germany, November 22, 2013
Hi All, As you probably know, November 22, 2013 in in Siegburg (Germany) there will be Firebird seminar, devoted to all aspects of transactions, from the basic idea to the internal implementation, about the best practices and guidance how to effectively use transactions in the applications, and, of course, performance analysis of transactions and related areas. More details: http://www.firebirdsql.org/en/firebird-conference-tour-2013/ Regards, Alexey Kovyazin IBSurgeon (www.ib-aid.com)
Re: [firebird-support] IBLite iOS and Android
Hi Alan, EMB earns about 100mlns of usd per year and has ~500 headcount (may be more, but it was at the times when they published such stats in their presentations after acquiring CodeGear). Firebird Project has funds about 110k of usd per year (24k of them are being paid by IBSurgeon) and has 4 core developers plus several part timers for testing, drivers, etc. So, very limited resources of 100mln USD pie and very limited resources of 110k are ~1000 times different. Embarcadero can hire good C++ developer for Android and perform migration of InterBase codebase, Firebird Project cannot afford it - all 4 core developers are working at Firebird 3.0 and bug fixing of previous versions. Regards, Alexey Kovyazin IBSurgeon www.ib-aid.com We hear a lot of complaints about EMB and the Delphi product and it all boils down to the notion of not enough resources being applied to development and bug fixes. But they have managed to supply, now, IBLite for both iOS and Android with what looks like a full feature set. How have they done that with what appears to be very limited resources and commitment? And what magic might they have pulled off to move the server into this arena? Is this not as difficult as we currently think? For Firebird? Regards Alan McDonald
Re: [firebird-support] XE4, Interbase Express, 32/64bit, Firebird 2.5.2
Hi! Firebird and InterBase are different databases. Regards, Alexey Kovyazin IBSurgeon Hi! Are there any known incompability issues? Thank you! [Non-text portions of this message have been removed]
Re: [firebird-support] Why a database grows after a cycle backup/restore?
Hi Walter, C:\Archivos de programa\Firebird\Firebird_2_5\bin\Gbak -c -v -t -rep -p 8192 -user SYSDBA -password masterkey D:\RestaurarBASES\BDRestaurada\BASE.GBK 127.0.0.1:D:\RestaurarBASES\BDRestaurada\BASE.FDB -FIX_FSS_D ISO8859_1 -FIX_FSS_MISO8859_1 This is the answer why database grows: -FIX_FSS_D ISO8859_1 -FIX_FSS_MISO8859_1 You should apply this option only once, when upgrading from 2.1. If you apply it every time, you do transliteration every time and database size will grow. Regards, Alexey Kovyazin IBSurgeon [Non-text portions of this message have been removed]
Re: [firebird-support] Firebird database
Hi, So you found 640Gb of information. Is it related with recent leaks of account form BVI offshore companies? :) Regarding your questions - see gbak manual here http://www.firebirdsql.org/en/reference-manuals/ Regards, Alexey Kovyazin IBSurgeon I found a database that weighs 640G, this basis consists of seven files. fdb ie datos_1.fdb datos_2.fdb datos_3.fdb datos_4.fdb datos_5.fdb datos_6.fdb datos_7.fdb as I can generate a backup of the database and how I can perform restore, thanks. [Non-text portions of this message have been removed] [Non-text portions of this message have been removed]
Re: [firebird-support] RDB$PAGES
Hi, You can use our free product DBInfo http://ib-aid.com/products/firebird_interbase/monitoring/dbinfo Also, you can divide size of your database in bytes to the page size of your database. Regards, Alexey Kovyazin IBSurgeon Hi, I'd like to get the count of all types of db pages. If I run the query select count(*), rdb$page_type from rdb$pages group by rdb$page_type I got only about 2200 pages, but there are about 320 000 pages in DB. And the result of query contains only - 3, 4, 6 and 9 type of page. How can I get the real numbers?? Best regards, Tomas __ [Non-text portions of this message have been removed]
Re: [firebird-support] Best Firebird Platform for our Environment
Hello, You need to install 64Gb RAM. If you effective drivers for HDD, OS is not very important. Regards, Alexey Kovyazin IBSurgeon We are trying to determine the best platform for Firebird SQL 2.5.2. Our firebird databases are 40-60gb in size and are being accessed by dbase plus 2.6.2 programs. Currently we are running on Windows 2003 Server with dual Intel XEON E5430 quad-core processors and 8gb RAM. This server is being accessed with Windows Remote Desktop. We are in the process of replacing this server with a new server using 2 Intel XEON E5-2640 processors and 16gb of RAM. We are trying to determine whether we should go with Windows or Linux. We also want to consider client/server versus the current model we are using. We would use Intel I7-3770K processors with 8gb of ram for workstations. [Non-text portions of this message have been removed]
Re: [firebird-support] gbak restore error
Rick, No space left on the disk. Regards, Alexey Kovyazin IBSurgeon Does anyone know what this error from gbak is? Done with volume #1, /mnt/usb/firebird/clone.fbk Press return to reopen that file, or type a new name followed by return to open a different file. [Non-text portions of this message have been removed]
Re: [firebird-support] Re: Internal GDS errors that cause corruption and unrecoverable databases
Hi Eduardo, I also got a good look at FBGuard from IBSurgeon that is about perfect for what we need. We have over 300 servers all over the US (including Hawaii and Alaska) so FBGuard looks good. Poul, great suggestion. Will change our back up implementation today! FBDataGuard has implementation of check restore. Regards, Alexey Kovyazin IBSurgeon [Non-text portions of this message have been removed]
Re: [firebird-support] Re: SuperClassic 2.52 on Linux Mint 24 Cinnamon Failed
Hello, Did you perform test backup/restore before that? Did you check that all UDFs are in place and they have adequate Windows and Linux versions? Did you test your application with Firebird 2.5.2? Help? return to Interbase 6. It will be the cheapest and the most effective solution. Regards, Alexey Kovyazin IBSurgeon Sorry, that should have been Mint 14. --- In firebird-support@yahoogroups.com mailto:firebird-support%40yahoogroups.com, jackmason17@... wrote: We converted from Windows 7 Interbase 6.02 last Monday by backing up the databases then restoring them to SuperClassic under Mint. The hardware is an Intel I3 with 8GB of memory, a hardware RAID (2 SSDs), and a system SSD. All 5 Firebird databases are on the RAID, a shared drive with Windows 7. All 6 users are on Windows 7. Everything seemed to be running fine until this afternoon. The first indication was a temporary server disconnect for one user. We restarted his program and all seemed well. About an hour later, all users failed, unable to write to the database. In over 12 years of using Interbase 6 on Windows, we have not encountered this problem. When we rebooted the Firebird server, everything returned to normal operation. At the time, we did not know the correct name for the Firebird process so we could not tell if it was still running before the reboot. We do not know where the Firebird logs are located, so cannot check them to see what went wrong. Should we be using a different Firebird server for this setup? Can we determine the cause of the failure after having rebooted? We were having to reboot the Windows 7 Interbase server at least once a week and do not want to have to return to that scenario. We expected Firebird to run for many months without a reboot. Help? [Non-text portions of this message have been removed]
Re: [firebird-support] Hosting Firebird in cloud
Hello, You can use any VPS with reasonable IO bandwidth. Regards, Alexey Kovyazin IBSurgeon What are possible hosting providers that support Firebird? I have searched older blog posts about Azure and Amazon but have found that it has not been very smooth in the past. What is current situation? which VPS (Windows) or cloud provider could be used? [Non-text portions of this message have been removed] _ [Non-text portions of this message have been removed]
Re: [firebird-support] Database corruption with FB 1.5 on Linux... Please help
Hello Myles, Do backup with the following switches: gbak -b -g -v -ig ... Regards, Alexey Kovyazin IBSurgeon We have a Firebird 1.5 Super Server database on Linux running that decided last week to stop successfully completing a backup with GBAK. After running for about an hour, it fails with the following error: gbak: ERROR: database file appears corrupt () gbak: ERROR: wrong page type gbak: ERROR: page 12726 is of wrong type (expected 7, found 5) gbak: ERROR: gds_$receive failed gbak: Exiting before completion due to errors [Non-text portions of this message have been removed]
Re: [firebird-support] URGENT : Corrupt Firebird dabase
Gary, gbak.exe -user SYSDBA -password masterkey -c -R -K -BU 1 -P 8192 -v c:\data\yourdb.bak c:\data\yourdb.gdb I don't think this is good set of options -c means create database from backup -r means replace existing file. This is dangerous option, but if you specify it, you don't need to specify -c -k restore without creating shadows. Useful for those who use shadows. -Bu 1 -sets 1 page buffers. It will be very bad for Classic. -p 8192 specifies page size to 8192. Some people prefer bigger or smaller page sizes. gbak -c -v will preserve current settings and lead to the less potential problems. Regards, Alexey Kovyazin IBSurgeon This works for me: gfix.exe -user SYSDBA -password masterkey -m -f -ignore c:\data\yourdb.gdb gbak.exe -user SYSDBA -password masterkey -b -v -limbo -ignore -garbage c:\data\yourdb.gdb c:\data\yourdb.bak ren c:\data\yourdb.gdb c:\data\yourdb_corrupt.gdb gbak.exe -user SYSDBA -password masterkey -c -R -K -BU 1 -P 8192 -v c:\data\yourdb.bak c:\data\yourdb.gdb Regards Gary On 1/22/2013 11:19 PM, rddymanohar wrote: Hi, One of our clients has a corrupted database (we are getting internal gds error). Its a Firebird Database version 1.5.6, the files size is almost 7.5GB, we are unable to recover it with the normal tools, we have run the Repair procedure in IBFIRST aid and followed the recommended steps following that, using GFIX and GBAK command lines. Backup fails with the following error on a table gbak: ERROR: Internal gds software consistency check (wrong record length (183)) gbak: ERROR: gds_$receive failed We are not able to even delete the table or its data to continue with the backup. The client is down for the last one day. I would really appreciate if any one can help me in find a way to get this database up and running. Thanks [Non-text portions of this message have been removed] [Non-text portions of this message have been removed]
Re: [firebird-support] Is windows better than Linux for Firebird 2.5 64 bit?
Hello, In essence, if you don't know answers for the questions you asked, you should not move to Linux. There are more pitfalls, which cannot be explained by short hints. Regards, Alexey Kovyazin IBSurgeon Hi all, I am considering moving from windows to linux, but not sure if it is a good idea. Any one can give me a hints about this matter? Is it Linux better than windows on the same hardware, regarding performance/security/etc? And if it's better, what distro should I choose and what file system for database file? Thanks and regards, Sugi.
