[firebird-support] 2.5.9 - LOCALTIME
Hi Everyone! Can You recommend a simple workaround on the new LOCALTIME variable when the very same name is used as column name in a table? Thanks in advance Regards Zsolt
[firebird-support] Data dump
Hello guys/gals! What is the fastest (performance-wise) way to export all data from a massive 2.5 database? Any tools installed already with the server or available freely? Thanks in advance! Best Regards Zsolt
[firebird-support] firebird.log in Windows directory
Hi everyone, We are using FB 2.5.2 and 2.5.3 x64 SuperClassic under Windows 2008R2 with default installation options and noticed recently that beside the expected location (%programfiles%\firebird\firebird_2_5\) a firebird.log instance containing fairly recent entries. Anyone else noticed, any way to avoid or should it be registered in the tracker? It bugs the operators as the latter is'nt checked regularly and some failure conditions might be missed. Best Regards Zsolt
Re: [firebird-support] firebird.log in Windows directory
2014-09-19 15:55 GMT+02:00 Mark Rotteveel m...@lawinegevaar.nl [firebird-support] firebird-support@yahoogroups.com: On Fri, 19 Sep 2014 15:14:22 +0200, Zsazsi m-zs...@freemail.hu [firebird-support] firebird-support@yahoogroups.com wrote: Hi everyone, We are using FB 2.5.2 and 2.5.3 x64 SuperClassic under Windows 2008R2 with default installation options and noticed recently that beside the expected location (%programfiles%\firebird\firebird_2_5\) a firebird.log instance containing fairly recent entries. Anyone else noticed, any way to avoid or should it be registered in the tracker? It bugs the operators as the latter is'nt checked regularly and some failure conditions might be missed. That might be from client, not from the server. If fbclient.dll is loaded from the Windows folder, then chances are the log is also written there. Mark Good bet Mark, it seems that only client entries exist in Windows\firebird.log. Our application uses IBX that binds to gds32.dll (a copy of fbclient.dll), which is placed into the WINDOWS\SysWOW64 during installation with fbclient.dll, not into WINDOWS. Also this behaviour seems to exists only in SuperClassic and perhaps Classic, SuperServer writes the client log messages correctly to the FB install base folder. Thanks Zsolt
Re: [firebird-support] Cache Performance Options
Hi Karol, what Windows 2008 memory problem are You refering to that needs 2.5.3? Thanks Zsazsi 2014-05-13 7:23 GMT+02:00 'liviusliv...@poczta.onet.pl' liviusliv...@poczta.onet.pl [firebird-support] firebird-support@yahoogroups.com: Hi, Your database is not big but your settings are low. Change your FB server to 64bit and increase your dbbuffer or in fbconfig defaultdbcasche setting and use superserver. Check your database data page size. I always set it to 16KB. Your database utylize memory in this pattern: Dbpage size * dbbuffers Or if dbbuffer is 0 Db page size * defaultdbcachepages You must add to this sort buffer for any connection. You should also download shnapshot of firebird 2.5.3.xxx to fix windows 2008 memory problem Regards, Karol Bieniasxewski Wysłane z mojego HTC - Reply message - Od: Joshua Hartmann jhartm...@computekdental.com [firebird-support] firebird-support@yahoogroups.com Do: firebird-support@yahoogroups.com Temat: [firebird-support] Cache Performance Options Data: pon., maj 12, 2014 21:32 I am a MSP for a large dental office that uses an application with a Firebird DB. I've done a lot of database work in my life, but none with firebird so I need a little help with the configurations. The office is complaining of slowness and what we've done so far to help them will be below. Keep in mind, I am not the developer of the application, just a MSP trying to help them out since the developer has no clue what they're doing. The server is QEMU/KVM virtual server running Microsoft Server 2008 R2. The host machine is running Ubuntu Server 12.04. Xeon 1275 4 cores allocated to the virtual server 12GB memory allocated to the virtual server (32GB total on the host machine) 750GB Momentus Hybrid SSD/HDD's (RAID 0+1 1.5TB total usable) The database is ~30GB At first, they were running in classic server mode (FB version 2.1.3 x86) on a physical server 2003 machine with 4GB of memory. That machine's HDD's started to fail so we just moved it to the new virtual 2008 server. We let the software company do the install and they set it to classic mode (version 2.1.3 x86) but left all options at default. We noticed the server would start pretty fast but then throughout the day slow down. When checking the system's resources, I noticed it was maxing out on RAM and moving to the page file which explained the slowness. However, task manager did not display that memory was actually being used by the fbserver.exe processes. I asked the developer to switch it to superserver because I read its better for shared cache and since all the clients are accessing the same data (appointment lists, patient lists, etc) I thought it would speed things up. It didn't change the memory usage and fbserver.exe still only reported using about 60MB. So I started reading through articles online and found a bunch of optimization and cache settings. I changed the database options for async, set page buffers at 60k, and turned off auto sweeping. I also changed the firebird.conf settings. Specifically, the MaxFileSystemCache. None of it made any difference. Next, I upgraded to 2.5.2 (still x86) and its made a little difference. I still notice the fbserver using quite a bit of disk IO though and its still not very fast. I guess my questions are: In my situation, should I be using all file system cache or firebird cache? Essentially, what should I set my page buffers and FileSystemCacheThreshole to? I've already set my FileSystemCache to 90%. Should I enable or disable async? Should I enable auto sweeping or not? Would performance be faster if we upgraded to the 64bit version of 2.5.2? Thanks for any advice you can give. -Josh
Re: [firebird-support] Cache Performance Options
Hi Karol, I can see nothing related, The only problem that shows up was fixed in 2.5.2 already. http://tracker.firebirdsql.org/browse/CORE-3791 Do You know something more specific? Regards Zsazsi 2014-05-13 8:56 GMT+02:00 'liviusliv...@poczta.onet.pl' liviusliv...@poczta.onet.pl [firebird-support] firebird-support@yahoogroups.com: Hi, Write in google firebird and windows 2008 cache problem and you will see Regards, Karol Bieniaszewski - Reply message - Od: Zsazsi m-zs...@freemail.hu [firebird-support] firebird-support@yahoogroups.com Do: firebird-support@yahoogroups.com Temat: [firebird-support] Cache Performance Options Data: wt., maj 13, 2014 08:44 Hi Karol, what Windows 2008 memory problem are You refering to that needs 2.5.3? Thanks Zsazsi
Re: [firebird-support] NBackup Levels
Every operating system has some limit on environment strings like command line, that can be a problem on restore where the every level's filename should be supplied. Not sure if it's a theoretical or practical problem in Your case. I use 3 levels (0 - friday night, 1 - every other weekday night, 2 - 90 minutes). Regards Zsazsi 2014-05-07 8:43 GMT+02:00 Steffen Heil (Mailinglisten) li...@steffen-heil.de: Hi There is no formal limit, ... Is there a negative effect on too many levels? (Slowdown or database storage overhead?) Regards, Steffen ++ Visit http://www.firebirdsql.org and click the Resources item on the main (top) menu. Try Knowledgebase and FAQ links ! Also search the knowledgebases at http://www.ibphoenix.com ++ Yahoo Groups Links
Re: [firebird-support] Re: Shutting down the server - active sevice(s)
Hi Vlad, Thank You for the answer. It could be an indication of a memory leak caused by an offending client application that failed to execute isc_dsql_free_statement after executing the statements. Anyone interested how I found out the offending client: selecting the records from the mon$statements table, observing that many statements' mon$state is 0 on statements that running too long from the same attachments. Regards Zsolt
Re: [firebird-support] FB 2.5.2 SS crash
2014-04-28 15:22 GMT+02:00 Gabor Boros gaborbo...@outlook.com: 2014.04.23. 14:57 keltezéssel, Zsazsi írta: Before these, several (I mean a lot) INET/inet_error: read errno = 10054 was logged and the Server refused to answer to the requests for a few minutes. Hi, 10054 is a network error: Connection reset by peer. An existing connection was forcibly closed by the remote host. http://msdn.microsoft.com/en-us/library/windows/desktop/ms740668%28v=vs.85%29.aspx Gabor Hi Gabor, Thanks for the hint. This error is very generic by nature, In my case it was caused by a lot of leaking, open statements (see details in thread Shutting down the server - active sevice(s)) that was not handled very well by the Firebird server. Regards Zsolt
[firebird-support] Shutting down the server - active sevice(s)
Dea all, What does the 110 active service(s) mean in the firebird.log? Is it an indication of some further problem? Shutting down the server with 11 active connection(s) to 3 database(s), 110 active service(s) Any suggestions? FB 2.5.2 SS Win64 Regards Zsolt
[firebird-support] Threads and Handles
Hi all, On one of our client's system the thread and handle count associated with fbserver.exe in Windows Task Manager grows quite quickly. The thread count is around 600 and the handles ar about 7000 after a few hours of Firebird service restart, We have backed up and restored the databases this weekend but it didn't influence this behavior. I'm affraid of having a very similar crash I've already reported here - but didn't got any response. I appreciate any help or hint You may offer. Regards Zsolt
Re: [firebird-support] Very very very slow FB 2.5.2 64bit performance on Windows 2008 R2
Hi folks, Alexey might be referring to us as we also had some performance issues under Win2008R2 and FB 252 SS, but we started a different thread, so I might as well be wrong. Anyway we are still in the process of evaluating the impact of our resolving actions on performance. The operator company rebuilt the server from scratch and we have also changed the application logic a bit, but nothing really changed seriously on either side. We aimed to satisfy the needs and satisfaction of the client and therefore we do not want to change or have any impact on the system that might alter the performance negatively yet. We try to suspend this status quo for some time. More to come on the issue and hopefully the cause and resolution, I ask for Your patience. Regarding Alexey's support. I personally asked for Alexey's help and although we have not got into deep system analysis I must say that during the negotiating process Alexey's attitude was way superior, he was fast at reply, helpful and professional. I am sure we will be happy collaborating on other issues in the future. Regards Zsolt *From:* firebird-support@yahoogroups.com [mailto: firebird-support@yahoogroups.com] *On Behalf Of *Alexey Kovyazin *Sent:* Tuesday, February 18, 2014 3:01 PM *To:* firebird-support@yahoogroups.com *Subject:* Re: [firebird-support] Very very very slow FB 2.5.2 64bit performance on Windows 2008 R2 Hi Marius, Sorry, I don't want to be rude. I just want to point that there is no problem with Windows 2008 R2, and a bit tired with all the same questions (with the same answers). Our largest customers databases are on Win2008R2, and it works just fine - 500+ users and 150Gb, 440Gb with 50 users, etc, etc. And, btw, 440Gb is running at the server in Port Elizabeth. Regarding promotion of our business - there are very few professional service providers listed on the Firebirdsql.org, and they are also Firebird sponsors. Without our sponsorship Firebird would not exists and all users would sit with InterBase 6.0, as it was released by Borland in 2000. Regards, Alexey Kovyazin IBSurgeon Hi, I suppose we all have our opinions. This is not an opinion, this is statement, confirmed by our 12 years experience with Firebird and 5 years with Win 2008. Your problem with Win2008 is lack of knowledge, that's all, sorry for the truth. And I'm not going to offer such technical support for free in this support list, sorry. Try other Firebird service providers: http://www.firebirdsql.org/en/professional-support/ may be they have free time. Regards, Alexey Kovyazin IBSurgeon *[Marius Labuschagne] * *What you doing in this forum Alexey? As far as I am aware this is a support forum, am I wrong? You promoting your business over here with all your years of experience? (Or at least you must be thinking that 12 is a very high number)* *Lets leave it at that, I would not dare ask you for any support anyway.* *Regards* *Marius* -- http://www.avast.com/ This email is free from viruses and malware because avast! Antivirusna zaščita http://www.avast.com/ protection is active.
Re: [firebird-support] Firebird slowdowns while resources are available
Hi Alexey, I've sent a mail directly to You about this particular case asking for personal assistance. Any suggestions or hints are welcome if someone else is willing to participate. Best Regards Zsolt 2014-02-11 9:58 GMT+01:00 Alexey Kovyazin a...@ib-aid.com: Hi Zoltan, this problem is often topic here. Solving this problem is a long boring process, where community will try to explain you basics about transactions and transaction markers meaning, ask you to send gstat statistics, then explain about record versioning and garbage and long-running transactions, about advanced monitoring and so on. In the end you will land with big3 - long-running transactions, bad plans and wrong configuration, each is another big topic . In short, your database size looks pretty serious to afford professional services http://www.firebirdsql.org/en/professional-support/ Regards, Alexey Kovyazin IBSurgeon PS If somebody here wants to go through steps described above, please don't hesitate to do this. Hi, I have a strange slowdown problem with a Firebird database. During the daily use of the database the clients experience significant slowdowns while the system still have lots of resources available. Some information about the environment: - 64 bit Firebird 2.5.2 server running in SuperServer mode - the database is running on a 64 bit Windows 2008 R2 server OS - the server OS is running in a VMware 4.1 VM with 4 CPU cores and 16 GB of RAM - the database size is around 37 GB and the number of concurrent connections to the database is around 150. While observing the slowdowns: - the CPU usage on the machine is between 40-60% without higher spikes and the load is nicely distributed among all 4 cores - the memory usage of the server is around 4-6 GB and the rest of the memory is used as OS cache - the disc queue lenghts almost never go over 0.3 with around 2-5 ms latency - there is almost no network activity on the server. Still, the slowdown seems to be linked to the general load on the server. During the night when no users are connected to the database/no background jobs are running a test query used for reference executes in 4-5 seconds while during the day when all the users are connected to the database executing the same reference query requires 60+ seconds to finish. It should be added though that the slowdown is general in nature, there are no specific queries that are slower while the server is under load, everything gets slower within the specific Firebird database. The server has other databases with a very low number of transactions executed daily and these other databases show no sign of slowdowns. I even created a copy of the live database experiencing slowdowns and executed the same query against both the originaly and the duplicate database - the original did execute the query slow and hte duplicate fast. The only difference between the original and the duplicate I know is the number of connected users/concurrent transactions. As I found no evident reasons of all these in the available OS resources so I tried to fetch statistics from Firebird. The observations: - at peak times the databse has 30-40 transactions running in parallel according to mon$statements (where mon$state == 1 which according to the archives means the transactions are running or are waiting for a lock) - fb_lock_print displays the following about the database: LOCK_HEADER BLOCK Version: 145, Active owner: 0, Length: 2097152, Used: 1335440 Flags: 0x0001 Enqs: 9993237, Converts: 93191, Rejects: 1417230, Blocks: 2 Deadlock scans: 0, Deadlocks: 0, Scan interval: 10 Acquires: 19972846, Acquire blocks: 0, Spin count: 0 Mutex wait: 0.0% Hash slots: 1009, Hash lengths (min/avg/max): 0/ 2/ 7 Remove node: 0, Insert queue: 0, Insert prior: 0 Owners (38): forward: 20824, backward: 872088 Free owners (126): forward: 973360, backward: 728016 Free locks (370): forward: 852200, backward: 195936 Free requests (12425): forward: 614608, backward: 1230536 Lock Ordering: Enabled Here I noted that the rejects field accounts for ~14% of enqs field but unfortunately I don't know the exact meaning of these values. I guess about 14% of the lock requests are rejected for some reason but I might be completely wrong. So the questions: - How should the output of fb_lock_print interpreted in this case? Are these numbers wrong in some sense? Can they be improved by some parameter tuning? - What additional steps should be taken to pinpoint what causes the slowdowns? Thanks, Zoltan
Re: [firebird-support] Re: Fwd: MON$STATE CPU usage
Dear Sean and Dmitry, It is clear now, thanks for taking time to answer. Best Regards Zsolt 2014-02-07 19:20 GMT+01:00 Leyne, Sean s...@broadviewsoftware.com: 07.02.2014 20:39, Leyne, Sean wrote: The case subject reads: Memory usage statistics in MON$STATEMENTS and MON$STATE represent actual **CPU consumption**. Consumption there means consumed / not consumed, No, actually, that is state -- active/inactive. Consumption most commonly refers a measure/amount of usage. So, in the case context actual CPU consumption would refer to the amount of CPU time which a statement has used.. Sean ++ Visit http://www.firebirdsql.org and click the Resources item on the main (top) menu. Try Knowledgebase and FAQ links ! Also search the knowledgebases at http://www.ibphoenix.com ++ Yahoo Groups Links
[firebird-support] Fwd: MON$STATE CPU usage
Hello everyone, I am a bit perplexed understanding the meaning of the values of MON$STATEMENTS.MON$STATE. Here is what I found in the FB 2.5 Release notes: Memory Usage in MON$STATEMENTS and MON$STATE Memory usage statistics in MON$STATEMENTS and MON$STATE represent actual CPU consumption. Tracker reference: CORE-1583http://tracker.firebirdsql.org/browse/CORE-1583 ) The tracker referenced here is not clear on how the MON$STATE represents CPU usage. Any help is greatly appreciated. Regards Zsolt
[firebird-support] FB freeze
Hi everyone! We have FB 2.5.2 SS running on Win2003/x32 and Win2008/x64 servers. around 50 - 150 user connects to de databases . Every now and then some of our clients' FB server service freezes at the time we issue an ALTER DATABASE BEGIN BACKUP or start an nbackup session. After the freeze the FB service stops responding, and only hard stopping the process helps. I couldn't identify any problem at the database or environment level. Some 10057 and 10061 error can be found in the firebird log before the freeze, but these messages are quite common even the system and the nbackup sessions otherwise working well. The database sizes are around 10 - 30 GB and are fully backuped and restored at every weekend. Any idea what could happen and how can I avoid the phenomenon? Best Regards Zsolt [Non-text portions of this message have been removed]
