Re: [firebird-support] Firebird slowdown.

2017-08-15 Thread Alexey Kovyazin a...@ib-aid.com [firebird-support]

Hi,

It can be several reasons.

Try ##7, 20, 21, 23 from this list
https://www.ib-aid.com/en/articles/45-ways-to-speed-up-firebird-database/

Regards,
Alexey

On 15.08.2017 19:50, anderphil...@hotmail.com [firebird-support] wrote:



Hi, I have a strange problem which is probably quite obvious to 
someone.  If anyone could help it would be much appreciated.



We run a site connected to a Firebird database, its only about 700MB 
in size. We have started running into a regular slowdown of the site 
and have narrowed it down to the database.



The site runs very slowly (7000ms to 8000ms response times) when 
usually it is in the 2000-3000 region.



The odd thing I have discovered is that the site works at normal 
speed, IF I run a SELECT on a couple of the tables in FlameRobin and 
keep them open and the transcations uncommited.



The differnce in the web app response time goes from 2000-3000ms to 
7000ms-8000ms just a couple of seconds after commiting the 
transactions and closing flame robin. Opening them again and running 
the select will bring the app response time right down.



In Process Monitor fbserver.exe uses only roughly 50,000k which seems 
quite low and the server still has over 62% ram free.



The server specs are:


4x Intel(R) Xeon(R) CPU X5650 @ 2.67GHz

physical memory: 4096 MB

7gb disk free


Firebird 2.5.3 x64 super server

Windows 2008 R2

iis 8.5


The application is a remobjects server connected to a ISAPI dll.


We are running a (perhaps out of date) optimised flamerobin.conf file.


Here are the non hashed lines:


DefaultDbCachePages = 384

TempBlockSize = 2048576

TempCacheLimit = 77108864

LockMemSize = 7048576

LockHashSlots = 30011

CpuAffinityMask = 15


I have tried increasing the DefaultDbCachePages to  and it did not 
make a difference



Any help appreciated.


Thankyou


Regards

Philip








Re: [firebird-support] Firebird slowdown.

2017-08-15 Thread Dimitry Sibiryakov s...@ibphoenix.com [firebird-support]
15.08.2017 18:50, anderphil...@hotmail.com [firebird-support] wrote:
> 4x Intel(R) Xeon(R) CPU X5650 @ 2.67GHz
> 
> physical memory: 4096 MB
> 7gb disk free
> 
> Firebird 2.5.3 x64 super server
> Windows 2008 R2

 
https://support.microsoft.com/en-us/help/2207548/slow-performance-on-windows-server-when-using-the-balanced-power-plan


-- 
   WBR, SD.






++

Visit http://www.firebirdsql.org and click the Documentation item
on the main (top) menu.  Try FAQ and other links from the left-side menu there.

Also search the knowledgebases at http://www.ibphoenix.com/resources/documents/ 

++


Yahoo Groups Links

<*> To visit your group on the web, go to:
http://groups.yahoo.com/group/firebird-support/

<*> Your email settings:
Individual Email | Traditional

<*> To change settings online go to:
http://groups.yahoo.com/group/firebird-support/join
(Yahoo! ID required)

<*> To change settings via email:
firebird-support-dig...@yahoogroups.com 
firebird-support-fullfeatu...@yahoogroups.com

<*> To unsubscribe from this group, send an email to:
firebird-support-unsubscr...@yahoogroups.com

<*> Your use of Yahoo Groups is subject to:
https://info.yahoo.com/legal/us/yahoo/utos/terms/



RE: [firebird-support] Automation tools?

2017-08-15 Thread Edward Mendez edmende...@gmail.com [firebird-support]
Kjell,



There is a product called IBEXPERT. This product is an IDE but also has a set 
of command line utilities that allow you to perform scripting from a windows 
CMD shell. It is very powerful. It has functions for working with files, ftp 
servers, sending emails, etc.

Here is the link to their docs. 
http://ibexpert.net/ibe/index.php?n=Doc.IBEBlock.

Here is the link to send email… 
http://ibexpert.net/ibe/index.php?n=Doc.IbecSmtpSendMail , for working with ftp 
servers http://ibexpert.net/ibe/index.php?n=Doc.IbecFtpPutFile .



I HTH,



Edward Mendez







From: firebird-support@yahoogroups.com [mailto:firebird-support@yahoogroups.com]
Sent: Tuesday, August 15, 2017 9:36 AM
To: firebird-support@yahoogroups.com
Subject: [firebird-support] Automation tools?





Hi,

We're in need of a tool where we can author sequences of SQL queries against FB 
and non-DB commands like file operations etc. I'd like to call them "batch 
runs" to perform recurring tasks.

Do you know of such tools or what that kind of tool would be called in general?

We need to be able to schedule some runs. Others need to be triggered by e.g. 
the appearance of a file in a local or FTP/SFTP folder. Yet others need to be 
executed ad hoc, i.e. started manually.

We also need to be able to enter conditions/checks between each step, to check 
results, e.g. reasonable number of affected records, and bail out or at least 
send a warning e-mail message to me if something goes wrong or looks suspicious.

Regards,
Kjell

--



Kjell Rilbe
Telefon: 08-761 06 55
Mobil: 0733-44 24 64

Marknadsinformation i Sverige AB
Ulvsundavägen 106C
168 67 Bromma
www.marknadsinformation.se  
08-514 905 90

 
 







[Non-text portions of this message have been removed]



RE: [firebird-support] Automation tools?

2017-08-15 Thread 'Leyne, Sean' s...@broadviewsoftware.com [firebird-support]
Kjell,

> We're in need of a tool where we can author sequences of SQL queries
> against FB and non-DB commands like file operations etc. I'd like to call them
> "batch runs" to perform recurring tasks.
> 
> Do you know of such tools or what that kind of tool would be called in
> general?
> 
> We need to be able to schedule some runs. Others need to be triggered by
> e.g. the appearance of a file in a local or FTP/SFTP folder. Yet others need 
> to
> be executed ad hoc, i.e. started manually.
> 
> We also need to be able to enter conditions/checks between each step, to
> check results, e.g. reasonable number of affected records, and bail out or at
> least send a warning e-mail message to me if something goes wrong or looks
> suspicious.

You could look at the IBExpert IBEScript tool, it has a lot of functionality 
that you could leverage, alone or together with some PowerShell scripts (forget 
batch files -- PS is much more powerful, though initially confusing).


Sean



Re: [firebird-support] Automation tools?

2017-08-15 Thread Mark Rotteveel m...@lawinegevaar.nl [firebird-support]
On 15-8-2017 15:36, Kjell Rilbe kjell.ri...@marknadsinformation.se 
[firebird-support] wrote:

> We're in need of a tool where we can author sequences of SQL queries 
> against FB and non-DB commands like file operations etc. I'd like to 
> call them "batch runs" to perform recurring tasks.
> 
> Do you know of such tools or what that kind of tool would be called in 
> general?
> 
> We need to be able to schedule some runs. Others need to be triggered by 
> e.g. the appearance of a file in a local or FTP/SFTP folder. Yet others 
> need to be executed ad hoc, i.e. started manually.
> 
> We also need to be able to enter conditions/checks between each step, to 
> check results, e.g. reasonable number of affected records, and bail out 
> or at least send a warning e-mail message to me if something goes wrong 
> or looks suspicious.

Sounds like you are looking for an ETL (Extract Transform Load) tool

In the past I have used Pentaho DI (also known as Kettle) 
(http://www.pentaho.com/ and http://community.pentaho.com/) for 
combining data from various sources. Note that there is an open-source - 
free - community-edition, but it looks like they are progressively 
moving to a walled-garden for support/information (or at least, making 
it harder to find); see 
http://wiki.pentaho.com/display/EAI/Latest+Pentaho+Data+Integration+%28aka+Kettle%29+Documentation
 
for documentation

It has a variety of tools: Spoon, a GUI to design a transformation or 
job, and Pan (transformations) or Kitchen (jobs) to execute them from 
the command line.

However I haven't used them extensively, so I'm not sure if they are 
suitable for what you want.

Mark
-- 
Mark Rotteveel


Re: [firebird-support] Automation tools?

2017-08-15 Thread Kjell Rilbe kjell.ri...@marknadsinformation.se [firebird-support]
Dimitry Sibiryakov s...@ibphoenix.com [firebird-support] skrev:
> 15.08.2017 15:36, Kjell Rilbe kjell.ri...@marknadsinformation.se 
> [firebird-support] wrote:
>> We're in need of a tool where we can author sequences of SQL queries against 
>> FB and non-DB
>> commands like file operations etc. I'd like to call them "batch runs" to 
>> perform recurring
>> tasks.
>>
>> Do you know of such tools or what that kind of tool would be called in 
>> general?
> This kind of tool used to call "batch files" or "shell scripts". You can 
> use isql as
> well because it has "shell" command, but isql language lack execution flow 
> control directives.

Nononono... That's much too crude.

"Integration tools" perhaps?

Regards,
Kjell






++

Visit http://www.firebirdsql.org and click the Documentation item
on the main (top) menu.  Try FAQ and other links from the left-side menu there.

Also search the knowledgebases at http://www.ibphoenix.com/resources/documents/ 

++


Yahoo Groups Links

<*> To visit your group on the web, go to:
http://groups.yahoo.com/group/firebird-support/

<*> Your email settings:
Individual Email | Traditional

<*> To change settings online go to:
http://groups.yahoo.com/group/firebird-support/join
(Yahoo! ID required)

<*> To change settings via email:
firebird-support-dig...@yahoogroups.com 
firebird-support-fullfeatu...@yahoogroups.com

<*> To unsubscribe from this group, send an email to:
firebird-support-unsubscr...@yahoogroups.com

<*> Your use of Yahoo Groups is subject to:
https://info.yahoo.com/legal/us/yahoo/utos/terms/



Re: [firebird-support] Automation tools?

2017-08-15 Thread Dimitry Sibiryakov s...@ibphoenix.com [firebird-support]
15.08.2017 15:36, Kjell Rilbe kjell.ri...@marknadsinformation.se 
[firebird-support] wrote:
> We're in need of a tool where we can author sequences of SQL queries against 
> FB and non-DB 
> commands like file operations etc. I'd like to call them "batch runs" to 
> perform recurring 
> tasks.
> 
> Do you know of such tools or what that kind of tool would be called in 
> general?

   This kind of tool used to call "batch files" or "shell scripts". You can use 
isql as 
well because it has "shell" command, but isql language lack execution flow 
control directives.


-- 
   WBR, SD.






++

Visit http://www.firebirdsql.org and click the Documentation item
on the main (top) menu.  Try FAQ and other links from the left-side menu there.

Also search the knowledgebases at http://www.ibphoenix.com/resources/documents/ 

++


Yahoo Groups Links

<*> To visit your group on the web, go to:
http://groups.yahoo.com/group/firebird-support/

<*> Your email settings:
Individual Email | Traditional

<*> To change settings online go to:
http://groups.yahoo.com/group/firebird-support/join
(Yahoo! ID required)

<*> To change settings via email:
firebird-support-dig...@yahoogroups.com 
firebird-support-fullfeatu...@yahoogroups.com

<*> To unsubscribe from this group, send an email to:
firebird-support-unsubscr...@yahoogroups.com

<*> Your use of Yahoo Groups is subject to:
https://info.yahoo.com/legal/us/yahoo/utos/terms/



Re: [firebird-support] Automation tools?

2017-08-15 Thread Slavomir Skopalik skopa...@elektlabs.cz [firebird-support]

Hi,

we are using combination of bat and SQL.

In bat file we are generating SQL and vice versa.

Some example:

@SET sql=s1.sql
@ECHO SET TERM ^^; >%sql%
@ECHO EXECUTE BLOCK AS>>%sql%
@ECHO DECLARE VARIABLE s VARCHAR(1000);>>%sql%
@ECHO BEGIN>>%sql%
@ECHO   s = 'CREATE USER %3 PASSWORD ''%4'';';>>%sql%
@ECHO  BEGIN>>%sql%
@ECHOEXECUTE STATEMENT s WITH AUTONOMOUS TRANSACTION;>>%sql%
@ECHO  WHEN ANY DO BEGIN END>>%sql%
@ECHO  END >>%sql%
@ECHO END^^ >>%sql%
@ECHO SET TERM ;^^ >>%sql%
@ECHO GRANT RDB$ADMIN TO %3;>>%sql%
@ECHO SET ECHO OFF; >>%sql%
@ECHO SET HEADING OFF; >>%sql%
@ECHO output RepInfo.bat; >>%sql%
@ECHO SELECT '@SET DBNO='^|^|(MAX(DBNO) + 1) FROM REPL$DATABASES;>>%sql%
@ECHO SELECT '@SET SchNo='^|^|(MAX(ReplNo) + 1) FROM REPL$Schemata;>>%sql%


%ISQL% -b -e -q -charset UTF8 -i %sql% %1
@IF %ERRORLEVEL% NEQ 0 goto :error

Slavek

Ing. Slavomir Skopalik
Executive Head
Elekt Labs s.r.o.
Collection and evaluation of data from machines and laboratories
by means of system MASA (http://www.elektlabs.cz/m2demo)
-
Address:
Elekt Labs s.r.o.
Chaloupky 158
783 72 Velky Tynec
Czech Republic
---
Mobile: +420 724 207 851
icq:199 118 333
skype:skopaliks
e-mail:skopa...@elektlabs.cz
http://www.elektlabs.cz

On 15.8.2017 15:36, Kjell Rilbe kjell.ri...@marknadsinformation.se 
[firebird-support] wrote:


Hi,

We're in need of a tool where we can author sequences of SQL queries 
against FB and non-DB commands like file operations etc. I'd like to 
call them "batch runs" to perform recurring tasks.


Do you know of such tools or what that kind of tool would be called in 
general?


We need to be able to schedule some runs. Others need to be triggered 
by e.g. the appearance of a file in a local or FTP/SFTP folder. Yet 
others need to be executed ad hoc, i.e. started manually.


We also need to be able to enter conditions/checks between each step, 
to check results, e.g. reasonable number of affected records, and bail 
out or at least send a warning e-mail message to me if something goes 
wrong or looks suspicious.


Regards,
Kjell

--

Marknadsinformation logotyp

Kjell Rilbe
Telefon: 08-761 06 55
Mobil: 0733-44 24 64

Marknadsinformation i Sverige AB
Ulvsundavägen 106C
168 67 Bromma
www.marknadsinformation.se 
08-514 905 90

Företagskontakt.se 
Personkontakt.se 







[firebird-support] Automation tools?

2017-08-15 Thread Kjell Rilbe kjell.ri...@marknadsinformation.se [firebird-support]

Hi,

We're in need of a tool where we can author sequences of SQL queries 
against FB and non-DB commands like file operations etc. I'd like to 
call them "batch runs" to perform recurring tasks.


Do you know of such tools or what that kind of tool would be called in 
general?


We need to be able to schedule some runs. Others need to be triggered by 
e.g. the appearance of a file in a local or FTP/SFTP folder. Yet others 
need to be executed ad hoc, i.e. started manually.


We also need to be able to enter conditions/checks between each step, to 
check results, e.g. reasonable number of affected records, and bail out 
or at least send a warning e-mail message to me if something goes wrong 
or looks suspicious.


Regards,
Kjell
--

Marknadsinformation logotyp

Kjell Rilbe
Telefon: 08-761 06 55
Mobil: 0733-44 24 64

Marknadsinformation i Sverige AB
Ulvsundavägen 106C
168 67 Bromma
www.marknadsinformation.se 
08-514 905 90

Företagskontakt.se 
Personkontakt.se 




[firebird-support] Re: replying...

2017-08-15 Thread prosse...@yahoo.com [firebird-support]
Now it works... no one will convince me computers are deterministic.