Paweł Sztromwasser wrote: > Hi, > > I am trying to test the performance of Base2 (2.4.3) installation on > our server. It is an 8-processor machine so we thought about running > several job agents on it to speed up the plugin execution.
You will not gain anything by running multiple job agents on the same machine. It will only use more memory and make the server harder to administrate. It is better to have a single job agent and increase the number of slots it can execute in parallel. The only reason for having multiple job agents on the same server is if you want to configure which plug-ins they can run or which users/projects that may use them independently of each other. For example, one job agent could be dedicated to only run jobs for the server administrator to make sure that important stuff are not delayed. > I started and configured 5 of them, following instructions from > documentation. All are using the same default Base JobAgent account, > the same database user (the same as Base installation) and have access > to the same userfiles folder. They have different ports and external > IDs of course. To test it I used plugins importing genepix raw data to > RawBioAssays. > > Everything seemed fine as far as it was one import at a time. When I > started 5 threads logging in as 5 different users and submitting an > import job I noticed that job agents work in sequence, not in parallel > as I expected. One waits until another finishes executing its job. I > started 2 jobs for 2 different users at the same time using web user > interface with the same effect. > > Where is the bottle neck that stops simultaneous plugin execution? Is > it on the database level where one transactions blocks another until > it is finished? Or maybe, job agents are not supposed to work on the > same machine with Base2 installation? There is nothing in BASE or in the job agents that stops this. It sounds more like a configuration issue. Are you sure that the plug-ins may run on all job agents and that the user is allowed to use them? Have you disabled the internal job queue? Many of the import plug-ins puts more load on the database than on their own process. This means that you will not get very much increase in performance unless the database is able to cope with the increased load. I also recommend that you upgrade to BASE 2.4.4. It contains a very important performance issue fix. It doesn't affect import plug-ins but have a huge effect (50-90% less execution time) in the analysis phase. /Nicklas ------------------------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ basedb-devel mailing list basedb-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/basedb-devel
