performance

[Bahaa Alamood]

Hello,

I have an of biz installation and it is used daily for accounting and 
other things, however I am having to restart the server every week to 
keep the performance at an  acceptable speed. my environment is java 1.8 
and the server has 4 GB RAM with 2 core processor. I have noticed that 
the performance decreases with time. I start the server with gradle and 
the background option.


Any Ideas why this is happening?


--
Bahaaldin Al-amood
IQ Tel: +964 (0) 780 926 2103
US tel: 540 632 1388
email: ba...@arcdsc.com
Skype ID: bahaa.alamood

Arc Digital Solutions and Consultancy
www.arcdsc.com

This message contains information that may be confidential
and privileged to Arc digital Solutions and Consultancy, its partners, or 
customers.
Unauthorized use is strictly prohibited. Unless you are the
addressee (or authorized to receive mail for the addressee),
you should not use, copy or disclose to anyone this message
or any information contained in this message. If you have
received this message in error, please so advise the sender
by reply e-mail and delete this message. Thank you for your
cooperation.

Performance issues

[snowch]

Hi Forum,

My application needs to serve images to users but each image request is
checked to ensure the user has permission to view the image.  To do this, I
have created a custom bsh servlet to serve the images for a ftl page (which
are included using   tags).  There can be 20 to 30 images per page.  The
images are around 40Kb.  The page is currently taking 20+ seconds to load
the images.  I have noticed in the log that there be a few second delay
between the ImageServlet finishing and the next request being handled by the
ContextFilter (see below).

Does anyone on this forum have any idea what can be causing the delay?

Many thanks in advance,

Chris

2009-05-11 20:37:56,097 (TP-Processor3) [ ControlServlet.java:256:DEBUG]
[[[ImageServlet] Done rendering page, Servlet Finished- total:0.188,since
last([ImageServlet] Se...):0.125]]
2009-05-11 20:37:56,112 (TP-Processor2) [TransactionUtil.java:187:DEBUG]
[TransactionUtil.commit] transaction committed
2009-05-11 20:37:56,112 (TP-Processor2) [ ControlServlet.java:256:DEBUG]
[[[ImageServlet] Done rendering page, Servlet Finished- total:0.203,since
last([ImageServlet] Se...):0.14]]
2009-05-11 20:38:01,597 (TP-Processor2) [  ContextFilter.java:182:INFO ]
[Request]: /xxx/control/ImageServlet
2009-05-11 20:38:01,612 (TP-Processor3) [  ContextFilter.java:182:INFO ]
[Request]: /xxx/control/ImageServlet

-- 
View this message in context: 
http://www.nabble.com/Performance-issues-tp23490557p23490557.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

performance input

[BJ Freeman]

have a 3ghz cpu 1 gig of ram postresql RHE4.
under full load which is reading in 1000 of products from remote sites
parsing the data and crud the products in ofbiz,
besides handling Realtime orders reception, storage, parsing and
processing upto 1000/per second.
the cpu usage is below 60%.

findListIteratorByCondition performance

[Chris Howe]

I've recently been playing with a data set that has about 4 million
records in the Person entity and am having some performance issues in
the Entity Data Maintenance portion of Webtools.

The only search term is partyTypeId="PERSON"

The bottleneck is the resultEli = delegator...  It takes about 30
seconds

efo.setResultSetType(EntityFindOptions.TYPE_SCROLL_INSENSITIVE);
EntityListIterator resultEli = null;
resultEli = delegator.findListIteratorByCondition(entityName,
condition, null, null, null, efo);
resultPartialList = resultEli.getPartialList(lowIndex, highIndex -
lowIndex + 1);

running the following query from the mysql command line take 0.80
seconds
SELECT * FROM person WHERE party_type_id="PERSON" limit 0,200;

Can anyone offer assistance as to why the discrepency?

Re: performance

[Taher Alkhateeb]

Hi Bahaa,

It's hard to tell without looking at some details. Did you perform any kind
of production optimization as mentioned in [1]?

[1]
https://cwiki.apache.org/confluence/display/OFBIZ/Apache+OFBiz+Technical+Production+Setup+Guide

On Mar 17, 2017 3:11 PM, "Bahaa Alamood" <
balam...@arcdigitalsolutionsandconsultancy.com> wrote:

> Hello,
>
> I have an of biz installation and it is used daily for accounting and
> other things, however I am having to restart the server every week to keep
> the performance at an  acceptable speed. my environment is java 1.8 and the
> server has 4 GB RAM with 2 core processor. I have noticed that the
> performance decreases with time. I start the server with gradle and the
> background option.
>
> Any Ideas why this is happening?
>
>
> --
> Bahaaldin Al-amood
> IQ Tel: +964 (0) 780 926 2103
> US tel: 540 632 1388
> email: ba...@arcdsc.com
> Skype ID: bahaa.alamood
>
> Arc Digital Solutions and Consultancy
> www.arcdsc.com
>
> This message contains information that may be confidential
> and privileged to Arc digital Solutions and Consultancy, its partners, or
> customers.
> Unauthorized use is strictly prohibited. Unless you are the
> addressee (or authorized to receive mail for the addressee),
> you should not use, copy or disclose to anyone this message
> or any information contained in this message. If you have
> received this message in error, please so advise the sender
> by reply e-mail and delete this message. Thank you for your
> cooperation.
>
>

Re: performance

[Bahaa Alamood]

Dear Taher,

Thanks that helped, it is much faster now. I will report back in a week 
to see if the performance degrades or not after that. thanks again



On 3/17/2017 8:31 AM, Taher Alkhateeb wrote:

Hi Bahaa,

It's hard to tell without looking at some details. Did you perform any 
kind of production optimization as mentioned in [1]?


[1] 
https://cwiki.apache.org/confluence/display/OFBIZ/Apache+OFBiz+Technical+Production+Setup+Guide


On Mar 17, 2017 3:11 PM, "Bahaa Alamood" 
<mailto:balam...@arcdigitalsolutionsandconsultancy.com>> wrote:


Hello,

I have an of biz installation and it is used daily for accounting
and other things, however I am having to restart the server every
week to keep the performance at an acceptable speed. my
environment is java 1.8 and the server has 4 GB RAM with 2 core
processor. I have noticed that the performance decreases with
time. I start the server with gradle and the background option.

Any Ideas why this is happening?


-- 
Bahaaldin Al-amood

IQ Tel: +964 (0) 780 926 2103

US tel: 540 632 1388 
email: ba...@arcdsc.com <mailto:ba...@arcdsc.com>
Skype ID: bahaa.alamood

Arc Digital Solutions and Consultancy
www.arcdsc.com <http://www.arcdsc.com>

This message contains information that may be confidential
and privileged to Arc digital Solutions and Consultancy, its
partners, or customers.
Unauthorized use is strictly prohibited. Unless you are the
addressee (or authorized to receive mail for the addressee),
you should not use, copy or disclose to anyone this message
or any information contained in this message. If you have
received this message in error, please so advise the sender
by reply e-mail and delete this message. Thank you for your
cooperation.

Re: performance

[Pierre Smits]

Hi Bahaaldin,

Here are some (other) tips to optimize your production environment for
performance:

   - remove all components that you don't intend to use
   - remove all 3rd party solution integrations that you don't use
   (payment/shipment/etc)
   - don't use gradle to start up, but use java - jar ofbiz.jar
   - set 'check-on-start' to false
   - set 'add-missing-on-start' to false
   - set 'check-inidices-on-start' to false

Best regards,


Pierre Smits

ORRTIZ.COM <http://www.orrtiz.com>
OFBiz based solutions & services

OFBiz Extensions Marketplace
http://oem.ofbizci.net/oci-2/

On Fri, Mar 17, 2017 at 1:10 PM, Bahaa Alamood <
balam...@arcdigitalsolutionsandconsultancy.com> wrote:

> Hello,
>
> I have an of biz installation and it is used daily for accounting and
> other things, however I am having to restart the server every week to keep
> the performance at an  acceptable speed. my environment is java 1.8 and the
> server has 4 GB RAM with 2 core processor. I have noticed that the
> performance decreases with time. I start the server with gradle and the
> background option.
>
> Any Ideas why this is happening?
>
>
> --
> Bahaaldin Al-amood
> IQ Tel: +964 (0) 780 926 2103
> US tel: 540 632 1388
> email: ba...@arcdsc.com
> Skype ID: bahaa.alamood
>
> Arc Digital Solutions and Consultancy
> www.arcdsc.com
>
> This message contains information that may be confidential
> and privileged to Arc digital Solutions and Consultancy, its partners, or
> customers.
> Unauthorized use is strictly prohibited. Unless you are the
> addressee (or authorized to receive mail for the addressee),
> you should not use, copy or disclose to anyone this message
> or any information contained in this message. If you have
> received this message in error, please so advise the sender
> by reply e-mail and delete this message. Thank you for your
> cooperation.
>
>

Re: performance

[Bahaa Alamood]

Hi Pierre,

Thanks for the tips, I use centos 7  for this server, do you have a 
startup script for this or hints on how to create one?



On 3/18/2017 4:44 AM, Pierre Smits wrote:

Hi Bahaaldin,

Here are some (other) tips to optimize your production environment for
performance:

- remove all components that you don't intend to use
- remove all 3rd party solution integrations that you don't use
(payment/shipment/etc)
- don't use gradle to start up, but use java - jar ofbiz.jar
- set 'check-on-start' to false
- set 'add-missing-on-start' to false
- set 'check-inidices-on-start' to false

Best regards,


Pierre Smits

ORRTIZ.COM <http://www.orrtiz.com>
OFBiz based solutions & services

OFBiz Extensions Marketplace
http://oem.ofbizci.net/oci-2/

On Fri, Mar 17, 2017 at 1:10 PM, Bahaa Alamood <
balam...@arcdigitalsolutionsandconsultancy.com> wrote:


Hello,

I have an of biz installation and it is used daily for accounting and
other things, however I am having to restart the server every week to keep
the performance at an  acceptable speed. my environment is java 1.8 and the
server has 4 GB RAM with 2 core processor. I have noticed that the
performance decreases with time. I start the server with gradle and the
background option.

Any Ideas why this is happening?


--
Bahaaldin Al-amood
IQ Tel: +964 (0) 780 926 2103
US tel: 540 632 1388
email: ba...@arcdsc.com
Skype ID: bahaa.alamood

Arc Digital Solutions and Consultancy
www.arcdsc.com

This message contains information that may be confidential
and privileged to Arc digital Solutions and Consultancy, its partners, or
customers.
Unauthorized use is strictly prohibited. Unless you are the
addressee (or authorized to receive mail for the addressee),
you should not use, copy or disclose to anyone this message
or any information contained in this message. If you have
received this message in error, please so advise the sender
by reply e-mail and delete this message. Thank you for your
cooperation.

Re: performance

[Pierre Smits]

You could consider looking in the tools folder of your OFBiz instance.

Best regards,

Pierre Smits

ORRTIZ.COM <http://www.orrtiz.com>
OFBiz based solutions & services

OFBiz Extensions Marketplace
http://oem.ofbizci.net/oci-2/

On Sat, Mar 18, 2017 at 1:15 PM, Bahaa Alamood <
balam...@arcdigitalsolutionsandconsultancy.com> wrote:

> Hi Pierre,
>
> Thanks for the tips, I use centos 7  for this server, do you have a
> startup script for this or hints on how to create one?
>
>
> On 3/18/2017 4:44 AM, Pierre Smits wrote:
>
>> Hi Bahaaldin,
>>
>> Here are some (other) tips to optimize your production environment for
>> performance:
>>
>> - remove all components that you don't intend to use
>> - remove all 3rd party solution integrations that you don't use
>> (payment/shipment/etc)
>> - don't use gradle to start up, but use java - jar ofbiz.jar
>> - set 'check-on-start' to false
>> - set 'add-missing-on-start' to false
>> - set 'check-inidices-on-start' to false
>>
>> Best regards,
>>
>>
>> Pierre Smits
>>
>> ORRTIZ.COM <http://www.orrtiz.com>
>>
>> OFBiz based solutions & services
>>
>> OFBiz Extensions Marketplace
>> http://oem.ofbizci.net/oci-2/
>>
>> On Fri, Mar 17, 2017 at 1:10 PM, Bahaa Alamood <
>> balam...@arcdigitalsolutionsandconsultancy.com> wrote:
>>
>> Hello,
>>>
>>> I have an of biz installation and it is used daily for accounting and
>>> other things, however I am having to restart the server every week to
>>> keep
>>> the performance at an  acceptable speed. my environment is java 1.8 and
>>> the
>>> server has 4 GB RAM with 2 core processor. I have noticed that the
>>> performance decreases with time. I start the server with gradle and the
>>> background option.
>>>
>>> Any Ideas why this is happening?
>>>
>>>
>>> --
>>> Bahaaldin Al-amood
>>> IQ Tel: +964 (0) 780 926 2103
>>> US tel: 540 632 1388
>>> email: ba...@arcdsc.com
>>> Skype ID: bahaa.alamood
>>>
>>> Arc Digital Solutions and Consultancy
>>> www.arcdsc.com
>>>
>>> This message contains information that may be confidential
>>> and privileged to Arc digital Solutions and Consultancy, its partners, or
>>> customers.
>>> Unauthorized use is strictly prohibited. Unless you are the
>>> addressee (or authorized to receive mail for the addressee),
>>> you should not use, copy or disclose to anyone this message
>>> or any information contained in this message. If you have
>>> received this message in error, please so advise the sender
>>> by reply e-mail and delete this message. Thank you for your
>>> cooperation.
>>>
>>>
>>>
>

Re: performance

[stimits]

...
- don't use gradle to start up, but use java - jar ofbiz.jar - set 
'check-on-start' to false - set 'add-missing-on-start' to false - set 
'check-inidices-on-start' to false
...
 
I am curious if gradle and the others are just start up time issues...I am 
assuming these have no effect after start up is complete?

Re: performance

[Pierre Smits]

With respect to gradle that is not entirely true. As you use it to run
OFBiz it will continue to consume hardware resources.

Best regards,

Pierre Smits

ORRTIZ.COM 
OFBiz based solutions & services

OFBiz Extensions Marketplace
http://oem.ofbizci.net/oci-2/

On Sat, Mar 18, 2017 at 6:18 PM,  wrote:

> ...
> - don't use gradle to start up, but use java - jar ofbiz.jar - set
> 'check-on-start' to false - set 'add-missing-on-start' to false - set
> 'check-inidices-on-start' to false
> ...
>
> I am curious if gradle and the others are just start up time issues...I am
> assuming these have no effect after start up is complete?

Re: performance

[Scott Gray]

Is there any indication it consumes anything other than some small amount
of RAM after startup?

Regards
Scott

On 19 March 2017 at 22:23, Pierre Smits  wrote:

> With respect to gradle that is not entirely true. As you use it to run
> OFBiz it will continue to consume hardware resources.
>
> Best regards,
>
> Pierre Smits
>
> ORRTIZ.COM 
> OFBiz based solutions & services
>
> OFBiz Extensions Marketplace
> http://oem.ofbizci.net/oci-2/
>
> On Sat, Mar 18, 2017 at 6:18 PM,  wrote:
>
> > ...
> > - don't use gradle to start up, but use java - jar ofbiz.jar - set
> > 'check-on-start' to false - set 'add-missing-on-start' to false - set
> > 'check-inidices-on-start' to false
> > ...
> >
> > I am curious if gradle and the others are just start up time issues...I
> am
> > assuming these have no effect after start up is complete?
>

Performance issues

[Mandar K]

Hi All,

In a recent switchover to Ofbiz we are observing performance issues where
almost all the application is running very slow.

Please give pointers which will give breakthrough.  Thanks for your
inputs,  much appreciated.


Regards
Mk

Re: Performance issues

[BJ Freeman]

Start with memory allocation, then CPU usage.
Also check if you have the cache turned on

other thing you can do on you page is put a start and stop time that
shows page load time.
see if this is the same as the real time you experience.

there also could be some ways for streamlining your code
however that is beyond the scope of the mailing list.

snowch sent the following on 5/11/2009 1:07 PM:
> Hi Forum,
> 
> My application needs to serve images to users but each image request is
> checked to ensure the user has permission to view the image.  To do this, I
> have created a custom bsh servlet to serve the images for a ftl page (which
> are included using   tags).  There can be 20 to 30 images per page.  The
> images are around 40Kb.  The page is currently taking 20+ seconds to load
> the images.  I have noticed in the log that there be a few second delay
> between the ImageServlet finishing and the next request being handled by the
> ContextFilter (see below).
> 
> Does anyone on this forum have any idea what can be causing the delay?
> 
> Many thanks in advance,
> 
> Chris
> 
> 2009-05-11 20:37:56,097 (TP-Processor3) [ ControlServlet.java:256:DEBUG]
> [[[ImageServlet] Done rendering page, Servlet Finished- total:0.188,since
> last([ImageServlet] Se...):0.125]]
> 2009-05-11 20:37:56,112 (TP-Processor2) [TransactionUtil.java:187:DEBUG]
> [TransactionUtil.commit] transaction committed
> 2009-05-11 20:37:56,112 (TP-Processor2) [ ControlServlet.java:256:DEBUG]
> [[[ImageServlet] Done rendering page, Servlet Finished- total:0.203,since
> last([ImageServlet] Se...):0.14]]
> 2009-05-11 20:38:01,597 (TP-Processor2) [  ContextFilter.java:182:INFO ]
> [Request]: /xxx/control/ImageServlet
> 2009-05-11 20:38:01,612 (TP-Processor3) [  ContextFilter.java:182:INFO ]
> [Request]: /xxx/control/ImageServlet
> 

-- 
BJ Freeman
http://www.businessesnetwork.com/automation
http://bjfreeman.elance.com
http://www.linkedin.com/profile?viewProfile=&key=1237480&locale=en_US&trk=tab_pro
Systems Integrator.

Re: Performance issues

[Harmeet Bedi]

For us the following worked
- Look at cache.properties. Change that to cache information. In default dev 
friendly environment xml documents for forms/screens are parsed almost on each 
request
- We were serving images from a remote location. The way ofbiz was serving 
images was Browser -> Ofbiz -> Fetch remote content. Instead we changed to 
display actual URL of image. Check to see if you your html page has the Image 
URLs.

Hope it helps,
Harmeet

- Original Message -
From: "snowch" 
To: user@ofbiz.apache.org
Sent: Monday, May 11, 2009 4:07:14 PM GMT -05:00 US/Canada Eastern
Subject: Performance issues


Hi Forum,

My application needs to serve images to users but each image request is
checked to ensure the user has permission to view the image.  To do this, I
have created a custom bsh servlet to serve the images for a ftl page (which
are included using   tags).  There can be 20 to 30 images per page.  The
images are around 40Kb.  The page is currently taking 20+ seconds to load
the images.  I have noticed in the log that there be a few second delay
between the ImageServlet finishing and the next request being handled by the
ContextFilter (see below).

Does anyone on this forum have any idea what can be causing the delay?

Many thanks in advance,

Chris

2009-05-11 20:37:56,097 (TP-Processor3) [ ControlServlet.java:256:DEBUG]
[[[ImageServlet] Done rendering page, Servlet Finished- total:0.188,since
last([ImageServlet] Se...):0.125]]
2009-05-11 20:37:56,112 (TP-Processor2) [TransactionUtil.java:187:DEBUG]
[TransactionUtil.commit] transaction committed
2009-05-11 20:37:56,112 (TP-Processor2) [ ControlServlet.java:256:DEBUG]
[[[ImageServlet] Done rendering page, Servlet Finished- total:0.203,since
last([ImageServlet] Se...):0.14]]
2009-05-11 20:38:01,597 (TP-Processor2) [  ContextFilter.java:182:INFO ]
[Request]: /xxx/control/ImageServlet
2009-05-11 20:38:01,612 (TP-Processor3) [  ContextFilter.java:182:INFO ]
[Request]: /xxx/control/ImageServlet

-- 
View this message in context: 
http://www.nabble.com/Performance-issues-tp23490557p23490557.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Performance issues

[snowch]

Problem solved:

Many thanks for the replies...

Chris

...
FileInputStream in = new FileInputStream(filename);
bytes = IOUtils.toByteArray(in);
in.close();

response.setHeader("Content-Type", "image/jpeg");
response.setDateHeader("Expires",  System.currentTimeMillis(  ) +
24*60*60*1000);
response.setHeader("Content-Disposition", "attachment;filename=" +
upliftNumber + "_" + imgNum + ".jpg");

OutputStream out;
if (MyUtil.acceptsGZIP(request))
{
response.setHeader("Content-Encoding", "gzip");
out = new GZIPOutputStream(response.getOutputStream(  ));
}
else {
out = response.getOutputStream(  );
}
IOUtils.write(bytes, out);
out.flush();
out.close();



snowch wrote:
> 
> Hi Forum,
> 
> My application needs to serve images to users but each image request is
> checked to ensure the user has permission to view the image.  To do this,
> I have created a custom bsh servlet to serve the images for a ftl page
> (which are included using   tags).  There can be 20 to 30 images per page. 
> The images are around 40Kb.  The page is currently taking 20+ seconds to
> load the images.  I have noticed in the log that there be a few second
> delay between the ImageServlet finishing and the next request being
> handled by the ContextFilter (see below).
> 
> Does anyone on this forum have any idea what can be causing the delay?
> 
> Many thanks in advance,
> 
> Chris
> 
> 2009-05-11 20:37:56,097 (TP-Processor3) [
> ControlServlet.java:256:DEBUG] [[[ImageServlet] Done rendering page,
> Servlet Finished- total:0.188,since last([ImageServlet] Se...):0.125]]
> 2009-05-11 20:37:56,112 (TP-Processor2) [   
> TransactionUtil.java:187:DEBUG] [TransactionUtil.commit] transaction
> committed
> 2009-05-11 20:37:56,112 (TP-Processor2) [
> ControlServlet.java:256:DEBUG] [[[ImageServlet] Done rendering page,
> Servlet Finished- total:0.203,since last([ImageServlet] Se...):0.14]]
> 2009-05-11 20:38:01,597 (TP-Processor2) [  ContextFilter.java:182:INFO
> ] [Request]: /xxx/control/ImageServlet
> 2009-05-11 20:38:01,612 (TP-Processor3) [  ContextFilter.java:182:INFO
> ] [Request]: /xxx/control/ImageServlet
> 
> 

-- 
View this message in context: 
http://www.nabble.com/Performance-issues-tp23490557p23552601.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Ofbiz performance test

[Vikrant.Rathore]

Hi Everyone,

I have started working on creating a performance test for ofbiz along
with its development. I am using the tool http://www.webload.org/ to do
functional as well as performance testing. I could have done this in
Selenium or JMeter but it seems webload is polished, easy and now is
open source.

If anyone else has some performance figures for ofbiz please would you
share with me.

Thanks
with best regards,
Vikrant

Performance in org.ofbiz.entity.util.EntityListIterator

[Rodrigo Souza]

Hi community!

This is a my implementation to best performance in pagination using
org.ofbiz.entity.util.EntityListIterator class.

Add this method to get size of resultset without create GenericValue.

* public int getSize()throws GenericEntityException {*
*int result = 0;*
*try{*
*   if( resultSet.last() )*
*   result = resultSet.getRow();*

*}  catch (SQLException e) {*
*  Debug.logWarning("Warning: No calculate EntityListIterator
size because of exception: " + e.toString(), module);*
*}*

*return result;*
*}*

RE: performance input

[[EMAIL PROTECTED]]

So the Ofbiz server is on the same machine?  Are the remote machines pushing
the data directly to postgres or through the Ofbiz server?

If the later is the case, that would be pretty impressive.

Is this 1000 per second, minute, day?

I am looking at my non-production setup machine and noting that the service
to create an Invoice from a Shipment is taking 6+ seconds.

Skip

-Original Message-
From: BJ Freeman [mailto:[EMAIL PROTECTED]
Sent: Saturday, November 03, 2007 3:59 PM
To: user@ofbiz.apache.org
Subject: performance input


have a 3ghz cpu 1 gig of ram postresql RHE4.
under full load which is reading in 1000 of products from remote sites
parsing the data and crud the products in ofbiz,
besides handling Realtime orders reception, storage, parsing and
processing upto 1000/per second.
the cpu usage is below 60%.

Re: performance input

[BJ Freeman]

it processes about 21,000 products in about 15min.
the postgresql and ofbiz reside on the same  drive

[EMAIL PROTECTED] sent the following on 11/3/2007 2:08 PM:
> So the Ofbiz server is on the same machine?  Are the remote machines pushing
> the data directly to postgres or through the Ofbiz server?
> 
> If the later is the case, that would be pretty impressive.
> 
> Is this 1000 per second, minute, day?
> 
> I am looking at my non-production setup machine and noting that the service
> to create an Invoice from a Shipment is taking 6+ seconds.
> 
> Skip
> 
> -Original Message-
> From: BJ Freeman [mailto:[EMAIL PROTECTED]
> Sent: Saturday, November 03, 2007 3:59 PM
> To: user@ofbiz.apache.org
> Subject: performance input
> 
> 
> have a 3ghz cpu 1 gig of ram postresql RHE4.
> under full load which is reading in 1000 of products from remote sites
> parsing the data and crud the products in ofbiz,
> besides handling Realtime orders reception, storage, parsing and
> processing upto 1000/per second.
> the cpu usage is below 60%.
> 
> 
> 
> 

Unusual performance question

[stupid]

I am importing several million sales records in a test run using the derby database.  I let it run all night and it averaged about 8000 records an hour and my CPU utilization averaged under 10%.I stopped and restarted it to clear out the log files and when I restarted it, my CPU utilization is now 95% and I am processing 8+ records an hour.I did nothing else except for deleting the contents of the logs directory.This is running on MS Windows.Anyone have a clue as to what could explain the performance increase (so I can duplicate it again)?Skip

Re: findListIteratorByCondition performance

[BJ Freeman]

just curious for a 4 million records
lowIndex, highIndex - lowIndex + 1
1, 4million- 1+1 = 4million.
the other is for 200 only.


Chris Howe sent the following on 12/31/2007 5:24 PM:
> I've recently been playing with a data set that has about 4 million
> records in the Person entity and am having some performance issues in
> the Entity Data Maintenance portion of Webtools.
> 
> The only search term is partyTypeId="PERSON"
> 
> The bottleneck is the resultEli = delegator...  It takes about 30
> seconds
> 
> efo.setResultSetType(EntityFindOptions.TYPE_SCROLL_INSENSITIVE);
> EntityListIterator resultEli = null;
> resultEli = delegator.findListIteratorByCondition(entityName,
> condition, null, null, null, efo);
> resultPartialList = resultEli.getPartialList(lowIndex, highIndex -
> lowIndex + 1);
> 
> running the following query from the mysql command line take 0.80
> seconds
> SELECT * FROM person WHERE party_type_id="PERSON" limit 0,200;
> 
> Can anyone offer assistance as to why the discrepency?
> 
> 
> 
> 

Re: findListIteratorByCondition performance

[Chris Howe]

The webtools entity maint paginates 50 records @ a time


--- BJ Freeman <[EMAIL PROTECTED]> wrote:

> just curious for a 4 million records
> lowIndex, highIndex - lowIndex + 1
> 1, 4million- 1+1 = 4million.
> the other is for 200 only.
> 
> 
> Chris Howe sent the following on 12/31/2007 5:24 PM:
> > I've recently been playing with a data set that has about 4 million
> > records in the Person entity and am having some performance issues
> in
> > the Entity Data Maintenance portion of Webtools.
> > 
> > The only search term is partyTypeId="PERSON"
> > 
> > The bottleneck is the resultEli = delegator...  It takes about 30
> > seconds
> > 
> > efo.setResultSetType(EntityFindOptions.TYPE_SCROLL_INSENSITIVE);
> > EntityListIterator resultEli = null;
> > resultEli = delegator.findListIteratorByCondition(entityName,
> > condition, null, null, null, efo);
> > resultPartialList = resultEli.getPartialList(lowIndex, highIndex -
> > lowIndex + 1);
> > 
> > running the following query from the mysql command line take 0.80
> > seconds
> > SELECT * FROM person WHERE party_type_id="PERSON" limit 0,200;
> > 
> > Can anyone offer assistance as to why the discrepency?
> > 
> > 
> > 
> > 
> 
> 

Re: findListIteratorByCondition performance

[BJ Freeman]

I  change the qty in the URL to get higher number per page.
assumed you did the same.
:)

Chris Howe sent the following on 12/31/2007 8:14 PM:
> The webtools entity maint paginates 50 records @ a time
> 
> 
> --- BJ Freeman <[EMAIL PROTECTED]> wrote:
> 
>> just curious for a 4 million records
>> lowIndex, highIndex - lowIndex + 1
>> 1, 4million- 1+1 = 4million.
>> the other is for 200 only.
>>
>>
>> Chris Howe sent the following on 12/31/2007 5:24 PM:
>>> I've recently been playing with a data set that has about 4 million
>>> records in the Person entity and am having some performance issues
>> in
>>> the Entity Data Maintenance portion of Webtools.
>>>
>>> The only search term is partyTypeId="PERSON"
>>>
>>> The bottleneck is the resultEli = delegator...  It takes about 30
>>> seconds
>>>
>>> efo.setResultSetType(EntityFindOptions.TYPE_SCROLL_INSENSITIVE);
>>> EntityListIterator resultEli = null;
>>> resultEli = delegator.findListIteratorByCondition(entityName,
>>> condition, null, null, null, efo);
>>> resultPartialList = resultEli.getPartialList(lowIndex, highIndex -
>>> lowIndex + 1);
>>>
>>> running the following query from the mysql command line take 0.80
>>> seconds
>>> SELECT * FROM person WHERE party_type_id="PERSON" limit 0,200;
>>>
>>> Can anyone offer assistance as to why the discrepency?
>>>
>>>
>>>
>>>
>>
> 
> 
> 
> 

Re: findListIteratorByCondition performance

[David E Jones]

Have you added timing to see which part of this is taking a long time?  
The main candidates would probably be the findListIteratorByCondition  
call and the getPartialList call.


You could also change it to not do the scroll insensitive... MySQL  
might be doing something funny with that...


-David


On Dec 31, 2007, at 6:24 PM, Chris Howe wrote:


I've recently been playing with a data set that has about 4 million
records in the Person entity and am having some performance issues in
the Entity Data Maintenance portion of Webtools.

The only search term is partyTypeId="PERSON"

The bottleneck is the resultEli = delegator...  It takes about 30
seconds

efo.setResultSetType(EntityFindOptions.TYPE_SCROLL_INSENSITIVE);
EntityListIterator resultEli = null;
resultEli = delegator.findListIteratorByCondition(entityName,
condition, null, null, null, efo);
resultPartialList = resultEli.getPartialList(lowIndex, highIndex -
lowIndex + 1);

running the following query from the mysql command line take 0.80
seconds
SELECT * FROM person WHERE party_type_id="PERSON" limit 0,200;

Can anyone offer assistance as to why the discrepency?





smime.p7s
Description: S/MIME cryptographic signature

Re: findListIteratorByCondition performance

[BJ Freeman]

Chris I would like to work on this with you.
I have a different DB, but large amount of records.
I suggest that we do an java.recordset test like your direct call to mydb.
1)connect to db
2)make SQL execute to return the first recordset using cursors.
3)then another call that moves the cursor by x number of records.

this will give us a reference from java through the driver to the db.
then compare that to the calls for the same number of records through
the code your using.
The will give us a delta of what ofbiz is adding to to the timing and a
benchmark to work on code.

It may turn out that there is something funky about the way mydb works.
I read something like it max record count 5.0 is about 4 million.
Since to to cursor and know the end of the recordset, it must find them
all.  if the number of records you have is close the max record set that
may cause a problem.

Chris Howe sent the following on 12/31/2007 5:24 PM:
> I've recently been playing with a data set that has about 4 million
> records in the Person entity and am having some performance issues in
> the Entity Data Maintenance portion of Webtools.
> 
> The only search term is partyTypeId="PERSON"
> 
> The bottleneck is the resultEli = delegator...  It takes about 30
> seconds
> 
> efo.setResultSetType(EntityFindOptions.TYPE_SCROLL_INSENSITIVE);
> EntityListIterator resultEli = null;
> resultEli = delegator.findListIteratorByCondition(entityName,
> condition, null, null, null, efo);
> resultPartialList = resultEli.getPartialList(lowIndex, highIndex -
> lowIndex + 1);
> 
> running the following query from the mysql command line take 0.80
> seconds
> SELECT * FROM person WHERE party_type_id="PERSON" limit 0,200;
> 
> Can anyone offer assistance as to why the discrepency?
> 
> 
> 
> 

Re: findListIteratorByCondition performance

[BJ Freeman]

also, at least for the db's I use there is a this type of code in ofbiz
SET @skip=1; SET @numrows=5;
PREPARE STMT FROM 'SELECT * FROM tbl LIMIT ?, ?';
EXECUTE STMT USING @skip, @numrows;
this above was taken from
http://dev.mysql.com/doc/refman/5.0/en/select.html

BJ Freeman sent the following on 1/1/2008 3:25 AM:
> Chris I would like to work on this with you.
> I have a different DB, but large amount of records.
> I suggest that we do an java.recordset test like your direct call to mydb.
> 1)connect to db
> 2)make SQL execute to return the first recordset using cursors.
> 3)then another call that moves the cursor by x number of records.
> 
> this will give us a reference from java through the driver to the db.
> then compare that to the calls for the same number of records through
> the code your using.
> The will give us a delta of what ofbiz is adding to to the timing and a
> benchmark to work on code.
> 
> It may turn out that there is something funky about the way mydb works.
> I read something like it max record count 5.0 is about 4 million.
> Since to to cursor and know the end of the recordset, it must find them
> all.  if the number of records you have is close the max record set that
> may cause a problem.
> 
> Chris Howe sent the following on 12/31/2007 5:24 PM:
>> I've recently been playing with a data set that has about 4 million
>> records in the Person entity and am having some performance issues in
>> the Entity Data Maintenance portion of Webtools.
>>
>> The only search term is partyTypeId="PERSON"
>>
>> The bottleneck is the resultEli = delegator...  It takes about 30
>> seconds
>>
>> efo.setResultSetType(EntityFindOptions.TYPE_SCROLL_INSENSITIVE);
>> EntityListIterator resultEli = null;
>> resultEli = delegator.findListIteratorByCondition(entityName,
>> condition, null, null, null, efo);
>> resultPartialList = resultEli.getPartialList(lowIndex, highIndex -
>> lowIndex + 1);
>>
>> running the following query from the mysql command line take 0.80
>> seconds
>> SELECT * FROM person WHERE party_type_id="PERSON" limit 0,200;
>>
>> Can anyone offer assistance as to why the discrepency?
>>
>>
>>
>>
> 
> 
> 
> 

serious performance problems?

[Florin Popa]

Hello all,


I had a quick look here

http://cwiki.apache.org/confluence/display/OFBIZ/Apache+OFBiz+User+List

and it seems most of the ecommerce samples are either no longer 
available or not using ofbiz anymore.


I only found one

http://www.actionenvelope.com

which is for sure based on Ofbiz. I tried using Apache "ab" tool to 
measure the number of requests per second accepted there:


the result is:

<>

Which is similar with what I get on my production system. Tried already 
several attempts for improvements (both implementation and deployment) 
but it seems no chance.


Any clue for this?

regards,
Florin

OFBiz performance issue.

[Anil Soni]

Dear Users,

I am doing OFBiz performance testing on JBOSS application server. I've done all 
the performance setting on both side application side and database side.
But still results are very poor then I decided to find the root cause for the 
problem. For  that I've used Java Profiler to monitor performance and test the 
time taken to load of ecommerce main page and found that Ofbiz is taking lots 
of time in screen / form rendering because every time it parse XML (like 
screens / forms/ and minilang service ) that takes lots of time.

Please refer the below link to check the performance results.

http://www.screencast.com/t/ZGJjM2QxOGY
 I also tried the one thing where I've render the FTL directly in view map 
instead of rendering it in screen and it saves my 50 % time.

So it seems like OFBiz taking lots of time in XML parsing. Is anyone looked 
into this issue and what is the solution for that ?

Any suggestions or reply would be highly appreciated.



Regards,
Anil Soni
Tel  : 91-22-6795 4324
Cell : 91 9930302283



This Email may contain confidential or privileged information for the intended 
recipient (s) If you are not the intended recipient, please do not use or 
disseminate the information, notify the sender and delete it from your system.

__

OFBiz performance levels ?

[Nitin Mittal]

Hello,

I have just started evaluating OFBiz and curious to know what performance 
levels 
does it support. Experienced users, please share some data based on your 
experience. For example, how many concurrent users does it support ? What is 
the 
average response time ?

Not looking for exact figures, just an idea would help a lot.
 thanks,
Nitin Mittal

OFBiz performance enhancement

[Giulio Speri - MpStyle Srl]

Hello everyone,

I would like to ask you some suggestion on improving performances of our
eCommerce site
We're monitoring our jvm  with NewRelic tool and response times are quite
good, and the server on which ofbiz run has minimal cpu/ram usage, but
customers often complains slowness in page loading.

Which components of OFBiz should we change or on which other aspects should
we work on to get better performances (eg: database, catalina servlet
container, Tomcat..) ?

​Thank you in advance,

Giulio​



-- 
Giulio Speri

*Mp Styl**e Srl*
via Antonio Meucci, 37
41019 Limidi di Soliera (MO)
T 059/684916
M 334/3779851

www.mpstyle.it

AW: Performance issues

[Ingo Wolfmayr]

Hi Mk,

I recommend checking the following points first:

1. Database Optimization:
Indexes: Ensure that your database tables are properly indexed. Missing indexes 
can dramatically slow down query performance.
Query Analysis: Use tools like slow query logs to identify inefficient queries 
and optimize them.
Connection Pooling: Verify that your database connection settings are optimized 
for your usage pattern.

For mysql/mariadb I use: https://github.com/major/MySQLTuner-perl for 
performance recommendations

2. Server and JVM Tuning:
Memory Allocation: Increase the JVM heap size if necessary. This is especially 
important if you are experiencing OutOfMemoryErrors.
Garbage Collection: Optimize garbage collection parameters to reduce overhead. 
Tools like VisualVM can help monitor garbage collection and tweak settings.

3. OFBiz Configuration:
Thread Pools: Adjust the size of thread pools in OFBiz to match your server’s 
hardware capabilities.
Service Engine: Review the service engine configuration for performance 
bottlenecks.

Best regards
Ingo

-Ursprüngliche Nachricht-
Von: Mandar K  
Gesendet: Dienstag, 23. April 2024 06:51
An: user@ofbiz.apache.org
Betreff: Performance issues

Hi All,

In a recent switchover to Ofbiz we are observing performance issues where 
almost all the application is running very slow.

Please give pointers which will give breakthrough.  Thanks for your inputs,  
much appreciated.


Regards
Mk

Re: Performance issues

[Mandar K]

Thanks Pierre. Apologies for the delay in responding as I was travelling.
You guys keep the forum interactive !

Below are the details on infra :

16 Core logical
96GB RAM
1 TB HDD SSD
Linux

Share your thoughts.

 BR
Mandar

On Tue, Apr 23, 2024 at 12:08 PM Pierre Smits 
wrote:

> Hi Mandar (I trust this is your first name),
>
> Welcome back.
>
> Could you tell a bit more about your OFBiz implementation (which version,
> which RDBMS, whether running in cloud or on premise, what you use most in
> OFBiz).
>
> Such information will surely help pinpoint your issue
>
> Met vriendelijke groet,
>
> Pierre
>
>
> On Tue, Apr 23, 2024 at 6:53 AM Mandar K  wrote:
>
>> Hi All,
>>
>> In a recent switchover to Ofbiz we are observing performance issues where
>> almost all the application is running very slow.
>>
>> Please give pointers which will give breakthrough.  Thanks for your
>> inputs,  much appreciated.
>>
>>
>> Regards
>> Mk
>>
>

-- 
Regards
Mandar Kulkarni
Adaptability is the whole mystery of life - Swami Vivekanand

Re: Performance issues

[Mandar K]

Thanks Ingo, we will go through the below pointers.

Appreciate it.


On Tue, Apr 23, 2024 at 11:24 AM Ingo Wolfmayr 
wrote:

> Hi Mk,
>
> I recommend checking the following points first:
>
> 1. Database Optimization:
> Indexes: Ensure that your database tables are properly indexed. Missing
> indexes can dramatically slow down query performance.
> Query Analysis: Use tools like slow query logs to identify inefficient
> queries and optimize them.
> Connection Pooling: Verify that your database connection settings are
> optimized for your usage pattern.
>
> For mysql/mariadb I use: https://github.com/major/MySQLTuner-perl for
> performance recommendations
>
> 2. Server and JVM Tuning:
> Memory Allocation: Increase the JVM heap size if necessary. This is
> especially important if you are experiencing OutOfMemoryErrors.
> Garbage Collection: Optimize garbage collection parameters to reduce
> overhead. Tools like VisualVM can help monitor garbage collection and tweak
> settings.
>
> 3. OFBiz Configuration:
> Thread Pools: Adjust the size of thread pools in OFBiz to match your
> server’s hardware capabilities.
> Service Engine: Review the service engine configuration for performance
> bottlenecks.
>
> Best regards
> Ingo
>
> -Ursprüngliche Nachricht-
> Von: Mandar K 
> Gesendet: Dienstag, 23. April 2024 06:51
> An: user@ofbiz.apache.org
> Betreff: Performance issues
>
> Hi All,
>
> In a recent switchover to Ofbiz we are observing performance issues where
> almost all the application is running very slow.
>
> Please give pointers which will give breakthrough.  Thanks for your
> inputs,  much appreciated.
>
>
> Regards
> Mk
>


-- 
Regards
Mandar Kulkarni
Adaptability is the whole mystery of life - Swami Vivekanand

Performance improvement consultancy

[Mandar K]

Dear All, Greetings.

We are looking for formal performance improvement assistance. Anyone who
has optimized it can reach out to me directly for formal consultancy.

Thanks and have a nice day

-- 
Regards
Mandar K
Adaptability is the whole mystery of life - Swami Vivekanand

Re: Ofbiz performance test

[David E. Jones]

That's great Vikrant. Especially as we start working on stabilizing  
the release branch testing in general will be very important.


Unfortunately WebLoad is GPL licensed. What that means is that not  
only can we not include it with OFBiz, but we can't even include code  
that uses it in OFBiz (because it would have to be GPL licensed, and  
if other code used it that code would have to be GPL licensed... the  
viral effect can kill our more friendly licensing).


-David


On Apr 18, 2007, at 7:39 PM, <[EMAIL PROTECTED]>  
<[EMAIL PROTECTED]> wrote:



Hi Everyone,

I have started working on creating a performance test for ofbiz along
with its development. I am using the tool http://www.webload.org/  
to do

functional as well as performance testing. I could have done this in
Selenium or JMeter but it seems webload is polished, easy and now is
open source.

If anyone else has some performance figures for ofbiz please would you
share with me.

Thanks
with best regards,
Vikrant





smime.p7s
Description: S/MIME cryptographic signature

RE: Ofbiz performance test

[Vikrant.Rathore]

Hi David,

Even if we do not include webload with ofbiz its not a problem, since we
can just include the test suites created for it.

I wanted to use JMeter (which can be obviously bundled with ofbiz), but
its not as polished as webload. Also webload is thick client application
and would require it to be installed on load machines, so it would be
good if we just include the test suite and let the users download it
themselves and test the application in their environment. Since at last
its upto the users to do the test based on their specific functional
requirements. Obviously we can use Webload to publish out performance
test results based on specific hardware and software configuration.

So GPL licensing won't pose any problem for us as we are not changing
the source of webload just using it as it is. Moreover we are not
bundling it with ofbiz (there is no need its better if user download by
themselves as it is pretty big application).

Thanks
with best regards,
Vikrant
 

-Original Message-
From: David E. Jones [mailto:[EMAIL PROTECTED] 
Sent: Thursday, April 19, 2007 10:06 AM
To: user@ofbiz.apache.org
Subject: Re: Ofbiz performance test


That's great Vikrant. Especially as we start working on stabilizing the
release branch testing in general will be very important.

Unfortunately WebLoad is GPL licensed. What that means is that not only
can we not include it with OFBiz, but we can't even include code that
uses it in OFBiz (because it would have to be GPL licensed, and if other
code used it that code would have to be GPL licensed... the viral effect
can kill our more friendly licensing).

-David


On Apr 18, 2007, at 7:39 PM, <[EMAIL PROTECTED]>
<[EMAIL PROTECTED]> wrote:

> Hi Everyone,
>
> I have started working on creating a performance test for ofbiz along 
> with its development. I am using the tool http://www.webload.org/ to 
> do functional as well as performance testing. I could have done this 
> in Selenium or JMeter but it seems webload is polished, easy and now 
> is open source.
>
> If anyone else has some performance figures for ofbiz please would you

> share with me.
>
> Thanks
> with best regards,
> Vikrant
>

Re: Ofbiz performance test

[David E. Jones]

One of the big goals for testing tools and a test suite in OFBiz is  
to have tests that can be automatically run periodically by a server,  
and preferably something that only requires a checkout, build, run  
tests.


At this point we haven't a test tool that will fulfill this and other  
things we'd like in an Apache compatible open source license.


As for WebLoad, it would depend on the licensing requirements of the  
scripts it generates as sometimes those or parts of them are licensed  
similar to what generates them.


-David


On Apr 18, 2007, at 8:31 PM, <[EMAIL PROTECTED]>  
<[EMAIL PROTECTED]> wrote:



Hi David,

Even if we do not include webload with ofbiz its not a problem,  
since we

can just include the test suites created for it.

I wanted to use JMeter (which can be obviously bundled with ofbiz),  
but
its not as polished as webload. Also webload is thick client  
application

and would require it to be installed on load machines, so it would be
good if we just include the test suite and let the users download it
themselves and test the application in their environment. Since at  
last

its upto the users to do the test based on their specific functional
requirements. Obviously we can use Webload to publish out performance
test results based on specific hardware and software configuration.

So GPL licensing won't pose any problem for us as we are not changing
the source of webload just using it as it is. Moreover we are not
bundling it with ofbiz (there is no need its better if user  
download by

themselves as it is pretty big application).

Thanks
with best regards,
Vikrant


-Original Message-
From: David E. Jones [mailto:[EMAIL PROTECTED]
Sent: Thursday, April 19, 2007 10:06 AM
To: user@ofbiz.apache.org
Subject: Re: Ofbiz performance test


That's great Vikrant. Especially as we start working on stabilizing  
the

release branch testing in general will be very important.

Unfortunately WebLoad is GPL licensed. What that means is that not  
only

can we not include it with OFBiz, but we can't even include code that
uses it in OFBiz (because it would have to be GPL licensed, and if  
other
code used it that code would have to be GPL licensed... the viral  
effect

can kill our more friendly licensing).

-David


On Apr 18, 2007, at 7:39 PM, <[EMAIL PROTECTED]>
<[EMAIL PROTECTED]> wrote:


Hi Everyone,

I have started working on creating a performance test for ofbiz along
with its development. I am using the tool http://www.webload.org/ to
do functional as well as performance testing. I could have done this
in Selenium or JMeter but it seems webload is polished, easy and now
is open source.

If anyone else has some performance figures for ofbiz please would  
you



share with me.

Thanks
with best regards,
Vikrant







smime.p7s
Description: S/MIME cryptographic signature

RE: Ofbiz performance test

[Vikrant.Rathore]

Hi David,

Yes its a very good idea to periodically do a checkout build and run
tests. I think using JMeter can resolve this problem and I guess its
apache compatible license. 

Currently my checkout, merge (with my own configuration changes), build
is done automatically. I think JMeter can be set to automatically run a
scheduled test and publish the results in html. Would check little
possibility and let you know.

Thanks
with best regards,
Vikrant


-Original Message-
From: David E. Jones [mailto:[EMAIL PROTECTED] 
Sent: Thursday, April 19, 2007 4:20 PM
To: user@ofbiz.apache.org
Subject: Re: Ofbiz performance test


One of the big goals for testing tools and a test suite in OFBiz is to
have tests that can be automatically run periodically by a server, and
preferably something that only requires a checkout, build, run tests.

At this point we haven't a test tool that will fulfill this and other
things we'd like in an Apache compatible open source license.

As for WebLoad, it would depend on the licensing requirements of the
scripts it generates as sometimes those or parts of them are licensed
similar to what generates them.

-David


On Apr 18, 2007, at 8:31 PM, <[EMAIL PROTECTED]>
<[EMAIL PROTECTED]> wrote:

> Hi David,
>
> Even if we do not include webload with ofbiz its not a problem, since 
> we can just include the test suites created for it.
>
> I wanted to use JMeter (which can be obviously bundled with ofbiz), 
> but its not as polished as webload. Also webload is thick client 
> application and would require it to be installed on load machines, so 
> it would be good if we just include the test suite and let the users 
> download it themselves and test the application in their environment. 
> Since at last its upto the users to do the test based on their 
> specific functional requirements. Obviously we can use Webload to 
> publish out performance test results based on specific hardware and 
> software configuration.
>
> So GPL licensing won't pose any problem for us as we are not changing 
> the source of webload just using it as it is. Moreover we are not 
> bundling it with ofbiz (there is no need its better if user download 
> by themselves as it is pretty big application).
>
> Thanks
> with best regards,
> Vikrant
>
>
> -Original Message-
> From: David E. Jones [mailto:[EMAIL PROTECTED]
> Sent: Thursday, April 19, 2007 10:06 AM
> To: user@ofbiz.apache.org
> Subject: Re: Ofbiz performance test
>
>
> That's great Vikrant. Especially as we start working on stabilizing 
> the release branch testing in general will be very important.
>
> Unfortunately WebLoad is GPL licensed. What that means is that not 
> only can we not include it with OFBiz, but we can't even include code 
> that uses it in OFBiz (because it would have to be GPL licensed, and 
> if other code used it that code would have to be GPL licensed... the 
> viral effect can kill our more friendly licensing).
>
> -David
>
>
> On Apr 18, 2007, at 7:39 PM, <[EMAIL PROTECTED]>
> <[EMAIL PROTECTED]> wrote:
>
>> Hi Everyone,
>>
>> I have started working on creating a performance test for ofbiz along

>> with its development. I am using the tool http://www.webload.org/ to 
>> do functional as well as performance testing. I could have done this 
>> in Selenium or JMeter but it seems webload is polished, easy and now 
>> is open source.
>>
>> If anyone else has some performance figures for ofbiz please would 
>> you
>
>> share with me.
>>
>> Thanks
>> with best regards,
>> Vikrant
>>
>

RE: Ofbiz performance test

[Vikrant.Rathore]

Hi David,

After checking out JMeter, it seems it can be run as ant task. The link
below is the Ant Task for JMeter. Also JMeter is apache TLP so bundling
it with ofbiz shoult not be an issue.

http://www.programmerplanet.org/pages/projects/jmeter-ant-task.php

http://jakarta.apache.org/jmeter/

Also we can built functional test using JMeter.

Thanks
with best regards,
Vikrant
 

-Original Message-
From: David E. Jones [mailto:[EMAIL PROTECTED] 
Sent: Thursday, April 19, 2007 4:20 PM
To: user@ofbiz.apache.org
Subject: Re: Ofbiz performance test


One of the big goals for testing tools and a test suite in OFBiz is to
have tests that can be automatically run periodically by a server, and
preferably something that only requires a checkout, build, run tests.

At this point we haven't a test tool that will fulfill this and other
things we'd like in an Apache compatible open source license.

As for WebLoad, it would depend on the licensing requirements of the
scripts it generates as sometimes those or parts of them are licensed
similar to what generates them.

-David


On Apr 18, 2007, at 8:31 PM, <[EMAIL PROTECTED]>
<[EMAIL PROTECTED]> wrote:

> Hi David,
>
> Even if we do not include webload with ofbiz its not a problem, since 
> we can just include the test suites created for it.
>
> I wanted to use JMeter (which can be obviously bundled with ofbiz), 
> but its not as polished as webload. Also webload is thick client 
> application and would require it to be installed on load machines, so 
> it would be good if we just include the test suite and let the users 
> download it themselves and test the application in their environment. 
> Since at last its upto the users to do the test based on their 
> specific functional requirements. Obviously we can use Webload to 
> publish out performance test results based on specific hardware and 
> software configuration.
>
> So GPL licensing won't pose any problem for us as we are not changing 
> the source of webload just using it as it is. Moreover we are not 
> bundling it with ofbiz (there is no need its better if user download 
> by themselves as it is pretty big application).
>
> Thanks
> with best regards,
> Vikrant
>
>
> -Original Message-
> From: David E. Jones [mailto:[EMAIL PROTECTED]
> Sent: Thursday, April 19, 2007 10:06 AM
> To: user@ofbiz.apache.org
> Subject: Re: Ofbiz performance test
>
>
> That's great Vikrant. Especially as we start working on stabilizing 
> the release branch testing in general will be very important.
>
> Unfortunately WebLoad is GPL licensed. What that means is that not 
> only can we not include it with OFBiz, but we can't even include code 
> that uses it in OFBiz (because it would have to be GPL licensed, and 
> if other code used it that code would have to be GPL licensed... the 
> viral effect can kill our more friendly licensing).
>
> -David
>
>
> On Apr 18, 2007, at 7:39 PM, <[EMAIL PROTECTED]>
> <[EMAIL PROTECTED]> wrote:
>
>> Hi Everyone,
>>
>> I have started working on creating a performance test for ofbiz along

>> with its development. I am using the tool http://www.webload.org/ to 
>> do functional as well as performance testing. I could have done this 
>> in Selenium or JMeter but it seems webload is polished, easy and now 
>> is open source.
>>
>> If anyone else has some performance figures for ofbiz please would 
>> you
>
>> share with me.
>>
>> Thanks
>> with best regards,
>> Vikrant
>>
>

Re: Ofbiz performance test

[G.Venkata Phanindra]

Hi,
Its very good idea to integrate JMeter with ofbiz .. when ever i had to use
JMeter for testing i use to run out of resources as i have to run them into
two different JVMs hopefully adding JMEter into ofbiz will solve the issue,
but i also have a question at the same time will it not force us to increase
the Memory size and also the resources while running ofbiz.

Regards
Phani

On 4/19/07, [EMAIL PROTECTED] <
[EMAIL PROTECTED]> wrote:


Hi David,

After checking out JMeter, it seems it can be run as ant task. The link
below is the Ant Task for JMeter. Also JMeter is apache TLP so bundling
it with ofbiz shoult not be an issue.

http://www.programmerplanet.org/pages/projects/jmeter-ant-task.php

http://jakarta.apache.org/jmeter/

Also we can built functional test using JMeter.

Thanks
with best regards,
Vikrant


-Original Message-
From: David E. Jones [mailto:[EMAIL PROTECTED]
Sent: Thursday, April 19, 2007 4:20 PM
To: user@ofbiz.apache.org
Subject: Re: Ofbiz performance test


One of the big goals for testing tools and a test suite in OFBiz is to
have tests that can be automatically run periodically by a server, and
preferably something that only requires a checkout, build, run tests.

At this point we haven't a test tool that will fulfill this and other
things we'd like in an Apache compatible open source license.

As for WebLoad, it would depend on the licensing requirements of the
scripts it generates as sometimes those or parts of them are licensed
similar to what generates them.

-David


On Apr 18, 2007, at 8:31 PM, <[EMAIL PROTECTED]>
<[EMAIL PROTECTED]> wrote:

> Hi David,
>
> Even if we do not include webload with ofbiz its not a problem, since
> we can just include the test suites created for it.
>
> I wanted to use JMeter (which can be obviously bundled with ofbiz),
> but its not as polished as webload. Also webload is thick client
> application and would require it to be installed on load machines, so
> it would be good if we just include the test suite and let the users
> download it themselves and test the application in their environment.
> Since at last its upto the users to do the test based on their
> specific functional requirements. Obviously we can use Webload to
> publish out performance test results based on specific hardware and
> software configuration.
>
> So GPL licensing won't pose any problem for us as we are not changing
> the source of webload just using it as it is. Moreover we are not
> bundling it with ofbiz (there is no need its better if user download
> by themselves as it is pretty big application).
>
> Thanks
> with best regards,
> Vikrant
>
>
> -Original Message-
> From: David E. Jones [mailto:[EMAIL PROTECTED]
> Sent: Thursday, April 19, 2007 10:06 AM
> To: user@ofbiz.apache.org
> Subject: Re: Ofbiz performance test
>
>
> That's great Vikrant. Especially as we start working on stabilizing
> the release branch testing in general will be very important.
>
> Unfortunately WebLoad is GPL licensed. What that means is that not
> only can we not include it with OFBiz, but we can't even include code
> that uses it in OFBiz (because it would have to be GPL licensed, and
> if other code used it that code would have to be GPL licensed... the
> viral effect can kill our more friendly licensing).
>
> -David
>
>
> On Apr 18, 2007, at 7:39 PM, <[EMAIL PROTECTED]>
> <[EMAIL PROTECTED]> wrote:
>
>> Hi Everyone,
>>
>> I have started working on creating a performance test for ofbiz along

>> with its development. I am using the tool http://www.webload.org/ to
>> do functional as well as performance testing. I could have done this
>> in Selenium or JMeter but it seems webload is polished, easy and now
>> is open source.
>>
>> If anyone else has some performance figures for ofbiz please would
>> you
>
>> share with me.
>>
>> Thanks
>> with best regards,
>> Vikrant
>>
>





--
G.Venkata Phanindra
Mob:: 9849852989

Re: Ofbiz performance test

[Cameron Smith]

Dear Vikrant, the following information may or may not
be of use to you.   We have one OFBiz-based product
which runs as a windows service on a laptop.   If the
computer has at least 756Mb RAM, the application runs
satisfactorily once it gets going.

However the specific problem we had was startup time. 
If the service took too long to drag itself up, the
user would click the shortcut in IE, and not get a
response from the Catalina container.

We managed to get the startup time down from about 45s
to 12s, with the measures described below.  These
measurements were taken on a Fujitsu Siemens Amilo Pro
v2030, with a 1.7Ghz Mobile Celeron, and 1Gb RAM. 
Windows XP, SP 2. It had several other applications
open at the same time, to simulate normal usage.  We
used JDK 1.5.005 and MySQL 5.0.24.

Note that, if startup time is NOT your priority, some
of these measures may not be relevant.

1. Logging.
In debug.properties, log only to file and not stdout. 
Set logging to WARN for everything.

2. Modules.
a. Remove all modules from hot-deploy and specialized
except the ones you actually use.  You might also be
able to remove some of the modules in applications but
they do not have a hierarchical dependency, so you can
probably only remove one or two. We only removed the
marketing module, David has been quite clear about
this in previous posts - its generally more trouble
than its worth.
b. WITHIN the modules, deactivate any webapp you ain't
using (simply comment out the relevant part in
ofbiz-component.xml).  For example, the only module we
left up, apart from our own custom module, was
webtools.

3. Containers
a. For a standard webapp system, we found that we can
get by with only the following 5 containers, we
removed everything else:
 component-container
 classloader-container
 naming-container 
 catalina-container

b. Inside catalina-container, only activate the
containers you need - very often it is only http,
https or ajp, depending on your setup

4. Memory.
a. Give the JVM at least 384Mb of memory, otherwise it
really has trouble setting everything up.  You can set
this either in startofbiz.bat/sh, or in service.conf
if you are running as a windows service (see my recent
tutorial on wiki).

There are some other points to explore, which for
various reasons I haven't tried yet.

5. Entity Engine
OFBiz does a lot of clever stuff when it starts up to
match XML entity definitions with what is actually in
the DB.  But in a production system you aren't going
to change this very regularly.  So theoretically you
should switch it off, and shave off a couple more
seconds at start up.
In practice, I only managed the following config for
my delegator in entityengine.xml:
check-on-start="true"
add-missing-on-start="true"
check-pks-on-start="false"

I wanted to set all 3 to false, but when I did this,
the JVM went into an endless loop and then bust with
an OutOfMemoryError.  If anyone could shed any light
I'd be grateful.

6. JDK 1.6
I have run my application without any probs on JDK1.6,
 which is supposed to up to a zillion % faster than
1.5 in certain situations according to SUN.  But I
haven't taken any measurements yet, will let you know
when I do.

7. JNDI
>From what I have seen of OFBiz internals so far, it
doesn't really use JNDI for much.  So I will
investigate taking out this container as well, as for
my scenario, I am not getting anything from JNDI.

cameron



  ___ 
Yahoo! Mail is the world's favourite email. Don't settle for less, sign up for
your free account today 
http://uk.rd.yahoo.com/evt=44106/*http://uk.docs.yahoo.com/mail/winter07.html 

RE: Ofbiz performance test

[Vikrant.Rathore]

Hi Cameron,

Thanks very much for sharing the information. It will be very useful
information for us when we are implementing POS component for ofbiz as
startup time would matter a lot there.

On the server side we are not that much worried about the startup time
but more about the application performance when database grow
exponentially. To give you an idea we expect our database size would
reach atleast 600 GB in 1 year and also the number of active members
would be in upwards of 2.5 million. We do a lot of warehouse and
financial operations. So performance measurement is a must for us. Our
current implementation are all very slow indeed due to the transactions
and size of the database.

Thanks
with best regards,
Vikrant



-Original Message-
From: Cameron Smith [mailto:[EMAIL PROTECTED] 
Sent: Thursday, April 19, 2007 6:34 PM
To: user@ofbiz.apache.org
Subject: Re: Ofbiz performance test

Dear Vikrant, the following information may or may not
be of use to you.   We have one OFBiz-based product
which runs as a windows service on a laptop.   If the
computer has at least 756Mb RAM, the application runs satisfactorily
once it gets going.

However the specific problem we had was startup time. 
If the service took too long to drag itself up, the user would click the
shortcut in IE, and not get a response from the Catalina container.

We managed to get the startup time down from about 45s to 12s, with the
measures described below.  These measurements were taken on a Fujitsu
Siemens Amilo Pro v2030, with a 1.7Ghz Mobile Celeron, and 1Gb RAM. 
Windows XP, SP 2. It had several other applications open at the same
time, to simulate normal usage.  We used JDK 1.5.005 and MySQL 5.0.24.

Note that, if startup time is NOT your priority, some of these measures
may not be relevant.

1. Logging.
In debug.properties, log only to file and not stdout. 
Set logging to WARN for everything.

2. Modules.
a. Remove all modules from hot-deploy and specialized except the ones
you actually use.  You might also be able to remove some of the modules
in applications but they do not have a hierarchical dependency, so you
can probably only remove one or two. We only removed the marketing
module, David has been quite clear about this in previous posts - its
generally more trouble than its worth.
b. WITHIN the modules, deactivate any webapp you ain't using (simply
comment out the relevant part in ofbiz-component.xml).  For example, the
only module we left up, apart from our own custom module, was webtools.

3. Containers
a. For a standard webapp system, we found that we can get by with only
the following 5 containers, we removed everything else:
 component-container
 classloader-container
 naming-container
 catalina-container

b. Inside catalina-container, only activate the containers you need -
very often it is only http, https or ajp, depending on your setup

4. Memory.
a. Give the JVM at least 384Mb of memory, otherwise it really has
trouble setting everything up.  You can set this either in
startofbiz.bat/sh, or in service.conf if you are running as a windows
service (see my recent tutorial on wiki).

There are some other points to explore, which for various reasons I
haven't tried yet.

5. Entity Engine
OFBiz does a lot of clever stuff when it starts up to match XML entity
definitions with what is actually in the DB.  But in a production system
you aren't going to change this very regularly.  So theoretically you
should switch it off, and shave off a couple more seconds at start up.
In practice, I only managed the following config for my delegator in
entityengine.xml:
check-on-start="true"
add-missing-on-start="true"
check-pks-on-start="false"

I wanted to set all 3 to false, but when I did this, the JVM went into
an endless loop and then bust with an OutOfMemoryError.  If anyone could
shed any light I'd be grateful.

6. JDK 1.6
I have run my application without any probs on JDK1.6,  which is
supposed to up to a zillion % faster than
1.5 in certain situations according to SUN.  But I haven't taken any
measurements yet, will let you know when I do.

7. JNDI
>From what I have seen of OFBiz internals so far, it doesn't really use
JNDI for much.  So I will investigate taking out this container as well,
as for my scenario, I am not getting anything from JNDI.

cameron



  ___
Yahoo! Mail is the world's favourite email. Don't settle for less, sign
up for your free account today
http://uk.rd.yahoo.com/evt=44106/*http://uk.docs.yahoo.com/mail/winter07
.html 

Re: Unusual performance question

[BJ Freeman]

might want to ask in the derby ML

[EMAIL PROTECTED] sent the following on 11/9/2007 6:09 PM:
> I am importing several million sales records in a test run using the derby 
> database.  I let it run all night and it averaged about 8000 records an hour 
> and 
> my CPU utilization averaged under 10%.
> 
> I stopped and restarted it to clear out the log files and when I restarted 
> it, 
> my CPU utilization is now 95% and I am processing 8+ records an hour.
> 
> I did nothing else except for deleting the contents of the logs directory.
> 
> This is running on MS Windows.
> 
> Anyone have a clue as to what could explain the performance increase (so I 
> can 
> duplicate it again)?
> 
> Skip

Re: OFBiz performance issue.

[David E Jones]

You need to remove the cache timeouts. There are caches for all of the XML 
widgets that cache it objects that are created from the XML files so no more 
interpretation is needed in order to execute them. If you have the default 
timeouts still enabled those will be thrown away every 10 seconds, causing HUGE 
performance problems. These settings are in the cache.properties file, and you 
can use the WebTools Cache Management pages to check on the cache settings to 
make sure they are what you expect (ie NO timeouts for the widget and other XML 
files, including service defs, etc, etc).

Please be sure to read through the sections on caching and logging in the 
Technical Production Setup Guide that is available on cwiki.apache.org.

-David


On Apr 8, 2010, at 11:50 PM, Anil Soni wrote:

> Dear Users,
> 
> I am doing OFBiz performance testing on JBOSS application server. I've done 
> all the performance setting on both side application side and database side.
> But still results are very poor then I decided to find the root cause for the 
> problem. For  that I've used Java Profiler to monitor performance and test 
> the time taken to load of ecommerce main page and found that Ofbiz is taking 
> lots of time in screen / form rendering because every time it parse XML (like 
> screens / forms/ and minilang service ) that takes lots of time.
> 
> Please refer the below link to check the performance results.
> 
> http://www.screencast.com/t/ZGJjM2QxOGY
> I also tried the one thing where I've render the FTL directly in view map 
> instead of rendering it in screen and it saves my 50 % time.
> 
> So it seems like OFBiz taking lots of time in XML parsing. Is anyone looked 
> into this issue and what is the solution for that ?
> 
> Any suggestions or reply would be highly appreciated.
> 
> 
> 
> Regards,
> Anil Soni
> Tel  : 91-22-6795 4324
> Cell : 91 9930302283
> 
> 
> 
> This Email may contain confidential or privileged information for the 
> intended recipient (s) If you are not the intended recipient, please do not 
> use or disseminate the information, notify the sender and delete it from your 
> system.
> 
> __

Re: OFBiz performance issue.

[Jeroen van der Wal]

You can find the document here:
http://cwiki.apache.org/confluence/display/OFBTECH/Apache+OFBiz+Technical+Production+Setup+Guide#ApacheOFBizTechnicalProductionSetupGuide-CacheSettings
-- 
Jeroen

On Fri, Apr 9, 2010 at 6:56 AM, David E Jones  wrote:
>
> You need to remove the cache timeouts. There are caches for all of the XML 
> widgets that cache it objects that are created from the XML files so no more 
> interpretation is needed in order to execute them. If you have the default 
> timeouts still enabled those will be thrown away every 10 seconds, causing 
> HUGE performance problems. These settings are in the cache.properties file, 
> and you can use the WebTools Cache Management pages to check on the cache 
> settings to make sure they are what you expect (ie NO timeouts for the widget 
> and other XML files, including service defs, etc, etc).
>
> Please be sure to read through the sections on caching and logging in the 
> Technical Production Setup Guide that is available on cwiki.apache.org.
>
> -David
>
>
> On Apr 8, 2010, at 11:50 PM, Anil Soni wrote:
>
>> Dear Users,
>>
>> I am doing OFBiz performance testing on JBOSS application server. I've done 
>> all the performance setting on both side application side and database side.
>> But still results are very poor then I decided to find the root cause for 
>> the problem. For  that I've used Java Profiler to monitor performance and 
>> test the time taken to load of ecommerce main page and found that Ofbiz is 
>> taking lots of time in screen / form rendering because every time it parse 
>> XML (like screens / forms/ and minilang service ) that takes lots of time.
>>
>> Please refer the below link to check the performance results.
>>
>> http://www.screencast.com/t/ZGJjM2QxOGY
>> I also tried the one thing where I've render the FTL directly in view map 
>> instead of rendering it in screen and it saves my 50 % time.
>>
>> So it seems like OFBiz taking lots of time in XML parsing. Is anyone looked 
>> into this issue and what is the solution for that ?
>>
>> Any suggestions or reply would be highly appreciated.
>>
>>
>>
>> Regards,
>> Anil Soni
>> Tel  : 91-22-6795 4324
>> Cell : 91 9930302283
>>
>>
>> 
>> This Email may contain confidential or privileged information for the 
>> intended recipient (s) If you are not the intended recipient, please do not 
>> use or disseminate the information, notify the sender and delete it from 
>> your system.
>>
>> __
>
>

RE: OFBiz performance issue.

[Anil Soni]

Thanks David for the reply.

I 'had already done all these setting and tried on Jboss but still result are  
the same. Now when I am doing testing through Jmeter for concurrent users than 
it is giving the error related to duplicate key value violates for 
UserLoginHistory and ServerHit entities. Here is the error logs :


 exception report --
Failure in create operation for entity [UserLoginHistory]: 
org.ofbiz.entity.GenericEntityException: Error while inserting: [Gener
icEntity:UserLoginHistory][createdStamp,2010-04-13 
11:12:50.609(java.sql.Timestamp)][createdTxStamp,2010-04-13 11:12:50.609(java.
sql.Timestamp)][fromDate,2010-04-13 
11:12:50.609(java.sql.Timestamp)][lastUpdatedStamp,2010-04-13 
11:12:50.609(java.sql.Timestamp
)][lastUpdatedTxStamp,2010-04-13 
11:12:50.609(java.sql.Timestamp)][partyId,admin(java.lang.String)][successfulLogin,Y(java.lang.S
tring)][userLoginId,admin(java.lang.String)][visitId,10049(java.lang.String)] 
(SQL Exception while executing the following:INSERT
 INTO public.USER_LOGIN_HISTORY (USER_LOGIN_ID, VISIT_ID, FROM_DATE, THRU_DATE, 
PASSWORD_USED, SUCCESSFUL_LOGIN, LAST_UPDATED_STA
MP, LAST_UPDATED_TX_STAMP, CREATED_STAMP, CREATED_TX_STAMP, PARTY_ID) VALUES 
(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) (ERROR: duplicate
key value violates unique constraint "pk_user_login_history")). Rolling back 
transaction.
Exception: org.ofbiz.entity.GenericEntityException
Message: Error while inserting: 
[GenericEntity:UserLoginHistory][createdStamp,2010-04-13 
11:12:50.609(java.sql.Timestamp)][create
dTxStamp,2010-04-13 11:12:50.609(java.sql.Timestamp)][fromDate,2010-04-13 
11:12:50.609(java.sql.Timestamp)][lastUpdatedStamp,2010
-04-13 11:12:50.609(java.sql.Timestamp)][lastUpdatedTxStamp,2010-04-13 
11:12:50.609(java.sql.Timestamp)][partyId,admin(java.lang.
String)][successfulLogin,Y(java.lang.String)][userLoginId,admin(java.lang.String)][visitId,10049(java.lang.String)]
 (SQL Exceptio
n while executing the following:INSERT INTO public.USER_LOGIN_HISTORY 
(USER_LOGIN_ID, VISIT_ID, FROM_DATE, THRU_DATE, PASSWORD_US
ED, SUCCESSFUL_LOGIN, LAST_UPDATED_STAMP, LAST_UPDATED_TX_STAMP, CREATED_STAMP, 
CREATED_TX_STAMP, PARTY_ID) VALUES (?, ?, ?, ?, ?
, ?, ?, ?, ?, ?, ?) (ERROR: duplicate key value violates unique constraint 
"pk_user_login_history"))
 cause -
Exception: org.ofbiz.entity.GenericDataSourceException
Message: SQL Exception while executing the following:INSERT INTO 
public.USER_LOGIN_HISTORY (USER_LOGIN_ID, VISIT_ID, FROM_DATE, T
HRU_DATE, PASSWORD_USED, SUCCESSFUL_LOGIN, LAST_UPDATED_STAMP, 
LAST_UPDATED_TX_STAMP, CREATED_STAMP, CREATED_TX_STAMP, PARTY_ID)
VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) (ERROR: duplicate key value violates 
unique constraint "pk_user_login_history")
 cause -
Exception: org.postgresql.util.PSQLException
Message: ERROR: duplicate key value violates unique constraint 
"pk_user_login_history"
 stack trace ---
org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique 
constraint "pk_user_login_history"
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)


Is there any solution for this ?


-Original Message-
From: David E Jones [mailto:d...@me.com]
Sent: Friday, April 09, 2010 10:27 AM
To: user@ofbiz.apache.org
Subject: Re: OFBiz performance issue.


You need to remove the cache timeouts. There are caches for all of the XML 
widgets that cache it objects that are created from the XML files so no more 
interpretation is needed in order to execute them. If you have the default 
timeouts still enabled those will be thrown away every 10 seconds, causing HUGE 
performance problems. These settings are in the cache.properties file, and you 
can use the WebTools Cache Management pages to check on the cache settings to 
make sure they are what you expect (ie NO timeouts for the widget and other XML 
files, including service defs, etc, etc).

Please be sure to read through the sections on caching and logging in the 
Technical Production Setup Guide that is available on cwiki.apache.org.

-David


On Apr 8, 2010, at 11:50 PM, Anil Soni wrote:

> Dear Users,
>
> 

Re: OFBiz performance issue.

[David E Jones]

If you made the change and results are still the same then the change probably 
didn't work. Did you check the WebTools cache management page to see if the 
timeouts were gone?

This isn't rocket science, but be careful when you're doing custom deployments 
(like with JBoss) because the classpath may not be what you think it is...

-David


On Apr 13, 2010, at 12:55 AM, Anil Soni wrote:

> Thanks David for the reply.
> 
> I 'had already done all these setting and tried on Jboss but still result are 
>  the same. Now when I am doing testing through Jmeter for concurrent users 
> than it is giving the error related to duplicate key value violates for 
> UserLoginHistory and ServerHit entities. Here is the error logs :
> 
> 
>  exception report 
> --
> Failure in create operation for entity [UserLoginHistory]: 
> org.ofbiz.entity.GenericEntityException: Error while inserting: [Gener
> icEntity:UserLoginHistory][createdStamp,2010-04-13 
> 11:12:50.609(java.sql.Timestamp)][createdTxStamp,2010-04-13 11:12:50.609(java.
> sql.Timestamp)][fromDate,2010-04-13 
> 11:12:50.609(java.sql.Timestamp)][lastUpdatedStamp,2010-04-13 
> 11:12:50.609(java.sql.Timestamp
> )][lastUpdatedTxStamp,2010-04-13 
> 11:12:50.609(java.sql.Timestamp)][partyId,admin(java.lang.String)][successfulLogin,Y(java.lang.S
> tring)][userLoginId,admin(java.lang.String)][visitId,10049(java.lang.String)] 
> (SQL Exception while executing the following:INSERT
> INTO public.USER_LOGIN_HISTORY (USER_LOGIN_ID, VISIT_ID, FROM_DATE, 
> THRU_DATE, PASSWORD_USED, SUCCESSFUL_LOGIN, LAST_UPDATED_STA
> MP, LAST_UPDATED_TX_STAMP, CREATED_STAMP, CREATED_TX_STAMP, PARTY_ID) VALUES 
> (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) (ERROR: duplicate
> key value violates unique constraint "pk_user_login_history")). Rolling back 
> transaction.
> Exception: org.ofbiz.entity.GenericEntityException
> Message: Error while inserting: 
> [GenericEntity:UserLoginHistory][createdStamp,2010-04-13 
> 11:12:50.609(java.sql.Timestamp)][create
> dTxStamp,2010-04-13 11:12:50.609(java.sql.Timestamp)][fromDate,2010-04-13 
> 11:12:50.609(java.sql.Timestamp)][lastUpdatedStamp,2010
> -04-13 11:12:50.609(java.sql.Timestamp)][lastUpdatedTxStamp,2010-04-13 
> 11:12:50.609(java.sql.Timestamp)][partyId,admin(java.lang.
> String)][successfulLogin,Y(java.lang.String)][userLoginId,admin(java.lang.String)][visitId,10049(java.lang.String)]
>  (SQL Exceptio
> n while executing the following:INSERT INTO public.USER_LOGIN_HISTORY 
> (USER_LOGIN_ID, VISIT_ID, FROM_DATE, THRU_DATE, PASSWORD_US
> ED, SUCCESSFUL_LOGIN, LAST_UPDATED_STAMP, LAST_UPDATED_TX_STAMP, 
> CREATED_STAMP, CREATED_TX_STAMP, PARTY_ID) VALUES (?, ?, ?, ?, ?
> , ?, ?, ?, ?, ?, ?) (ERROR: duplicate key value violates unique constraint 
> "pk_user_login_history"))
>  cause 
> -
> Exception: org.ofbiz.entity.GenericDataSourceException
> Message: SQL Exception while executing the following:INSERT INTO 
> public.USER_LOGIN_HISTORY (USER_LOGIN_ID, VISIT_ID, FROM_DATE, T
> HRU_DATE, PASSWORD_USED, SUCCESSFUL_LOGIN, LAST_UPDATED_STAMP, 
> LAST_UPDATED_TX_STAMP, CREATED_STAMP, CREATED_TX_STAMP, PARTY_ID)
> VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) (ERROR: duplicate key value violates 
> unique constraint "pk_user_login_history")
>  cause 
> -
> Exception: org.postgresql.util.PSQLException
> Message: ERROR: duplicate key value violates unique constraint 
> "pk_user_login_history"
>  stack trace 
> ---
> org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique 
> constraint "pk_user_login_history"
> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
> org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
> org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
> org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)
> 
> 
> Is there any solution for this ?
> 
> 
> -Original Message-
> From: David E Jones [mailto:d...@me.com]
> Sent: Friday, April 09, 2010 10:27 AM
> To: user@ofbiz.apache.org
> Subject: Re: OFBiz performance issue.
> 
> 
> You n

Catalog management performance issue

[Michał Cukierman]

Hi,

I have a problem with performence (and Out of Memmory Issue) with
catalog management module. There is a section invoked after 
Choose Top Category

Collection allCategories =
delegator.findList("ProductCategory", null, null, null, null, false);
for (GenericValue curCat: allCategories) {
Collection parentCats =
curCat.getRelatedCache("CurrentProductCategoryRollup");

 if (parentCats.isEmpty())
results.add(curCat);
}

As we see. To get categories without parents we need to fetch for all
categories and for each of them, find a parent.

I do not know Ofbiz api very well for now, so I have implemented:
EntityWhereString where =
EntityCondition.makeConditionWhere("PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID
not in" +
" (select PRODUCT_CATEGORY_ROLLUP.PRODUCT_CATEGORY_ID from
PRODUCT_CATEGORY_ROLLUP)");
Set fieldsToSelect = FastSet.newInstance();
fieldsToSelect.add("productCategoryId");
results.addAll(delegator.findList("ProductCategory", 
where,
fieldsToSelect, null, null, false));


I simply do invoke a SQL query in the database:

select PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID from PRODUCT_CATEGORY where
PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID not in
(select PRODUCT_CATEGORY_ROLLUP.PRODUCT_CATEGORY_ID from
PRODUCT_CATEGORY_ROLLUP);

Is there a way ( for sure is ) to implement it in a better manner? For
now it works on my system, but after improving the query it could be
passed to a production.

So I got two questions in fact:

1) How to implement Right/Left joins on DynamicViewEntity
2) How to implement my whereString


Thank you in advance,

Re: demo server performance

[Jacques Le Roux]

I have spent a lot of time (I mean in respect of my free time) this last days 
to understand the problems.
It appears that removing the help was a great relief for our demo sever.

For few hours now we are running with

trunk: -Xms128M -Xmx768M -XX:MaxPermSize=192m (so max seems 768+192=960MB but 
actually it's more)
branch9: -Xms128M -Xmx512M

For instance now we have
Mem:   2573924k total,  2159888k used,   414036k free,53672k buffers
Swap:  1502036k total,50676k used,  1451360k free,   438000k cached

PID USER  PR  NI  VIRT  RES  SHR  %CPU %MEM
trunk 14896 ofbiz 20   0 1377m 753m 7956   0.3 30.0
branch918147 ofbiz 20   0  918m 670m  13m   0.7 26.7

As you can see at some stage we reach more than 960MB for the trunk (1377 max, 
which is approx but anyway)

The main points:
* We have still around 400MB  free, but I suppose it will be less just before 
the 24h reload)
* We have anymore CPU running always near 100%, for instance right now
 PID USER  PR  NI  VIRT  RES  SHR  %CPU %MEMTIME+  COMMAND
14896 ofbiz 20   0 1377m 757m 7968  29.7 30.2  19:57.63 java -Xms128M 
-Xmx768M -XX:MaxPermSize=192m
18147 ofbiz 20   0  918m 671m  13m  22.4 26.7  14:23.55 java -Xms128M 
-Xmx512M


I will wait some days and, if things continue to go well, will re-use more 
memory for our 2 processes. But I know there are other
problems...

Like David and Scott said if people are using the Artifact Info or other 
gluttonous features (Birts?) we will be in trouble with our
memory quota. So if such things come back in the future I will suggest to 
prevent users to use them on the demo server...

For the real problems, I think we should focus on fixing the online Help 
feature. It seems that this isues is something relatively
new and a disect should help (I use this word because it's convenient, on my 
side I simply use dichotomic tests with svn but I have
bigger fish to fry for now, that's why I have deactivated it). I think it's not 
more than few days (weeks?), help appreciated...

Thanks

Jacques

From: "BJ Freeman" 

there is a thread on the user ML about the demo being slow.
I would think that would be a high priority for all those that commit and make 
changes to ofbiz.
after all what good is all this stuff if it can't be used.
I brought down the demo trunk by accessing with seperate requests at one time, 
as I stated on the user ml.

lets focus on real problems.

Re: OFBiz performance levels ?

[Jacques Le Roux]

OFBiz is based on Tomcat s. So it is very scalable and depends on hardware and configuration you use (app and db clusters, farms, 
etc.).

This sais when heavily used (hundreds and more) Price Rules, Promotions, or 
even Items per Order are known to be bottlenecks

Jacques

Nitin Mittal wrote:

Hello,

I have just started evaluating OFBiz and curious to know what performance levels
does it support. Experienced users, please share some data based on your
experience. For example, how many concurrent users does it support ? What is the
average response time ?

Not looking for exact figures, just an idea would help a lot.
thanks,
Nitin Mittal 

Re: OFBiz performance levels ?

[Nitin Mittal]

Thanks for your quick reply,
Is there any recommendation for hardware(including RAM, Processor) required for 
a small to medium startup ecommerce website with following load/configuration :-
* 50 concurrent users at a time 
* Not more than 10 items per order
* Simple pricing rules
* couple of promotions running at a time (not more than 5)
 thanks,
Nitin Mittal


 




From: Jacques Le Roux 
To: user@ofbiz.apache.org
Sent: Mon, 18 April, 2011 12:12:19 PM
Subject: Re: OFBiz performance levels ?

OFBiz is based on Tomcat s. So it is very scalable and depends on hardware and 
configuration you use (app and db clusters, farms, 

etc.).
This sais when heavily used (hundreds and more) Price Rules, Promotions, or 
even 
Items per Order are known to be bottlenecks

Jacques

Nitin Mittal wrote:
> Hello,
>
> I have just started evaluating OFBiz and curious to know what performance 
>levels
> does it support. Experienced users, please share some data based on your
> experience. For example, how many concurrent users does it support ? What is 
>the
> average response time ?
>
> Not looking for exact figures, just an idea would help a lot.
> thanks,
> Nitin Mittal 

Re: OFBiz performance levels ?

[Jacques Le Roux]

Any recent and decent server will handle that load quite easily

Jacques

Nitin Mittal wrote:

Thanks for your quick reply,
Is there any recommendation for hardware(including RAM, Processor) required for
a small to medium startup ecommerce website with following load/configuration :-
* 50 concurrent users at a time
* Not more than 10 items per order
* Simple pricing rules
* couple of promotions running at a time (not more than 5)
thanks,
Nitin Mittal







From: Jacques Le Roux 
To: user@ofbiz.apache.org
Sent: Mon, 18 April, 2011 12:12:19 PM
Subject: Re: OFBiz performance levels ?

OFBiz is based on Tomcat s. So it is very scalable and depends on hardware and
configuration you use (app and db clusters, farms,

etc.).
This sais when heavily used (hundreds and more) Price Rules, Promotions, or even
Items per Order are known to be bottlenecks

Jacques

Nitin Mittal wrote:

Hello,

I have just started evaluating OFBiz and curious to know what performance
levels
does it support. Experienced users, please share some data based on your
experience. For example, how many concurrent users does it support ? What is
the
average response time ?

Not looking for exact figures, just an idea would help a lot.
thanks,
Nitin Mittal

Re: Users - OfBiz -performance

[amitagrawal]

Hi All,

I saw some sample OfBiz applications and I executed them also.

But I am unable to understand the flow.

In other frameworks the flow can easily explained.

But in this I could not.

We are defining the data model in  XML files.
We are not writing any JDBC code. But I want display the data which is in
the
DB on the UI( using JSP or HTML)

In this case I need to interact with the DB.

But No method is given to interact with DB. I am not understanding How we
the
interaction between UI and DB..?

What are the components in OfBiz that are implementing Business Layer?

If Services are implementing the Business Layer then what is the need of
java
source files..?

How much java code we can use in typical OfBiz application..?
How much java code we should actually use if We want to call it as an
efficient OFBiz application ?

Anyone please answer these questions and also suggest me how can I learn
ofBiz
as quickly as possible ?
Thanks and Regards
Amit Agrawal
amitagrawal.mits...@gmail.com

--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Users-OfBiz-performance-tp139865p4484282.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Users - OfBiz -performance

[Nitesh Suryavanshi]

Hi Amit,

Please refer Ofbiz tutorial documentation.
https://cwiki.apache.org/OFBIZ/ofbiz-tutorial-a-beginners-development-guide.html

Thanks&  Regards
Nitesh Suryavanshi


On Monday 19 March 2012 03:39 PM, amitagrawal wrote:

Hi All,

I saw some sample OfBiz applications and I executed them also.

But I am unable to understand the flow.

In other frameworks the flow can easily explained.

But in this I could not.

We are defining the data model in  XML files.
We are not writing any JDBC code. But I want display the data which is in
the
DB on the UI( using JSP or HTML)

In this case I need to interact with the DB.

But No method is given to interact with DB. I am not understanding How we
the
interaction between UI and DB..?

What are the components in OfBiz that are implementing Business Layer?

If Services are implementing the Business Layer then what is the need of
java
source files..?

How much java code we can use in typical OfBiz application..?
How much java code we should actually use if We want to call it as an
efficient OFBiz application ?

Anyone please answer these questions and also suggest me how can I learn
ofBiz
as quickly as possible ?
Thanks and Regards
Amit Agrawal
amitagrawal.mits...@gmail.com

--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Users-OfBiz-performance-tp139865p4484282.html
Sent from the OFBiz - User mailing list archive at Nabble.com.
   

Re: Users - OfBiz -performance

[amitagrawal]

Thanks for ur respone Sir,I have created one demo application inside hot-deploy
folder.But I want to make 1 application with database.So plz if u have any
source code then share with me please.

Thanks & Regards
Amit Agrawal
9970971709


On Mon, Mar 19, 2012 at 6:00 PM, Nitesh Suryavanshi [via OFBiz] <
ml-node+s135035n4484586...@n4.nabble.com> wrote:

> Hi Amit,
>
> Please refer Ofbiz tutorial documentation.
>
> https://cwiki.apache.org/OFBIZ/ofbiz-tutorial-a-beginners-development-guide.html
>
> Thanks&  Regards
> Nitesh Suryavanshi
>
>
> On Monday 19 March 2012 03:39 PM, amitagrawal wrote:
>
> > Hi All,
> >
> > I saw some sample OfBiz applications and I executed them also.
> >
> > But I am unable to understand the flow.
> >
> > In other frameworks the flow can easily explained.
> >
> > But in this I could not.
> >
> > We are defining the data model in  XML files.
> > We are not writing any JDBC code. But I want display the data which is
> in
> > the
> > DB on the UI( using JSP or HTML)
> >
> > In this case I need to interact with the DB.
> >
> > But No method is given to interact with DB. I am not understanding How
> we
> > the
> > interaction between UI and DB..?
> >
> > What are the components in OfBiz that are implementing Business Layer?
> >
> > If Services are implementing the Business Layer then what is the need of
> > java
> > source files..?
> >
> > How much java code we can use in typical OfBiz application..?
> > How much java code we should actually use if We want to call it as an
> > efficient OFBiz application ?
> >
> > Anyone please answer these questions and also suggest me how can I learn
> > ofBiz
> > as quickly as possible ?
> > Thanks and Regards
> > Amit Agrawal
> > [hidden email] <http://user/SendEmail.jtp?type=node&node=4484586&i=0>
> >
> > --
> > View this message in context:
> http://ofbiz.135035.n4.nabble.com/Users-OfBiz-performance-tp139865p4484282.html
> > Sent from the OFBiz - User mailing list archive at Nabble.com.
> >
>
>
> --
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://ofbiz.135035.n4.nabble.com/Users-OfBiz-performance-tp139865p4484586.html
>  To unsubscribe from Users - OfBiz -performance, click 
> here<http://ofbiz.135035.n4.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=139865&code=YW1pdGFncmF3YWwubWl0c2d3bEBnbWFpbC5jb218MTM5ODY1fDIwNjY3MTE0MjY=>
> .
> NAML<http://ofbiz.135035.n4.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>


--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Users-OfBiz-performance-tp139865p4484610.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Users - OfBiz -performance

[manish]

You can connect with data base using entityEngine.xml. 
And then read Entity Model in Ofbiz Tutorial.You will find your solution
there.



--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Users-OfBiz-performance-tp139865p4484892.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Performance of Ofbiz

[Mike]

First thing to check is if mysql is properly tuned.  With the huge number
of tables, it is important that the table cache is large.  Try running
tuning-primer.sh on the DB host and make changes as recommended.

https://launchpad.net/mysql-tuning-primer

On Wed, Apr 25, 2012 at 5:26 AM, hzzg6y  wrote:

> Dear All,
>
>I have just started using the Ofbiz for my ecommerce website.
> However I am seeing a huge performance problems with ofbiz.  My website is
> quite slow compared to many other websites on ecommerce. I have modified
> cache Settings ( cache.properties)  & debug properties ( debug.properties
> ),
> however I still see that Widgets take lot of time to load. Earlier I have
> experience with MYSQL + PHP + SMARTY template engine. In this case whenever
> I type the website URL, websiite immediately opens however here at ofbiz it
> is taking a while to open the front page. This will impact visitors on my
> website.
> Please can someone advice me on any best Frontend GUI which works with
> OFbiz
> with super performance.  Sorry I don't have benchmark or data to prove this
> however it is by visual inspection for last one month.
>
> I am using trunk : $ svn co http://svn.apache.org/repos/asf/ofbiz/trunk
> ofbiz
>
> Rgs,
>
>
>
>
>
> --
> View this message in context:
> http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4586418.html
> Sent from the OFBiz - User mailing list archive at Nabble.com.
>

Re: Performance of Ofbiz

[hzzg6y]

No, I am using Postgresql not MYSQL. 

--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4587311.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Performance of Ofbiz

[madppiper]

Well, there certainly are ways to push ofbiz. 

Have you taken a look at Syracus? www.syracus.net

--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4587352.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Performance of Ofbiz

[hzzg6y]

Please  can  someone help me with performance tips for Ofbiz. I am really
struggling to get to high performance of the ecommerce site.

Rgds,

--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4602795.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Performance of Ofbiz

[Hans Bakker]

check my blog i wrote sometime ago

http://www.antwebsystems.com/control/ViewBlogArticle?contentId=16640

Regards,
Hans

On 05/02/2012 05:16 PM, hzzg6y wrote:

Please  can  someone help me with performance tips for Ofbiz. I am really
struggling to get to high performance of the ecommerce site.

Rgds,

--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4602795.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Performance of Ofbiz

[Scott Gray]

In regards to one part of that post, I wouldn't recommend disabling Visit 
tracking for ecommerce unless you have some other type of analytics in place.  
It can be an invaluable resource for tracking down slow pages and also aid in 
locating requests are causing errors in the logs.

Regards
Scott

On 2/05/2012, at 10:22 PM, Hans Bakker wrote:

> check my blog i wrote sometime ago
> 
> http://www.antwebsystems.com/control/ViewBlogArticle?contentId=16640
> 
> Regards,
> Hans
> 
> On 05/02/2012 05:16 PM, hzzg6y wrote:
>> Please  can  someone help me with performance tips for Ofbiz. I am really
>> struggling to get to high performance of the ecommerce site.
>> 
>> Rgds,
>> 
>> --
>> View this message in context: 
>> http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4602795.html
>> Sent from the OFBiz - User mailing list archive at Nabble.com.
> 

Re: Performance of Ofbiz

[hzzg6y]

Thanks a lot to Hans & Scott for prompt response. 

Scott,

   If we don't disable visit function, do we have  any other choice.
Ecommerce site should be working like amazon.com else it is of NO use. We
need to make ofbiz with top performance as normal PHP+MYSQL site else we
will lose visitors & one day we have shut down the business. Please advice
if you have any recommendation. 

Secondly, Hans in your article at the bottom you mentioned about FTL. Please
can you provide some details on the below recommendation. How can I acheive
below. 

"We recently found out that retrieving database data inside an ftl is not a
good idea, not only bad practice but very slow. Retrieving data should be,
as much as possible, only be done in the 'action' part of screens."

One person ( Anil ) informed that " I also tried the one thing where I've
render the FTL directly in view map instead of rendering it in screen and it
saves my 50 % time. "

Please note that I have 2GB Centos 6 VPS server with postgre & JDK 7  -  $
svn co https://svn.apache.org/repos/asf/ofbiz/trunk ofbiz


Rgds, 

--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4603098.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Performance of Ofbiz

[Adrian Crum]

This thread illustrates the fundamental problem with most performance 
tuning advice - there are no statistics, no metrics, no examples, etc. 
In other words, there is no concrete information to base a decision on.


I would recommend hiring a qualified and experienced professional to 
evaluate your site.


-Adrian

On 5/2/2012 1:46 PM, hzzg6y wrote:

Thanks a lot to Hans&  Scott for prompt response.

Scott,

If we don't disable visit function, do we have  any other choice.
Ecommerce site should be working like amazon.com else it is of NO use. We
need to make ofbiz with top performance as normal PHP+MYSQL site else we
will lose visitors&  one day we have shut down the business. Please advice
if you have any recommendation.

Secondly, Hans in your article at the bottom you mentioned about FTL. Please
can you provide some details on the below recommendation. How can I acheive
below.

"We recently found out that retrieving database data inside an ftl is not a
good idea, not only bad practice but very slow. Retrieving data should be,
as much as possible, only be done in the 'action' part of screens."

One person ( Anil ) informed that " I also tried the one thing where I've
render the FTL directly in view map instead of rendering it in screen and it
saves my 50 % time. "

Please note that I have 2GB Centos 6 VPS server with postgre&  JDK 7  -  $
svn co https://svn.apache.org/repos/asf/ofbiz/trunk ofbiz


Rgds,

--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4603098.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Performance of Ofbiz

[Scott Gray]

Exactly, you need to perform (or have on performed on your behalf) analysis of 
the site.  There are plenty of OFBiz sites out there that perform just fine 
with nothing much more than correctly configured cache settings.

Regards
Scott

On 3/05/2012, at 1:06 AM, Adrian Crum wrote:

> This thread illustrates the fundamental problem with most performance tuning 
> advice - there are no statistics, no metrics, no examples, etc. In other 
> words, there is no concrete information to base a decision on.
> 
> I would recommend hiring a qualified and experienced professional to evaluate 
> your site.
> 
> -Adrian
> 
> On 5/2/2012 1:46 PM, hzzg6y wrote:
>> Thanks a lot to Hans&  Scott for prompt response.
>> 
>> Scott,
>> 
>>If we don't disable visit function, do we have  any other choice.
>> Ecommerce site should be working like amazon.com else it is of NO use. We
>> need to make ofbiz with top performance as normal PHP+MYSQL site else we
>> will lose visitors&  one day we have shut down the business. Please advice
>> if you have any recommendation.
>> 
>> Secondly, Hans in your article at the bottom you mentioned about FTL. Please
>> can you provide some details on the below recommendation. How can I acheive
>> below.
>> 
>> "We recently found out that retrieving database data inside an ftl is not a
>> good idea, not only bad practice but very slow. Retrieving data should be,
>> as much as possible, only be done in the 'action' part of screens."
>> 
>> One person ( Anil ) informed that " I also tried the one thing where I've
>> render the FTL directly in view map instead of rendering it in screen and it
>> saves my 50 % time. "
>> 
>> Please note that I have 2GB Centos 6 VPS server with postgre&  JDK 7  -  $
>> svn co https://svn.apache.org/repos/asf/ofbiz/trunk ofbiz
>> 
>> 
>> Rgds,
>> 
>> --
>> View this message in context: 
>> http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4603098.html
>> Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Performance of Ofbiz

[Mike]

Try switching java.  Download java from sun and modify the startup script
to use it.  I place java in /opt, like this:

root@vm-121:/opt# ls -al /opt
lrwxrwxrwx  1 root  root12 2012-03-04 15:36 java -> jdk1.6.0_31/
drwxr-xr-x 10 root  root  4096 2012-03-04 15:36 jdk1.6.0_31

I then reference it as /opt/java/bin/java.

On Wed, May 2, 2012 at 3:16 AM, hzzg6y  wrote:

> Please  can  someone help me with performance tips for Ofbiz. I am really
> struggling to get to high performance of the ecommerce site.
>
> Rgds,
>
> --
> View this message in context:
> http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4602795.html
> Sent from the OFBiz - User mailing list archive at Nabble.com.
>

Re: Performance of Ofbiz

[hzzg6y]

I somehow want to redue the startup time for my ecommerce  site. Below are
some threads posted by Cameron - information which I need to know whether it
is valid today or not. 

1. Logging. 
In debug.properties, log only to file and not stdout. 
Set logging to WARN for everything. 

2. Modules. 
a. Remove all modules from hot-deploy and specialized 
except the ones you actually use.  You might also be 
able to remove some of the modules in applications but 
they do not have a hierarchical dependency, so you can 
probably only remove one or two. We only removed the 
marketing module, David has been quite clear about 
this in previous posts - its generally more trouble 
than its worth. 
b. WITHIN the modules, deactivate any webapp you ain't 
using (simply comment out the relevant part in 
ofbiz-component.xml).  For example, the only module we 
left up, apart from our own custom module, was 
webtools. 

3. Containers 
a. For a standard webapp system, we found that we can 
get by with only the following 5 containers, we 
removed everything else: 
 component-container 
 classloader-container 
 naming-container 
 catalina-container 

b. Inside catalina-container, only activate the 
containers you need - very often it is only http, 
https or ajp, depending on your setup 

4. Memory. 
a. Give the JVM at least 384Mb of memory, otherwise it 
really has trouble setting everything up.  You can set 
this either in startofbiz.bat/sh, or in service.conf 
if you are running as a windows service (see my recent 
tutorial on wiki). 

There are some other points to explore, which for 
various reasons I haven't tried yet. 

5. Entity Engine 
OFBiz does a lot of clever stuff when it starts up to 
match XML entity definitions with what is actually in 
the DB.  But in a production system you aren't going 
to change this very regularly.  So theoretically you 
should switch it off, and shave off a couple more 
seconds at start up. 
In practice, I only managed the following config for 
my delegator in entityengine.xml: 
check-on-start="true" 
add-missing-on-start="true" 
check-pks-on-start="false" 

I wanted to set all 3 to false, but when I did this, 
the JVM went into an endless loop and then bust with 
an OutOfMemoryError.  If anyone could shed any light 
I'd be grateful. 

6. JDK 1.6 
I have run my application without any probs on JDK1.6, 
 which is supposed to up to a zillion % faster than 
1.5 in certain situations according to SUN.  But I 
haven't taken any measurements yet, will let you know 
when I do. 

7. JNDI 
>From what I have seen of OFBiz internals so far, it 
doesn't really use JNDI for much.  So I will 
investigate taking out this container as well, as for 
my scenario, I am not getting anything from JNDI. 





  

--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4603549.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Performance of Ofbiz

[hzzg6y]

Mike,

   Thanks ... You mean that JDK6 is better than JDK7 (
jdk-7u4-linux-x64.rpm ).  Please  clarify that whether I should use the old
version of JDK which finely tuned with Ofbiz. 

Rgsd


--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4603558.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Performance of Ofbiz

[hzzg6y]

Since We are using Postgresql. Is it the issue with DB. We can fine to switch
to MYSQL but performance need to be improved for ecommerce site. 

--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4603628.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Performance of Ofbiz

[Mike]

Try running pgtune for postgres and set the figures 30-50% (or more) higher.

pgtune -i /etc/postgresql/8.4/main/postgresql.conf

Requires a restart.

Regarding java, yes, use the latest 1.6 java from sun (only).

On Wed, May 2, 2012 at 8:53 AM, hzzg6y  wrote:

> Since We are using Postgresql. Is it the issue with DB. We can fine to
> switch
> to MYSQL but performance need to be improved for ecommerce site.
>
> --
> View this message in context:
> http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4603628.html
> Sent from the OFBiz - User mailing list archive at Nabble.com.
>

Re: Performance of Ofbiz

[Sanjeev Gupta]

Also try configuring Apache HTTP server as a fronted to Ofbiz server.
Although it will add an additional layer in the architecture, it will handle
all static and cached content rendering to browser and improve your app
server's performance. 

That said, please do to keep in mind that a Java bases server can't be tuned
to perform like the LAMP stack. both have their own merits and demerits, but
when it come to performance in small deployments, Java stack can't match the
LAMP stack. 

-
Rgds
Sanjeev
www.sanjeevg.com
@sanjeevgcom
--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4603804.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Re: Performance of Ofbiz

[Deepak Agarwal]

Following has benifited me:
1)  -Xms1024M -Xmx2048M -XX:MaxPermSize=1024m(Increased the PermSize
from 512 to 1024)
2) Increased innodb_lock_wait_timeout from 50 sec to 300 sec in mysql
3) Added following in mysql
 a) table_cache=1000
 b) table_definition_cache=1000
 c) query_cache_type=1
 d) query-cache-size = 20M
 e) query_cache_limit=20M
  f) open_files_limit=4000
4) Modified framework/base/config/cache.properties to use softreferences
5) Modified ofbiz-container.xml connector at 8080 to use GZip for js and
css.
6) Increased the number of threads to 400 for tomcat container
7) Decreased the connection time out to 3 seconds.

Our box has 2 CPU and 8 GB or RAM .


On Wed, May 2, 2012 at 10:23 PM, Sanjeev Gupta wrote:

> Also try configuring Apache HTTP server as a fronted to Ofbiz server.
> Although it will add an additional layer in the architecture, it will
> handle
> all static and cached content rendering to browser and improve your app
> server's performance.
>
> That said, please do to keep in mind that a Java bases server can't be
> tuned
> to perform like the LAMP stack. both have their own merits and demerits,
> but
> when it come to performance in small deployments, Java stack can't match
> the
> LAMP stack.
>
> -
> Rgds
> Sanjeev
> www.sanjeevg.com
> @sanjeevgcom
> --
> View this message in context:
> http://ofbiz.135035.n4.nabble.com/Performance-of-Ofbiz-tp4586418p4603804.html
> Sent from the OFBiz - User mailing list archive at Nabble.com.
>
> --
> Thanks,
> Deepak Agarwal,
>
> Paxcel Technologies Pvt Ltd.
> Hartron Complex, Sector 18, Gurgaon, India.
> E-Mail: deepak.agar...@paxcel.net
> Mobile: +91 9910322604
>
>

Re: OFBiz performance enhancement

[Michael Brohl]

Hi Giulio,

have you already considered the production setup guide in [1]?

If yes, we will need some more information as there are many possible 
performance issues (network, configuration etc.).


Best regards,

Michael Brohl
ecomify GmbH
www.ecomify.de

[1] 
https://cwiki.apache.org/confluence/display/OFBIZ/Apache+OFBiz+Technical+Production+Setup+Guide



Am 18.05.17 um 11:37 schrieb Giulio Speri - MpStyle Srl:

Hello everyone,

I would like to ask you some suggestion on improving performances of our
eCommerce site
We're monitoring our jvm  with NewRelic tool and response times are quite
good, and the server on which ofbiz run has minimal cpu/ram usage, but
customers often complains slowness in page loading.

Which components of OFBiz should we change or on which other aspects should
we work on to get better performances (eg: database, catalina servlet
container, Tomcat..) ?

​Thank you in advance,

Giulio​








smime.p7s
Description: S/MIME Cryptographic Signature

Re: OFBiz performance enhancement

[Paul Mandeltort]

What database are you using? If you're using the the default Derby database, 
there's your problem. 

If you're on Postgres, make sure you tune it. 
http://pgtune.leopard.in.ua/

Also if you're on Postgres make sure you're running a VACUUM at least weekly. 
Out of the box Postgres is set pretty conservative so it can run well on small 
VMs. 

If you're hosting the site in a generic virtual machine or AWS EC2 be aware 
that the IO performance on these systems is pretty lousy. Nowadays I'd 
recommend just using Amazon RDS so you don't have to mess with it. 

Or just do like most folks and throw more RAM at your system and see if that 
helps. :) 

--P

> On May 18, 2017, at 4:37 AM, Giulio Speri - MpStyle Srl 
>  wrote:
> 
> Hello everyone,
> 
> I would like to ask you some suggestion on improving performances of our
> eCommerce site
> We're monitoring our jvm  with NewRelic tool and response times are quite
> good, and the server on which ofbiz run has minimal cpu/ram usage, but
> customers often complains slowness in page loading.
> 
> Which components of OFBiz should we change or on which other aspects should
> we work on to get better performances (eg: database, catalina servlet
> container, Tomcat..) ?
> 
> ​Thank you in advance,
> 
> Giulio​
> 
> 
> 
> -- 
> Giulio Speri
> 
> *Mp Styl**e Srl*
> via Antonio Meucci, 37
> 41019 Limidi di Soliera (MO)
> T 059/684916
> M 334/3779851
> 
> www.mpstyle.it

Re: OFBiz performance enhancement

[Giulio Speri - MpStyle Srl]

Thanks for the suggestions.
Out OFBiz istance is running on a server hosted by Aruba, with 16 CPU and
32 GB of RAM; we changed jvm ofbiz memory start parameters to 20GB of max
memory (and monitoring the memory usage with OFBiz Webtools, I see that is
always between 3-10 GB).
The dbms we are using is MariaDB a fork of MySQL(the OS on the server is
CentOS 7 and MariaDB is installed by default on it).

At the moment I'm trying to set caching control in the embedded Tomcat,
adding the filter class ExpiresFilters in web.xml file of our eCommerce web
application, but I can't see anything changed in HTTP headers (always and
only cache-control: no cache).
I basically followed the set up guide of Tomcat (
https://tomcat.apache.org/tomcat-7.0-doc/config/filter.html), but no luck.
Is it the right way to set up cache control for the embedded Tomcat of
OFBiz?

We've tested our website also with PingDom tools, and gives us swinging
page loading times (from 2 sec up to 12 sec); the only thing that we
noticed using that tool, is that a good number of images give error and are
not loaded, but we cannot understand why (the link to the image works!).
On different pages of our site, we used AJAX to retrieve url of images:
could this be the problem?

Honestly we are quite in difficulty to understand why is this happening.

If needed I could share my ofbiz_component.xml for the settings of catalina
connectors that we are using.

Giulio



2017-05-18 17:48 GMT+02:00 Paul Mandeltort :

> What database are you using? If you're using the the default Derby
> database, there's your problem.
>
> If you're on Postgres, make sure you tune it.
> http://pgtune.leopard.in.ua/
>
> Also if you're on Postgres make sure you're running a VACUUM at least
> weekly. Out of the box Postgres is set pretty conservative so it can run
> well on small VMs.
>
> If you're hosting the site in a generic virtual machine or AWS EC2 be
> aware that the IO performance on these systems is pretty lousy. Nowadays
> I'd recommend just using Amazon RDS so you don't have to mess with it.
>
> Or just do like most folks and throw more RAM at your system and see if
> that helps. :)
>
> --P
>
> > On May 18, 2017, at 4:37 AM, Giulio Speri - MpStyle Srl <
> giulio.sp...@mpstyle.it> wrote:
> >
> > Hello everyone,
> >
> > I would like to ask you some suggestion on improving performances of our
> > eCommerce site
> > We're monitoring our jvm  with NewRelic tool and response times are quite
> > good, and the server on which ofbiz run has minimal cpu/ram usage, but
> > customers often complains slowness in page loading.
> >
> > Which components of OFBiz should we change or on which other aspects
> should
> > we work on to get better performances (eg: database, catalina servlet
> > container, Tomcat..) ?
> >
> > ​Thank you in advance,
> >
> > Giulio​
> >
> >
> >
> > --
> > Giulio Speri
> >
> > *Mp Styl**e Srl*
> > via Antonio Meucci, 37
> > 41019 Limidi di Soliera (MO)
> > T 059/684916
> > M 334/3779851
> >
> > www.mpstyle.it
>



-- 
Giulio Speri

*Mp Styl**e Srl*
via Antonio Meucci, 37
41019 Limidi di Soliera (MO)
T 059/684916
M 334/3779851

www.mpstyle.it

Re: OFBiz performance enhancement

[Paul Mandeltort]

Check all of your connection limits. If memory serves, there are tomcat 
connection limits and database connection limits and these can be fairly 
conservative out of the box. 

If your image requests are being served by tomcat/ofbiz, (which is not a great 
idea, better to keep those directly served), then you may be hitting those 
limits pretty quickly.

Use chrome devtools and check the network tab, see what’s actually taking a 
long time to load. 

Also check and repair your databased indexes, they might be fragmented like 
crazy if you haven’t been maintaining them: 
https://mariadb.com/kb/en/mariadb/mysqlcheck/ 
<https://mariadb.com/kb/en/mariadb/mysqlcheck/>


—P

> On May 18, 2017, at 11:19 AM, Giulio Speri - MpStyle Srl 
>  wrote:
> 
> Thanks for the suggestions.
> Out OFBiz istance is running on a server hosted by Aruba, with 16 CPU and
> 32 GB of RAM; we changed jvm ofbiz memory start parameters to 20GB of max
> memory (and monitoring the memory usage with OFBiz Webtools, I see that is
> always between 3-10 GB).
> The dbms we are using is MariaDB a fork of MySQL(the OS on the server is
> CentOS 7 and MariaDB is installed by default on it).
> 
> At the moment I'm trying to set caching control in the embedded Tomcat,
> adding the filter class ExpiresFilters in web.xml file of our eCommerce web
> application, but I can't see anything changed in HTTP headers (always and
> only cache-control: no cache).
> I basically followed the set up guide of Tomcat (
> https://tomcat.apache.org/tomcat-7.0-doc/config/filter.html), but no luck.
> Is it the right way to set up cache control for the embedded Tomcat of
> OFBiz?
> 
> We've tested our website also with PingDom tools, and gives us swinging
> page loading times (from 2 sec up to 12 sec); the only thing that we
> noticed using that tool, is that a good number of images give error and are
> not loaded, but we cannot understand why (the link to the image works!).
> On different pages of our site, we used AJAX to retrieve url of images:
> could this be the problem?
> 
> Honestly we are quite in difficulty to understand why is this happening.
> 
> If needed I could share my ofbiz_component.xml for the settings of catalina
> connectors that we are using.
> 
> Giulio
> 
> 
> 
> 2017-05-18 17:48 GMT+02:00 Paul Mandeltort :
> 
>> What database are you using? If you're using the the default Derby
>> database, there's your problem.
>> 
>> If you're on Postgres, make sure you tune it.
>> http://pgtune.leopard.in.ua/
>> 
>> Also if you're on Postgres make sure you're running a VACUUM at least
>> weekly. Out of the box Postgres is set pretty conservative so it can run
>> well on small VMs.
>> 
>> If you're hosting the site in a generic virtual machine or AWS EC2 be
>> aware that the IO performance on these systems is pretty lousy. Nowadays
>> I'd recommend just using Amazon RDS so you don't have to mess with it.
>> 
>> Or just do like most folks and throw more RAM at your system and see if
>> that helps. :)
>> 
>> --P
>> 
>>> On May 18, 2017, at 4:37 AM, Giulio Speri - MpStyle Srl <
>> giulio.sp...@mpstyle.it> wrote:
>>> 
>>> Hello everyone,
>>> 
>>> I would like to ask you some suggestion on improving performances of our
>>> eCommerce site
>>> We're monitoring our jvm  with NewRelic tool and response times are quite
>>> good, and the server on which ofbiz run has minimal cpu/ram usage, but
>>> customers often complains slowness in page loading.
>>> 
>>> Which components of OFBiz should we change or on which other aspects
>> should
>>> we work on to get better performances (eg: database, catalina servlet
>>> container, Tomcat..) ?
>>> 
>>> ​Thank you in advance,
>>> 
>>> Giulio​
>>> 
>>> 
>>> 
>>> --
>>> Giulio Speri
>>> 
>>> *Mp Styl**e Srl*
>>> via Antonio Meucci, 37
>>> 41019 Limidi di Soliera (MO)
>>> T 059/684916
>>> M 334/3779851
>>> 
>>> www.mpstyle.it
>> 
> 
> 
> 
> -- 
> Giulio Speri
> 
> *Mp Styl**e Srl*
> via Antonio Meucci, 37
> 41019 Limidi di Soliera (MO)
> T 059/684916
> M 334/3779851
> 
> www.mpstyle.it

Re: OFBiz performance enhancement

[Giulio Speri - MpStyle Srl]

Thank you very much Paul, I will check all those things out and test the
site again!

Giulio

Il 18/Mag/2017 20:45, "Paul Mandeltort"  ha scritto:

Check all of your connection limits. If memory serves, there are tomcat
connection limits and database connection limits and these can be fairly
conservative out of the box.

If your image requests are being served by tomcat/ofbiz, (which is not a
great idea, better to keep those directly served), then you may be hitting
those limits pretty quickly.

Use chrome devtools and check the network tab, see what’s actually taking a
long time to load.

Also check and repair your databased indexes, they might be fragmented like
crazy if you haven’t been maintaining them:
https://mariadb.com/kb/en/mariadb/mysqlcheck/ <https://mariadb.com/kb/en/
mariadb/mysqlcheck/>


—P

> On May 18, 2017, at 11:19 AM, Giulio Speri - MpStyle Srl <
giulio.sp...@mpstyle.it> wrote:
>
> Thanks for the suggestions.
> Out OFBiz istance is running on a server hosted by Aruba, with 16 CPU and
> 32 GB of RAM; we changed jvm ofbiz memory start parameters to 20GB of max
> memory (and monitoring the memory usage with OFBiz Webtools, I see that is
> always between 3-10 GB).
> The dbms we are using is MariaDB a fork of MySQL(the OS on the server is
> CentOS 7 and MariaDB is installed by default on it).
>
> At the moment I'm trying to set caching control in the embedded Tomcat,
> adding the filter class ExpiresFilters in web.xml file of our eCommerce
web
> application, but I can't see anything changed in HTTP headers (always and
> only cache-control: no cache).
> I basically followed the set up guide of Tomcat (
> https://tomcat.apache.org/tomcat-7.0-doc/config/filter.html), but no luck.
> Is it the right way to set up cache control for the embedded Tomcat of
> OFBiz?
>
> We've tested our website also with PingDom tools, and gives us swinging
> page loading times (from 2 sec up to 12 sec); the only thing that we
> noticed using that tool, is that a good number of images give error and
are
> not loaded, but we cannot understand why (the link to the image works!).
> On different pages of our site, we used AJAX to retrieve url of images:
> could this be the problem?
>
> Honestly we are quite in difficulty to understand why is this happening.
>
> If needed I could share my ofbiz_component.xml for the settings of
catalina
> connectors that we are using.
>
> Giulio
>
>
>
> 2017-05-18 17:48 GMT+02:00 Paul Mandeltort :
>
>> What database are you using? If you're using the the default Derby
>> database, there's your problem.
>>
>> If you're on Postgres, make sure you tune it.
>> http://pgtune.leopard.in.ua/
>>
>> Also if you're on Postgres make sure you're running a VACUUM at least
>> weekly. Out of the box Postgres is set pretty conservative so it can run
>> well on small VMs.
>>
>> If you're hosting the site in a generic virtual machine or AWS EC2 be
>> aware that the IO performance on these systems is pretty lousy. Nowadays
>> I'd recommend just using Amazon RDS so you don't have to mess with it.
>>
>> Or just do like most folks and throw more RAM at your system and see if
>> that helps. :)
>>
>> --P
>>
>>> On May 18, 2017, at 4:37 AM, Giulio Speri - MpStyle Srl <
>> giulio.sp...@mpstyle.it> wrote:
>>>
>>> Hello everyone,
>>>
>>> I would like to ask you some suggestion on improving performances of our
>>> eCommerce site
>>> We're monitoring our jvm  with NewRelic tool and response times are
quite
>>> good, and the server on which ofbiz run has minimal cpu/ram usage, but
>>> customers often complains slowness in page loading.
>>>
>>> Which components of OFBiz should we change or on which other aspects
>> should
>>> we work on to get better performances (eg: database, catalina servlet
>>> container, Tomcat..) ?
>>>
>>> ​Thank you in advance,
>>>
>>> Giulio​
>>>
>>>
>>>
>>> --
>>> Giulio Speri
>>>
>>> *Mp Styl**e Srl*
>>> via Antonio Meucci, 37
>>> 41019 Limidi di Soliera (MO)
>>> T 059/684916
>>> M 334/3779851
>>>
>>> www.mpstyle.it
>>
>
>
>
> --
> Giulio Speri
>
> *Mp Styl**e Srl*
> via Antonio Meucci, 37
> 41019 Limidi di Soliera (MO)
> T 059/684916
> M 334/3779851
>
> www.mpstyle.it

Re: OFBiz performance enhancement

[Sanjeev Gupta]

Hi Giulio,
Did you optimize your Apache http server ? I'd look at that too.. 
Try increasing the cache expire interval, also try consolidating CSS & JS
files. 
I also noticed that you are running wordpress on the server for the blog -
not sure why though. You could build one with ofbiz too.. 

Regards
Sanjeev Gupta




-
Rgds
Sanjeev Gupta
--
View this message in context: 
http://ofbiz.135035.n4.nabble.com/OFBiz-performance-enhancement-tp4705974p4705983.html
Sent from the OFBiz - User mailing list archive at Nabble.com.

Performance scale up Thread

[Mandar K]

Dear All, related to performance scale up thread wanted to share one
observation :

Everytime there is an increase in memory it gets filled up. This may be due
to a memory management bug in any code. Some processes are creating a lot
of objects and not clearing afterwards.

Requesting inputs on the below

1. How to identify those objects / code which is causing memory leak
2. Any suggestions for GC

We are facing a challenge on the performance issue. Any strong assistance
will really help.

Thanks a lot.

-- 
Regards
Mandar K

Using webload for performance testing

[Vikrant.Rathore]

Hi Everyone,

Recently I have done a test of ofbiz on the following configuration:
Hardware -
Dell 2950 Quad Core Dual processor 1.86 GHz
8 GB RAM
6 SAS 146 GB HDD with 15,000 RPM

Software:
1. XenSource open source paravirtualization (Native virtualization was
slow)
2. Host OS- Ubuntu Dapper LTS 6.04 (minimal install with just xen
hypervisor)
3. Guest OS 1 - Ubuntu Dapper LTS 6.04 (Minimal install with ofbiz)
4. Guest OS 2 - Ubuntu Dapper LTS 6.04 (Minimal install and PostgreSQL
only)
5. Web Server - Apache 2 
6. AJP for Apache2 with ofbiz

The application + web server was Guest OS ubuntu with 4 GB RAM out of
which 3 GB was allocated to ofbiz while starting the JVM.
The postgreSQL server was running on 2 GB RAM on another guest OS which
is again ubuntu.

I have done some tests with 1 million dummy customers and the entity
test results and alos in general the order creation and response results
were very good. Attaching with this mail the entity performance test.

Thanks
with best regards,
Vikrant
 <> 

Test with 10,000 Customers

NOTE: These performance results may vary a great deal for different databases, 
JDBC drivers, JTA implementations (transaction managers), connection pools, 
local vs. remote deployment configurations, and hardware (app server hardware, 
database server hardware, network connections).

Operation   Entity  Calls   Seconds Seconds/CallCalls/Second
findByPrimaryKeyLarge:Product   1,000   1.640.00164 
609.7560976
findByPrimaryKeyCache   Large:Product   10,000  1.342   0.0001342   
7,451.5648286
findByPrimaryKeySmall:Party 1,000   0.687   0.000687
1,455.6040757
findByPrimaryKeyCache   Small:Party 10,000  0.826   0.826   
12,106.5375303
create  Large:Product   1,000   2.430.00243 411.5226337
update  Large:Product   1,000   1.868   0.001868535.3319058
remove  Large:Product   1,000   6.713   0.006713148.9646954
new HashMap N/A 100,000 1.726   0.173   57,937.4275782
UtilMisc.toMap  N/A 100,000 5.383   0.538   18,577.0016719
UtilCache.get(String) - basic settings  N/A 1,000,000   5.636   
0.056   177,430.8019872
UtilCache.get(GenericPK) - basic settings   N/A 1,000,000   6.234   
0.062   160,410.6512672
UtilCache.put(GenericPK) - basic settings   N/A 1,000,000   7.001   
0.07142,836.7376089


Test Results with 100,000 customers

NOTE: These performance results may vary a great deal for different databases, 
JDBC drivers, JTA implementations (transaction managers), connection pools, 
local vs. remote deployment configurations, and hardware (app server hardware, 
database server hardware, network connections).

Operation   Entity  Calls   Seconds Seconds/CallCalls/Second
findByPrimaryKeyLarge:Product   1,000   1.852   0.001852
539.9568035
findByPrimaryKeyCache   Large:Product   10,000  1.341   0.0001341   
7,457.1215511
findByPrimaryKeySmall:Party 1,000   0.719   0.000719
1,390.8205841
findByPrimaryKeyCache   Small:Party 10,000  0.818   0.818   
12,224.9388753
create  Large:Product   1,000   2.331   0.002331429.000429
update  Large:Product   1,000   2.206   0.002206453.3091568
remove  Large:Product   1,000   5.909   0.005909169.2333728
new HashMap N/A 100,000 1.699   0.1758,858.151854
UtilMisc.toMap  N/A 100,000 5.356   0.536   18,670.6497386
UtilCache.get(String) - basic settings  N/A 1,000,000   5.722   
0.057   174,764.0685075
UtilCache.get(GenericPK) - basic settings   N/A 1,000,000   6.462   
0.065   154,750.8511297
UtilCache.put(GenericPK) - basic settings   N/A 1,000,000   6.883   
0.069   145,285.48598



Test Results with 0.5 million customers

NOTE: These performance results may vary a great deal for different databases, 
JDBC drivers, JTA implementations (transaction managers), connection pools, 
local vs. remote deployment configurations, and hardware (app server hardware, 
database server hardware, network connections).

Operation   Entity  Calls   Seconds Seconds/CallCalls/Second
findByPrimaryKeyLarge:Product   1,000   1.843   0.001843
542.5935974
findByPrimaryKeyCache   Large:Product   10,000  1.217   0.0001217   
8,216.9268694
findByPrimaryKeySmall:Party 1,000   0.759   0.000759
1,317.5230567
findByPrimaryKeyCache   Small:Party 10,000  0.774   0.774   
12,919.8966408
create  Large:Product   1,000   2.442   0.002442409.5004095
update  Large:Product   1,000   1.907   0.001907524.383849
remove  Large:Product   1,000   6.337   0.006337157.803377
new HashMap N/A 100,000 1.739   0.174   57,504.3128235
UtilMisc.toMap  N/A 100,000 5.374   0.0

Re: Catalog management performance issue

[BJ Freeman]

as far as performance how much memory have you allocated to ofbiz?
what version of ofbiz are you using?
There is a top Category that should be checked for first.
have not been in that part of the code for a while.

Michał Cukierman sent the following on 8/17/2010 7:41 AM:

Hi,

I have a problem with performence (and Out of Memmory Issue) with
catalog management module. There is a section invoked after
Choose Top Category

Collection  allCategories =
delegator.findList("ProductCategory", null, null, null, null, false);
for (GenericValue curCat: allCategories) {
Collection  parentCats =
curCat.getRelatedCache("CurrentProductCategoryRollup");

  if (parentCats.isEmpty())
results.add(curCat);
}

As we see. To get categories without parents we need to fetch for all
categories and for each of them, find a parent.

I do not know Ofbiz api very well for now, so I have implemented:
EntityWhereString where =
EntityCondition.makeConditionWhere("PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID
not in" +
" (select PRODUCT_CATEGORY_ROLLUP.PRODUCT_CATEGORY_ID from
PRODUCT_CATEGORY_ROLLUP)");
Set  fieldsToSelect = FastSet.newInstance();
fieldsToSelect.add("productCategoryId");
results.addAll(delegator.findList("ProductCategory", 
where,
fieldsToSelect, null, null, false));


I simply do invoke a SQL query in the database:

select PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID from PRODUCT_CATEGORY where
PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID not in
(select PRODUCT_CATEGORY_ROLLUP.PRODUCT_CATEGORY_ID from
PRODUCT_CATEGORY_ROLLUP);

Is there a way ( for sure is ) to implement it in a better manner? For
now it works on my system, but after improving the query it could be
passed to a production.

So I got two questions in fact:

1) How to implement Right/Left joins on DynamicViewEntity
2) How to implement my whereString


Thank you in advance,

Re: Catalog management performance issue

[Michał Cukierman]

Thanks for the quick answer.

I have allocated 2GB of memory, so it's not a case. The problem is that
I work on huge data sets. Version is 10.4 but 9.04 is has the same code.
I have ommited those informations 'couse as you see - it's not relevant
to the topic.

I don't understand your last assumption. Maybe it will someting in my
understanding?

For now I think the best would be to improve the code I have proposed as
it fixes:
1) My issues
2) Coding way of selecting everything to get a couple of categories.

So, thats why I asked about:

> 1) How to implement Right/Left joins on DynamicViewEntity 
(I was able to find out how to creat inner join only)
> > 2) How to implement my whereString 
(Haven't found in a code such a use case)


Regards,
Michał

 


Dnia 2010-08-17, wto o godzinie 07:54 -0700, BJ Freeman pisze:
> as far as performance how much memory have you allocated to ofbiz?
> what version of ofbiz are you using?
> There is a top Category that should be checked for first.
> have not been in that part of the code for a while.
> 
> Michał Cukierman sent the following on 8/17/2010 7:41 AM:
> > Hi,
> >
> > I have a problem with performence (and Out of Memmory Issue) with
> > catalog management module. There is a section invoked after
> > Choose Top Category
> >
> > Collection  allCategories =
> > delegator.findList("ProductCategory", null, null, null, null, false);
> > for (GenericValue curCat: allCategories) {
> > Collection  parentCats =
> > curCat.getRelatedCache("CurrentProductCategoryRollup");
> >
> >   if (parentCats.isEmpty())
> > results.add(curCat);
> > }
> >
> > As we see. To get categories without parents we need to fetch for all
> > categories and for each of them, find a parent.
> >
> > I do not know Ofbiz api very well for now, so I have implemented:
> > EntityWhereString where =
> > EntityCondition.makeConditionWhere("PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID
> > not in" +
> > " (select PRODUCT_CATEGORY_ROLLUP.PRODUCT_CATEGORY_ID from
> > PRODUCT_CATEGORY_ROLLUP)");
> > Set  fieldsToSelect = FastSet.newInstance();
> > fieldsToSelect.add("productCategoryId");
> > results.addAll(delegator.findList("ProductCategory", 
> > where,
> > fieldsToSelect, null, null, false));
> >
> >
> > I simply do invoke a SQL query in the database:
> >
> > select PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID from PRODUCT_CATEGORY where
> > PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID not in
> > (select PRODUCT_CATEGORY_ROLLUP.PRODUCT_CATEGORY_ID from
> > PRODUCT_CATEGORY_ROLLUP);
> >
> > Is there a way ( for sure is ) to implement it in a better manner? For
> > now it works on my system, but after improving the query it could be
> > passed to a production.
> >
> > So I got two questions in fact:
> >
> > 1) How to implement Right/Left joins on DynamicViewEntity
> > 2) How to implement my whereString
> >
> >
> > Thank you in advance,
> >
> >

Re: Catalog management performance issue

[Ruth Hoffman]

Hi Micha:

Could I ask how big are your data sets? The reason I ask is that several 
years ago, prior to 9.04 I had an out-of-memory problem that was never 
resolved. The database tables that I was querying had between 4 - 12 
million records. My database (and OFBiz usage of the same) went away 
before I couldn't do any further investigation into the problem.


So, I'm still curious about OFBiz support for really large data sets.

Regards,
Ruth

Michał Cukierman wrote:

Thanks for the quick answer.

I have allocated 2GB of memory, so it's not a case. The problem is that
I work on huge data sets. Version is 10.4 but 9.04 is has the same code.
I have ommited those informations 'couse as you see - it's not relevant
to the topic.

I don't understand your last assumption. Maybe it will someting in my
understanding?

For now I think the best would be to improve the code I have proposed as
it fixes:
1) My issues
2) Coding way of selecting everything to get a couple of categories.

So, thats why I asked about:

  
1) How to implement Right/Left joins on DynamicViewEntity 


(I was able to find out how to creat inner join only)
  
2) How to implement my whereString 
  

(Haven't found in a code such a use case)


Regards,
Michał

 



Dnia 2010-08-17, wto o godzinie 07:54 -0700, BJ Freeman pisze:
  

as far as performance how much memory have you allocated to ofbiz?
what version of ofbiz are you using?
There is a top Category that should be checked for first.
have not been in that part of the code for a while.

Michał Cukierman sent the following on 8/17/2010 7:41 AM:


Hi,

I have a problem with performence (and Out of Memmory Issue) with
catalog management module. There is a section invoked after
Choose Top Category

Collection  allCategories =
delegator.findList("ProductCategory", null, null, null, null, false);
for (GenericValue curCat: allCategories) {
Collection  parentCats =
curCat.getRelatedCache("CurrentProductCategoryRollup");

  if (parentCats.isEmpty())
results.add(curCat);
}

As we see. To get categories without parents we need to fetch for all
categories and for each of them, find a parent.

I do not know Ofbiz api very well for now, so I have implemented:
EntityWhereString where =
EntityCondition.makeConditionWhere("PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID
not in" +
" (select PRODUCT_CATEGORY_ROLLUP.PRODUCT_CATEGORY_ID from
PRODUCT_CATEGORY_ROLLUP)");
Set  fieldsToSelect = FastSet.newInstance();
fieldsToSelect.add("productCategoryId");
results.addAll(delegator.findList("ProductCategory", 
where,
fieldsToSelect, null, null, false));


I simply do invoke a SQL query in the database:

select PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID from PRODUCT_CATEGORY where
PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID not in
(select PRODUCT_CATEGORY_ROLLUP.PRODUCT_CATEGORY_ID from
PRODUCT_CATEGORY_ROLLUP);

Is there a way ( for sure is ) to implement it in a better manner? For
now it works on my system, but after improving the query it could be
passed to a production.

So I got two questions in fact:

1) How to implement Right/Left joins on DynamicViewEntity
2) How to implement my whereString


Thank you in advance,


  



  

Re: Catalog management performance issue

[Michał Cukierman]

Hi Ruth,
I do not know exact data set size, as we are in development stage at the
moment. What I know is that we need to prepare for:
- unknown no of categories (tests made on 100 000 - then the error
eccured)
- at least 2*suppliers number catalogs 
- around 200 different manufacturers
- around 10,20 suppliters 
- at the moment I am working with fetures, it's possible that I will
split number of categories.

My market is automotive industry. As you know, parts for such a
companies are very well categorised. Those criteria basis on:
a) Car selection
1)Make
2)Model
3)Year
4)Engine
5)Body Type

b) Part selection
-)Number
-)Placement
-)Vendor
-)Price
-)Supplier
-)Location
-)Material
1)Type (i.e. engine parts)
2)Sub-type (i.e bearings)
3)Part (i.e. crankshaft bearing)
4)Part instances

+ information about replacements
+ information about related parts

So this is only regarding categorisation. At the beggining I wanted to
put it all in one tree ( without criteria marked by "-)"). Just like in
www.rockauto.com
Now I do think about putting there more criteria to allow users browse
for what do they need. See example:
www.autopartswarehouse.com

Part catalog information will be integrated next year (soonest). Now we
need to prepare Phase0 project. As you see, with such amount of data we
need to fix issues that do not bother when playing with medium size shop
selling clothes.

Anyway I think that I could improve my working solution and pass it to
you. It will be easier for maintance for myself. Thats why my question
was regarding improvement of my code.

Hope this brings some light on the topic.



Dnia 2010-08-17, wto o godzinie 11:33 -0400, Ruth Hoffman pisze:
> Hi Micha:
> 
> Could I ask how big are your data sets? The reason I ask is that
> several 
> years ago, prior to 9.04 I had an out-of-memory problem that was
> never 
> resolved. The database tables that I was querying had between 4 - 12 
> million records. My database (and OFBiz usage of the same) went away 
> before I couldn't do any further investigation into the problem.
> 
> So, I'm still curious about OFBiz support for really large data sets.
> 
> Regards,
> Ruth
> 
> Michał Cukierman wrote:
> > Thanks for the quick answer.
> >
> > I have allocated 2GB of memory, so it's not a case. The problem is
> that
> > I work on huge data sets. Version is 10.4 but 9.04 is has the same
> code.
> > I have ommited those informations 'couse as you see - it's not
> relevant
> > to the topic.
> >
> > I don't understand your last assumption. Maybe it will someting in
> my
> > understanding?
> >
> > For now I think the best would be to improve the code I have
> proposed as
> > it fixes:
> > 1) My issues
> > 2) Coding way of selecting everything to get a couple of categories.
> >
> > So, thats why I asked about:
> >
> >   
> >> 1) How to implement Right/Left joins on DynamicViewEntity 
> >> 
> > (I was able to find out how to creat inner join only)
> >   
> >>> 2) How to implement my whereString 
> >>>   
> > (Haven't found in a code such a use case)
> >
> >
> > Regards,
> > Michał
> >
> >  
> >
> >
> > Dnia 2010-08-17, wto o godzinie 07:54 -0700, BJ Freeman pisze:
> >   
> >> as far as performance how much memory have you allocated to ofbiz?
> >> what version of ofbiz are you using?
> >> There is a top Category that should be checked for first.
> >> have not been in that part of the code for a while.
> >>
> >> Michał Cukierman sent the following on 8/17/2010 7:41 AM:
> >> 
> >>> Hi,
> >>>
> >>> I have a problem with performence (and Out of Memmory Issue) with
> >>> catalog management module. There is a section invoked after
> >>> Choose Top Category
> >>>
> >>> Collection  allCategories =
> >>> delegator.findList("ProductCategory", null, null, null, null,
> false);
> >>> for (GenericValue curCat: allCategories) {
> >>> Collection  parentCats =
> >>> curCat.getRelatedCache("CurrentProductCategoryRollup");
> >>>
> >>>   if (parentCats.isEmpty())
> >>> results.add(curCat);
> >>> }
> >>>
> >>> As we see. To get categories without parents we need to fetch for
> all
> >>> categories and for each of them, find a parent.
> >>>
> >>> I do not know Ofbiz api very well for now, so I have implemented:
> >>> EntityWhereString where =
> >>>
> EntityCon

Re: Catalog management performance issue

[David E Jones]

One thing to keep in mind is that with database queries and OFBiz there is no 
inherent nature of how it handles large data sets. Each bit of code and each 
query needs to be designed with a certain expected data set size, and typically 
the more data you want to allow for in the data store the more effort and 
testing it requires.

In other words, a query and bit of code that doesn't handle a certain large 
table means absolutely nothing about how other queries and other code will 
handle similarly large tables.

-David


On Aug 17, 2010, at 9:33 AM, Ruth Hoffman wrote:

> Hi Micha:
> 
> Could I ask how big are your data sets? The reason I ask is that several 
> years ago, prior to 9.04 I had an out-of-memory problem that was never 
> resolved. The database tables that I was querying had between 4 - 12 million 
> records. My database (and OFBiz usage of the same) went away before I 
> couldn't do any further investigation into the problem.
> 
> So, I'm still curious about OFBiz support for really large data sets.
> 
> Regards,
> Ruth
> 
> Michał Cukierman wrote:
>> Thanks for the quick answer.
>> 
>> I have allocated 2GB of memory, so it's not a case. The problem is that
>> I work on huge data sets. Version is 10.4 but 9.04 is has the same code.
>> I have ommited those informations 'couse as you see - it's not relevant
>> to the topic.
>> 
>> I don't understand your last assumption. Maybe it will someting in my
>> understanding?
>> 
>> For now I think the best would be to improve the code I have proposed as
>> it fixes:
>> 1) My issues
>> 2) Coding way of selecting everything to get a couple of categories.
>> 
>> So, thats why I asked about:
>> 
>>  
>>> 1) How to implement Right/Left joins on DynamicViewEntity 
>> (I was able to find out how to creat inner join only)
>>  
>>>> 2) How to implement my whereString   
>> (Haven't found in a code such a use case)
>> 
>> 
>> Regards,
>> Michał
>> 
>> 
>> 
>> Dnia 2010-08-17, wto o godzinie 07:54 -0700, BJ Freeman pisze:
>>  
>>> as far as performance how much memory have you allocated to ofbiz?
>>> what version of ofbiz are you using?
>>> There is a top Category that should be checked for first.
>>> have not been in that part of the code for a while.
>>> 
>>> Michał Cukierman sent the following on 8/17/2010 7:41 AM:
>>>
>>>> Hi,
>>>> 
>>>> I have a problem with performence (and Out of Memmory Issue) with
>>>> catalog management module. There is a section invoked after
>>>> Choose Top Category
>>>> 
>>>> Collection  allCategories =
>>>> delegator.findList("ProductCategory", null, null, null, null, false);
>>>> for (GenericValue curCat: allCategories) {
>>>>Collection  parentCats =
>>>> curCat.getRelatedCache("CurrentProductCategoryRollup");
>>>> 
>>>>  if (parentCats.isEmpty())
>>>>results.add(curCat);
>>>> }
>>>> 
>>>> As we see. To get categories without parents we need to fetch for all
>>>> categories and for each of them, find a parent.
>>>> 
>>>> I do not know Ofbiz api very well for now, so I have implemented:
>>>> EntityWhereString where =
>>>> EntityCondition.makeConditionWhere("PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID
>>>> not in" +
>>>> " (select PRODUCT_CATEGORY_ROLLUP.PRODUCT_CATEGORY_ID from
>>>> PRODUCT_CATEGORY_ROLLUP)");
>>>> Set  fieldsToSelect = FastSet.newInstance();
>>>>fieldsToSelect.add("productCategoryId");
>>>>results.addAll(delegator.findList("ProductCategory", 
>>>> where,
>>>> fieldsToSelect, null, null, false));
>>>> 
>>>> 
>>>> I simply do invoke a SQL query in the database:
>>>> 
>>>> select PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID from PRODUCT_CATEGORY where
>>>> PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID not in
>>>> (select PRODUCT_CATEGORY_ROLLUP.PRODUCT_CATEGORY_ID from
>>>> PRODUCT_CATEGORY_ROLLUP);
>>>> 
>>>> Is there a way ( for sure is ) to implement it in a better manner? For
>>>> now it works on my system, but after improving the query it could be
>>>> passed to a production.
>>>> 
>>>> So I got two questions in fact:
>>>> 
>>>> 1) How to implement Right/Left joins on DynamicViewEntity
>>>> 2) How to implement my whereString
>>>> 
>>>> 
>>>> Thank you in advance,
>>>> 
>>>> 
>>>>  
>> 
>> 
>>  

Re: Catalog management performance issue

[Ruth Hoffman]

Hi David:
Thanks for chiming in! I understand and my experience has been exactly 
as you say: "Each bit of code and each query needs to be designed with a 
certain expected data set size"


What you get with OFBiz out-of-the-box is a middle of the road 
"compromise". The really good news is that OFBiz is flexible enough to 
handle any necessary tweeks.


FYI - I wanted to do more exploration into testing with large data sets 
and try and arrive at some guidelines to help determine just how those 
"tweeks" might work. I had intended to document the same, but then my 
database went away and I turned my attention to other things.


Regards,
Ruth

David E Jones wrote:

One thing to keep in mind is that with database queries and OFBiz there is no 
inherent nature of how it handles large data sets. Each bit of code and each 
query needs to be designed with a certain expected data set size, and typically 
the more data you want to allow for in the data store the more effort and 
testing it requires.

In other words, a query and bit of code that doesn't handle a certain large 
table means absolutely nothing about how other queries and other code will 
handle similarly large tables.

-David


On Aug 17, 2010, at 9:33 AM, Ruth Hoffman wrote:

  

Hi Micha:

Could I ask how big are your data sets? The reason I ask is that several years 
ago, prior to 9.04 I had an out-of-memory problem that was never resolved. The 
database tables that I was querying had between 4 - 12 million records. My 
database (and OFBiz usage of the same) went away before I couldn't do any 
further investigation into the problem.

So, I'm still curious about OFBiz support for really large data sets.

Regards,
Ruth

Michał Cukierman wrote:


Thanks for the quick answer.

I have allocated 2GB of memory, so it's not a case. The problem is that
I work on huge data sets. Version is 10.4 but 9.04 is has the same code.
I have ommited those informations 'couse as you see - it's not relevant
to the topic.

I don't understand your last assumption. Maybe it will someting in my
understanding?

For now I think the best would be to improve the code I have proposed as
it fixes:
1) My issues
2) Coding way of selecting everything to get a couple of categories.

So, thats why I asked about:

 
  
1) How to implement Right/Left joins on DynamicViewEntity 


(I was able to find out how to creat inner join only)
 
  
2) How to implement my whereString   
  

(Haven't found in a code such a use case)


Regards,
Michał



Dnia 2010-08-17, wto o godzinie 07:54 -0700, BJ Freeman pisze:
 
  

as far as performance how much memory have you allocated to ofbiz?
what version of ofbiz are you using?
There is a top Category that should be checked for first.
have not been in that part of the code for a while.

Michał Cukierman sent the following on 8/17/2010 7:41 AM:
   


Hi,

I have a problem with performence (and Out of Memmory Issue) with
catalog management module. There is a section invoked after
Choose Top Category

Collection  allCategories =
delegator.findList("ProductCategory", null, null, null, null, false);
for (GenericValue curCat: allCategories) {
Collection  parentCats =
curCat.getRelatedCache("CurrentProductCategoryRollup");

 if (parentCats.isEmpty())
results.add(curCat);
}

As we see. To get categories without parents we need to fetch for all
categories and for each of them, find a parent.

I do not know Ofbiz api very well for now, so I have implemented:
EntityWhereString where =
EntityCondition.makeConditionWhere("PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID
not in" +
" (select PRODUCT_CATEGORY_ROLLUP.PRODUCT_CATEGORY_ID from
PRODUCT_CATEGORY_ROLLUP)");
Set  fieldsToSelect = FastSet.newInstance();
fieldsToSelect.add("productCategoryId");
results.addAll(delegator.findList("ProductCategory", 
where,
fieldsToSelect, null, null, false));


I simply do invoke a SQL query in the database:

select PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID from PRODUCT_CATEGORY where
PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID not in
(select PRODUCT_CATEGORY_ROLLUP.PRODUCT_CATEGORY_ID from
PRODUCT_CATEGORY_ROLLUP);

Is there a way ( for sure is ) to implement it in a better manner? For
now it works on my system, but after improving the query it could be
passed to a production.

So I got two questions in fact:

1) How to implement Right/Left joins on DynamicViewEntity
2) How to implement my whereString


Thank you in advance,


 
  
 
  



  

Re: Catalog management performance issue

[David E Jones]

I wouldn't say that OFBiz OOTB is a middle of the road compromise, that would 
imply consistency in the code which is not the case. The fact is some code is 
designed and tested to properly handle millions or even billions of rows in its 
target table, and other code can only have a few thousand or perhaps tens of 
thousands. There is no general rule or easy way to simplify that down. Things 
that are used more by larger organization have tended to be written or improved 
over time to handle more data. Things that aren't haven't, it's that simple.

-David


On Aug 17, 2010, at 10:19 AM, Ruth Hoffman wrote:

> Hi David:
> Thanks for chiming in! I understand and my experience has been exactly as you 
> say: "Each bit of code and each query needs to be designed with a certain 
> expected data set size"
> 
> What you get with OFBiz out-of-the-box is a middle of the road "compromise". 
> The really good news is that OFBiz is flexible enough to handle any necessary 
> tweeks.
> 
> FYI - I wanted to do more exploration into testing with large data sets and 
> try and arrive at some guidelines to help determine just how those "tweeks" 
> might work. I had intended to document the same, but then my database went 
> away and I turned my attention to other things.
> 
> Regards,
> Ruth
> 
> David E Jones wrote:
>> One thing to keep in mind is that with database queries and OFBiz there is 
>> no inherent nature of how it handles large data sets. Each bit of code and 
>> each query needs to be designed with a certain expected data set size, and 
>> typically the more data you want to allow for in the data store the more 
>> effort and testing it requires.
>> 
>> In other words, a query and bit of code that doesn't handle a certain large 
>> table means absolutely nothing about how other queries and other code will 
>> handle similarly large tables.
>> 
>> -David
>> 
>> 
>> On Aug 17, 2010, at 9:33 AM, Ruth Hoffman wrote:
>> 
>>  
>>> Hi Micha:
>>> 
>>> Could I ask how big are your data sets? The reason I ask is that several 
>>> years ago, prior to 9.04 I had an out-of-memory problem that was never 
>>> resolved. The database tables that I was querying had between 4 - 12 
>>> million records. My database (and OFBiz usage of the same) went away before 
>>> I couldn't do any further investigation into the problem.
>>> 
>>> So, I'm still curious about OFBiz support for really large data sets.
>>> 
>>> Regards,
>>> Ruth
>>> 
>>> Michał Cukierman wrote:
>>>
>>>> Thanks for the quick answer.
>>>> 
>>>> I have allocated 2GB of memory, so it's not a case. The problem is that
>>>> I work on huge data sets. Version is 10.4 but 9.04 is has the same code.
>>>> I have ommited those informations 'couse as you see - it's not relevant
>>>> to the topic.
>>>> 
>>>> I don't understand your last assumption. Maybe it will someting in my
>>>> understanding?
>>>> 
>>>> For now I think the best would be to improve the code I have proposed as
>>>> it fixes:
>>>> 1) My issues
>>>> 2) Coding way of selecting everything to get a couple of categories.
>>>> 
>>>> So, thats why I asked about:
>>>> 
>>>>   
>>>>> 1) How to implement Right/Left joins on DynamicViewEntity 
>>>> (I was able to find out how to creat inner join only)
>>>>   
>>>>>> 2) How to implement my whereString 
>>>> (Haven't found in a code such a use case)
>>>> 
>>>> 
>>>> Regards,
>>>> Michał
>>>> 
>>>> 
>>>> 
>>>> Dnia 2010-08-17, wto o godzinie 07:54 -0700, BJ Freeman pisze:
>>>>   
>>>>> as far as performance how much memory have you allocated to ofbiz?
>>>>> what version of ofbiz are you using?
>>>>> There is a top Category that should be checked for first.
>>>>> have not been in that part of the code for a while.
>>>>> 
>>>>> Michał Cukierman sent the following on 8/17/2010 7:41 AM:
>>>>>   
>>>>>> Hi,
>>>>>> 
>>>>>> I have a problem with performence (and Out of Memmory Issue) with
>>>>>> catalog management module. There is a section invoked after
>>>>>> Choose To

Re: Catalog management performance issue

[Ruth Hoffman]

Hi David:

Would you be interested in describing for us all - here on the list - 
where some of that code is and how an implementation was arrived at to 
"properly handle millions or even billions of rows" in a target table. 
I, for one would be very interested in knowing just where that code 
might be and how it was tested.


Regards,
Ruth

David E Jones wrote:

I wouldn't say that OFBiz OOTB is a middle of the road compromise, that would 
imply consistency in the code which is not the case. The fact is some code is 
designed and tested to properly handle millions or even billions of rows in its 
target table, and other code can only have a few thousand or perhaps tens of 
thousands. There is no general rule or easy way to simplify that down. Things 
that are used more by larger organization have tended to be written or improved 
over time to handle more data. Things that aren't haven't, it's that simple.

-David


On Aug 17, 2010, at 10:19 AM, Ruth Hoffman wrote:

  

Hi David:
Thanks for chiming in! I understand and my experience has been exactly as you say: 
"Each bit of code and each query needs to be designed with a certain expected data 
set size"

What you get with OFBiz out-of-the-box is a middle of the road "compromise". 
The really good news is that OFBiz is flexible enough to handle any necessary tweeks.

FYI - I wanted to do more exploration into testing with large data sets and try and 
arrive at some guidelines to help determine just how those "tweeks" might work. 
I had intended to document the same, but then my database went away and I turned my 
attention to other things.

Regards,
Ruth

David E Jones wrote:


One thing to keep in mind is that with database queries and OFBiz there is no 
inherent nature of how it handles large data sets. Each bit of code and each 
query needs to be designed with a certain expected data set size, and typically 
the more data you want to allow for in the data store the more effort and 
testing it requires.

In other words, a query and bit of code that doesn't handle a certain large 
table means absolutely nothing about how other queries and other code will 
handle similarly large tables.

-David


On Aug 17, 2010, at 9:33 AM, Ruth Hoffman wrote:

 
  

Hi Micha:

Could I ask how big are your data sets? The reason I ask is that several years 
ago, prior to 9.04 I had an out-of-memory problem that was never resolved. The 
database tables that I was querying had between 4 - 12 million records. My 
database (and OFBiz usage of the same) went away before I couldn't do any 
further investigation into the problem.

So, I'm still curious about OFBiz support for really large data sets.

Regards,
Ruth

Michał Cukierman wrote:
   


Thanks for the quick answer.

I have allocated 2GB of memory, so it's not a case. The problem is that
I work on huge data sets. Version is 10.4 but 9.04 is has the same code.
I have ommited those informations 'couse as you see - it's not relevant
to the topic.

I don't understand your last assumption. Maybe it will someting in my
understanding?

For now I think the best would be to improve the code I have proposed as
it fixes:
1) My issues
2) Coding way of selecting everything to get a couple of categories.

So, thats why I asked about:

  
  
1) How to implement Right/Left joins on DynamicViewEntity 


(I was able to find out how to creat inner join only)
  
  
2) How to implement my whereString 
  

(Haven't found in a code such a use case)


Regards,
Michał



Dnia 2010-08-17, wto o godzinie 07:54 -0700, BJ Freeman pisze:
  
  

as far as performance how much memory have you allocated to ofbiz?
what version of ofbiz are you using?
There is a top Category that should be checked for first.
have not been in that part of the code for a while.

Michał Cukierman sent the following on 8/17/2010 7:41 AM:
  


Hi,

I have a problem with performence (and Out of Memmory Issue) with
catalog management module. There is a section invoked after
Choose Top Category

Collection  allCategories =
delegator.findList("ProductCategory", null, null, null, null, false);
for (GenericValue curCat: allCategories) {
Collection  parentCats =
curCat.getRelatedCache("CurrentProductCategoryRollup");

if (parentCats.isEmpty())
results.add(curCat);
}

As we see. To get categories without parents we need to fetch for all
categories and for each of them, find a parent.

I do not know Ofbiz api very well for now, so I have implemented:
EntityWhereString where =
EntityCondition.makeConditionWhere("PRODUCT_CATEGORY.PRODUCT_CATEGORY_ID
not in" +
" (select PRODUCT_CATEGORY_ROLLUP.PRODUCT_CATEGORY_ID from
PRODUCT_CATEGORY_ROLLUP)");
Set  fieldsToSelect = FastSet.newInstance();

Re: Catalog management performance issue

[Michał Cukierman]

I know that Ofbiz is limited in some areas, but as far it's the best
place to start. It's better to improve some code than write it all. What
I also think: I have software for free, I can put some effort to improve
it. 

So to keep the problem in mind. What is the way of implementing:

1) How to implement Right/Left joins on DynamicViewEntity
2) How to implement my whereString
 - > select  where not in (select ...)

And by the way:
class:CategoryWorker
method:getCategoriesWithNoParent

My change do not affect the system I think. It gets some parameters and
return a query result. So there is not much to break :)


Dnia 2010-08-17, wto o godzinie 10:23 -0600, David E Jones pisze:
> I wouldn't say that OFBiz OOTB is a middle of the road compromise, that would 
> imply consistency in the code which is not the case. The fact is some code is 
> designed and tested to properly handle millions or even billions of rows in 
> its target table, and other code can only have a few thousand or perhaps tens 
> of thousands. There is no general rule or easy way to simplify that down. 
> Things that are used more by larger organization have tended to be written or 
> improved over time to handle more data. Things that aren't haven't, it's that 
> simple.
> 
> -David
> 
> 
> On Aug 17, 2010, at 10:19 AM, Ruth Hoffman wrote:
> 
> > Hi David:
> > Thanks for chiming in! I understand and my experience has been exactly as 
> > you say: "Each bit of code and each query needs to be designed with a 
> > certain expected data set size"
> > 
> > What you get with OFBiz out-of-the-box is a middle of the road 
> > "compromise". The really good news is that OFBiz is flexible enough to 
> > handle any necessary tweeks.
> > 
> > FYI - I wanted to do more exploration into testing with large data sets and 
> > try and arrive at some guidelines to help determine just how those "tweeks" 
> > might work. I had intended to document the same, but then my database went 
> > away and I turned my attention to other things.
> > 
> > Regards,
> > Ruth
> > 
> > David E Jones wrote:
> >> One thing to keep in mind is that with database queries and OFBiz there is 
> >> no inherent nature of how it handles large data sets. Each bit of code and 
> >> each query needs to be designed with a certain expected data set size, and 
> >> typically the more data you want to allow for in the data store the more 
> >> effort and testing it requires.
> >> 
> >> In other words, a query and bit of code that doesn't handle a certain 
> >> large table means absolutely nothing about how other queries and other 
> >> code will handle similarly large tables.
> >> 
> >> -David
> >> 
> >> 
> >> On Aug 17, 2010, at 9:33 AM, Ruth Hoffman wrote:
> >> 
> >>  
> >>> Hi Micha:
> >>> 
> >>> Could I ask how big are your data sets? The reason I ask is that several 
> >>> years ago, prior to 9.04 I had an out-of-memory problem that was never 
> >>> resolved. The database tables that I was querying had between 4 - 12 
> >>> million records. My database (and OFBiz usage of the same) went away 
> >>> before I couldn't do any further investigation into the problem.
> >>> 
> >>> So, I'm still curious about OFBiz support for really large data sets.
> >>> 
> >>> Regards,
> >>> Ruth
> >>> 
> >>> Michał Cukierman wrote:
> >>>
> >>>> Thanks for the quick answer.
> >>>> 
> >>>> I have allocated 2GB of memory, so it's not a case. The problem is that
> >>>> I work on huge data sets. Version is 10.4 but 9.04 is has the same code.
> >>>> I have ommited those informations 'couse as you see - it's not relevant
> >>>> to the topic.
> >>>> 
> >>>> I don't understand your last assumption. Maybe it will someting in my
> >>>> understanding?
> >>>> 
> >>>> For now I think the best would be to improve the code I have proposed as
> >>>> it fixes:
> >>>> 1) My issues
> >>>> 2) Coding way of selecting everything to get a couple of categories.
> >>>> 
> >>>> So, thats why I asked about:
> >>>> 
> >>>>   
> >>>>> 1) How to implement Right/Left joins on DynamicViewEntity 
> >>>> (I was able to find out how to creat inner jo

Re: Catalog management performance issue

[Ruth Hoffman]

Hi Micha:

Sorry, but I'm probably not the best person to answer this question. 
Hopefully David or someone who has spent considerable time working with 
the API could lend a hand. Its been several years since I've had to look 
at optimizing SQL statements within OFBiz.


Regards,
Ruth

Michał Cukierman wrote:

I know that Ofbiz is limited in some areas, but as far it's the best
place to start. It's better to improve some code than write it all. What
I also think: I have software for free, I can put some effort to improve
it. 


So to keep the problem in mind. What is the way of implementing:

1) How to implement Right/Left joins on DynamicViewEntity
2) How to implement my whereString
 - > select  where not in (select ...)

And by the way:
class:CategoryWorker
method:getCategoriesWithNoParent

My change do not affect the system I think. It gets some parameters and
return a query result. So there is not much to break :)


Dnia 2010-08-17, wto o godzinie 10:23 -0600, David E Jones pisze:
  

I wouldn't say that OFBiz OOTB is a middle of the road compromise, that would 
imply consistency in the code which is not the case. The fact is some code is 
designed and tested to properly handle millions or even billions of rows in its 
target table, and other code can only have a few thousand or perhaps tens of 
thousands. There is no general rule or easy way to simplify that down. Things 
that are used more by larger organization have tended to be written or improved 
over time to handle more data. Things that aren't haven't, it's that simple.

-David


On Aug 17, 2010, at 10:19 AM, Ruth Hoffman wrote:



Hi David:
Thanks for chiming in! I understand and my experience has been exactly as you say: 
"Each bit of code and each query needs to be designed with a certain expected data 
set size"

What you get with OFBiz out-of-the-box is a middle of the road "compromise". 
The really good news is that OFBiz is flexible enough to handle any necessary tweeks.

FYI - I wanted to do more exploration into testing with large data sets and try and 
arrive at some guidelines to help determine just how those "tweeks" might work. 
I had intended to document the same, but then my database went away and I turned my 
attention to other things.

Regards,
Ruth

David E Jones wrote:
  

One thing to keep in mind is that with database queries and OFBiz there is no 
inherent nature of how it handles large data sets. Each bit of code and each 
query needs to be designed with a certain expected data set size, and typically 
the more data you want to allow for in the data store the more effort and 
testing it requires.

In other words, a query and bit of code that doesn't handle a certain large 
table means absolutely nothing about how other queries and other code will 
handle similarly large tables.

-David


On Aug 17, 2010, at 9:33 AM, Ruth Hoffman wrote:

 


Hi Micha:

Could I ask how big are your data sets? The reason I ask is that several years 
ago, prior to 9.04 I had an out-of-memory problem that was never resolved. The 
database tables that I was querying had between 4 - 12 million records. My 
database (and OFBiz usage of the same) went away before I couldn't do any 
further investigation into the problem.

So, I'm still curious about OFBiz support for really large data sets.

Regards,
Ruth

Michał Cukierman wrote:
   
  

Thanks for the quick answer.

I have allocated 2GB of memory, so it's not a case. The problem is that
I work on huge data sets. Version is 10.4 but 9.04 is has the same code.
I have ommited those informations 'couse as you see - it's not relevant
to the topic.

I don't understand your last assumption. Maybe it will someting in my
understanding?

For now I think the best would be to improve the code I have proposed as
it fixes:
1) My issues
2) Coding way of selecting everything to get a couple of categories.

So, thats why I asked about:

  

1) How to implement Right/Left joins on DynamicViewEntity 
  

(I was able to find out how to creat inner join only)
  

2) How to implement my whereString 


(Haven't found in a code such a use case)


Regards,
Michał



Dnia 2010-08-17, wto o godzinie 07:54 -0700, BJ Freeman pisze:
  


as far as performance how much memory have you allocated to ofbiz?
what version of ofbiz are you using?
There is a top Category that should be checked for first.
have not been in that part of the code for a while.

Michał Cukierman sent the following on 8/17/2010 7:41 AM:
  
  

Hi,

I have a problem with performence (and Out of Memmory Issue) with
catalog management module. There is a section invoked after
Choose Top Category

Collection  allCategories >>>>>> 
delegator.fi

Re: Catalog management performance issue

[BJ Freeman]

Micheal I have, in the past had to deal with large databases.
even the best enterprise DB has memory problems in this case.
i have had to write Procedures (functions) in the database to parse the 
data so it is usable.
That said it is more than just joins, indexes, and where statements, it 
is staging the data in a way to make it usable.
one thing that David implemented was Cursors, however not all Databases 
that are implemented by ofbiz supports cursors.

that said the place to add these is in the Delegator Classes in my opinion.



Michał Cukierman sent the following on 8/17/2010 9:35 AM:

I know that Ofbiz is limited in some areas, but as far it's the best
place to start. It's better to improve some code than write it all. What
I also think: I have software for free, I can put some effort to improve
it.

So to keep the problem in mind. What is the way of implementing:

1) How to implement Right/Left joins on DynamicViewEntity
2) How to implement my whereString
  ->  select  where not in (select ...)

And by the way:
class:CategoryWorker
method:getCategoriesWithNoParent

My change do not affect the system I think. It gets some parameters and
return a query result. So there is not much to break :)


Dnia 2010-08-17, wto o godzinie 10:23 -0600, David E Jones pisze:

I wouldn't say that OFBiz OOTB is a middle of the road compromise, that would 
imply consistency in the code which is not the case. The fact is some code is 
designed and tested to properly handle millions or even billions of rows in its 
target table, and other code can only have a few thousand or perhaps tens of 
thousands. There is no general rule or easy way to simplify that down. Things 
that are used more by larger organization have tended to be written or improved 
over time to handle more data. Things that aren't haven't, it's that simple.

-David


On Aug 17, 2010, at 10:19 AM, Ruth Hoffman wrote:


Hi David:
Thanks for chiming in! I understand and my experience has been exactly as you say: 
"Each bit of code and each query needs to be designed with a certain expected data 
set size"

What you get with OFBiz out-of-the-box is a middle of the road "compromise". 
The really good news is that OFBiz is flexible enough to handle any necessary tweeks.

FYI - I wanted to do more exploration into testing with large data sets and try and 
arrive at some guidelines to help determine just how those "tweeks" might work. 
I had intended to document the same, but then my database went away and I turned my 
attention to other things.

Regards,
Ruth

David E Jones wrote:

One thing to keep in mind is that with database queries and OFBiz there is no 
inherent nature of how it handles large data sets. Each bit of code and each 
query needs to be designed with a certain expected data set size, and typically 
the more data you want to allow for in the data store the more effort and 
testing it requires.

In other words, a query and bit of code that doesn't handle a certain large 
table means absolutely nothing about how other queries and other code will 
handle similarly large tables.

-David


On Aug 17, 2010, at 9:33 AM, Ruth Hoffman wrote:



Hi Micha:

Could I ask how big are your data sets? The reason I ask is that several years 
ago, prior to 9.04 I had an out-of-memory problem that was never resolved. The 
database tables that I was querying had between 4 - 12 million records. My 
database (and OFBiz usage of the same) went away before I couldn't do any 
further investigation into the problem.

So, I'm still curious about OFBiz support for really large data sets.

Regards,
Ruth

Michał Cukierman wrote:


Thanks for the quick answer.

I have allocated 2GB of memory, so it's not a case. The problem is that
I work on huge data sets. Version is 10.4 but 9.04 is has the same code.
I have ommited those informations 'couse as you see - it's not relevant
to the topic.

I don't understand your last assumption. Maybe it will someting in my
understanding?

For now I think the best would be to improve the code I have proposed as
it fixes:
1) My issues
2) Coding way of selecting everything to get a couple of categories.

So, thats why I asked about:



1) How to implement Right/Left joins on DynamicViewEntity

(I was able to find out how to creat inner join only)


2) How to implement my whereString

(Haven't found in a code such a use case)


Regards,
Michał



Dnia 2010-08-17, wto o godzinie 07:54 -0700, BJ Freeman pisze:


as far as performance how much memory have you allocated to ofbiz?
what version of ofbiz are you using?
There is a top Category that should be checked for first.
have not been in that part of the code for a while.

Michał Cukierman sent the following on 8/17/2010 7:41 AM:


Hi,

I have a problem with performence (and Out of Memmory Issue) with
catalog management module. There is a section invoked after
Choose Top Category

View allow category performance impact

[Jacques Le Roux]

Hi,

I read in "Apache OFBiz Business Setup Guide" that using View Allow category 
has a performance impact and that sometimes
alternatives might be desirable. May I have more information about that point, 
please ?

Thanks

Jacques

OFBiz Performance, a good story

[Nick Rosser]

All,

I thought I'd share some encouraging news from a recent implementation 
we were involved in:


 * we built a site for a Philly based jeweler who has some unique
   products geared for Valentine's Day
 * they start their sale on 1-Jan, it typically gains real momentum by
   the end of Jan, and peaks around the 11th, 12th Feb
 * peak #visitors (day): 20,000
 * peak #pageviews (day): 150,000
 * peak #orders (day): ~4000
 * peak #concurrent users: 275

And perhaps the most impressive fact around performance was that during 
peak the site was flying, no noticeable difference if there was a single 
user or 275 concurrent users.


My conclusion is that the OFBiz caching model works really well when 
configured correctly (together with good memory allocation and 
settings). We also spent a great deal of time tuning our BigFish 
solution, specifically around the usage of the entity model layer 
(really just making sure we always use cache calls). We logged all SQL 
calls, and then analyzed the code to remove a second execution of any 
SQL call (since it should be cached). The Grinder was used to monitor 
and gauge performance improvements. All in all very encouraging and 
gives great confidence of marketing this solution into the largest 
organizations.


I would personally like to thank the key committers who built the 
caching functionality -- it's a little tricky to understand, use and 
configure but once that is overcome it works impressively.


We have been involved in some IBM Websphere Commerce implementations and 
I'm really beginning to wonder why the software and implementations are 
10-20 times more expensive. With OFBiz we have an enterprise solution, 
with affordability for a small business.


I'd be interested in any stories in the community around performance and 
high levels of order taking --- these case studies can really increase 
adoption of OFBiz. Stability and scalability are often at the top of 
anyone's list when looking at a new platform. Any stories out there?


Check out the site: www.ihatestevensinger.com. It's built using our 
BigFish solution. More at http://bigfish.solveda.com.


Nick

Re: Performance scale up Thread

[Jacques Le Roux]

I suggest you use YourKit Java Profiler

BTW, it's free for Apache committers
https://svn.apache.org/repos/private/committers/donated-licenses/yourkit-java-profiler.txt

HTH

Jacques

Le 08/05/2024 à 20:30, Mandar K a écrit :

Dear All, related to performance scale up thread wanted to share one
observation :

Everytime there is an increase in memory it gets filled up. This may be due
to a memory management bug in any code. Some processes are creating a lot
of objects and not clearing afterwards.

Requesting inputs on the below

1. How to identify those objects / code which is causing memory leak
2. Any suggestions for GC

We are facing a challenge on the performance issue. Any strong assistance
will really help.

Thanks a lot.

AW: Performance scale up Thread

[Ingo Wolfmayr]

Did you check the caching settings.

framework/base/config/cache.properties

You should enable caching groovy scripts :

# Development Mode - comment these out to better cache groovy scripts, etc
#These are all cleared by default every 1 milliseconds, or ten seconds
#minilang.SimpleMethodsDirect.expireTime=1
#minilang.SimpleMethodsResource.expireTime=1
#minilang.SimpleMethodsURL.expireTime=1

I remember this causing a memory leak on production - it is meant for 
developing mode.

Best regards,
Ingo

-Ursprüngliche Nachricht-
Von: Mandar K  
Gesendet: Mittwoch, 8. Mai 2024 20:31
An: ofbizuser 
Betreff: Performance scale up Thread

Dear All, related to performance scale up thread wanted to share one 
observation :

Everytime there is an increase in memory it gets filled up. This may be due to 
a memory management bug in any code. Some processes are creating a lot of 
objects and not clearing afterwards.

Requesting inputs on the below

1. How to identify those objects / code which is causing memory leak 2. Any 
suggestions for GC

We are facing a challenge on the performance issue. Any strong assistance will 
really help.

Thanks a lot.

--
Regards
Mandar K

Re: Performance scale up Thread

[Mandar K]

Thanks Ingo, we will check. Appreciate it.

On Thu, May 9, 2024 at 3:16 PM Ingo Wolfmayr 
wrote:

> Did you check the caching settings.
>
> framework/base/config/cache.properties
>
> You should enable caching groovy scripts :
>
> # Development Mode - comment these out to better cache groovy scripts, etc
> #These are all cleared by default every 1 milliseconds, or ten seconds
> #minilang.SimpleMethodsDirect.expireTime=1
> #minilang.SimpleMethodsResource.expireTime=1
> #minilang.SimpleMethodsURL.expireTime=1
>
> I remember this causing a memory leak on production - it is meant for
> developing mode.
>
> Best regards,
> Ingo
>
> -Ursprüngliche Nachricht-
> Von: Mandar K 
> Gesendet: Mittwoch, 8. Mai 2024 20:31
> An: ofbizuser 
> Betreff: Performance scale up Thread
>
> Dear All, related to performance scale up thread wanted to share one
> observation :
>
> Everytime there is an increase in memory it gets filled up. This may be
> due to a memory management bug in any code. Some processes are creating a
> lot of objects and not clearing afterwards.
>
> Requesting inputs on the below
>
> 1. How to identify those objects / code which is causing memory leak 2.
> Any suggestions for GC
>
> We are facing a challenge on the performance issue. Any strong assistance
> will really help.
>
> Thanks a lot.
>
> --
> Regards
> Mandar K
>


-- 
Regards
Mandar Kulkarni
Adaptability is the whole mystery of life - Swami Vivekanand

Re: Performance scale up Thread

[Mandar K]

Hi Jacques, greetings. We will check. Appreciate it.

On Thu, May 9, 2024 at 10:56 AM Jacques Le Roux <
jacques.le.r...@les7arts.com> wrote:

> I suggest you use YourKit Java Profiler
>
> BTW, it's free for Apache committers
>
> https://svn.apache.org/repos/private/committers/donated-licenses/yourkit-java-profiler.txt
>
> HTH
>
> Jacques
>
> Le 08/05/2024 à 20:30, Mandar K a écrit :
> > Dear All, related to performance scale up thread wanted to share one
> > observation :
> >
> > Everytime there is an increase in memory it gets filled up. This may be
> due
> > to a memory management bug in any code. Some processes are creating a lot
> > of objects and not clearing afterwards.
> >
> > Requesting inputs on the below
> >
> > 1. How to identify those objects / code which is causing memory leak
> > 2. Any suggestions for GC
> >
> > We are facing a challenge on the performance issue. Any strong assistance
> > will really help.
> >
> > Thanks a lot.
> >
>


-- 
Regards
Mandar Kulkarni
Adaptability is the whole mystery of life - Swami Vivekanand

Re: OFBiz Performance, a good story

[Adrian Crum]

That's great news Nick! Performance will improve more when you switch to 
R13. There have been a lot of performance improvements since R10.


Adrian Crum
Sandglass Software
www.sandglass-software.com

On 2/13/2014 4:06 AM, Nick Rosser wrote:

All,

I thought I'd share some encouraging news from a recent implementation
we were involved in:

  * we built a site for a Philly based jeweler who has some unique
products geared for Valentine's Day
  * they start their sale on 1-Jan, it typically gains real momentum by
the end of Jan, and peaks around the 11th, 12th Feb
  * peak #visitors (day): 20,000
  * peak #pageviews (day): 150,000
  * peak #orders (day): ~4000
  * peak #concurrent users: 275

And perhaps the most impressive fact around performance was that during
peak the site was flying, no noticeable difference if there was a single
user or 275 concurrent users.

My conclusion is that the OFBiz caching model works really well when
configured correctly (together with good memory allocation and
settings). We also spent a great deal of time tuning our BigFish
solution, specifically around the usage of the entity model layer
(really just making sure we always use cache calls). We logged all SQL
calls, and then analyzed the code to remove a second execution of any
SQL call (since it should be cached). The Grinder was used to monitor
and gauge performance improvements. All in all very encouraging and
gives great confidence of marketing this solution into the largest
organizations.

I would personally like to thank the key committers who built the
caching functionality -- it's a little tricky to understand, use and
configure but once that is overcome it works impressively.

We have been involved in some IBM Websphere Commerce implementations and
I'm really beginning to wonder why the software and implementations are
10-20 times more expensive. With OFBiz we have an enterprise solution,
with affordability for a small business.

I'd be interested in any stories in the community around performance and
high levels of order taking --- these case studies can really increase
adoption of OFBiz. Stability and scalability are often at the top of
anyone's list when looking at a new platform. Any stories out there?

Check out the site: www.ihatestevensinger.com. It's built using our
BigFish solution. More at http://bigfish.solveda.com.

Nick

Re: OFBiz Performance, a good story

[Ted Byers]

On Thu, Feb 13, 2014 at 7:06 AM, Nick Rosser  wrote:

> All,
>
> I thought I'd share some encouraging news from a recent implementation we
> were involved in:
>
>  * we built a site for a Philly based jeweler who has some unique
>products geared for Valentine's Day
>  * they start their sale on 1-Jan, it typically gains real momentum by
>the end of Jan, and peaks around the 11th, 12th Feb
>  * peak #visitors (day): 20,000
>  * peak #pageviews (day): 150,000
>  * peak #orders (day): ~4000
>  * peak #concurrent users: 275
>
> And perhaps the most impressive fact around performance was that during
> peak the site was flying, no noticeable difference if there was a single
> user or 275 concurrent users.
>

This looks good.  It wouldn't be so good if you had to deploy on the latest
super-computer to get that performance, but it would be astounding if you
could get that off a five year old desktop that would otherwise be a really
ugly paper-weight.  ;-)

I agree with you that it would be good to collect reports like yours
regarding good performance.  Might I suggest setting something up either on
the OFBiz site, or on yours, to make such reports easy to find.  I would
also suggest that the technical details of the host be provided (whether
that is on Amazon's service, or one of the many other hosting services),
documenting at least the amount of RAM, number of cores/processors, and
hard disk space.  And with the processors, some indication of the speed of
the processor (after all, my current workstation, with 8 cores, is more
than an order of magnitude faster than my old HP that had a 4 core AMD -
not all cores were created equal).  And how many (virtual) machines were
used: 2, 3, more?  And if more than one, how is each used?

It is great that this is affordable for small business, but a good
businessman is going to want information that lets him assess the cost of
getting it done (both initial setup and continuing monthly costs), along
with the performance, and whether or not the interface is user friendly.
How can a businessman hope to do a cost-benefit analysis without such
information, especially if he or she knows little about IT save that it is
needed and must rely on outside consultants?

I would suggest that, in addition to providing information suitable for
other developers interested in contributing code, and more for users, it is
necessary for some documentation, along with reports of performance like
yours, written to deal with the concerns of a businessman from the
perspective of businessmen.  Only then will OFBiz really thrive, if I may
use that metaphor.

Cheers

Ted