Re: Camel performance issue

[RichardChen]

Thanks for replying. Here is the process:
We copy 1000 xml files from source folder to destination folder in every
test, for example from "c:/source" to "c:/dest“. Our camel route will
consume those xml files, and convert them to JTO objects, at last send to
JMS queue(ActiveMQ).

Test 1 on physical machine, it takes more than 2 minutes.
Test 2 on the VM which is hosted on the physical machine above, it takes
about 30 seconds.

We have tested this on several machines, always VM is faster. 
We are testing the performance of our product which is integrated with
Camel, so we did a lot of test on different platforms. We are confused about
performance gap between physical machine and VM. From the hawtio profiling
we found that IO maybe the bottle neck, VM consumes files is faster that
phycial machine.

Our machines are powerful enough, so hardware should not be the problem I
think. 



--
View this message in context: 
http://camel.465427.n5.nabble.com/Camel-performance-issue-tp5794918p5794957.html
Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Camel performance issue

[souciance]

Well I have used the file component both in a VM, docker and a physical
host and did not see any drop in performance. There must be something else
on your physical host that is cause this.

Have you done any profiling or enabled AuditEventNotifier on Camel to see
which steps are taking the most time? Where is your ActiveMQ located?

On Mon, Mar 6, 2017 at 2:56 PM, shuston [via Camel] <
ml-node+s465427n5794958...@n5.nabble.com> wrote:

> Did you run it multiple times in succession for each scenario? The file
> system cache may skew your timing if you just run it once.
>
> > -Original Message-
> > From: RichardChen [mailto:[hidden email]
> ]
> > Sent: Monday, March 06, 2017 5:13 AM
> > To: [hidden email]
> 
> > Subject: Camel performance issue
> >
> > We are facing performance problem when we integrate camel into our
> > product.
> > The simple scenario is this: let camel monitor a folder, put 1000 xml
> files to
> > that folder, camel consume all the files and send them to ActiveMQ.
> >
> > I ran this scenario in both physical machine and VM(hosted on the same
> > physical machine). The result is really confused me, the VM's
> performance is
> > higher than physical machine.
> > I found that, camel on VM consumed files very fast, but meanwhie
> physical
> > machine was slow.
> >
> > Anthoer thing is our product pervious using Mule ESB, the performance is
> > higher than camel when running the same scenario.
> >
> > Our testing evniroment is clean, no anti-virus software installed. Do OS
> > version impact the result?
> > We are using Windows7 x64 and Windows Server 2012 x64, camel is running
> > on Apache Tomcat 8.5.6.
> >
> > Have you met the same problem when using camel? Or is there some
> > advices on improving performance of my scenario?
> >
> > Thanks
> >
> >
> >
> > --
> > View this message in context: http://camel.465427.n5.nabble.com/Camel-
> > performance-issue-tp5794918.html
> > Sent from the Camel - Users mailing list archive at Nabble.com.
>
>
> --
> If you reply to this email, your message will be added to the discussion
> below:
> http://camel.465427.n5.nabble.com/Camel-performance-issue-
> tp5794918p5794958.html
> To start a new topic under Camel - Users, email
> ml-node+s465427n465428...@n5.nabble.com
> To unsubscribe from Camel - Users, click here
> 
> .
> NAML
> 
>




--
View this message in context: 
http://camel.465427.n5.nabble.com/Camel-performance-issue-tp5794918p5794960.html
Sent from the Camel - Users mailing list archive at Nabble.com.

RE: Camel performance issue

[Steve Huston]

Did you run it multiple times in succession for each scenario? The file system 
cache may skew your timing if you just run it once.

> -Original Message-
> From: RichardChen [mailto:richard.c...@spsoft-cn.com]
> Sent: Monday, March 06, 2017 5:13 AM
> To: users@camel.apache.org
> Subject: Camel performance issue
> 
> We are facing performance problem when we integrate camel into our
> product.
> The simple scenario is this: let camel monitor a folder, put 1000 xml files to
> that folder, camel consume all the files and send them to ActiveMQ.
> 
> I ran this scenario in both physical machine and VM(hosted on the same
> physical machine). The result is really confused me, the VM's performance is
> higher than physical machine.
> I found that, camel on VM consumed files very fast, but meanwhie physical
> machine was slow.
> 
> Anthoer thing is our product pervious using Mule ESB, the performance is
> higher than camel when running the same scenario.
> 
> Our testing evniroment is clean, no anti-virus software installed. Do OS
> version impact the result?
> We are using Windows7 x64 and Windows Server 2012 x64, camel is running
> on Apache Tomcat 8.5.6.
> 
> Have you met the same problem when using camel? Or is there some
> advices on improving performance of my scenario?
> 
> Thanks
> 
> 
> 
> --
> View this message in context: http://camel.465427.n5.nabble.com/Camel-
> performance-issue-tp5794918.html
> Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Camel performance issue

[souciance]

You will need to be more specific about the performance.  What was slow?
How long did things take and what was your expectation?  How are you
putting the files?  All at once?  Please provide more metrics.

Den 6 mars 2017 11:13 fm skrev "RichardChen [via Camel]" <
ml-node+s465427n5794918...@n5.nabble.com>:

We are facing performance problem when we integrate camel into our product.
The simple scenario is this: let camel monitor a folder, put 1000 xml files
to that folder, camel consume all the files and send them to ActiveMQ.

I ran this scenario in both physical machine and VM(hosted on the same
physical machine). The result is really confused me, the VM's performance
is higher than physical machine.
I found that, camel on VM consumed files very fast, but meanwhie physical
machine was slow.

Anthoer thing is our product pervious using Mule ESB, the performance is
higher than camel when running the same scenario.

Our testing evniroment is clean, no anti-virus software installed. Do OS
version impact the result?
We are using Windows7 x64 and Windows Server 2012 x64, camel is running on
Apache Tomcat 8.5.6.

Have you met the same problem when using camel? Or is there some advices on
improving performance of my scenario?

Thanks

--
If you reply to this email, your message will be added to the discussion
below:
http://camel.465427.n5.nabble.com/Camel-performance-issue-tp5794918.html
To start a new topic under Camel - Users, email
ml-node+s465427n465428...@n5.nabble.com
To unsubscribe from Camel - Users, click here

.
NAML





--
View this message in context: 
http://camel.465427.n5.nabble.com/Camel-performance-issue-tp5794918p5794921.html
Sent from the Camel - Users mailing list archive at Nabble.com.