Re: Camel Monitoring Tool
I've also blogged recently about monitoring Camel applications with JMX and Amazon CloudWatch: http://www.ofbizian.com/2012/11/monitoring-camel-applications-on-cloud.html Cheers Bilgin On 22/11/2012, Preben.Asmussen wrote: > I developed a custom monitoring solution where that uses route jmx stats. > to > report the health of a route by looking af completed and failed exchanges. > The solution is generalized, so that you can configure which routes should > be monitored by route name. > Route stats. are not always enough though since this requires that there > has > been an exchange. Typically som Camel consumers like file/ftp jpa asf. > doesn't create an exchange if there has been an io error connecting to eg. > ftp/file or a db is down. > For that reason I have developed some custom resource monitors eg. db, > file, > ftp monitors that can be connected to each route monitor as a secondary > target so that if there has been no exchanges within a given timespan the > secondary target is run to check an external ressource. > > The monitor config gets deployed with the camel app. as a war and exposes a > rest interface with a overall health status of the app. > > For a global overview of all integrations running there is a integration > monitor that knows each rest endpoint, calls each one, and correlates this > to a global health state of all deployed camel apps. The global healthstate > is exposed as a rest interface that gets called by HP Openview. > A GUI is also available. > I haven't put it at github, mostly because of lack of time. > > Atm I'm working on a bam solution where throughput, total number of > messages, total message size can be monitored over time. For that I'm using > WSO2 bam - www.wso2.org. Looks really cool :-) > Source is available at https://github.com/pax95/bam-toolbox if you wanna > have a look, but it's still work in progress. > > Best > Preben > > > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Camel-Monitoring-Tool-tp5618301p5723124.html > Sent from the Camel - Users mailing list archive at Nabble.com. >
Re: Camel Monitoring Tool
I developed a custom monitoring solution where that uses route jmx stats. to report the health of a route by looking af completed and failed exchanges. The solution is generalized, so that you can configure which routes should be monitored by route name. Route stats. are not always enough though since this requires that there has been an exchange. Typically som Camel consumers like file/ftp jpa asf. doesn't create an exchange if there has been an io error connecting to eg. ftp/file or a db is down. For that reason I have developed some custom resource monitors eg. db, file, ftp monitors that can be connected to each route monitor as a secondary target so that if there has been no exchanges within a given timespan the secondary target is run to check an external ressource. The monitor config gets deployed with the camel app. as a war and exposes a rest interface with a overall health status of the app. For a global overview of all integrations running there is a integration monitor that knows each rest endpoint, calls each one, and correlates this to a global health state of all deployed camel apps. The global healthstate is exposed as a rest interface that gets called by HP Openview. A GUI is also available. I haven't put it at github, mostly because of lack of time. Atm I'm working on a bam solution where throughput, total number of messages, total message size can be monitored over time. For that I'm using WSO2 bam - www.wso2.org. Looks really cool :-) Source is available at https://github.com/pax95/bam-toolbox if you wanna have a look, but it's still work in progress. Best Preben -- View this message in context: http://camel.465427.n5.nabble.com/Camel-Monitoring-Tool-tp5618301p5723124.html Sent from the Camel - Users mailing list archive at Nabble.com.
Re: Camel Monitoring Tool
I provided an example application using jolokia on the camel user list a couple of months ago. If you search the mailing list for "jolokia" you will probably find it. In case you want to get it and don't find it, let me know. Thanks Lars Skickat från min iPhone 21 nov 2012 kl. 12:36 skrev Claus Ibsen : > On Wed, Nov 21, 2012 at 12:30 PM, wrote: >> If you are using pure JMS suggest using >> http://www.hermesjms.com/confluence/display/HJMS/Home which we use >> extensively. For Quartz trigger, you can set log level in quartz.properties >> file (along with things like number of threads) AFAIK... > > Yeah a cheap way for monitoring is tailing log files and scanning for > patterns for activity. > > You can also create a custom event notifier in Camel and integrate > with monitoring tooling that way in a custom fashion. > Or use jolokia over JMX with Camel to make it easier to pull stats > using REST API. > > Chapter 12 in the Camel in Action book covers about monitoring Camel > and gives some advice and examples. > > > >> -Original Message- >> From: tosheer [mailto:tosh...@gmail.com] >> Sent: Wednesday, November 21, 2012 12:02 PM >> To: users@camel.apache.org >> Subject: Re: Camel Monitoring Tool >> >> Hi All, >> >> I have different set of requirement for monitoring, as we have route will >> will always be running and has a timer/Quartz based trigger which goes off >> after few seconds. Can you also please guide us how we can monitore this >> timer/Quartz based activity. >> >> Also we are facing issue in which camel route deployed in Karaf stopped >> working continuesly for say around a week. Any ideas how we can monitor this >> automatically? >> >> ~Regards >> Tosheer >> >> >> >> -- >> View this message in context: >> http://camel.465427.n5.nabble.com/Camel-Monitoring-Tool-tp5618301p5723041.html >> Sent from the Camel - Users mailing list archive at Nabble.com. >> This e-mail and any files transmitted with it are for the sole use of the >> intended recipient(s) and may contain confidential and privileged >> information. If you are not the intended recipient(s), please reply to the >> sender and destroy all copies of the original message. Any unauthorized >> review, use, disclosure, dissemination, forwarding, printing or copying of >> this email, and/or any action taken in reliance on the contents of this >> e-mail is strictly prohibited and may be unlawful. > > > > -- > Claus Ibsen > - > Red Hat, Inc. > FuseSource is now part of Red Hat > Email: cib...@redhat.com > Web: http://fusesource.com > Twitter: davsclaus > Blog: http://davsclaus.com > Author of Camel in Action: http://www.manning.com/ibsen
Re: Camel Monitoring Tool
On Wed, Nov 21, 2012 at 12:30 PM, wrote: > If you are using pure JMS suggest using > http://www.hermesjms.com/confluence/display/HJMS/Home which we use > extensively. For Quartz trigger, you can set log level in quartz.properties > file (along with things like number of threads) AFAIK... > Yeah a cheap way for monitoring is tailing log files and scanning for patterns for activity. You can also create a custom event notifier in Camel and integrate with monitoring tooling that way in a custom fashion. Or use jolokia over JMX with Camel to make it easier to pull stats using REST API. Chapter 12 in the Camel in Action book covers about monitoring Camel and gives some advice and examples. > -Original Message- > From: tosheer [mailto:tosh...@gmail.com] > Sent: Wednesday, November 21, 2012 12:02 PM > To: users@camel.apache.org > Subject: Re: Camel Monitoring Tool > > Hi All, > > I have different set of requirement for monitoring, as we have route will > will always be running and has a timer/Quartz based trigger which goes off > after few seconds. Can you also please guide us how we can monitore this > timer/Quartz based activity. > > Also we are facing issue in which camel route deployed in Karaf stopped > working continuesly for say around a week. Any ideas how we can monitor this > automatically? > > ~Regards > Tosheer > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Camel-Monitoring-Tool-tp5618301p5723041.html > Sent from the Camel - Users mailing list archive at Nabble.com. > This e-mail and any files transmitted with it are for the sole use of the > intended recipient(s) and may contain confidential and privileged > information. If you are not the intended recipient(s), please reply to the > sender and destroy all copies of the original message. Any unauthorized > review, use, disclosure, dissemination, forwarding, printing or copying of > this email, and/or any action taken in reliance on the contents of this > e-mail is strictly prohibited and may be unlawful. -- Claus Ibsen - Red Hat, Inc. FuseSource is now part of Red Hat Email: cib...@redhat.com Web: http://fusesource.com Twitter: davsclaus Blog: http://davsclaus.com Author of Camel in Action: http://www.manning.com/ibsen
RE: Camel Monitoring Tool
If you are using pure JMS suggest using http://www.hermesjms.com/confluence/display/HJMS/Home which we use extensively. For Quartz trigger, you can set log level in quartz.properties file (along with things like number of threads) AFAIK... -Original Message- From: tosheer [mailto:tosh...@gmail.com] Sent: Wednesday, November 21, 2012 12:02 PM To: users@camel.apache.org Subject: Re: Camel Monitoring Tool Hi All, I have different set of requirement for monitoring, as we have route will will always be running and has a timer/Quartz based trigger which goes off after few seconds. Can you also please guide us how we can monitore this timer/Quartz based activity. Also we are facing issue in which camel route deployed in Karaf stopped working continuesly for say around a week. Any ideas how we can monitor this automatically? ~Regards Tosheer -- View this message in context: http://camel.465427.n5.nabble.com/Camel-Monitoring-Tool-tp5618301p5723041.html Sent from the Camel - Users mailing list archive at Nabble.com. This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient(s), please reply to the sender and destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email, and/or any action taken in reliance on the contents of this e-mail is strictly prohibited and may be unlawful.
Re: Camel Monitoring Tool
On Wed, Nov 21, 2012 at 7:31 AM, tosheer wrote: > Hi All, > > I have different set of requirement for monitoring, as we have route will > will always be running and has a timer/Quartz based trigger which goes off > after few seconds. Can you also please guide us how we can monitore this > timer/Quartz based activity. > > Also we are facing issue in which camel route deployed in Karaf stopped > working continuesly for say around a week. Any ideas how we can monitor this > automatically? > Most monitoring tooling can integrate with JMX and allows them to monitor metrics, if they change etc. So you can monitor the route JMX if the total number of exchanges change over a period of time. If that number doesnt change over X period, then you may raise some alert etc. > ~Regards > Tosheer > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Camel-Monitoring-Tool-tp5618301p5723041.html > Sent from the Camel - Users mailing list archive at Nabble.com. -- Claus Ibsen - Red Hat, Inc. FuseSource is now part of Red Hat Email: cib...@redhat.com Web: http://fusesource.com Twitter: davsclaus Blog: http://davsclaus.com Author of Camel in Action: http://www.manning.com/ibsen
Re: Camel Monitoring Tool
Hi All, I have different set of requirement for monitoring, as we have route will will always be running and has a timer/Quartz based trigger which goes off after few seconds. Can you also please guide us how we can monitore this timer/Quartz based activity. Also we are facing issue in which camel route deployed in Karaf stopped working continuesly for say around a week. Any ideas how we can monitor this automatically? ~Regards Tosheer -- View this message in context: http://camel.465427.n5.nabble.com/Camel-Monitoring-Tool-tp5618301p5723041.html Sent from the Camel - Users mailing list archive at Nabble.com.
Re: Camel Monitoring Tool
Hi Apache Camel offers details as JMX stats. And some as REST (see camel-web). But JMX is the most elaborate and has the most data. And of course there is also the logs as well. Any 3rd party tool which can work with JMX can then monitor Camel. Such tools could be: Nagios, Hyperic, IBM Tivoli, HP OpenView, Progress Actional, and there is another commerical vendor I cannot remember its name which is working on native Camel integraiton. And from FuseSource we have Fuse HQ, Fuse IDE. And mcollective can collect stats from AMQ (I think). There is of course other tools as well. In terms of the Fuse tooling, then you can check details from our website. http://fusesource.com/ On Wed, Apr 4, 2012 at 6:19 PM, gilboy wrote: > Hi > > We are planning on using Camel for a large scale, real-time, critical > system. > > We are investigating which tools (opensource and vendor) are available to > view the usage patterns of our routes - volumes of messages etc, identify > bottlenecks in our routes etc > > Just wondering if anybody could recommend any tools? > > Thanks > Joe > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Camel-Monitoring-Tool-tp5618301p5618301.html > Sent from the Camel - Users mailing list archive at Nabble.com. -- Claus Ibsen - CamelOne 2012 Conference, May 15-16, 2012: http://camelone.com FuseSource Email: cib...@fusesource.com Web: http://fusesource.com Twitter: davsclaus, fusenews Blog: http://davsclaus.blogspot.com/ Author of Camel in Action: http://www.manning.com/ibsen/
Re: Camel Monitoring Tool
I don´t know exactly how the fuse hyperic integration works but I guess it is probably the same as at Talend. We also offer a Hyperic integration which is just a Hyperic plugin that discovers the camel jmx beans. So it is just for convenience. All the monitoring data is already offered by the camel jmx beans and you can of course also directly access this data. Christian Am 05.04.2012 00:47, schrieb Vincent Nonnenmacher: I made a mistake I should have mentioned Fuse IDE that have a 'monitor' route mechanism but I only saw that on their screencast (never used it). You can use the JMX probes inside Camel an for example JConsole even with your instrumented process beans to monitor whatever you want and monitor standards endpoints implemented counters. Fuse ID and Hyperic could be the 'commercial' side asked for, but I don't know what are the subscriptions fees for that (Jconsole, and Logs are sufficient for me ;-)) -- Christian Schneider http://www.liquid-reality.de Open Source Architect Talend Application Integration Division http://www.talend.com
Re: Camel Monitoring Tool
I made a mistake I should have mentioned Fuse IDE that have a 'monitor' route mechanism but I only saw that on their screencast (never used it). You can use the JMX probes inside Camel an for example JConsole even with your instrumented process beans to monitor whatever you want and monitor standards endpoints implemented counters. Fuse ID and Hyperic could be the 'commercial' side asked for, but I don't know what are the subscriptions fees for that (Jconsole, and Logs are sufficient for me ;-)) On Wed, Apr 4, 2012 at 11:33 PM, Jason Chaffee wrote: > They have FuseHQ which I believe is based off Hyperic, but I am not sure > if it truly has any extra benefits over Hyperic and Apache Camel. > > Jason > > On Apr 4, 2012, at 2:24 PM, "Christian Müller" < > christian.muel...@gmail.com> wrote: > > > Fuse Mediation Router is a distribution of Apache Camel from FuseSource. > It > > doesn't have additional monitoring capabilities as I know. > > > > But Apache Camel (and Apache ActiveMQ too) expose many data via JMX. So > you > > can watch e.g. > > - min/max/mean time of route execution > > - failed/success route executions > > - countext/route status (started, stopped, ...) > > - queue sizes > > - ... > > > > So if you already have a monitoring tool you are familiar with (e.g, > > Nagios, Hyperic, ...), you can easily monitor Camel with these tools. > > Otherwise, write a batch/shell script which call the JMX beans and check > > the values. We are doing this and we use [1]. > > > > [1] http://crawler.archive.org/cmdline-jmxclient/ > > > > Best, > > Christian > > > > > > On Wed, Apr 4, 2012 at 10:48 PM, Vincent Nonnenmacher < > > vincent.nonnenmac...@gmail.com> wrote: > > > >> you can use the camel fuse mediation router that I think have > >> monitoring/debug tool > >> > >> here : http://fusesource.com/products/enterprise-camel/ > >> > >> and as a side effect use their service has main committers on Camel work > >> here ;-) > >> (not affiliated with them !) > >> > >> > >> > >> On Wed, Apr 4, 2012 at 6:19 PM, gilboy wrote: > >> > >>> Hi > >>> > >>> We are planning on using Camel for a large scale, real-time, critical > >>> system. > >>> > >>> We are investigating which tools (opensource and vendor) are available > to > >>> view the usage patterns of our routes - volumes of messages etc, > identify > >>> bottlenecks in our routes etc > >>> > >>> Just wondering if anybody could recommend any tools? > >>> > >>> Thanks > >>> Joe > >>> > >>> -- > >>> View this message in context: > >>> > >> > http://camel.465427.n5.nabble.com/Camel-Monitoring-Tool-tp5618301p5618301.html > >>> Sent from the Camel - Users mailing list archive at Nabble.com. > >>> > >> > > > In order to protect our email recipients, Betfair Group use SkyScan from > MessageLabs to scan all Incoming and Outgoing mail for viruses. > > >
Re: Camel Monitoring Tool
They have FuseHQ which I believe is based off Hyperic, but I am not sure if it truly has any extra benefits over Hyperic and Apache Camel. Jason On Apr 4, 2012, at 2:24 PM, "Christian Müller" wrote: > Fuse Mediation Router is a distribution of Apache Camel from FuseSource. It > doesn't have additional monitoring capabilities as I know. > > But Apache Camel (and Apache ActiveMQ too) expose many data via JMX. So you > can watch e.g. > - min/max/mean time of route execution > - failed/success route executions > - countext/route status (started, stopped, ...) > - queue sizes > - ... > > So if you already have a monitoring tool you are familiar with (e.g, > Nagios, Hyperic, ...), you can easily monitor Camel with these tools. > Otherwise, write a batch/shell script which call the JMX beans and check > the values. We are doing this and we use [1]. > > [1] http://crawler.archive.org/cmdline-jmxclient/ > > Best, > Christian > > > On Wed, Apr 4, 2012 at 10:48 PM, Vincent Nonnenmacher < > vincent.nonnenmac...@gmail.com> wrote: > >> you can use the camel fuse mediation router that I think have >> monitoring/debug tool >> >> here : http://fusesource.com/products/enterprise-camel/ >> >> and as a side effect use their service has main committers on Camel work >> here ;-) >> (not affiliated with them !) >> >> >> >> On Wed, Apr 4, 2012 at 6:19 PM, gilboy wrote: >> >>> Hi >>> >>> We are planning on using Camel for a large scale, real-time, critical >>> system. >>> >>> We are investigating which tools (opensource and vendor) are available to >>> view the usage patterns of our routes - volumes of messages etc, identify >>> bottlenecks in our routes etc >>> >>> Just wondering if anybody could recommend any tools? >>> >>> Thanks >>> Joe >>> >>> -- >>> View this message in context: >>> >> http://camel.465427.n5.nabble.com/Camel-Monitoring-Tool-tp5618301p5618301.html >>> Sent from the Camel - Users mailing list archive at Nabble.com. >>> >> In order to protect our email recipients, Betfair Group use SkyScan from MessageLabs to scan all Incoming and Outgoing mail for viruses.
Re: Camel Monitoring Tool
Fuse Mediation Router is a distribution of Apache Camel from FuseSource. It doesn't have additional monitoring capabilities as I know. But Apache Camel (and Apache ActiveMQ too) expose many data via JMX. So you can watch e.g. - min/max/mean time of route execution - failed/success route executions - countext/route status (started, stopped, ...) - queue sizes - ... So if you already have a monitoring tool you are familiar with (e.g, Nagios, Hyperic, ...), you can easily monitor Camel with these tools. Otherwise, write a batch/shell script which call the JMX beans and check the values. We are doing this and we use [1]. [1] http://crawler.archive.org/cmdline-jmxclient/ Best, Christian On Wed, Apr 4, 2012 at 10:48 PM, Vincent Nonnenmacher < vincent.nonnenmac...@gmail.com> wrote: > you can use the camel fuse mediation router that I think have > monitoring/debug tool > > here : http://fusesource.com/products/enterprise-camel/ > > and as a side effect use their service has main committers on Camel work > here ;-) > (not affiliated with them !) > > > > On Wed, Apr 4, 2012 at 6:19 PM, gilboy wrote: > > > Hi > > > > We are planning on using Camel for a large scale, real-time, critical > > system. > > > > We are investigating which tools (opensource and vendor) are available to > > view the usage patterns of our routes - volumes of messages etc, identify > > bottlenecks in our routes etc > > > > Just wondering if anybody could recommend any tools? > > > > Thanks > > Joe > > > > -- > > View this message in context: > > > http://camel.465427.n5.nabble.com/Camel-Monitoring-Tool-tp5618301p5618301.html > > Sent from the Camel - Users mailing list archive at Nabble.com. > > >
Re: Camel Monitoring Tool
you can use the camel fuse mediation router that I think have monitoring/debug tool here : http://fusesource.com/products/enterprise-camel/ and as a side effect use their service has main committers on Camel work here ;-) (not affiliated with them !) On Wed, Apr 4, 2012 at 6:19 PM, gilboy wrote: > Hi > > We are planning on using Camel for a large scale, real-time, critical > system. > > We are investigating which tools (opensource and vendor) are available to > view the usage patterns of our routes - volumes of messages etc, identify > bottlenecks in our routes etc > > Just wondering if anybody could recommend any tools? > > Thanks > Joe > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Camel-Monitoring-Tool-tp5618301p5618301.html > Sent from the Camel - Users mailing list archive at Nabble.com. >
Camel Monitoring Tool
Hi We are planning on using Camel for a large scale, real-time, critical system. We are investigating which tools (opensource and vendor) are available to view the usage patterns of our routes - volumes of messages etc, identify bottlenecks in our routes etc Just wondering if anybody could recommend any tools? Thanks Joe -- View this message in context: http://camel.465427.n5.nabble.com/Camel-Monitoring-Tool-tp5618301p5618301.html Sent from the Camel - Users mailing list archive at Nabble.com.
