How to remove message from ManagedRouteMBean

2017-09-25 Thread David Hoffer
We use Camel's JMX feature to report the overall stats/status of all the routes in our application (e.g. ManagedRouteMBean). However the routes often make heavy use of Camel's choice option where we have multiple when/simple options and then if no matches are found we use an otherwise/stop to make

Re: How to remove message from ManagedRouteMBean

2017-09-26 Thread David Hoffer
> call) as your metrics, as the otherwise will not call any route. > > On Mon, Sep 25, 2017 at 11:44 PM, David Hoffer wrote: > > We use Camel's JMX feature to report the overall stats/status of all the > > routes in our application (e.g. ManagedRouteMBean). > > >

Camel exception handling

2017-11-06 Thread David Hoffer
I’m having trouble getting the exception behavior I’m looking for. What I expected this to do is when any exception is thrown it will cause this route to fail and not do any retries as the docs say that no onException retries is the default. However instead it retries forever as long as the handl

Re: Camel exception handling

2017-11-07 Thread David Hoffer
Ibsen wrote: > You cannot do that, but you can track the failures handled attribute > in JMX which we be incremented when you handle that exception. > > > On Mon, Nov 6, 2017 at 8:22 PM, David Hoffer wrote: > > I’m having trouble getting the exception behavior I’m looking for.

Upgrade from 2.13.2 to 2.15.x has JMX bugs

2016-05-16 Thread David Hoffer
I'm upgrading an app from Camel 2.13.2 to 2.15.6 that uses Camel's JMX support. Specifically we query for the various routes and leverage several of the operations. The problem is the getDescription() operation now always returns null. I have tried several of the 2.15.x versions and they all ret

Re: Upgrade from 2.13.2 to 2.15.x has JMX bugs

2016-05-17 Thread David Hoffer
[convertBodyTo[byte[]]], Channel[RecipientList[Simple: http://0.0.0.0:80/ackStarguard/${file:onlyname}?proxyHost=0.0.0.0&proxyPort=80]]] ]] In version 2.15.x it just returns null. How can I fix this? -Dave On Mon, May 16, 2016 at 3:29 PM, David Hoffer wrote: > I'm upgrading an app from C

Re: Upgrade from 2.13.2 to 2.15.x has JMX bugs

2016-05-17 Thread David Hoffer
Dave On Tue, May 17, 2016 at 8:30 AM, David Hoffer wrote: > As an example in the prior version the getDescription() method would > return something like: > > EventDrivenConsumerRoute[Endpoint[file://C:/JMS/gangplank/work/guard_ACK/?delay=1000&delete=true&filter=%23partialFilte

Re: Upgrade from 2.13.2 to 2.15.x has JMX bugs

2016-05-18 Thread David Hoffer
voking the dump route as xml > operations on the route or camel context mbeans. > > There is plenty of details maybe try using a jconsole or something and > browse the jmx tree and see what you can find. > > On Tue, May 17, 2016 at 7:51 PM, David Hoffer wrote: > > I

Re: How to retain exchange headers through RoutingSlip

2016-07-11 Thread David Hoffer
routing slip and show > some code of a route that starts from a file, and without any routing > slip. > > Also see this FAQ > > http://camel.apache.org/why-do-my-message-lose-its-headers-during-routing.html > > On Sun, Oct 4, 2015 at 4:20 PM, David Hoffer wrote: > > I

Re: How to retain exchange headers through RecipientList destination

2016-07-12 Thread David Hoffer
hown below, that was just to satisfy Camel. What we really want is the file logic in backupProcessor but it has to know about the Camel headers/metadata somehow. http://camel.apache.org/schema/spring";> On Mon, Jul 11, 2016 at 2:05 PM, David Hoffer wrote: &

Suggestions on how to cluster Camel?

2016-07-22 Thread David Hoffer
We have a standalone Camel app (runs as daemon with no container) that we need to cluster and I'm looking for options on how to do this. Our Camel app handles file routing. All inputs are files so exchanges deal with byte arrays and the file name. Destinations are either file folders or web-serv

How to dynamically change/redirect choice/when option?

2016-07-26 Thread David Hoffer
We have several file routes that have several 'when' clauses in a 'choice' element (XML config). I need a way to let the user disable some of the 'when' options at runtime. Each 'when' clause currently just has a 'to' file URI. Note I can't just stop the route that picks up the file at the above

XSLT URI with network share

2016-09-30 Thread David Hoffer
I have a Camel xslt uri defined as: which works fine if {{gangplank.home}} is a local path. However now gangplank.home points to a network share so it looks something like \\jmsshares\Utility\gangplank Now camel fails to resolve with: INFO|5848/0|Service Gangplank Server|16-09-30 20:55:39|Cau

FTP/SFTP URI with literal \ path characters

2017-02-21 Thread David Hoffer
I'm trying to connect to a Linux SFTP server that has a literal sub-folder name of \a\b\c. Where \ are literal backslash characters. Note, this subfolder is a child of the user's login folder and does not represent a root folder. Is there any way to configure Camel to treat the backslashes as lit

Re: FTP/SFTP URI with literal \ path characters

2017-02-21 Thread David Hoffer
y setting the separator option on the ftp endpoint. > > Otherwise then .. you would be out of luck. Its maybe better to avoid > such "bad" folder names instead. > > On Tue, Feb 21, 2017 at 6:34 PM, David Hoffer wrote: > > I'm trying to connect to a Linux SFTP serv

Re: FTP/SFTP URI with literal \ path characters

2017-02-21 Thread David Hoffer
too > > much the code - as there is a fair amount of code that parses folder > > names with / and \ slashes and whatnot. > > > > You can fork the code and built your own extended ftp component or use > > some other ftp library. > > > > > > On Tue, Feb

Camel SFTP

2017-03-03 Thread David Hoffer
How does Camel handle the SSH cert when connecting to SFTP servers? Somehow it has to accept the cert provided by the server how does it do that? The docs say the default is: strictHostKeyChecking=no What does this mean? Does this mean it will accept every cert? What does strictHostKeyChecking=

Re: Camel SFTP

2017-03-03 Thread David Hoffer
it gives you an idea about where to look at. > > > Good luck. > > > On 03.03.2017 17:32, David Hoffer wrote: > > How does Camel handle the SSH cert when connecting to SFTP servers? > Somehow it has to accept the cert provided by the server how does it do > that? >

Re: Camel SFTP

2017-03-03 Thread David Hoffer
additivity = false > logger.mylogger.appenderRef.mylogger.ref = MYLOGGER > > Regards. > > On 03.03.2017 18:16, David Hoffer wrote: > > Is there a way to turn on low level logging so we can see why Camel is > failing to connect? We can connect to the same server with puttyftp

Re: Camel SFTP

2017-03-05 Thread David Hoffer
-do-i-configure-password- > options-on-camel-endpoints-without-the-value-being-encoded.html) > in the password. > > Abraços, > Luis Felipe - Finx > > On Fri, Mar 3, 2017 at 11:52 PM, David Hoffer wrote: > > > We are using password authentication > > > >

Re: Camel SFTP

2017-03-07 Thread David Hoffer
Finx > > On Mon, Mar 6, 2017 at 12:40 AM, David Hoffer wrote: > > > Thanks for the tip I did not know about this. I would think Camel would > > want to treat all passwords as raw...can never tolerate those changing. > > Once we get back on site (Monday I think) we will

Re: Camel SFTP

2017-03-08 Thread David Hoffer
ços, > Luis Felipe - Finx > > On Wed, Mar 8, 2017 at 4:59 AM, Claus Ibsen wrote: > > > There is camel-exec to call executables such as .exe files. > > http://camel.apache.org/exec > > > > You can also build your own components if you fancy > > > > On Wed, Mar 8,

How to implement DataFormat

2017-04-28 Thread David Hoffer
We have several DataFormat implementations that handle a variety of compression algorithms. We use these as beans in routes to marshal/unmarshal. Here is an example unmarshal: where zip is our Zip DataFormat implementation bean. ${file:name} regex 'obs-.*\.zip' ${header.C

How to retain exchange headers through RoutingSlip

2015-10-02 Thread David Hoffer
I'm using a RoutingSlip to route files but all custom headers set on the Exchange are discarded. I assume that's because Camel assumes custom headers are not useful for file messages but I need a way to pass source information from the RoutingSlip to the file Processors. How can I do this? Is th

Re: How to retain exchange headers through RoutingSlip

2015-10-03 Thread David Hoffer
ang.Exception false -Dave On Sat, Oct 3, 2015 at 2:27 AM, Claus Ibsen wrote: > Where do you set those custom headers? > > On Fri, Oct 2, 2015 at 8:20 PM, David Hoffer wrote: > > I'm using a RoutingSlip to route files but

Re: How to retain exchange headers through RoutingSlip

2015-10-04 Thread David Hoffer
rs is not stored. You need to do some kind of custom message > transformation if you want to include headers, and also when you read > the file. eg where should the headers be stored in the file? > > On Sat, Oct 3, 2015 at 2:33 PM, David Hoffer wrote: > > We add the headers where w

sftp endpoint is not as performant as expected

2015-11-11 Thread David Hoffer
I have a spring configured (XML) Camel project where where are many routes but the starting point of all the data is an sftp URI. E.g. ftp://{{gp.camel.sg.username}}@ {{gp.camel.sg.host}}:{{gp.camel.sg.port}}/{{gp.camel.sg.path}}?password={{gp.camel.sg.password}}&delete=true&exclusiveReadLockStra

Re: sftp endpoint is not as performant as expected

2015-11-12 Thread David Hoffer
I'm rather new to Camel, I'm assuming that if the SFTP source gets 900 files then the configured GenericFileExclusiveReadLockStrategy#acquireExclusiveReadLock will get called 900 times (once per file) every polling cycle. We too have a custom GenericFileExclusiveReadLockStrategy class that does no

Camel ThreadPool maxQueueSize question

2015-11-19 Thread David Hoffer
I'm trying to understand the default Camel Thread Pool and how the maxQueueSize is used, or more precisely what's it for? I can't find any documentation on what this really is or how it's used. I understand all the other parameters as they match what I'd expect from the JDK...poolSize is the mini

GenericFileExclusiveReadLockStrategy#prepareOnStartup() question

2015-11-19 Thread David Hoffer
What is the lifecycle of the GenericFileExclusiveReadLockStrategy#prepareOnStartup() method. I'm assuming that it will never be called more than once at startup...but is that correct? We store state in our custom GenericFileExclusiveReadLockStrategy class and the state is cleared when prepareOnSt

How to configure threadPoolProfile?

2015-11-19 Thread David Hoffer
I'm trying to change the default thread pool using the following but then my app won't start it says the XML is invalid at the routeContextRef line but that line works fine before I added threadPoolProfile. What am I doing wrong? I'm using Camel 2.8.2. http://camel.apache.org/schema/spring";>

Re: GenericFileExclusiveReadLockStrategy#prepareOnStartup() question

2015-11-20 Thread David Hoffer
and it will be called again. > > On Fri, Nov 20, 2015 at 12:49 AM, David Hoffer wrote: > > What is the lifecycle of > > the GenericFileExclusiveReadLockStrategy#prepareOnStartup() method. I'm > > assuming that it will never be called more than once at startup...but is

Re: How to configure threadPoolProfile?

2015-11-20 Thread David Hoffer
ou. > > On Fri, Nov 20, 2015 at 1:22 AM, David Hoffer wrote: > > I'm trying to change the default thread pool using the following but then > > my app won't start it says the XML is invalid at the routeContextRef line > > but that line works fine before I added threa

Re: Camel ThreadPool maxQueueSize question

2015-11-20 Thread David Hoffer
the Camel in Action books > > > On Fri, Nov 20, 2015 at 12:22 AM, David Hoffer wrote: > > I'm trying to understand the default Camel Thread Pool and how the > > maxQueueSize is used, or more precisely what's it for? > > > > I can't find any documenta

Re: Camel ThreadPool maxQueueSize question

2015-11-21 Thread David Hoffer
to > decide what to do if there is no free threads, such as reject or use > current thread etc. > > On Fri, Nov 20, 2015 at 11:09 PM, David Hoffer wrote: > > This part I'm not clear on and it raises more questions. > > > > When using the JDK one generally us

Re: Camel ThreadPool maxQueueSize question

2015-11-21 Thread David Hoffer
ithout any problems. > > Maybe you have to many sftp connections? Maybe its entirely independent > from camel and you reached a file handle limit? > > Jens > > > Von meinem iPhone gesendet > > > Am 20.11.2015 um 23:09 schrieb David Hoffer : > > > > This part

Re: Camel ThreadPool maxQueueSize question

2015-11-21 Thread David Hoffer
are queued in camel? > Otherwise only a profiler can tell you whats going on... > > Jens > > Von meinem iPhone gesendet > > > Am 21.11.2015 um 16:32 schrieb David Hoffer : > > > > I have more information on my case. It turns out that the reason the > sftp >

Re: Camel ThreadPool maxQueueSize question

2015-11-21 Thread David Hoffer
w > > > Jens > > Von meinem iPhone gesendet > > > Am 21.11.2015 um 16:40 schrieb David Hoffer : > > > > Yes when the sftp read thread stops it was still processing files it had > > previously downloaded. And since we can get so many files on each poll > &g

Re: Camel ThreadPool maxQueueSize question

2015-11-23 Thread David Hoffer
-Dave On Sun, Nov 22, 2015 at 1:33 AM, Claus Ibsen wrote: > On Sun, Nov 22, 2015 at 3:29 AM, David Hoffer wrote: > > I'm not sure how to block the polling. > > > > Here is what seems like an ideal approach...the SFTP polling always runs > on > > schedule and

Custom sorting using the file component

2016-01-27 Thread David Hoffer
I have a route that receives several different file types and the names vary too but always contain a timestamp. I need to process these in timestamp order and planned to use sortBy=file:name, this worked fine in testing but now that we are closer to production we are finding that the file names o

Re: Custom sorting using the file component

2016-01-28 Thread David Hoffer
the sorter option > http://camel.apache.org/file2 > > On Thu, Jan 28, 2016 at 7:17 AM, David Hoffer wrote: > > I have a route that receives several different file types and the names > > vary too but always contain a timestamp. I need to process these > > in timestamp order and pla

Can't shut down due to inflight and pending exchanges

2016-02-26 Thread David Hoffer
For some reason we are getting the following message from the DefaultShutdownStrategy "Waiting as there are still 1 inflight and pending exchanges to complete, timeout in 300 seconds." Which causes our app to not shut down for 5 minutes. This is happening although there was no work for the app to

Re: Can't shut down due to inflight and pending exchanges

2016-02-26 Thread David Hoffer
t of problems like that. > > You could also configure your own DefaultShutdownStrategy and set a smaller > timeout. For example: > > class="org.apache.camel.impl.DefaultShutdownStrategy"> > > > > > > > On 26 February 2016 at 13:55,

Re: Can't shut down due to inflight and pending exchanges

2016-02-26 Thread David Hoffer
How do I inject the defaultShutdownStrategy bean into the camelContext? On Fri, Feb 26, 2016 at 1:20 PM, David Hoffer wrote: > I found a doc that says I can add the following to my camel context. I > tried it and it worked but then took it out and it still works so this > problem is

Re: Can't shut down due to inflight and pending exchanges

2016-02-26 Thread David Hoffer
e.org/graceful-shutdown.html > > On 26 February 2016 at 14:20, David Hoffer wrote: > > > I found a doc that says I can add the following to my camel context. I > > tried it and it worked but then took it out and it still works so this > > problem is random it doe

Camel AWS Athena SDK

2024-11-19 Thread David Hoffer
https://camel.apache.org/components/4.8.x/aws2-athena-component.html We use multiple data sources in our Quarkus application and Athena is one of them. Is there a way to make this XA compliant? The latest Quarkus is failing with our current CData driver as its not XA, so looking for something th

Re: Camel AWS Athena SDK

2024-11-19 Thread David Hoffer
Long > Running Activities) which is guaranteed to eventually consistent. See > https://quarkus.io/blog/using-lra/ > > > > > On Wed, Nov 20, 2024 at 8:30 AM David Hoffer wrote: > > > Hi, > > > > Yes we actually have 4 datasources. > > > > This is the m

Re: Camel AWS Athena SDK

2024-11-19 Thread David Hoffer
ng Feng wrote: > Hi David, > > Can you describe more about your scenario? Do you want to run Athean and > other data sources in an XA transaction? What transaction manager did you > use, is it quarkus-narayana-jta? > > On Wed, Nov 20, 2024 at 7:19 AM David Hoffer wrote: >

Re: Camel AWS Athena SDK

2024-11-20 Thread David Hoffer
Thanks! On Tue, Nov 19, 2024, 9:13 PM Zheng Feng wrote: > Answer inline, > > On Wed, Nov 20, 2024 at 10:49 AM David Hoffer wrote: > > > Thanks for your quick response. > > > > As I think about this more I do not think MongoDB and Athena are ever > used > >