sftp route runs fine for days but then it stops picking up new files

Hi, I have a sftp route that runs ok for a while, but after a few days it doesn't pick up any (new) files anymore. When looking at the hawtio console, nothing was inflight and the route was running. Anybody experienced this behaviour ? i'm using camel-2.15 My endpoint is:

Re: Use splitter to ftp List of InputStreams

No, that doesn't matter (or else it would fail earlier). It's because i supply a LIST of InputStreams instead of one. Regards Rino -- View this message in context: http://camel.465427.n5.nabble.com/Use-splitter-to-ftp-List-of-InputStreams-tp5786195p5786197.html Sent from the Camel - Users

Use splitter to ftp List of InputStreams

Hi, I'm using the splitter as mentioned here , but with a modified aggregation strategy in order to accumulate all files processed and ftp the all (the aggregator in the link will just

Re: getProcessor().process(exchange) takes 15 minutes

Wait, this must be the dreaded ftp no-op delay i experienced way earlier. See http://camel.465427.n5.nabble.com/camel-ftp-sendNoOp-takes-15-minutes-td5767210.html#a5767553 -- View this message in context:

getProcessor().process(exchange) takes 15 minutes

Hi, I've created a custom camel consumer that consumes files from a JCR repository. It extends DefaultConsumer (and the endpoint extends DefaultEndpoint). In the consumer i spawn a thread that loops forever and does 3 things: 1) read the next file from JCR repo (under a certain path) 2) set

FTP consumer in route does not seem to retry poll after error

Hi, We've got a (transacted) camel 2.15.1 route that seems to 'hang', i.e. not pick up any files from ftp anymore, after an error occured. I waited a few hours and nothing happened. I paused the routes and still nothing happened. Only after restarting the OSGi bundle the route was in , the files

Re: Content-Length and CamelFileLength suddenly 0

Note, the FtpChangedRenameReadLockStrategy combines the 'changed' and the 'rename' read lock strategy. It first calls acquire on GenericFileRenameExclusiveReadLockStrategy, followed by a acquire call on FtpChangedExclusiveReadLockStrategy. This is because the @#$%^&* SAP system first creates an

Re: Content-Length and CamelFileLength suddenly 0

Example: Body class: class org.apache.camel.component.file.remote.RemoteFile Endpoint key=ftp://xxx/Acceptance/SAP/I0019/Outbox?antFilterCaseSensitive=false=NID*=true=3=true=true=%23ftpChangedRenameReadLockStrategy=100=true=secret=rename=5000=3=false=userxyz Endpoint

Content-Length and CamelFileLength suddenly 0

Hi, When downloading a file with (camel:) ftp or http, i suddenly see that Content-Length / CamelFileLength = 0 despite the fact that the InputStream that *is* available in the body is not empty (i.e. containt 300+ bytes) Any idea as to when this could happen? I'm using Camel 2.15.1 Regards

Dynamically created CamelContext not visible in fuse console

Hi, I got 2 camel contexts defined in xml and a bunch of others i created dynamically with: CamelContext camelContext = new SpringCamelContext(applicationContext); The point is, when doing "camel:context-list" in the JBoss Fuse 6.2 console, is only get to see the 2 (fixed) ones. In hawtio i

Re: Dynamically created CamelContext not visible in fuse console

ok, tried that. CamelContext camelContext = new OsgiSpringCamelContext(getApplicationContext(), Activator.getBundleContext()); ((OsgiSpringCamelContext)camelContext).setName(contextId); The OsgiSpringCamelContext constructor is calling OsgiCamelContextHelper.osgiUpdate(this,

Re: ftp multiple streams in body => custom splitter

ok, so i thought it worked for all cases, but now i see it only copies the last file in the zip! In the debug log i see that the processor and aggregator are called N times (for N number of files in the zip file) .. Processing file /var/folders/mg/3ms51p890wgc9nl5y47d2s80gn/T/file1 ...

Re: ftp multiple streams in body => custom splitter

never mind, i got it -- View this message in context: http://camel.465427.n5.nabble.com/ftp-multiple-streams-in-body-custom-splitter-tp5774343p5774445.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: ftp multiple streams in body?

Hi Claus, i implemented a splitter (see below) but i'm not sure if this is the way to go; i think this can be implemented more elegantly/simpler (but i don't know how ;-). A unzipped file *does* come out, but where do i set the current filename (if there are more than one) ? -- View this

Re: ftp multiple streams in body?

ah, ofcourse the good 'ol' splitter. Thanks Claus! -- View this message in context: http://camel.465427.n5.nabble.com/ftp-multiple-streams-in-body-tp5774197p5774236.html Sent from the Camel - Users mailing list archive at Nabble.com.

ftp multiple streams in body?

Hi, i've developed a simplified camellish DSL for my end-users in which they can basically specify how they want files to be moved around. For the most part this works great, but i don't have a solution yet for the case where i read just one file and the end result is N files. For example this

Re: Recommended practices for dynamically creating and removing camel routes and camel contexts

talking to myself here ;-) If i replace camelContext.stop() with camelContext.suspend() and camelContext.start() with camelContext.resume() than it works fine. I guess using camelContext.stop() is only used for bringing the whole camel stack down, not to bring it up again later Rino. --

Re: Recommended practices for dynamically creating and removing camel routes and camel contexts

The problem arises when i stop all non-default camel contexts and recreate them later again after a route or property is changed for example. Then all camelContexts are gone (except the one that was in a spring xml file that rereads the route xmls every xx-seconds). I also got this then: Caused

Recommended practices for dynamically creating and removing camel routes and camel contexts

Hi, I have a program which creates Camel routes dynamically based on one or more route xml files in a folder. You can also specify a context, which then will lead to the route created in that specified camel context. Basically this: CamelContext camelContext = new

Re: onCompletion / exchange.isFailed() does not 'see' exception.

so, you're saying .handled(true) is the default when using onCompletion? I don't set handled to true myself. Besides, the Exchange.EXCEPTION_CAUGHT propery is also empty in the onCompletion code! Regards Rino -- View this message in context:

onCompletion / exchange.isFailed() does not 'see' exception.

Hi, I have a camel (2.15) route where i want to log an audit message when the route is successfull or log an an exception message when an exception occurs in the route. I thought i could use an onCompletion and check isFailed() on the exchange, but the strange thing is : the exception seems to

Camel extra jcifs for camel 2.15.x ?

Hi, Where can i find the 2.15 version for camel-jcifs ? The last version on maven central is 2.14.1 http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache-extras.camel-extra%22%20AND%20a%3A%22camel-jcifs%22 Regards Rino -- View this message in context:

Re: Create 'to' http endpoint (with arguments) with bean

Work-around: (works, but why use bean:xxx at all then? could then just replace it with a processor ;-) -- View this message in context: http://camel.465427.n5.nabble.com/Create-to-http-endpoint-with-arguments-with-bean-tp5770857p5770876.html Sent from the Camel - Users mailing list archive

Using exchange in PropertiesFunction ?

Hi, Is it possible to get hold of the exchange somehow when apply() is called in an PropertiesFunction? Regards Rino -- View this message in context: http://camel.465427.n5.nabble.com/Using-exchange-in-PropertiesFunction-tp5770848.html Sent from the Camel - Users mailing list archive at

Create 'to' http endpoint (with arguments) with bean

Hi, I'm 'calculating' a dynamic http uri / arguments with a bean as below. But, the http endpoint does not seem to be called (i do not see the Http headers; i *do* see the getFxAllUrl being called) When replacing the bean:fxAllHttpUrlBuilder with https:jadajada it is called again (and i see http

Re: Cannot use ${file:xx} in blueprint route / properties

Thanks Claus, that worked! -- View this message in context: http://camel.465427.n5.nabble.com/Cannot-use-file-xx-in-blueprint-route-properties-tp5770764p5770785.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Cannot use ${file:xx} in blueprint route / properties

Thanks, it took 8 backslashes to make it work. This looks ridiculous ;-) file:{{example.host}} -- View this message in context: http://camel.465427.n5.nabble.com/Cannot-use-file-xx-in-blueprint-route-properties-tp5770764p5770782.html Sent from the Camel - Users mailing list

Cannot use ${file:xx} in blueprint route / properties

Hi, I noticed that i cannot use things like ${file:name} or ${date:now} in my blueprint route that uses a OSGI config file (the value stays empty) E.g. I got this in the /etc/com.example.myconfig.cfg The {{ }} works ok, how can i make the ${file:xx} work ? I'm using Camel 2.15. -- View

Re: Cannot use ${file:xx} in blueprint route / properties

More specific: This works: When you include tempFileName=tempTransfer/${file:name} in the cfs.defaultWriteOptions property, than this does not work: -- View this message in context: http://camel.465427.n5.nabble.com/Cannot-use-file-xx-in-blueprint-route-properties-tp5770764p5770765.html

Re: Cannot use ${file:xx} in blueprint route / properties

On a related note (an maybe blueprint related) example.endpoint = file:example.host.com from uri={{example.endpoint}} / = Does not work: creates folder in root of c:\ named example.host.com and reads from that from uri=file:example.host.com / = Works / reads from windows share

Re: MDC logging does not work with camel.routeId anymore

Yes, i messed the example up a bit. The original route had no onCompletion tag and the routeId also was not printed. Luckilly i can work around it by doing a normal processor like: and in the route : -- View this message in context:

Re: MDC logging does not work with camel.routeId anymore

I use camel 2.15 (Fuse 6.2) so this issue should be solved already i think Rino -- View this message in context: http://camel.465427.n5.nabble.com/MDC-logging-does-not-work-with-camel-routeId-anymore-tp5768851p5768941.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: MDC logging does not work with camel.routeId anymore

Hi Claus, The problem has to do with the onCompletion processor we use (and indeed, maybe also with the osgi pax logging) In the logging i see one line with the routeid and one line without the routeid. I can reproduce it with the blueprint route, logging config and java class @ fuse 6.2

Re: MDC logging does not work with camel.routeId anymore

Yes, it's part of the JBoss Fuse 6.2 stack, so Apache Karaf 2.4 -- View this message in context: http://camel.465427.n5.nabble.com/MDC-logging-does-not-work-with-camel-routeId-anymore-tp5768851p5768855.html Sent from the Camel - Users mailing list archive at Nabble.com.

MDC logging does not work with camel.routeId anymore

Hi, We migrated from camel 2.12 to 2.15 and noticed that our MDC logging didn't work anymore. When we removed {camel.routeId} from the logging definition, all worked again. Any ideas? Regards Rino -- View this message in context:

MDC logging does not work with camel.routeId anymore

Hi, We migrated from camel 2.12 to 2.15 and noticed that the {camel.routeId} in our MDC logger is no longer honored. Worse: it doesn't log anything anymore (we don't see MDC logger is enabled for context xyz) untill you remove {camel.routeId}, then it logs again. Our mdc log def: Any ideas?

camel-file2 include with expression

Hi, I totally assumed the include option in the camel-file2 component also supported the simple language (like the move and preMove does for example) , so i thought i could do this include=*.gz.enc.${date:now:MMdd} to read only the files from today (but this didn't work as it should be a

Trace from and to endpoints

Hi, What would be the best way to gather the 'path' a camel route takes for an audit log. The way i see it i have at least 3 options: implement my own Tracer (http://camel.apache.org/tracer.html), implement my own InterceptStrategy or catch the exchange events by extending the

Re: Tip: speed up camel-ftp download/upload by setting bufferSize on the FTPClient

Hi, I'm using camel 2.12.x Regards Rino -- View this message in context: http://camel.465427.n5.nabble.com/Tip-speed-up-camel-ftp-download-upload-by-setting-bufferSize-on-the-FTPClient-tp5767800p5767903.html Sent from the Camel - Users mailing list archive at Nabble.com.

file-to-file copy gives unreliable results (not entire file is copied)

Hi, I'm trying to reproduce a problem we have in production with one of our camel routes, in the process i found some strange behaviour when just copying a file with a simple blueprint camel route (see below). Small (zip) files seem to be copied correctly, but large files (i used 162MB)

Re: file-to-file copy gives unreliable results (not entire file is copied)

When i tweak the route some more (added options readLockTimeout and readLockCheckInterval), the succesrate seems to be 100% now. Is this expected behaviour? I mean, you would expect the files to be copied with a 100% successrate no matter what the (timing) options right ? Improved route: --

Re: file-to-file copy gives unreliable results (not entire file is copied)

BTW: My colleague copying a 1GB file with the same blueprint route on Windows 8 seems to have no problem at all ! -- View this message in context: http://camel.465427.n5.nabble.com/file-to-file-copy-gives-unreliable-results-not-entire-file-is-copied-tp5767775p5767779.html Sent from the Camel -

Tip: speed up camel-ftp download/upload by setting bufferSize on the FTPClient

Just a tip for those experiencing performance problems using ftp download with the localWorkDirectory option. We've got a camel route that downloads a file via ftp and upload this file to another ftp server. Since the files grew big, we added the localWorkDirectory option. The performance was

Re: camel-ftp sendNoOp takes 15 minutes

Hi Claus, thanks for your response. I'm affraid i'm stuck on this camel version (2.12). What is the best way to do this? I'm thinking creating a new component, say ftp2, that extends from the standard ftp component and overrides the preWriteCheck method in the RemoteFileProducer. Or is there a

Re: FOUND CAUSE! - FTP Move fails - have found cause but don't understands why

I've experiencedalmost the same problem with this streamDownload option (i got a lot of exceptions on renaming the file to Archive). Now i'm using the localWorkDirectory option instead and this seems to work better! Regards Rino -- View this message in context:

camel-ftp sendNoOp takes 15 minutes

Hi, In one of our production routes we see a delay of 15 minutes per ftp'ed file (on the clock). So sending 4 files takes 1 hour ! I turned on the trace logging of the RemoteFileProducer and directly before and after the 15 minutes there are 2 log lines: Any ideas on why the noop can take that

Re-use from-endpoint and kickoff route in Java dsl

Hi, We have some routes that read from file/ftp endpoints and send to file/ftp endpoints (your basic 'filemover'). The endpoints are specified in beans so we can re-use this in other routes. I re-use these from endpoints (but now with a delete=true option and some sort of FileAge filter) in

Re: Wiretap not firing events?

Thanks Claus! For now, as a workaround (i'm stuck at camel 2.12 for the moment), i do something like the thing below in my wiretap : .process(new Processor() { @Override public void process(Exchange exchange) throws Exception { // some trick to get the

Re: Wiretap not firing events?

Thanks Claus! For now, as a workaround (i'm stuck at camel 2.12 for the moment), i do something like the thing below in my wiretap : .process(new Processor() { @Override public void process(Exchange exchange) throws Exception { // some trick to get the

Wiretap not firing events?

Hi, We use an extension of EventNotifierSupport to log all camel messages (from/to) to Elasticsearch. This works fine for all routes except for a wiretap route (that sends a newExchange). This wiretap route does not seem to fire AbstractExchangeEvents. Is this correct? Shouldn't it send these

Camel-sql dynamic from ?

Hi, Is it possible to use a dynamic from() in camel 2.12 ? Like this: from(buildAnCamelSqlQueryInABean).process(doSomething); // not possible this way! (like a recipientList but now for from() endpoints) Regards Rino -- View this message in context:

Re: camel-jdbc: read-update performance drop / prepareStatementStrategy

I find the solution: instead of using the camel-jdbc component, i now use the camel-sql component with the option batch=true. This will do ps.addBatch() and eventually ps.executeBatch() which gives a lot better performance. You'll have to prepare the parameters a bit though (as an

Empty response with camel cxf when putting message on queue also

Hi, I've got a camel route acting as a cxf webservice that must sent a non-empty response back to the caller *and* put the message on the queue. The message is put on the queue alright, but i always get an empty soap response: This is my cxf definition: and this is the camel route: The

Re: Empty response with camel cxf when putting message on queue also

Found it! I forgot a marshal(xyzPriceDataFormat) after process(updateMarketDataXyzResponder). -- View this message in context: http://camel.465427.n5.nabble.com/Empty-response-with-camel-cxf-when-putting-message-on-queue-also-tp5758662p5758664.html Sent from the Camel - Users mailing list

Re: BreadcrumbId is null after using transacted

Hi Claus, The route was a bit simplified too much ;-) from(step4) should be: from(direct:step4) Basically we're trying to put a message on the queue (toEndPoint == amq:queue:jadajada) ,update a record in the database and check if the database record was indeed updated - all in a transaction!

BreadcrumbId is null after using transacted

Hi, I noticed the breadcrumbId is null after i use transacted. Is this by design? See example route below. from(step4)) .routeId(route-step4) .onCompletion().onCompleteOnly().bean(loggingProcessor, LoggingProcessor.AUDIT) .end()