Re: How to improve throughput by grouping messages in a Transaction (in JMS)

Hi, I have made a thorough search but unable to find docs.spring.io/spring-batch/apidocs/org/springframework/batch/container/jms/BatchMessageListenerContainer.html in the spring-batch/spring-batch-core library. (although the javadocs says its available) I don't see the package org/springframewo

Re: How to improve throughput by grouping messages in a Transaction (in JMS)

Hi, Thanks for the reply, the XA connection factory is in place, Can you pls point to an example on how to override the default messageListener? (I have checked in forum - I am not able to see anyone done this in the past) regards D -- View this message in context: http://camel.465427.n5.nab

Re: How to improve throughput by grouping messages in a Transaction (in JMS)

Hi, As mentioned in my previous post - I am developing a bridge that will set b/w ActiveMQ and TIBCO EMS. My aim is to use a XATransactionManager (like Atomikos) that will be common for the JMS Session that will consume from ActiveMQ and the JMS Session that will be publish to TIBCO EMS. With th

Re: How to improve throughput by grouping messages in a Transaction (in JMS)

Thanks, but I would have to compromise on performance right? Because of the additional hop / intermediate queue? regards, D -- View this message in context: http://camel.465427.n5.nabble.com/How-to-improve-throughput-by-grouping-messages-in-a-Transaction-tp5773344p5773916.html Sent from the C

Re: How to improve throughput by grouping messages in a Transaction (in JMS)

Hi Jakub, Thanks for the reply, that's unfortunate because XA is a must for me, and to improve performance I need to group number of messages in a Transaction. Is there a work around some one can suggest - would using Spring-batch help achieve this? Any suggestions will be helpful. regards D

Re: How to improve throughput by grouping messages in a Transaction (in JMS)

Thanks Claus, The dependency looks exactly same as SJMS, does this mean SJMS has been enhanced/re-branded as SJMS-batch? in version 2.16? org.apache.camel camel-sjms x.x.x Also can you pls point me to the Javadoc? I can only see Javadoc available for 2.15. I need to chec

Re: How to improve throughput by grouping messages in a Transaction (in JMS)

All, I read the below link - and it appears this lets me batch messages during consumption or publication http://camel.apache.org/sjms.html i.e. (multiple messages in one transaction). But unfortunately this does not support XA (I am using Atomikos as Transaction Manager) https://issues.apache.o

How to improve throughput by grouping messages in a Transaction

All, I have a simple bridge between ActiveMQ and TibcoEMS. There are 2 routes. 1st Route moves messages into ActiveMQ Queue. (thisroute reads messages from Disk and publishes to ActiveMQ). 2nd Route consumes messages from ActiveMQ and publish to a Topic in TibcoEMS. For both the routes, because

What is the significance of Load01, Load05 and Load15 in JMX

All, Can some one help me clarify what is the significance of Load01, Load05 and Load15 that is exposed via JMX MBeanServer in Camel? My intention is to visually indicate the transfer progress for a large file. i.e. with a scrolling indicator that indicates the % of file transfer as the file ge

Re: Unable to access camel MBean Server from JBoss

Hi, createConnector="true" is already set. My question is - is it possible to start MBean server and expose JMX through Java JSR 160 (remote jmx) instead of RMI. regards -- View this message in context: http://camel.465427.n5.nabble.com/Unable-to-access-camel-MBean-Server-from-JBoss-tp57569

Re: Unable to access camel MBean Server from JBoss

All, Just realized the following JMXConnector: service:jmx:rmi:///jndi/rmi://LDN-LRM-PC-189:1/jmxrmi/camel I see the above from Camel log. Thats the service exposed by Camel's MBEan Server. It appears camel exposes only jmx via RMI, while JBoss (EAP 6.1+) supports JSR 160 (JMX Remoting). i.

Unable to access camel MBean Server from JBoss

All, I run (camel) in a separate JVM. Camel @ runtime creates and registers MBean management objects with a MBeanServerinstance in the VM. Another application deployed in JBoss access this MBean Server. i.e. a Singleton Bean deployed in Jboss (EAP 6.3.0 / 6.1.0 Alpha) will try to access this MBe

Re: Problem with sFTP PUT (solved + Potential code enhancement?)

Hi, After going through the code - its now clear on why the PUT action failed. As explained in my previous post - by sFTP server provider does not allow command like CD to be run after logging in. Following is my routes.xml

Logging for jSCH and File-component

Hi, Can i know how to enable logging for jSCH & FileComponent. I am using sFTP component from Camel and interested in seeing debug/trace level logs for jSCH and File Component. I can see that I am able to log in to sFTP server successfully. After logging in when I attempt to PUT a file - I see

Re: Problem with sFTP PUT

Hi, Can some one advise on the above issue I am facing. Upgrading Camel is not an option - since we are facing this issue in Production. FYI: I set up a local sFTP server locally to test the above requirement - and it seems to work fine - I am wondering if its to do with directory permission?

Re: Problem with sFTP PUT

Hi Claus, So can you pls clarify how my route should be - I don't have a '/' in from of the 'put' directory - so this should work right? or should I try: /put/DTS4.UP.C5T62.S60300 ? (I think I might have tried that already) put/DTS4.UP.C5T

Re: Problem with sFTP PUT

I have got confirmation that relevant access/rights have been given to the /put directory. As explained in my first post, I can successfully 'PUT' by logging to the sFTP form command line via psftp.exe Problem occurs only when i use Camel. -- View this message in context: http://camel.465427

Re: Problem with sFTP PUT

Hi Can some one advise on how to fix this? I have tried setting separator to Unix, also tried stepwise to true/false - cannot get it to work. -- View this message in context: http://camel.465427.n5.nabble.com/Problem-with-sFTP-PUT-tp5752794p5752808.html Sent from the Camel - Users mailing li

Re: Problem with sFTP PUT

/apps/cdts/data_in_datapower/ is the root directory but I do not have access/privilege to access root directory. When I login I will be defaulted to home directory from where I can do a 'put' But when I PUT the file I must also explicitly include the /put directory (because sFTP server has not giv

Re: Problem with sFTP PUT

I will try this approach (storing the file in disk, reading it again and sending over sFTP) But I think the problem is with the put/ Its the 'put' directory before the file name - I think the route is not able to traverse to that directory when it attempts to put the file. (nothing wrong with th

Problem with sFTP PUT

Hi, I am using Camel 2.12.0. I am using the sftp component. The sFTP server is hosted on a UNIX based system. The following works fine when I 'PUT' a file manually This is What works: psftp> put D:\opt\share\Outbound_DTCC\DTS4\UP\C5T62\S60300 put/DTS4.UP.C5T62.S60300 I am trying to do somethin

Potential bug in sFTP (jSCH)?

Hi, I am using Camel 2.12.0. I have a route that establishes a sFTP connection. I have set the route so that it will attempt to re-connect every 15 minutes and then disconnect. This is set up because the sFTP service provider has explicitly requested not to keep connection open and poll at regular

Query regarding SES Component

All, I am trying to use SES Component. I am unable to find any examples on how t use this. MICS I am setting the access keys directly in the Route instead of using Registry for amazonSESClient. Intenti

Re: Query on cipher 'aes256-cbc' for sFTP

Hi - an some one provide some guidance on my above query - its unlikely we will be able to update libraries/jar files in JRE - since we do not have control over thisregardsD -- View this message in context: http://camel.465427.n5.nabble.com/Query-on-cipher-aes256-cbc-for-sFTP-tp5745927p5745

Regarding Pluggable+storage+lockers

All, I am running ActiveMQ (5.6.0) integrated in JBoss. I am also using Apache Camel. ActiveMQ runs in a master/slave fashion. To ensure failover of Apache Camel routes, I have implemented strategy as shown below http://www.liquid-reality.de/display/liquid/2011/11/11/Hot+Standby+failover+for+

Adding end point details to Camel logs

All, My camel logs look like this INFO Route: route_simulatorMICS started and consuming from: Endpoint[file:///opt/share/EventFileInput?move=.event-done] INFO Route: SendToSDR started and consuming from: Endpoint[jms://queue:queue.SendToSDR] INFO Route: route_DTCCToReform started and consum

Re: Camel sFTP how to track processed files?

Hi Claus, Found the answer I will be using JdbcMessageIdRepository or JpaMessageIdRepository. Will prefer JpaMessageIdRepository in my case. regards D -- View this message in context: http://camel.465427.n5.nabble.com/Camel-sFTP-how-to-track-processed-files-tp5740461p5740471.html Sent fro

Re: Camel sFTP how to track processed files?

Thanks Claus! Looks like that's exactly what I may need. But what does it mean by repository here? "Camel will add the message id eagerly to the repository to detect duplication" Ans also does this hold good even when the Came RouteContext is recreated. i.e. camel is bounced and routes are recrea

Camel sFTP how to track processed files?

Hi All, As per http://camel.apache.org/ftp2.html "The FTP consumer will by default leave the consumed files untouched on the remote FTP server. You have to configure it explicitly if you want it to delete the files or move them to another location. For example you can use delete=true to delete th

Re: Issue with camel in Camel 2.12.0

http://camel.apache.org/using-propertyplaceholder.html Following section: *Clashing Spring property placeholders with Camels Simple language* in the above link explains how to avoid this problem. Following now works fine * $simple{body}

Re: Issue with camel in Camel 2.12.0

Hi, Just retried it with Camel 2.9.0 and ${body} and ${body} works fine. Only in Camel 2.12.0 - it assumes that anything under ${} is a property - and throws an exception that property value not found for the Key. Is this a genuine defect or am I using it wrongly? regards D -- Vi

Re: Issue with camel in Camel 2.12.0

Hi, I have tried ${body} and ${in.body} Still getting the same exception. Looks like Camel is assuming that it to be a property 'key' being passed into the routes.xml. regards D -- View this message in context: http://camel.465427.n5.nabble.com/Issue-with-camel-el-in-Camel-2-12-0-tp5740188p5

Issue with camel in Camel 2.12.0

All, I am migrating from camel 2.9.0 to 2.12.0. One change I had to do was around additional boolean argument added in method resolveProperties of org.apache.camel.component.properties.DefaultPropertiesResolver I am also seeing the use of Expression Language failing in 2.12.0. My Route is as foll

Re: When to use AWS SQS?

Hi, Thanks, that was useful. We are providing our Software as a Saas. Its sometimes hosted/deployed within our firm and at times deployed at the client's site. Now we plan to deploy our software in the cloud and provide it as a service to clients. I am still trying to understand if there is any

When to use AWS SQS?

Hi, Apologies if I am posting this in the wrong forum (have just stared with AWS - though might get a better response here given that Camel supports SQS) I am analyzing the various components of AWS. My current architecture looks similar to the image in the below link http://activemq.2283324.n4.

Using Camel File component to Poll a directory (but not read the files)

Hi, is it possible to use file component to poll for files in directories but NOT actually read the file? - but I need a notification message (with the file name) Is there a way to achieve this using File component? or any other component that will help me achieve this? regards D -- View thi

Re: SFTP Support to run GET PUT commands

On further analysis - it appears the sFTP server is expecting ONLY the following sequence of operations to GET a file (1) Change to DTCC-assigned directory cd //artdialu.d3346 (2) List contents of directory ls //artdialu.d3346 (3) Set transfer mode & file char

Re: SFTP Support to run GET PUT commands

Thanks, I am getting an exception when I try to GET a file from SFTP. My route is set up as follows ftp://x...@xxx.xx.xx.xxx:22///.XX.X?password=XXX&noop=true&binary=true&delay=6&stepwise=false"/>

SFTP Support to run GET PUT commands

All, I am currently using Apace Camel for connecting to various end points - webservice, JMS, file etc. Now I have a requirement to PUT/GET files from an external system using SFTP. Is there support in Camel to run GET & PUT commands? e.g. put {local_file_name} // get // c:/myFile In addition

Re: Round Robin in Camel Routes

Yes, ** expecting your consumers to actively fetch messages. * -> That's where I was trying to get to! Thanks for the explanation - its much clear now. -- View this message in context: http://camel.465427.n5.nabble.com/Round-Robin-in-Camel-Routes-tp5735857p5736014.html Sent fro

Re: Round Robin in Camel Routes

Hi, I was not clear in my earlier query. let me clarify. In my current architecture I have multiple routes set up. Each route has has a unique 'from' point and a 'to' end point (that is common for all routes) e.g. Route 1: From: MQ-Queue;To: inbound.Queue (in activeMQ) Route 2: From: FTP;

Round Robin in Camel Routes

Hi, In my architecture I am using Jboss+ActiveMQ (integrated) and activeMQ. is it possible to have a camel route that does round-robin from one or more ActiveMQ queues? The round-robin I am trying to get is at the consumer end. This way my route can pull/consume messages at an even/constant rate

Re: Camel in Master/Slave ActiveMQ config

All fyi - after some testing I went ahead with the approach suggested below http://camel.465427.n5.nabble.com/How-to-make-your-camel-routes-highly-available-when-only-one-may-be-active-at-a-time-td4984581.html#a4988271 http://www.liquid-reality.de/display/liquid/2011/11/11/Hot+Standby+failover+

Re: [Best practise question] Running Camel in JBoss cluster

Hi Robin, You may want to check my thread http://camel.465427.n5.nabble.com/Camel-in-Master-Slave-ActiveMQ-config-td5734804.html I am doing something slightly similar. Difference is my camelContext are in a separate VM (different from JBoss+ActiveMQ) VM But I am yet to find a solution. regard

Re: Camel in Master/Slave ActiveMQ config

Thanks Christian/Christian, http://camel.465427.n5.nabble.com/How-to-make-your-camel-routes-highly-available-when-only-one-may-be-active-at-a-time-td4984581.html#a4988271 The above Post explains the same problem I face - I am going to read that in detail and try it out. -- View this message i

Camel in Master/Slave ActiveMQ config

Hi, In my architecture, I have a Master/Slave set up of ActiveMQ (integrated with JBoss). ActiveMQ in master: tcp://localhost:61616 ActiveMQ in slave: tcp://localhost:61617 Camelcontext(s) runs in a separate VM. So I have 2 instances of camel context running (one for master one for Slave) Follo

Re: Query on Multiple Producers & one consumer (use of throttling)

Hi, I have been reading about load-balancing in camel. http://camel.apache.org/load-balancer.html This makes sense when we intend to spread the load evenly to multiple consumers. i.e. one Producer (FROM end point) spreading load to multiple consumers (TO END POINTS) is there a way to create load

Query on Multiple Producers & one consumer (use of throttling)

Hi, In our system, Camel produces JMS messages from integrated endpoints, which are consumed by EJB MDBs. The EJB application in-turn produces new JMS messages, which are consumed by Camel to send to other integrated endpoints (eg. WebSphere MQ). We use transacted routes, and Atomikos as XA

Re: Using camel:routeContextRef under camel:camelContext

Hi All, After spending a lot of time with the namespace issue, I decided to follow a different approach 1st load the appContext via Spring. This appContext has a camel:camelContext that defines the errorHandlerRef attributes and also other items like camel:onException camel:onCompletion Once the

Re: Using camel:routeContextRef under camel:camelContext

Hi, There was a matching ending tag for routeContex. (the routes.xml was quite large, so I had pasted only a section of it) Issue is not because of invalid XMl but because of namespace but not able to figure it out http://camel.apache.org/schema/spring";>

Re: Using camel:routeContextRef under camel:camelContext

Hi All, Based on reading posts by other users I am following this approach. An applicationCOntext that has a camel:camelContext (that defines define one or more camel:routeContextRef ) Each of these camel:routeContextRef is referred in routes.xml (routeContext id) These routes.xml will be loaded

Using camel:routeContextRef under camel:camelContext

All, In my current application I use Spring appContext which has a camel:camelContext. Under it I have defined a camel:routeContextRef (which corresponds to the routeContext in my routes.xml) As per "How do I import routes from other XML files" in http://camel.apache.org/configuring-camel.html

Using Camel to control the JMS message priority

Hi, In the architecture I am working in, messages come into a ActiveMQ Queue from IBM MQ. An application/consumer polls the messages from this active MQ Queue. Note: Active-MQ is configured within JBoss & Camel does the job of moving messages b/w IBM MQ, Active MQ and b/w active MQ; consumer.

Re: How to use throwExceptionOnFailure=false to differentiate HTTP Status codes

Hi, I took an *ugly* approach. Capture the HTTP exception (OnExeption) - then find out what type of ShatusCode it is. If its between 400..499 then just simply log the exception, if Status Code is between 500..599 then i manually publish the message back into my ActiveMQ Queue (for camel to again p

Re: How to use throwExceptionOnFailure=false to differentiate HTTP Status codes

Hi, Thanks, works fine now after setting the field to false in http://www.google.com?throwExceptionOnFailure=false"/> My aim is to segregate HTTP response status 400 and 500. i.e. for HTTP Statuses: 400-499, there should not be any retries while status 500+ - we need to retry n

Re: How to use throwExceptionOnFailure=false to differentiate HTTP Status codes

Hi, Do you mean to say - point to www.google.com instead of my servlet? But I have set up my servlet in such a way it always sends back a 500 0r 501 as Status Code. -- View this message in context: http://camel.465427.n5.nabble.com/How-to-use-throwExceptionOnFailure-false-to-differentiate-HTT

How to use throwExceptionOnFailure=false to differentiate HTTP Status codes

All, I am using the option throwExceptionOnFailure=false to ensure I Camel doesn't throw exceptions for HTTP Status code 500 and above (since I want to retry) By default Camel throws HttpOperationFailedException for all HTTP responses where status code is 400+ Pls see below for snippet from my R