Camel FTP: how to work with corrupt files.

2017-05-15 Thread sakouhi
Hi, I'm newbie in apache camel. I configured a route from camel ftp to JMS topic. I noticed that the processed files, they are either deleted, moved either processed again and again. In my work, I have a lot of corrupt files that are loaded into HDFS, so I need to reentered the same files into FT

Re: Camel FTP: how to work with corrupt files.

2017-05-16 Thread sakouhi
Thanks for reply. I work on Big data project. Sometimes the FTP server receives an incomplete files. Then, I need to load them again. I no want to have a duplicate files into hdfs. I just need to load the new lines. I look for an option in FTP component that scan the new lines and send them to JM

Re: Camel FTP: how to work with corrupt files.

2017-05-16 Thread sakouhi
Thank you Sir, Another question please? is there a flume component in apache camel? I saw kafka, flink, ActiveMQ... I have 2 months trying to integrate apache camel with flume. I hope to find a possible way do to that. -- View this message in context: http://camel.465427.n5.nabble.co

filtering files based on their contents

2017-06-02 Thread sakouhi
Hi, I'm trying to configure a camel route that reads from file ( .csv or .xl3). An example of file: ClientA ClientB Start-time End-time DurationStatus 35862515 36958452 16/01/217 16/01/2017 10good 32456988 22583694 16/01/217 16/01/2017 05good 35968478

Parsing csv data format

2017-06-08 Thread sakouhi
I followed an example from a book Camel in action. how to marchal and unmarchal a csv data format. However, I want to unmarchal a csv files with (comma seperated delimiter) and split body. Then, I will use content based .choice to distribute messages according to required tasks. In fact, The first

Re: Parsing csv data format

2017-06-08 Thread sakouhi
Yes, the program locks the file (for example test\standard.csv.camelLock ), then it shut down. -- View this message in context: http://camel.465427.n5.nabble.com/Parsing-csv-data-format-tp5802566p5802568.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Parsing csv data format

2017-06-08 Thread sakouhi
The newest version of Camel requires Java 8. In my work, we use java 7. I followed the example into the book Camel in action which use camel version 2.5.0 -- View this message in context: http://camel.465427.n5.nabble.com/Parsing-csv-data-format-tp5802566p5802572.html Sent from the Camel - Use

Re: Parsing csv data format

2017-06-08 Thread sakouhi
Ok Thanks Allan, -- View this message in context: http://camel.465427.n5.nabble.com/Parsing-csv-data-format-tp5802566p5802575.html Sent from the Camel - Users mailing list archive at Nabble.com.