Unicode characters not recognizing when reading file

2016-04-13 Thread patelp7
Hi, I have defined my file URI as file:///?charset=UTF-8 and my route looks like below: from(file) .convertBodyTo(String.class,"UTF-8") .split(body().tokenize("\r\n|\n|\r")).streaming() .process(test) .en

Re: Unicode characters not recognizing when reading file

2016-04-13 Thread patelp7
Hi, I tried both solutions. My JVM default encoding is already set to UTF-8. I confirmed by printing System.getProperty("file.encoding"). I also changed my route to: from(file).marshal().string("UTF-8").split(body().tokenize("\r\n|\n|\r")).streaming() It's still converting the character to "?".

Re: Unicode characters not recognizing when reading file

2016-04-13 Thread patelp7
I guess my assumption was wrong. I removed tokenizing and its still not working :( -- View this message in context: http://camel.465427.n5.nabble.com/Unicode-characters-not-recognizing-when-reading-file-tp5781028p5781032.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Unicode characters not recognizing when reading file

2016-04-13 Thread patelp7
I changed my route to from(file).to("file:/?fileName=out.csv&fileExist=Append") It preserved the character. -- View this message in context: http://camel.465427.n5.nabble.com/Unicode-characters-not-recognizing-when-reading-file-tp5781028p5781036.html Sent from the Camel - Users mailing list ar

Re: Unicode characters not recognizing when reading file

2016-04-13 Thread patelp7
Not true exactly. It has to do with some camel component. I tried few things. 1) Route: file(from).split(body()).streaming().to(file) /This scenario preserves the character./ 2) Route: file(from).convertBodyTo(String.class,"UTF-8").split(body()).streaming().to(file) /This scenario converts the cha

Re: Unicode characters not recognizing when reading file

2016-04-14 Thread patelp7
I tried and it just doesnt work for me. As soon as I modify the body, either try to replace all /r/n with /n or convert the body to string or use the transform tag, the character is corrupted. I have attached the file if that's helpful. sample_data_export.csv

Re: Unicode characters not recognizing when reading file

2016-04-15 Thread patelp7
I figured the problem is converting from one charset to another. I realized that the file I am reading is in charset "US-ASCII" and then I am trying to convert it into "UTF-8" at which point the unicode character is lost. Any suggestions on how to fix it? -- View this message in context: http:/

camel-jdbc fetchSize out of memory error

2016-05-23 Thread patelp7
I am trying to ingest data from postgres to another DB and I am using camel-jdbc component to do it. I have a large table so I want to read few rows at a time instead of the whole table altogether. so my route looks like below (only for testing purpose) from(fromUri).setBody("select * from limit

Re: Strange issue with JDBC add Postgres

2016-05-23 Thread patelp7
Hi Tim, Can you possible provide me a snippet of what your route actually looks like with the workaround? I ran into same problem where my fetchsize is not working and I want to have a work around while still using camel. Thanks -- View this message in context: http://camel.465427.n5.nabble.co