Re: 61M csv file cause Heap error on JVM with 1 GB limit

2017-05-22 Thread brent-e2
Thanks for the reply. I'm posting the solution here in case anybody else falls into the same trap I did: My route is splitting the file on Windows/Dos line-endings CR-LF. My input file had Unix (LF) line-endings, though. I believe that was why the route was trying to process the entire file at

61M csv file cause Heap error on JVM with 1 GB limit

2017-05-21 Thread brent-e2
I'm new to Camel, but have followed advice on various fora to produce the below route: Picks up a csv file, splits into lines and unmarshals each line into a Map to be inserted into a database, as named parameters. The route works (database gets updated), when I use a subset of data (up to 30,00