Twitter + Aggregation: Out of Memory errors

2014-10-13 Thread Andreas C. Osowski
Hey there. I'm running into "OOM: Java heap space" exceptions trying to aggregate twitter messages before pushing them to s3. (Xmx/Xms = 1.5g; there's definitely sufficient free memory available when the exceptions happen) I've also tried to use camel-leveldb as the AggregationRepository but withou

Re: Twitter + Aggregation: Out of Memory errors

2014-10-14 Thread Andreas C. Osowski
gt; is OK. > > > > BTW, you can always using write the stream into to file to avoid load > the whole message > > into memory. > > > > -- > > Willem Jiang > > > > Red Hat, Inc. > > Web: http://www.redhat.com > > Blog: http://willemjiang.b

Re: Twitter + Aggregation: Out of Memory errors

2014-10-14 Thread Andreas C. Osowski
t.com (English) > http://jnn.iteye.com (Chinese) > Twitter: willemjiang > Weibo: 姜宁willem > > > > On October 14, 2014 at 4:09:39 PM, Andreas C. Osowski ( > andreas.chr.osow...@gmail.com) wrote: > > Thanks for the reply. I also came to that conclusion eventually. Ho