Am 11. März 2012 15:05 schrieb Emmanuel Bourg <ebo...@apache.org>: > Hi, > > I compared the performance of Commons CSV with the other CSV parsers > available. I took the world cities file from Maxmind as a test file [1], > it's a big file of 130M with 2.8 million records. > > Here are the results obtained on a Core 2 Duo E8400 after several iterations > to let the JIT compiler kick in: > > Direct read 750 ms > Java CSV 3328 ms > Super CSV 3562 ms (+7%) > OpenCSV 3609 ms (+8.4%) > GenJava CSV 3844 ms (+15.5%) > Commons CSV 4656 ms (+39.9%) > Skife CSV 4813 ms (+44.6%) > > I also tried Nuiton CSV and Esperio CSV but I couldn't figure how to use > them. > > I haven't analyzed why Commons CSV is slower yet, but it seems there is room > for improvements. The memory usage will have to be compared too, I'm looking > for a way to measure it. >
Hey Emmanuel, I have some spare time to help you with this. I'll check out the latest source tonight. Any suggestion where to start? Regards, Benedikt > > Emmanuel Bourg > > [1] http://www.maxmind.com/download/worldcities/worldcitiespop.txt.gz > --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@commons.apache.org For additional commands, e-mail: dev-h...@commons.apache.org
