The latest test show saxon to be twice as fast on a single partition. Each program spends ~70% of the time in the parsing phase. The percentage holds true for filter and aggregate queries we are testing.
The profiler does not show one specific area that is slow. Rather it highlights many functions with smaller time components. Basically speeding up the process will take modification to many functions with minor improvements. The one area that could be worth looking at would be the ArrayBackValueStorage. The process would require rewriting a java library and could be a concern with software intellectual property. I realized I have been using old numbers for saxon and they may have been run on another machine. So here are updated numbers. I included the average query time in addition to the whole execution time. Whole Execution Time (start up, compile, 10 queries executed) Time in minutes and seconds. Query q00 (500mb) --------------- 1m46.150s Saxon 3m23.631s VXQuery - 1 partition 1m48.651s VXQuery - 2 partitions 1m18.325s VXQuery - 4 partitions Query q01 (500mb) --------------- 1m40.378s Saxon 3m33.476s VXQuery - 1 partition 1m47.740s VXQuery - 2 partitions 1m11.582s VXQuery - 4 partitions Query q02 (500mb) --------------- 1m39.073s Saxon 3m59.144s VXQuery - 1 partition 1m55.534s VXQuery - 2 partitions 1m20.533s VXQuery - 4 partitions Query q03 (500mb) --------------- 1m33.257s Saxon 3m29.877s VXQuery - 1 partition 1m50.296s VXQuery - 2 partitions 1m15.348s VXQuery - 4 partitions Average Execution time (average of 4-10 queries executed) Time in milliseconds. Query q00 (500mb) --------------- 9,741ms Saxon 18,638ms VXQuery - 1 partition 9,744ms VXQuery - 2 partitions 7,221ms VXQuery - 4 partitions Query q01 (500mb) --------------- 9,741ms Saxon 18,491ms VXQuery - 1 partition 9,749ms VXQuery - 2 partitions 6,342ms VXQuery - 4 partitions Query q02 (500mb) --------------- 9,395ms Saxon 21,136ms VXQuery - 1 partition 10,445ms VXQuery - 2 partitions 7,057ms VXQuery - 4 partitions Query q03 (500mb) --------------- 8,904ms Saxon 19,228ms VXQuery - 1 partition 9,927ms VXQuery - 2 partitions 6,610ms VXQuery - 4 partitions
