sandugood commented on PR #1853: URL: https://github.com/apache/datafusion-ballista/pull/1853#issuecomment-4758778865
Refactored the code and placed it inside the `PartitionLocationExt` .proto spec. Seemed like a good reason to save some bytes here and there. However, by running the same Q-2 query on TPCH SF-2 - `cargo run --bin tpch -- benchmark ballista -p /home/sandu/datafusion-ballista/data -f parquet -i 1 --port 50050 --host 127.0.0.1 -c datafusion.execution.target_partitions=512 -q 2` Got: `Error, decoded message length too large: found 18834462 bytes, the limit is: 16777216 bytes` Saved 100k (comparing to previous test report) by this change, but couldn't fit it inside the default threshold. cc @milenkovicm @coderfender -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
