alamb commented on PR #10037: URL: https://github.com/apache/arrow-rs/pull/10037#issuecomment-4579554386
https://github.com/apache/arrow-rs/pull/10037#issuecomment-4577614661 Those look like nice improvements for list writing 🚀 ``` group main minor-optimize-batching ----- ---- ----------------------- ... list_primitive/bloom_filter 1.09 354.3±1.16ms 1539.3 MB/sec 1.00 326.3±1.15ms 1671.4 MB/sec list_primitive/cdc 1.11 372.2±9.28ms 1465.2 MB/sec 1.00 334.8±9.19ms 1629.1 MB/sec list_primitive/default 1.14 275.6±3.64ms 1978.7 MB/sec 1.00 242.8±10.96ms 2.2 GB/sec list_primitive/parquet_2 1.15 296.4±0.46ms 1839.7 MB/sec 1.00 258.0±6.18ms 2.1 GB/sec list_primitive/zstd 1.06 514.8±2.45ms 1059.5 MB/sec 1.00 486.1±2.77ms 1122.0 MB/sec list_primitive/zstd_parquet_2 1.07 499.6±0.47ms 1091.6 MB/sec 1.00 468.5±5.80ms 1164.1 MB/sec list_primitive_non_null/bloom_filter 1.05 442.2±10.12ms 1230.7 MB/sec 1.00 421.6±8.76ms 1290.8 MB/sec list_primitive_non_null/cdc 1.06 435.1±10.09ms 1250.9 MB/sec 1.00 409.8±7.44ms 1328.1 MB/sec list_primitive_non_null/default 1.08 308.4±13.91ms 1764.7 MB/sec 1.00 284.4±13.46ms 1913.9 MB/sec list_primitive_non_null/parquet_2 1.23 357.1±4.16ms 1524.1 MB/sec 1.00 290.7±34.74ms 1872.1 MB/sec list_primitive_non_null/zstd 1.01 697.5±13.36ms 780.3 MB/sec 1.00 690.0±18.66ms 788.8 MB/sec list_primitive_non_null/zstd_parquet_2 1.07 710.4±18.01ms 766.1 MB/sec 1.00 664.5±1.92ms 819.0 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 10.9±0.05ms 3.4 GB/sec 1.19 13.0±0.04ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 22.7±0.11ms 1645.6 MB/sec 1.09 24.7±0.07ms 1510.1 MB/sec list_primitive_sparse_99pct_null/default 1.00 10.6±0.08ms 3.5 GB/sec 1.21 12.8±0.65ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 10.6±0.12ms 3.4 GB/sec 1.19 12.7±0.02ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 12.5±0.11ms 2.9 GB/sec 1.16 14.5±0.03ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 10.8±0.08ms 3.4 GB/sec 1.18 12.8±0.03ms 2.8 GB/sec ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
