tadeja commented on PR #49189: URL: https://github.com/apache/arrow/pull/49189#issuecomment-3874689994
@kou speeding up jobs would be best, indeed! I've been checking Build and why `ccache` almost never retrieves for macOS 15-intel - as it gets evicted due to the [10 GB repo-wide cache limit.](https://docs.github.com/en/actions/reference/workflows-and-actions/dependency-caching#usage-limits-and-eviction-policy) `Cache not found for input keys: python-ccache-macos-15-intel-` I see [just around 7 successful completions in February](https://github.com/apache/arrow/actions/workflows/python.yml) [example A ](https://github.com/apache/arrow/actions/runs/21741692681/job/62809010441#step:8:47) and [example B with ccache](https://github.com/apache/arrow/actions/runs/21781218926/job/62845471494#step:8:54) (Perhaps using `sccache` for macOS could be an option?) I will check Test phase and profiling options next. For now I've added ["--durations=20 -v" on pytest](https://github.com/apache/arrow/actions/runs/21845968406/job/63041765523?pr=49189#step:10:5092) Locally on M1 I get pytest finished in 86.44s (0:01:26) and the following test duration for comparison: ``` =========================================== slowest 20 durations ============================================ 5.91s call tests/test_fs.py::test_s3_options[builtin_pickle] 5.90s call tests/test_fs.py::test_s3_options[cloudpickle] 4.67s call tests/test_cython.py::test_cython_api 3.80s call tests/test_extension_type.py::test_cpp_extension_in_python 3.76s call tests/test_cython.py::test_visit_strings 2.95s call tests/test_dataset.py::test_write_dataset_with_backpressure 1.66s call tests/test_csv.py::TestThreadedCSVTableRead::test_cancellation 1.47s call tests/test_fs.py::test_s3_real_aws_region_selection 1.08s call tests/test_io.py::test_compression_level[zstd] 1.06s call tests/test_csv.py::TestSerialCSVTableRead::test_cancellation 1.02s call tests/test_pandas.py::test_is_data_frame_race_condition 0.97s call tests/test_fs.py::test_s3_finalize 0.66s call tests/parquet/test_metadata.py::test_table_large_metadata 0.64s call tests/test_pandas.py::TestConvertMisc::test_threaded_conversion_multiprocess 0.60s call tests/test_fs.py::test_s3fs_wrong_region 0.60s call tests/test_fs.py::test_s3_finalize_region_resolver 0.58s call tests/test_fs.py::test_concurrent_s3fs_init 0.50s call tests/test_fs.py::test_s3_real_aws 0.48s call tests/test_ipc.py::test_read_year_month_nano_interval 0.46s call tests/test_pandas.py::test_threaded_pandas_import ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
