Ruifeng Zheng created SPARK-61457:
-------------------------------------
Summary: Improve Python Column access performance with PyO3 frozen
Key: SPARK-61457
URL: https://issues.apache.org/jira/browse/SPARK-61457
Project: Spark
Issue Type: Improvement
Components: Connect
Affects Versions: connect-rust-4.3.0
Reporter: Ruifeng Zheng
Mark the PySpark Column PyO3 class as frozen. Column has no mutable Rust
access, so this declares the existing invariant and allows PyO3 to use cheaper
immutable access. Python 3.13 release-mode microbenchmarks show about 4-6%
faster direct Column payload access and extraction.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]