Ruifeng Zheng created SPARK-61457:
-------------------------------------

             Summary: Improve Python Column access performance with PyO3 frozen
                 Key: SPARK-61457
                 URL: https://issues.apache.org/jira/browse/SPARK-61457
             Project: Spark
          Issue Type: Improvement
          Components: Connect
    Affects Versions: connect-rust-4.3.0
            Reporter: Ruifeng Zheng


Mark the PySpark Column PyO3 class as frozen. Column has no mutable Rust 
access, so this declares the existing invariant and allows PyO3 to use cheaper 
immutable access. Python 3.13 release-mode microbenchmarks show about 4-6% 
faster direct Column payload access and extraction.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to