dongjoon-hyun opened a new pull request, #517: URL: https://github.com/apache/spark-connect-swift/pull/517
### What changes were proposed in this pull request? This PR aims to support the following 15 misc metadata functions by adding a new `MiscFunctions.swift` file. | Function | Since (Apache Spark) | | -------- | -------------------- | | `monotonically_increasing_id()`, `spark_partition_id()`, `input_file_name()` | 1.6.0 | | `input_file_block_start()`, `input_file_block_length()` | 3.5.0 | | `current_catalog()`, `current_database()`, `current_schema()` | 3.5.0 | | `current_user()`, `user()`, `version()`, `typeof(col)`, `uuid()` | 3.5.0 | | `session_user()` | 4.0.0 | | `uuid(seed)` | 4.1.0 | | `current_path()` | 4.2.0 | Note that `uuid()` is sent without any argument like PySpark's `sf.uuid()` does, so that it keeps working against Apache Spark 4.0 servers. ### Why are the changes needed? To improve the API coverage. These functions expose session, partition, and file metadata, and none of them was available in this client before. ### Does this PR introduce _any_ user-facing change? No, this is a new addition to the public API. ```swift let df = try await spark.range(1) try await df.select(current_catalog(), current_database(), version()).show() ``` ### How was this patch tested? Pass the CIs with newly added test cases. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Opus 5 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
