dongjoon-hyun commented on PR #45029: URL: https://github.com/apache/arrow/pull/45029#issuecomment-2859231442
To @kou and @abandy , as a user, I really appreciated your efforts on Apache Arrow. To @kou , > Will apache/spark-connect-swift use Apache Arrow Swift as a package when we release 21.0.0? As a member of Apache Spark PMC, I can say that Apache Spark community has no intention to duplicate Apache Arrow. I clearly mentioned in the following PR from the beginning when I started with 19.0.1. - https://github.com/apache/spark-connect-swift/pull/6 Apache Spark community uses only the committed Apache Arrow codebase. To be honest, I'd been evaluating and waiting for Apache Arrow for a long time than you expected, but it didn't meet my expectation. There are a few reasons why we couldn't start as a package consumer. The most important thing is the lack of Swift 6 support. In addition, some instability in Linux environments (due to the potential data race). I started inevitably as `Spark Connect Swift Client` as `v0.1` because Apache Spark 4.0 is already RC4. In the end, I hope and I will remove all copied content from Apache Spark repository when Apache Arrow Swift is ready to be used directly. To @abandy , - Sorry for making you confused. Although I'm as a ASF member and Apache Spark PMC member, I'm just a user in Apache Arrow community. I just tested your PR and approved it as an audience. - I'm wondering if we have a roadmap or ETA for the remaining development. For example, `list` type support? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
