Re: 回复: [DISCUSS] Apache Spark 3.0.1 Release

2020-08-13 Thread Jason Moore
Thank you so much! Any update on getting the RC1 up for vote? Jason. From: 郑瑞峰 Sent: Wednesday, 5 August 2020 12:54 PM To: Jason Moore ; Spark dev list Subject: 回复: [DISCUSS] Apache Spark 3.0.1 Release Hi all, I am going to prepare the realease of 3.0.1 RC1

Re: [DISCUSS] Apache Spark 3.0.1 Release

2020-07-29 Thread Jason Moore
Hi all, Discussion around 3.0.1 seems to have trickled away. What was blocking the release process kicking off? I can see some unresolved bugs raised against 3.0.0, but conversely there were quite a few critical correctness fixes waiting to be released. Cheers, Jason. From: Takeshi Yamamuro

Re: [DISCUSS] Apache Spark 3.0.1 Release

2020-06-30 Thread Jason Moore
Hi all, Could I get some input on the severity of this one that I found yesterday? If that’s a correctness issue, should it block this patch? Let me know under the ticket if there’s more info that I can provide to help. https://issues.apache.org/jira/browse/SPARK-32136 Thanks, Jason. From:

Sorting within partitions is not maintained in parquet?

2016-08-10 Thread Jason Moore
Hi, It seems that something changed between Spark 1.6.2 and 2.0.0 that I wasn't expecting. If I have a DataFrame with records sorted within each partition, and I write it to parquet and read back from the parquet, previously the records would be iterated through in the same order they were wri