Re: [VOTE] Release Apache Spark 3.5.0 (RC2)

2023-08-20 Thread yangjie01
-1, due to SPARK-43646 and SPARK-44784 not yet being fixed. Jie Yang 发件人: Sean Owen 日期: 2023年8月20日 星期日 04:43 收件人: Yuanjian Li 抄送: Spark dev list 主题: Re: [VOTE] Release Apache Spark 3.5.0

Probable Bug in Spark 3.3.0

2023-08-20 Thread Dipayan Dev
Hi Dev Team, https://issues.apache.org/jira/browse/SPARK-44884 We have recently upgraded to Spark 3.3.0 in our Production Dataproc. We have a lot of downstream application that relies on the SUCCESS file. Please let me know if this is a bug or I need to any additional configuration to fix this

Unsubscribe

2023-08-20 Thread Dennis Suhari
Unsubscribe Von meinem iPhone gesendet - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: Dynamic resource allocation for structured streaming [SPARK-24815]

2023-08-20 Thread Pavan Kotikalapudi
IMO ML might be good for cluster scheduler but for the core DRA algorithm of SSS I believe we should start with some primitives of Structured streaming. I would love to get some reviews on the doc and opinions on the feasibility of the solution. We have seen quite some savings using this solution