Re: [VOTE] Release Spark 3.2.1 (RC1)

2022-01-13 Thread huaxin gao
The two regressions have been fixed. I will cut RC2 tomorrow late afternoon. Thanks, Huaxin On Wed, Jan 12, 2022 at 9:11 AM huaxin gao wrote: > Thank you all for testing and voting! > > I will -1 this RC because > https://issues.apache.org/jira/browse/SPARK-37855 and >

Seems like a bug in Spark dynamic allocation, numberMaxNeededExecutors value is negative in JMX exporter, which is unreasonable

2022-01-13 Thread 徐涛
Hi Experts: Seems like a bug in ExecutorAllocationManager, because numberMaxNeededExecutors value is negative in JMX exporter, which is unreasonable Spark Version is 3.1.1 And the following is the debug log, the numRunningOrPendingTasks get a negative value: 22/01/13 09:32:21

Re: Spark on Oracle available as an Apache licensed open source repo

2022-01-13 Thread Harish Butani
- happy to link to Apache Spark. Will add the link to the README - Sorry didn’t know about the trademark rules. Let me think about a name, though ‘Oracle Translator for Apache Spark’ sounds pretty good. regards, Harish. > On Jan 13, 2022, at 5:00 PM, Sean Owen wrote: > > -user > Thank you for

Re: Spark on Oracle available as an Apache licensed open source repo

2022-01-13 Thread Sean Owen
-user Thank you for this, but just a small but important point about the use of the Spark name. Please take a look at https://spark.apache.org/trademarks.html Specifically, this should reference "Apache Spark" at least once prominently with a link to the project. It's also advisable to avoid using

Spark on Oracle available as an Apache licensed open source repo

2022-01-13 Thread Harish Butani
Spark on Oracle is now available as an open source Apache licensed github repo . Build and deploy it as an extension jar in your Spark clusters. Use it to combine Apache Spark programs with data in your existing Oracle databases without expensive data