I would suppose it will be at least 2.17. Whatever is needed to resolve
recent security issues. There is no release date for 3.3.0 yet. Probably
within a few months.
On Mon, Dec 20, 2021, 10:46 PM Chintan Mohan Rohila
wrote:
> Hi,
>
> I see that under JIRA:
Hi,
I see that under JIRA: https://issues.apache.org/jira/browse/SPARK-6305
support for log4j 2.x to Spark in release 3.3.0
I need to know what version of log4j 2 will be bundled and what is the
release date of 3.3.0, so that we can plan to integrate it in our product?
Any help is highly
Happy Holidays
I am a newbie
I have 16,000 data files, all files have the same number of rows and columns.
The row ids are identical and are in the same order. I want to create a new
data frame that contains the 3rd column from each data file. My pyspark script
runs correctly when I test on
Hi Anil,
To recap: Apache Spark plugins are an interface and configuration that allows
to inject code on executor start-up and, among others, provide a hook to the
Spark metrics system. This provides a way to extend metrics collection beyond
what is available in Apache Spark.
