Re: [VOTE] Release Spark 3.2.2 (RC1)

I noticed that `TimestampNTZ` is intentionally hidden from the doc. https://github.com/apache/spark/pull/35313#issuecomment-1185194701 So, it's better to remove notes about TimestampNTZ from the doc. But I don't think this issue is not a blocker, so +1 on this RC. Kousuke Hi Bruce, FYI we

Re: [VOTE] Release Spark 3.2.2 (RC1)

Hi Bruce, FYI we had further discussions on https://github.com/apache/spark/pull/35313#issuecomment-1185195455. Thanks for pointing that out, but this document issue should not be a blocker of the release. +1 on the RC. Gengliang On Thu, Jul 14, 2022 at 10:22 PM sarutak wrote: > Hi Dongjoon

Re: [VOTE] Release Spark 3.2.2 (RC1)

Hi Dongjoon and Bruce, SPARK-36724 is about SessionWindow, while SPARK-38017 and PR #35313 are about TimeWindow, and TimeWindow already supports TimestampNTZ in v3.2.1.

Re: [VOTE] Release Spark 3.2.2 (RC1)

Thank you so much, Bruce. After SPARK-36724 landed at Spark 3.3.0, SPARK-38017 seems to land at branch-3.2 mistakenly here. https://github.com/apache/spark/pull/35313 I believe I can remove those four places after uploading the docs to our website. Dongjoon. On Thu, Jul 14, 2022 at 2:16 PM

Re: [VOTE] Release Spark 3.2.2 (RC1)

A small thing. The function API doc (here ) claims that the window function accepts a timeColumn of TimestampType or TimestampNTZType. The update to the API doc was made since v3.2.1.

Re: [DISCUSS][Catalog API] Deprecate 4 Catalog API that takes two parameters which are (dbName, tableName/functionName)

There were some extra discussions that happened at https://github.com/apache/spark/pull/37105. As of now we agreed to have a "soft deprecation" that 1. document the limitation of four API and suggest to use alternatives in the API doc 2. do not use the @deprecation annotation. Please let us know

Looking for Review for SPARK-39091

Hello, I am not sure if this is the best place to ask but I submitted a PR for SPARK-39091 sometime ago and was wondering if anyone with write access has the bandwidth to review my work? This is the PR: https://github.com/apache/spark/pull/36441 Thanks, Neil

Re: [VOTE] Release Spark 3.2.2 (RC1)

+1 (non-binding) On Thu, Jul 14, 2022 at 12:40 AM Wenchen Fan wrote: > > +1 > > On Wed, Jul 13, 2022 at 7:29 PM Yikun Jiang wrote: >> >> +1 (non-binding) >> >> Checked out tag and built from source on Linux aarch64 and ran some basic >> test. >> >> >> Regards, >> Yikun >> >> >> On Wed, Jul 13,

Spark-39755 Review/comment

Hi Dev community Please review/comment https://issues.apache.org/jira/browse/SPARK-39755 Regards Pralabh kumar

Re: [SPARK-39515] Improve scheduled jobs in GitHub Actions

With the help from the community, the cache based job switch has been completed! * About the ghcr images: You might notice that two images are generated in apache ghcr: - Image cache: spark/apache-spark-github-action-image-cache

Re: [VOTE] Release Spark 3.2.2 (RC1)

+1 On Wed, Jul 13, 2022 at 7:29 PM Yikun Jiang wrote: > +1 (non-binding) > > Checked out tag and built from source on Linux aarch64 and ran some basic > test. > > > Regards, > Yikun > > > On Wed, Jul 13, 2022 at 5:54 AM Mridul Muralidharan > wrote: > >> >> +1 >> >> Signatures, digests, etc

How to set platform-level defaults for array-like configs?

Hi Spark devs, Spark contains a bunch of array-like configs (comma separated lists). Some examples include `spark.sql.extensions`, `spark.sql.queryExecutionListeners`, `spark.jars.repositories`, `spark.extraListeners`, `spark.driver.extraClassPath` and so on (there are a dozen or so more). As