Re: [VOTE] Release Spark 3.2.2 (RC1)

2022-07-14 Thread Bruce Robbins
A small thing. The function API doc (here ) claims that the window function accepts a timeColumn of TimestampType or TimestampNTZType. The update to the API doc was made since v3.2.1.

mvn auto-downloading on fresh clone

2021-04-21 Thread Bruce Robbins
Is it just me, or does the auto-download of maven on a fresh Spark clone no longer work? It looks like https://www.apache.org/dyn/closer.lua?action=download= is not functioning anymore (or for the moment) for any piece of Apache software. I noted this in

Re: Hive Hash in Spark

2019-05-07 Thread Bruce Robbins
Mildly off-topic: >From a *correctness* perspective only, it seems Spark can read bucketed Hive tables just fine. I am ignoring the fact that Spark doesn't take advantage of the bucketing. Is that a fair assessment? Or is it more complicated than that? Also, Spark has code to prevent an

Re: Dataset schema incompatibility bug when reading column partitioned data

2019-04-11 Thread Bruce Robbins
I see a Jira: https://issues.apache.org/jira/browse/SPARK-21021 On Thu, Apr 11, 2019 at 9:08 AM Dávid Szakállas wrote: > +dev for more visibility. Is this a known issue? Is there a plan for a fix? > > Thanks, > David > > Begin forwarded message: > > *From: *Dávid Szakállas > *Subject:

PR tests not running?

2019-02-26 Thread Bruce Robbins
Sorry for stating what is likely obvious, but PR tests don't appear to be running. Last one started was around 2AM.

Re: [VOTE] SPIP: Standardize SQL logical plans

2018-07-18 Thread Bruce Robbins
+1 (non-binding) On Tue, Jul 17, 2018 at 10:59 AM, Ryan Blue wrote: > Hi everyone, > > From discussion on the proposal doc and the discussion thread, I think we > have consensus around the plan to standardize logical write operations for > DataSourceV2. I would like to call a vote on the