Re: SPIP: Catalog API for view metadata

2020-11-09 Thread Wenchen Fan
Moving back the discussion to this thread. The current argument is how to avoid extra RPC calls for catalogs supporting both table and view. There are several options: 1. ignore it as extra PRC calls are cheap compared to the query execution 2. have a per session cache for loaded table/view 3.

Re: [VOTE] Standardize Spark Exception Messages SPIP

2020-11-09 Thread Reynold Xin
Exciting & look forward to this! (And a late +1 vote that probably won't be counted) On Mon, Nov 09, 2020 at 2:37 PM, Allison Wang < allison.w...@databricks.com > wrote: > > > > Thanks everyone for voting! With 11 +1s and no -1s, this vote passes. > > > > +1s: > Mridul Muralidharan >

Re: [VOTE] Standardize Spark Exception Messages SPIP

2020-11-09 Thread Allison Wang
Thanks everyone for voting! With 11 +1s and no -1s, this vote passes. +1s: Mridul Muralidharan Angers Zhu Chandni Singh Eve Liao Matei Zaharia Kalyan Wenchen Fan Gengliang Wang Xiao Li Takeshi Yamamuro Herman van Hovell Thanks, Allison -- Sent from:

Adding uuid support

2020-11-09 Thread Denise Mauldin
Hello, When I run PySpark to save to a Postgresql database, I run into an error where uuid insert statements are not constructed properly. There are a lot of different questions on stackoverflow about the same issue.

Re: -Phadoop-provided still includes hadoop jars

2020-11-09 Thread Steve Loughran
On Mon, 12 Oct 2020 at 19:06, Sean Owen wrote: > I don't have a good answer, Steve may know more, but from looking at > dependency:tree, it looks mostly like it's hadoop-common that's at issue. > Without -Phive it remains 'provided' in the assembly/ module, but -Phive > causes it to come back

Re: [VOTE] Standardize Spark Exception Messages SPIP

2020-11-09 Thread Herman van Hovell
+1 On Mon, Nov 9, 2020 at 2:06 AM Takeshi Yamamuro wrote: > +1 > > On Thu, Nov 5, 2020 at 3:41 AM Xinyi Yu wrote: > >> Hi all, >> >> We had the discussion of SPIP: Standardize Spark Exception Messages at >> >>