I opened https://github.com/apache/spark/pull/31461 to track the discussion
further. It narrowly proposes making a few types public.
On Mon, Feb 1, 2021 at 8:52 AM Fitch, Simeon wrote:
>
>
> On Mon, Feb 1, 2021 at 9:38 AM Sean Owen wrote:
>
>> I'm not hearing any objection to making it
Sending https://github.com/apache/spark/pull/31460Based my research so far, when there is there is an existingio.file.buffer.size in hive-site.xml, the hadoopConf finallly get reset by that. In many real-world cases, when interacting with hive catalog through Spark SQL,
Hi,
FYI, I have been using the project at
https://github.com/chermenin/spark-states
for a few months and it has been working well for me.
-Nico
--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
-
To
+1 for this work!
I agree with some clarifications below:
SQL is a somewhat different case. There are functions that aren't _that_ useful
in general, kind of niche, but nevertheless exist in other SQL systems, most
notably Hive. It's useful to try to expand SQL support to cover those to ease
