.
From: Alfredo Marquez
Sent: Friday, November 22, 2019 4:26:49 PM
To: user@spark.apache.org
Subject: Re: SparkR integration with Hive 3 spark-r
Does anyone else have some insight to this question?
Thanks,
Alfredo
On Mon, Nov 18, 2019, 3:00 PM Alfredo Marquez
Does anyone else have some insight to this question?
Thanks,
Alfredo
On Mon, Nov 18, 2019, 3:00 PM Alfredo Marquez
wrote:
> Hello Nicolas,
>
> Well the issue is that with Hive 3, Spark gets it's own metastore,
> separate from the Hive 3 metastore. So how do you reconcile this
> separation of
Hello Nicolas,
Well the issue is that with Hive 3, Spark gets it's own metastore, separate
from the Hive 3 metastore. So how do you reconcile this separation of
metastores?
Can you continue to "enableHivemetastore" and be able to connect to Hive 3?
Does this connection take advantage of Hive's
Hi Alfredo
my 2 cents:
To my knowlegde and reading the spark3 pre-release note, it will handle
hive metastore 2.3.5 - no mention of hive 3 metastore. I made several
tests on this in the past[1] and it seems to handle any hive metastore
version.
However spark cannot read hive managed table AKA
Hello,
Our company is moving to Hive 3, and they are saying that there is no
SparkR implementation in Spark 2.3.x + that will connect to Hive 3. Is
this true?
If it is true, will this be addressed in the Spark 3 release?
I don't use python, so losing SparkR to get work done on Hadoop is a huge
