Hi all,
I process a lot of JSON files of different sizes. All files share the same
overall structure. I have no issue with files of sizes around 150-300MB.
Another file of around 530MB now causes errors when I apply selectExpr on the
resulting DF after reading the file.
AnalysisException:
Hi,
The spark job where we save a dataset to a give table using
exampledataset.saveAsTable() fails with the following error after upgrading
from spark 2.4 to spark 3.0
Exception in thread "main" org.apache.spark.sql.AnalysisException: Cannot
write incompatible data to table '':
- Cannot write
Hi Badrinath,
This is a very valid question.
The option of getting a ticket before being authorised is clearly not going
to work here as any authentication of that nature applies to the
environment where both Hive and Spark co-exist. So the question has to move
to how we can authenticate
Hi Mich,
Is there any possible way to connect Hive JDBC through Kerberos
Authentication Type in Spark JDBC?
https://docs.cloudera.com/runtime/7.2.2/securing-hive/topics/hive_remote_data_access.html.
Thanks,
Badrinath
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
