Spark 3.2.1 parquet read error

2023-10-30 Thread Suryansh Agnihotri
Hello spark-dev I have loaded tpcds data in parquet format using spark *3.0.2* and while reading it from spark *3.2.1* , my query is failing with below error. Later I set spark.sql.parquet.enableVectorizedReader=false my but it resulted in a different error. I am also providing output of

Re: Spark ACID compatibility

2021-06-14 Thread Suryansh Agnihotri
h may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Mon, 14 Jun 2021 at 15:19, Suryansh Agnihotri > wrote: >

Re: Spark ACID compatibility

2021-06-14 Thread Suryansh Agnihotri
damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Mon, 14 Ju

Spark ACID compatibility

2021-06-14 Thread Suryansh Agnihotri
Hi Does spark support querying hive tables which are transactional? I am using spark 3.0.2 / hive metastore 3.1.2 and trying to query the table but I am not able to see the data from the table , although *show tables *does list the table from hive metastore and desc table works fine but *select *

beeline spark thrift server issue

2021-05-13 Thread Suryansh Agnihotri
Hi I was trying to access spark sql through jdbc but facing some error. I am trying to run beeline ! /usr/lib/spark/bin/beeline -u 'jdbc:hive2://host:10016/default;transportMode=binary' -e '' 2>&1| awk '{print}'|grep -i -e 'Connection refused' -e 'Invalid URL' -e 'Error: Could not open' Error: