Ok there were issues in the past with the ORC table read through Spark. If the ORC table is created through Spark I believe it will work
Do a test. Create the ORC table through Spark first. Then do insert overwrite into that table through Hive cli from your Hive created ORC table and see if you can access data in the new table through Spark. HTH view my Linkedin profile <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On Mon, 14 Jun 2021 at 15:19, Suryansh Agnihotri <sagnihotri2...@gmail.com> wrote: > Table was created by hive (hive-cli) , format is orc. I am able to get > data from hive-cli (hive return rows). > But spark-sql/spark-shell does not return any rows. > > On Mon, 14 Jun 2021 at 19:26, Mich Talebzadeh <mich.talebza...@gmail.com> > wrote: > >> How the table was created in the first place, spark or Hive? >> >> Is this table an ORC table and does Spark or Hive return rows? >> >> HTH >> >> >> >> view my Linkedin profile >> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> >> >> >> >> *Disclaimer:* Use it at your own risk. Any and all responsibility for >> any loss, damage or destruction of data or any other property which may >> arise from relying on this email's technical content is explicitly >> disclaimed. The author will in no case be liable for any monetary damages >> arising from such loss, damage or destruction. >> >> >> >> >> On Mon, 14 Jun 2021 at 14:33, Suryansh Agnihotri < >> sagnihotri2...@gmail.com> wrote: >> >>> Hi >>> Does spark support querying hive tables which are transactional? >>> I am using spark 3.0.2 / hive metastore 3.1.2 and trying to query the >>> table but I am not able to see the data from the table , although *show >>> tables *does list the table from hive metastore and desc table works >>> fine but *select * from table* gives *empty result*. >>> Does the later version of spark have the fix or is there another way to >>> query? >>> Thanks >>> >>
