Re: Spark Scala reading from Google Cloud BigQuery table throws error

Thanks Sam. Looks interesting. I will have a look in details and let you know. Best, Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *

Re: Spark Scala reading from Google Cloud BigQuery table throws error

Hi Mich I wrote a connector to make it easier to connect Bigquery and Spark Have a look here https://github.com/samelamin/spark-bigquery/ Your feedback is always welcome Kind Regards Sam On Tue, Dec 18, 2018 at 7:46 PM Mich Talebzadeh wrote: > Thanks Jorn. I will try that. Requires

Re: Spark Scala reading from Google Cloud BigQuery table throws error

Thanks Jorn. I will try that. Requires installing sbt etc on ephemeral compute server in Google Cloud to built an uber jar file. Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Spark Scala reading from Google Cloud BigQuery table throws error

Maybe the guava version in your spark lib folder is not compatible (if your Spark version has a guava library)? In this case i propose to create a fat/uber jar potentially with a shaded guava dependency. > Am 18.12.2018 um 11:26 schrieb Mich Talebzadeh : > > Hi, > > I am writing a small test

Spark Scala reading from Google Cloud BigQuery table throws error

Hi, I am writing a small test code in spark-shell with attached jar dependencies spark-shell --jars