Re: Unable to handle bignumeric datatype in spark/pyspark

Hi Rajnil, Sorry for the multiple emails. It seems you are getting the ModuleNotFoundError error was curious, have you tried using the below-mentioned solution mentioned in the readme file? Below is the link:- https://github.com/GoogleCloudDataproc/spark-bigquery-connector#bignumeric-support

Re: Unable to handle bignumeric datatype in spark/pyspark

Hi Rajnil, Just curious, what version of spark-bigquery-connector are you using? Thanks, Atheeth On Sat, 25 Feb 2023 at 23:48, Mich Talebzadeh wrote: > sounds like it is cosmetric. The important point is that if the data > stored in GBQ is valid? > > > THT > > >view my Linkedin profile >

Re: Unable to handle bignumeric datatype in spark/pyspark

sounds like it is cosmetric. The important point is that if the data stored in GBQ is valid? THT view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all

Re: Unable to handle bignumeric datatype in spark/pyspark

Hi All, I had created an issue on Stackoverflow(linked below) a few months back about issues while handling bignumeric type values of BigQuery in Spark. link On Fri,

Re: Unable to handle bignumeric datatype in spark/pyspark

Hi Nidhi, can you create a BigQuery table with a bignumeric and numeric column types, add a few lines and try to read into spark. through DF and do df.printSchema() df.show(5,False) HTH view my Linkedin profile

Unable to handle bignumeric datatype in spark/pyspark

Hello, I am facing below issue in pyspark code: We are running spark code using dataproc serverless batch in google cloud platform. Spark code is causing issue while writing the data to bigquery table. In bigquery table , few of the columns have datatype as bignumeric and spark code is changing