Re: Unable to handle bignumeric datatype in spark/pyspark

2023-02-25 Thread Mich Talebzadeh
sounds like it is cosmetric. The important point is that if the data stored in GBQ is valid? THT view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all

Re: Unable to handle bignumeric datatype in spark/pyspark

2023-02-25 Thread Rajnil Guha
Hi All, I had created an issue on Stackoverflow(linked below) a few months back about issues while handling bignumeric type values of BigQuery in Spark. link On Fri,

Late arriving updates to fact tables

2023-02-25 Thread rajat kumar
Hi Users, We are getting updates in Kafka Topic(Through CDC). Can you please tell how do I correct/replay/reprocess the late arriving records in Data lake? Thanks Rajat