unsubscribe

2019-12-07 Thread Deepak Sharma

[pyspark 2.4.0] write with overwrite mode fails

2019-12-07 Thread Rishi Shah
Hi All, df = spark.read.csv(PATH) spark.conf.set('spark.sql.sources.partitionOverwriteMode', 'dynamic') df.repartition(col1, col2).write.mode('overwrite').partitionBy('col1').parquet(OUT_PATH) works fine and overwrites the partitioned directory as expected. However this doesn't overwrite when pr

Unsubscribe

2019-12-07 Thread gopal kulkarni

unsubscribe

2019-12-07 Thread Alex Pajaron
unsubscribe