Hi, i have a next question:|val data = sc.textFile("s3:///") val df = data.toDF df.saveAsParquetFile("hdfs://") df.someAction(...) |
if during someAction some workers would die, would recomputation download files from s3 or from hdfs parquet?
Thanks, Peter Rudenko