Hi Have anyone experienced problem with uploading to s3 with s3n protocol with spark newHadoopApi, when job completes successfully(there is _SUCCESS marker), but in reality one of the parts of the file is missing ? Thanks in advance
ps: we are trying s3a now(which needs upgrade to hadoop2.7) -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/missing-part-of-the-file-while-using-newHadoopApi-tp23318.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
