I’m getting a FileAlreadyExistsException. I’ve tired setting the save to SaveMode.Overwrite, and setting spark.hadooop.validateOutputSpecs to false. However, I am wonder if these settings are being ignored, because I’m using Spark Streaming. We aren’t using checkpointing though. Here’s the stack trace: http://pastebin.com/AqBFXkga <http://pastebin.com/AqBFXkga>
Peter Halliday