Hi, Currently we are using HDFS for our checkpointing but we are having issues maintaining a HDFS cluster.
We tried glusterfs in the past for checkpointing but in our setup glusterfs does not work well. We are evaluating using Cassandra for storing the checkpoint data. Has any one implemented *StateStoreProvider* any blogs or articles which describe how to create our own *checkpointing* implementation Thanks -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org