Re: Questions about Fault tolerance of Spark

2015-07-11 Thread 牛兆捷
message From: 牛兆捷 Date:07-09-2015 04:19 (GMT-05:00) To: dev@spark.apache.org, u...@spark.apache.org Subject: Questions about Fault tolerance of Spark Hi All: We already know that Spark utilizes the lineage to recompute the RDDs when failure occurs. I want to study the performance

Re: Questions about Fault tolerance of Spark

2015-07-10 Thread MIKE HYNES
...@spark.apache.org /divdivSubject: Questions about Fault tolerance of Spark /divdiv /divHi All: We already know that Spark utilizes the lineage to recompute the RDDs when failure occurs. I want to study the performance of this fault-tolerant approach and have some questions about it. 1

Questions about Fault tolerance of Spark

2015-07-09 Thread 牛兆捷
Hi All: We already know that Spark utilizes the lineage to recompute the RDDs when failure occurs. I want to study the performance of this fault-tolerant approach and have some questions about it. 1) Is there any benchmark (or standard failure model) to test the fault tolerance of these kinds of