Hi Chang, RDD/Dataframe is immutable and lazy computed. They are thread safe.
Thanks! On Tue, Nov 12, 2019 at 12:31 PM Chang Chen <baibaic...@gmail.com> wrote: > Hi all > > I meet a case where I need cache a source RDD, and then create different > DataFrame from it in different threads to accelerate query. > > I know that SparkSession is thread safe( > https://issues.apache.org/jira/browse/SPARK-15135), but i am not sure > whether RDD is thread safe or not > > Thanks >
