Note the --packages option works for both PySpark and Spark (Scala). For the SparkLauncher class, you should be able to include packages ala:
spark.addSparkArg("--packages", "graphframes:0.5.0-spark2.0-s_2.11") On Sun, Feb 18, 2018 at 3:30 PM xiaobo <guxiaobo1...@qq.com> wrote: > Hi Denny, > The pyspark script uses the --packages option to load graphframe library, > what about the SparkLauncher class? > > > > ------------------ Original ------------------ > *From:* Denny Lee <denny.g....@gmail.com> > *Date:* Sun,Feb 18,2018 11:07 AM > *To:* 94035420 <guxiaobo1...@qq.com> > *Cc:* user@spark.apache.org <user@spark.apache.org> > *Subject:* Re: Does Pyspark Support Graphx? > That’s correct - you can use GraphFrames though as it does support > PySpark. > On Sat, Feb 17, 2018 at 17:36 94035420 <guxiaobo1...@qq.com> wrote: > >> I can not find anything for graphx module in the python API document, >> does it mean it is not supported yet? >> >