Re: --packages configuration equivalent item name?

2016-04-05 Thread Russell Jurney
OT/bin/pyspark $extraPkgs --conf >>> spark.cassandra.connection.host= >>> ec2-54-153-102-232.us-west-1.compute.amazonaws.com $* >>> >>> >>> >>> From: Russell Jurney <russell.jur...@gmail.com >>> <javascript:_e(%7B%7D,'cvml','russell.jur.

Re: --packages configuration equivalent item name?

2016-04-04 Thread Saisai Shao
ARK_PYTHON=python3 >> >> export PYSPARK_DRIVER_PYTHON=python3 >> >> IPYTHON_OPTS=notebook $SPARK_ROOT/bin/pyspark $extraPkgs --conf >> spark.cassandra.connection.host= >> ec2-54-153-102-232.us-west-1.compute.amazonaws.com $* >> >> >> >>

Re: --packages configuration equivalent item name?

2016-04-02 Thread Russell Jurney
xport PYSPARK_DRIVER_PYTHON=python3 > > IPYTHON_OPTS=notebook $SPARK_ROOT/bin/pyspark $extraPkgs --conf > spark.cassandra.connection.host= > ec2-54-153-102-232.us-west-1.compute.amazonaws.com $* > > > > From: Russell Jurney <russell.jur...@gmail.com> > Date: Sunday, M

Re: --packages configuration equivalent item name?

2016-03-28 Thread Andy Davidson
ail.com> Date: Sunday, March 27, 2016 at 7:22 PM To: "user @spark" <user@spark.apache.org> Subject: --packages configuration equivalent item name? > I run PySpark with CSV support like so: IPYTHON=1 pyspark --packages > com.databricks:spark-csv_2.10:1.4.0 > > I

--packages configuration equivalent item name?

2016-03-27 Thread Russell Jurney
I run PySpark with CSV support like so: IPYTHON=1 pyspark --packages com.databricks:spark-csv_2.10:1.4.0 I don't want to type this --packages argument each time. Is there a config item for --packages? I can't find one in the reference at http://spark.apache.org/docs/latest/configuration.html If