Re: PySpark TaskContext

2016-11-24 Thread Holden Karau
gt;>>>> >>>>> On Thu, Nov 24, 2016 at 1:39 AM, ofer wrote: >>>>> >>>>>> Hi, >>>>>> Is there a way to get in PYSPARK something like TaskContext from a >>>>>> code >>>>>

Re: PySpark TaskContext

2016-11-24 Thread Ofer Eliassaf
4, 2016 at 1:39 AM, ofer wrote: >>>> >>>>> Hi, >>>>> Is there a way to get in PYSPARK something like TaskContext from a code >>>>> running on executor like in scala spark? >>>>> >>>>> If not - how can i kn

Re: PySpark TaskContext

2016-11-24 Thread Holden Karau
gt;>> >>> On Thu, Nov 24, 2016 at 1:39 AM, ofer wrote: >>> >>>> Hi, >>>> Is there a way to get in PYSPARK something like TaskContext from a code >>>> running on executor like in scala spark? >>>> >>>> If not -

Re: PySpark TaskContext

2016-11-24 Thread Holden Karau
ala spark? >>> >>> If not - how can i know my task id from inside the executors? >>> >>> Thanks! >>> >>> >>> >>> -- >>> View this message in context: http://apache-spark-user-list. >>> 100156

Re: PySpark TaskContext

2016-11-24 Thread Ofer Eliassaf
ks! >> >> >> >> -- >> View this message in context: http://apache-spark-user-list. >> 1001560.n3.nabble.com/PySpark-TaskContext-tp28125.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> -

Re: PySpark TaskContext

2016-11-24 Thread Holden Karau
t: http://apache-spark-user-list. > 1001560.n3.nabble.com/PySpark-TaskContext-tp28125.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe e-mail: user-unsubscr...@

PySpark TaskContext

2016-11-24 Thread ofer
Hi, Is there a way to get in PYSPARK something like TaskContext from a code running on executor like in scala spark? If not - how can i know my task id from inside the executors? Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/PySpark-TaskContext