Thank you for your reply Akhil!
Here is an example of the script that we are using:
https://gist.github.com/wasauce/40f3350c1a110e5cef1c
Any pointers would be very helpful.
Best,
- Bill
On Thu, Jun 25, 2015 at 2:03 AM, Akhil Das
wrote:
> That totally depends on the way you extract the data.
That totally depends on the way you extract the data. It will be helpful if
you can paste your code so that we will understand it better.
Thanks
Best Regards
On Wed, Jun 24, 2015 at 2:32 PM, William Ferrell wrote:
> Hello -
>
> I am using Apache Spark 1.2.1 via pyspark. Thanks to any developers
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Killing-Long-running-tasks-stragglers-tp23485.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e
Hello -
I am using Apache Spark 1.2.1 via pyspark. Thanks to any developers here
for the great product!
In my use case, I am running spark jobs to extract data from some raw data.
Generally this works quite well.
However, I am noticing that for certain data sets there are certain tasks
that are
