Vijay Gaikwad
University of Washington
vijay...@uw.edu
On Nov 29, 2013, at 9:35 AM, Matteo Ceccarello
wrote:
> Hi all,
>
> I’m experiencing the following issue with spark 0.8.0-incubating. I’m running
> spark in local mode on a multicore machine. As long as I use up to 16
running seamlessly without halts on multiple cores. Although it throws
“TooManyFileOpen exception” if I increase the number of cores beyond 4.
Still I will try running the jstack on the process, especially the one which
gets stuck.
Thx
Vijay Gaikwad
University of Washington MSIM
vijay
e:
> How about memory usage, any GC problem? When you mention get stuck, you
> mean 0% or 1200% CPU while no progress?
>
> Raymond
>
> From: Vijay Gaikwad [mailto:vijay...@gmail.com]
> Sent: Wednesday, November 27, 2013 2:54 PM
> To: user@spark.incubator.apache.org
> Su
and reduce operations. I am sufficient 100GB ram.
Any thoughts?
Vijay Gaikwad
University of Washington MSIM
vijay...@gmail.com
(206) 261-5828
On Nov 25, 2013, at 11:43 AM, Patrick Wendell wrote:
> When it gets stuck, what does it show in the web UI? Also, can you run
> a jstack on the p
sing Scala 2.9.3 and sbt to build and run the application
-
http://stackoverflow.com/questions/20187048/apache-spark-localk-master-url-job-gets-stuck
Thx
Vijay Gaikwad
University of Washington MSIM
vijay...@gmail.com
(206) 261-5828
