Re: Spark 2.1.0 and Shapeless

2017-01-31 Thread Phil Wills
Are you not able to shade it when you're building your fat jar with something like https://github.com/sbt/sbt-assembly#shading? I would have thought doing the shading at the app level would be a bit less painful than doing it at the library level. Phil On Tue, 31 Jan 2017, 04:24 Timothy Chan,

Re: Single worker locked at 100% CPU

2014-12-24 Thread Phil Wills
spark.hadoop.cloneConf=true and see if that fixes things. Good luck! Andrew On Tue, Dec 23, 2014 at 9:40 AM, Phil Wills otherp...@gmail.com wrote: I've been attempting to run a job based on MLlib's ALS implementation for a while now and have hit an issue I'm having a lot of difficulty

Single worker locked at 100% CPU

2014-12-23 Thread Phil Wills
I've been attempting to run a job based on MLlib's ALS implementation for a while now and have hit an issue I'm having a lot of difficulty getting to the bottom of. On a moderate size set of input data it works fine, but against larger (still well short of what I'd think of as big) sets of data,