Re: Add jar files on classpath when submitting tasks to Spark

unsubscribe On Tue, Nov 1, 2016 at 8:56 AM, Jan Botorek wrote: > Thank you for the reply. > > I am aware of the parameters used when submitting the tasks (--jars is > working for us). > > > > But, isn’t there any way how to specify a location (directory) for jars > „in

graphx - trianglecount of 2B edges

I was attempting to use the graphx triangle count method on a 2B edge graph (Friendster dataset on SNAP) . I have access to a 60 node cluster with 90GB memory and 30v cores per node . I am running into memory issues I am using 1000 partitions using the RandomVertexCut. Here’s my submit