block? How much memory are you giving to the executors? I
>> assume you are running on YARN, if so you would want to make sure your yarn
>> executor memory overhead is set to a higher value than default.
>>
>> Just curious, could you also explain why you need matrix mul
;
> Just curious, could you also explain why you need matrix multiplication with
> transpose? Smells like similarity computation.
>
> Regards
> Sab
>
> On Thu, Nov 12, 2015 at 7:27 PM, Eilidh Troup <e.tr...@epcc.ed.ac.uk> wrote:
> Hi,
>
> I’m trying to mul
Hi,
I’m trying to multiply a large squarish matrix with its transpose. Eventually
I’d like to work with matrices of size 200,000 by 500,000, but I’ve started off
first with 100 by 100 which was fine, and then with 10,000 by 10,000 which
failed with an out of memory exception.
I used MLlib and
