For #2, XmlInputFormat was involved. Is it possible to prune (unneeded) field(s) so that heap requirement is lower ?
On Wed, Jun 14, 2017 at 8:47 AM, Sebastian Neef < gehax...@mailbox.tu-berlin.de> wrote: > Hi Ted, > > sure. > > Here's the stack strace with .distinct() with the Exception in the > 'SortMerger Reading Thread': [1] > > Here's the stack strace without .distinct() and the 'Requested array > size exceeds VM limit' error: [2] > > If you need anything else, I can more or less reliably reproduce the issue. > > The best, > Sebastian > > [1] > http://paste.gehaxelt.in/?2757c33ed3a3733b#jHQPPQNKKrE2wq4o9KCR48m+/ > V91S55kWH3dwEuyAkc= > [2] > http://paste.gehaxelt.in/?b106990deccecf1a#y22HgySqCYEOaP2wN6xxApGk/ > r4YICRkLCH2HBNN9yQ= >
