[MLlib] StackOverflow Error spark mllib 1.6.1 FpGrowth Algorithm for Association rule generation

Hi, I am getting stackoverflow error when I run FpGrowth algorithm on my 21 million transactions with a low support, since I want almost every products association with other product. I know the problem is caused by the recursive lineage of the algorithm, but I don't know how to get around this

StackOverflow Error spark mllib 1.6.1 FpGrowth Algorithm for Association rule generation

Hi, I am getting stackoverflow error when I run FpGrowth algorithm on my 21 million transactions with a low support, since I want almost every products association with other product. I know the problem is caused by the recursive lineage of the algorithm, but I don't know how to get around this