Re: How to use DataFrame with MySQL

I just ran into this too. Thanks for the tip! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-use-DataFrame-with-MySQL-tp22178p23351.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

How to deal with an explosive flatmap

I have a flatmap that takes a line from an input file, splits it by tab into words then returns an array of tuples consisting of every combination of 2 words. I then go on to count the frequency of each combination across the whole file using a reduce by key (where the key is the tuple). I am