Re: Trainning a spark ml linear regresion model fail after migrating from 1.5.2 to 1.6.1

2016-06-09 Thread chaz2505
I ran into this problem too - it's because WeightedLeastSquares (added in 1.6.0 SPARK-10668) is being used on an ill-conditioned problem (SPARK-11918). I guess because of the one hot encoding. To get around it you need to ensure WeightedLeastSquares isn't used. Set parameters to make the following

Jdbc connection from sc.addJar failing

2016-04-18 Thread chaz2505
Hi all, I'm a bit stuck with a problem that I thought was solved in SPARK-6913 but can't seem to get it to work. I'm programatically adding a jar (sc.addJar(pathToJar)) after the SparkContext is created then using the driver from the jar to load a table through sqlContext.read.jdbc(). When I