Using a variable (a column name) in an IF statement in Spark SQL

132]; * It seems I can only use numerical values inside this IF statement, but when a column name is used, it fails. Is there any workaround to do this? Best regards. -- Pruthuvi Maheshakya Wijewardena Software Engineer WSO2 : http://wso2.com/ Email: mahesha...@wso2.com Mobile: +94711228855

Re: Using a variable (a column name) in an IF statement in Spark SQL

e: >> >> *SELECT barcode, IF(items is null, 0, items) FROM goods* >> >> But this query fails with the error: >> >> *unresolved operator 'Project [if (IS NULL items#1) 0 else items#1 AS >> c0#132]; * >> >> It seems I can only use numerical value

Re: Model weights of linear regression becomes abnormal values

, Maheshakya Wijewardena mahesha...@wso2.com wrote: Hi, I'm trying to use Sparks' LinearRegressionWithSGD in PySpark with the attached dataset. The code is attached. When I check the model weights vector after training, it contains `nan` values. [nan,nan,nan,nan,nan,nan,nan,nan

Fwd: Model weights of linear regression becomes abnormal values

be the reason for this? Is this an issue with the data I'm using or a bug? Best regards. -- Pruthuvi Maheshakya Wijewardena Software Engineer WSO2 Lanka (Pvt) Ltd Email: mahesha...@wso2.com Mobile: +94711228855 6,148,72,35,0,336,627,50,1 1,85,66,29,0,266,351,31,0 8,183,64,0,0,233,672,32,1