Re: Problem in Restoring ML Pipeline with UDF

2021-06-08 Thread Sean Owen
It's a little bit of a guess, but the class name $line103090609224.$read$FeatureModder looks like something generated by the shell. I think it's your 'real' classname in this case. If you redefined this later and loaded it you may not find it matches up. Can you declare this in a package? On Tue,

Problem in Restoring ML Pipeline with UDF

2021-06-08 Thread Artemis User
We have a feature engineering transformer defined as a custom class with UDF as follows: class FeatureModder extends Transformer with DefaultParamsWritable with DefaultParamsReadable[FeatureModder] {     val uid: String = "FeatureModder"+randomUUID     final val inputCol: Param[String] = new