Hi all,
We have some problems while implementing custom Transformers in JAVA (SPARK
1.6.1).
We do override the method copy, but it crashes with an AbstractMethodError.
If we extends the UnaryTransformer, and do not override the copy method, it
works without any error.
We tried to write the copy like in these examples :
https://github.com/apache/spark/blob/branch-2.0/mllib/src/test/java/org/apache/spark/ml/param/JavaTestParams.java
https://github.com/eBay/Spark/blob/branch-1.6/examples/src/main/java/org/apache/spark/examples/ml/JavaDeveloperApiExample.java
None of it worked.
The copy is defined in the Params class as :
/**
* Creates a copy of this instance with the same UID and some extra params.
* Subclasses should implement this method and set the return type properly.
*
* @see [[defaultCopy()]]
*/
def copy(extra: ParamMap): Params
Any idea?
Thanks,
Mehdi