Hi Brandon, they are available, but private to ml package. They are now
public in 1.4. For 1.3.1 you can define your transformer in
org.apache.spark.ml package - then you could use these traits.
Thanks,
Peter Rudenko
On 2015-06-04 20:28, Brandon Plaster wrote:
Is HasInputCol and HasOutputCol
Hi Dimple,
take a look to existing transformers:
https://github.com/apache/spark/blob/master/mllib/src/main/scala/org/apache/spark/ml/feature/OneHotEncoder.scala
https://github.com/apache/spark/blob/master/mllib/src/main/scala/org/apache/spark/ml/feature/Tokenizer.scala
Thanks Peter. Can you share the Tokenizer.java class for Spark 1.2.1.
Dimple
On Tue, Jun 2, 2015 at 10:51 AM, Peter Rudenko petro.rude...@gmail.com
wrote:
Hi Dimple,
take a look to existing transformers:
Thanks for the quick reply Ram. Will take a look at the Tokenizer code and
try it out.
Dimple
On Tue, Jun 2, 2015 at 10:42 AM, Ram Sriharsha sriharsha@gmail.com
wrote:
Hi
We are in the process of adding examples for feature transformations (
I found this :
https://spark.apache.org/docs/1.2.0/api/java/org/apache/spark/ml/feature/Tokenizer.html
which indicates the Tokenizer did exist in Spark 1.2.0 then and not in
1.2.1?
On Tue, Jun 2, 2015 at 12:45 PM, Peter Rudenko petro.rude...@gmail.com
wrote:
I'm afraid there's no such class
Hi
We are in the process of adding examples for feature transformations (
https://issues.apache.org/jira/browse/SPARK-7546) and this should be
available shortly on Spark Master.
In the meanwhile, the best place to start would be to look at how the
Tokenizer works here: