Hi Spark Version 1.4
I am trying to replicate a DecisionTree in Spark having already produced the same in Scikit Learn. In Scikit learn I can access the model to pick out certain details. Is there anyway to that in spark? I know you can save the model which looks to go into a parquet file. However when I try and load the parquet file Py4JJavaError: An error occurred while calling o20.parquet. : java.io.IOException: Could not read footer: java.lang.RuntimeException: hdfs://?:9000/tmp/model/metadata/part-00000 is not a Parquet file. expected magic number at tail [80, 65, 82, 49] but found [58, 52, 125, 10] Thanks Rob CONFIDENTIALITY NOTICE This e-mail message and any attachments are only for the use of the intended recipient and may contain information that is privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient, any disclosure, distribution or other use of this e-mail message or attachments is prohibited. If you have received this e-mail message in error, please delete and notify the sender immediately. Thank you.