Saif Addin created SPARK-21511:
----------------------------------
Summary: Unable to load Pipeline or Pipeline model
Key: SPARK-21511
URL: https://issues.apache.org/jira/browse/SPARK-21511
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 2.1.0
Reporter: Saif Addin
{code:java}
...
model.transform(self.data).show()
pipe_path = "./tmp_pipeline"
pipeline.write().overwrite().save(pipe_path)
loaded_pipeline = Pipeline.read().load(pipe_path)
{code}
throws
{code:java}
======================================================================
ERROR: runTest (test.code.PipelineTestSpec)
----------------------------------------------------------------------
Traceback (most recent call last):
File "code.py", line 207, in runTest
loaded_pipeline = Pipeline.read().load(pipe_path)
File "spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/util.py",
line 198, in load
return self._clazz._from_java(java_obj)
File
"spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/pipeline.py", line
155, in _from_java
py_stages = [JavaParams._from_java(s) for s in java_stage.getStages()]
File
"spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/pipeline.py", line
155, in <listcomp>
py_stages = [JavaParams._from_java(s) for s in java_stage.getStages()]
File
"spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/wrapper.py", line
173, in _from_java
py_type = __get_class(stage_name)
File
"spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/wrapper.py", line
167, in __get_class
m = __import__(module)
ModuleNotFoundError: No module named 'com'
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
