[
https://issues.apache.org/jira/browse/SYSTEMML-955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pierre Regazzoni updated SYSTEMML-955:
--------------------------------------
Component/s: (was: PyDML)
Runtime
> NPE running GLM-predict.dml in spark mode
> -----------------------------------------
>
> Key: SYSTEMML-955
> URL: https://issues.apache.org/jira/browse/SYSTEMML-955
> Project: SystemML
> Issue Type: Bug
> Components: Runtime
> Affects Versions: SystemML 0.11
> Reporter: Pierre Regazzoni
>
> Trying to run Linear Regression example
> (http://www.ibm.com/support/knowledgecenter/SSPT3X_4.2.0/com.ibm.swg.im.infosphere.biginsights.product.doc/doc/bi_systemML.html)
> and hit following NPE:
> {noformat}
> 16/09/23 18:16:04 ERROR ApplicationMaster: User class threw exception:
> org.apache.sysml.api.DMLException: org.apache.sysml.lops.LopsException:
> ERROR: line 243, column 30 -- Problem generating simple inst -
> SPARK°cdf°dist=normal°target=¶_Var238¶°_Var239·SCALAR·DOUBLE
> org.apache.sysml.api.DMLException: org.apache.sysml.lops.LopsException:
> ERROR: line 243, column 30 -- Problem generating simple inst -
> SPARK°cdf°dist=normal°target=¶_Var238¶°_Var239·SCALAR·DOUBLE
> at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:374)
> at org.apache.sysml.api.DMLScript.main(DMLScript.java:198)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:627)
> Caused by: org.apache.sysml.lops.LopsException: ERROR: line 243, column 30 --
> Problem generating simple inst -
> SPARK°cdf°dist=normal°target=¶_Var238¶°_Var239·SCALAR·DOUBLE
> at
> org.apache.sysml.lops.compile.Dag.generateControlProgramJobs(Dag.java:1529)
> at org.apache.sysml.lops.compile.Dag.doGreedyGrouping(Dag.java:1194)
> at org.apache.sysml.lops.compile.Dag.getJobs(Dag.java:268)
> at
> org.apache.sysml.parser.DMLProgram.createRuntimeProgramBlock(DMLProgram.java:541)
> at
> org.apache.sysml.parser.DMLProgram.createRuntimeProgramBlock(DMLProgram.java:338)
> at
> org.apache.sysml.parser.DMLProgram.getRuntimeProgram(DMLProgram.java:207)
> at org.apache.sysml.api.DMLScript.execute(DMLScript.java:648)
> at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:360)
> ... 6 more
> Caused by: java.lang.NullPointerException
> at
> org.apache.sysml.runtime.instructions.SPInstructionParser.parseSingleInstruction(SPInstructionParser.java:304)
> at
> org.apache.sysml.runtime.instructions.InstructionParser.parseSingleInstruction(InstructionParser.java:48)
> at
> org.apache.sysml.lops.compile.Dag.generateControlProgramJobs(Dag.java:1516)
> ... 13 more
> {noformat}
> I am running on tech preview code using spark 2.0 and
> systemml-0.11.0-incubating_IBM_3.jar.
> GML-predict.dml was invoked as:
> {noformat}
> $SPARK_HOME/bin/spark-submit --master yarn --deploy-mode cluster \
> --class org.apache.sysml.api.DMLScript
> /usr/iop/current/systemml-client/lib/systemml.jar \
> -f /usr/iop/current/systemml-client/scripts/algorithms/GLM-predict.dml
> -exec spark \
> -nvargs X=linRegData.test.data.csv Y=linRegData.test.labels.csv B=betas.csv
> fmt=csv
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
