[
https://issues.apache.org/jira/browse/SYSTEMML-1071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15626628#comment-15626628
]
Glenn Weidner edited comment on SYSTEMML-1071 at 11/1/16 9:00 PM:
------------------------------------------------------------------
Files:
0 2016-11-01 12:49 gwperftest/bivar/A_1M/data
254 2016-11-01 12:49 gwperftest/bivar/A_1M/data.mtd
319 2016-11-01 12:49 gwperftest/bivar/A_1M/set1.indices
238 2016-11-01 12:49 gwperftest/bivar/A_1M/set1.indices.mtd
319 2016-11-01 12:49 gwperftest/bivar/A_1M/set1.types
238 2016-11-01 12:49 gwperftest/bivar/A_1M/set1.types.mtd
239 2016-11-01 12:49 gwperftest/bivar/A_1M/set2.indices
238 2016-11-01 12:49 gwperftest/bivar/A_1M/set2.indices.mtd
239 2016-11-01 12:49 gwperftest/bivar/A_1M/set2.types
238 2016-11-01 12:49 gwperftest/bivar/A_1M/set2.types.mtd
8159 2016-11-01 12:47 gwperftest/bivar/A_1M/types
242 2016-11-01 12:47 gwperftest/bivar/A_1M/types.mtd
337008 2016-11-01 13:14 gwperftest/bivar/stats/u
188 2016-11-01 13:14 gwperftest/bivar/stats/u.mtd
{
"data_type": "matrix",
"value_type": "double",
"rows": 17,
"cols": 1000,
"nnz": 12900,
"format": "text",
"description": {
"author": "SystemML"
}
}
was (Author: gweidner):
HDFS:
337008 2016-11-01 13:14 gwperftest/bivar/stats/u
188 2016-11-01 13:14 gwperftest/bivar/stats/u.mtd
> Perftest: Univar-Stats.dml fails with dimension mismatch for M (8GB) scenario
> -----------------------------------------------------------------------------
>
> Key: SYSTEMML-1071
> URL: https://issues.apache.org/jira/browse/SYSTEMML-1071
> Project: SystemML
> Issue Type: Bug
> Reporter: Glenn Weidner
> Assignee: Glenn Weidner
> Fix For: Not Applicable
>
>
> Univar-Stats.dml fails for 8G medium scenario (runUnivar-Stats_A_1M) with
> below stack trace. Note smaller and larger (80G) scenarios completed without
> error.
> 16/10/27 10:20:20 WARN parser.Expression: WARNING:
> ../algorithms/Univar-Stats.dml -- line 64, column 21 -- ppred() has been
> deprecated. Please use the operator directly.
> 16/10/27 10:20:20 ERROR api.DMLScript: Failed to execute DML script.
> org.apache.sysml.parser.LanguageException: Invalid Parameters : ERROR:
> ../algorithms/Univar-Stats.dml -- line 64, column 21 -- Mismatch in
> dimensions for operation (PPRED(K,1,>) MULT maxs)
> at
> org.apache.sysml.parser.Expression.raiseValidateError(Expression.java:557)
> at
> org.apache.sysml.parser.BinaryExpression.checkAndSetDimensions(BinaryExpression.java:188)
> at
> org.apache.sysml.parser.BinaryExpression.validateExpression(BinaryExpression.java:141)
> at
> org.apache.sysml.parser.BuiltinFunctionExpression.validateExpression(BuiltinFunctionExpression.java:323)
> at
> org.apache.sysml.parser.StatementBlock.validate(StatementBlock.java:600)
> at
> org.apache.sysml.parser.DMLTranslator.validateParseTree(DMLTranslator.java:136)
> at org.apache.sysml.api.DMLScript.execute(DMLScript.java:595)
> at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:354)
> at org.apache.sysml.api.DMLScript.main(DMLScript.java:199)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
> at
> org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
> at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> Exception in thread "main" org.apache.sysml.api.DMLException:
> org.apache.sysml.parser.LanguageException: Invalid Parameters : ERROR:
> ../algorithms/Univar-Stats.dml -- line 64, column 21 -- Mismatch in
> dimensions for operation (PPRED(K,1,>) MULT maxs)
> at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:368)
> at org.apache.sysml.api.DMLScript.main(DMLScript.java:199)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
> at
> org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
> at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> Caused by: org.apache.sysml.parser.LanguageException: Invalid Parameters :
> ERROR: ../algorithms/Univar-Stats.dml -- line 64, column 21 -- Mismatch in
> dimensions for operation (PPRED(K,1,>) MULT maxs)
> at
> org.apache.sysml.parser.Expression.raiseValidateError(Expression.java:557)
> at
> org.apache.sysml.parser.BinaryExpression.checkAndSetDimensions(BinaryExpression.java:188)
> at
> org.apache.sysml.parser.BinaryExpression.validateExpression(BinaryExpression.java:141)
> at
> org.apache.sysml.parser.BuiltinFunctionExpression.validateExpression(BuiltinFunctionExpression.java:323)
> at
> org.apache.sysml.parser.StatementBlock.validate(StatementBlock.java:600)
> at
> org.apache.sysml.parser.DMLTranslator.validateParseTree(DMLTranslator.java:136)
> at org.apache.sysml.api.DMLScript.execute(DMLScript.java:595)
> at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:354)
> ... 10 more
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
