[jira] [Comment Edited] (SYSTEMML-1561) Improve constant folding during compilation

Mike Dusenberry (JIRA) Tue, 09 May 2017 15:59:01 -0700

    [ 
https://issues.apache.org/jira/browse/SYSTEMML-1561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003710#comment-16003710
 ]


Mike Dusenberry edited comment on SYSTEMML-1561 at 5/9/17 10:57 PM:
--------------------------------------------------------------------

Well, I tried logging the rewrites with {{ProgramRewriter.LDEBUG = true}} 
enabled and log4j set to DEBUG, but it only displayed the common subexpression 
elimination rewrites during the second chance pass.  Looking into it further, 
rewrites like the constant folding don't seem to ever emit debug logging, so I 
don't think the log isn't showing the whole picture.  Regardless, here's the 
trace (look for the {{ABOUT TO START STATIC REWRITE + IPA SECOND 
CHANCE!!!!!!!!}} section).

{code}
.....

17/05/09 15:50:35 DEBUG DMLScript:
DML config:
INFO: localtmpdir: /tmp/systemml
INFO: scratch: scratch_space
INFO: optlevel: 2
INFO: numreducers: 10
INFO: defaultblocksize: 1000
INFO: dml.yarn.appmaster: false
INFO: dml.yarn.appmaster.mem: 2048
INFO: dml.yarn.mapreduce.mem: -1
INFO: cp.parallel.matrixmult: true
INFO: cp.parallel.textio: true
INFO: native.blas: auto
INFO: compressed.linalg: false
INFO: codegen.enabled: false
INFO: codegen.literals: 1
INFO: codegen.plancache: true
INFO: systemml.stats.extraGPU: false
INFO: systemml.stats.extraDNN: false

17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/examples/mnist_lenet.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/affine.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/conv2d_builtin.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/cross_entropy_loss.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/dropout.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/l2_reg.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/max_pool2d_builtin.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/relu.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/softmax.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/optim/sgd_nesterov.dml
17/05/09 15:50:36 DEBUG MRConfigurationNames: Hadoop build version: 2.6.5 from 
e8c9fe0b4c252caf2ebf1464220599650f119997 by sjlee source checksum 
f05c9fa095a395faa9db9f7ba5d754
17/05/09 15:50:36 DEBUG MRConfigurationNames: Using hadoop 2.x configuration 
properties.
17/05/09 15:50:36 DEBUG MutableMetricsFactory: field 
org.apache.hadoop.metrics2.lib.MutableRate 
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with 
annotation @org.apache.hadoop.metrics2.annotation.Metric(sampleName=Ops, 
about=, always=false, type=DEFAULT, value=[Rate of successful kerberos logins 
and latency (milliseconds)], valueName=Time)
17/05/09 15:50:36 DEBUG MutableMetricsFactory: field 
org.apache.hadoop.metrics2.lib.MutableRate 
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with 
annotation @org.apache.hadoop.metrics2.annotation.Metric(sampleName=Ops, 
about=, always=false, type=DEFAULT, value=[Rate of failed kerberos logins and 
latency (milliseconds)], valueName=Time)
17/05/09 15:50:36 DEBUG MutableMetricsFactory: field 
org.apache.hadoop.metrics2.lib.MutableRate 
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with 
annotation @org.apache.hadoop.metrics2.annotation.Metric(sampleName=Ops, 
about=, always=false, type=DEFAULT, value=[GetGroups], valueName=Time)
17/05/09 15:50:36 DEBUG MetricsSystemImpl: UgiMetrics, User and group related 
metrics
17/05/09 15:50:36 DEBUG KerberosName: Kerberos krb5 configuration not found, 
setting default realm to empty
17/05/09 15:50:36 DEBUG Groups:  Creating new Groups object
17/05/09 15:50:36 DEBUG NativeCodeLoader: Trying to load the custom-built 
native-hadoop library...
17/05/09 15:50:36 DEBUG NativeCodeLoader: Failed to load native-hadoop with 
error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
17/05/09 15:50:36 DEBUG NativeCodeLoader: 
java.library.path=/Users/mwdusenb/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
17/05/09 15:50:36 WARN NativeCodeLoader: Unable to load native-hadoop library 
for your platform... using builtin-java classes where applicable
17/05/09 15:50:36 DEBUG PerformanceAdvisory: Falling back to shell based
17/05/09 15:50:36 DEBUG JniBasedUnixGroupsMappingWithFallback: Group mapping 
impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
17/05/09 15:50:36 DEBUG Groups: Group mapping 
impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; 
cacheTimeout=300000; warningDeltaMs=5000
17/05/09 15:50:36 DEBUG UserGroupInformation: hadoop login
17/05/09 15:50:36 DEBUG UserGroupInformation: hadoop login commit
17/05/09 15:50:36 DEBUG UserGroupInformation: using local user:UnixPrincipal: 
mwdusenb
17/05/09 15:50:36 DEBUG UserGroupInformation: Using user: "UnixPrincipal: 
mwdusenb" with name mwdusenb
17/05/09 15:50:36 DEBUG UserGroupInformation: User entry: "mwdusenb"
17/05/09 15:50:36 DEBUG UserGroupInformation: UGI loginUser:mwdusenb 
(auth:SIMPLE)
17/05/09 15:50:36 WARN Expression: Metadata file: 
nn/examples/data/mnist/mnist_train.csv.mtd not provided
17/05/09 15:50:36 WARN Expression: Metadata file: 
nn/examples/data/mnist/mnist_test.csv.mtd not provided
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1 
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1 
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1 
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1 
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1 
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1 
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG DMLScript: SystemML security check: local.user.name = 
mwdusenb, local.user.groups = com.apple.access_ssh, everyone, _appstore, 
com.apple.access_ftp, admin, staff, com.apple.sharepoint.group.1, _lpoperator, 
_appserverusr, _lpadmin, _developer, com.apple.access_screensharing, 
localaccounts, _appserveradm, mapreduce.jobtracker.address = local, 
mapreduce.tasktracker.taskcontroller = 
org.apache.hadoop.mapred.DefaultTaskController,mapreduce.tasktracker.group = 
null, fs.defaultFS = file, dfs.permissions.enabled = true
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 10 operators.
17/05/09 15:50:36 DEBUG Hop:     1710  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     93    b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1712  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     95    b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
removeUnnecessaryBinaryOperation5 (line 35)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 42 operators.
17/05/09 15:50:36 DEBUG Hop:     1715  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     256   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 10 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 12 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 8 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 9 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 9 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 9 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG Hop:     1740  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     430   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1742  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     431   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1744  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     436   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1746  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1748  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     492   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1750  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1752  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG Hop:     1754  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     699   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 9 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
removeUnnecessaryBinaryOperation5 (line 35)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
removeUnnecessaryBinaryOperation5 (line 35)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 25 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
simplifyBushyBinaryOperation1
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
removeUnnecessaryBinaryOperation5 (line 55)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
simplifyBushyBinaryOperation1
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
removeUnnecessaryBinaryOperation5 (line 35)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
removeUnnecessaryBinaryOperation5 (line 55)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 15 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 11 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG Hop:     1789  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1596  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1791  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1604  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1793  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1612  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1795  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1620  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1797  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1628  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1799  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1636  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1801  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1644  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1803  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1652  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG Hop:     1805  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1700  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG StatementBlockRewriteRule: Applied 
splitDagUnknownCSVRead.
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate: ./nn/examples/mnist_lenet.dml::train, callCount=1
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate: ./nn/examples/mnist_lenet.dml::predict, callCount=2
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate: ./nn/layers/dropout.dml::forward, callCount=1
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate (after pruning): ./nn/examples/mnist_lenet.dml::train
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate (after pruning): ./nn/layers/dropout.dml::forward
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[1 32 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[64 
32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 64 -1 -1] filter_dim=[1 64 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 64 -1 -1] 
filter_dim=[1 64 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 32 -1 -1] 
filter_dim=[64 32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 -1 -1] 
filter_dim=[1 32 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[1 32 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[64 
32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 64 -1 -1] filter_dim=[1 64 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 64 -1 -1] 
filter_dim=[1 64 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 32 -1 -1] 
filter_dim=[64 32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 -1 -1] 
filter_dim=[1 32 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[1 32 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[64 
32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 64 -1 -1] filter_dim=[1 64 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 64 -1 -1] 
filter_dim=[1 64 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 32 -1 -1] 
filter_dim=[64 32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 -1 -1] 
filter_dim=[1 32 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/max_pool2d_builtin.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/max_pool2d_builtin.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/optim/sgd_nesterov.dml::init
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/optim/sgd_nesterov.dml::update
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/examples/mnist_lenet.dml::generate_dummy_data
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/examples/mnist_lenet.dml::eval
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/relu.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/relu.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/cross_entropy_loss.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/cross_entropy_loss.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/affine.dml::init
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/affine.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/affine.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/l2_reg.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/l2_reg.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/softmax.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/softmax.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/conv2d_builtin.dml::init
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/conv2d_builtin.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/conv2d_builtin.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/dropout.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC flagged for 
recompile-once: ./nn/examples/mnist_lenet.dml::predict
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC flagged for 
recompile-once: ./nn/examples/mnist_lenet.dml::train
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG Hop:     1860  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     401   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1862  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     402   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1864  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     407   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1866  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1868  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     451   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1870  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     453   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1872  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     454   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1874  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     459   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1876  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     469   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1878  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 9 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG Hop:     1880  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     660   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1882  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     661   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1884  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     662   b(-)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1886  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     663   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1888  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     665   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1890  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1892  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1894  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     700   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1896  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     702   b(-)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1898  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     704   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1900  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     706   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1902  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1904  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1906  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     741   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1908  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     742   b(-)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1910  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     743   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1912  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     745   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1914  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1916  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1918  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     780   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1920  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     782   b(-)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1922  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     784   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1924  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     786   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1926  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1928  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1930  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1932  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG Hop:     1934  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     856   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 13 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG Hop:     1936  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1130  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate: ./nn/examples/mnist_lenet.dml::train, callCount=1
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate: ./nn/examples/mnist_lenet.dml::predict, callCount=2
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate: ./nn/layers/dropout.dml::forward, callCount=1
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate (after pruning): ./nn/examples/mnist_lenet.dml::train
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate (after pruning): ./nn/layers/dropout.dml::forward
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 6272 img_dim=[-1 32 28 28] filter_dim=[1 
32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 12544 img_dim=[-1 32 14 14] 
filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 3136 img_dim=[-1 64 14 14] filter_dim=[1 
64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 12544 img_dim=[-1 64 14 14] 
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 6272 img_dim=[-1 32 14 
14] filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 28 28] 
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 6272 img_dim=[-1 32 28 28] filter_dim=[1 
32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 12544 img_dim=[-1 32 14 14] 
filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 3136 img_dim=[-1 64 14 14] filter_dim=[1 
64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 12544 img_dim=[-1 64 14 14] 
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 6272 img_dim=[-1 32 14 
14] filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 28 28] 
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 6272 img_dim=[-1 32 28 28] filter_dim=[1 
32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 12544 img_dim=[-1 32 14 14] 
filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 3136 img_dim=[-1 64 14 14] filter_dim=[1 
64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 12544 img_dim=[-1 64 14 14] 
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 6272 img_dim=[-1 32 14 
14] filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 28 28] 
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC flagged for 
recompile-once: ./nn/examples/mnist_lenet.dml::predict
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC flagged for 
recompile-once: ./nn/examples/mnist_lenet.dml::train
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseSumSquared.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseSumSquared.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseSumSquared.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseSumSquared.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 164)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 164)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 165)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 165)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 166)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 166)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 167)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 167)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 17 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:MAX_POOLING -1 6272 img_dim=[-1 32 28 28] 
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:DIRECT_CONV2D -1 12544 img_dim=[-1 32 14 14] 
filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:MAX_POOLING -1 3136 img_dim=[-1 64 14 14] 
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:MAX_POOLING_BACKWARD -1 12544 img_dim=[-1 64 14 14] 
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:DIRECT_CONV2D_BACKWARD_DATA -1 6272 img_dim=[-1 32 
14 14] filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 
2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 28 28] 
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop:     141   TWrite N (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:   * 135   TRead X  (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:     143   TWrite Hf (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     145   TWrite Wf (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     147   TWrite stride (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     149   TWrite pad (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     151   TWrite F1 (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:   * 136   TRead W1 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:     153   TWrite F2 (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:   * 137   TRead W2 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 163   TWrite probs (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 162   dg(rand) (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 139   TRead W4 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:     165   TWrite batch_size (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     169   TWrite iters (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     167   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:   * 1723  TWrite b1 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1722  TRead b1 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1725  TWrite b2 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1724  TRead b2 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1727  TWrite b3 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1726  TRead b3 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1729  TWrite b4 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1728  TRead b4 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1731  TWrite X (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1730  TRead X  (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1733  TWrite W1 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1732  TRead W1 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1735  TWrite W2 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1734  TRead W2 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1737  TWrite W3 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1736  TRead W3 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1739  TWrite W4 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1738  TRead W4 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1843  TWrite b1 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1842  TRead b1 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1845  TWrite b2 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1844  TRead b2 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1847  TWrite b3 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1846  TRead b3 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1849  TWrite b4 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1848  TRead b4 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1851  TWrite X (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1850  TRead X  (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1853  TWrite W1 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1852  TRead W1 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1855  TWrite W2 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1854  TRead W2 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1857  TWrite W3 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1856  TRead W3 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1859  TWrite W4 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1858  TRead W4 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 369   TWrite probs (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 368   lix      (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 365   b(/)     (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 365   b(/)     (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 363   u(exp)   (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 362   b(-)     (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 362   b(-)     (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 360   b(+)     (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 360   b(+)     (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 359   ba(+*)   (9103,27308)  SPARK
17/05/09 15:50:36 INFO SparkContext: Running Spark version 2.3.0-SNAPSHOT
17/05/09 15:50:36 INFO SparkContext: Submitted application: 
org.apache.sysml.api.DMLScript

......
{code}


was (Author: mwdus...@us.ibm.com):
Well, I tried logging the rewrites with {{ProgramRewriter.LDEBUG = true}} 
enabled and log4j set to DEBUG, but it only displayed the common subexpression 
elimination rewrites during the second chance pass.  Looking into it further, 
rewrites like the constant folding don't seem to ever emit debug logging, so I 
don't think the log isn't showing the whole picture.  Regardless, here's the 
trace (look for the {{ABOUT TO START STATIC REWRITE + IPA SECOND 
CHANCE!!!!!!!!}} section).

{code}
17/05/09 15:50:35 DEBUG DMLScript:
DML config:
INFO: localtmpdir: /tmp/systemml
INFO: scratch: scratch_space
INFO: optlevel: 2
INFO: numreducers: 10
INFO: defaultblocksize: 1000
INFO: dml.yarn.appmaster: false
INFO: dml.yarn.appmaster.mem: 2048
INFO: dml.yarn.mapreduce.mem: -1
INFO: cp.parallel.matrixmult: true
INFO: cp.parallel.textio: true
INFO: native.blas: auto
INFO: compressed.linalg: false
INFO: codegen.enabled: false
INFO: codegen.literals: 1
INFO: codegen.plancache: true
INFO: systemml.stats.extraGPU: false
INFO: systemml.stats.extraDNN: false

17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/examples/mnist_lenet.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/affine.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/conv2d_builtin.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/cross_entropy_loss.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/dropout.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/l2_reg.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/max_pool2d_builtin.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/relu.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/layers/softmax.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local 
file system: ./nn/optim/sgd_nesterov.dml
17/05/09 15:50:36 DEBUG MRConfigurationNames: Hadoop build version: 2.6.5 from 
e8c9fe0b4c252caf2ebf1464220599650f119997 by sjlee source checksum 
f05c9fa095a395faa9db9f7ba5d754
17/05/09 15:50:36 DEBUG MRConfigurationNames: Using hadoop 2.x configuration 
properties.
17/05/09 15:50:36 DEBUG MutableMetricsFactory: field 
org.apache.hadoop.metrics2.lib.MutableRate 
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with 
annotation @org.apache.hadoop.metrics2.annotation.Metric(sampleName=Ops, 
about=, always=false, type=DEFAULT, value=[Rate of successful kerberos logins 
and latency (milliseconds)], valueName=Time)
17/05/09 15:50:36 DEBUG MutableMetricsFactory: field 
org.apache.hadoop.metrics2.lib.MutableRate 
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with 
annotation @org.apache.hadoop.metrics2.annotation.Metric(sampleName=Ops, 
about=, always=false, type=DEFAULT, value=[Rate of failed kerberos logins and 
latency (milliseconds)], valueName=Time)
17/05/09 15:50:36 DEBUG MutableMetricsFactory: field 
org.apache.hadoop.metrics2.lib.MutableRate 
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with 
annotation @org.apache.hadoop.metrics2.annotation.Metric(sampleName=Ops, 
about=, always=false, type=DEFAULT, value=[GetGroups], valueName=Time)
17/05/09 15:50:36 DEBUG MetricsSystemImpl: UgiMetrics, User and group related 
metrics
17/05/09 15:50:36 DEBUG KerberosName: Kerberos krb5 configuration not found, 
setting default realm to empty
17/05/09 15:50:36 DEBUG Groups:  Creating new Groups object
17/05/09 15:50:36 DEBUG NativeCodeLoader: Trying to load the custom-built 
native-hadoop library...
17/05/09 15:50:36 DEBUG NativeCodeLoader: Failed to load native-hadoop with 
error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
17/05/09 15:50:36 DEBUG NativeCodeLoader: 
java.library.path=/Users/mwdusenb/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
17/05/09 15:50:36 WARN NativeCodeLoader: Unable to load native-hadoop library 
for your platform... using builtin-java classes where applicable
17/05/09 15:50:36 DEBUG PerformanceAdvisory: Falling back to shell based
17/05/09 15:50:36 DEBUG JniBasedUnixGroupsMappingWithFallback: Group mapping 
impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
17/05/09 15:50:36 DEBUG Groups: Group mapping 
impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; 
cacheTimeout=300000; warningDeltaMs=5000
17/05/09 15:50:36 DEBUG UserGroupInformation: hadoop login
17/05/09 15:50:36 DEBUG UserGroupInformation: hadoop login commit
17/05/09 15:50:36 DEBUG UserGroupInformation: using local user:UnixPrincipal: 
mwdusenb
17/05/09 15:50:36 DEBUG UserGroupInformation: Using user: "UnixPrincipal: 
mwdusenb" with name mwdusenb
17/05/09 15:50:36 DEBUG UserGroupInformation: User entry: "mwdusenb"
17/05/09 15:50:36 DEBUG UserGroupInformation: UGI loginUser:mwdusenb 
(auth:SIMPLE)
17/05/09 15:50:36 WARN Expression: Metadata file: 
nn/examples/data/mnist/mnist_train.csv.mtd not provided
17/05/09 15:50:36 WARN Expression: Metadata file: 
nn/examples/data/mnist/mnist_test.csv.mtd not provided
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1 
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1 
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1 
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1 
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1 
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1 
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1 
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG DMLScript: SystemML security check: local.user.name = 
mwdusenb, local.user.groups = com.apple.access_ssh, everyone, _appstore, 
com.apple.access_ftp, admin, staff, com.apple.sharepoint.group.1, _lpoperator, 
_appserverusr, _lpadmin, _developer, com.apple.access_screensharing, 
localaccounts, _appserveradm, mapreduce.jobtracker.address = local, 
mapreduce.tasktracker.taskcontroller = 
org.apache.hadoop.mapred.DefaultTaskController,mapreduce.tasktracker.group = 
null, fs.defaultFS = file, dfs.permissions.enabled = true
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 10 operators.
17/05/09 15:50:36 DEBUG Hop:     1710  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     93    b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1712  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     95    b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
removeUnnecessaryBinaryOperation5 (line 35)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 42 operators.
17/05/09 15:50:36 DEBUG Hop:     1715  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     256   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 10 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 12 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 8 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 9 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 9 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 9 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG Hop:     1740  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     430   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1742  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     431   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1744  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     436   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1746  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1748  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     492   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1750  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1752  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG Hop:     1754  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     699   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 9 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
removeUnnecessaryBinaryOperation5 (line 35)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
removeUnnecessaryBinaryOperation5 (line 35)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 25 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
simplifyBushyBinaryOperation1
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
removeUnnecessaryBinaryOperation5 (line 55)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
simplifyBushyBinaryOperation1
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
removeUnnecessaryBinaryOperation5 (line 35)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied 
removeUnnecessaryBinaryOperation5 (line 55)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 15 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 11 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG Hop:     1789  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1596  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1791  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1604  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1793  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1612  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1795  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1620  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1797  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1628  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1799  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1636  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1801  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1644  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1803  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1652  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG Hop:     1805  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1700  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG StatementBlockRewriteRule: Applied 
splitDagUnknownCSVRead.
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate: ./nn/examples/mnist_lenet.dml::train, callCount=1
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate: ./nn/examples/mnist_lenet.dml::predict, callCount=2
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate: ./nn/layers/dropout.dml::forward, callCount=1
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate (after pruning): ./nn/examples/mnist_lenet.dml::train
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate (after pruning): ./nn/layers/dropout.dml::forward
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[1 32 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[64 
32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 64 -1 -1] filter_dim=[1 64 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 64 -1 -1] 
filter_dim=[1 64 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 32 -1 -1] 
filter_dim=[64 32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 -1 -1] 
filter_dim=[1 32 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[1 32 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[64 
32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 64 -1 -1] filter_dim=[1 64 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 64 -1 -1] 
filter_dim=[1 64 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 32 -1 -1] 
filter_dim=[64 32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 -1 -1] 
filter_dim=[1 32 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[1 32 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[64 
32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 64 -1 -1] filter_dim=[1 64 
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 64 -1 -1] 
filter_dim=[1 64 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 32 -1 -1] 
filter_dim=[64 32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 -1 -1] 
filter_dim=[1 32 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/max_pool2d_builtin.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/max_pool2d_builtin.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/optim/sgd_nesterov.dml::init
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/optim/sgd_nesterov.dml::update
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/examples/mnist_lenet.dml::generate_dummy_data
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/examples/mnist_lenet.dml::eval
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/relu.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/relu.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/cross_entropy_loss.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/cross_entropy_loss.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/affine.dml::init
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/affine.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/affine.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/l2_reg.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/l2_reg.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/softmax.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/softmax.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/conv2d_builtin.dml::init
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/conv2d_builtin.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/conv2d_builtin.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function: 
./nn/layers/dropout.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC flagged for 
recompile-once: ./nn/examples/mnist_lenet.dml::predict
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC flagged for 
recompile-once: ./nn/examples/mnist_lenet.dml::train
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG Hop:     1860  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     401   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1862  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     402   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1864  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     407   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1866  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1868  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     451   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1870  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     453   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1872  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     454   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1874  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     459   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1876  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     469   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1878  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 9 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG Hop:     1880  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     660   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1882  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     661   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1884  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     662   b(-)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1886  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     663   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1888  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     665   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1890  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1892  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1894  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     700   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1896  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     702   b(-)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1898  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     704   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1900  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     706   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1902  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1904  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1906  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     741   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1908  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     742   b(-)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1910  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     743   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1912  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     745   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1914  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1916  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1918  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     780   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1920  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     782   b(-)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1922  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     784   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1924  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     786   b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1926  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1928  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1930  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1932  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG Hop:     1934  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     856   b(*)     (0,0)  CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 13 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 5 operators.
17/05/09 15:50:36 DEBUG Hop:     1936  TWrite __cf_tmp (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     1130  b(+)     (0,0)  CP
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate: ./nn/examples/mnist_lenet.dml::train, callCount=1
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate: ./nn/examples/mnist_lenet.dml::predict, callCount=2
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate: ./nn/layers/dropout.dml::forward, callCount=1
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate (after pruning): ./nn/examples/mnist_lenet.dml::train
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic 
propagation candidate (after pruning): ./nn/layers/dropout.dml::forward
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 6272 img_dim=[-1 32 28 28] filter_dim=[1 
32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 12544 img_dim=[-1 32 14 14] 
filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 3136 img_dim=[-1 64 14 14] filter_dim=[1 
64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 12544 img_dim=[-1 64 14 14] 
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 6272 img_dim=[-1 32 14 
14] filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 28 28] 
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 6272 img_dim=[-1 32 28 28] filter_dim=[1 
32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 12544 img_dim=[-1 32 14 14] 
filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 3136 img_dim=[-1 64 14 14] filter_dim=[1 
64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 12544 img_dim=[-1 64 14 14] 
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 6272 img_dim=[-1 32 14 
14] filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 28 28] 
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 6272 img_dim=[-1 32 28 28] filter_dim=[1 
32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D -1 12544 img_dim=[-1 32 14 14] 
filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING -1 3136 img_dim=[-1 64 14 14] filter_dim=[1 
64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 12544 img_dim=[-1 64 14 14] 
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 6272 img_dim=[-1 32 14 
14] filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 28 28] 
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC flagged for 
recompile-once: ./nn/examples/mnist_lenet.dml::predict
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC flagged for 
recompile-once: ./nn/examples/mnist_lenet.dml::train
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseSumSquared.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseSumSquared.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseSumSquared.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseSumSquared.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 164)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 164)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 165)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 165)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 166)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 166)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 167)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 167)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 17 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination - 
removed 2 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied 
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] 
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28] 
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:MAX_POOLING -1 6272 img_dim=[-1 32 28 28] 
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:DIRECT_CONV2D -1 12544 img_dim=[-1 32 14 14] 
filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:MAX_POOLING -1 3136 img_dim=[-1 64 14 14] 
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:MAX_POOLING_BACKWARD -1 12544 img_dim=[-1 64 14 14] 
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:DIRECT_CONV2D_BACKWARD_DATA -1 6272 img_dim=[-1 32 
14 14] filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 
2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in 
inferOutputCharacteristics:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 28 28] 
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop:     141   TWrite N (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:   * 135   TRead X  (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:     143   TWrite Hf (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     145   TWrite Wf (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     147   TWrite stride (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     149   TWrite pad (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     151   TWrite F1 (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:   * 136   TRead W1 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:     153   TWrite F2 (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:   * 137   TRead W2 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 163   TWrite probs (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 162   dg(rand) (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 139   TRead W4 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:     165   TWrite batch_size (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     169   TWrite iters (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:     167   b(/)     (0,0)  CP
17/05/09 15:50:36 DEBUG Hop:   * 1723  TWrite b1 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1722  TRead b1 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1725  TWrite b2 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1724  TRead b2 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1727  TWrite b3 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1726  TRead b3 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1729  TWrite b4 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1728  TRead b4 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1731  TWrite X (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1730  TRead X  (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1733  TWrite W1 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1732  TRead W1 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1735  TWrite W2 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1734  TRead W2 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1737  TWrite W3 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1736  TRead W3 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1739  TWrite W4 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1738  TRead W4 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1843  TWrite b1 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1842  TRead b1 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1845  TWrite b2 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1844  TRead b2 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1847  TWrite b3 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1846  TRead b3 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1849  TWrite b4 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1848  TRead b4 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1851  TWrite X (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1850  TRead X  (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1853  TWrite W1 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1852  TRead W1 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1855  TWrite W2 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1854  TRead W2 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1857  TWrite W3 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1856  TRead W3 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1859  TWrite W4 (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 1858  TRead W4 (9103,9103)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 369   TWrite probs (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 368   lix      (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 365   b(/)     (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 365   b(/)     (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 363   u(exp)   (9103,18205)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 362   b(-)     (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 362   b(-)     (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 360   b(+)     (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 360   b(+)     (9103,27308)  SPARK
17/05/09 15:50:36 DEBUG Hop:   * 359   ba(+*)   (9103,27308)  SPARK
17/05/09 15:50:36 INFO SparkContext: Running Spark version 2.3.0-SNAPSHOT
17/05/09 15:50:36 INFO SparkContext: Submitted application: 
org.apache.sysml.api.DMLScript

......
{code}

> Improve constant folding during compilation
> -------------------------------------------
>
>                 Key: SYSTEMML-1561
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1561
>             Project: SystemML
>          Issue Type: Improvement
>            Reporter: Mike Dusenberry
>            Assignee: Mike Dusenberry
>             Fix For: SystemML 1.0
>
>         Attachments: scenario1_plan.txt, scenario1.py, scenario2_plan.txt, 
> scenario2.py
>
>
> In our `nn` library, our convolution and pooling layers have to pass around 
> the spatial dimensions (height and width) of the images that are stretched 
> out into rows of the input/output matrices.  These output dimensions are 
> computed within the forward functions of the above layers as small scalar 
> equations.  From a mathematical standpoint, these sizes can be determined at 
> compile time, and it is nice to have these size equations in DML (v.s. hiding 
> them inside the engine within built-in functions).  However, we do not 
> currently evaluate these expressions during compilation, and thus we are left 
> with unknown sizes even during recompilation.  This naturally leads to max 
> memory estimates and thus often leads to unnecessary distributed runtime ops 
> rather than simple CP ones.
> I have two related scenarios for which this is a problem.  They both involve 
> the {{Houtc1}} & {{Woutc1}} values that are returned from a 
> `conv2d::forward(...)` function.  These represent the spatial dimensions of 
> the volume with each of the rows of the output {{outc1}} of the function, and 
> the third dimension is {{F1}}.  Thus, {{outc1}} has a number of columns equal 
> to {{F1*Houtc1*Wouc1}}.
> In the first scenario ({{scenario1.py}}), a random matrix {{doutc1}} is 
> created that should have the same dimensions as {{outc1}}.  For the columns, 
> if I use {{cols=ncol(outc1)}} in this rand statement, the size will be 
> propagated and CP ops will be compiled and run.  I I instead use 
> {{cols=F1*Houtc1*Woutc1}}, the size will forever be unknown, even during 
> recompilation, and thus Spark ops will be compiled and run.  I have included 
> the recompile hops plan ({{scenario1_plan.txt}}).
> In the second scenario ({{scenario2.py}}), a {{max_pool2d::forward(...)}} 
> function is inserted after the {{conv2d::forward(...)}} function that 
> requires the {{Houtc1}} and {{Woutc1}} variables to be supplied as arguments. 
>  Since those latter variables are not executed during compilation time, the 
> max pooling sizes remain unknown, even during recompilation, and thus Spark 
> ops will be compiled and run.  I have included the recompile hops plan 
> ({{scenario2_plan.txt}}).
> We should either improve or fix our constant folding rewrites so that these 
> scenarios are fixed, as they are necessary for performant deep learning 
> applications.  Note too that this issue will be present in other non-deep 
> learning scenarios as well.
> Mailing list thread: 
> https://www.mail-archive.com/dev@systemml.incubator.apache.org/msg01657.html



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Comment Edited] (SYSTEMML-1561) Improve constant folding during compilation

Reply via email to