[ 
https://issues.apache.org/jira/browse/MAHOUT-1800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184432#comment-15184432
 ] 

Hudson commented on MAHOUT-1800:
--------------------------------

FAILURE: Integrated in Mahout-Quality #3309 (See 
[https://builds.apache.org/job/Mahout-Quality/3309/])
MAHOUT-1800: Pare down Casstag overuse closes apache/mahout#183 (apalumbo: rev 
6919fd9febe1585d15e78e51aabcad8fa29235f3)
* 
spark/src/main/scala/org/apache/mahout/sparkbindings/drm/CheckpointedDrmSparkOps.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/SparkEngine.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAtA.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/MapBlock.scala
* spark/src/main/scala/org/apache/mahout/drivers/TrainNBDriver.scala
* math-scala/src/main/scala/org/apache/mahout/math/decompositions/DQR.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpMapBlock.scala
* 
math-scala/src/main/scala/org/apache/mahout/math/drm/logical/AbstractUnaryOp.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAtx.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpABAnyKey.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/CheckpointedOps.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAB.scala
* math-scala/src/main/scala/org/apache/mahout/math/decompositions/ALS.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpCbind.scala
* 
math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpTimesLeftMatrix.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/DistributedEngine.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/CbindAB.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/Ax.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpRowRange.scala
* 
math-scala/src/main/scala/org/apache/mahout/classifier/naivebayes/NaiveBayes.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/DrmRddOps.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAtAnyKey.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAtB.scala
* math-scala/src/main/scala/org/apache/mahout/math/decompositions/DSSVD.scala
* 
math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpCbindScalar.scala
* 
math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpTimesRightMatrix.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpABt.scala
* 
math-scala/src/main/scala/org/apache/mahout/math/drm/logical/CheckpointAction.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/DrmLikeOps.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/RLikeDrmOps.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/Par.scala
* math-scala/src/test/scala/org/apache/mahout/math/drm/DrmLikeOpsSuiteBase.scala
* h2o/src/main/scala/org/apache/mahout/h2obindings/H2OEngine.scala
* 
math-scala/src/main/scala/org/apache/mahout/math/drm/logical/AbstractBinaryOp.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/package.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAt.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAewB.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpPar.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/package.scala
* math-scala/src/main/scala/org/apache/mahout/math/decompositions/DSPCA.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAx.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/drm/package.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/CheckpointedDrm.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAewScalar.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/AewB.scala
* 
math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAewUnaryFuncFusion.scala
* 
math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAewUnaryFunc.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/DrmLike.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/RbindAB.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/ABt.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpRbind.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/AinCoreB.scala
* 
spark/src/main/scala/org/apache/mahout/classifier/naivebayes/SparkNaiveBayes.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/package.scala


> Pare down Casstag overuse
> -------------------------
>
>                 Key: MAHOUT-1800
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1800
>             Project: Mahout
>          Issue Type: Improvement
>    Affects Versions: 0.11.1
>            Reporter: Andrew Palumbo
>             Fix For: 0.11.2
>
>
> currently, almost every operator requires implicit parameter for the classtag 
> context bound of drm rowset key type, even for things like drmA + drmB.
> in reality though DAG can already infer that similarly to e.g. it infers 
> product geometry because classtags are already embedded in the logical plan. 
> for example, {{classtag(drmA+drmB) == classtag(drmA) == classtag(drmB)}}. 
> Not only does the DAG already contain this information, but also it opens 
> doors to a loss of inference, since the optimizer doesn't verify that the new 
> context bound is actually valid by retracing the inference. So any operation 
> may introduce an invalid row key type, and as a consequence, invalid 
> optimization information, without any further checks. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to