[
https://issues.apache.org/jira/browse/MAHOUT-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15234716#comment-15234716
]
Hudson commented on MAHOUT-1570:
--------------------------------
FAILURE: Integrated in Mahout-Quality #3324 (See
[https://builds.apache.org/job/Mahout-Quality/3324/])
MAHOUT-1570: initial skeleton for Mahout DSL on Apache Flink
(alexey.s.grigoriev: rev bb4c4bcaf452d67b75b3c8d7c500cca6aeb31036)
* pom.xml
* flink/src/main/scala/org/apache/mahout/flinkbindings/package.scala
* flink/pom.xml
* flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkEngine.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/DistributedContext.scala
*
flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkDistributedContext.scala
MAHOUT-1570: Flink: calculating ncol, nrow; colSum, colMean, norm
(alexey.s.grigoriev: rev df1db7cc775ed5e10c6416e033e25e430ffdd171)
*
flink/src/main/scala/org/apache/mahout/flinkbindings/drm/CheckpointedFlinkDrm.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkEngine.scala
MAHOUT-1570: rebased to latest upstream (alexey.s.grigoriev: rev
de732d4bc7fae9d4719ecba54decd14376551344)
* flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkEngine.scala
MAHOUT-1570: upgraded to flink 0.9-SNAPSHOT for IO (alexey.s.grigoriev: rev
1806ca809beb2312c62e83b3dbab314b90172118)
* flink/src/test/scala/org/apache/mahout/flinkbindings/RLikeOpsSuite.scala
* flink/src/test/scala/org/apache/mahout/flinkbindings/blas/LATestSuit.scala
* pom.xml
* flink/src/main/resources/log4j.properties
* flink/pom.xml
MAHOUT-1570: Flink: added headers, comments and aknowledgements
(alexey.s.grigoriev: rev 58f79489129c73b9a4bd7cd5a503cfaf723ccaef)
* flink/src/main/scala/org/apache/mahout/flinkbindings/package.scala
* flink/src/test/scala/org/apache/mahout/flinkbindings/RLikeOpsSuite.scala
*
flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkDistributedContext.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/io/DrmMetadata.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpCBind.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/io/HDFSPathSearch.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkEngine.scala
*
flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpTimesRightMatrix.scala
*
flink/src/test/scala/org/apache/mahout/flinkbindings/examples/ReadCsvExample.scala
*
flink/src/main/scala/org/apache/mahout/flinkbindings/drm/CheckpointedFlinkDrm.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/drm/FlinkDrm.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/blas/package.scala
* flink/src/test/scala/org/apache/mahout/flinkbindings/blas/LATestSuit.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAewB.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/io/Hadoop1HDFSUtil.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAt.scala
*
flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpMapBlock.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/DataSetOps.scala
*
flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpRowRange.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpRBind.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAtB.scala
*
flink/src/test/scala/org/apache/mahout/flinkbindings/DistributedFlinkSuit.scala
* flink/src/test/scala/org/apache/mahout/flinkbindings/UseCasesSuite.scala
*
flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAewScalar.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAx.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/io/HDFSUtil.scala
MAHOUT-1570: rebased to latest upstream (alexey.s.grigoriev: rev
8de8b798f0ffa374c2b18e00b8130ac0a0d8e918)
*
flink/src/test/scala/org/apache/mahout/flinkbindings/DistributedFlinkSuit.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkEngine.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkByteBCast.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/package.scala
MAHOUT-1570: Flink: imports cleaned (alexey.s.grigoriev: rev
851eebcb648752f1a3bff08191d19ce3d6f66ab5)
* flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAt.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/drm/FlinkDrm.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkEngine.scala
*
flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpTimesRightMatrix.scala
*
flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpMapBlock.scala
*
flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpRowRange.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAewB.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpCBind.scala
*
flink/src/main/scala/org/apache/mahout/flinkbindings/drm/CheckpointedFlinkDrm.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpRBind.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAtB.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAx.scala
MAHOUT-1570: Flink: nrow and ncol optimized (alexey.s.grigoriev: rev
be815fb25f4c008bf3809bb444e3d8562dea96fa)
*
flink/src/main/scala/org/apache/mahout/flinkbindings/drm/CheckpointedFlinkDrm.scala
MAHOUT-1570: rebased to latest upstream (alexey.s.grigoriev: rev
4bafc76276ff3d6a3eb1687d4d1c3f834671a482)
* flink/pom.xml
MAHOUT-1570: Flink: drmParallelizeEmpty and extra tests (alexey.s.grigoriev:
rev d13f48849ad5658cc03acea57f7c5d9d14bad137)
* flink/src/test/scala/org/apache/mahout/flinkbindings/DrmLikeOpsSuite.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkEngine.scala
MAHOUT-1570: Flink: numNonZeroElementsPerColumn (alexey.s.grigoriev: rev
35426a96b98bb74538466318c5347d2f90415e97)
* flink/src/test/scala/org/apache/mahout/flinkbindings/DrmLikeOpsSuite.scala
* flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkEngine.scala
MAHOUT-1570: fixed maven issue (a.grigorev: rev
c72698aca16368c4f16d5181fbdd3db6314c04e3)
* flink/pom.xml
> Adding support for Apache Flink as a backend for the Mahout DSL
> ---------------------------------------------------------------
>
> Key: MAHOUT-1570
> URL: https://issues.apache.org/jira/browse/MAHOUT-1570
> Project: Mahout
> Issue Type: Improvement
> Components: Flink
> Affects Versions: 0.11.2
> Reporter: Till Rohrmann
> Assignee: Suneel Marthi
> Labels: DSL, flink, scala
> Fix For: 0.12.0
>
>
> With the finalized abstraction of the Mahout DSL plans from the backend
> operations (MAHOUT-1529), it should be possible to integrate further backends
> for the Mahout DSL. Apache Flink would be a suitable candidate to act as a
> good execution backend.
> With respect to the implementation, the biggest difference between Spark and
> Flink at the moment is probably the incremental rollout of plans, which is
> triggered by Spark's actions and which is not supported by Flink yet.
> However, the Flink community is working on this issue. For the moment, it
> should be possible to circumvent this problem by writing intermediate results
> required by an action to HDFS and reading from there.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
