[
https://issues.apache.org/jira/browse/MAHOUT-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dmitriy Lyubimov updated MAHOUT-1529:
-------------------------------------
Description:
We have a few situations when algorithm-facing API has Spark dependencies
creeping in.
In particular, we know of the following cases:
(1) checkpoint() accepts Spark constant StorageLevel directly;
(2) certain things in CheckpointedDRM;
(3) drmParallelize etc. routines in the "drm" and "sparkbindings" package.
-(5) drmBroadcast returns a Spark-specific Broadcast object-
*Current tracker:* https://github.com/dlyubimov/mahout-commits/tree/MAHOUT-1529.
*Pull requests are welcome*.
was:
We have a few situations when algorithm-facing API has Spark dependencies
creeping in.
In particular, we know of the following cases:
(1) checkpoint() accepts Spark constant StorageLevel directly;
(2) certain things in CheckpointedDRM;
(3) drmParallelize etc. routines in the "drm" and "sparkbindings" package.
+(5) drmBroadcast returns a Spark-specific Broadcast object+
*Current tracker:* https://github.com/dlyubimov/mahout-commits/tree/MAHOUT-1529.
*Pull requests are welcome*.
> Finalize abstraction of distributed logical plans from backend operations
> -------------------------------------------------------------------------
>
> Key: MAHOUT-1529
> URL: https://issues.apache.org/jira/browse/MAHOUT-1529
> Project: Mahout
> Issue Type: Improvement
> Reporter: Dmitriy Lyubimov
> Fix For: 1.0
>
>
> We have a few situations when algorithm-facing API has Spark dependencies
> creeping in.
> In particular, we know of the following cases:
> (1) checkpoint() accepts Spark constant StorageLevel directly;
> (2) certain things in CheckpointedDRM;
> (3) drmParallelize etc. routines in the "drm" and "sparkbindings" package.
> -(5) drmBroadcast returns a Spark-specific Broadcast object-
> *Current tracker:*
> https://github.com/dlyubimov/mahout-commits/tree/MAHOUT-1529.
> *Pull requests are welcome*.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
