[
https://issues.apache.org/jira/browse/MAHOUT-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14016901#comment-14016901
]
Dmitriy Lyubimov commented on MAHOUT-1529:
------------------------------------------
[~gokhancapan] As i explained before, i don't favor common hierarchy for
matrices with vastly different programming models. I can roll about a dozen of
bona-fide arguments as to why, but i am kind of tired speaking on the topic.
Main inference of this work is that common algebraic traits are semantically
identical but are not always identical in signatures and more over these
signature mis-identities do not necessary follow any functional split. This
makes common hierarchies inelegant. Second takeaway from this work is that DSL
features + IDEA scala plugin are more than a match for OOA approach as far as
readability and maintainability is concerned. If we go by Straustrup's circa
1989 claim that OOA is nothing but code organization for maintainability
purposes, then DSL renders strict OOA design moot.
> Finalize abstraction of distributed logical plans from backend operations
> -------------------------------------------------------------------------
>
> Key: MAHOUT-1529
> URL: https://issues.apache.org/jira/browse/MAHOUT-1529
> Project: Mahout
> Issue Type: Improvement
> Reporter: Dmitriy Lyubimov
> Assignee: Dmitriy Lyubimov
> Fix For: 1.0
>
>
> We have a few situations when algorithm-facing API has Spark dependencies
> creeping in.
> In particular, we know of the following cases:
> -(1) checkpoint() accepts Spark constant StorageLevel directly;-
> -(2) certain things in CheckpointedDRM;-
> -(3) drmParallelize etc. routines in the "drm" and "sparkbindings" package.-
> -(5) drmBroadcast returns a Spark-specific Broadcast object-
> (6) Stratosphere/Flink conceptual api changes.
> *Current tracker:* PR #1 https://github.com/apache/mahout/pull/1 - closed,
> need new PR for remaining things once ready.
> *Pull requests are welcome*.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
