[
https://issues.apache.org/jira/browse/MAHOUT-1791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271648#comment-15271648
]
Dmitriy Lyubimov commented on MAHOUT-1791:
------------------------------------------
experiments show that native solvers + 2x backend threads per task creates good
cpu saturation balance.
ditto all-core threads for the front-end
> Automatic threading for java based mmul in the front end and the backend.
> -------------------------------------------------------------------------
>
> Key: MAHOUT-1791
> URL: https://issues.apache.org/jira/browse/MAHOUT-1791
> Project: Mahout
> Issue Type: Improvement
> Affects Versions: 0.11.1, 0.12.0, 0.11.2
> Reporter: Dmitriy Lyubimov
> Assignee: Andrew Musselman
> Fix For: 0.12.1
>
>
> As we know, we are still struggling with decisions which path to take for
> bare metal accelerations in in-core math.
> Meanwhile, a simple no-brainer improvement though is to add decision paths
> and apply multithreaded matrix-matrix multiplication (and maybe even others;
> but mmul perhaps is the most prominent beneficiary here at the moment which
> is both easy to do and to have a statistically significant improvement)
> So multithreaded logic addition to mmul is one path.
> Another path is automatic adjustment of multithreading.
> In front end, we probably want to utilize all cores available.
> in the backend, we can oversubscribe cores but probably doing so by more than
> 2x or 3x is unadvisable because of point of diminishing returns driven by
> growing likelihood of context switching overhead.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
