[
https://issues.apache.org/jira/browse/MAHOUT-1791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dmitriy Lyubimov updated MAHOUT-1791:
-------------------------------------
Description:
As we know, we are still struggling with decisions which path to take for bare
metal accelerations in in-core math.
Meanwhile, a simple no-brainer improvement though is to add decision paths and
apply multithreaded matrix-matrix multiplication (and maybe even others; but
mmul perhaps is the most prominent beneficiary here at the moment which is both
easy to do and to have a statistically significant improvement)
So multithreaded logic addition to mmul is one path.
Another path is automatic adjustement of multithreading.
In front end, we probably want to utilize all cores available.
in the backend, we can oversubscribe cores but probably doing so by more than
2x or 3x is unadvisable because of point of diminishing returns driven by
growing likelihood of context switching overhead.
was:
As we know, we are still struggling with decisions which path to take for bare
metal accelerations in in-core math.
A simple no-brainer improvement though is to add decision paths and apply
multithreaded matrix-matrix multiplication (and maybe even others; but mmul
perhaps is the most prominent beneficiary here at the moment which is both easy
to do and to have a statistically significant improvement)
So multithreaded logic addition to mmul is one path.
Another path is automatic adjustement of multithreading.
In front end, we probably want to utilize all cores available.
in the backend, we can oversubscribe cores but probably doing so by more than
2x or 3x is unadvisable because of point of diminishing returns driven by
growing likelihood of context switching overhead.
> Automatic threading for java based mmul in the front end and the backend.
> -------------------------------------------------------------------------
>
> Key: MAHOUT-1791
> URL: https://issues.apache.org/jira/browse/MAHOUT-1791
> Project: Mahout
> Issue Type: Improvement
> Affects Versions: 0.11.1
> Reporter: Dmitriy Lyubimov
> Assignee: Dmitriy Lyubimov
> Fix For: 0.11.2
>
>
> As we know, we are still struggling with decisions which path to take for
> bare metal accelerations in in-core math.
> Meanwhile, a simple no-brainer improvement though is to add decision paths
> and apply multithreaded matrix-matrix multiplication (and maybe even others;
> but mmul perhaps is the most prominent beneficiary here at the moment which
> is both easy to do and to have a statistically significant improvement)
> So multithreaded logic addition to mmul is one path.
> Another path is automatic adjustement of multithreading.
> In front end, we probably want to utilize all cores available.
> in the backend, we can oversubscribe cores but probably doing so by more than
> 2x or 3x is unadvisable because of point of diminishing returns driven by
> growing likelihood of context switching overhead.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
