Jinyang Gao created SINGA-83:
--------------------------------
Summary: Param Hashing
Key: SINGA-83
URL: https://issues.apache.org/jira/browse/SINGA-83
Project: Singa
Issue Type: Improvement
Reporter: Jinyang Gao
Param hashing will be a very useful technique to reduce communication cost of
deep learning parameter. It can reduce the param size by 20x with little impact
on model accuracy. Further details can be seen in the following icml paper.
Research problems can be done after the second release.
http://arxiv.org/pdf/1504.04788.pdf
http://arxiv.org/pdf/1306.0543v2.pdf
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
