Janardhan created SYSTEMML-2041: ----------------------------------- Summary: Implement Block-Sparse GPU Kernels Key: SYSTEMML-2041 URL: https://issues.apache.org/jira/browse/SYSTEMML-2041 Project: SystemML Issue Type: New Feature Components: Infrastructure Reporter: Janardhan Attachments: GPU Kernels for Block-Sparse Weights.pdf
Sparsity enables, for example, training of neural networks that are much wider and deeper than otherwise possible with a given parameter budget and computational budget, such as LSTMs with tens of thousands of hidden units. (The largest LSTMs trained today are only thousands of hidden units.) *Resource:* TensorFlow implemented repo - https://github.com/openai/blocksparse -- This message was sent by Atlassian JIRA (v6.4.14#64029)