[ https://issues.apache.org/jira/browse/MAHOUT-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13990121#comment-13990121 ]
Anand Avati commented on MAHOUT-1544: ------------------------------------- Ah, I have been testing with just the matrix multiply operators and they work fine. The issue shows with custom code coming with mapBlock(). Investigating more. IDE-specific files came probably because 'diff' represents rename of directory from 'spark-shell' to 'spark' as deletion and creation of all files inside. My code changes are done only through emacs. > make Mahout DSL shell depend dynamically on Spark > ------------------------------------------------- > > Key: MAHOUT-1544 > URL: https://issues.apache.org/jira/browse/MAHOUT-1544 > Project: Mahout > Issue Type: Improvement > Reporter: Anand Avati > Fix For: 1.0 > > Attachments: 0001-spark-shell-rename-to-shell.patch, > 0002-shell-make-dependency-on-Spark-optional-and-dynamic.patch, > 0002-shell-make-dependency-on-Spark-optional-and-dynamic.patch, > 0002-shell-make-dependency-on-Spark-optional-and-dynamic.patch > > > Today the Mahout's scala shell depends on spark. > Create a cleaner separation between the shell and Spark. For e.g, the in core > scalabindings and operators do not need Spark. So make Spark a runtime > "addon" to the shell. Similarly in the future new distributed backend engines > can transparently (dynamically) be available through the DSL shell. > The new shell works, looks and feels exactly like the shell before, but has a > cleaner modular architecture. -- This message was sent by Atlassian JIRA (v6.2#6252)