[
https://issues.apache.org/jira/browse/MAHOUT-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856618#comment-15856618
]
ASF GitHub Bot commented on MAHOUT-1894:
----------------------------------------
Github user skanjila commented on the issue:
https://github.com/apache/mahout/pull/271
And here's the results for spark 2.1.0
saikan@dsexperiments:~/code/mahout$ MASTER=local[4] ./bin/mahout spark-shell
Using Spark's default log4j profile:
org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use
setLogLevel(newLevel).
17/02/07 19:27:59 WARN SparkContext: Support for Java 7 is deprecated as of
Spark 2.0.0
17/02/07 19:27:59 WARN NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
17/02/07 19:28:05 WARN ObjectStore: Failed to get database global_temp,
returning NoSuchObjectException
Spark context Web UI available at http://10.4.9.4:4040
Spark context available as 'sc' (master = local[4], app id =
local-1486495680739).
Spark session available as 'spark'.
Loading /home/saikan/code/mahout/bin/load-shell.scala...
import org.apache.mahout.math._
import org.apache.mahout.math.scalabindings._
import org.apache.mahout.math.drm._
import org.apache.mahout.math.scalabindings.RLikeOps._
import org.apache.mahout.math.drm.RLikeDrmOps._
import org.apache.mahout.sparkbindings._
sdc: org.apache.mahout.sparkbindings.SparkDistributedContext =
org.apache.mahout.sparkbindings.SparkDistributedContext@3ea6753e
_ _
_ __ ___ __ _| |__ ___ _ _| |_
'_ ` _ \ / _` | '_ \ / _ \| | | | __|
| | | | (_| | | | | (_) | |_| | |_
_| |_| |_|\__,_|_| |_|\___/ \__,_|\__| version 0.13.0
That file does not exist
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.1.0
/_/
Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java
1.7.0_80)
Type in expressions to have them evaluated.
Type :help for more information.
scala>
I would highly recommend we come up with a beefy set of tests to validate
the shell further, thoughts on which set of operations to consider other than
OLS?
> Add support for Spark 2x backend
> --------------------------------
>
> Key: MAHOUT-1894
> URL: https://issues.apache.org/jira/browse/MAHOUT-1894
> Project: Mahout
> Issue Type: Task
> Components: spark
> Affects Versions: 0.13.0
> Reporter: Suneel Marthi
> Assignee: Trevor Grant
> Priority: Critical
> Fix For: 1.0.0, 0.13.0, 0.14.0
>
>
> add support for Spark 2.x as backend execution engine.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
