Hi,
I’m trying to connect my tableau to spark sql. Using this guide
https://community.tableau.com/docs/DOC-7638.
Then I’m try start thrift server (or $SPARK_HOME/sbin/start-thriftserver.sh
--master spark://data01:7077 --driver-class-path $CLASSPATH --hiveconf
hive.server2.thrift.bind.host
Hi, I can’t filter my rdd.
def filter1(tp: ((Array[String], Int), (Array[String], Int))): Boolean= {
tp._1._2 > tp._2._2
}
val mail_rdd = sc.parallelize(A.toSeq).cache()
val step1 = mail_rdd.cartesian(mail_rdd)
val step2 = step1.filter(filter1)
Get error “Class not found”. What I’m doing
step2 = step1.filter(filter1)
//step1.collect().foreach(println)
}
}
From: Harsh J [mailto:ha...@cloudera.com]
Sent: Thursday, December 10, 2015 2:50 PM
To: Бобров Виктор <ma...@bk.ru>; Ndjido Ardo Bar <ndj...@gmail.com>
Cc: user@spark.apache.org
Subject: Re: Can't filter
filter(RDD.scala:330)"
13 = {StackTraceElement@7145}
"SimpleApp$GeneratedEvaluatorClass$44$1.invoke(FileToCompile0.scala:30)"
14 = {StackTraceElement@7146} "SimpleApp$.main(test1.scala:26)"
15 = {StackTraceElement@7147} "SimpleApp.main(test1.scala)"
From: N
treaming_2.11" % "1.5.1",
"org.apache.spark" % "spark-mllib_2.11" % "1.5.1"
From: Бобров Виктор [mailto:ma...@bk.ru]
Sent: Thursday, December 10, 2015 2:54 PM
To: 'Harsh J' <ha...@cloudera.com>
Cc: user@spark.apache.org
Subject:
