Hi Sasi, Thrift is not needed to integrate Cassandra with Spark. In fact the only dep you need is spark-cassandra-connector_2.10-1.1.0-alpha3.jar, and you can upgrade to alpha4; we’re publishing beta very soon. For future reference, questions/tickets can be created here:https://github.com/datastax/spark-cassandra-connector/issues.
Thanks, - Helena @helenaedelson On Oct 27, 2014, at 6:00 AM, Sasi <sasikumar....@gmail.com> wrote: > Apache Spark Team, > > We recently started experimenting with Apache Spark for high speed data > retrieval. We downloaded Apache Spark Source Code; Installed Git; Packaged > the assebly; Installed Scala and ran some examples mentioned in the > documentation. We did all these steps on WindowsXP. Till this point, every > thing seems to be fine. > > After that, we tried to connect Apache Spark with Cassandra. Downloaded > Cassandra from DataStax and installed it. Developed small sample code for > connecting to cassandra using > https://github.com/datastax/spark-cassandra-connector/blob/b1.0/doc/0_quick_start.md > link. During "spark-submit", we faced some JARs related issue and we > resolved them using "--jars" option for spark-submit. However, we stuck with > NoSuchMethodError: cassandra.thrift.ITransportFactory.openTransport() > > Find enclosed image for the complete error. > <http://apache-spark-user-list.1001560.n3.nabble.com/file/n17338/Error.png> > > We included following JARS using "--jars" option for "spark-submit" > a) apache-cassandra-thrift-1.1.10.jar > b) libthrift-0.9.0.jar > c) spark-cassandra-connector_2.10-1.1.0-alpha3.jar > d) cassandra-all-2.1.0.jar > e) cassandra-clientutil-2.1.0.jar > f) cassandra-driver-core-2.1.0.jar > > Are we missed any JAR file? or Is it the right way to connect Spark with > Cassandra? Any guidance would be appreciated. > > Sasi > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/NoSuchMethodError-cassandra-thrift-ITransportFactory-openTransport-tp17338.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org >
