Re: NoSuchMethodError: cassandra.thrift.ITransportFactory.openTransport()
Add my message. On Tue, Oct 28, 2014 at 3:22 PM, Sasi [via Apache Spark User List] ml-node+s1001560n17471...@n3.nabble.com wrote: Thank you Akhil. You are correct it's about overlapped thrift libraries. We have taken reference from http://mail-archives.apache.org/mod_mbox/spark-user/201409.mbox/%3Cdf6cde12e07c47f58bc6829a7c2167d6%40CHCXEXCHMBX001.SEA.CORP.EXPECN.com%3E link and given libraries in following order - a) cassandra-driver-core-2.1.0.jar b) cassandra-thrift-2.1.0.jar c) libthrift-0.9.0.jar d) spark-cassandra-connector_2.10-1.1.0-alpha3.jar It resolved our issue. Sasi -- If you reply to this email, your message will be added to the discussion below: http://apache-spark-user-list.1001560.n3.nabble.com/NoSuchMethodError-cassandra-thrift-ITransportFactory-openTransport-tp17338p17471.html To unsubscribe from NoSuchMethodError: cassandra.thrift.ITransportFactory.openTransport(), click here http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=17338code=c2FzaWt1bWFyLjIzOEBnbWFpbC5jb218MTczMzh8LTE3NzQ3OTQzNTA= . NAML http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/NoSuchMethodError-cassandra-thrift-ITransportFactory-openTransport-tp17338p17481.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
NoSuchMethodError: cassandra.thrift.ITransportFactory.openTransport()
Apache Spark Team, We recently started experimenting with Apache Spark for high speed data retrieval. We downloaded Apache Spark Source Code; Installed Git; Packaged the assebly; Installed Scala and ran some examples mentioned in the documentation. We did all these steps on WindowsXP. Till this point, every thing seems to be fine. After that, we tried to connect Apache Spark with Cassandra. Downloaded Cassandra from DataStax and installed it. Developed small sample code for connecting to cassandra using https://github.com/datastax/spark-cassandra-connector/blob/b1.0/doc/0_quick_start.md link. During spark-submit, we faced some JARs related issue and we resolved them using --jars option for spark-submit. However, we stuck with NoSuchMethodError: cassandra.thrift.ITransportFactory.openTransport() Find enclosed image for the complete error. http://apache-spark-user-list.1001560.n3.nabble.com/file/n17338/Error.png We included following JARS using --jars option for spark-submit a) apache-cassandra-thrift-1.1.10.jar b) libthrift-0.9.0.jar c) spark-cassandra-connector_2.10-1.1.0-alpha3.jar d) cassandra-all-2.1.0.jar e) cassandra-clientutil-2.1.0.jar f) cassandra-driver-core-2.1.0.jar Are we missed any JAR file? or Is it the right way to connect Spark with Cassandra? Any guidance would be appreciated. Sasi -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/NoSuchMethodError-cassandra-thrift-ITransportFactory-openTransport-tp17338.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: NoSuchMethodError: cassandra.thrift.ITransportFactory.openTransport()
This can happen due to jar conflict, meaning one of the jar (possibly the first one apache-cassandra-thrift*jar) is having a class named *ITransportFactory *but it doesn't contain the method *openTransport()* in it. You can make sure the jar is having *ITransportFactory *class in it and it also has the method openTransport in it. Thanks Best Regards On Mon, Oct 27, 2014 at 3:30 PM, Sasi sasikumar@gmail.com wrote: Apache Spark Team, We recently started experimenting with Apache Spark for high speed data retrieval. We downloaded Apache Spark Source Code; Installed Git; Packaged the assebly; Installed Scala and ran some examples mentioned in the documentation. We did all these steps on WindowsXP. Till this point, every thing seems to be fine. After that, we tried to connect Apache Spark with Cassandra. Downloaded Cassandra from DataStax and installed it. Developed small sample code for connecting to cassandra using https://github.com/datastax/spark-cassandra-connector/blob/b1.0/doc/0_quick_start.md link. During spark-submit, we faced some JARs related issue and we resolved them using --jars option for spark-submit. However, we stuck with NoSuchMethodError: cassandra.thrift.ITransportFactory.openTransport() Find enclosed image for the complete error. http://apache-spark-user-list.1001560.n3.nabble.com/file/n17338/Error.png We included following JARS using --jars option for spark-submit a) apache-cassandra-thrift-1.1.10.jar b) libthrift-0.9.0.jar c) spark-cassandra-connector_2.10-1.1.0-alpha3.jar d) cassandra-all-2.1.0.jar e) cassandra-clientutil-2.1.0.jar f) cassandra-driver-core-2.1.0.jar Are we missed any JAR file? or Is it the right way to connect Spark with Cassandra? Any guidance would be appreciated. Sasi -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/NoSuchMethodError-cassandra-thrift-ITransportFactory-openTransport-tp17338.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: NoSuchMethodError: cassandra.thrift.ITransportFactory.openTransport()
Hi Sasi, Thrift is not needed to integrate Cassandra with Spark. In fact the only dep you need is spark-cassandra-connector_2.10-1.1.0-alpha3.jar, and you can upgrade to alpha4; we’re publishing beta very soon. For future reference, questions/tickets can be created here:https://github.com/datastax/spark-cassandra-connector/issues. Thanks, - Helena @helenaedelson On Oct 27, 2014, at 6:00 AM, Sasi sasikumar@gmail.com wrote: Apache Spark Team, We recently started experimenting with Apache Spark for high speed data retrieval. We downloaded Apache Spark Source Code; Installed Git; Packaged the assebly; Installed Scala and ran some examples mentioned in the documentation. We did all these steps on WindowsXP. Till this point, every thing seems to be fine. After that, we tried to connect Apache Spark with Cassandra. Downloaded Cassandra from DataStax and installed it. Developed small sample code for connecting to cassandra using https://github.com/datastax/spark-cassandra-connector/blob/b1.0/doc/0_quick_start.md link. During spark-submit, we faced some JARs related issue and we resolved them using --jars option for spark-submit. However, we stuck with NoSuchMethodError: cassandra.thrift.ITransportFactory.openTransport() Find enclosed image for the complete error. http://apache-spark-user-list.1001560.n3.nabble.com/file/n17338/Error.png We included following JARS using --jars option for spark-submit a) apache-cassandra-thrift-1.1.10.jar b) libthrift-0.9.0.jar c) spark-cassandra-connector_2.10-1.1.0-alpha3.jar d) cassandra-all-2.1.0.jar e) cassandra-clientutil-2.1.0.jar f) cassandra-driver-core-2.1.0.jar Are we missed any JAR file? or Is it the right way to connect Spark with Cassandra? Any guidance would be appreciated. Sasi -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/NoSuchMethodError-cassandra-thrift-ITransportFactory-openTransport-tp17338.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
