Thanks for the information, I have no any issue on connect my local Cassandra server, However I still has issue on connect my company dev server. What’s need to do to resolve this issue. Thanks so much.
-Vincent From: Ankur Srivastava [mailto:ankur.srivast...@gmail.com] Sent: Thursday, January 29, 2015 8:02 PM To: Sun, Vincent Y Cc: user@spark.apache.org Subject: Re: Connecting Cassandra by unknow host Hi, I am no expert but have a small application working with Spark and Cassandra. I faced these issues when we were deploying our cluster on EC2 instances with some machines on public network and some on private. This seems to be a similar issue as you are trying to connect to "10.34.224.249" which is a private IP but the address you get in the error message is a public IP "30.247.7.8". If you want to connect to public IP ensure that your network settings allow you to connect using spark cluster's public IP on the port 9042. Hope this helps!! Thanks Ankur On Thu, Jan 29, 2015 at 1:33 PM, oxpeople <vincent.y....@bankofamerica.com<mailto:vincent.y....@bankofamerica.com>> wrote: I have the code set up the Cassandra SparkConf conf = new SparkConf(true); conf.setAppName("Java cassandra R&D"); conf.set(*"spark.cassandra.connection.host", "10.34.224.249"*); but I got log try to connect different host. 15/01/29 16:16:42 INFO NettyBlockTransferService: Server created on 62002 15/01/29 16:16:42 INFO BlockManagerMaster: Trying to register BlockManager 15/01/29 16:16:42 INFO BlockManagerMasterActor: Registering block manager F6C3BE5F7042A.corp.com:62002<http://F6C3BE5F7042A.corp.com:62002> with 975.5 MB RAM, BlockManagerId(<driver>, F6C3BE5F7042A.corp.com<http://F6C3BE5F7042A.corp.com>, 62002) 15/01/29 16:16:42 INFO BlockManagerMaster: Registered BlockManager 15/01/29 16:16:42 INFO SparkDeploySchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.0 15/01/29 16:16:44 INFO SparkDeploySchedulerBackend: Registered executor: Actor[akka.tcp://sparkexecu...@f6c3be5f7042a.corp.com:62064/user/Executor#-184690467<http://sparkexecu...@f6c3be5f7042a.corp.com:62064/user/Executor#-184690467>] with ID 0 15/01/29 16:16:44 INFO BlockManagerMasterActor: Registering block manager F6C3BE5F7042A.corp.com:62100<http://F6C3BE5F7042A.corp.com:62100> with 265.4 MB RAM, BlockManagerId(0, F6C3BE5F7042A.corp, 62100) Exception in thread "main" java.io.IOException: Failed to open native connection to Cassandra at *{30.247.7.8}:9042* at com.datastax.spark.connector.cql.CassandraConnector$.com$datastax$spark$connector$cql$CassandraConnector$$createSession(CassandraConnector.scala:174) at com.datastax.spark.connector.cql.CassandraConnector$$anonfun$2.apply(CassandraConnector.scala:160) at com.datastax.spark.connector.cql.CassandraConnector$$anonfun$2.apply(CassandraConnector.scala:160) at com.datastax.spark.connector.cql.RefCountedCache.createNewValueAndKeys(RefCountedCache.scala:36) at com.datastax.spark.connector.cql.RefCountedCache.acquire(RefCountedCache.scala:61) at com.datastax.spark.connector.cql.CassandraConnector.openSession(CassandraConnector.scala:71) at com.datastax.spark.connector.cql.CassandraConnector.withSessionDo(CassandraConnector.scala:97) at com.datastax.spark.connector.cql.CassandraConnector.withClusterDo(CassandraConnector.scala:108) at com.datastax.spark.connector.cql.Schema$.fromCassandra(Schema.scala:134) at com.datastax.spark.connector.rdd.CassandraRDD.tableDef$lzycompute(CassandraRDD.scala:240) at com.datastax.spark.connector.rdd.CassandraRDD.tableDef(CassandraRDD.scala:239) at com.datastax.spark.connector.rdd.CassandraRDD.verify$lzycompute(CassandraRDD.scala:298) at com.datastax.spark.connector.rdd.CassandraRDD.verify(CassandraRDD.scala:295) at com.datastax.spark.connector.rdd.CassandraRDD.getPartitions(CassandraRDD.scala:324) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:205) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:203) at scala.Option.getOrElse(Option.scala:120) at org.apache.spark.rdd.RDD.partitions(RDD.scala:203) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1328) at org.apache.spark.rdd.RDD.collect(RDD.scala:780) at org.apache.spark.api.java.JavaRDDLike$class.collect(JavaRDDLike.scala:309) at org.apache.spark.api.java.JavaPairRDD.collect(JavaPairRDD.scala:45) at com.bof.spark.cassandra.JavaSparkCassandraTest.run(JavaSparkCassandraTest.java:41) at com.bof.spark.cassandra.JavaSparkCassandraTest.main(JavaSparkCassandraTest.java:70) Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /30.247.7.8:9042<http://30.247.7.8:9042> (com.datastax.driver.core.TransportException: [/30.247.7.8:9042<http://30.247.7.8:9042>] Cannot connect)) at com.datastax.driver.core.ControlConnection.reconnectInternal(ControlConnection.java:220) at com.datastax.driver.core.ControlConnection.connect(ControlConnection.java:78) at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1231) at com.datastax.driver.core.Cluster.getMetadata(Cluster.java:334) at com.datastax.spark.connector.cql.CassandraConnector$.com$datastax$spark$connector$cql$CassandraConnector$$createSession(CassandraConnector.scala:167) ... 23 more Any helping is appreciated. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Connecting-Cassandra-by-unknow-host-tp21424.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org<mailto:user-unsubscr...@spark.apache.org> For additional commands, e-mail: user-h...@spark.apache.org<mailto:user-h...@spark.apache.org> ---------------------------------------------------------------------- This message, and any attachments, is for the intended recipient(s) only, may contain information that is privileged, confidential and/or proprietary and subject to important terms and conditions available at http://www.bankofamerica.com/emaildisclaimer. If you are not the intended recipient, please delete this message.
