[jira] [Updated] (SPARK-11115) Host verification is not correct for IPv6
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-5: - Priority: Major (was: Critical) > Host verification is not correct for IPv6 > - > > Key: SPARK-5 > URL: https://issues.apache.org/jira/browse/SPARK-5 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 1.5.1 > Environment: CentOS 6.7, Java 1.8.0_25, dual stack IPv4 + IPv6 >Reporter: Thomas Dudziak >Priority: Major > Labels: starter > > When running Spark with -Djava.net.preferIPv6Addresses=true, I get this error: > 15/10/14 14:36:01 ERROR SparkContext: Error initializing SparkContext. > java.lang.AssertionError: assertion failed: Expected hostname > at scala.Predef$.assert(Predef.scala:179) > at org.apache.spark.util.Utils$.checkHost(Utils.scala:805) > at > org.apache.spark.storage.BlockManagerId.(BlockManagerId.scala:48) > at > org.apache.spark.storage.BlockManagerId$.apply(BlockManagerId.scala:107) > at > org.apache.spark.storage.BlockManager.initialize(BlockManager.scala:190) > at org.apache.spark.SparkContext.(SparkContext.scala:528) > at > org.apache.spark.repl.SparkILoop.createSparkContext(SparkILoop.scala:1017) > Looking at the code in question, it seems that the code will only work for > IPv4 as it assumes ':' can't be part of the hostname (which it clearly can > for IPv6 addresses). > Instead, the code should probably use Guava's HostAndPort class, i.e.: > def checkHost(host: String, message: String = "") { > assert(!HostAndPort.fromString(host).hasPort, message) > } > def checkHostPort(hostPort: String, message: String = "") { > assert(HostAndPort.fromString(hostPort).hasPort, message) > } -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-11115) Host verification is not correct for IPv6
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5: -- Labels: starter (was: ) > Host verification is not correct for IPv6 > - > > Key: SPARK-5 > URL: https://issues.apache.org/jira/browse/SPARK-5 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 1.5.1 > Environment: CentOS 6.7, Java 1.8.0_25, dual stack IPv4 + IPv6 >Reporter: Thomas Dudziak >Priority: Critical > Labels: starter > > When running Spark with -Djava.net.preferIPv6Addresses=true, I get this error: > 15/10/14 14:36:01 ERROR SparkContext: Error initializing SparkContext. > java.lang.AssertionError: assertion failed: Expected hostname > at scala.Predef$.assert(Predef.scala:179) > at org.apache.spark.util.Utils$.checkHost(Utils.scala:805) > at > org.apache.spark.storage.BlockManagerId.(BlockManagerId.scala:48) > at > org.apache.spark.storage.BlockManagerId$.apply(BlockManagerId.scala:107) > at > org.apache.spark.storage.BlockManager.initialize(BlockManager.scala:190) > at org.apache.spark.SparkContext.(SparkContext.scala:528) > at > org.apache.spark.repl.SparkILoop.createSparkContext(SparkILoop.scala:1017) > Looking at the code in question, it seems that the code will only work for > IPv4 as it assumes ':' can't be part of the hostname (which it clearly can > for IPv6 addresses). > Instead, the code should probably use Guava's HostAndPort class, i.e.: > def checkHost(host: String, message: String = "") { > assert(!HostAndPort.fromString(host).hasPort, message) > } > def checkHostPort(hostPort: String, message: String = "") { > assert(HostAndPort.fromString(hostPort).hasPort, message) > } -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-11115) Host verification is not correct for IPv6
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5: Summary: Host verification is not correct for IPv6 (was: IPv6 regression) > Host verification is not correct for IPv6 > - > > Key: SPARK-5 > URL: https://issues.apache.org/jira/browse/SPARK-5 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 1.5.1 > Environment: CentOS 6.7, Java 1.8.0_25, dual stack IPv4 + IPv6 >Reporter: Thomas Dudziak >Priority: Critical > > When running Spark with -Djava.net.preferIPv6Addresses=true, I get this error: > 15/10/14 14:36:01 ERROR SparkContext: Error initializing SparkContext. > java.lang.AssertionError: assertion failed: Expected hostname > at scala.Predef$.assert(Predef.scala:179) > at org.apache.spark.util.Utils$.checkHost(Utils.scala:805) > at > org.apache.spark.storage.BlockManagerId.(BlockManagerId.scala:48) > at > org.apache.spark.storage.BlockManagerId$.apply(BlockManagerId.scala:107) > at > org.apache.spark.storage.BlockManager.initialize(BlockManager.scala:190) > at org.apache.spark.SparkContext.(SparkContext.scala:528) > at > org.apache.spark.repl.SparkILoop.createSparkContext(SparkILoop.scala:1017) > Looking at the code in question, it seems that the code will only work for > IPv4 as it assumes ':' can't be part of the hostname (which it clearly can > for IPv6 addresses). > Instead, the code should probably use Guava's HostAndPort class, i.e.: > def checkHost(host: String, message: String = "") { > assert(!HostAndPort.fromString(host).hasPort, message) > } > def checkHostPort(hostPort: String, message: String = "") { > assert(HostAndPort.fromString(hostPort).hasPort, message) > } -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org