Re: Spark (K8S) IPv6 support

2022-07-14 Thread Sean Owen
I don't know about the state of IPv6 support, but yes you're right in guessing that 3.4.0 might be released perhaps early next year. You can always clone the source repo and build it! On Thu, Jul 14, 2022 at 2:19 PM Valer wrote: > Hi, > > We're starting to use IPv6-only K8S cluster (E

Spark (K8S) IPv6 support

2022-07-14 Thread Valer
Hi, We're starting to use IPv6-only K8S cluster (EKS) which currently breaks spark. I've noticed

Re: IPv6 support

2015-06-30 Thread Steve Loughran
On 24 Jun 2015, at 18:56, Kevin Liu kevin...@fb.commailto:kevin...@fb.com wrote: Continuing this thread beyond standalone - onto clusters, does anyone have experience successfully running any Spark cluster on IPv6 only (not dual stack) machines? More companies are moving to IPv6 and some such

Re: IPv6 support

2015-05-25 Thread Akhil Das
Hi Kevin, Did you try adding a host name for the ipv6? I have a few ipv6 boxes, spark failed for me when i use just the ipv6 addresses, but it works fine when i use the host names. Here's an entry in my /etc/hosts: 2607:5300:0100:0200::::0a4d hacked.work My spark-env.sh file:

IPv6 support

2015-05-20 Thread Kevin Liu
Hello, I have to work with IPv6 only servers and when I installed the 1.3.1 hadoop 2.6 build, I couldn¹t get the example to run due to IPv6 issues (errors below). I tried to add the -Djava.net.preferIPv6Addresses=true setting but it still doesn¹t work. A search on Spark¹s support for IPv6 is