Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-25 Thread Holden Karau
Hmm, this isn’t the first time we’ve had the mirror issues happen if that’s the case. Maybe we should log the IP if this happens so we can report it to infra? On Sat, Nov 25, 2017 at 7:47 PM Felix Cheung wrote: > Ah sorry digging through the history it looks like this is

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-25 Thread Felix Cheung
Ah sorry digging through the history it looks like this is changed relatively recently and should only download previous releases. Perhaps we are intermittently hitting a mirror that doesn’t have the files? https://github.com/apache/spark/commit/daa838b8886496e64700b55d1301d348f1d5c9ae On

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-25 Thread Felix Cheung
Thanks Sean. For the second one, it looks like the HiveExternalCatalogVersionsSuite is trying to download the release tgz from the official Apache mirror, which won’t work unless the release is actually, released? val preferredMirror = Seq("wget",

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-25 Thread Sean Owen
I hit the same StackOverflowError as in the previous RC test, but, pretty sure this is just because the increased thread stack size JVM flag isn't applied consistently. This seems to resolve it: https://github.com/apache/spark/pull/19820 This wouldn't block release IMHO. I am currently