Regarding SPARK-23192

Hi, I was trying to reproduce SPARK-23192 on spark 2.2.1 Somehow, I still see Broadcast join happening. Could anyone please explain what exactly ​was the issue? Regards

Re: Failing Spark Unit Tests

Got it, I opened a PR. -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Spark 2.3.0 (RC2)

+1 Xiao Li 2018-01-23 9:44 GMT-08:00 Marcelo Vanzin : > On Tue, Jan 23, 2018 at 7:01 AM, Sean Owen wrote: > > I'm not seeing that same problem on OS X and /usr/bin/tar. I tried > unpacking > > it with 'xvzf' and also unzipping it first, and it untarred

Re: [VOTE] Spark 2.3.0 (RC2)

On Tue, Jan 23, 2018 at 7:01 AM, Sean Owen wrote: > I'm not seeing that same problem on OS X and /usr/bin/tar. I tried unpacking > it with 'xvzf' and also unzipping it first, and it untarred without warnings > in either case. The warnings just show up if you unpack using GNU

Re: Failing Spark Unit Tests

I tried doing a change for it, but I was unable to reproduce. Anyway, I am seeing some unrelated errors in other PRs too, so there might be (or might have been) something wrong at some point. But I'd expect the test to pass locally anyway. 2018-01-23 15:23 GMT+01:00 Sean Owen

Re: [VOTE] Spark 2.3.0 (RC2)

I'm not seeing that same problem on OS X and /usr/bin/tar. I tried unpacking it with 'xvzf' and also unzipping it first, and it untarred without warnings in either case. I am encountering errors while running the tests, different ones each time, so am still figuring out whether there is a real

Re: Dataset.localCheckpoint?

Hi, sorry again, I was wrong - it was added in 2.3 by Fernando Pereira Pozdrawiam / Best regards, Tomek Gawęda On 2018-01-22 19:32, Tomasz Gawęda wrote: > Hi, > > Today I saw that there is no localCheckpoint() function in Dataset. Is > there any reason for that? Checkpointing can truncate

Failing Spark Unit Tests

Hi All, I am currently working on SPARK-23166 , but after running "./dev/run-tests", the Python unit tests (supposedly unrelated to my change) are failing for the following reason: