Re: More publicly documenting the options under spark.sql.*

Some of it is intentionally undocumented, as far as I know, as an experimental option that may change, or legacy, or safety valve flag. Certainly anything that's marked an internal conf. (That does raise the question of who it's for, if you have to read source to find it.) I don't know if we need

More publicly documenting the options under spark.sql.*

I filed SPARK-30510 thinking that we had forgotten to document an option, but it turns out that there's a whole bunch of stuff under SQLConf.scala

Re: [VOTE] Release Apache Spark 2.4.5 (RC1)

+1; I checked the links and materials, then I run the tests with `-Pyarn -Phadoop-2.7 -Phive -Phive-thriftserver -Pmesos -Pkubernetes -Psparkr` on macOS (Java 8). All the things look fine and I didn't see the error on my env that Sean said above. Thanks, Dongjoon! Bests, Takeshi On Wed, Jan

Re: [VOTE] Release Apache Spark 2.4.5 (RC1)

+1 Thanks. Sincerely, DB Tsai -- Web: https://www.dbtsai.com PGP Key ID: 42E5B25A8F7A82C1 On Tue, Jan 14, 2020 at 11:08 AM Sean Owen wrote: > > Yeah it's something about the env I spun up, but I don't know what. It > happens frequently

Re: [VOTE] Release Apache Spark 2.4.5 (RC1)

Yeah it's something about the env I spun up, but I don't know what. It happens frequently when I test, but not on Jenkins. The Kafka error comes up every now and then and a clean rebuild fixes it, but not in my case. I don't know why. But if nobody else sees it, I'm pretty sure it's just an

Re: [VOTE] Release Apache Spark 2.4.5 (RC1)

+1 from me. I checked sigs/licenses, and built/tested from source on Java 8 + Ubuntu 18.04 with " -Pyarn -Phive -Phive-thriftserver -Phadoop-2.7 -Pmesos -Pkubernetes -Psparkr -Pkinesis-asl". I do get test failures, but, these are some I have always seen on Ubuntu, and I do not know why they

[no subject]

Regards Sanjiv Singh Mob : +1 571-599-5236