Re: [VOTE] Release Spark 3.1.1 (RC3)

2021-02-22 Thread Gengliang Wang
+1 (non-binding) On Tue, Feb 23, 2021 at 10:56 AM Yuming Wang wrote: > +1 @Sean Owen I do not have this issue: > > [info] SparkSQLEnvSuite: > 19:45:15.430 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load > native-hadoop library for your platform... using builtin-java classes

Re: [VOTE] Release Spark 3.1.1 (RC3)

2021-02-22 Thread Yuming Wang
+1 @Sean Owen I do not have this issue: [info] SparkSQLEnvSuite: 19:45:15.430 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 19:45:56.366 WARN org.apache.hadoop.hive.conf.HiveConf: HiveConf of

Re: [VOTE] Release Spark 3.1.1 (RC3)

2021-02-22 Thread Sean Owen
+1 LGTM, same results as last time. Does anyone see the error below? It is probably env-specific as the Jenkins jobs don't hit this. Just checking. SPARK-29604 external listeners should be initialized with Spark classloader *** FAILED *** java.lang.RuntimeException: [download failed:

Re: [VOTE] Release Spark 3.1.1 (RC3)

2021-02-22 Thread Herman van Hovell
+1 On Mon, Feb 22, 2021 at 12:59 PM Jungtaek Lim wrote: > +1 (non-binding) > > Verified signatures. Only a few commits added after RC2 which don't seem > to change the SS behavior, so I'd carry over my +1 from RC2. > > On Mon, Feb 22, 2021 at 3:57 PM Hyukjin Kwon wrote: > >> Starting with my

Re: [VOTE] Release Spark 3.1.1 (RC3)

2021-02-22 Thread Jungtaek Lim
+1 (non-binding) Verified signatures. Only a few commits added after RC2 which don't seem to change the SS behavior, so I'd carry over my +1 from RC2. On Mon, Feb 22, 2021 at 3:57 PM Hyukjin Kwon wrote: > Starting with my +1 (binding). > > 2021년 2월 22일 (월) 오후 3:56, Hyukjin Kwon 님이 작성: > >>

Re: [DISCUSS] SPIP: FunctionCatalog

2021-02-22 Thread Wenchen Fan
Hi Walaa, Thanks for sharing this! The type signature stuff is already covered by the unbound UDF API, which specifies the input and output data types. The problem is how to check the method signature of the bound UDF. As you said, Java has type erasure and we can't check `List` for example. My