Re: [VOTE] SPIP: Catalog API for view metadata

2022-02-04 Thread Terry Kim
+1 (non-binding). Thanks John! Terry On Fri, Feb 4, 2022 at 4:13 PM Yufei Gu wrote: > +1 (non-binding) > Best, > > Yufei > > `This is not a contribution` > > > On Fri, Feb 4, 2022 at 11:54 AM huaxin gao wrote: > >> +1 (non-binding) >> >> On Fri, Feb 4, 2022 at 11:40 AM L. C. Hsieh wrote: >>

Re: [VOTE] Release Spark 3.2.0 (RC7)

2021-10-11 Thread Terry Kim
+1 (non-binding) Thanks, Terry On Wed, Oct 6, 2021 at 9:49 AM Gengliang Wang wrote: > Please vote on releasing the following candidate as > Apache Spark version 3.2.0. > > The vote is open until 11:59pm Pacific time October 11 and passes if a > majority +1 PMC votes are cast, with a minimum of

Re: [VOTE] Release Spark 3.1.1 (RC3)

2021-02-24 Thread Terry Kim
+1 (non-binding) Tested against .NET for Apache Spark. Thanks, Terry On Wed, Feb 24, 2021 at 8:05 AM Dongjoon Hyun wrote: > +1 > > Bests, > Dongjoon > > On Wed, Feb 24, 2021 at 5:46 AM Gabor Somogyi > wrote: > >> +1 (non-binding) >> >> Tested my added security related featues, found an issue

Re: dataFrame.na.fill() fails for column with dot

2021-02-09 Thread Terry Kim
, 2021 at 9:53 AM Terry Kim wrote: > Thanks Amandeep. This seems like a valid bug to me as quoted columns are > not handled property for na.fill(). I think the better place to fix is in > DataFrameNaFunctions.scala > <https://github.com/apache/spark/blob/18b30107adb37d3c7a767a20cc02

Re: dataFrame.na.fill() fails for column with dot

2021-02-09 Thread Terry Kim
Thanks Amandeep. This seems like a valid bug to me as quoted columns are not handled property for na.fill(). I think the better place to fix is in DataFrameNaFunctions.scala

Re: [VOTE] Release Spark 3.1.1 (RC1)

2021-01-26 Thread Terry Kim
Hi, Please check if the following regression should be included: https://github.com/apache/spark/pull/31352 Thanks, Terry On Tue, Jan 26, 2021 at 7:54 AM Holden Karau wrote: > If were ok waiting for it, I’d like to get > https://github.com/apache/spark/pull/31298 in as well (it’s not a >

Re: [VOTE] Release Spark 3.1.1 (RC1)

2021-01-20 Thread Terry Kim
+1 (non-binding) (Also ran .NET for Apache Spark E2E tests, which touch many of DataFrame, Function APIs) Thanks, Terry On Wed, Jan 20, 2021 at 6:01 AM Jacek Laskowski wrote: > Hi, > > +1 (non-binding) > > 1. Built locally using AdoptOpenJDK (build 11.0.9+11) with >

Re: [VOTE] Decommissioning SPIP

2020-07-06 Thread Terry Kim
+1 (non-binding) Thanks, Terry On Wed, Jul 1, 2020 at 6:05 PM Holden Karau wrote: > Hi Spark Devs, > > I think discussion has settled on the SPIP doc at > https://docs.google.com/document/d/1EOei24ZpVvR7_w0BwBjOnrWRy4k-qTdIlx60FsHZSHA/edit?usp=sharing > , > design doc at >

[DISCUSS] Consistent relation resolution behavior in SparkSQL

2019-12-01 Thread Terry Kim
Hi all, As discussed in SPARK-29900, Spark currently has two different relation resolution behaviors: 1. Look up temp view first, then table/persistent view 2. Look up table/persistent view The first behavior is used in SELECT, INSERT and a few commands that support temp views such as

Re: Release Apache Spark 2.4.4

2019-08-13 Thread Terry Kim
Can the following be included? [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) Thanks, Terry On Tue, Aug 13, 2019 at 10:24 PM Wenchen Fan wrote: > +1 > > On Wed, Aug 14, 2019 at 12:52

FlatMapGroupsInPandasExec with multiple record batches

2019-06-11 Thread Terry Kim
Hi, I see the following comment in FlatMapGroupsInPandasExec.scala : "It's possible to further split one group into multiple record batches to reduce the

Re: [VOTE] Release Apache Spark 2.4.2

2019-04-26 Thread Terry Kim
Very much interested in hearing what you folks decide. We currently have a couple asking us questions at https://github.com/dotnet/spark/issues. Thanks, Terry -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

[DISCUSS] SPIP: .NET bindings for Apache Spark

2019-02-27 Thread Terry Kim
Hi, I have posted a SPIP to JIRA: https://issues.apache.org/jira/browse/SPARK-27006. I look forward to your feedback. Thanks, Terry