Re: [VOTE] SPIP: Stored Procedures API for Catalogs

2024-05-12 Thread Kent Yao
+1 Dongjoon Hyun 于2024年5月13日周一 08:39写道: > > +1 > > On Sun, May 12, 2024 at 3:50 PM huaxin gao wrote: >> >> +1 >> >> On Sat, May 11, 2024 at 4:35 PM L. C. Hsieh wrote: >>> >>> +1 >>> >>> On Sat, May 11, 2024 at 3:11 PM Chao Sun wrote: >>> > >>> > +1 >>> > >>> > On Sat, May 11, 2024 at 2:10 PM

Re: [VOTE] SPARK-46122: Set spark.sql.legacy.createHiveTableByDefault to false

2024-04-30 Thread Kent Yao
+1 Kent Yao On 2024/04/30 09:07:21 Yuming Wang wrote: > +1 > > On Tue, Apr 30, 2024 at 3:31 PM Ye Xianjin wrote: > > > +1 > > Sent from my iPhone > > > > On Apr 30, 2024, at 3:23 PM, DB Tsai wrote: > > > >  > > +1 > > > > On

Re: [FYI] SPARK-47993: Drop Python 3.8

2024-04-26 Thread Kent Yao
+1 yangjie01 于2024年4月26日周五 17:16写道: > > +1 > > > > 发件人: Ruifeng Zheng > 日期: 2024年4月26日 星期五 15:05 > 收件人: Xinrong Meng > 抄送: Dongjoon Hyun , "dev@spark.apache.org" > > 主题: Re: [FYI] SPARK-47993: Drop Python 3.8 > > > > +1 > > > > On Fri, Apr 26, 2024 at 10:26 AM Xinrong Meng wrote: > > +1 > >

Re: [DISCUSS] SPARK-46122: Set spark.sql.legacy.createHiveTableByDefault to false

2024-04-25 Thread Kent Yao
+1 Nit: the umbrella ticket is SPARK-44111, not SPARK-4. Thanks, Kent Yao Dongjoon Hyun 于2024年4月25日周四 14:39写道: > > Hi, All. > > It's great to see community activities to polish 4.0.0 more and more. > Thank you all. > > I'd like to bring SPARK-46122 (another S

Re: [VOTE] Release Spark 3.4.3 (RC2)

2024-04-16 Thread Kent Yao
+1(non-binding) Thanks, Kent Yao bo yang 于2024年4月17日周三 09:49写道: > > +1 > > On Tue, Apr 16, 2024 at 1:38 PM Hyukjin Kwon wrote: >> >> +1 >> >> On Wed, Apr 17, 2024 at 3:57 AM L. C. Hsieh wrote: >>> >>> +1 >>> >>

Re: Apache Spark 3.4.3 (?)

2024-04-07 Thread Kent Yao
+1, thank you, Dongjoon Kent Holden Karau 于2024年4月7日周日 14:54写道: > > Sounds good to me :) > > Twitter: https://twitter.com/holdenkarau > Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 > YouTube Live Streams: https://www.youtube.com/user/holdenkarau > > > On Sat,

Re: [VOTE] SPIP: Pure Python Package in PyPI (Spark Connect)

2024-04-01 Thread Kent Yao
+1(non-binding). Thank you, Hyukjin. Kent Yao Takuya UESHIN 于2024年4月1日周一 18:04写道: > > +1 > > On Sun, Mar 31, 2024 at 6:16 PM Hyukjin Kwon wrote: >> >> Hi all, >> >> I'd like to start the vote for SPIP: Pure Python Package in PyPI (Spark >> Co

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-11 Thread Kent Yao
+1 (non-binding) Kent Yao Hyukjin Kwon 于2024年3月11日周一 17:26写道: > > +1 > > On Mon, 11 Mar 2024 at 18:11, yangjie01 wrote: >> >> +1 >> >> >> >> Jie Yang >> >> >> >> 发件人: Haejoon Lee >> 日期: 2024年3月11日 星期一 17:09

Re: [DISCUSS] Release Spark 3.5.1?

2024-02-03 Thread Kent Yao
+1 Jungtaek Lim 于2024年2月3日周六 21:14写道: > > Hi dev, > > looks like there are a huge number of commits being pushed to branch-3.5 > after 3.5.0 was released, 200+ commits. > > $ git log --oneline v3.5.0..HEAD | wc -l > 202 > > Also, there are 180 JIRA tickets containing 3.5.1 as fixed version, and

Re: [VOTE] Release Spark 3.3.4 (RC1)

2023-12-10 Thread Kent Yao
+1(non-binding Kent Yao Yuming Wang 于2023年12月11日周一 09:33写道: > > +1 > > On Mon, Dec 11, 2023 at 5:55 AM Dongjoon Hyun wrote: >> >> +1 >> >> Dongjoon >> >> On 2023/12/08 21:41:00 Dongjoon Hyun wrote: >> > Please vote on releasing t

Re: Apache Spark 3.3.4 EOL Release?

2023-12-04 Thread Kent Yao
+1 Thank you for driving this EOL release, Dongjoon! Kent Yao On 2023/12/04 19:40:10 Mridul Muralidharan wrote: > +1 > > Regards, > Mridul > > On Mon, Dec 4, 2023 at 11:40 AM L. C. Hsieh wrote: > > > +1 > > > > Thanks Dongjoon! > > >

Re: [VOTE] Release Spark 3.4.2 (RC1)

2023-11-28 Thread Kent Yao
+1(non-binding) Kent Yao On 2023/11/27 01:12:53 Dongjoon Hyun wrote: > Hi, Marc. > > Given that it exists in 3.4.0 and 3.4.1, I don't think it's a release > blocker for Apache Spark 3.4.2. > > When the patch is ready, we can consider it for 3.4.3. > > In addition,

[RESULT][VOTE] SPIP: Testing Framework for Spark UI Javascript files

2023-11-28 Thread Kent Yao
Hi Spark dev, The vote[1] has now closed. The results are: +1 Votes(*=binding): - Mridul Muralidharan* - Ye Zhou - Dongjoon Hyun* - Reynold Xin* - Yang Jie - Gengliang Wang* - Ruifeng Zheng* - Binjie Yang - Kent Yao 0 Votes: None -1 Votes: None The vote is successful with 5 binding +1 votes

Re: [VOTE] SPIP: Testing Framework for Spark UI Javascript files

2023-11-28 Thread Kent Yao
023 at 6:58 AM Gengliang Wang wrote: > > > > > +1 > > > > > > On Sat, Nov 25, 2023 at 2:50 AM yangjie01 > > > wrote: > > > > > >> +1 > > >> > > >> > > >> > > >> *发件人**: *Reynold Xin &g

[VOTE] SPIP: Testing Framework for Spark UI Javascript files

2023-11-24 Thread Kent Yao
the proposal as an official SPIP [ ] +0 [ ] -1: I don’t think this is a good idea because … Thank you! Kent Yao [1] https://lists.apache.org/thread/5rqrho4ldgmqlc173y2229pfll5sgkff [2] https://docs.google.com/document/d/1hWl5Q2CNNOjN5Ubyoa28XmpJtDyD9BtGtiEG2TT94rg/edit?usp=sharing

Re: [DISCUSS] SPIP: Testing Framework for Spark UI Javascript files

2023-11-24 Thread Kent Yao
posing a new UI test framework for Apache Spark 4.0. > > > > It looks very useful. > > > > Thanks, > > Dongjoon. > > > > > > On Tue, Nov 21, 2023 at 1:51 AM Kent Yao wrote: > > > >> Hi Spark Dev, > >> > >> This is a

[DISCUSS] SPIP: Testing Framework for Spark UI Javascript files

2023-11-21 Thread Kent Yao
. Thanks, Kent Yao [1] https://docs.google.com/document/d/1hWl5Q2CNNOjN5Ubyoa28XmpJtDyD9BtGtiEG2TT94rg/edit?usp=sharing [2] https://github.com/jestjs/jest [3] https://github.com/apache/spark/pull/43903 - To unsubscribe e-mail

Re: Apache Spark 3.4.2 (?)

2023-11-10 Thread Kent Yao
+1 Maxim Gekk 于2023年11月9日周四 18:18写道: > > +1 > > On Wed, Nov 8, 2023 at 5:29 AM kazuyuki tanimura > wrote: >> >> +1 >> >> Kazu >> >> On Nov 7, 2023, at 5:23 PM, L. C. Hsieh wrote: >> >> +1 >> >> On Tue, Nov 7, 2023 at 4:56 PM Dongjoon Hyun wrote: >> >> >> Thank you all! >> >> Dongjoon >> >>

Re: Welcome to Our New Apache Spark Committer and PMCs

2023-10-09 Thread Kent Yao
Congrats! Kent 在 2023年10月7日星期六,John Zhuge 写道: > Congratulations! > > On Fri, Oct 6, 2023 at 6:41 PM Yi Wu wrote: > >> Congrats! >> >> On Sat, Oct 7, 2023 at 9:24 AM XiDuo You wrote: >> >>> Congratulations! >>> >>> Prashant Sharma 于2023年10月6日周五 00:26写道: >>> > >>> > Congratulations  >>> >

Re: [VOTE] Release Apache Spark 3.5.0 (RC5)

2023-09-11 Thread Kent Yao
+1 (non-binding), great work! Kent Yao Yuming Wang 于2023年9月12日周二 11:32写道: > > +1. > > On Tue, Sep 12, 2023 at 10:57 AM yangjie01 > wrote: >> >> +1 >> >> >> >> 发件人: Jia Fan >> 日期: 2023年9月12日 星期二 10:08 >> 收件人: Ruifeng Zheng >&

Re: [VOTE] Release Apache Spark 3.5.0 (RC4)

2023-09-07 Thread Kent Yao
+1 (Non-binding) Kent Gengliang Wang 于2023年9月7日周四 14:09写道: > > +1 > > On Wed, Sep 6, 2023 at 9:46 PM Yuanjian Li wrote: >> >> +1 (non-binding) >> >> Xiao Li 于2023年9月6日周三 15:27写道: >>> >>> +1 >>> >>> Xiao >>> >>> Herman van Hovell 于2023年9月6日周三 22:08写道: Tested connect, and everything

Re: Welcome two new Apache Spark committers

2023-08-06 Thread Kent Yao
Congrats! Peter and Xiduo! Cheng Pan 于2023年8月7日周一 11:01写道: > > Congratulations! Peter and Xiduo! > > Thanks, > Cheng Pan > > > > On Aug 7, 2023, at 10:58, Gengliang Wang wrote: > > > > Congratulations! Peter and Xiduo! > > > >

Re: Spark Docker Official Image is now available

2023-07-20 Thread Kent Yao
Thank you, Yikun! Kent Dongjoon Hyun 于2023年7月20日周四 19:25写道: > Thank you! > > Dongjoon > > On Thu, Jul 20, 2023 at 8:40 AM Xiao Li > wrote: > >> Thank you, Yikun! This is great! >> >> On Wed, Jul 19, 2023 at 7:55 PM Ruifeng Zheng wrote: >> >>> Awesome, thank you YiKun for driving this! >>>

Re: Time for Spark v3.5.0 release

2023-07-04 Thread Kent Yao
+1, thank you Kent On 2023/07/04 05:32:52 Dongjoon Hyun wrote: > +1 > > Thank you, Yuanjian > > Dongjoon > > On Tue, Jul 4, 2023 at 1:03 AM Hyukjin Kwon wrote: > > > Yeah one day postponed shouldn't be a big deal. > > > > On Tue, Jul 4, 2023 at 7:10 AM Yuanjian Li wrote: > > > >> Hi All,

Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

2023-04-10 Thread Kent Yao
+1 (non-binding) L. C. Hsieh 于2023年4月10日周一 15:02写道: > > +1 > > Thanks Dongjoon > > On Sun, Apr 9, 2023 at 5:20 PM Dongjoon Hyun wrote: > > > > I'll start with my +1. > > > > I verified the checksum, signatures of the artifacts, and documentations. > > Also, ran the tests with YARN and K8s

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

2023-04-10 Thread Kent Yao
+1(non-binding) Gengliang Wang 于2023年4月10日周一 15:27写道: > > +1 > > On Sun, Apr 9, 2023 at 3:17 PM Dongjoon Hyun wrote: >> >> +1 >> >> I verified the same steps like previous RCs. >> >> Dongjoon. >> >> >> On Sat, Apr 8, 2023 at 7:47 PM Mridul Muralidharan wrote: >>> >>> >>> +1 >>> >>> Signatures,

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

2022-11-16 Thread Kent Yao
+1, non-binding Gengliang Wang 于2022年11月16日周三 16:36写道: > > Hi all, > > I’d like to start a vote for SPIP: "Better Spark UI scalability and Driver > stability for large applications" > > The goal of the SPIP is to improve the Driver's stability by supporting > storing Spark's UI data on

Re: [VOTE] SPIP: Support Docker Official Image for Spark

2022-09-21 Thread Kent Yao
+1 Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi-tenant JDBC

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

2022-09-18 Thread Kent Yao
+1 Gengliang Wang 于2022年9月19日周一 09:23写道: > > +1, thanks for the work! > > On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon wrote: >> >> +1 >> >> On Mon, 19 Sept 2022 at 09:15, Yikun Jiang wrote: >>> >>> Hi, all >>> >>> >>> I would like to start the discussion for supporting Docker Official Image

Re: 回复: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Kent Yao
+1, non-binding Xiao Li 于2022年6月14日周二 13:11写道: > > +1 > > Xiao > > beliefer 于2022年6月13日周一 20:04写道: >> >> +1 AFAIK, no blocking issues now. >> Glad to hear to release 3.3.0 ! >> >> >> 在 2022-06-14 09:38:35,"Ruifeng Zheng" 写道: >> >> +1 (non-binding) >> >> Maxim, thank you for driving this

Re: [VOTE] Release Spark 3.3.0 (RC2)

2022-05-19 Thread Kent Yao
Wenchen Fan wrote: >> >> I think it should have been fixed by >> https://github.com/apache/spark/commit/0fdb6757946e2a0991256a3b73c0c09d6e764eed >> . Maybe the fix is not completed... >> >> On Thu, May 19, 2022 at 2:16 PM Kent Yao wrote: >&g

Re: [VOTE] Release Spark 3.3.0 (RC2)

2022-05-19 Thread Kent Yao
Thanks, Maxim. Leave my -1 for this release candidate. Unfortunately, I don't know which PR fixed this. Does anyone happen to know? BR, Kent Yao Maxim Gekk 于2022年5月19日周四 13:42写道: > > Hi Kent, > > > Shall we backport the fix from the master to 3.3 too? > > Yes, we

Re: [VOTE] Release Spark 3.3.0 (RC2)

2022-05-18 Thread Kent Yao
oth 3.2 releases and the master branch work fine with correct errors - 'due to data type mismatch'. Shall we backport the fix from the master to 3.3 too? Bests Kent Yao Yuming Wang 于2022年5月18日周三 19:04写道: > > -1. There is a regression: https://github.com/apache/spark/pull/36595 > >

Re: [VOTE] Release Spark 3.2.1 (RC2)

2022-01-24 Thread Kent Yao
+1, non-binding John Zhuge 于2022年1月25日周二 06:56写道: > +1 (non-binding) > > On Mon, Jan 24, 2022 at 2:28 PM Cheng Su wrote: > >> +1 (non-binding) >> >> >> >> Cheng Su >> >> >> >> *From: *Chao Sun >> *Date: *Monday, January 24, 2022 at 2:10 PM >> *To: *Michael Heuer >> *Cc: *dev >> *Subject:

Re: [VOTE][SPIP] Support Customized Kubernetes Schedulers Proposal

2022-01-12 Thread Kent Yao
+1 (non-binding) Thomas Graves 于2022年1月12日周三 11:52写道: > +1 (binding). > > One minor note since I haven't had time to look at the implementation > details is please make sure resource aware scheduling and the stage > level scheduling still work or any caveats are documented. Feel free > to ping

Re: [VOTE] Release Spark 3.2.1 (RC1)

2022-01-12 Thread Kent Yao
+1 (non-binding). Chao Sun 于2022年1月12日周三 16:10写道: > +1 (non-binding). Thanks Huaxin for driving the release! > > On Tue, Jan 11, 2022 at 11:56 PM Ruifeng Zheng > wrote: > >> +1 (non-binding) >> >> Thanks, ruifeng zheng >> >> -- Original -- >> *From:* "Cheng Su"

Re: [VOTE] Release Spark 3.2.0 (RC7)

2021-10-08 Thread Kent Yao
; } font{ line-height: 1.6; } Kent Yao@ Data Science Center, Hangzhou Research Institute, NetEase Corp.a sparkenthusiasthttps://github.com/yaooqinn/kyuubi; style="box-sizing: border-box;">kyuubiis a unifiedmulti-tenantJDBC interf

Re:Time to start publishing Spark Docker Images?

2021-07-21 Thread Kent Yao
+1Bests, Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi-tenant

Re: [VOTE] Release Spark 3.0.3 (RC1)

2021-06-20 Thread Kent Yao
+1 (non-binding) Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark

Re: Apache Spark 3.0.3 Release?

2021-06-08 Thread Kent Yao
+1. Thanks, Yi ~ Bests, Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis

Re: [VOTE] Release Spark 3.1.2 (RC1)

2021-05-26 Thread Kent Yao
+1, non-binding Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi

Re: Resolves too old JIRAs as incomplete

2021-05-20 Thread Kent Yao
+1,thanks Takeshi Kent Yao  @ Data Science Center, Hangzhou Research Institute, NetEase Corp. a spark enthusiast kyuubiis a unified multi-tenant JDBC interface for large-scale data processing and analytics, built on top of Apache Spark. spark-authorizerA Spark SQL extension which provides SQL

Re: Apache Spark 3.1.2 Release?

2021-05-17 Thread Kent Yao
+1. thanks Dongjoon Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified

Re: [VOTE] Release Spark 2.4.8 (RC4)

2021-05-10 Thread Kent Yao
+1 (non-binding) Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified

Re: [VOTE] Release Spark 2.4.8 (RC3)

2021-04-28 Thread Kent Yao
n/s" = 2.4.8 >>> >>> Committers should look at those and triage. Extremely important bug >>> fixes, documentation, and API tweaks that impact compatibility should >>> be worked on immediately. Everything else please retarget to an >>> appropri

Re: [PSA] Please read: PR builder now runs test and build in your forked repository

2021-04-14 Thread Kent Yao
nks Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi-tenant JDBC interface for large-scale d

Re: [PSA] Please read: PR builder now runs test and build in your forked repository

2021-04-14 Thread Kent Yao
11:34写道: > > Thank you again, Hyukjin. > > Bests, > Dongjoon. > > On Wed, Apr 14, 2021 at 5:25 AM Kent Yao wrote: >> >> Cool, thanks! >> >> Hyukjin Kwon 于2021年4月14日周三 下午8:19写道: >>> >>> Good point! I had to clarify. >>> O

Re: [PSA] Please read: PR builder now runs test and build in your forked repository

2021-04-14 Thread Kent Yao
Cool, thanks! Hyukjin Kwon 于2021年4月14日周三 下午8:19写道: > Good point! I had to clarify. > Once is enough. The sync is needed for your branch to include the changes > of https://github.com/apache/spark/pull/32092. > > > 2021년 4월 14일 (수) 오후 9:11, Kent Yao 님이 작성: > >> Hi H

Re: [PSA] Please read: PR builder now runs test and build in your forked repository

2021-04-14 Thread Kent Yao
ost to keep up with the current master branch? Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi-tenant JDBC interface for large-scale d

Re: [PSA] Please read: PR builder now runs test and build in your forked repository

2021-04-14 Thread Kent Yao
Cool~Thanks, Hyukjin Yuanjian Li 于2021年4月14日周三 下午3:39写道: > Awesome! Thanks for making this happen, Hyukjin! > > Yi Wu 于2021年4月14日周三 下午2:51写道: > >> Thanks for the great work, Hyukjin! >> >> On Wed, Apr 14, 2021 at 1:00 PM Gengliang Wang wrote: >> >>> Thanks for the amazing work, Hyukjin! >>> I

Re: [VOTE] Release Spark 2.4.8 (RC2)

2021-04-13 Thread Kent Yao
+1 (non-binding) Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark

Re: [VOTE] SPIP: Add FunctionCatalog

2021-03-09 Thread Kent Yao
+1, looks great! Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi

Re: [ANNOUNCE] Announcing Apache Spark 3.1.1

2021-03-02 Thread Kent Yao
Congrats, all! Bests, Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark

Re:[VOTE] Release Spark 3.1.1 (RC2)

2021-02-08 Thread Kent Yao
+1 Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi-tenant JDBC

Re: [VOTE] Release Spark 3.1.1 (RC1)

2021-02-03 Thread Kent Yao
g's behavior for tuning the IO performance w/ HDFS if there is an existing io.file.buffer.size in hive-site.xml Kent Yao @ Data Science Center, Hangzhou Research Institute, Ne

Re: [Spark SQL]: SQL, Python, Scala and R API Consistency

2021-01-30 Thread Kent Yao
guments, are fully tested.> --> Best regards,> Maciej Szymkiewicz> Web: https://zero323.net> Keybase: https://keybase.io/zero323> Gigs: https://www.codementor.io/@zero323> PGP: A30CEF0C31A501EC> --> Best regards,> Maciej Szymkiewicz> Web: https://z

Re: [FYI] Kubernetes GA Preparation (SPARK-33005)

2020-09-28 Thread Dr. Kent Yao
Best, Kent Yao -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: Welcoming some new Apache Spark committers

2020-07-16 Thread Dr. Kent Yao
Congrats and welcome!!! -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [vote] Apache Spark 3.0 RC3

2020-06-09 Thread Dr. Kent Yao
+1 (non-binding) -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Apache Spark 3.0.0 RC1

2020-04-01 Thread Dr. Kent Yao
-1 Do not release this package because v3.0.0 is the 3rd major release since we added Spark On Kubernetes. Can we make it more production-ready as it has been experimental for more than 2 years? The main practical adoption of Spark on Kubernetes is to take on the role of other cluster

Re: [DISCUSS] Support year-month and day-time Intervals

2020-01-16 Thread Dr. Kent Yao
Following ANSI might be a good option but also a serious user behavior change to introduce two different interval types, so I also agree with Reynold to follow what we have done since version 1.5.0, just like Snowflake and Redshift. Perhaps, we can make some efforts for the current interval type

Re: [DISCUSS] Support year-month and day-time Intervals

2020-01-10 Thread Kent Yao
our proposal need to revert something from the master branch?I'm just asking because it's not clear in the proposal document.Bests,Dongjoon.On Fri, Jan 10, 2020 at 5:31 AM Dr. Kent Yao <yaooq...@qq.com> wrote:Hi, Devs I’d like to propose to add two new interval types which are year-month and

[DISCUSS] Support year-month and day-time Intervals

2020-01-10 Thread Dr. Kent Yao
compatibility of the old interval type usages in 2.4 will be guaranteed. Here is the design doc: [SPIP] Support Year-Month and Day-Time Intervals - https://docs.google.com/document/d/1JNRzcBk4hcm7k2cOXSG1A9U9QM2iNGQzBSXZzScUwAU/edit?usp=sharing All comments are welcome! Thanks, Kent Yao -- Sent

[PROPOSAL] Support ANSI type real/numeric as synonyms for float/decimal

2019-12-05 Thread Dr. Kent Yao
Hi all, For better SQL standard support, I recently opened a pull request https://github.com/apache/spark/pull/26537 to support real type as float and numeric as decimal. We have researched a bit and discussed it among several contributors/committers. Sending the email to the dev list to

Re: Accessing Hive Tables in Spark

2018-04-10 Thread Dr. Kent Yao
Applying this fix https://github.com/apache/spark/pull/19663 Or Using --files or --jars /local/path/to/hive-site.xml may works Thanks, Kent -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To