Re: [VOTE] Release Spark 3.4.2 (RC1)

+1 L. C. Hsieh 于2023年11月30日周四 12:33写道： > +1 > > Thanks Dongjoon! > > On Wed, Nov 29, 2023 at 7:53 PM Mridul Muralidharan > wrote: > > > > +1 > > > > Signatures, digests, etc check out fine. > > Checked out tag and build/tested with -Phive -Pyarn -Pmesos -Pkubernetes > > > > Regards, > > Mridul

Re: [VOTE] SPIP: State Data Source - Reader

+1 L. C. Hsieh 于2023年10月24日周二 13:23写道： > +1 > > On Mon, Oct 23, 2023 at 6:31 PM Anish Shrigondekar > wrote: > > > > +1 (non-binding) > > > > Thanks, > > Anish > > > > On Mon, Oct 23, 2023 at 5:01 PM Wenchen Fan wrote: > >> > >> +1 > >> > >> On Mon, Oct 23, 2023 at 4:03 PM Jungtaek Lim < >

Re: [VOTE] Release Apache Spark 3.5.0 (RC5)

+1 Ruifeng Zheng 于2023年9月12日周二 08:46写道： > +1 > > On Tue, Sep 12, 2023 at 7:24 AM Hyukjin Kwon wrote: > >> +1 >> >> On Tue, Sep 12, 2023 at 7:05 AM Xiao Li wrote: >> >>> +1 >>> >>> Xiao >>> >>> Yuanjian Li 于2023年9月11日周一 10:53写道： >>> @Peter Toth I've looked into the details of this

Re: [DISCUSS] Incremental statistics collection

For those databases with automatic deduplication capabilities, such as hbase, we have inserted 100 rows with the same rowkey, but in fact there is only one in hbase. Is the new statistical value we added 100 or 1, or hbase already contains this rowkey, the value would be 0. How should we handle

Re: Some questions about Spark github action

g 24, 2023 at 11:52 AM Jack Wells > wrote: > >> Hi Jia, >> >> Github Action workflows are stored in the .github/workflows directory off >> the base of the git repo. Here’s a link: >> https://github.com/apache/spark/tree/master/.github/workflows. Does this >>

Some questions about Spark github action

developers can control the github action opening and retrying of their own PRs. I checked Spark's github action configuration and found nothing special, is there any key point that I haven't noticed? I'd be very grateful if anyone could help. Best regards, Jia Fan

Re: [VOTE] Release Apache Spark 3.3.3 (RC1)

+1 Mridul Muralidharan 于2023年8月11日周五 15:57写道： > > +1 > > Signatures, digests, etc check out fine. > Checked out tag and build/tested with -Phive -Pyarn -Pmesos -Pkubernetes > > Regards, > Mridul > > > On Fri, Aug 11, 2023 at 2:00 AM Cheng Pan wrote: > >> +1 (non-binding) >> >> Passed

Re: What else could be removed in Spark 4?

to use the deprecated method of 2.x on 4.x. 3. For Mesos, I think we should remove it from doc first. Jia Fan > 2023年8月8日 05:47，Sean Owen 写道： > > While we're noodling on the topic, what else might be worth removing in Spark > 4? > > For example

Re: Welcome two new Apache Spark committers

Congratulations! Jia Fan > 2023年8月7日 11:28，Ye Xianjin 写道： > > Congratulations! > > Sent from my iPhone > >> On Aug 7, 2023, at 11:16 AM, Yuming Wang wrote: >> >>  >> >> Congratulations! >> >> On Mon

Re: [VOTE] SPIP: XML data source support

+ 1 > 2023年7月29日 13:06，Adrian Pop-Tifrea 写道： > > +1, the more data source formats, the better, and if the solution is already > thoroughly tested, I say we should go for it. > > On Sat, Jul 29, 2023, 06:35 Xiao Li > wrote: >> +1 >> >> On Fri, Jul 28, 2023 at

Re: [Reminder] Spark 3.5 Branch Cut

Can we put [SPARK-44262][SQL] Add `dropTable` and `getInsertStatement` to JdbcDialect into 3.5.0? https://github.com/apache/spark/pull/41855 Since this is the last major version update of 3.x, I think we need to make sure JdbcDialect can support more databases. Gengliang Wang 于2023年7月15日周六

Re: Time for Spark v3.5.0 release

+1 Maxim Gekk 于2023年7月4日周二 17:23写道： > +1 > > On Tue, Jul 4, 2023 at 11:55 AM Kent Yao wrote: > >> +1， thank you >> >> Kent >> >> On 2023/07/04 05:32:52 Dongjoon Hyun wrote: >> > +1 >> > >> > Thank you, Yuanjian >> > >> > Dongjoon >> > >> > On Tue, Jul 4, 2023 at 1:03 AM Hyukjin Kwon >> wrote:

Re: Beginner - Looking for starter issues

Hi Harry, Maybe you can start with https://issues.apache.org/jira/browse/SPARK-37935 Jia Fan > 2023年6月28日 08:09，Harry 写道： > > Hi, > > I am looking to pick up some tasks on ASF Jira. > I have a basic understanding of how things work in t

Re: [VOTE] Release Spark 3.4.1 (RC1)

+1 Dongjoon Hyun 于2023年6月20日周二 10:41写道： > Please vote on releasing the following candidate as Apache Spark version > 3.4.1. > > The vote is open until June 23rd 1AM (PST) and passes if a majority +1 PMC > votes are cast, with a minimum of 3 +1 votes. > > [ ] +1 Release this package as Apache

Re: [VOTE] Release Plan for Apache Spark 4.0.0 (June 2024)

By the way, like Holden said, what's big feature for 4.0.0? I think very big version change always bring some different. Jia Fan 于2023年6月13日周二 08:25写道： > +1 > > ____ > > Jia Fan > > > > 2023年6月13日 03:51，Chao Sun 写道： > > +1 > > On

Re: [VOTE] Release Plan for Apache Spark 4.0.0 (June 2024)

+1 Jia Fan > 2023年6月13日 03:51，Chao Sun 写道： > > +1 > > On Mon, Jun 12, 2023 at 12:50 PM kazuyuki tanimura > wrote: >> +1 (non-binding) >> >> Thank you! >> Kazu >> >> >>> On Jun 12, 2023, at

Re: Apache Spark 3.4.1 Release?

+1 Jia Fan > 2023年6月9日 08:00，Yuming Wang 写道： > > +1. > > On Fri, Jun 9, 2023 at 7:14 AM Chao Sun <mailto:sunc...@apache.org>> wrote: >> +1 too >> >> On Thu, Jun 8, 2023 at 2:34 PM kazuyuki tanimura >> wrote

Re: Apache Spark 3.5.0 Expectations (?)

Thanks Dongjoon! There are some ticket I want to share. SPARK-39420 Support ANALYZE TABLE on v2 tables SPARK-42750 Support INSERT INTO by name SPARK-43521 Support CREATE TABLE LIKE FILE Dongjoon Hyun 于2023年5月29日周一 08:42写道： > Hi, All. > > Apache Spark 3.5.0 is scheduled for August (1st Release

Re: [DISCUSS] Add SQL functions into Scala, Python and R API

+1 It is important that different APIs can be used to call the same function Ryan Berti 于2023年5月25日周四 01:48写道： > During my recent experience developing functions, I found that identifying > locations (sql + connect functions.scala + functions.py, FunctionRegistry, > + whatever is required for

Re: [CONNECT] New Clients for Go and Rust

clickhouse. It use different repository for jdbc, odbc, c++. Please refer: https://github.com/ClickHouse/clickhouse-java https://github.com/ClickHouse/clickhouse-odbc https://github.com/ClickHouse/clickhouse-cpp PS: I'm looking forward to the javascript connect client! Thanks Regards Jia Fan Martin

Re: The Spark email setting should be update

re talking about, Jia? > > ~ Jonathan Kelly > > On Wed, Apr 19, 2023 at 3:29 PM Rui Wang wrote: > >> I am replying now and the default address is dev@spark.apache.org. >> >> >> -Rui >> >> On Mon, Apr 17, 2023 at 4:27 AM Jia Fan wrote: >&g

The Spark email setting should be update

when I reply to emails from other communities, the default reply address is d...@xxx.apache.org. Can spark modify the corresponding settings to reduce the chance of developers replying incorrectly？ Thanks Jia Fan

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

+1 Wenchen Fan 于2023年4月11日周二 14:32写道： > +1 > > On Tue, Apr 11, 2023 at 9:57 AM Yuming Wang wrote: > >> +1. >> >> On Tue, Apr 11, 2023 at 9:14 AM Yikun Jiang wrote: >> >>> +1 (non-binding) >>> >>> Also ran the docker image related test (signatures/standalone/k8s) with >>> rc7:

Re: Undelivered Mail Returned to Sender

mail system > > : Host or domain name not found. Name > service > error for name=databricks.com.invalid type=: Host not found > > > > -- Forwarded message -- > From: Jia Fan > To: Herman van Hovell > Cc: Hyukjin Kwon , dev@spark.apac

Re: [Question] Can't start Spark Connect

Hi Herman, I just use ./build/mvn -DskipTests clean package, also had try to use ./build/mvn -DskipTests clean install. Herman van Hovell 于2023年3月8日周三 21:17写道： > Hi Jia, > > How are you building connect? > > Kind regards, > Herman > > On Wed, Mar 8, 2023 a

Re: [Question] Can't start Spark Connect

t case like > `SparkConnectServiceSuite` in IntelliJ should work. > > On Wed, 8 Mar 2023 at 15:02, Jia Fan wrote: > >> Hi developers, >>I want to contribute some code for Spark Connect. Any doc for >> starters? I want to debug SimpleSparkConnectService but I can't start it

[Question] Can't start Spark Connect

Hi developers, I want to contribute some code for Spark Connect. Any doc for starters? I want to debug SimpleSparkConnectService but I can't start it with IDEA. I would appreciate any help. Thanks Jia Fan