Re: [VOTE] SPIP: Testing Framework for Spark UI Javascript files

2023-11-24 Thread Ye Zhou 
+1(non-binding)

On Fri, Nov 24, 2023 at 11:16 Mridul Muralidharan  wrote:

>
> +1
>
> Regards,
> Mridul
>
> On Fri, Nov 24, 2023 at 8:21 AM Kent Yao  wrote:
>
>> Hi Spark Dev,
>>
>> Following the discussion [1], I'd like to start the vote for the SPIP [2].
>>
>> The SPIP aims to improve the test coverage and develop experience for
>> Spark UI-related javascript codes.
>>
>> This thread will be open for at least the next 72 hours.  Please vote
>> accordingly,
>>
>> [ ] +1: Accept the proposal as an official SPIP
>> [ ] +0
>> [ ] -1: I don’t think this is a good idea because …
>>
>>
>> Thank you!
>> Kent Yao
>>
>> [1] https://lists.apache.org/thread/5rqrho4ldgmqlc173y2229pfll5sgkff
>> [2]
>> https://docs.google.com/document/d/1hWl5Q2CNNOjN5Ubyoa28XmpJtDyD9BtGtiEG2TT94rg/edit?usp=sharing
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>>

Re: [VOTE] SPIP: An Official Kubernetes Operator for Apache Spark

2023-11-14 Thread Ye Zhou 
+1(Non-binding)

On Tue, Nov 14, 2023 at 9:42 AM L. C. Hsieh  wrote:

> Hi all,
>
> I’d like to start a vote for SPIP: An Official Kubernetes Operator for
> Apache Spark.
>
> The proposal is to develop an official Java-based Kubernetes operator
> for Apache Spark to automate the deployment and simplify the lifecycle
> management and orchestration of Spark applications and Spark clusters
> on k8s at prod scale.
>
> This aims to reduce the learning curve and operation overhead for
> Spark users so they can concentrate on core Spark logic.
>
> Please also refer to:
>
>- Discussion thread:
> https://lists.apache.org/thread/wdy7jfhf7m8jy74p6s0npjfd15ym5rxz
>- JIRA ticket: https://issues.apache.org/jira/browse/SPARK-45923
>- SPIP doc:
> https://docs.google.com/document/d/1f5mm9VpSKeWC72Y9IiKN2jbBn32rHxjWKUfLRaGEcLE
>
>
> Please vote on the SPIP for the next 72 hours:
>
> [ ] +1: Accept the proposal as an official SPIP
> [ ] +0
> [ ] -1: I don’t think this is a good idea because …
>
>
> Thank you!
>
> Liang-Chi Hsieh
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>

-- 

*Zhou, Ye  **周晔*

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

2023-04-11 Thread Ye Zhou 
+1 non-binding

On Tue, Apr 11, 2023 at 18:40 Ye Zhou  wrote:

> Yes, it is not a regression issue. We can fix it after the release.
>
> Thanks
> Ye
>
> On Tue, Apr 11, 2023 at 17:42 Xiao Li  wrote:
>
>> Thanks for testing it in your environment!
>>
>>
>>> This is a minor issue itself, and only impacts the metrics for
>>> push-based shuffle, but it will essentially completely eliminate the effort
>>> in SPARK-36620.
>>
>>
>> Based on my understanding, this is not a regression. It only affects the
>> new enhancements https://issues.apache.org/jira/browse/SPARK-36620 If
>> so, it does not block the release RC.
>>
>> We should still fix it in 3.4 and the fix will be available in the next
>> maintenance releases.
>>
>> Xiao
>>
>>
>>
>> Ye Zhou  于2023年4月11日周二 17:14写道：
>>
>>> Manually tested the binary in our cluster.
>>> Started spark-shell application with some shuffle. Found one issue which
>>> is related to push based shuffle client side metrics introduced in
>>> https://github.com/apache/spark/pull/36165.
>>> Filed a ticket https://issues.apache.org/jira/browse/SPARK-43100,
>>> posted PR there, and verified that the PR fixes the issue.
>>>
>>> This is a minor issue itself, and only impacts the metrics for
>>> push-based shuffle, but it will essentially completely eliminate the effort
>>> in SPARK-36620.
>>>
>>> Would like to raise this issue in the voting thread, but hold my
>>> non-binding -1 here.
>>>
>>>
>>> On Tue, Apr 11, 2023 at 1:06 AM Peter Toth  wrote:
>>>
>>>> +1
>>>>
>>>> Jia Fan  ezt írta (időpont: 2023. ápr. 11., K,
>>>> 9:09):
>>>>
>>>>> +1
>>>>>
>>>>> Wenchen Fan  于2023年4月11日周二 14:32写道：
>>>>>
>>>>>> +1
>>>>>>
>>>>>> On Tue, Apr 11, 2023 at 9:57 AM Yuming Wang  wrote:
>>>>>>
>>>>>>> +1.
>>>>>>>
>>>>>>> On Tue, Apr 11, 2023 at 9:14 AM Yikun Jiang 
>>>>>>> wrote:
>>>>>>>
>>>>>>>> +1 (non-binding)
>>>>>>>>
>>>>>>>> Also ran the docker image related test (signatures/standalone/k8s)
>>>>>>>> with rc7: https://github.com/apache/spark-docker/pull/32
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Yikun
>>>>>>>>
>>>>>>>>
>>>>>>>> On Tue, Apr 11, 2023 at 4:44 AM Jacek Laskowski 
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> +1
>>>>>>>>>
>>>>>>>>> * Built fine with Scala 2.13
>>>>>>>>> and 
>>>>>>>>> -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
>>>>>>>>> * Ran some demos on Java 17
>>>>>>>>> * Mac mini / Apple M2 Pro / Ventura 13.3.1
>>>>>>>>>
>>>>>>>>> Pozdrawiam,
>>>>>>>>> Jacek Laskowski
>>>>>>>>> 
>>>>>>>>> "The Internals Of" Online Books <https://books.japila.pl/>
>>>>>>>>> Follow me on https://twitter.com/jaceklaskowski
>>>>>>>>>
>>>>>>>>> <https://twitter.com/jaceklaskowski>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng <
>>>>>>>>> xinrong.apa...@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Please vote on releasing the following candidate(RC7) as Apache
>>>>>>>>>> Spark version 3.4.0.
>>>>>>>>>>
>>>>>>>>>> The vote is open until 11:59pm Pacific time *April 12th* and
>>>>>>>>>> passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 
>>>>>>>>>> votes.
>>>>>>>>>>
>>>>>>>>>> [ ] +1 Release this package as Apache Spark 3.4.0
>>>>>>>>>> [ ] -1 Do not release this package because ...
>>>>>>>>>>
>>>>>>>>&g

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

2023-04-11 Thread Ye Zhou 
Yes, it is not a regression issue. We can fix it after the release.

Thanks
Ye

On Tue, Apr 11, 2023 at 17:42 Xiao Li  wrote:

> Thanks for testing it in your environment!
>
>
>> This is a minor issue itself, and only impacts the metrics for push-based
>> shuffle, but it will essentially completely eliminate the effort
>> in SPARK-36620.
>
>
> Based on my understanding, this is not a regression. It only affects the
> new enhancements https://issues.apache.org/jira/browse/SPARK-36620 If so,
> it does not block the release RC.
>
> We should still fix it in 3.4 and the fix will be available in the next
> maintenance releases.
>
> Xiao
>
>
>
> Ye Zhou  于2023年4月11日周二 17:14写道：
>
>> Manually tested the binary in our cluster.
>> Started spark-shell application with some shuffle. Found one issue which
>> is related to push based shuffle client side metrics introduced in
>> https://github.com/apache/spark/pull/36165.
>> Filed a ticket https://issues.apache.org/jira/browse/SPARK-43100, posted
>> PR there, and verified that the PR fixes the issue.
>>
>> This is a minor issue itself, and only impacts the metrics for push-based
>> shuffle, but it will essentially completely eliminate the effort
>> in SPARK-36620.
>>
>> Would like to raise this issue in the voting thread, but hold my
>> non-binding -1 here.
>>
>>
>> On Tue, Apr 11, 2023 at 1:06 AM Peter Toth  wrote:
>>
>>> +1
>>>
>>> Jia Fan  ezt írta (időpont: 2023. ápr. 11., K, 9:09):
>>>
>>>> +1
>>>>
>>>> Wenchen Fan  于2023年4月11日周二 14:32写道：
>>>>
>>>>> +1
>>>>>
>>>>> On Tue, Apr 11, 2023 at 9:57 AM Yuming Wang  wrote:
>>>>>
>>>>>> +1.
>>>>>>
>>>>>> On Tue, Apr 11, 2023 at 9:14 AM Yikun Jiang 
>>>>>> wrote:
>>>>>>
>>>>>>> +1 (non-binding)
>>>>>>>
>>>>>>> Also ran the docker image related test (signatures/standalone/k8s)
>>>>>>> with rc7: https://github.com/apache/spark-docker/pull/32
>>>>>>>
>>>>>>> Regards,
>>>>>>> Yikun
>>>>>>>
>>>>>>>
>>>>>>> On Tue, Apr 11, 2023 at 4:44 AM Jacek Laskowski 
>>>>>>> wrote:
>>>>>>>
>>>>>>>> +1
>>>>>>>>
>>>>>>>> * Built fine with Scala 2.13
>>>>>>>> and -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
>>>>>>>> * Ran some demos on Java 17
>>>>>>>> * Mac mini / Apple M2 Pro / Ventura 13.3.1
>>>>>>>>
>>>>>>>> Pozdrawiam,
>>>>>>>> Jacek Laskowski
>>>>>>>> 
>>>>>>>> "The Internals Of" Online Books <https://books.japila.pl/>
>>>>>>>> Follow me on https://twitter.com/jaceklaskowski
>>>>>>>>
>>>>>>>> <https://twitter.com/jaceklaskowski>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng <
>>>>>>>> xinrong.apa...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Please vote on releasing the following candidate(RC7) as Apache
>>>>>>>>> Spark version 3.4.0.
>>>>>>>>>
>>>>>>>>> The vote is open until 11:59pm Pacific time *April 12th* and
>>>>>>>>> passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 
>>>>>>>>> votes.
>>>>>>>>>
>>>>>>>>> [ ] +1 Release this package as Apache Spark 3.4.0
>>>>>>>>> [ ] -1 Do not release this package because ...
>>>>>>>>>
>>>>>>>>> To learn more about Apache Spark, please see
>>>>>>>>> http://spark.apache.org/
>>>>>>>>>
>>>>>>>>> The tag to be voted on is v3.4.0-rc7 (commit
>>>>>>>>> 87a5442f7ed96b11051d8a9333476d080054e5a0):
>>>>>>>>> https://github.com/apache/spark/tree/v3.4.0-rc7
>>>>>>>>>
>>>>>>>>> The release files, including signatures, digests, etc. can be
>&g

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

2023-04-11 Thread Ye Zhou 
Manually tested the binary in our cluster.
Started spark-shell application with some shuffle. Found one issue which is
related to push based shuffle client side metrics introduced in
https://github.com/apache/spark/pull/36165.
Filed a ticket https://issues.apache.org/jira/browse/SPARK-43100, posted PR
there, and verified that the PR fixes the issue.

This is a minor issue itself, and only impacts the metrics for push-based
shuffle, but it will essentially completely eliminate the effort
in SPARK-36620.

Would like to raise this issue in the voting thread, but hold my
non-binding -1 here.


On Tue, Apr 11, 2023 at 1:06 AM Peter Toth  wrote:

> +1
>
> Jia Fan  ezt írta (időpont: 2023. ápr. 11., K, 9:09):
>
>> +1
>>
>> Wenchen Fan  于2023年4月11日周二 14:32写道：
>>
>>> +1
>>>
>>> On Tue, Apr 11, 2023 at 9:57 AM Yuming Wang  wrote:
>>>
 +1.

 On Tue, Apr 11, 2023 at 9:14 AM Yikun Jiang 
 wrote:

> +1 (non-binding)
>
> Also ran the docker image related test (signatures/standalone/k8s)
> with rc7: https://github.com/apache/spark-docker/pull/32
>
> Regards,
> Yikun
>
>
> On Tue, Apr 11, 2023 at 4:44 AM Jacek Laskowski 
> wrote:
>
>> +1
>>
>> * Built fine with Scala 2.13
>> and -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
>> * Ran some demos on Java 17
>> * Mac mini / Apple M2 Pro / Ventura 13.3.1
>>
>> Pozdrawiam,
>> Jacek Laskowski
>> 
>> "The Internals Of" Online Books 
>> Follow me on https://twitter.com/jaceklaskowski
>>
>> 
>>
>>
>> On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng 
>> wrote:
>>
>>> Please vote on releasing the following candidate(RC7) as Apache
>>> Spark version 3.4.0.
>>>
>>> The vote is open until 11:59pm Pacific time *April 12th* and passes
>>> if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>>
>>> [ ] +1 Release this package as Apache Spark 3.4.0
>>> [ ] -1 Do not release this package because ...
>>>
>>> To learn more about Apache Spark, please see
>>> http://spark.apache.org/
>>>
>>> The tag to be voted on is v3.4.0-rc7 (commit
>>> 87a5442f7ed96b11051d8a9333476d080054e5a0):
>>> https://github.com/apache/spark/tree/v3.4.0-rc7
>>>
>>> The release files, including signatures, digests, etc. can be found
>>> at:
>>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
>>>
>>> Signatures used for Spark RCs can be found in this file:
>>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>>
>>> The staging repository for this release can be found at:
>>>
>>> https://repository.apache.org/content/repositories/orgapachespark-1441
>>>
>>> The documentation corresponding to this release can be found at:
>>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
>>>
>>> The list of bug fixes going into 3.4.0 can be found at the following
>>> URL:
>>> https://issues.apache.org/jira/projects/SPARK/versions/12351465
>>>
>>> This release is using the release script of the tag v3.4.0-rc7.
>>>
>>>
>>> FAQ
>>>
>>> =
>>> How can I help test this release?
>>> =
>>> If you are a Spark user, you can help us test this release by taking
>>> an existing Spark workload and running on this release candidate,
>>> then
>>> reporting any regressions.
>>>
>>> If you're working in PySpark you can set up a virtual env and install
>>> the current RC and see if anything important breaks, in the
>>> Java/Scala
>>> you can add the staging repository to your projects resolvers and
>>> test
>>> with the RC (make sure to clean up the artifact cache before/after so
>>> you don't end up building with an out of date RC going forward).
>>>
>>> ===
>>> What should happen to JIRA tickets still targeting 3.4.0?
>>> ===
>>> The current list of open tickets targeted at 3.4.0 can be found at:
>>> https://issues.apache.org/jira/projects/SPARK and search for
>>> "Target Version/s" = 3.4.0
>>>
>>> Committers should look at those and triage. Extremely important bug
>>> fixes, documentation, and API tweaks that impact compatibility should
>>> be worked on immediately. Everything else please retarget to an
>>> appropriate release.
>>>
>>> ==
>>> But my bug isn't fixed?
>>> ==
>>> In order to make timely releases, we will typically not hold the
>>> release unless the bug in question is a regression from the previous
>>> release. That being said, if there is something which is a regression
>>> that has not been correctly targeted please ping me

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

2022-11-16 Thread Ye Zhou 
+1 (non-binding)
Thanks for proposing this improvement to SHS, it resolves the main
performance issue within SHS.

On Wed, Nov 16, 2022 at 1:15 PM Jungtaek Lim 
wrote:

> +1
>
> Nice to see the chance for driver to reduce resource usage and increase
> stability, especially the fact that the driver is SPOF. It's even promising
> to have a future plan to pre-bake the kvstore for SHS from the driver.
>
> Thanks for driving the effort, Gengliang!
>
> On Thu, Nov 17, 2022 at 5:32 AM Chris Nauroth  wrote:
>
>> +1 (non-binding)
>>
>> Gengliang, thank you for the SPIP.
>>
>> Chris Nauroth
>>
>>
>> On Wed, Nov 16, 2022 at 4:27 AM Maciej  wrote:
>>
>>> +1
>>>
>>> On 11/16/22 13:19, Yuming Wang wrote:
>>> > +1, non-binding
>>> >
>>> > On Wed, Nov 16, 2022 at 8:12 PM Yang,Jie(INF) >> > > wrote:
>>> >
>>> > +1, non-binding
>>> >
>>> > __ __
>>> >
>>> > Yang Jie
>>> >
>>> > __ __
>>> >
>>> > *发件人**: *Mridul Muralidharan >> > >
>>> > *日期**: *2022年11月16日星期三17:35
>>> > *收件人**: *Kent Yao mailto:y...@apache.org>>
>>> > *抄送**: *Gengliang Wang >> > >, dev >> > >
>>> > *主题**: *Re: [VOTE][SPIP] Better Spark UI scalability and Driver
>>> > stability for large applications
>>> >
>>> > __ __
>>> >
>>> > __ __
>>> >
>>> > +1
>>> >
>>> > __ __
>>> >
>>> > Would be great to see history server performance improvements and
>>> > lower resource utilization at driver !
>>> >
>>> > __ __
>>> >
>>> > Regards,
>>> >
>>> > Mridul 
>>> >
>>> > __ __
>>> >
>>> > On Wed, Nov 16, 2022 at 2:38 AM Kent Yao >> > > wrote:
>>> >
>>> > +1, non-binding
>>> >
>>> > Gengliang Wang mailto:ltn...@gmail.com>> 于
>>> > 2022年11月16日周三16:36写道：
>>> > >
>>> > > Hi all,
>>> > >
>>> > > I’d like to start a vote for SPIP: "Better Spark UI
>>> scalability and Driver stability for large applications"
>>> > >
>>> > > The goal of the SPIP is to improve the Driver's stability by
>>> supporting storing Spark's UI data on RocksDB. Furthermore, to fasten the
>>> read and write operations on RocksDB, it introduces a new Protobuf
>>> serializer.
>>> > >
>>> > > Please also refer to the following:
>>> > >
>>> > > Previous discussion in the dev mailing list: [DISCUSS] SPIP:
>>> Better Spark UI scalability and Driver stability for large applications
>>> > > Design Doc: Better Spark UI scalability and Driver stability
>>> for large applications
>>> > > JIRA: SPARK-41053
>>> > >
>>> > >
>>> > > Please vote on the SPIP for the next 72 hours:
>>> > >
>>> > > [ ] +1: Accept the proposal as an official SPIP
>>> > > [ ] +0
>>> > > [ ] -1: I don’t think this is a good idea because …
>>> > >
>>> > > Kind Regards,
>>> > > Gengliang
>>> >
>>> >
>>>  -
>>> > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>> > 
>>> >
>>>
>>> --
>>> Best regards,
>>> Maciej Szymkiewicz
>>>
>>> Web: https://zero323.net
>>> PGP: A30CEF0C31A501EC
>>>
>>>

-- 

*Zhou, Ye  **周晔*

Re: [VOTE] Release Spark 3.2.0 (RC7)

2021-10-09 Thread Ye Zhou 
+1 (non-binding).

Run Maven build, tested within our YARN cluster, in client or cluster mode,
with push based shuffle enabled/disalbled, and shuffling a large amount of
data. Applications ran successfully with expected shuffle behavior.

On Fri, Oct 8, 2021 at 10:06 PM sarutak  wrote:

> +1
>
> I think no critical issue left.
> Thank you Gengliang.
>
> Kousuke
>
> > +1
> >
> > Looks good.
> >
> > Liang-Chi
> >
> > On 2021/10/08 16:16:12, Kent Yao  wrote:
> >> +1 (non-binding) BR
> >> 
> >> 
> >> 
> >> 
> >> 
> >> 
> >> font{
> >> line-height: 1.6;
> >> }
> >> 
> >> 
> >> 
> >> font{
> >> line-height: 1.6;
> >> }
> >> 
> >> 
> >> 
> >> font{
> >> line-height: 1.6;
> >> }
> >> 
> >> 
> >> 
> >> font{
> >> line-height: 1.6;
> >> }
> >> 
> >>
> >> 
> >> font{
> >> line-height: 1.6;
> >> }
> >> 
> >> 
> >> 
> >> font{
> >> line-height: 1.6;
> >> }
> >> 
> >>
> >> 
> >> font{
> >> line-height: 1.6;
> >> }
> >> 
> >>
> >> 
> >> font{
> >> line-height: 1.6;
> >> }
> >> 
> >>
> >> 
> >> font{
> >> line-height: 1.6;
> >> }
> >> 
> >> 
> >> 
> >> font{
> >> line-height: 1.6;
> >> }
> >> 
> >>  >> size="3">Kent Yao  >> style="color: rgb(82, 82, 82); font-family: 宋体-简; font-size:
> >> x-small;">@ Data Science Center, Hangzhou Research Institute, NetEase
> >> Corp. >> style="font-size: 13px;">a s >> color="#525252" style="font-size: 13px;">park enthusiast >> style="color: rgb(0, 0, 0); font-family: Helvetica; font-size:
> >> 13px;"> > class="mr-2 flex-self-stretch" style="box-sizing: border-box;
> > align-self: stretch !important; margin-right: 8px !important;"> > face="宋体-简" color="#525252" class=" classDarkfont" style="box-sizing:
> > border-box; font-size: 13px;"> > class="" href="https://github.com/yaooqinn/kyuubi; style="box-sizing:
> > border-box;">kyuubiis a unified multi-tenant JDBC interface for large-scale data processing and
> > analytics, built on top of  > href="http://spark.apache.org/; rel="nofollow" style="font-we
> >  ight: normal; color: rgb(49, 53, 59); font-family: 宋体-简; font-size:
> > 13px; box-sizing: border-box; font-variant-ligatures: normal;">Apache
> > Spark. > class=" d-flex flex-wrap flex-items-center break-word f3 text-normal
> > classDarkfont" style="box-sizing: border-box; margin: 0px;
> > font-variant-ligatures: normal; orphans: 2; widows: 2;
> > text-decoration-thickness: initial; flex-wrap: wrap !important;
> > align-items: center !important; word-break: break-word !important;
> > overflow-wrap: break-word !important; display: flex !important;"> > style="color: rgb(49, 53, 59); font-family: Helvetica; font-size:
> > 14px;"> > style="b
> >  ox-sizing: border-box; align-self: stretch !important; margin-right:
> > 8px !important;"> > href="https://github.com/yaooqinn/spark-authorizer; style="box-sizing:
> > border-box; outline-width: 0px;">spark-authorizer > style="font-weight: normal;">A Spark SQL extension which provides SQL
> > Standard Authorization for http://spark.apache.org/; rel="nofollow"
> > style="font-weight: normal; color: rgb(49, 53, 59); font-family: 宋体-简;
> > font-size: 13px; box-sizing: border-box; font-variant-ligatures:
> > normal;">Apache Spark > style="font-weight: normal; color: rgb(82, 82, 82); font-family: 宋体-简;
> > font-size: 13px; caret-color: rgb(82, 82, 82); font-variant-ligatures:
> > normal; text-decoration-thickness: initial;">. > style="color: rgb(49, 53, 59); font-family: Helvetica; font-size:
> > 14px;"> > class="" href="https://github.com/yaooqinn/spark-postgres;
> > style="font-size: 13px; font-family: 宋体-简; box-sizing: border-box;
> > outline-width: 0px;">spark-postgres A library for reading data from and
> > transferring data to Postgres / Greenplum with Spark SQL and
> > DataFrames, 10~100x faster. > class=" classDarkfont" style="font-variant-ligatures: normal;
> > text-decoration-thickness: initial; display: inline
> > !important;"> >  emprop="name" class="mr-2 flex-self-stretch" style="caret-color:
> > rgb(49, 53, 59); color: rgb(49, 53, 59); font-family: Helvetica;
> > font-size: 14px; font-weight: bold; box-sizing: border-box;
> > align-self: stretch !important; margin-right: 8px !important;"> > face="宋体-简" color="#525252" style="box-sizing: border-box;
> > outline-width: 0px; font-size: 13px;"> > data-pjax="#js-repo-pjax-container" class=""
> > href="https://github.com/yaooqinn/spark-func-extras;
> > style="box-sizing: border-box; outline-width:
> > 0px;">itatchiA > style="font-variant-ligatures: normal; text-decoration-thickness:
> > initial; font-weight: normal; color: rgb(82, 82, 82); font-size: 13px;
> > display: inline !important;">
> > library t >  >hat brings useful
> > functions