[RESULT] Updating documentation hosted for EOL and maintenance releases

The vote passes with 9 +1s (6 binding +1s). (* = binding) +1: - Hyukjin Kwon * - Ruifeng Zheng * - Jiaan Geng - Yikun Jiang * - Herman van Hovell * - Michel Miotto Barbosa - Maciej Szymkiewicz * - Denny Lee - Yuanjian Li *

Re: [VOTE] Updating documentation hosted for EOL and maintenance releases

; On Tue, Sep 26, 2023 at 11:44 AM Herman van Hovell >> wrote: >> >>> +1 >>> >>> On Tue, Sep 26, 2023 at 10:39 AM yangjie01 >>> wrote: >>> >>>> +1 >>>> >>>> >>>> >>>> *发件人**: *Yikun J

Re: [VOTE] Updating documentation hosted for EOL and maintenance releases

; wrote: >> >>> +1 >>> >>> >>> >>> *发件人**: *Yikun Jiang >>> *日期**: *2023年9月26日 星期二 18:06 >>> *收件人**: *dev >>> *抄送**: *Hyukjin Kwon , Ruifeng Zheng < >>> ruife...@apache.org> >>> *主题**: *Re: [VOTE]

Re: [VOTE] Updating documentation hosted for EOL and maintenance releases

] Updating documentation hosted for EOL and maintenance releases +1, I believe it is a wise choice to update the EOL policy of the document based on the real demands of community users. Regards, Yikun On Tue, Sep 26, 2023 at 1:06 PM Ruifeng Zheng

Re: [VOTE] Updating documentation hosted for EOL and maintenance releases

ote: > >> +1 >> >> >> >> *发件人**: *Yikun Jiang >> *日期**: *2023年9月26日 星期二 18:06 >> *收件人**: *dev >> *抄送**: *Hyukjin Kwon , Ruifeng Zheng < >> ruife...@apache.org> >> *主题**: *Re: [VOTE] Updating documentation hosted for EOL and maintenance >

Re: [VOTE] Updating documentation hosted for EOL and maintenance releases

+1 On Tue, Sep 26, 2023 at 10:39 AM yangjie01 wrote: > +1 > > > > *发件人**: *Yikun Jiang > *日期**: *2023年9月26日 星期二 18:06 > *收件人**: *dev > *抄送**: *Hyukjin Kwon , Ruifeng Zheng < > ruife...@apache.org> > *主题**: *Re: [VOTE] Updating documentation hosted for EOL a

Re: [VOTE] Updating documentation hosted for EOL and maintenance releases

+1 发件人: Yikun Jiang 日期: 2023年9月26日 星期二 18:06 收件人: dev 抄送: Hyukjin Kwon , Ruifeng Zheng 主题: Re: [VOTE] Updating documentation hosted for EOL and maintenance releases +1, I believe it is a wise choice to update the EOL policy of the document based on the real demands of community users

Re: [VOTE] Updating documentation hosted for EOL and maintenance releases

>> >> I would like to start the vote for updating documentation hosted for EOL >> and maintenance releases to improve the usability here, and in order for >> end users to read the proper and correct documentation. >> >> For discussion thread, please refer to >> h

Re:Re: [VOTE] Updating documentation hosted for EOL and maintenance releases

+1 At 2023-09-26 13:03:56, "Ruifeng Zheng" wrote: +1 On Tue, Sep 26, 2023 at 12:51 PM Hyukjin Kwon wrote: Hi all, I would like to start the vote for updating documentation hosted for EOL and maintenance releases to improve the usability here, and in order for end users t

Re: [VOTE] Updating documentation hosted for EOL and maintenance releases

+1 On Tue, Sep 26, 2023 at 12:51 PM Hyukjin Kwon wrote: > Hi all, > > I would like to start the vote for updating documentation hosted for EOL > and maintenance releases to improve the usability here, and in order for > end users to read the proper and correct documentation. >

[VOTE] Updating documentation hosted for EOL and maintenance releases

Hi all, I would like to start the vote for updating documentation hosted for EOL and maintenance releases to improve the usability here, and in order for end users to read the proper and correct documentation. For discussion thread, please refer to https://lists.apache.org/thread

Re: [DISCUSS] Updating documentation hosted for EOL and maintenance releases

be smaller issues too. > On Aug 30, 2023, at 10:27 PM, Hyukjin Kwon wrote: > > Hi all, > > I would like to raise a discussion about updating documentation hosted for > EOL and maintenance > versions. > > To provide some context, we currently host the documentation fo

[DISCUSS] Updating documentation hosted for EOL and maintenance releases

Hi all, I would like to raise a discussion about updating documentation hosted for EOL and maintenance versions. To provide some context, we currently host the documentation for EOL versions of Apache Spark, which can be found at links like https://spark.apache.org/docs/2.3.1/api/python

Re: [Spark] [SQL] Updating Spark from version 3.0.1 to 3.2.1 reduced functionality for working with parquet files

: [Spark] [SQL] Updating Spark from version 3.0.1 to 3.2.1 reduced functionality for working with parquet files Hi, even though the config option has been around since 1.2.0, it might be that more filters are being pushed into Parquet after 3.0.1 under the same option. Are you sure the filter had

RE: [Spark] [SQL] Updating Spark from version 3.0.1 to 3.2.1 reduced functionality for working with parquet files

.filterPushdown" setting correctly yet? From: Enrico Minack<mailto:i...@enrico.minack.dev> Sent: Sunday, June 5, 2022 1:32 PM To: Amin Borjian<mailto:borjianami...@outlook.com>; dev@spark.apache.org<mailto:dev@spark.apache.org> Subject: Re: [Spark] [SQL] Updating Spark from ve

Re: [Spark] [SQL] Updating Spark from version 3.0.1 to 3.2.1 reduced functionality for working with parquet files

jian: Hi. We are updating our Spark cluster from version 3.0.1 to 3.2.1 in order to get benefits from lots of improvement. Everything was good until we see strange behavior. Assume follow protobuf structure: message Model { string name = 1; repeated string keywords = 2; } We stor

[Spark] [SQL] Updating Spark from version 3.0.1 to 3.2.1 reduced functionality for working with parquet files

Hi. We are updating our Spark cluster from version 3.0.1 to 3.2.1 in order to get benefits from lots of improvement. Everything was good until we see strange behavior. Assume follow protobuf structure: message Model { string name = 1; repeated string keywords = 2; } We store

Re: Updating

perfect, thanks Sean! On Thu, Apr 13, 2017 at 4:21 PM, Sean Owen wrote: > The site source is at https://github.com/apache/spark-website/ > > On Thu, Apr 13, 2017 at 4:20 PM Sam Elamin > wrote: > >> Hey all >> >> Who do I need to talk to in order to update the Useful developer tools >> page

Re: Updating

The site source is at https://github.com/apache/spark-website/ On Thu, Apr 13, 2017 at 4:20 PM Sam Elamin wrote: > Hey all > > Who do I need to talk to in order to update the Useful developer tools > page ? > > I want to update the build instructions

Updating

Hey all Who do I need to talk to in order to update the Useful developer tools page ? I want to update the build instructions for IntelliJ as they do not apply at the moment Regards Sam

Re: Updating Parquet dep to 1.9

github.com/apache/spark/pull/15538 needs to make > it into 2.1. The logging output issue is really bad. I would probably call > it a blocker. > > Michael > > > On Nov 1, 2016, at 1:22 PM, Ryan Blue wrote: > > I can when I'm finished with a couple other issues if

Re: Updating Parquet dep to 1.9

m finished with a couple other issues if no one gets to it first. > > Michael, if you're interested in updating to 1.9.0 I'm happy to help review > that PR. > > On Tue, Nov 1, 2016 at 1:03 PM, Reynold Xin <mailto:r...@databricks.com>> wrote: > Ryan want to submi

Re: Updating Parquet dep to 1.9

I can when I'm finished with a couple other issues if no one gets to it first. Michael, if you're interested in updating to 1.9.0 I'm happy to help review that PR. On Tue, Nov 1, 2016 at 1:03 PM, Reynold Xin wrote: > Ryan want to submit a pull request? > > > On

Re: Updating Parquet dep to 1.9

gt; testing and evaluation of the changes from 1.8, but yes this would be good. >> >> On Mon, Oct 31, 2016 at 9:07 PM Michael Allman >> wrote: >> >>> Hi All, >>> >>> Is anyone working on updating Spark's Parquet library dep to 1.9? If >>

Re: Updating Parquet dep to 1.9

is just how well it will play with other components, so bears some > testing and evaluation of the changes from 1.8, but yes this would be good. > > On Mon, Oct 31, 2016 at 9:07 PM Michael Allman > wrote: > >> Hi All, >> >> Is anyone working on updating Spark's Parquet

Re: Updating Parquet dep to 1.9

, but yes this would be good. On Mon, Oct 31, 2016 at 9:07 PM Michael Allman wrote: > Hi All, > > Is anyone working on updating Spark's Parquet library dep to 1.9? If not, > I can at least get started on it and publish a PR. &

Updating Parquet dep to 1.9

Hi All, Is anyone working on updating Spark's Parquet library dep to 1.9? If not, I can at least get started on it and publish a PR. Cheers, Michael - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: Updating Spark PR builder and 2.x test jobs to use Java 8 JDK

I finally figured out the problem: it seems that my *export JAVA_HOME=/path/to/java8/home* was somehow not affecting the javac executable that Zinc's SBT incremental compiler uses when it forks out to javac to handle Java source files. As a result, we were passing a -source 1.8 flag to the platform

Re: Updating Spark PR builder and 2.x test jobs to use Java 8 JDK

I've reverted the bulk of the conf changes while I investigate. I think that Zinc might be handling JAVA_HOME in a weird way and am SSH'ing to Jenkins to try to reproduce the problem in isolation. On Tue, Apr 5, 2016 at 4:14 PM Ted Yu wrote: > Josh: > You may have noticed the following error ( >

Re: Updating Spark PR builder and 2.x test jobs to use Java 8 JDK

Josh: You may have noticed the following error ( https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-hadoop-2.7/566/console ): [error] javac: invalid source release: 1.8 [error] Usage: javac [error] use -help for a list of possible options On Tue, Apr 5, 2016 at 2:14 PM, Josh Ro

Updating Spark PR builder and 2.x test jobs to use Java 8 JDK

In order to be able to run Java 8 API compatibility tests, I'm going to push a new set of Jenkins configurations for Spark's test and PR builders so that those jobs use a Java 8 JDK. I tried this once in the past and it seemed to introduce some rare, transient flakiness in certain tests, so if anyo

Re: "Spree": Live-updating web UI for Spark

-Live-updating-web-UI-for-Spark-tp13456p13511.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h

Re: "Spree": Live-updating web UI for Spark

dev@spark, I wanted to quickly ping about Spree > <http://www.hammerlab.org/2015/07/25/spree-58-a-live-updating-web-ui-for-spark/>, > a live-updating web UI for Spark that I released on Friday (along with some > supporting infrastructure), and mention a couple things that came up whi

"Spree": Live-updating web UI for Spark

Hi dev@spark, I wanted to quickly ping about Spree <http://www.hammerlab.org/2015/07/25/spree-58-a-live-updating-web-ui-for-spark/>, a live-updating web UI for Spark that I released on Friday (along with some supporting infrastructure), and mention a couple things that came up while I worked

Re: Trouble testing after updating to latest master

ts/Home >>>as default JAVA_HOME. >>> Note, this will be overridden by -java-home if it is set. >>> Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.6.jar >>> [error] Got a return code of 1 on line 163 of the run-tests script. >&g

Re: Trouble testing after updating to latest master

code of 1 on line 163 of the run-tests script. >> >> With an individual test I get the same error. I have tried downloading >>a new copy of SBT 0.13.6 but it has not helped. Does anyone have any >>suggestions for getting this running? Things worked fine before updating >

Re: Trouble testing after updating to latest master

t; > With an individual test I get the same error. I have tried downloading a new > copy of SBT 0.13.6 but it has not helped. Does anyone have any suggestions > for getting this running? Things worked fine before updating Spark. > _

Trouble testing after updating to latest master

0.13.6 but it has not helped. Does anyone have any suggestions for getting this running? Things worked fine before updating Spark. The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates

Updating docs for running on Mesos

The docs for how to run Spark on Mesos have changed very little since 0.6.0, but setting it up is much easier now than then. Does it make sense to revamp with the below changes? You no longer need to build mesos yourself as pre-built versions are available from Mesosphere: http://mesosphere.io/d

Re: Updating docs for running on Mesos

Perhaps linking to a Mesos page, which then can list the various package incantations. Cheers, Tim - Original Message - > From: "Matei Zaharia" > To: dev@spark.apache.org > Sent: Tuesday, May 13, 2014 2:59:42 AM > Subject: Re: Updating docs for running on Mesos &

Re: Updating docs for running on Mesos

Great work!. I just left some comments in the PR. In summary, it would be great to have more background on how Spark works on Mesos and how the different elements interact. That will (hopefully) help understanding the practicalities of the common assembly location (http/hdfs) and how the jobs are d

Re: Updating docs for running on Mesos

issing? > > > On Sun, May 11, 2014 at 2:16 PM, Patrick Wendell > wrote: > > > Andrew, > > > > Updating these docs would be great! I think this would be a welcome > change. > > > > In terms of packaging, it would be good to mention the bina

Re: Updating docs for running on Mesos

>> As far as I know, the upstream doesn't release binaries, only source > code. > >> The downloads page <https://mesos.apache.org/downloads/> for 0.18.0 > only > >> has a source tarball. Is there a binary release somewhere from Mesos > that > >> I

Re: Updating docs for running on Mesos

elease somewhere from Mesos that >> I'm missing? >> >> >> On Sun, May 11, 2014 at 2:16 PM, Patrick Wendell >> wrote: >> >>> Andrew, >>> >>> Updating these docs would be great! I think this would be a welcome >> chan

Re: Updating docs for running on Mesos

. > The downloads page <https://mesos.apache.org/downloads/> for 0.18.0 only > has a source tarball. Is there a binary release somewhere from Mesos that > I'm missing? > > > On Sun, May 11, 2014 at 2:16 PM, Patrick Wendell wrote: > >> Andrew, >> >> U

Re: Updating docs for running on Mesos

k Wendell wrote: > Andrew, > > Updating these docs would be great! I think this would be a welcome change. > > In terms of packaging, it would be good to mention the binaries > produced by the upstream project as well, in addition to Mesosphere. > > - Patrick > > On T

Re: Updating docs for running on Mesos

For trimming the Running Alongside Hadoop section I mostly think there should be a separate Spark+HDFS section and have the CDH+HDP page be merged into that one, but I supposed that's a separate docs change. On Sun, May 11, 2014 at 4:28 PM, Andy Konwinski wrote: > Thanks for suggesting this and

Re: Updating docs for running on Mesos

Andrew, Updating these docs would be great! I think this would be a welcome change. In terms of packaging, it would be good to mention the binaries produced by the upstream project as well, in addition to Mesosphere. - Patrick On Thu, May 8, 2014 at 12:51 AM, Andrew Ash wrote: > The docs

Re: Updating docs for running on Mesos

Thanks for suggesting this and volunteering to do it. On May 11, 2014 3:32 AM, "Andrew Ash" wrote: > > The docs for how to run Spark on Mesos have changed very little since > 0.6.0, but setting it up is much easier now than then. Does it make sense > to revamp with the below changes? > > > You n

Updating all references to github.com/apache/incubator-spark on spark website

Since http://github.com/apache/incubator-spark and any links underneath it now return 404, I propose we do a global search and replace to change all instances to remove "incubator-", including those in docs/0.8.0 docs/0.8.1 and docs/0.9.0. I'm happy to do this. Any discussion before I do? Andy