Invalid link for Spark 1.0.0 in Official Web Site

Hi, I found there is a invalid link in http://spark.apache.org/downloads.html . The link for release note of Spark 1.0.0 indicates http://spark.apache.org/releases/spark-release-1.0.0.html but this link is invalid. I think that is mistake for

Miss-link for the document of Spark 1.0.1

Hi developpers Conguraturations on the release of Spark 1.0.1! I found a miss-link for the document of Spark 1.0.1. I checked out the overview from the link http://spark.apache.org/docs/latest/ but this link points to the page for 1.0.0. I also visited the link

Re: Miss-link for the document of Spark 1.0.1

Sorry, it may be my bad. Now I confirmed the link points to the page for 1.0.1. Thanks Kousuke (2014/07/12 7:22), Sean Owen wrote: It correctly points to 1.0.1 but you may need to refresh in your browser to see the update. On Jul 12, 2014 3:18 PM, Kousuke Saruta saru...@oss.nttdata.co.jp

Re: too many CancelledKeyException throwed from ConnectionManager

Hi Shengzhe I faced to same situation. I think, Connection and ConnectionManager have some race condition issues and the error you mentioned may be caused by the issues. Now I'm trying to resolve the issue in https://github.com/apache/spark/pull/2019. Please check it out. - Kousuke

Re: [VOTE] Designating maintainers for some Spark components

+1, It makes sense! - Kousuke (2014/11/05 17:31), Matei Zaharia wrote: Hi all, I wanted to share a discussion we've been having on the PMC list, as well as call for an official vote on it on a public list. Basically, as the Spark project scales up, we need to define a model to make sure

Re: [VOTE] Release Apache Spark 1.1.1 (RC1)

Now I've finished to revert for SPARK-4434 and opened PR. (2014/11/16 17:08), Josh Rosen wrote: -1 I found a potential regression in 1.1.1 related to spark-submit and cluster deploy mode: https://issues.apache.org/jira/browse/SPARK-4434 I think that this is worth fixing. On Fri, Nov 14, 2014

Re: Assembly jar file name does not match profile selection

Hi Alessandro, It's fixed by SPARK-3787 and will be applied to 1.2.1 and 1.3.0. https://issues.apache.org/jira/browse/SPARK-3787 - Kousuke (2014/12/27 11:15), Alessandro Baretta wrote: I am building spark with sbt off of branch 1.2. I'm using the following command: sbt/sbt -Pyarn

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

+1 Built on Mac OS X with -Dhadoop.version=2.4.0 -Pyarn -Phive -Phive-thriftserver. Tested on YARN (cluster/client) on CentOS 7. Also WebUI incuding DAG and Timeline View work. On 2015/06/05 15:01, Burak Yavuz wrote: +1 Tested on Mac OS X Burak On Thu, Jun 4, 2015 at 6:35 PM, Calvin Jia

Re: How do we convert a Dataset includes timestamp columns to RDD?

Hi Yu, I found it's because DateTimeUtils passed to StaticInvoke is not serializable. I think it's potential bug that StaticInvoke can receives non-Serializable objects. I opened a PR about this issue. https://github.com/apache/spark/pull/10357 - Kousuke On 2015/12/17 16:35, Yu Ishikawa

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

+1 (non-binding) Tested some workloads using basic API and DataFrame API on my 4-nodes YARN cluster (1 master and 3 slaves). I also tested the Web UI. (I'm resending this mail just in case because it seems that I failed to send the mail to dev@) On 2015/12/13 2:39, Michael Armbrust wrote:

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On 2015/12/23 16:14, Jean-Baptiste Onofré wrote: +1 (non binding) Tested with samples on standalone and yarn. Regards JB On 12/22/2015 09:10 PM, Michael Armbrust wrote: Please vote on releasing the following candidate as Apache Spark version 1.6.0! The vote is open until Friday,

Re: Welcoming Yanbo Liang as a committer

Congratulations Yanbo! - Kousuke On 2016/06/04 11:48, Matei Zaharia wrote: Hi all, The PMC recently voted to add Yanbo Liang as a committer. Yanbo has been a super active contributor in many areas of MLlib. Please join me in welcoming Yanbo! Matei

Re: [VOTE] Release Apache Spark 1.6.2 (RC2)

+1 (non-binding) On 2016/06/23 4:53, Reynold Xin wrote: +1 myself On Wed, Jun 22, 2016 at 12:19 PM, Sean McNamara > wrote: +1 On Jun 22, 2016, at 1:14 PM, Michael Armbrust

Re: [VOTE] Release Apache Spark 1.6.1 (RC1)

+1 (non-binding) On 2016/03/09 4:28, Burak Yavuz wrote: +1 On Tue, Mar 8, 2016 at 10:59 AM, Andrew Or > wrote: +1 2016-03-08 10:59 GMT-08:00 Yin Huai >: +1

Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt?

Thanks. Of course, I verified checksum and it didn't matched. Kousuke On 2016/04/05 0:39, Jitendra Shelar wrote: We can think of using checksum for this kind of issues. On Mon, Apr 4, 2016 at 8:32 PM, Kousuke Saruta <saru...@oss.nttdata.co.jp <mailto:saru...@oss.nttdata.co.jp&g

Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt?

Oh, I overlooked that. Thanks. Kousuke On 2016/04/04 22:58, Nicholas Chammas wrote: This is still an issue. The Spark 1.6.1 packages on S3 are corrupt. Is anyone looking into this issue? Is there anything contributors can do to help solve this problem? Nick On Sun, Mar 27, 2016 at 8:49

Re: [VOTE] Release Apache Spark 2.0.0 (RC5)

+1 (non-binding) Tested on my cluster with three slave nodes. On 2016/07/23 10:25, Suresh Thalamati wrote: +1 (non-binding) Tested data source api , and jdbc data sources. On Jul 19, 2016, at 7:35 PM, Reynold Xin > wrote: Please vote on

Re: ERROR: java.net.UnknownHostException

Hi Miki, What version of Spark are you using? If the version is > 1.4, you might hit SPARK-11227. - Kousuke On 2016/07/28 18:34, Miki Shingo wrote: To whom who has knowledge? I have faced the following error try to use HA configuration. (java.net.UnknownHostException) below is the error

Re: welcoming Burak and Holden as committers

Congrats, Burak and Holden! - Kousuke On 2017/01/25 6:36, Herman van Hövell tot Westerflier wrote: Congrats! On Tue, Jan 24, 2017 at 10:20 PM, Felix Cheung > wrote: Congrats and welcome!!

Re: welcoming Takuya Ueshin as a new Apache Spark committer

Congratulations, Takuya! - Kousuke On 2017/02/14 7:38, Herman van Hövell tot Westerflier wrote: Congrats Takuya! On Mon, Feb 13, 2017 at 11:27 PM, Neelesh Salian > wrote: Congratulations, Takuya! On Mon, Feb 13, 2017 at

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

+1 (non-binding) On 2016年09月26日 07:26, Herman van Hövell tot Westerflier wrote: +1 (non-binding) On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida > wrote: +1 (non-binding) Built and tested on - Ubuntu 16.04 /

Re: welcoming Xiao Li as a committer

Congratulations Xiao! - Kousuke On 2016/10/05 7:44, Bryan Cutler wrote: Congrats Xiao! On Tue, Oct 4, 2016 at 11:14 AM, Holden Karau > wrote: Congratulations :D :) Yay! On Tue, Oct 4, 2016 at 11:14 AM, Suresh Thalamati

Re: [VOTE] Release Apache Spark 2.0.2 (RC1)

+1 - Kousuke On 2016/10/28 2:07, vaquar khan wrote: +1 On Thu, Oct 27, 2016 at 11:56 AM, Davies Liu > wrote: +1 On Thu, Oct 27, 2016 at 12:18 AM, Reynold Xin > wrote: >

Re: [VOTE] Release Apache Spark 2.0.2 (RC3)

+1 (non-binding) On 2016年11月08日 15:09, Reynold Xin wrote: Please vote on releasing the following candidate as Apache Spark version 2.0.2. The vote is open until Thu, Nov 10, 2016 at 22:00 PDT and passes if a majority of at least 3+1 PMC votes are cast. [ ] +1 Release this package as Apache

Re: [VOTE] Release Apache Spark 1.6.3 (RC2)

+1 (non-binding) - Kousuke On 2016/11/03 9:40, Reynold Xin wrote: Please vote on releasing the following candidate as Apache Spark version 1.6.3. The vote is open until Sat, Nov 5, 2016 at 18:00 PDT and passes if a majority of at least 3+1 PMC votes are cast. [ ] +1 Release this package as

Re: welcome a new batch of committers

Congratulations! - Kousuke On 2018/10/04 0:30, Gengliang wrote: Congratulations to all ! On Wed, Oct 3, 2018 at 10:06 PM Wenchen Fan mailto:cloud0...@gmail.com>> wrote: Congratulations! On Wed, Oct 3, 2018 at 9:24 PM Madhusudanan Kandasamy mailto:madhusuda...@in.ibm.com>> wrote:

Re: Build time limit in PR builder

Thanks all. It's very helpful! - Kousuke On 2020/05/29 3:31, shane knapp ☠ wrote: https://github.com/apache/spark/pull/28666 On Thu, May 28, 2020 at 11:20 AM shane knapp ☠ mailto:skn...@berkeley.edu>> wrote: i'll get a PR put together now. On Thu, May 28, 2020 at 8:26 AM Hyukjin