Re: [VOTE] Release Apache Spark 1.6.3 (RC2)

2016-11-04 Thread Weiqing Yang
+1 (non-binding) Built and tested on CentOS Linux release 7.0.1406 / openjdk version "1.8.0_111". On Fri, Nov 4, 2016 at 9:06 AM, Ricardo Almeida < ricardo.alme...@actnowib.com> wrote: > +1 (non-binding) > > tested over Ubuntu / OpenJDK 1.8.0_111 > > On 4 November 2016 at 10:00, Sean Owen

Re: [VOTE] Release Apache Spark 2.0.2 (RC2)

2016-11-04 Thread Reynold Xin
I will cut a new one once https://github.com/apache/spark/pull/15774 gets in. On Fri, Nov 4, 2016 at 11:44 AM, Sean Owen wrote: > I guess it's worth explicitly stating that I think we need another RC one > way or the other because this test seems to consistently fail. It

Re: [VOTE] Release Apache Spark 2.0.2 (RC2)

2016-11-04 Thread Herman van Hövell tot Westerflier
+1 On Fri, Nov 4, 2016 at 7:20 PM, Michael Armbrust wrote: > +1 > > On Tue, Nov 1, 2016 at 9:51 PM, Reynold Xin wrote: > >> Please vote on releasing the following candidate as Apache Spark version >> 2.0.2. The vote is open until Fri, Nov 4, 2016 at

Re: [VOTE] Release Apache Spark 2.0.2 (RC2)

2016-11-04 Thread Sean Owen
I guess it's worth explicitly stating that I think we need another RC one way or the other because this test seems to consistently fail. It was a (surprising) last-minute regression. I think I'd have to say -1 only for this. Reverting https://github.com/apache/spark/pull/15706 for branch-2.0

Re: [VOTE] Release Apache Spark 2.0.2 (RC2)

2016-11-04 Thread Joseph Bradley
+1 On Fri, Nov 4, 2016 at 11:20 AM, Michael Armbrust wrote: > +1 > > On Tue, Nov 1, 2016 at 9:51 PM, Reynold Xin wrote: > >> Please vote on releasing the following candidate as Apache Spark version >> 2.0.2. The vote is open until Fri, Nov 4, 2016

Re: [VOTE] Release Apache Spark 2.0.2 (RC2)

2016-11-04 Thread Michael Armbrust
+1 On Tue, Nov 1, 2016 at 9:51 PM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.0.2. The vote is open until Fri, Nov 4, 2016 at 22:00 PDT and passes if a > majority of at least 3+1 PMC votes are cast. > > [ ] +1 Release

Anyone want to weigh in on a Kafka DStreams api change?

2016-11-04 Thread Cody Koeninger
SPARK-17510 https://github.com/apache/spark/pull/15132 It's for allowing tweaking of rate limiting on a per-partition basis - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: Continuous warning while consuming using new kafka-spark010 API

2016-11-04 Thread Cody Koeninger
I answered the duplicate post on the user mailing list, I'd say keep the discussion there. On Fri, Nov 4, 2016 at 12:14 PM, vonnagy wrote: > Nitin, > > I am getting the similar issues using Spark 2.0.1 and Kafka 0.10. I have to > jobs, one that uses a Kafka stream and one that

Hadoop Summit EU 2017

2016-11-04 Thread Owen O'Malley
The DataWorks Summit EU 2017 (including Hadoop Summit) is going to be in Munich April 5-6 2017 . I’ve pasted the text from the CFP below. Would you like to share your knowledge with the best and brightest in the data community? If so, we encourage you to submit an abstract for DataWorks Summit

Re: Continuous warning while consuming using new kafka-spark010 API

2016-11-04 Thread vonnagy
Nitin, I am getting the similar issues using Spark 2.0.1 and Kafka 0.10. I have to jobs, one that uses a Kafka stream and one that uses just the KafkaRDD. With the KafkaRDD, I continually get the "Failed to get records". I have adjusted the polling with `spark.streaming.kafka.consumer.poll.ms`

Re: [VOTE] Release Apache Spark 2.0.2 (RC2)

2016-11-04 Thread Yin Huai
+1 On Tue, Nov 1, 2016 at 9:51 PM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.0.2. The vote is open until Fri, Nov 4, 2016 at 22:00 PDT and passes if a > majority of at least 3+1 PMC votes are cast. > > [ ] +1 Release

Re: [VOTE] Release Apache Spark 1.6.3 (RC2)

2016-11-04 Thread Ricardo Almeida
+1 (non-binding) tested over Ubuntu / OpenJDK 1.8.0_111 On 4 November 2016 at 10:00, Sean Owen wrote: > Likewise, ran my usual tests on Ubuntu with > yarn/hive/hive-thriftserver/hadoop-2.6 > on JDK 8 and all passed. Sigs and licenses are OK. +1 > > > On Thu, Nov 3, 2016 at

Re: [VOTE] Release Apache Spark 1.6.3 (RC2)

2016-11-04 Thread Sean Owen
Likewise, ran my usual tests on Ubuntu with yarn/hive/hive-thriftserver/hadoop-2.6 on JDK 8 and all passed. Sigs and licenses are OK. +1 On Thu, Nov 3, 2016 at 7:57 PM Herman van Hövell tot Westerflier < hvanhov...@databricks.com> wrote: > +1 > > On Thu, Nov 3, 2016 at 6:58 PM, Michael Armbrust