Re: SPIP: Spark on Kubernetes

+1 as well. Regards JB On Aug 16, 2017, 10:12, at 10:12, "Ismaël Mejía" wrote: >+1 (non-binding) > >This is something really great to have. More schedulers and runtime >environments are a HUGE win for the Spark ecosystem. >Amazing work, Big kudos for the guys who created and

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

> http://people.apache.org/~pwendell/spark-releases/spark-2.0.1-rc3-docs/ <http://people.apache.org/~pwendell/spark-releases/spark-2.0.1-rc3-docs/>

Re: Aggregations with scala pairs

Agreed. Regards JB On Aug 18, 2016, 07:32, at 07:32, Olivier Girardot wrote: >CC'ing dev list, you should open a Jira and a PR related to it to >discuss it c.f.

Re: https://issues.apache.org seems to be down for a while today.

, --Prashant -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org

Re: Creating Spark Extras project, was Re: SPARK-13843 and future of streaming backends

- To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com - To unsubs

Re: Creating Spark Extras project, was Re: SPARK-13843 and future of streaming backends

Hi Luciano, I didn't mean Spark proper, but more something like you proposed. Regards JB On 03/26/2016 06:38 PM, Luciano Resende wrote: On Sat, Mar 26, 2016 at 10:20 AM, Jean-Baptiste Onofré <j...@nanthrax.net <mailto:j...@nanthrax.net>> wrote: Hi Luciano, If we ta

Re: [discuss] ending support for Java 7 in Spark 2.0

o i have a hard time understanding why anyone would stay on > scala 2.10. and finally with scala 2.12 around the corner you really dont > want to be supporting 3 versions. so clearly i am missing something here. > > > > On Thu, Mar 24, 20

Re: [discuss] ending support for Java 7 in Spark 2.0

right now, but will become increasingly more difficult as we optimize performance. The downside of not supporting Java 7 is also obvious. Some organizations are stuck with Java 7, and they wouldn't be able to use Spark 2.0 without upgrading Java. -- Jean-Baptiste Onofré jbono...@apache.org

Re: SPARK-13843 Next steps

OK, so kafka, kinesis and flume will stay in Spark. Thanks, Regards JB On 03/22/2016 08:30 AM, Reynold Xin wrote: Kinesis is still in it. I think it's OK to add Flume back. On Tue, Mar 22, 2016 at 12:29 AM, Jean-Baptiste Onofré <j...@nanthrax.net <mailto:j...@nanthrax.net>> wrote:

Re: SPARK-13843 Next steps

the streaming-flume added back to Apache Spark. Thanks, Kostas -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org

Re: SPARK-13843 and future of streaming backends

Am I to understand from your reply that it's not possible for a single project to have multiple repos? -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com - To unsubscribe, e-mai

Re: [POWERED BY] Please add our organization

gement platform (Bedrock) and self-service data preparation solution ​ ​ (Mica) leverage Spark for ​fast execution of transformations and data exploration. -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend

Re: SPARK-13843 and future of streaming backends

within the ASF Spark project? I think that would be better for everybody. -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com - To unsubscribe, e-mail: dev-unsubscr...@spark.apach

Re: BUILD FAILURE at spark-sql_2.11?!

laskowski.gitbooks.io/mastering-apache-spark/ Follow me at https://twitter.com/jaceklaskowski - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org -- Jean-Baptiste Onofr

Re: BUILD FAILURE...again?! :( Spark Project External Flume on fire

I confirm: I have the same issue. I tried Josh's PR and but the branch is not found: git pull https://github.com/JoshRosen/spark netty-hotfix As the issue is on Flume external, I'm not sure it's related. Let me take a look and eventually provide a fix. Regards JB -- Jean-Baptiste Onofré

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

https://issues.apache.org/jira/browse/SPARK-11724>). * With the improved query planner for queries having distinct aggregations (SPARK-9241 <https://issues.apache.org/jira/browse/SPARK-9241>), the plan of a query having a single distinct aggregation has been changed

Re: [VOTE] Release Apache Spark 1.6.0 (RC3)

PARK-11724 <https://issues.apache.org/jira/browse/SPARK-11724>). * With the improved query planner for queries having distinct aggregations (SPARK-9241 <https://issues.apache.org/jira/browse/SPARK-9241>), the plan of a query having a single distinct aggregation has been

RE: [VOTE] Release Apache Spark 1.6.0 (RC2)

+1 (non binding) Tested with different samples. RegardsJB  Sent from my Samsung device Original message From: Michael Armbrust Date: 12/12/2015 18:39 (GMT+01:00) To: dev@spark.apache.org Subject: [VOTE] Release Apache Spark 1.6.0 (RC2)

Re: Dropping support for earlier Hadoop versions in Spark 2.0?

, keep only Hadoop 2.6 and greater. What are the community's thoughts on that? -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com - To unsubscribe, e-mail: dev-unsubscr

Re: Persisting DStreams

you compute the DStream right? -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org

Re: A proposal for Spark 2.0

ing is harder The proposal is to just avoid a single fat jar. -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com - To unsubscribe, e-mail: dev-unsubscr...@spark.apac

Re: A proposal for Spark 2.0

or two public >>>> classes but a lot of private classes. A better structure is to have public >>>> classes isolated to a few public packages, and these public packages should >>>> have minimal private classes for low level developer APIs. >>>

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

, then reporting any regressions. What justifies a -1 vote for this release? -1 vote should occur for regressions from Spark 1.5.1. Bugs already present in 1.5.1 will not block this release. -- Jean-Baptiste

Re: Master build fails ?

Hi Ted, thanks for the update. The build with sbt is in progress on my box. Regards JB On 11/03/2015 03:31 PM, Ted Yu wrote: Interesting, Sbt builds were not all failing: https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-SBT/ FYI On Tue, Nov 3, 2015 at 5:58 AM, Jean-Baptiste Onofré

Re: Unable to run applications on spark in standalone cluster mode

:7077, it is not working…. Any type of help would be appreciated….. Thanks in advance -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com - To unsubscribe, e-mail: dev-unsubscr

Re: Building Spark

m.xml (Access i s denied) -> [Help 1] Any idea, I'm running a 64-bit Windows 8 machine Thanks -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com - To unsubscribe, e-mail: dev-u

Re: SPARK_MASTER_IP actually expects a DNS name, not IP address

template indicates that either an IP address or a hostname should work <https://github.com/apache/spark/blob/4ace4f8a9c91beb21a0077e12b75637a4560a542/conf/spark-env.sh.template#L49>, but my testing shows that only hostnames work. Nick ​ -- Jea