Re: Using Travis for JDK7/8 compilation and lint-java.

Thank you for feedback. Sure, correctly, that's the reason why the current SparkPullRequestBuilder do not run `lint-java`. :-) In addition, that's the same reason why contributors are reluctant to run `lint-java` and causes breaking on JDK7 builds. Such a tedious and time-consuming job should be

Re: Using Travis for JDK7/8 compilation and lint-java.

Without Zinc, 'mvn -DskipTests clean install' takes ~30 minutes. Maybe not everyone is willing to wait that long. On Sun, May 22, 2016 at 1:30 PM, Dongjoon Hyun wrote: > Oh, Sure. My bad! > > - For Oracle JDK7, mvn -DskipTests install and run `dev/lint-java`. > - For

Re: [VOTE] Removing module maintainer process

Correction, let's run this for 72 hours, so until 9 PM EST May 25th. > On May 22, 2016, at 8:34 PM, Matei Zaharia wrote: > > It looks like the discussion thread on this has only had positive replies, so > I'm going to call a VOTE. The proposal is to remove the

Re: [VOTE] Removing module maintainer process

+1 (binding) On Sun, May 22, 2016 at 7:34 PM, Matei Zaharia wrote: > It looks like the discussion thread on this has only had positive replies, > so I'm going to call a VOTE. The proposal is to remove the maintainer > process in >

Re: [VOTE] Removing module maintainer process

On Sunday, May 22, 2016, Matei Zaharia wrote: > It looks like the discussion thread on this has only had positive replies, > so I'm going to call a VOTE. The proposal is to remove the maintainer > process in >

[VOTE] Removing module maintainer process

It looks like the discussion thread on this has only had positive replies, so I'm going to call a VOTE. The proposal is to remove the maintainer process in https://cwiki.apache.org/confluence/display/SPARK/Committers#Committers-ReviewProcessandMaintainers

Re: Using Travis for JDK7/8 compilation and lint-java.

Oh, Sure. My bad! - For Oracle JDK7, mvn -DskipTests install and run `dev/lint-java`. - For Oracle JDK8, mvn -DskipTests install and run `dev/lint-java`. Thank you, Ted. Dongjoon. On Sun, May 22, 2016 at 1:29 PM, Ted Yu wrote: > The following line was repeated twice: > >

Re: Using Travis for JDK7/8 compilation and lint-java.

The following line was repeated twice: - For Oracle JDK7, mvn -DskipTests install and run `dev/lint-java`. Did you intend to cover JDK 8 ? Cheers On Sun, May 22, 2016 at 1:25 PM, Dongjoon Hyun wrote: > Hi, All. > > I want to propose the followings. > > - Turn on Travis

Using Travis for JDK7/8 compilation and lint-java.

Hi, All. I want to propose the followings. - Turn on Travis CI for Apache Spark PR queue. - Recommend this for contributors, too Currently, Spark provides Travis CI configuration file to help contributors check Scala/Java style conformance and JDK7/8 compilation easily during their preparing

Re:

No permission is required. Just send your PR:) > On May 22, 2016, at 20:04, 成强 > wrote: > > spark-15429

[no subject]

I would like to contribute to spark. I am working on spark-15429. Please give permission to contribute.

Re: spark on kubernetes

On 05/22/2016 10:23 AM, Sun Rui wrote: > If it is possible to rewrite URL in outbound responses in Knox or other > reverse proxy, would that solve your issue? Any process which can keep track of workers and application drivers IP addresses and route traffic to those will work. Considering Spark

Re: spark on kubernetes

If it is possible to rewrite URL in outbound responses in Knox or other reverse proxy, would that solve your issue? > On May 22, 2016, at 14:55, Gurvinder Singh wrote: > > On 05/22/2016 08:32 AM, Reynold Xin wrote: >> Kubernetes itself already has facilities for http

Re: spark on kubernetes

On 05/22/2016 08:32 AM, Reynold Xin wrote: > Kubernetes itself already has facilities for http proxy, doesn't it? > Yeah kubernetes has ingress controller which can act the L7 load balancer and router traffic to Spark UI in this case. But I am referring to link present in UI to worker and

Re: spark on kubernetes

On 05/22/2016 08:30 AM, Sun Rui wrote: > I think “reverse proxy” is beneficial to monitoring a cluster in a > secure way. This feature is not only desired for Spark on standalone, > but also Spark on YARN, and also projects other than spark. I think to secure the Spark you can use any reverse

Re: spark on kubernetes

Kubernetes itself already has facilities for http proxy, doesn't it? On Sat, May 21, 2016 at 9:30 AM, Gurvinder Singh wrote: > Hi, > > I am currently working on deploying Spark on kuberentes (K8s) and it is > working fine. I am running Spark with standalone mode

Re: spark on kubernetes

I think “reverse proxy” is beneficial to monitoring a cluster in a secure way. This feature is not only desired for Spark on standalone, but also Spark on YARN, and also projects other than spark. Maybe Apache Knox can help you. Not sure how Knox can integrate with Spark. > On May 22, 2016, at