Re: Spark development with IntelliJ

2015-01-17 Thread Chunnan Yao
Followed is the discussion between Imran and me. 2015-01-18 4:12 GMT+08:00 Chunnan Yao yaochun...@gmail.com: Thank you for your patience! Im now not so familiar with the mailing list. I just clicked reply in Gmail, thinking it would be automatically attached to the list. I will later post the

Re: Spark development with IntelliJ

2015-01-17 Thread Chunnan Yao
Nice! - Feel the sparking Spark! -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-development-with-IntelliJ-tp10032p10167.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

Re: Spark development with IntelliJ

2015-01-17 Thread Imran Rashid
btw, I updated the wiki to include instructions on making the macro-paradise jar a compiler plugin for Intellij: https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark#ContributingtoSpark-IntelliJ On Sat, Jan 17, 2015 at 12:16 PM, Chunnan Yao yaochun...@gmail.com wrote:

Re: Bouncing Mails

2015-01-17 Thread Patrick Wendell
Akhil, Those are handled by ASF infrastructure, not anyone in the Spark project. So this list is not the appropriate place to ask for help. - Patrick On Sat, Jan 17, 2015 at 12:56 AM, Akhil Das ak...@sigmoidanalytics.com wrote: My mails to the mailing list are getting rejected, have opened a

Re: Semantics of LGTM

2015-01-17 Thread Matei Zaharia
+1 on this. On Jan 17, 2015, at 6:16 PM, Reza Zadeh r...@databricks.com wrote: LGTM On Sat, Jan 17, 2015 at 5:40 PM, Patrick Wendell pwend...@gmail.com wrote: Hey All, Just wanted to ping about a minor issue - but one that ends up having consequence given Spark's volume of reviews

Re: Bouncing Mails

2015-01-17 Thread Akhil Das
Yep. They have sorted it out it seems. On 18 Jan 2015 03:58, Patrick Wendell pwend...@gmail.com wrote: Akhil, Those are handled by ASF infrastructure, not anyone in the Spark project. So this list is not the appropriate place to ask for help. - Patrick On Sat, Jan 17, 2015 at 12:56 AM,

Re: Semantics of LGTM

2015-01-17 Thread sandy . ryza
I think clarifying these semantics is definitely worthwhile. Maybe this complicates the process with additional terminology, but the way I've used these has been: +1 - I think this is safe to merge and, barring objections from others, would merge it immediately. LGTM - I have no concerns

Re: Semantics of LGTM

2015-01-17 Thread Aaron Davidson
I think I've seen something like +2 = strong LGTM and +1 = weak LGTM; someone else should review before. It's nice to have a shortcut which isn't a sentence when talking about weaker forms of LGTM. On Sat, Jan 17, 2015 at 6:59 PM, sandy.r...@cloudera.com wrote: I think clarifying these

run time exceptions in Spark 1.2.0 manual build together with OpenStack hadoop driver

2015-01-17 Thread Gil Vernik
Hi, I took a source code of Spark 1.2.0 and tried to build it together with hadoop-openstack.jar ( To allow Spark an access to OpenStack Swift ) I used Hadoop 2.6.0. The build was fine without problems, however in run time, while trying to access swift:// name space i got an exception:

Re: Semantics of LGTM

2015-01-17 Thread Kay Ousterhout
+1 to Patrick's proposal of strong LGTM semantics. On past projects, I've heard the semantics of LGTM expressed as I've looked at this thoroughly and take as much ownership as if I wrote the patch myself. My understanding is that this is the level of review we expect for all patches that

Re: Semantics of LGTM

2015-01-17 Thread Reza Zadeh
LGTM On Sat, Jan 17, 2015 at 5:40 PM, Patrick Wendell pwend...@gmail.com wrote: Hey All, Just wanted to ping about a minor issue - but one that ends up having consequence given Spark's volume of reviews and commits. As much as possible, I think that we should try and gear towards Google

Re: Semantics of LGTM

2015-01-17 Thread sandy . ryza
Yeah, the ASF +1 has become partly overloaded to mean both I would like to see this feature and this patch should be committed, although, at least in Hadoop, using +1 on JIRA (as opposed to, say, in a release vote) should unambiguously mean the latter unless qualified in some other way. I

Semantics of LGTM

2015-01-17 Thread Patrick Wendell
Hey All, Just wanted to ping about a minor issue - but one that ends up having consequence given Spark's volume of reviews and commits. As much as possible, I think that we should try and gear towards Google Style LGTM on reviews. What I mean by this is that LGTM has the following semantics: I

Bouncing Mails

2015-01-17 Thread Akhil Das
My mails to the mailing list are getting rejected, have opened a Jira issue, can someone take a look at it? https://issues.apache.org/jira/browse/INFRA-9032 Thanks Best Regards

Re: Spark development with IntelliJ

2015-01-17 Thread Chunnan Yao
*I followed the procedures instructed by https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark#ContributingtoSpark-IntelliJ. But problems still occurs which has made me a little bit annoyed. My environment settings are:JAVA 1.7.0 Scala: 2.10.4 Spark:1.2.0, Intellij Idea

Re: LinearRegressionWithSGD accuracy

2015-01-17 Thread DB Tsai
I'm working on LinearRegressionWithElasticNet using OWLQN now. This will do the data standardization internally so it's transparent to users. With OWLQN, you don't have to manually choose stepSize. Will send out PR soon next week. Sincerely, DB Tsai

Re: Spark development with IntelliJ

2015-01-17 Thread Sean Owen
Yes I've seen that error in the past too, and was just talking to Imran the other day about it. I thought it only occurred when the hive module was enabled, which I don't enable. The problem is that the plugin that causes an error in IntelliJ for scalac is what parses these values.* I think he