Github user rxin commented on the pull request:
https://github.com/apache/incubator-spark/pull/578#issuecomment-34846154
lgtm. will merge once jenkins is happy
Github user aarondav commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34845592
Jenkins, retest this please.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/578#issuecomment-34845562
Merged build triggered.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/578#issuecomment-34845563
Merged build started.
Github user colorant closed the pull request at:
https://github.com/apache/incubator-spark/pull/583
Github user mengxr commented on the pull request:
https://github.com/apache/incubator-spark/pull/578#issuecomment-34845415
The link is at the bottom of the PR description.
Github user rxin commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34844952
BTW Jenkins desire assertiveness. By asking him whether you could do this,
he wouldn't do it ...
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34844926
Merged build finished.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34844927
One or more automated tests failed
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12687/
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34844919
Merged build started.
Github user rxin commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34844932
It's because branch-0.9 doesn't have the scalastyle stuff ...
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34844917
Merged build triggered.
Github user rxin commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34844882
Jenkins, retest this please.
Github user andyk commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34844857
Jenkins, retest this please (can I do this?)
Github user rxin commented on the pull request:
https://github.com/apache/incubator-spark/pull/578#issuecomment-34844284
BTW - the new dev rules require us to create a JIRA for this, and update
the PR description to include a link to the JIRA.
Github user aarondav commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34844226
Jenkins, retest this please (can I do this?)
Github user aarondav commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34844075
Failure was due to scalastyle failing to run (not even a failure due to a
style violation). Weird.
Github user aarondav commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34843731
Merged into master and cherry-picked into branch-0.9 and branch-0.8.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/578#issuecomment-34843553
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12685/
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/578#issuecomment-34843552
Merged build finished.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34843473
One or more automated tests failed
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12686/
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34843472
Merged build finished.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34843445
Merged build started.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34843444
Merged build triggered.
Github user pwendell commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34843366
LGTM pending tests.
Github user pwendell commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34843361
Jenkins, test this please.
Github user aarondav commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34842990
Created issue
[SPARK-1080](https://spark-project.atlassian.net/browse/SPARK-1080) to
associate with this PR.
Sounds good, now that we are all clear on what we mean. Didn't mean to be
a dick, just was a little confused on what you meant.
On Tue, Feb 11, 2014 at 8:08 PM, Patrick Wendell wrote:
> I think Aaron just meant 1.0.0 by "the next minor release".
>
> On Tue, Feb 11, 2014 at 7:56 PM, Mark Hamstr
Github user mengxr commented on the pull request:
https://github.com/apache/incubator-spark/pull/578#issuecomment-34842407
@rxin Thanks! Please see the updated code.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/578#issuecomment-34842337
Merged build started.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/578#issuecomment-34842336
Merged build triggered.
Github user bijaybisht commented on the pull request:
https://github.com/apache/incubator-spark/pull/522#issuecomment-34841425
Pls merge #584 which is merge able now.
GitHub user bijaybisht opened a pull request:
https://github.com/apache/incubator-spark/pull/584
Ported hadoopClient jar for < 1.0.1 fix
#522 got messed after i rewrote the branch hadoop_jar_name. So created a
new one.
You can merge this pull request into a Git repository by runni
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/584#issuecomment-34841291
Can one of the admins verify this patch?
Github user bijaybisht closed the pull request at:
https://github.com/apache/incubator-spark/pull/522
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/522#issuecomment-34841092
Can one of the admins verify this patch?
GitHub user bijaybisht reopened a pull request:
https://github.com/apache/incubator-spark/pull/522
Hadoop jar name
This pull request is a copy of
#121 - Fix for hadoop client jar name, which got changed from 1.*. The
other one was from master, which is wrong way of generating t
Github user bijaybisht closed the pull request at:
https://github.com/apache/incubator-spark/pull/522
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34839767
Merged build finished.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34839768
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12683/
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34839550
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12682/
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34839549
Merged build finished.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34839331
Merged build finished.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34839333
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12681/
Github user pwendell commented on the pull request:
https://github.com/apache/incubator-spark/pull/522#issuecomment-34839244
@bijaybisht this is out of date with master - mind bringing it up to date?
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/522#issuecomment-34839050
One or more automated tests failed
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12684/
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/522#issuecomment-34839049
Build finished.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/522#issuecomment-34839012
Build triggered.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/522#issuecomment-34839013
Build started.
Github user pwendell commented on the pull request:
https://github.com/apache/incubator-spark/pull/522#issuecomment-34838973
Jenkins, test this please. This was reviewed previously as #121 by matei. I
think it's good to go.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34838606
Merged build triggered.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34838607
Merged build started.
Github user aarondav commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34838620
Alright, now looks-really-good-to-me :)
This should be included in 0.9.1.
Github user colorant commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34838369
oops, catch me ;) updated
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34838372
Merged build started.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34838371
Merged build triggered.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34838192
Merged build triggered.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34838194
Merged build started.
Github user aarondav commented on the pull request:
https://github.com/apache/incubator-spark/pull/583#issuecomment-34838201
Good catch! LGTM.
GitHub user colorant opened a pull request:
https://github.com/apache/incubator-spark/pull/583
Minor fix for ZooKeeperPersistenceEngine to use configured working dir
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/incubato
I think Aaron just meant 1.0.0 by "the next minor release".
On Tue, Feb 11, 2014 at 7:56 PM, Mark Hamstra wrote:
>>
>> The situation sounds fine for the next minor release...
>
>
> I don't understand what you mean by this. According to my current
> understanding, the next release of Spark other
My apologies, my intention was that it is fine for the next minor
*or*major release, regardless of what comes next. I only wanted to
distinguish
that from the next maintenance release, since my understanding is that we
wish to avoid changing dependencies during maintenance releases.
On Tue, Feb 1
Github user aarondav commented on the pull request:
https://github.com/apache/incubator-spark/pull/582#issuecomment-34836430
Thanks for looking into it! The situation sounds fine for the next minor
release, and I don't think this patch needs to be included in the next
maintenance rele
>
> The situation sounds fine for the next minor release...
I don't understand what you mean by this. According to my current
understanding, the next release of Spark other than maintenance releases on
0.9.x is intended to be a major release, 1.0.0, and there are no plans for
an intervening mino
Github user jyotiska commented on the pull request:
https://github.com/apache/incubator-spark/pull/581#issuecomment-34836413
I think for future improvements, it would be a good idea to move the
traceback code to a separate file and use that to return callsite. Please start
a JIRA tick
I am not sure I fully understand this reasoning. I imagine that lift-json
is only one of hundreds of packages that would have to be built if you
wanted to build all of Spark's transitive dependencies from source.
Additionally, to make sure I understand the impact -- this is only intended
to simpli
Github user willb commented on the pull request:
https://github.com/apache/incubator-spark/pull/582#issuecomment-34834423
The current version of json4s-jackson depends on paranamer 2.6, while the
current version of lift-json depends on 2.4.1. That's the only difference that
winds up
Should be fixed in both alpha and stable code base, since we aim to support
both version
Best Regards,
Raymond Liu
-Original Message-
From: Nan Zhu [mailto:zhunanmcg...@gmail.com]
Sent: Wednesday, February 12, 2014 10:29 AM
To: dev@spark.incubator.apache.org
Subject: Does yarn-stable st
Hi, all
I’m a new user of spark-yarn
I would like to create a pull request for an issue found in my usage, where
should I modify the code, stable or alpha (the problem exists in both)?
Best,
--
Nan Zhu
Github user colorant commented on the pull request:
https://github.com/apache/incubator-spark/pull/553#issuecomment-34831254
I agree that we do not need a hard check on it :) This patch looks good to
me, I just wonder we might need a few more explanation to clarify why this one
is not
Github user sryza commented on the pull request:
https://github.com/apache/incubator-spark/pull/553#issuecomment-34830852
It's true that you may need it when running in yarn-client mode. And also
true that you will not when running spark-shell. Because it depends, I think
not requir
Github user colorant commented on the pull request:
https://github.com/apache/incubator-spark/pull/553#issuecomment-34830448
@sryza I think this depends on what you mean to do with the yarn-client
mode, for spark-shell, since it is already packaged in the assembly jar. you
don't need
Github user aarondav commented on the pull request:
https://github.com/apache/incubator-spark/pull/582#issuecomment-34829822
Does json4s-jackson include any dependencies that lift-json doesn't? Does
the versioning match?
It seems that this version of json4s-jackson pulls in ja
Github user liancheng commented on the pull request:
https://github.com/apache/incubator-spark/pull/571#issuecomment-34825349
@aarondav I wonder is `@specialized` can be used here to avoid the type
dispatching in `CollectionUtils`?
+1 (non-binding)
On Tue, Feb 11, 2014 at 8:31 AM, Sean McNamara
wrote:
> +1 !!!
>
> On 2/10/14, 9:27 PM, "Chris Mattmann" wrote:
>
> >Hi Everyone,
> >
> >This is a new VOTE to decide if Apache Spark should graduate
> >from the Incubator. Please VOTE on the resolution pasted below
> >the ballot.
Github user holdenk closed the pull request at:
https://github.com/apache/incubator-spark/pull/571
Github user hsaputra closed the pull request at:
https://github.com/apache/incubator-spark/pull/577
Thanks Reynold! =)
- Henry
On Tue, Feb 11, 2014 at 3:05 PM, Reynold Xin wrote:
> I added you to the dev list on jira for spark.
>
>
> On Tue, Feb 11, 2014 at 2:58 PM, Henry Saputra wrote:
>
>> Hi Guys,
>>
>> With ASF JIRA still in transfer mode, could someone with permission to
>> add my userid
I added you to the dev list on jira for spark.
On Tue, Feb 11, 2014 at 2:58 PM, Henry Saputra wrote:
> Hi Guys,
>
> With ASF JIRA still in transfer mode, could someone with permission to
> add my userid "hsaputra" in https://spark-project.atlassian.net so I
> could assign issues and resolve them
Hi Guys,
With ASF JIRA still in transfer mode, could someone with permission to
add my userid "hsaputra" in https://spark-project.atlassian.net so I
could assign issues and resolve them myself?
CC @pwendell or @rxin
Thanks,
- Henry
Github user rxin commented on the pull request:
https://github.com/apache/incubator-spark/pull/571#issuecomment-34818238
Thanks. I've merged this.
Github user rxin commented on the pull request:
https://github.com/apache/incubator-spark/pull/577#issuecomment-34817976
Thanks. I've merged this.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/582#issuecomment-34804701
Merged build finished.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/582#issuecomment-34804702
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12680/
Github user jyotiska commented on the pull request:
https://github.com/apache/incubator-spark/pull/581#issuecomment-34804481
I have used the _extract_concise_traceback to print the callsite of
existing SparkContext. I guess this is what you had in mind.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/582#issuecomment-34801416
Merged build started.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/582#issuecomment-34801415
Merged build triggered.
Github user rxin commented on the pull request:
https://github.com/apache/incubator-spark/pull/582#issuecomment-34801246
Jenkins, add to whitelist.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/572#issuecomment-34800110
Merged build finished.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/572#issuecomment-34800114
One or more automated tests failed
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12679/
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/582#issuecomment-34799861
Can one of the admins verify this patch?
GitHub user willb opened a pull request:
https://github.com/apache/incubator-spark/pull/582
SPARK-1078: Replace lift-json with json4s-jackson.
The aim of the Json4s project is to provide a common API for
Scala JSON libraries. It is Apache-licensed, easier for
downstream dis
Github user JoshRosen commented on the pull request:
https://github.com/apache/incubator-spark/pull/581#issuecomment-34799232
You may be able to re-use the
[`_extract_concise_traceback`](https://github.com/apache/incubator-spark/pull/311/files#diff-d6fe2792e44f6babc94aabfefc8b9bceR43)
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/572#issuecomment-34798894
Merged build finished.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/572#issuecomment-34798895
One or more automated tests failed
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12678/
Github user jyotiska commented on the pull request:
https://github.com/apache/incubator-spark/pull/581#issuecomment-34798126
Got it. I will work on it and report it back to you. I guess traceback
module will be useful here.
Github user JoshRosen commented on the pull request:
https://github.com/apache/incubator-spark/pull/581#issuecomment-34797494
I'd store the constructor's call site (filename + line number) as an
instance variable inside SparkContext, since we already have the
`SparkContext._active_spa
Github user jyotiska commented on the pull request:
https://github.com/apache/incubator-spark/pull/581#issuecomment-34796972
I understand. Maybe we can use a global variable to store the call site
(line number?) and print it back along with the address. What do you think?
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/572#issuecomment-34797008
Merged build triggered.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/572#issuecomment-34797009
Merged build started.
1 - 100 of 138 matches
Mail list logo
