[GitHub] spark pull request: [SPARK-10515] When killing executor, the pendi...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8945#issuecomment-146755683 [Test build #43458 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43458/console) for PR 8945 at commit

[GitHub] spark pull request: [SPARK-10515] When killing executor, the pendi...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8945#issuecomment-146755528 [Test build #43458 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43458/consoleFull) for PR 8945 at commit

[GitHub] spark pull request: [SPARK-8654] [SQL] Analysis exception when usi...

2015-10-08 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/9036#issuecomment-146756112 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10990] [SPARK-11018] [SQL] improve unro...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146756468 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10990] [SPARK-11018] [SQL] improve unro...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146756479 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8654] [SQL] Analysis exception when usi...

2015-10-08 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/9036#issuecomment-146760436 Test this please On Oct 8, 2015 10:22 PM, "Dilip Biswal" wrote: > @cloud-fan > Hi Wenchen, the

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9000#issuecomment-146754464 Woohoo! Tests have passed as of the latest commit, so I'm going to merge this now. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146642923 LGTM, with except some minor comments, could you also update the PR description? (1.5 -> 1.4) --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-9718][ML] linear regression training su...

2015-10-08 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/8564#issuecomment-146643016 Thanks! Merging with master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9718][ML] linear regression training su...

2015-10-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8564 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10767][PYSPARK] Make pyspark shared par...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9017#issuecomment-146643664 [Test build #43411 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43411/console) for PR 9017 at commit

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6648#discussion_r41548771 --- Diff: network/shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockResolver.java --- @@ -163,12 +163,12 @@ public void

[GitHub] spark pull request: [SPARK-10973] __gettitem__ method throws Index...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9009#issuecomment-146644210 [Test build #1859 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1859/consoleFull) for PR 9009 at commit

[GitHub] spark pull request: SPARK-11006 Rename NullColumnAccess as NullCol...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9028#issuecomment-146645830 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7770] [ML] GBT validationTol change to ...

2015-10-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8549 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: SparkR joins. Used DataFrame.R and test_sparkS...

2015-10-08 Thread mfliu
GitHub user mfliu opened a pull request: https://github.com/apache/spark/pull/9029 SparkR joins. Used DataFrame.R and test_sparkSQL.R from Spark 1.5.1 I was having issues with collect() and orderBy() in Spark 1.5.0 so I used the DataFrame.R file and test_sparkSQL.R file from the

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9030#issuecomment-146647963 cc @davies and @JoshRosen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/9030 [SPARK-10914] UnsafeRow serialization breaks when two machines have different Oops size. UnsafeRow contains 3 pieces of information when pointing to some data in memory (an object, a base offset, and

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9030#discussion_r41551077 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoin.scala --- @@ -89,8 +89,13 @@ case class BroadcastHashJoin(

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9030#issuecomment-146648268 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9030#issuecomment-146648238 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8988#discussion_r41551421 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetIOSuite.scala --- @@ -176,6 +178,28 @@ class ParquetIOSuite

[GitHub] spark pull request: [SPARK-10973] __gettitem__ method throws Index...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9009#issuecomment-146649020 [Test build #1859 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1859/console) for PR 9009 at commit

[GitHub] spark pull request: [SPARK-10996][SPARKR] Implement sampleBy() in ...

2015-10-08 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/9023#issuecomment-146649139 It looked in this a bit since I thought I would be working on SPARK-9443 Would it be more R-like to support named list like this: ``` fractions =

[GitHub] spark pull request: [SPARK-10875][MLLib] Computed covariance matri...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8940#issuecomment-146649493 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SparkR joins. Used DataFrame.R and test_sparkS...

2015-10-08 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/9029#issuecomment-146649514 Jenkins, ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41551718 --- Diff: core/src/main/scala/org/apache/spark/MemoryManager.scala --- @@ -0,0 +1,100 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146650973 @davies All comments addressed. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146651550 [Test build #43417 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43417/consoleFull) for PR 8988 at commit

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9030#issuecomment-146651839 LGTM, we have done this for UTF8String already (not support Kryo). @cloud-fan Should we also do this for UnsafeArrayData? --- If your project is set up for it,

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9030#issuecomment-146652670 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9030#discussion_r41553096 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/UnsafeRowSuite.scala --- @@ -29,6 +30,32 @@ import org.apache.spark.unsafe.types.UTF8String

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9030#issuecomment-146652667 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9030#discussion_r41553070 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java --- @@ -596,4 +601,40 @@ public boolean anyNull() {

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41553080 --- Diff: core/src/main/scala/org/apache/spark/StaticMemoryManager.scala --- @@ -0,0 +1,229 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-11006 Rename NullColumnAccess as NullCol...

2015-10-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9028 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41553381 --- Diff: core/src/main/scala/org/apache/spark/StaticMemoryManager.scala --- @@ -0,0 +1,229 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-10622] [core] [yarn] Differentiate dead...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8887#issuecomment-146654329 [Test build #43403 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43403/console) for PR 8887 at commit

[GitHub] spark pull request: [SPARK-10979] [SparkR] Sparkrmerge: Add merge ...

2015-10-08 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/9012#issuecomment-146642706 Hi @felixcheung, what do you mean by "it breaks an existing api" ? I can call both merge from base and from SparkR it is similar to arrange, summary,

[GitHub] spark pull request: [SPARK-10973] __gettitem__ method throws Index...

2015-10-08 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/9009#issuecomment-146643732 @zero323 Can you please add tags "[ML] [PYTHON]" to the title of this PR? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-10767][PYSPARK] Make pyspark shared par...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9017#issuecomment-146643722 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10767][PYSPARK] Make pyspark shared par...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9017#issuecomment-146643723 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-11006 Rename NullColumnAccess as NullCol...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9028#issuecomment-146645641 [Test build #43402 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43402/console) for PR 9028 at commit

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-08 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/8983#issuecomment-146645486 Thanks a lot @marmbrus . Many thanks to @cloud-fan for his help. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: SPARK-11006 Rename NullColumnAccess as NullCol...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9028#issuecomment-146645833 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-7770] [ML] GBT validationTol change to ...

2015-10-08 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/8549#issuecomment-146645885 LGTM, merging with master. Thanks for the PR! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10905][SparkR]: Export freqItems() for ...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8962#issuecomment-146645978 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10905][SparkR]: Export freqItems() for ...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8962#issuecomment-146645981 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10979] [SparkR] Sparkrmerge: Add merge ...

2015-10-08 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/9012#issuecomment-146646706 I mean for a SparkR user who has code written to call merge like ``` merge(df, df2, df$name == df2$name, "outer") ``` would no longer work right?

[GitHub] spark pull request: SparkR joins. Used DataFrame.R and test_sparkS...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9029#issuecomment-146648243 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SparkR joins. Used DataFrame.R and test_sparkS...

2015-10-08 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/9029#issuecomment-146649529 cc @sun-rui --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-10875][MLLib] Computed covariance matri...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8940#issuecomment-146649523 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9030#issuecomment-146649482 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SparkR joins. Used DataFrame.R and test_sparkS...

2015-10-08 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/9029#issuecomment-146649495 Thanks for PR @mfliu - Could you format the PR title as `[SPARKR] [SPARK-10981] SparkR Join improvements` ? More instructions are at

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9030#issuecomment-146649524 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10875][MLLib] Computed covariance matri...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8940#issuecomment-146650691 [Test build #43415 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43415/consoleFull) for PR 8940 at commit

[GitHub] spark pull request: [SPARKR] [SPARK-10981] SparkR Join improvement...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9029#issuecomment-146651225 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146651270 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARKR] [SPARK-10981] SparkR Join improvement...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9029#issuecomment-146651254 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41552150 --- Diff: core/src/main/scala/org/apache/spark/MemoryManager.scala --- @@ -0,0 +1,100 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146651234 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41552537 --- Diff: core/src/main/scala/org/apache/spark/StaticMemoryManager.scala --- @@ -0,0 +1,229 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9030#issuecomment-146652257 [Test build #43414 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43414/consoleFull) for PR 9030 at commit

[GitHub] spark pull request: [SPARK-10887] [SQL] Build HashedRelation outsi...

2015-10-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8953 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10622] [core] [yarn] Differentiate dead...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8887#issuecomment-146654501 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10622] [core] [yarn] Differentiate dead...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8887#issuecomment-146654499 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/9030#issuecomment-146654269 I think we should apply this to unsafe array too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41557367 --- Diff: core/src/main/scala/org/apache/spark/MemoryManager.scala --- @@ -0,0 +1,100 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-146663391 [Test build #43405 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43405/console) for PR 8990 at commit

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-146663562 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-146663563 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-146663781 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-146663821 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41557708 --- Diff: core/src/main/scala/org/apache/spark/MemoryManager.scala --- @@ -0,0 +1,100 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41557901 --- Diff: core/src/main/scala/org/apache/spark/storage/MemoryStore.scala --- @@ -409,40 +397,42 @@ private[spark] class MemoryStore(blockManager:

[GitHub] spark pull request: [SPARK-10535] Sync up API for matrix factoriza...

2015-10-08 Thread smartkiwi
Github user smartkiwi commented on the pull request: https://github.com/apache/spark/pull/8700#issuecomment-146665724 Test passes. Any feedback on this? Or can this be merged? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41558500 --- Diff: core/src/main/scala/org/apache/spark/StaticMemoryManager.scala --- @@ -0,0 +1,229 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-146665667 [Test build #43418 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43418/consoleFull) for PR 8984 at commit

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-08 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-146665924 Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-14172 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-14193 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-14160 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-14191 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10855] [SQL] Add a JDBC dialect for Apa...

2015-10-08 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/8982#discussion_r41558960 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala --- @@ -464,5 +476,6 @@ class JDBCSuite extends SparkFunSuite with BeforeAndAfter

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-08 Thread adrian555
Github user adrian555 commented on the pull request: https://github.com/apache/spark/pull/8997#issuecomment-14559 @shivaram I have created the new pull request #9031 with the up-to-date files. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-08 Thread adrian555
GitHub user adrian555 opened a pull request: https://github.com/apache/spark/pull/9031 [SPARK-10913][SPARKR] attach() function support Bring the change code up to date. You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9030#discussion_r41558879 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/UnsafeRowSuite.scala --- @@ -29,6 +30,32 @@ import org.apache.spark.unsafe.types.UTF8String

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8990 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9031#issuecomment-146667220 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9031#issuecomment-146667176 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9030#issuecomment-146667055 [Test build #1860 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1860/consoleFull) for PR 9030 at commit

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9031#issuecomment-146668226 [Test build #43421 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43421/consoleFull) for PR 9031 at commit

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41560243 --- Diff: core/src/test/scala/org/apache/spark/StaticMemoryManagerSuite.scala --- @@ -0,0 +1,169 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-10810] [SPARK-10902] [SQL] Improve sess...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-146668946 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10810] [SPARK-10902] [SQL] Improve sess...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-146668949 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10810] [SPARK-10902] [SQL] Improve sess...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-146668852 [Test build #43407 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43407/console) for PR 8909 at commit

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41560298 --- Diff: core/src/main/scala/org/apache/spark/StaticMemoryManager.scala --- @@ -0,0 +1,229 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9016#discussion_r41560296 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/rowFormatConverters.scala --- @@ -23,6 +23,7 @@ import

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146669206 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-146669509 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

<    4   5   6   7   8   9   10   >