[GitHub] spark pull request: [SPARK-11017] Support ImperativeAggregates in ...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9038#issuecomment-146715344 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11017] Support ImperativeAggregates in ...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9038#issuecomment-146715345 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10810] [SPARK-10902] [SQL] Improve sess...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-146715402 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41583106 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,439 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-10810] [SPARK-10902] [SQL] Improve sess...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-146715308 [Test build #43428 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43428/console) for PR 8909 at commit

[GitHub] spark pull request: [SPARK-10973][ML][PYTHON] __gettitem__ method ...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9009#issuecomment-146716786 [Test build #1862 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1862/console) for PR 9009 at commit

[GitHub] spark pull request: [SPARK-8170][Python]Add signal handler to trap...

2015-10-08 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9033#issuecomment-146716840 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-10993] [SQL] Inital code generated enco...

2015-10-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9019#discussion_r41583866 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects.scala --- @@ -0,0 +1,334 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146716893 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10665][SQL] Query planner infra for loc...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9039#issuecomment-146716906 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146716905 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10665][SQL] Query planner infra for loc...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9039#issuecomment-146716888 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41562063 --- Diff: core/src/test/scala/org/apache/spark/StaticMemoryManagerSuite.scala --- @@ -0,0 +1,169 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146682930 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146682933 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10810] [SPARK-10902] [SQL] Improve sess...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-146682934 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146682895 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10858] YARN: archives/jar/files rename ...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9035#issuecomment-146682906 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10810] [SPARK-10902] [SQL] Improve sess...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-146682900 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41570238 --- Diff: core/src/main/scala/org/apache/spark/storage/MemoryStore.scala --- @@ -525,22 +519,40 @@ private[spark] class MemoryStore(blockManager:

[GitHub] spark pull request: [SPARK-10337][SQL][1.5] fix hive views on non-...

2015-10-08 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/9032#issuecomment-146712643 cc @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41582937 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,439 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41583010 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,439 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41584112 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,439 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41584139 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,439 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41584084 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,439 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41584063 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,439 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-8170][Python]Add signal handler to trap...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9033#issuecomment-146717125 [Test build #1863 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1863/consoleFull) for PR 9033 at commit

[GitHub] spark pull request: [SPARK-10250][CORE] External group by to handl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8438#issuecomment-146673367 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41562699 --- Diff: core/src/test/scala/org/apache/spark/StaticMemoryManagerSuite.scala --- @@ -0,0 +1,169 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-10250][CORE] External group by to handl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8438#issuecomment-146673361 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10250][CORE] External group by to handl...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8438#issuecomment-146673226 **[Test build #43400 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43400/console)** for PR 8438 at commit

[GitHub] spark pull request: [SPARK-10993] [SQL] Inital code generated enco...

2015-10-08 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9019#discussion_r41566470 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala --- @@ -75,6 +76,242 @@ trait ScalaReflection { */

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-08 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/8983#issuecomment-146680375 Sorry, this never passed tests and broke something. I'm going to revert. Please reopen the PR. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146683177 [Test build #43427 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43427/consoleFull) for PR 8988 at commit

[GitHub] spark pull request: [SPARK-10810] [SPARK-10902] [SQL] Improve sess...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-146683288 [Test build #43428 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43428/consoleFull) for PR 8909 at commit

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146685643 A note about interoperability: Hive 1.2.1 can read Parquet arrays and maps written in standard format. However, it still doesn't recognize Parquet decimals

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41569345 --- Diff: core/src/main/scala/org/apache/spark/storage/MemoryStore.scala --- @@ -525,22 +519,40 @@ private[spark] class MemoryStore(blockManager:

[GitHub] spark pull request: [SPARK-10973][ML][PYTHON] __gettitem__ method ...

2015-10-08 Thread zero323
Github user zero323 commented on the pull request: https://github.com/apache/spark/pull/9009#issuecomment-146689536 @jkbradley Done. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9016#discussion_r41570679 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnType.scala --- @@ -324,15 +296,18 @@ private[sql] object STRING extends

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9030#issuecomment-146693557 [Test build #1861 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1861/console) for PR 9030 at commit

[GitHub] spark pull request: [SPARK-8654] [SQL] Analysis exception when usi...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9036#issuecomment-146694616 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-8654] [SQL] Analysis exception when usi...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9036#issuecomment-146694612 [Test build #43430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43430/console) for PR 9036 at commit

[GitHub] spark pull request: [SPARK-8654] [SQL] Analysis exception when usi...

2015-10-08 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/9036#issuecomment-146696603 @cloud-fan , hi, how do we trigger a retest ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-8654] [SQL] Analysis exception when usi...

2015-10-08 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/9036#issuecomment-146701712 @cloud-fan It seems to fail now with the following exception .. hudson.plugins.git.GitException: Failed to fetch from https://github.com/apache/spark.git

[GitHub] spark pull request: [SPARK-10914] UnsafeRow serialization breaks w...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9030#issuecomment-146701970 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8654] [SQL] Analysis exception when usi...

2015-10-08 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/9036#issuecomment-146702882 you can just conmment "retest this please", and our jenkins will run the test for you :) --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41579688 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoCodec.scala --- @@ -0,0 +1,96 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-10337][SQL][1.5] fix hive views on non-...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9032#issuecomment-146711946 [Test build #43423 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43423/console) for PR 9032 at commit

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146713020 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11017] Support ImperativeAggregates in ...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9038#issuecomment-146713043 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11017] Support ImperativeAggregates in ...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9038#discussion_r41581411 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala --- @@ -134,19 +137,73 @@ class

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146713018 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11017] Support ImperativeAggregates in ...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9038#issuecomment-146713029 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11017] Support ImperativeAggregates in ...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9038#discussion_r41581951 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala --- @@ -288,17 +419,33 @@ class

[GitHub] spark pull request: [SPARK-11017] Support ImperativeAggregates in ...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9038#issuecomment-146714227 [Test build #43438 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43438/consoleFull) for PR 9038 at commit

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8988 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10993] [SQL] Inital code generated enco...

2015-10-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9019#discussion_r41583304 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects.scala --- @@ -0,0 +1,334 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-11007] [SQL] Adds dictionary aware Parq...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9040#issuecomment-146718007 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41584296 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,439 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146718024 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41584272 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,439 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-11007] [SQL] Adds dictionary aware Parq...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9040#issuecomment-146717980 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146718027 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41584339 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoOutputStream.scala --- @@ -0,0 +1,224 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41584330 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoOutputStream.scala --- @@ -0,0 +1,224 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9031#issuecomment-146672328 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9031#issuecomment-146672195 [Test build #43421 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43421/console) for PR 9031 at commit

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9000#discussion_r41563496 --- Diff: core/src/main/scala/org/apache/spark/SparkEnv.scala --- @@ -69,6 +69,8 @@ class SparkEnv ( val httpFileServer: HttpFileServer,

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146675183 [Test build #43417 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43417/console) for PR 8988 at commit

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146675256 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10960][SQL] SQL with windowing function...

2015-10-08 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/9011#issuecomment-146677593 Hi @viirya , can you add more description about the reason of this bug? e.g. why does this bug exist and how do you handle it, so that other people can understand

[GitHub] spark pull request: [SPARK-8170][Python]Add signal handler to trap...

2015-10-08 Thread ashwinshankar77
GitHub user ashwinshankar77 opened a pull request: https://github.com/apache/spark/pull/9033 [SPARK-8170][Python]Add signal handler to trap Ctrl-C in pyspark and cancel all running jobs This patch adds a signal handler to trap Ctrl-C and cancels running job. You can merge this

[GitHub] spark pull request: [SPARK-10337][SQL][1.5] fix hive views on non-...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9032#issuecomment-146679603 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10337][SQL][1.5] fix hive views on non-...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9032#issuecomment-146679568 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Revert [SPARK-8654] [SQL] Fix Analysis excepti...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9034#issuecomment-146681399 [Test build #43424 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43424/consoleFull) for PR 9034 at commit

[GitHub] spark pull request: Revert [SPARK-8654] [SQL] Fix Analysis excepti...

2015-10-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9034 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10337][SQL][1.5] fix hive views on non-...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9032#issuecomment-146681215 [Test build #43423 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43423/consoleFull) for PR 9032 at commit

[GitHub] spark pull request: [SPARK-10993] [SQL] Inital code generated enco...

2015-10-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9019 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-1267][PYSPARK] Adds pip installer for p...

2015-10-08 Thread rgbkrk
Github user rgbkrk commented on the pull request: https://github.com/apache/spark/pull/8318#issuecomment-146693064 Looks like @alope107 added fixes for the last few reviews. How does this stand now? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-10988] [SQL] Reduce duplication in Aggr...

2015-10-08 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9015#discussion_r41574147 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/utils.scala --- @@ -204,10 +144,13 @@ object Utils { } def

[GitHub] spark pull request: [SPARK-10988] [SQL] Reduce duplication in Aggr...

2015-10-08 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9015#issuecomment-146696229 LGTM. Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10858] YARN: archives/jar/files rename ...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9035#issuecomment-146709077 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10858] YARN: archives/jar/files rename ...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9035#issuecomment-146709018 [Test build #43425 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43425/console) for PR 9035 at commit

[GitHub] spark pull request: [SPARK-10858] YARN: archives/jar/files rename ...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9035#issuecomment-146709075 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-146709031 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41580146 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoCodec.scala --- @@ -0,0 +1,96 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9000#issuecomment-146712339 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11017] Support ImperativeAggregates in ...

2015-10-08 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/9038 [SPARK-11017] Support ImperativeAggregates in TungstenAggregate This patch extends TungstenAggregate to support ImperativeAggregate functions. The existing TungstenAggregate operator only

[GitHub] spark pull request: [SPARK-10956] Common MemoryManager interface f...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9000#issuecomment-146712356 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-08 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-146714344 Merged to master, thanks @davies for the detailed review! Finally fixed all the Parquet compatibility issues after 6 months! --- If your project is set up

[GitHub] spark pull request: [SPARK-11017] Support ImperativeAggregates in ...

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9038#discussion_r41582004 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala --- @@ -511,8 +658,10 @@ class

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146714428 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146714405 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41583648 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,439 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-10993] [SQL] Inital code generated enco...

2015-10-08 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9019#discussion_r41583685 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects.scala --- @@ -0,0 +1,334 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146716558 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146716512 [Test build #43429 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43429/console) for PR 9016 at commit

[GitHub] spark pull request: [SPARK-10990] [SQL] improve unrolling of compl...

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9016#issuecomment-146716559 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r41583770 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,439 @@ +/* + * Licensed to the Apache Software Foundation

<    1   2   3   4   5   6   7   8   9   10   >