[GitHub] spark issue #19001: [SPARK-19256][SQL] Hive bucketing support

2017-08-20 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19001 The R failure looks irrelevant. ``` 1. Error: spark.logit (@test_mllib_classification.R#288) --- java.lang.IllegalArgumentException: requirement failed: The

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-20 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134120545 --- Diff: external/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisInputDStreamBuilderSuite.scala --- @@ -104,12 +103,61 @@ class

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-20 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134120489 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/InitialPosition.scala --- @@ -0,0 +1,104 @@ +/* + * Licensed to the

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-20 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134120477 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/InitialPosition.scala --- @@ -0,0 +1,104 @@ +/* + * Licensed to the

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-20 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134120566 --- Diff: external/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisInputDStreamBuilderSuite.scala --- @@ -104,12 +103,61 @@ class

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-20 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134120535 --- Diff: external/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisInputDStreamBuilderSuite.scala --- @@ -72,7 +70,8 @@ class

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-20 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134120475 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/InitialPosition.scala --- @@ -0,0 +1,104 @@ +/* + * Licensed to the

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-20 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134120473 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/InitialPosition.scala --- @@ -0,0 +1,104 @@ +/* + * Licensed to the

[GitHub] spark pull request #19005: [SPARK-21721][SQL][Followup] Clear FileSystem del...

2017-08-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19005 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #19005: [SPARK-21721][SQL][Followup] Clear FileSystem deleteOnEx...

2017-08-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19005 merging to master/2.2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #18968: [SPARK-21759][SQL] In.checkInputDataTypes should ...

2017-08-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18968#discussion_r134120146 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -138,46 +138,80 @@ case class Not(child:

[GitHub] spark pull request #18968: [SPARK-21759][SQL] In.checkInputDataTypes should ...

2017-08-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18968#discussion_r134120034 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -138,46 +138,80 @@ case class Not(child:

[GitHub] spark pull request #18968: [SPARK-21759][SQL] In.checkInputDataTypes should ...

2017-08-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18968#discussion_r134119992 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -138,46 +138,80 @@ case class Not(child:

[GitHub] spark pull request #18968: [SPARK-21759][SQL] In.checkInputDataTypes should ...

2017-08-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18968#discussion_r134119888 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -138,46 +138,80 @@ case class Not(child:

[GitHub] spark pull request #18315: [SPARK-21108] [ML] convert LinearSVC to aggregato...

2017-08-20 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/18315#discussion_r134104799 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LinearSVC.scala --- @@ -219,8 +219,17 @@ class LinearSVC @Since("2.2.0") ( val

[GitHub] spark pull request #18315: [SPARK-21108] [ML] convert LinearSVC to aggregato...

2017-08-20 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/18315#discussion_r134104829 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/aggregator/HingeAggregator.scala --- @@ -0,0 +1,106 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #18315: [SPARK-21108] [ML] convert LinearSVC to aggregato...

2017-08-20 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/18315#discussion_r134104881 --- Diff: mllib/src/test/scala/org/apache/spark/ml/optim/aggregator/HingeAggregatorSuite.scala --- @@ -0,0 +1,136 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #18315: [SPARK-21108] [ML] convert LinearSVC to aggregato...

2017-08-20 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/18315#discussion_r134104883 --- Diff: mllib/src/test/scala/org/apache/spark/ml/optim/aggregator/HingeAggregatorSuite.scala --- @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #18986: [SPARK-21774][SQL] The rule PromoteStrings should cast a...

2017-08-20 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18986 @maropu Previously I did it in https://github.com/apache/spark/blob/master/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercionSuite.scala#L34-L59 We can

[GitHub] spark issue #19007: [SPARK-21783][SQL]Turn on ORC filter push-down by defaul...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19007 **[Test build #80907 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80907/testReport)** for PR 19007 at commit

[GitHub] spark issue #18270: [SPARK-21055][SQL] replace grouping__id with grouping_id...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18270 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80905/ Test FAILed. ---

[GitHub] spark issue #18270: [SPARK-21055][SQL] replace grouping__id with grouping_id...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18270 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18270: [SPARK-21055][SQL] replace grouping__id with grouping_id...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18270 **[Test build #80905 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80905/testReport)** for PR 18270 at commit

[GitHub] spark issue #19007: [SPARK-21783][SQL]Turn on ORC filter push-down by defaul...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19007 **[Test build #80906 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80906/testReport)** for PR 19007 at commit

[GitHub] spark pull request #19007: [SPARK-21783][SQL]Turn on ORC filter push-down by...

2017-08-20 Thread vinodkc
GitHub user vinodkc opened a pull request: https://github.com/apache/spark/pull/19007 [SPARK-21783][SQL]Turn on ORC filter push-down by default ## What changes were proposed in this pull request? Turned on ORC filter push-down option by default,

[GitHub] spark issue #19005: [SPARK-21721][SQL][Followup] Clear FileSystem deleteOnEx...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19005 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80903/ Test PASSed. ---

[GitHub] spark issue #19005: [SPARK-21721][SQL][Followup] Clear FileSystem deleteOnEx...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19005 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #19005: [SPARK-21721][SQL][Followup] Clear FileSystem deleteOnEx...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19005 **[Test build #80903 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80903/testReport)** for PR 19005 at commit

[GitHub] spark issue #19001: [SPARK-19256][SQL] Hive bucketing support

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19001 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80900/ Test FAILed. ---

[GitHub] spark issue #19001: [SPARK-19256][SQL] Hive bucketing support

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19001 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #19001: [SPARK-19256][SQL] Hive bucketing support

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19001 **[Test build #80900 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80900/testReport)** for PR 19001 at commit

[GitHub] spark issue #19006: [SPARK-21721][SQL][Backport-2.1][Followup] Clear FileSys...

2017-08-20 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19006 Thanks @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #19006: [SPARK-21721][SQL][Backport-2.1][Followup] Clear ...

2017-08-20 Thread viirya
Github user viirya closed the pull request at: https://github.com/apache/spark/pull/19006 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18717: [SPARK-21510] [SQL] Add isMaterialized() and eager persi...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18717 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80902/ Test PASSed. ---

[GitHub] spark issue #18717: [SPARK-21510] [SQL] Add isMaterialized() and eager persi...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18717 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18717: [SPARK-21510] [SQL] Add isMaterialized() and eager persi...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18717 **[Test build #80902 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80902/testReport)** for PR 18717 at commit

[GitHub] spark issue #19006: [SPARK-21721][SQL][Backport-2.1][Followup] Clear FileSys...

2017-08-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19006 thanks, merging to 2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18999: [SPARK-21779][PYTHON] Simpler DataFrame.sample API in Py...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18999 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80898/ Test PASSed. ---

[GitHub] spark issue #18999: [SPARK-21779][PYTHON] Simpler DataFrame.sample API in Py...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18999 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18999: [SPARK-21779][PYTHON] Simpler DataFrame.sample API in Py...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18999 **[Test build #80898 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80898/testReport)** for PR 18999 at commit

[GitHub] spark issue #18997: [SPARK-21788][SS]Handle more exceptions when stopping a ...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18997 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18997: [SPARK-21788][SS]Handle more exceptions when stopping a ...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18997 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80901/ Test PASSed. ---

[GitHub] spark issue #18997: [SPARK-21788][SS]Handle more exceptions when stopping a ...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18997 **[Test build #80901 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80901/testReport)** for PR 18997 at commit

[GitHub] spark issue #18985: [SPARK-21772] Fix staging parent directory for InsertInt...

2017-08-20 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/18985 I am unable to reproduce the issue too. Moreover, the PR would change also the location for normal SparkSQL application. This sounds strange to me because then this problem should affect

[GitHub] spark issue #18270: [SPARK-21055][SQL] replace grouping__id with grouping_id...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18270 **[Test build #80905 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80905/testReport)** for PR 18270 at commit

[GitHub] spark issue #19003: [SPARK-21769] [SQL] Add a table-specific option for alwa...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19003 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80899/ Test PASSed. ---

[GitHub] spark issue #19003: [SPARK-21769] [SQL] Add a table-specific option for alwa...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19003 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18270: [SPARK-21055][SQL] replace grouping__id with grouping_id...

2017-08-20 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/18270 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #19003: [SPARK-21769] [SQL] Add a table-specific option for alwa...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19003 **[Test build #80899 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80899/testReport)** for PR 19003 at commit

[GitHub] spark issue #18981: Fixed pandoc dependency issue in python/setup.py

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18981 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18981: Fixed pandoc dependency issue in python/setup.py

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18981 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80904/ Test PASSed. ---

[GitHub] spark issue #18981: Fixed pandoc dependency issue in python/setup.py

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18981 **[Test build #80904 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80904/testReport)** for PR 18981 at commit

[GitHub] spark pull request #18958: [SPARK-21745][SQL] Refactor ColumnVector hierarch...

2017-08-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18958#discussion_r134115047 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnarBatch.java --- @@ -307,64 +293,69 @@ public void update(int ordinal,

[GitHub] spark pull request #18958: [SPARK-21745][SQL] Refactor ColumnVector hierarch...

2017-08-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18958#discussion_r134114861 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/MutableColumnVector.java --- @@ -0,0 +1,599 @@ +/* + * Licensed to

[GitHub] spark pull request #18958: [SPARK-21745][SQL] Refactor ColumnVector hierarch...

2017-08-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18958#discussion_r134114822 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnarBatch.java --- @@ -307,64 +293,69 @@ public void update(int ordinal,

[GitHub] spark issue #18981: Fixed pandoc dependency issue in python/setup.py

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18981 **[Test build #80904 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80904/testReport)** for PR 18981 at commit

[GitHub] spark issue #18981: Fixed pandoc dependency issue in python/setup.py

2017-08-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18981 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #18981: Fixed pandoc dependency issue in python/setup.py

2017-08-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18981 looks something gone wrong with Jenkins command.. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #18958: [SPARK-21745][SQL] Refactor ColumnVector hierarch...

2017-08-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18958#discussion_r134114762 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnVector.java --- @@ -1049,43 +511,9 @@ public ColumnVector

[GitHub] spark pull request #19002: [SPARK-21790][TESTS][FOLLOW-UP] Add filter pushdo...

2017-08-20 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19002#discussion_r134114700 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala --- @@ -39,7 +39,6 @@ import

[GitHub] spark issue #19005: [SPARK-21721][SQL][Followup] Clear FileSystem deleteOnEx...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19005 **[Test build #80903 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80903/testReport)** for PR 19005 at commit

[GitHub] spark pull request #18958: [SPARK-21745][SQL] Refactor ColumnVector hierarch...

2017-08-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18958#discussion_r134114641 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnVector.java --- @@ -281,62 +255,14 @@ public Object get(int ordinal,

[GitHub] spark issue #19005: [SPARK-21721][SQL][Followup] Clear FileSystem deleteOnEx...

2017-08-20 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19005 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #18958: [SPARK-21745][SQL] Refactor ColumnVector hierarch...

2017-08-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18958#discussion_r134114520 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedParquetRecordReader.java --- @@ -172,20 +177,26 @@ public

[GitHub] spark pull request #18958: [SPARK-21745][SQL] Refactor ColumnVector hierarch...

2017-08-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18958#discussion_r134114491 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedColumnReader.java --- @@ -433,7 +434,8 @@ private void

[GitHub] spark pull request #18958: [SPARK-21745][SQL] Refactor ColumnVector hierarch...

2017-08-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18958#discussion_r134114461 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -450,14 +450,13 @@ class

[GitHub] spark issue #18968: [SPARK-21759][SQL] In.checkInputDataTypes should not wro...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18968 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80895/ Test PASSed. ---

[GitHub] spark issue #18968: [SPARK-21759][SQL] In.checkInputDataTypes should not wro...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18968 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18968: [SPARK-21759][SQL] In.checkInputDataTypes should not wro...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18968 **[Test build #80895 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80895/testReport)** for PR 18968 at commit

[GitHub] spark issue #19006: [SPARK-21721][SQL][Backport-2.1][Followup] Clear FileSys...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19006 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80897/ Test PASSed. ---

[GitHub] spark issue #19006: [SPARK-21721][SQL][Backport-2.1][Followup] Clear FileSys...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19006 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #19006: [SPARK-21721][SQL][Backport-2.1][Followup] Clear FileSys...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19006 **[Test build #80897 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80897/testReport)** for PR 19006 at commit

[GitHub] spark issue #19005: [SPARK-21721][SQL][Followup] Clear FileSystem deleteOnEx...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19005 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80896/ Test FAILed. ---

[GitHub] spark issue #19005: [SPARK-21721][SQL][Followup] Clear FileSystem deleteOnEx...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19005 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #19005: [SPARK-21721][SQL][Followup] Clear FileSystem deleteOnEx...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19005 **[Test build #80896 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80896/testReport)** for PR 19005 at commit

[GitHub] spark issue #19006: [SPARK-21721][SQL][Backport-2.1][Followup] Clear FileSys...

2017-08-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19006 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #19005: [SPARK-21721][SQL][Followup] Clear FileSystem deleteOnEx...

2017-08-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19005 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #18984: [SPARK-21773][BUILD][DOCS] Installs mkdocs if missing in...

2017-08-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18984 It looks still failed during mkdocs installation - https://amplab.cs.berkeley.edu/jenkins/job/spark-master-docs/3588/consoleFull ``` Missing mkdocs in your path, trying to install

[GitHub] spark issue #18717: [SPARK-21510] [SQL] Add isMaterialized() and eager persi...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18717 **[Test build #80902 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80902/testReport)** for PR 18717 at commit

[GitHub] spark issue #18717: [SPARK-21510] [SQL] Add isMaterialized() and eager persi...

2017-08-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18717 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18717: [SPARK-21510] [SQL] Add isMaterialized() and eager persi...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18717 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18717: [SPARK-21510] [SQL] Add isMaterialized() and eager persi...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18717 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80894/ Test FAILed. ---

[GitHub] spark issue #18717: [SPARK-21510] [SQL] Add isMaterialized() and eager persi...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18717 **[Test build #80894 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80894/testReport)** for PR 18717 at commit

[GitHub] spark issue #19003: [SPARK-21769] [SQL] Add a table-specific option for alwa...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19003 **[Test build #80899 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80899/testReport)** for PR 19003 at commit

[GitHub] spark issue #18997: [SPARK-21788][SS]Handle more exceptions when stopping a ...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18997 **[Test build #80901 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80901/testReport)** for PR 18997 at commit

[GitHub] spark issue #19001: [SPARK-19256][SQL] Hive bucketing support

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19001 **[Test build #80900 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80900/testReport)** for PR 19001 at commit

[GitHub] spark issue #19003: [SPARK-21769] [SQL] Add a table-specific option for alwa...

2017-08-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19003 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18997: [SPARK-21788][SS]Handle more exceptions when stopping a ...

2017-08-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18997 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #19001: [SPARK-19256][SQL] Hive bucketing support

2017-08-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19001 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #19002: [SPARK-21790][TESTS][FOLLOW-UP] Add filter pushdown veri...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19002 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #19002: [SPARK-21790][TESTS][FOLLOW-UP] Add filter pushdown veri...

2017-08-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19002 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80890/ Test PASSed. ---

[GitHub] spark issue #19002: [SPARK-21790][TESTS][FOLLOW-UP] Add filter pushdown veri...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19002 **[Test build #80890 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80890/testReport)** for PR 19002 at commit

[GitHub] spark pull request #18984: [SPARK-21773][BUILD][DOCS] Installs mkdocs if mis...

2017-08-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18984 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18984: [SPARK-21773][BUILD][DOCS] Installs mkdocs if missing in...

2017-08-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18984 Merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18999: [SPARK-21779][PYTHON] Simpler DataFrame.sample API in Py...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18999 **[Test build #80898 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80898/testReport)** for PR 18999 at commit

[GitHub] spark issue #18984: [SPARK-21773][BUILD][DOCS] Installs mkdocs if missing in...

2017-08-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18984 Let me merge this one and see if the doc build passes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #19006: [SPARK-21721][SQL][Backport-2.1][Followup] Clear FileSys...

2017-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19006 **[Test build #80897 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80897/testReport)** for PR 19006 at commit

[GitHub] spark issue #19006: [SPARK-21721][SQL][Backport-2.1][Followup] Clear FileSys...

2017-08-20 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19006 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #19006: [SPARK-21721][SQL][Backport-2.1][Followup] Clear ...

2017-08-20 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/19006 [SPARK-21721][SQL][Backport-2.1][Followup] Clear FileSystem deleteOnExit cache when paths are successfully removed ## What changes were proposed in this pull request? Fix a typo in test.

[GitHub] spark issue #19005: [SPARK-21721][SQL][Followup] Clear FileSystem deleteOnEx...

2017-08-20 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19005 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

<    1   2   3   >