[GitHub] spark issue #18953: [SPARK-20682][SQL] Update ORC data source based on Apach...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18953 **[Test build #80869 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80869/testReport)** for PR 18953 at commit

[GitHub] spark issue #18986: [SPARK-21774][SQL] The rule PromoteStrings should cast a...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18986 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18986: [SPARK-21774][SQL] The rule PromoteStrings should cast a...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18986 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80868/ Test FAILed. ---

[GitHub] spark issue #18986: [SPARK-21774][SQL] The rule PromoteStrings should cast a...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18986 **[Test build #80868 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80868/testReport)** for PR 18986 at commit

[GitHub] spark issue #18849: [SPARK-21617][SQL] Store correct table metadata when alt...

2017-08-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18849 If the new flag `DATASOURCE_HIVE_COMPATIBLE` is set to `true` when creating a table, are we sure it can be `true` forever? Is it a reliable flag we can trust? Is that possible the `ALTER TABLE`

[GitHub] spark issue #18986: [SPARK-21774][SQL] The rule PromoteStrings should cast a...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18986 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80866/ Test FAILed. ---

[GitHub] spark issue #18986: [SPARK-21774][SQL] The rule PromoteStrings should cast a...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18986 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18986: [SPARK-21774][SQL] The rule PromoteStrings should cast a...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18986 **[Test build #80866 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80866/testReport)** for PR 18986 at commit

[GitHub] spark issue #18986: [SPARK-21774][SQL] The rule PromoteStrings should cast a...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18986 **[Test build #80868 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80868/testReport)** for PR 18986 at commit

[GitHub] spark issue #18973: [SPARK-21765] Set isStreaming on leaf nodes for streamin...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18973 **[Test build #80867 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80867/testReport)** for PR 18973 at commit

[GitHub] spark issue #18986: [SPARK-21774][SQL] The rule PromoteStrings should cast a...

2017-08-18 Thread stanzhai
Github user stanzhai commented on the issue: https://github.com/apache/spark/pull/18986 In MySQL conversion of values from one string type to numeric, will be compared as floating-point (real) numbers. [](https://dev.mysql.com/doc/refman/5.7/en/type-conversion.html)

[GitHub] spark issue #18968: [SPARK-21759][SQL] In.checkInputDataTypes should not wro...

2017-08-18 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18968 @dilipbiswal Thanks for comment. This issue is happened at optimization phase, so I think it is supposed that we already pass `checkAnalysis`. --- If your project is set up for it, you can

[GitHub] spark issue #18973: [SPARK-21765] Set isStreaming on leaf nodes for streamin...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18973 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80863/ Test PASSed. ---

[GitHub] spark issue #18973: [SPARK-21765] Set isStreaming on leaf nodes for streamin...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18973 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18973: [SPARK-21765] Set isStreaming on leaf nodes for streamin...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18973 **[Test build #80863 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80863/testReport)** for PR 18973 at commit

[GitHub] spark issue #18998: [SPARK-21748][ML] Migrate the implementation of HashingT...

2017-08-18 Thread facaiy
Github user facaiy commented on the issue: https://github.com/apache/spark/pull/18998 cc @yanboliang @WeichenXu123 who I believe are interested in this PR. Could you take a look please? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #18998: [SPARK-21748][ML] Migrate the implementation of HashingT...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18998 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #18998: [SPARK-21748][ML] Migrate the implementation of H...

2017-08-18 Thread facaiy
GitHub user facaiy opened a pull request: https://github.com/apache/spark/pull/18998 [SPARK-21748][ML] Migrate the implementation of HashingTF from MLlib to ML ## What changes were proposed in this pull request? Migrate the implementation of HashingTF from MLlib to ML.

[GitHub] spark issue #18973: [SPARK-21765] Set isStreaming on leaf nodes for streamin...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18973 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80864/ Test PASSed. ---

[GitHub] spark issue #18973: [SPARK-21765] Set isStreaming on leaf nodes for streamin...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18973 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18973: [SPARK-21765] Set isStreaming on leaf nodes for streamin...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18973 **[Test build #80864 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80864/testReport)** for PR 18973 at commit

[GitHub] spark issue #18986: [SPARK-21774][SQL] The rule PromoteStrings should cast a...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18986 **[Test build #80866 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80866/testReport)** for PR 18986 at commit

[GitHub] spark issue #18953: [SPARK-20682][SQL] Update ORC data source based on Apach...

2017-08-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18953 Hi, @cloud-fan . Could you review this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15435 **[Test build #80865 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80865/testReport)** for PR 15435 at commit

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15435 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80865/ Test FAILed. ---

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15435 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18762: [SPARK-21566][SQL][Python] Python method for summ...

2017-08-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18762 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15435 **[Test build #80865 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80865/testReport)** for PR 15435 at commit

[GitHub] spark issue #18762: [SPARK-21566][SQL][Python] Python method for summary

2017-08-18 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18762 Thanks for doing this @aray, LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18647: [MINOR][PYTHON] Remove obsolete codes for parsing abstra...

2017-08-18 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18647 Although I'd recommend doing a JIRA. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18647: [MINOR][PYTHON] Remove obsolete codes for parsing abstra...

2017-08-18 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18647 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #18953: [SPARK-20682][SQL] Update ORC data source based on Apach...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18953 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80861/ Test PASSed. ---

[GitHub] spark issue #18953: [SPARK-20682][SQL] Update ORC data source based on Apach...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18953 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18953: [SPARK-20682][SQL] Update ORC data source based on Apach...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18953 **[Test build #80861 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80861/testReport)** for PR 18953 at commit

[GitHub] spark issue #18968: [SPARK-21759][SQL] In.checkInputDataTypes should not wro...

2017-08-18 Thread dilipbiswal
Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/18968 @viirya Hi Simon, many thanks for finding this. Instead of adding the compensation code in the resolve logic for in-subquery expression can we consider to move the semantic checking of

[GitHub] spark issue #18896: [SPARK-21681][ML] fix bug of MLOR do not work correctly ...

2017-08-18 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/18896 Thanks for catching this @WeichenXu123! I just added a note about the intent of test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request #18896: [SPARK-21681][ML] fix bug of MLOR do not work cor...

2017-08-18 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/18896#discussion_r134076580 --- Diff: mllib/src/test/scala/org/apache/spark/ml/classification/LogisticRegressionSuite.scala --- @@ -1392,6 +1415,61 @@ class LogisticRegressionSuite

[GitHub] spark pull request #18896: [SPARK-21681][ML] fix bug of MLOR do not work cor...

2017-08-18 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/18896#discussion_r134076552 --- Diff: mllib/src/test/scala/org/apache/spark/ml/optim/aggregator/LogisticAggregatorSuite.scala --- @@ -238,8 +238,17 @@ class LogisticAggregatorSuite

[GitHub] spark issue #18538: [SPARK-14516][ML] Adding ClusteringEvaluator with the im...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18538 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80862/ Test PASSed. ---

[GitHub] spark issue #18981: Fixed pandoc dependency issue in python/setup.py

2017-08-18 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18981 Also to be clear pandoc is pretty optional, we want to use for packaging but in local mode it doesn't really matter. So LGTM pending jenkins. --- If your project is set up for it, you can reply to

[GitHub] spark issue #18538: [SPARK-14516][ML] Adding ClusteringEvaluator with the im...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18538 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18981: Fixed pandoc dependency issue in python/setup.py

2017-08-18 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18981 Thanks for fixing this @dusktreader :) OSError seems to mostly occur when pandoc is not installed. I think automatically attempting to install pandoc is more likely to lead us into

[GitHub] spark issue #18538: [SPARK-14516][ML] Adding ClusteringEvaluator with the im...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18538 **[Test build #80862 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80862/testReport)** for PR 18538 at commit

[GitHub] spark issue #18281: [SPARK-21027][ML][PYTHON] Added tunable parallelism to o...

2017-08-18 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18281 Also to be clear, I'm fine with the changes I've suggested being left for a follow up (but if we do go ahead and merge this without those changes lets make it an explicit follow up task). --- If

[GitHub] spark pull request #18982: [SPARK-21685][PYTHON][ML] PySpark Params isSet st...

2017-08-18 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/18982#discussion_r134075412 --- Diff: python/pyspark/ml/wrapper.py --- @@ -118,11 +118,13 @@ def _transfer_params_to_java(self): """ Transforms the embedded

[GitHub] spark pull request #18982: [SPARK-21685][PYTHON][ML] PySpark Params isSet st...

2017-08-18 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/18982#discussion_r134075445 --- Diff: python/pyspark/ml/tests.py --- @@ -455,6 +455,14 @@ def test_logistic_regression_check_thresholds(self): LogisticRegression,

[GitHub] spark issue #18905: [SPARK-21660][YARN][Shuffle] Yarn ShuffleService failed ...

2017-08-18 Thread LiShuMing
Github user LiShuMing commented on the issue: https://github.com/apache/spark/pull/18905 Sorry, busy recently, I will update it today... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18732: [SPARK-20396][SQL][PySpark] groupby().apply() with panda...

2017-08-18 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18732 cc @HyukjinKwon @BryanCutler --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18970: [SPARK-21468][PYSPARK][ML] Python API for FeatureHasher

2017-08-18 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18970 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #18622: [SPARK-21340] Bring pyspark BinaryClassificationMetrics ...

2017-08-18 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18622 Oh wait sorry I misread that code, it looks like we have this already wrapped behind in the Spark ML API. Since we aren't actively working on the Spark MLlib APIs right now I probably

[GitHub] spark issue #18622: [SPARK-21340] Bring pyspark BinaryClassificationMetrics ...

2017-08-18 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18622 So while we are trying to limit the changes in mllib, we are currently exposing BinaryClassificationMetrics in the ML models so this makes sense to expose. --- If your project is set up for it,

[GitHub] spark issue #17849: [SPARK-10931][ML][PYSPARK] PySpark Models Copy Param Val...

2017-08-18 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17849 LGTM, its certainly sort of an intermediary fix state but making the params accessible without users having to go through py4j manually is worth while. I'll leave this over the weekend in

[GitHub] spark issue #18973: [SPARK-21765] Set isStreaming on leaf nodes for streamin...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18973 **[Test build #80864 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80864/testReport)** for PR 18973 at commit

[GitHub] spark issue #18997: [SPARK-21788][SS]Handle more exceptions when stopping a ...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18997 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80859/ Test FAILed. ---

[GitHub] spark issue #18997: [SPARK-21788][SS]Handle more exceptions when stopping a ...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18997 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18997: [SPARK-21788][SS]Handle more exceptions when stopping a ...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18997 **[Test build #80859 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80859/testReport)** for PR 18997 at commit

[GitHub] spark issue #17373: [SPARK-12664][ML] Expose probability in mlp model

2017-08-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17373 We can open a JIRA to track --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18973: [SPARK-21765] Set isStreaming on leaf nodes for streamin...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18973 **[Test build #80863 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80863/testReport)** for PR 18973 at commit

[GitHub] spark issue #18994: [SPARK-21784][SQL] Adds support for defining information...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18994 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18994: [SPARK-21784][SQL] Adds support for defining information...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18994 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80855/ Test PASSed. ---

[GitHub] spark issue #18538: [SPARK-14516][ML] Adding ClusteringEvaluator with the im...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18538 **[Test build #80862 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80862/testReport)** for PR 18538 at commit

[GitHub] spark issue #18994: [SPARK-21784][SQL] Adds support for defining information...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18994 **[Test build #80855 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80855/testReport)** for PR 18994 at commit

[GitHub] spark issue #18953: [SPARK-20682][SQL] Update ORC data source based on Apach...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18953 **[Test build #80861 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80861/testReport)** for PR 18953 at commit

[GitHub] spark issue #18953: [SPARK-20682][SQL] Update ORC data source based on Apach...

2017-08-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18953 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18953: [SPARK-20682][SQL] Update ORC data source based on Apach...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18953 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18953: [SPARK-20682][SQL] Update ORC data source based on Apach...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18953 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80858/ Test FAILed. ---

[GitHub] spark issue #18953: [SPARK-20682][SQL] Update ORC data source based on Apach...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18953 **[Test build #80858 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80858/testReport)** for PR 18953 at commit

[GitHub] spark issue #18995: [SPARK-21787][SQL] Support for pushing down filters for ...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18995 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18995: [SPARK-21787][SQL] Support for pushing down filters for ...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18995 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80857/ Test PASSed. ---

[GitHub] spark issue #18995: [SPARK-21787][SQL] Support for pushing down filters for ...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18995 **[Test build #80857 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80857/testReport)** for PR 18995 at commit

[GitHub] spark pull request #18953: [SPARK-20682][SQL] Update ORC data source based o...

2017-08-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/18953#discussion_r134068925 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/OrcQuerySuite.scala --- @@ -205,38 +220,53 @@ class OrcQuerySuite extends QueryTest

[GitHub] spark issue #18029: [SPARK-20168] [DStream] Add changes to use kinesis fetch...

2017-08-18 Thread budde
Github user budde commented on the issue: https://github.com/apache/spark/pull/18029 @yssharma Let me know what you think of my review suggestions. I should be able to review any updates from here on in a timely manner but you will still need @brkyvz or another Spark committer to do

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-18 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134068101 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/InitialPosition.scala --- @@ -0,0 +1,107 @@ +/* + * Licensed to the

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-18 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134063427 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/InitialPosition.scala --- @@ -0,0 +1,107 @@ +/* + * Licensed to the

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-18 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134067474 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisReceiver.scala --- @@ -148,18 +149,28 @@ private[kinesis] class

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-18 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134063380 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/InitialPosition.scala --- @@ -0,0 +1,107 @@ +/* + * Licensed to the

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-18 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134067523 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/InitialPosition.scala --- @@ -0,0 +1,107 @@ +/* + * Licensed to the

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-18 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134067110 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisReceiver.scala --- @@ -148,18 +149,28 @@ private[kinesis] class

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-18 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134067791 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisInputDStream.scala --- @@ -308,7 +308,6 @@ object

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-18 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134067693 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/InitialPosition.scala --- @@ -0,0 +1,107 @@ +/* + * Licensed to the

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-18 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134068186 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/InitialPosition.scala --- @@ -0,0 +1,107 @@ +/* + * Licensed to the

[GitHub] spark pull request #18029: [SPARK-20168] [DStream] Add changes to use kinesi...

2017-08-18 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/18029#discussion_r134067537 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/InitialPosition.scala --- @@ -0,0 +1,107 @@ +/* + * Licensed to the

[GitHub] spark issue #18538: [SPARK-14516][ML] Adding ClusteringEvaluator with the im...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18538 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80860/ Test FAILed. ---

[GitHub] spark issue #18538: [SPARK-14516][ML] Adding ClusteringEvaluator with the im...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18538 **[Test build #80860 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80860/testReport)** for PR 18538 at commit

[GitHub] spark issue #18538: [SPARK-14516][ML] Adding ClusteringEvaluator with the im...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18538 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18538: [SPARK-14516][ML] Adding ClusteringEvaluator with the im...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18538 **[Test build #80860 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80860/testReport)** for PR 18538 at commit

[GitHub] spark pull request #18940: [SPARK-21501] Change CacheLoader to limit entries...

2017-08-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18940#discussion_r134058845 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -597,7 +597,8 @@ private[spark] object SparkConf extends Logging {

[GitHub] spark issue #16992: [SPARK-19662][SCHEDULER][TEST] Add Fair Scheduler Unit T...

2017-08-18 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/16992 been a while so lets run tests again just to check: Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #16992: [SPARK-19662][SCHEDULER][TEST] Add Fair Scheduler...

2017-08-18 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/16992#discussion_r134056863 --- Diff: docs/job-scheduling.md --- @@ -235,7 +235,7 @@ properties: of the cluster. By default, each pool's `minShare` is 0. The pool

[GitHub] spark issue #18997: [SPARK-21788][SS]Handle more exceptions when stopping a ...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18997 **[Test build #80859 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80859/testReport)** for PR 18997 at commit

[GitHub] spark pull request #18997: [SPARK-21788][SS]Handle more exceptions when stop...

2017-08-18 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/18997 [SPARK-21788][SS]Handle more exceptions when stopping a streaming query ## What changes were proposed in this pull request? Add more cases we should view as a normal query stop rather than

[GitHub] spark issue #18978: [SPARK-21737][YARN]Create communication channel between ...

2017-08-18 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18978 So, one thing I'm a little confused about is: why are there any changes necessary to the transport library at all? The transport library abstracts away the concept of users / secrets so that

[GitHub] spark issue #18953: [SPARK-20682][SQL] Update ORC data source based on Apach...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18953 **[Test build #80858 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80858/testReport)** for PR 18953 at commit

[GitHub] spark issue #18972: [SPARK-21720][SQL] Fix 64KB JVM bytecode limit problem w...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18972 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18972: [SPARK-21720][SQL] Fix 64KB JVM bytecode limit problem w...

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18972 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80853/ Test PASSed. ---

[GitHub] spark issue #18972: [SPARK-21720][SQL] Fix 64KB JVM bytecode limit problem w...

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18972 **[Test build #80853 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80853/testReport)** for PR 18972 at commit

[GitHub] spark issue #18940: [SPARK-21501] Change CacheLoader to limit entries based ...

2017-08-18 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/18940 +1. Any further comments. @vanzin @jiangxb1987 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18996: [MINOR][TYPO] Fix typos: runnning and Excecutors

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18996 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80856/ Test PASSed. ---

[GitHub] spark issue #18996: [MINOR][TYPO] Fix typos: runnning and Excecutors

2017-08-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18996 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18996: [MINOR][TYPO] Fix typos: runnning and Excecutors

2017-08-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18996 **[Test build #80856 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80856/testReport)** for PR 18996 at commit

  1   2   3   4   >