[GitHub] spark pull request #16985: [SPARK-19122][SQL] Unnecessary shuffle+sort added...

2017-02-24 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16985#discussion_r102992758 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala --- @@ -33,8 +33,8 @@ import

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14731 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14731 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73433/ Test PASSed. ---

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14731 **[Test build #73433 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73433/testReport)** for PR 14731 at commit

[GitHub] spark pull request #16923: [SPARK-19038][YARN] Avoid overwriting keytab conf...

2017-02-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16923 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16923: [SPARK-19038][YARN] Avoid overwriting keytab configurati...

2017-02-24 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16923 Merging to master (2.1 and 2.0 if no conflicts). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #17038: [SPARK-19707][Core] Improve the invalid path chec...

2017-02-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17038 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17038: [SPARK-19707][Core] Improve the invalid path check for s...

2017-02-24 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17038 Merging to master (2.1 if no conflicts). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17031: [SPARK-19702][MESOS] Add suppress/revive support to the ...

2017-02-24 Thread susanxhuynh
Github user susanxhuynh commented on the issue: https://github.com/apache/spark/pull/17031 If we're concerned about the lost reviveOffer() and don't want to handle that corner case, do we want to document it somewhere for operators? "If jobs aren't running and you see [...] in the

[GitHub] spark issue #17031: [SPARK-19702][MESOS] Add suppress/revive support to the ...

2017-02-24 Thread susanxhuynh
Github user susanxhuynh commented on the issue: https://github.com/apache/spark/pull/17031 The suppress / revive logic LGTM. I didn't look that closely at the refactoring changes. Where are the Mesos/Spark integration tests that you mentioned? @mgummelt --- If your project is set

[GitHub] spark issue #17043: [SPARK-19719][SS][WIP] Kafka writer for both structured ...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17043 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17043: [SPARK-19719][SS][WIP] Kafka writer for both structured ...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17043 **[Test build #73432 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73432/testReport)** for PR 17043 at commit

[GitHub] spark issue #17043: [SPARK-19719][SS][WIP] Kafka writer for both structured ...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17043 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73432/ Test PASSed. ---

[GitHub] spark issue #16534: [SPARK-19161][PYTHON][SQL] Improving UDF Docstrings

2017-02-24 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/16534 I agree, just in case someone does have an isinstance check (or similar) we should document the change in the release notes. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #13932: [SPARK-15354] [CORE] Topology aware block replication st...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13932 **[Test build #73435 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73435/testReport)** for PR 13932 at commit

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14731 **[Test build #73434 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73434/testReport)** for PR 14731 at commit

[GitHub] spark issue #16534: [SPARK-19161][PYTHON][SQL] Improving UDF Docstrings

2017-02-24 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/16534 Thanks @holdenk. I think it should be mentioned as a change of behavior in the release notes. We don't change API, and `UserDefinedFunction` is hardly public (it is not even included in the docs),

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14731 **[Test build #73433 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73433/testReport)** for PR 14731 at commit

[GitHub] spark pull request #14731: [SPARK-17159] [streaming]: optimise check for new...

2017-02-24 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/14731#discussion_r102977480 --- Diff: docs/streaming-programming-guide.md --- @@ -630,35 +630,106 @@ which creates a DStream from text data received over a TCP socket

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2017-02-24 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/14731 @uncleGen: reviewed this, tweaked the docs slightly but otherwise, there's nothing left to do that I can see --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request #16534: [SPARK-19161][PYTHON][SQL] Improving UDF Docstrin...

2017-02-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16534 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16534: [SPARK-19161][PYTHON][SQL] Improving UDF Docstrings

2017-02-24 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/16534 Merged to master, thanks @zero323 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17043: [SPARK-19719][SS][WIP] Kafka writer for both structured ...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17043 **[Test build #73432 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73432/testReport)** for PR 17043 at commit

[GitHub] spark issue #16534: [SPARK-19161][PYTHON][SQL] Improving UDF Docstrings

2017-02-24 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/16534 Great! Thanks for doing this, will merge to master :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #16985: [SPARK-19122][SQL] Unnecessary shuffle+sort added...

2017-02-24 Thread tejasapatil
Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/16985#discussion_r102974682 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala --- @@ -33,8 +33,8 @@ import

[GitHub] spark issue #14807: [SPARK-17256][Deploy, Windows]Check before adding double...

2017-02-24 Thread roryodonnell
Github user roryodonnell commented on the issue: https://github.com/apache/spark/pull/14807 This causes issues starting Spark using the SparkLauncher under Windows, only when one sets an additional config parameter using the SparkLauncher.setConf method

[GitHub] spark issue #14412: [SPARK-15355] [CORE] Proactive block replication

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14412 **[Test build #73431 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73431/testReport)** for PR 14412 at commit

[GitHub] spark issue #16534: [SPARK-19161][PYTHON][SQL] Improving UDF Docstrings

2017-02-24 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/16534 Don't worry, I get it :) The point is to make user experience better not worse, right? In practice: - These changes are pretty far from data, so overall impact is negligible and constant.

[GitHub] spark issue #17057: [SPARK-19724][SQL]create a managed table with an existed...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17057 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73429/ Test FAILed. ---

[GitHub] spark issue #17057: [SPARK-19724][SQL]create a managed table with an existed...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17057 **[Test build #73429 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73429/testReport)** for PR 17057 at commit

[GitHub] spark issue #17057: [SPARK-19724][SQL]create a managed table with an existed...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17057 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16927: [SPARK-19571][R] Fix SparkR test break on Windows via Ap...

2017-02-24 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/16927 I could add the 2.6.5 binaries if you want, though the 2.6.4 ones should be compatible. I think I just lifted the 2.6.x artifacts out of an HDP build; its only the 2.7.x ones where I

[GitHub] spark issue #12004: [SPARK-7481] [build] Add spark-cloud module to pull in o...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12004 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12004: [SPARK-7481] [build] Add spark-cloud module to pull in o...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12004 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73430/ Test FAILed. ---

[GitHub] spark issue #12004: [SPARK-7481] [build] Add spark-cloud module to pull in o...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12004 **[Test build #73430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73430/testReport)** for PR 12004 at commit

[GitHub] spark issue #12004: [SPARK-7481] [build] Add spark-cloud module to pull in o...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12004 **[Test build #73430 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73430/testReport)** for PR 12004 at commit

[GitHub] spark issue #17054: Refactored the code to remove redundency of count operat...

2017-02-24 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17054 This is on purpose to show the speed effect of caching. Please close this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #12004: [SPARK-7481] [build] Add spark-cloud module to pull in o...

2017-02-24 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/12004 (apologies for not replying; rebuilding a deceased laptop) My main concern is to have the ability to make spark releases which include the object store client libraries and a set of

[GitHub] spark issue #17055: [SPARK-19723][SQL]create datasource table with an non-ex...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17055 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17055: [SPARK-19723][SQL]create datasource table with an non-ex...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17055 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73427/ Test PASSed. ---

[GitHub] spark issue #17055: [SPARK-19723][SQL]create datasource table with an non-ex...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17055 **[Test build #73427 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73427/testReport)** for PR 17055 at commit

[GitHub] spark issue #17057: [SPARK-19724][SQL]create a managed table with an existed...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17057 **[Test build #73429 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73429/testReport)** for PR 17057 at commit

[GitHub] spark issue #16938: [SPARK-19583][SQL]CTAS for data source table with a crea...

2017-02-24 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16938 @gatorsmile @cloud-fan could you help to review this pr? thanks :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #17057: [SPARK-19724][SQL]create a managed table with an existed...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17057 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17057: [SPARK-19724][SQL]create a managed table with an existed...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17057 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73428/ Test FAILed. ---

[GitHub] spark issue #17057: [SPARK-19724][SQL]create a managed table with an existed...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17057 **[Test build #73428 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73428/testReport)** for PR 17057 at commit

[GitHub] spark issue #17027: [SPARK-19650] Commands should not trigger a Spark job

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17027 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73425/ Test PASSed. ---

[GitHub] spark issue #17027: [SPARK-19650] Commands should not trigger a Spark job

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17027 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17027: [SPARK-19650] Commands should not trigger a Spark job

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17027 **[Test build #73425 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73425/testReport)** for PR 17027 at commit

[GitHub] spark issue #17057: [SPARK-19724][SQL][WIP]create a managed table with an ex...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17057 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73426/ Test FAILed. ---

[GitHub] spark issue #17057: [SPARK-19724][SQL][WIP]create a managed table with an ex...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17057 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17057: [SPARK-19724][SQL][WIP]create a managed table with an ex...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17057 **[Test build #73426 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73426/testReport)** for PR 17057 at commit

[GitHub] spark issue #15480: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2017-02-24 Thread dsimmie
Github user dsimmie commented on the issue: https://github.com/apache/spark/pull/15480 Is there any plan to apply this fix to 1.6? (am using the Cloudera version `spark-1.6.0-cdh5.9.0`) and am seeing this problem with running a `countDistinct` over a `DF` with 600 columns. --- If

[GitHub] spark issue #17058: Refactored code to remove null representation

2017-02-24 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17058 `var` is mutàble and the "default value" seems not exposed to users and being changed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #17058: Refactored code to remove null representation

2017-02-24 Thread HarshSharma8
Github user HarshSharma8 commented on the issue: https://github.com/apache/spark/pull/17058 May be this is right and readable from your point of view, this code is returning nothing else, just null again and again as default value if user along its other values are not present.

[GitHub] spark issue #17057: [SPARK-19724][SQL][WIP]CTAS for a managed hive table wit...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17057 **[Test build #73428 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73428/testReport)** for PR 17057 at commit

[GitHub] spark issue #17058: Refactored code to remove null representation

2017-02-24 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17058 It seems too tirival. The `default` seems even always `null`. I don't think this is an improvement if there is no other specific reason. The original codes are more readable to me. --- If

[GitHub] spark issue #17055: [SPARK-19723][SQL]create datasource table with an non-ex...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17055 **[Test build #73427 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73427/testReport)** for PR 17055 at commit

[GitHub] spark issue #17055: [SPARK-19723][SQL]create datasource table with an non-ex...

2017-02-24 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/17055 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17057: [SPARK-19724][SQL][WIP]CTAS for a managed hive table wit...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17057 **[Test build #73426 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73426/testReport)** for PR 17057 at commit

[GitHub] spark issue #16938: [SPARK-19583][SQL]CTAS for data source table with a crea...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16938 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16938: [SPARK-19583][SQL]CTAS for data source table with a crea...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16938 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73424/ Test PASSed. ---

[GitHub] spark issue #16938: [SPARK-19583][SQL]CTAS for data source table with a crea...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16938 **[Test build #73424 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73424/testReport)** for PR 16938 at commit

[GitHub] spark issue #17058: Refactored code to remove null representation

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17058 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16976: [SPARK-19610][SQL] Support parsing multiline CSV files

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16976 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73423/ Test PASSed. ---

[GitHub] spark issue #16976: [SPARK-19610][SQL] Support parsing multiline CSV files

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16976 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17058: Refactored code to remove null representation

2017-02-24 Thread HarshSharma8
GitHub user HarshSharma8 opened a pull request: https://github.com/apache/spark/pull/17058 Refactored code to remove null representation ## What changes were proposed in this pull request? Removed the null value that was returned directly with null representation and

[GitHub] spark issue #16976: [SPARK-19610][SQL] Support parsing multiline CSV files

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16976 **[Test build #73423 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73423/testReport)** for PR 16976 at commit

[GitHub] spark issue #16594: [SPARK-17078] [SQL] Show stats when explain

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16594 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73419/ Test PASSed. ---

[GitHub] spark issue #16594: [SPARK-17078] [SQL] Show stats when explain

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16594 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16594: [SPARK-17078] [SQL] Show stats when explain

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16594 **[Test build #73419 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73419/testReport)** for PR 16594 at commit

[GitHub] spark issue #17027: [SPARK-19650] Commands should not trigger a Spark job

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17027 **[Test build #73425 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73425/testReport)** for PR 17027 at commit

[GitHub] spark issue #17057: [SPARK-19724][SQL][WIP]CTAS for a managed hive table wit...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17057 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17057: [SPARK-19724][SQL][WIP]CTAS for a managed hive table wit...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17057 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73420/ Test PASSed. ---

[GitHub] spark issue #17057: [SPARK-19724][SQL][WIP]CTAS for a managed hive table wit...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17057 **[Test build #73420 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73420/testReport)** for PR 17057 at commit

[GitHub] spark issue #17053: [SPARK-18939][SQL] Timezone support in partition values.

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17053 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73418/ Test PASSed. ---

[GitHub] spark issue #17053: [SPARK-18939][SQL] Timezone support in partition values.

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17053 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17053: [SPARK-18939][SQL] Timezone support in partition values.

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17053 **[Test build #73418 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73418/testReport)** for PR 17053 at commit

[GitHub] spark issue #16976: [SPARK-19610][SQL] Support parsing multiline CSV files

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16976 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16976: [SPARK-19610][SQL] Support parsing multiline CSV files

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16976 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73417/ Test PASSed. ---

[GitHub] spark issue #16976: [SPARK-19610][SQL] Support parsing multiline CSV files

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16976 **[Test build #73417 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73417/testReport)** for PR 16976 at commit

[GitHub] spark issue #16976: [SPARK-19610][SQL] Support parsing multiline CSV files

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16976 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16976: [SPARK-19610][SQL] Support parsing multiline CSV files

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16976 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73422/ Test FAILed. ---

[GitHub] spark issue #16976: [SPARK-19610][SQL] Support parsing multiline CSV files

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16976 **[Test build #73422 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73422/testReport)** for PR 16976 at commit

[GitHub] spark pull request #17052: [SPARK-19690][SS] Join a streaming DataFrame with...

2017-02-24 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/17052#discussion_r102922775 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala --- @@ -393,6 +393,17 @@ case class

[GitHub] spark pull request #17052: [SPARK-19690][SS] Join a streaming DataFrame with...

2017-02-24 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/17052#discussion_r102922659 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala --- @@ -535,7 +535,8 @@ case class Range(

[GitHub] spark issue #17057: [SPARK-19724][SQL]CTAS for a managed hive table with an ...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17057 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17057: [SPARK-19724][SQL]CTAS for a managed hive table with an ...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17057 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73421/ Test FAILed. ---

[GitHub] spark issue #17057: [SPARK-19724][SQL]CTAS for a managed hive table with an ...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17057 **[Test build #73421 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73421/testReport)** for PR 17057 at commit

[GitHub] spark issue #16907: [SPARK-19572][SPARKR] Allow to disable hive in sparkR sh...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16907 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73416/ Test PASSed. ---

[GitHub] spark issue #16907: [SPARK-19572][SPARKR] Allow to disable hive in sparkR sh...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16907 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17051: [SPARK-17075][SQL] Follow up: fix file line ending and i...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17051 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73414/ Test PASSed. ---

[GitHub] spark issue #17051: [SPARK-17075][SQL] Follow up: fix file line ending and i...

2017-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17051 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16907: [SPARK-19572][SPARKR] Allow to disable hive in sparkR sh...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16907 **[Test build #73416 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73416/testReport)** for PR 16907 at commit

[GitHub] spark issue #17051: [SPARK-17075][SQL] Follow up: fix file line ending and i...

2017-02-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17051 **[Test build #73414 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73414/testReport)** for PR 17051 at commit

[GitHub] spark pull request #16976: [SPARK-19610][SQL] Support parsing multiline CSV ...

2017-02-24 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16976#discussion_r102916301 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -36,7 +37,7 @@ import

[GitHub] spark pull request #17042: [CORE][MINOR] Fix scaladoc

2017-02-24 Thread jaceklaskowski
Github user jaceklaskowski closed the pull request at: https://github.com/apache/spark/pull/17042 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #17057: [SPARK-19724][SQL]create a managed hive table wit...

2017-02-24 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17057#discussion_r102916099 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -1952,4 +1952,54 @@ class DDLSuite extends QueryTest with

[GitHub] spark issue #17042: [CORE][MINOR] Fix scaladoc

2017-02-24 Thread jaceklaskowski
Github user jaceklaskowski commented on the issue: https://github.com/apache/spark/pull/17042 Makes sense. Thanks @srowen! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17055: [SPARK-19723][SQL]create datasource table with an...

2017-02-24 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17055#discussion_r102915883 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -1952,4 +1952,49 @@ class DDLSuite extends QueryTest with

<    1   2   3   4   5   6   >