[GitHub] spark pull request #14008: [SPARK-16281][SQL] Implement parse_url SQL functi...

2016-07-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14008 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14095: [SPARK-16429][SQL] Include `StringType` columns i...

2016-07-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14095 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14008: [SPARK-16281][SQL] Implement parse_url SQL function

2016-07-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14008 Thanks - merging in master/2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14108: [SPARK-16453] [BUILD] release-build.sh is missing hive-t...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14108 **[Test build #61999 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61999/consoleFull)** for PR 14108 at commit

[GitHub] spark issue #14095: [SPARK-16429][SQL] Include `StringType` columns in `desc...

2016-07-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14095 Thanks - merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14108: [SPARK-16453] [BUILD] release-build.sh is missing...

2016-07-08 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/14108#discussion_r70144675 --- Diff: dev/create-release/release-build.sh --- @@ -258,7 +258,7 @@ if [[ "$1" == "publish-snapshot" ]]; then -Phive-thriftserver deploy

[GitHub] spark pull request #14108: [SPARK-16453] [BUILD] release-build.sh is missing...

2016-07-08 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/14108#discussion_r70144693 --- Diff: dev/create-release/release-build.sh --- @@ -258,7 +258,7 @@ if [[ "$1" == "publish-snapshot" ]]; then -Phive-thriftserver deploy

[GitHub] spark pull request #14108: [SPARK-16453] [BUILD] release-build.sh is missing...

2016-07-08 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/14108#discussion_r70144390 --- Diff: dev/create-release/release-build.sh --- @@ -258,7 +258,7 @@ if [[ "$1" == "publish-snapshot" ]]; then -Phive-thriftserver deploy

[GitHub] spark pull request #14108: [SPARK-16453] [BUILD] release-build.sh is missing...

2016-07-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14108#discussion_r70144266 --- Diff: dev/create-release/release-build.sh --- @@ -258,7 +258,7 @@ if [[ "$1" == "publish-snapshot" ]]; then -Phive-thriftserver deploy

[GitHub] spark issue #14108: [SPARK-16453] [BUILD] release-build.sh is missing hive-t...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14108 **[Test build #61998 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61998/consoleFull)** for PR 14108 at commit

[GitHub] spark pull request #14108: [SPARK-16453] [BUILD] release-build.sh is missing...

2016-07-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14108#discussion_r70144037 --- Diff: dev/create-release/release-build.sh --- @@ -258,7 +258,7 @@ if [[ "$1" == "publish-snapshot" ]]; then -Phive-thriftserver deploy

[GitHub] spark issue #14108: [SPARK-16453] [BUILD] release-build.sh is missing hive-t...

2016-07-08 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14108 cc @JoshRosen @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #14108: [SPARK-16453] [BUILD] release-build.sh is missing...

2016-07-08 Thread yhuai
GitHub user yhuai opened a pull request: https://github.com/apache/spark/pull/14108 [SPARK-16453] [BUILD] release-build.sh is missing hive-thriftserver for scala 2.10 ## What changes were proposed in this pull request? This PR adds hive-thriftserver profile to scala 2.10 build

[GitHub] spark issue #14034: [SPARK-16355] [SPARK-16354] [SQL] Fix Bugs When LIMIT/TA...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14034 **[Test build #61997 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61997/consoleFull)** for PR 14034 at commit

[GitHub] spark issue #14107: [SPARK-16387][SQL] JDBC Writer should use dialect to quo...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14107 **[Test build #61996 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61996/consoleFull)** for PR 14107 at commit

[GitHub] spark pull request #14107: [SPARK-16387][SQL] JDBC Writer should use dialect...

2016-07-08 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/14107 [SPARK-16387][SQL] JDBC Writer should use dialect to quote field names. ## What changes were proposed in this pull request? Currently, JDBC Writer uses dialects to get datatypes, but

[GitHub] spark issue #14008: [SPARK-16281][SQL] Implement parse_url SQL function

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14008 **[Test build #3173 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3173/consoleFull)** for PR 14008 at commit

[GitHub] spark pull request #13890: [SPARK-16189][SQL] Add ExternalRDD logical plan f...

2016-07-08 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/13890#discussion_r70139445 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala --- @@ -74,13 +74,71 @@ object RDDConversions { } }

[GitHub] spark issue #13991: [SPARK-16318][SQL] Implement all remaining xpath functio...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13991 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61992/ Test PASSed. ---

[GitHub] spark issue #13991: [SPARK-16318][SQL] Implement all remaining xpath functio...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13991 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13991: [SPARK-16318][SQL] Implement all remaining xpath functio...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13991 **[Test build #61992 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61992/consoleFull)** for PR 13991 at commit

[GitHub] spark issue #14006: [SPARK-13015][MLlib][DOC] Replace example code in mllib-...

2016-07-08 Thread yinxusen
Github user yinxusen commented on the issue: https://github.com/apache/spark/pull/14006 @mengxr --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #13831: [SPARK-16119][sql] Support PURGE option to drop table / ...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13831 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61991/ Test PASSed. ---

[GitHub] spark issue #13831: [SPARK-16119][sql] Support PURGE option to drop table / ...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13831 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13831: [SPARK-16119][sql] Support PURGE option to drop table / ...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13831 **[Test build #61991 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61991/consoleFull)** for PR 13831 at commit

[GitHub] spark issue #13374: [SPARK-13638][SQL] Add quoteAll option to CSV DataFrameW...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13374 **[Test build #3172 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3172/consoleFull)** for PR 13374 at commit

[GitHub] spark issue #13738: [SPARK-11227][CORE] UnknownHostException can be thrown w...

2016-07-08 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/13738 Sorry for my delay on this, so it looks like if we create any FileSystem is will cause the service loaders to load all services, so in hadoopRDD, newApiHadoopRDD where we don't know the path we

[GitHub] spark issue #14082: [SPARK-16381][SQL][SparkR] Update SQL examples and progr...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14082 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61995/ Test PASSed. ---

[GitHub] spark issue #14082: [SPARK-16381][SQL][SparkR] Update SQL examples and progr...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14082 **[Test build #61995 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61995/consoleFull)** for PR 14082 at commit

[GitHub] spark issue #14082: [SPARK-16381][SQL][SparkR] Update SQL examples and progr...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14082 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14095: [SPARK-16429][SQL] Include `StringType` columns i...

2016-07-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14095#discussion_r70130356 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -228,6 +228,15 @@ class Dataset[T] private[sql]( } }

[GitHub] spark pull request #14095: [SPARK-16429][SQL] Include `StringType` columns i...

2016-07-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14095#discussion_r70130150 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -228,6 +228,15 @@ class Dataset[T] private[sql]( } }

[GitHub] spark pull request #14093: SPARK-16420: Ensure compression streams are close...

2016-07-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14093 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14093: SPARK-16420: Ensure compression streams are closed.

2016-07-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14093 Merging in master/2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14082: [SPARK-16381][SQL][SparkR] Update SQL examples and progr...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14082 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14082: [SPARK-16381][SQL][SparkR] Update SQL examples and progr...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14082 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61993/ Test PASSed. ---

[GitHub] spark issue #14082: [SPARK-16381][SQL][SparkR] Update SQL examples and progr...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14082 **[Test build #61993 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61993/consoleFull)** for PR 14082 at commit

[GitHub] spark issue #14006: [SPARK-13015][MLlib][DOC] Replace example code in mllib-...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14006 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14006: [SPARK-13015][MLlib][DOC] Replace example code in mllib-...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14006 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61994/ Test PASSed. ---

[GitHub] spark issue #14080: [SPARK-16405] Add metrics and source for external shuffl...

2016-07-08 Thread lovexi
Github user lovexi commented on the issue: https://github.com/apache/spark/pull/14080 Added some test cases to verify expected metrics values @ericl --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #14006: [SPARK-13015][MLlib][DOC] Replace example code in mllib-...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14006 **[Test build #61994 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61994/consoleFull)** for PR 14006 at commit

[GitHub] spark issue #14093: SPARK-16420: Ensure compression streams are closed.

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14093 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14093: SPARK-16420: Ensure compression streams are closed.

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14093 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61988/ Test PASSed. ---

[GitHub] spark issue #14093: SPARK-16420: Ensure compression streams are closed.

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14093 **[Test build #61988 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61988/consoleFull)** for PR 14093 at commit

[GitHub] spark issue #14082: [SPARK-16381][SQL][SparkR] Update SQL examples and progr...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14082 **[Test build #61995 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61995/consoleFull)** for PR 14082 at commit

[GitHub] spark pull request #14082: [SPARK-16381][SQL][SparkR] Update SQL examples an...

2016-07-08 Thread keypointt
Github user keypointt commented on a diff in the pull request: https://github.com/apache/spark/pull/14082#discussion_r70125600 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -0,0 +1,198 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark pull request #14082: [SPARK-16381][SQL][SparkR] Update SQL examples an...

2016-07-08 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/14082#discussion_r70125056 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -0,0 +1,198 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark pull request #14082: [SPARK-16381][SQL][SparkR] Update SQL examples an...

2016-07-08 Thread keypointt
Github user keypointt commented on a diff in the pull request: https://github.com/apache/spark/pull/14082#discussion_r70124885 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -0,0 +1,198 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark pull request #14082: [SPARK-16381][SQL][SparkR] Update SQL examples an...

2016-07-08 Thread keypointt
Github user keypointt commented on a diff in the pull request: https://github.com/apache/spark/pull/14082#discussion_r70124300 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -0,0 +1,198 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark pull request #14082: [SPARK-16381][SQL][SparkR] Update SQL examples an...

2016-07-08 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/14082#discussion_r70124201 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -0,0 +1,198 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark pull request #14082: [SPARK-16381][SQL][SparkR] Update SQL examples an...

2016-07-08 Thread keypointt
Github user keypointt commented on a diff in the pull request: https://github.com/apache/spark/pull/14082#discussion_r70124162 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -0,0 +1,198 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark issue #14082: [SPARK-16381][SQL][SparkR] Update SQL examples and progr...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14082 **[Test build #61993 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61993/consoleFull)** for PR 14082 at commit

[GitHub] spark issue #14006: [SPARK-13015][MLlib][DOC] Replace example code in mllib-...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14006 **[Test build #61994 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61994/consoleFull)** for PR 14006 at commit

[GitHub] spark issue #14075: [SPARK-16401] [SQL] Data Source API: Enable Extending Re...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14075 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14075: [SPARK-16401] [SQL] Data Source API: Enable Extending Re...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14075 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61990/ Test PASSed. ---

[GitHub] spark issue #14075: [SPARK-16401] [SQL] Data Source API: Enable Extending Re...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14075 **[Test build #61990 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61990/consoleFull)** for PR 14075 at commit

[GitHub] spark issue #14048: [SPARK-16370][SQL] Union queries should not be executed ...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14048 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14048: [SPARK-16370][SQL] Union queries should not be executed ...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14048 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61989/ Test PASSed. ---

[GitHub] spark issue #14048: [SPARK-16370][SQL] Union queries should not be executed ...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14048 **[Test build #61989 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61989/consoleFull)** for PR 14048 at commit

[GitHub] spark pull request #14082: [SPARK-16381][SQL][SparkR] Update SQL examples an...

2016-07-08 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/14082#discussion_r70122513 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -0,0 +1,175 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark pull request #14082: [SPARK-16381][SQL][SparkR] Update SQL examples an...

2016-07-08 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/14082#discussion_r70122361 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -0,0 +1,198 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark pull request #13374: [SPARK-13638][SQL] Add quoteAll option to CSV Dat...

2016-07-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13374 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14082: [SPARK-16381][SQL][SparkR] Update SQL examples an...

2016-07-08 Thread keypointt
Github user keypointt commented on a diff in the pull request: https://github.com/apache/spark/pull/14082#discussion_r70122204 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -0,0 +1,198 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark pull request #14082: [SPARK-16381][SQL][SparkR] Update SQL examples an...

2016-07-08 Thread keypointt
Github user keypointt commented on a diff in the pull request: https://github.com/apache/spark/pull/14082#discussion_r70122235 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -0,0 +1,198 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark issue #14008: [SPARK-16281][SQL] Implement parse_url SQL function

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14008 **[Test build #3173 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3173/consoleFull)** for PR 14008 at commit

[GitHub] spark pull request #14082: [SPARK-16381][SQL][SparkR] Update SQL examples an...

2016-07-08 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/14082#discussion_r70121939 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -0,0 +1,198 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark issue #13374: [SPARK-13638][SQL] Add quoteAll option to CSV DataFrameW...

2016-07-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13374 Merging in master. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14082: [SPARK-16381][SQL][SparkR] Update SQL examples an...

2016-07-08 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/14082#discussion_r70121544 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -0,0 +1,198 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark pull request #14087: [SPARK-16411][SQL][STREAMING] Add textFile to Str...

2016-07-08 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/14087#discussion_r70121449 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala --- @@ -281,6 +281,31 @@ final class DataStreamReader

[GitHub] spark pull request #14082: [SPARK-16381][SQL][SparkR] Update SQL examples an...

2016-07-08 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/14082#discussion_r70121398 --- Diff: examples/src/main/r/RSparkSQLExample.R --- @@ -0,0 +1,198 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark issue #13991: [SPARK-16318][SQL] Implement all remaining xpath functio...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13991 **[Test build #61992 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61992/consoleFull)** for PR 13991 at commit

[GitHub] spark pull request #13969: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13969#discussion_r70120022 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Reflect.scala --- @@ -0,0 +1,170 @@ +/* + * Licensed to the

[GitHub] spark issue #13374: [SPARK-13638][SQL] Add quoteAll option to CSV DataFrameW...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13374 **[Test build #3171 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3171/consoleFull)** for PR 13374 at commit

[GitHub] spark issue #13991: [SPARK-16318][SQL] Implement all remaining xpath functio...

2016-07-08 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/13991 @hvanhovell can you take a look at this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14097: [MINOR][Streaming][Docs] Minor changes on kinesis integr...

2016-07-08 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/14097 maybe I should also cc @tdas , he is on the streaming part --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #13867: [SPARK-16161][SQL] Ambiguous error message for unsupport...

2016-07-08 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13867 cc @hvanhovell @cloud-fan Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13969: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13969#discussion_r70118085 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Reflect.scala --- @@ -0,0 +1,170 @@ +/* + * Licensed to the

[GitHub] spark pull request #14034: [SPARK-16355] [SPARK-16354] [SQL] Fix Bugs When L...

2016-07-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14034#discussion_r70118783 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -46,6 +46,21 @@ trait CheckAnalysis extends

[GitHub] spark issue #13969: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-08 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/13969 I've pushed a new commit that addresses the review comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #13969: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-08 Thread petermaxlee
Github user petermaxlee commented on a diff in the pull request: https://github.com/apache/spark/pull/13969#discussion_r70117803 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Reflect.scala --- @@ -0,0 +1,170 @@ +/* + * Licensed to the

[GitHub] spark issue #14106: [SPARK-16448] RemoveAliasOnlyProject should not remove a...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14106 **[Test build #61986 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61986/consoleFull)** for PR 14106 at commit

[GitHub] spark issue #14106: [SPARK-16448] RemoveAliasOnlyProject should not remove a...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14106 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14008: [SPARK-16281][SQL] Implement parse_url SQL function

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14008 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61987/ Test FAILed. ---

[GitHub] spark issue #14106: [SPARK-16448] RemoveAliasOnlyProject should not remove a...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14106 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61986/ Test FAILed. ---

[GitHub] spark issue #14008: [SPARK-16281][SQL] Implement parse_url SQL function

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14008 **[Test build #61987 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61987/consoleFull)** for PR 14008 at commit

[GitHub] spark issue #14008: [SPARK-16281][SQL] Implement parse_url SQL function

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14008 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13969: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-08 Thread petermaxlee
Github user petermaxlee commented on a diff in the pull request: https://github.com/apache/spark/pull/13969#discussion_r70116854 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Reflect.scala --- @@ -0,0 +1,170 @@ +/* + * Licensed to the

[GitHub] spark issue #13374: [SPARK-13638][SQL] Add quoteAll option to CSV DataFrameW...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13374 **[Test build #3172 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3172/consoleFull)** for PR 13374 at commit

[GitHub] spark issue #13831: [SPARK-16119][sql] Support PURGE option to drop table / ...

2016-07-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13831 **[Test build #61991 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61991/consoleFull)** for PR 13831 at commit

[GitHub] spark issue #13831: [SPARK-16119][sql] Support PURGE option to drop table / ...

2016-07-08 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/13831 > it would be nice to test using purge actually does a purge None of the tests run on actual HDFS cluster, so I doubt that would be possible without a lot more work... --- If your project

[GitHub] spark pull request #13831: [SPARK-16119][sql] Support PURGE option to drop t...

2016-07-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/13831#discussion_r70115433 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -179,7 +179,8 @@ case class DescribeDatabaseCommand( case

[GitHub] spark pull request #14080: [SPARK-16405] Add metrics and source for external...

2016-07-08 Thread lovexi
Github user lovexi commented on a diff in the pull request: https://github.com/apache/spark/pull/14080#discussion_r70115043 --- Diff: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockHandler.java --- @@ -143,4 +179,26 @@ private void

[GitHub] spark pull request #14080: [SPARK-16405] Add metrics and source for external...

2016-07-08 Thread lovexi
Github user lovexi commented on a diff in the pull request: https://github.com/apache/spark/pull/14080#discussion_r70114491 --- Diff: core/src/main/scala/org/apache/spark/deploy/ExternalShuffleServiceSource.scala --- @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #14078: [SPARK-11857] [Mesos] Deprecate fine grained

2016-07-08 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/14078 good to go :+1: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #14080: [SPARK-16405] Add metrics and source for external...

2016-07-08 Thread lovexi
Github user lovexi commented on a diff in the pull request: https://github.com/apache/spark/pull/14080#discussion_r70112425 --- Diff: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockHandler.java --- @@ -93,18 +113,34 @@ protected void

[GitHub] spark issue #14093: SPARK-16420: Ensure compression streams are closed.

2016-07-08 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/14093 LGTM pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13867: [SPARK-16161][SQL] Ambiguous error message for unsupport...

2016-07-08 Thread ioana-delaney
Github user ioana-delaney commented on the issue: https://github.com/apache/spark/pull/13867 Can someone please review the changes? Thank you. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14012: [SPARK-16343][SQL] Improve the PushDownPredicate rule to...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14012 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14012: [SPARK-16343][SQL] Improve the PushDownPredicate rule to...

2016-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14012 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61985/ Test PASSed. ---

[GitHub] spark pull request #14080: [SPARK-16405] Add metrics and source for external...

2016-07-08 Thread lovexi
Github user lovexi commented on a diff in the pull request: https://github.com/apache/spark/pull/14080#discussion_r70111868 --- Diff: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockHandler.java --- @@ -64,6 +75,10 @@ public

<    1   2   3   4   5   >