[GitHub] spark issue #14830: [SPARK-16992][PYSPARK][DOCS] PEP8 on Pyspark documentati...

2016-09-08 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14830 Could you maybe give this a clearer PR title as well? Right now it seems to imply the current examples aren't passing the pep8 tool but they currently are. Maybe something like "import sort and auto

[GitHub] spark issue #14912: [SPARK-17357][SQL] Fix current predicate pushdown

2016-09-08 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14912 @gatorsmile I've described it in the pr description. Simply said, now a Filter will be stopped to pushdown once it encounters another Filter. `BooleanSimplification` rule will simplify the pr

[GitHub] spark pull request #14963: [SPARK-16992][PYSPARK] Virtualenv for Pylint and ...

2016-09-08 Thread Stibbons
Github user Stibbons commented on a diff in the pull request: https://github.com/apache/spark/pull/14963#discussion_r78136301 --- Diff: dev/lint-python --- @@ -26,30 +67,26 @@ PYLINT_REPORT_PATH="$SPARK_ROOT_DIR/dev/pylint-report.txt" PYLINT_INSTALL_INFO="$SPARK_ROOT_DIR/dev/p

[GitHub] spark issue #14963: [SPARK-16992][PYSPARK] Reenable Pylint

2016-09-08 Thread Stibbons
Github user Stibbons commented on the issue: https://github.com/apache/spark/pull/14963 Hum I don't see how it was reenabled... Where is it called? And I had many errors to ignore once I have reenabled it on the execution of lint-python. I'll update the title. At least, being

[GitHub] spark pull request #14963: [SPARK-16992][PYSPARK] Reenable Pylint

2016-09-08 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/14963#discussion_r78135944 --- Diff: dev/lint-python --- @@ -26,30 +67,26 @@ PYLINT_REPORT_PATH="$SPARK_ROOT_DIR/dev/pylint-report.txt" PYLINT_INSTALL_INFO="$SPARK_ROOT_DIR/dev/py

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14452 **[Test build #65143 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65143/consoleFull)** for PR 14452 at commit [`23e2dc8`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #14963: [SPARK-16992][PYSPARK] Reenable Pylint

2016-09-08 Thread Stibbons
Github user Stibbons commented on a diff in the pull request: https://github.com/apache/spark/pull/14963#discussion_r78135769 --- Diff: dev/lint-python --- @@ -17,6 +17,47 @@ # limitations under the License. # +VIRTUAL_ENV_DIR="build/venv" +if [[ ! -z $VIRTUA

[GitHub] spark issue #14963: [SPARK-16992][PYSPARK] Reenable Pylint

2016-09-08 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14963 Oh wait I've been a little confused by the PR title - pylint is already reenabled and was only temporary disabled awhile back - maybe less important but would make sense in the context of the other

[GitHub] spark pull request #14963: [SPARK-16992][PYSPARK] Reenable Pylint

2016-09-08 Thread Stibbons
Github user Stibbons commented on a diff in the pull request: https://github.com/apache/spark/pull/14963#discussion_r78135582 --- Diff: dev/requirements.txt --- @@ -1,3 +1,5 @@ jira==1.0.3 PyGithub==1.26.0 Unidecode==0.04.19 +pep8==1.7.0 --- End diff --

[GitHub] spark pull request #14963: [SPARK-16992][PYSPARK] Reenable Pylint

2016-09-08 Thread Stibbons
Github user Stibbons commented on a diff in the pull request: https://github.com/apache/spark/pull/14963#discussion_r78135524 --- Diff: dev/lint-python --- @@ -26,30 +67,26 @@ PYLINT_REPORT_PATH="$SPARK_ROOT_DIR/dev/pylint-report.txt" PYLINT_INSTALL_INFO="$SPARK_ROOT_DIR/dev/p

[GitHub] spark pull request #15004: [SPARK-17440] [SPARK-17441] Fixed Multiple Bugs i...

2016-09-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15004#discussion_r78135593 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -383,7 +385,14 @@ case class AlterTableRenamePartitionCommand(

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14426 **[Test build #65142 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65142/consoleFull)** for PR 14426 at commit [`01105f5`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #14623: [SPARK-17044][SQL] Make test files for window functions ...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14623 **[Test build #65139 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65139/consoleFull)** for PR 14623 at commit [`679efb2`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #14527: [SPARK-16938][SQL] `drop/dropDuplicate` should handle th...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14527 **[Test build #65140 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65140/consoleFull)** for PR 14527 at commit [`c18781e`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14116 **[Test build #65141 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65141/consoleFull)** for PR 14116 at commit [`a8c30c6`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14638 **[Test build #65138 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65138/consoleFull)** for PR 14638 at commit [`63bcc08`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #15015: [SPARK-16445][MLlib][SparkR] Fix @return description for...

2016-09-08 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15015 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[GitHub] spark issue #15021: [SPARK-17464][SparkR][ML] SparkR spark.als argument reg ...

2016-09-08 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15021 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[GitHub] spark issue #15014: [SPARK-17429][SQL] use ImplicitCastInputTypes with funct...

2016-09-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15014 The only one error looks just about the changed behavior in `StringFunctionsSuite`. Could you fix that? --- If your project is set up for it, you can reply to this email and have your reply a

[GitHub] spark issue #15004: [SPARK-17440] [SPARK-17441] Fixed Multiple Bugs in ALTER...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15004 **[Test build #65137 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65137/consoleFull)** for PR 15004 at commit [`5d0cffe`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #14963: [SPARK-16992][PYSPARK] Reenable Pylint

2016-09-08 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14963 Thanks for working to reenable pylint (super important IMHO). Perhaps @davies could take a look at this approach? I like the building up of venv seems to help set up for your other work improvin

[GitHub] spark pull request #14963: [SPARK-16992][PYSPARK] Reenable Pylint

2016-09-08 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/14963#discussion_r78133178 --- Diff: dev/lint-python --- @@ -17,6 +17,47 @@ # limitations under the License. # +VIRTUAL_ENV_DIR="build/venv" +if [[ ! -z $VIRTUAL

[GitHub] spark pull request #14963: [SPARK-16992][PYSPARK] Reenable Pylint

2016-09-08 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/14963#discussion_r78133102 --- Diff: dev/lint-python --- @@ -26,30 +67,26 @@ PYLINT_REPORT_PATH="$SPARK_ROOT_DIR/dev/pylint-report.txt" PYLINT_INSTALL_INFO="$SPARK_ROOT_DIR/dev/py

[GitHub] spark issue #15004: [SPARK-17440] [SPARK-17441] Fixed Multiple Bugs in ALTER...

2016-09-08 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15004 Accepted all the comments. Will address comments now. : ) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15015: [SPARK-16445][MLlib][SparkR] Fix @return description for...

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15015 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15015: [SPARK-16445][MLlib][SparkR] Fix @return description for...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15015 **[Test build #65135 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65135/consoleFull)** for PR 15015 at commit [`91ae8d6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15015: [SPARK-16445][MLlib][SparkR] Fix @return description for...

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15015 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65135/ Test PASSed. ---

[GitHub] spark issue #14912: [SPARK-17357][SQL] Fix current predicate pushdown

2016-09-08 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14912 Could you define the conditions in which the predicates are unable to be pushed down? Then, we can easily justify the significance. --- If your project is set up for it, you can reply to this e

[GitHub] spark issue #14864: [SPARK-15453] [SQL] FileSourceScanExec to extract `outpu...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14864 **[Test build #65136 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65136/consoleFull)** for PR 14864 at commit [`445549b`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #15015: [SPARK-16445][MLlib][SparkR] Fix @return description for...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15015 **[Test build #65135 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65135/consoleFull)** for PR 15015 at commit [`91ae8d6`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14980 **[Test build #65134 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65134/consoleFull)** for PR 14980 at commit [`7b55255`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14980 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14980 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65134/ Test PASSed. ---

[GitHub] spark issue #15020: Spark 2.0 error in Intellij

2016-09-08 Thread yintengfei
Github user yintengfei commented on the issue: https://github.com/apache/spark/pull/15020 You can find : File -> Project Structure -> Modules -> Dependcies , change the provided to compile. As HyukjinKwon say , you'd better ask this to user-mailing list . --- If your projec

[GitHub] spark pull request #14864: [SPARK-15453] [SQL] FileSourceScanExec to extract...

2016-09-08 Thread tejasapatil
Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/14864#discussion_r78129784 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala --- @@ -156,24 +155,57 @@ case class FileSourceScanExec(

[GitHub] spark pull request #14750: [SPARK-17183][SQL] put hive serde table schema to...

2016-09-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14750#discussion_r78129508 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala --- @@ -169,7 +169,10 @@ case class InsertIntoHiveTable(

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14452 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14452 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65131/ Test FAILed. ---

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14452 **[Test build #65131 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65131/consoleFull)** for PR 14452 at commit [`bc70354`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14980 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65133/ Test PASSed. ---

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14980 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14980 **[Test build #65133 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65133/consoleFull)** for PR 14980 at commit [`1142fac`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14834: [SPARK-17163][ML][WIP] Unified LogisticRegression...

2016-09-08 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14834#discussion_r78128581 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -460,33 +564,74 @@ class LogisticRegression @Since("1.2.0")

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14980 **[Test build #65134 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65134/consoleFull)** for PR 14980 at commit [`7b55255`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #14834: [SPARK-17163][ML][WIP] Unified LogisticRegression...

2016-09-08 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14834#discussion_r78128374 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -460,33 +564,74 @@ class LogisticRegression @Since("1.2.0")

[GitHub] spark issue #15021: [SPARK-17464][SparkR][ML] SparkR spark.als argument reg ...

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15021 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15021: [SPARK-17464][SparkR][ML] SparkR spark.als argument reg ...

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15021 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65132/ Test PASSed. ---

[GitHub] spark issue #15021: [SPARK-17464][SparkR][ML] SparkR spark.als argument reg ...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15021 **[Test build #65132 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65132/consoleFull)** for PR 15021 at commit [`275fd85`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14834: [SPARK-17163][ML][WIP] Unified LogisticRegression...

2016-09-08 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14834#discussion_r78128102 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -452,6 +555,7 @@ class LogisticRegression @Since("1.2.0") (

[GitHub] spark pull request #14834: [SPARK-17163][ML][WIP] Unified LogisticRegression...

2016-09-08 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14834#discussion_r78127943 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -370,49 +420,102 @@ class LogisticRegression @Since("1.2.0"

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14980 **[Test build #65133 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65133/consoleFull)** for PR 14980 at commit [`1142fac`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #15015: [SPARK-16445][MLlib][SparkR] Fix @return description for...

2016-09-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15015 Up to my knowledge, INFRA ticket made by @shivaram is enough for now. For Apache REEF, we filed the following INFRA issue like that. https://issues.apache.org/jira/browse/INFRA-11411

[GitHub] spark pull request #14834: [SPARK-17163][ML][WIP] Unified LogisticRegression...

2016-09-08 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14834#discussion_r78127321 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -370,49 +420,102 @@ class LogisticRegression @Since("1.2.0"

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14980 Hmm the Jenkins error was ``` find: cannot delete `pkg/vignettes': Directory not empty ``` --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request #14834: [SPARK-17163][ML][WIP] Unified LogisticRegression...

2016-09-08 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14834#discussion_r78126776 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -370,49 +420,102 @@ class LogisticRegression @Since("1.2.0"

[GitHub] spark pull request #14719: [SPARK-17154][SQL] Wrong result can be returned o...

2016-09-08 Thread sarutak
Github user sarutak commented on a diff in the pull request: https://github.com/apache/spark/pull/14719#discussion_r78126865 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -683,8 +710,14 @@ class Analyzer( try {

[GitHub] spark issue #15020: Spark 2.0 error in Intellij

2016-09-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15020 Maybe you'd better close this PR and ask this to user-mailing list. I think we can have a better answer. Please refer http://spark.apache.org/community.html to subscribe. --- If your project i

[GitHub] spark issue #15021: [SPARK-17464][SparkR][ML] SparkR spark.als argument reg ...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15021 **[Test build #65132 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65132/consoleFull)** for PR 15021 at commit [`275fd85`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #15021: [SPARK-17464][SparkR][ML] SparkR spark.als argume...

2016-09-08 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/15021 [SPARK-17464][SparkR][ML] SparkR spark.als arguments reg should be 0.1 by default. ## What changes were proposed in this pull request? SparkR ```spark.als``` arguments ```reg``` should be 0.

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14980 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14980 **[Test build #65130 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65130/consoleFull)** for PR 14980 at commit [`adabb2d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14980 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65130/ Test FAILed. ---

[GitHub] spark issue #15015: [SPARK-16445][MLlib][SparkR] Fix @return description for...

2016-09-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15015 @dongjoon-hyun Meanwhile, do you mind if I ask whether you have any idea on this maybe? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #15015: [SPARK-16445][MLlib][SparkR] Fix @return description for...

2016-09-08 Thread spark-test-client
Github user spark-test-client commented on the issue: https://github.com/apache/spark/pull/15015 @dongjoon-hyun Meanwhile, do you mind if I ask whether you have any idea on this maybe? --- If your project is set up for it, you can reply to this email and have your reply appear on Git

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-08 Thread cenyuhai
Github user cenyuhai commented on the issue: https://github.com/apache/spark/pull/14737 @srowen If it is ok,can you merge this pr to master?thank you. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark issue #14912: [SPARK-17357][SQL] Fix current predicate pushdown

2016-09-08 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14912 @srinathshankar @gatorsmile I think CNF is another issue other then the issue this PR was proposed to solve at the first. I would like to solve the original adjoining Filter pushdown problem here. An

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread junyangq
Github user junyangq commented on the issue: https://github.com/apache/spark/pull/14980 @felixcheung we still need to deal with the leftover files in that case? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14452 **[Test build #65131 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65131/consoleFull)** for PR 14452 at commit [`bc70354`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #15015: [SPARK-16445][MLlib][SparkR] Fix @return description for...

2016-09-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15015 I will check this out as far as I can and be back. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14980 **[Test build #65130 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65130/consoleFull)** for PR 14980 at commit [`adabb2d`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #15015: [SPARK-16445][MLlib][SparkR] Fix @return description for...

2016-09-08 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/15015 Created https://issues.apache.org/jira/browse/INFRA-12590 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request #14750: [SPARK-17183][SQL] put hive serde table schema to...

2016-09-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14750#discussion_r78124662 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala --- @@ -169,7 +169,10 @@ case class InsertIntoHiveTable(

[GitHub] spark issue #15015: [SPARK-16445][MLlib][SparkR] Fix @return description for...

2016-09-08 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/15015 I think we need to file an INFRA ticket like https://issues.apache.org/jira/browse/INFRA-11294 -- I'll file one now --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #15015: [SPARK-16445][MLlib][SparkR] Fix @return description for...

2016-09-08 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/15015 @HyukjinKwon I thought it should have run the tests ? Any ideas why its not getting picked up ? Is there some other set of steps that we need to do ? (I'm now investigating how it works for Apache

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65129/ Test PASSed. ---

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13571 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #65129 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65129/consoleFull)** for PR 11105 at commit [`2a8d2b2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13571 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65128/ Test PASSed. ---

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13571 **[Test build #65128 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65128/consoleFull)** for PR 13571 at commit [`fbe4549`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15015: [SPARK-16445][MLlib][SparkR] Fix @return description for...

2016-09-08 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15015 @keypointt let's have a check for the first few values perhaps? @HyukjinKwon It seems it would be good to start running R tests though I'm not sure actually - I'd defer to @shivaram --- If

[GitHub] spark issue #14995: [Test Only][SPARK-6235][CORE]Address various 2G limits

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14995 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65126/ Test PASSed. ---

[GitHub] spark issue #14995: [Test Only][SPARK-6235][CORE]Address various 2G limits

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14995 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14995: [Test Only][SPARK-6235][CORE]Address various 2G limits

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14995 **[Test build #65126 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65126/consoleFull)** for PR 14995 at commit [`a8f89d4`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15020: Spark 2.0 error in Intellij

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15020 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #15020: Spark 2.0 error in Intellij

2016-09-08 Thread bigdatatraining
GitHub user bigdatatraining opened a pull request: https://github.com/apache/spark/pull/15020 Spark 2.0 error in Intellij If i run twitter code in Console it's working fine, but if i run same command in Spark 2.0 in Intellij I got this error Exception in thread "main"

[GitHub] spark issue #14702: [SPARK-15694] Implement ScriptTransformation in sql/core...

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14702 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65127/ Test PASSed. ---

[GitHub] spark issue #14702: [SPARK-15694] Implement ScriptTransformation in sql/core...

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14702 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14702: [SPARK-15694] Implement ScriptTransformation in sql/core...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14702 **[Test build #65127 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65127/consoleFull)** for PR 14702 at commit [`f5256dd`](https://github.com/apache/spark/commit/

[GitHub] spark issue #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work for jdb...

2016-09-08 Thread JustinPihony
Github user JustinPihony commented on the issue: https://github.com/apache/spark/pull/12601 Can this be merged now? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #14969: [SPARK-17406][WEB UI] limit timeline executor events

2016-09-08 Thread cenyuhai
Github user cenyuhai commented on the issue: https://github.com/apache/spark/pull/14969 @srowen I remove parallel maps, please review the latest codes.Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark issue #15013: [SPARK-17451] [CORE] CoarseGrainedExecutorBackend should...

2016-09-08 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/15013 Done with all change. Ready for review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15013: [SPARK-17451] [CORE] CoarseGrainedExecutorBackend should...

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15013 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15013: [SPARK-17451] [CORE] CoarseGrainedExecutorBackend should...

2016-09-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15013 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65124/ Test PASSed. ---

[GitHub] spark issue #15013: [SPARK-17451] [CORE] CoarseGrainedExecutorBackend should...

2016-09-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15013 **[Test build #65124 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65124/consoleFull)** for PR 15013 at commit [`71fa2e3`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14750: [SPARK-17183][SQL] put hive serde table schema to...

2016-09-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14750#discussion_r78120149 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala --- @@ -169,7 +169,10 @@ case class InsertIntoHiveTable(

[GitHub] spark issue #14678: [MINOR][SQL] Add missing functions for some options in S...

2016-09-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14678 @cloud-fan Do you mind if I ask to take a look please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark issue #14660: [SPARK-17071][SQL] Add an option to support for reading ...

2016-09-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14660 Gentle ping @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark issue #14399: [SPARK-16777][SQL] Do not use deprecated listType API in...

2016-09-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14399 Gentle ping @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] spark issue #14172: [SPARK-16516][SQL] Support for pushing down filters for ...

2016-09-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14172 Could you take a look please @yhuai and @liancheng ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

  1   2   3   4   5   >