[GitHub] spark pull request #18114: [SPARK-20889][SparkR] Grouped documentation for D...

2017-06-21 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18114#discussion_r123312656 --- Diff: R/pkg/R/functions.R --- @@ -34,6 +34,58 @@ NULL #' df <- createDataFrame(cbind(model = rownames(mtcars), mtcars))} NULL

[GitHub] spark pull request #18114: [SPARK-20889][SparkR] Grouped documentation for D...

2017-06-21 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18114#discussion_r123310929 --- Diff: R/pkg/R/functions.R --- @@ -2458,111 +2441,78 @@ setMethod("instr", signature(y = "Column", x = "character"), column(jc)

[GitHub] spark issue #18378: [SPARK-21163][SQL] DataFrame.toPandas should respect the...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18378 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78395/ Test FAILed. ---

[GitHub] spark issue #18378: [SPARK-21163][SQL] DataFrame.toPandas should respect the...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18378 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18378: [SPARK-21163][SQL] DataFrame.toPandas should respect the...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18378 **[Test build #78395 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78395/testReport)** for PR 18378 at commit

[GitHub] spark issue #18367: [SQL][Doc] Fix documentation of lpad

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18367 **[Test build #78396 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78396/testReport)** for PR 18367 at commit

[GitHub] spark issue #18269: [SPARK-21056][SQL] Use at most one spark job to list fil...

2017-06-21 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/18269 Hi @bbossy > Does it match your scenario? It does not match my scenario. I'm reading files from HDFS. In your test, you're reading files from the local filesystem. Can you try a

[GitHub] spark issue #18378: [SPARK-21163][SQL] DataFrame.toPandas should respect the...

2017-06-21 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/18378 LGTM, pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18367: [SQL][Doc] Fix documentation of lpad

2017-06-21 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/18367 OK. Updated the doc as suggested. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18378: [SPARK-21163][SQL] DataFrame.toPandas should respect the...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18378 **[Test build #78395 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78395/testReport)** for PR 18378 at commit

[GitHub] spark pull request #18327: [SPARK-21047] Add test suites for complicated cas...

2017-06-21 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18327#discussion_r123303980 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/vectorized/ColumnarBatchSuite.scala --- @@ -739,6 +739,123 @@ class ColumnarBatchSuite

[GitHub] spark pull request #15417: [SPARK-17851][SQL][TESTS] Make sure all test sqls...

2017-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15417 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15417: [SPARK-17851][SQL][TESTS] Make sure all test sqls in cat...

2017-06-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15417 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18375: [SPARK-21144][SQL] Check if the data schema and partitio...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18375 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18375: [SPARK-21144][SQL] Check if the data schema and partitio...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18375 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78391/ Test FAILed. ---

[GitHub] spark issue #15417: [SPARK-17851][SQL][TESTS] Make sure all test sqls in cat...

2017-06-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15417 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #18375: [SPARK-21144][SQL] Check if the data schema and partitio...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18375 **[Test build #78391 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78391/testReport)** for PR 18375 at commit

[GitHub] spark issue #18375: [SPARK-21144][SQL] Check if the data schema and partitio...

2017-06-21 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/18375 @gatorsmile I remembered @liancheng said `we want to allow users to create partitioned tables that allow data schema to contain (part of) the partition columns, and there are test cases for this use

[GitHub] spark issue #18334: [SPARK-21127] [SQL] Update statistics after data changin...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18334 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18334: [SPARK-21127] [SQL] Update statistics after data changin...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18334 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78389/ Test PASSed. ---

[GitHub] spark issue #18334: [SPARK-21127] [SQL] Update statistics after data changin...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18334 **[Test build #78389 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78389/testReport)** for PR 18334 at commit

[GitHub] spark issue #18377: [SPARK-18016][SQL][CATALYST][BRANCH-2.2] Code Generation...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18377 **[Test build #78393 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78393/testReport)** for PR 18377 at commit

[GitHub] spark issue #18354: [SPARK-18016][SQL][CATALYST][BRANCH-2.1] Code Generation...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18354 **[Test build #78394 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78394/testReport)** for PR 18354 at commit

[GitHub] spark issue #18376: [SPARK-21161][CORE] Make the parseHostPort method tolera...

2017-06-21 Thread janplus
Github user janplus commented on the issue: https://github.com/apache/spark/pull/18376 Hi @srowen, @jiangxb1987. Thanks for quick response. After further debug and consideration, this fix should be done in the `spark-solr` project. Since this is a Solr specific issue. I'll

[GitHub] spark pull request #18376: [SPARK-21161][CORE] Make the parseHostPort method...

2017-06-21 Thread janplus
Github user janplus closed the pull request at: https://github.com/apache/spark/pull/18376 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18377: [SPARK-18016][SQL][CATALYST][BRANCH-2.2] Code Generation...

2017-06-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18377 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18354: [SPARK-18016][SQL][CATALYST][BRANCH-2.1] Code Generation...

2017-06-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18354 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18378: [SPARK-21163][SQL] DataFrame.toPandas should respect the...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18378 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78392/ Test FAILed. ---

[GitHub] spark issue #18378: [SPARK-21163][SQL] DataFrame.toPandas should respect the...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18378 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18378: [SPARK-21163][SQL] DataFrame.toPandas should respect the...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18378 **[Test build #78392 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78392/testReport)** for PR 18378 at commit

[GitHub] spark issue #18378: [SPARK-21163][SQL] DataFrame.toPandas should respect the...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18378 **[Test build #78392 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78392/testReport)** for PR 18378 at commit

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

2017-06-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15821 we can update the test after merging https://github.com/apache/spark/pull/18378 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #18378: [SPARK-21163][SQL] DataFrame.toPandas should respect the...

2017-06-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18378 cc @ueshin @BryanCutler --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #18378: [SPARK-21163][SQL] DataFrame.toPandas should resp...

2017-06-21 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/18378 [SPARK-21163][SQL] DataFrame.toPandas should respect the data type ## What changes were proposed in this pull request? Currently we convert a spark DataFrame to Pandas Dataframe by

[GitHub] spark issue #18309: [SPARK-21079] [SQL] Calculate total size of a partition ...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18309 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18309: [SPARK-21079] [SQL] Calculate total size of a partition ...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18309 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78387/ Test PASSed. ---

[GitHub] spark issue #18309: [SPARK-21079] [SQL] Calculate total size of a partition ...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18309 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18309: [SPARK-21079] [SQL] Calculate total size of a partition ...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18309 **[Test build #78387 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78387/testReport)** for PR 18309 at commit

[GitHub] spark issue #18309: [SPARK-21079] [SQL] Calculate total size of a partition ...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18309 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78386/ Test PASSed. ---

[GitHub] spark issue #18309: [SPARK-21079] [SQL] Calculate total size of a partition ...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18309 **[Test build #78386 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78386/testReport)** for PR 18309 at commit

[GitHub] spark issue #18375: [SPARK-21144][SQL] Check if the data schema and partitio...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18375 **[Test build #78391 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78391/testReport)** for PR 18375 at commit

[GitHub] spark issue #18375: [SPARK-21144][SQL] Check if the data schema and partitio...

2017-06-21 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/18375 [This fix](https://github.com/apache/spark/pull/18375/files#diff-7a6cb188d2ae31eb3347b5629a679cecR196) breaks the existing test suites, so I'm looking for other approaches to fix this issue only...

[GitHub] spark issue #16677: [SPARK-19355][SQL] Use map output statistices to improve...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16677 **[Test build #78390 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78390/testReport)** for PR 16677 at commit

[GitHub] spark issue #18300: [SPARK-21043][SQL] Add unionByName in Dataset

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18300 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78385/ Test PASSed. ---

[GitHub] spark issue #18300: [SPARK-21043][SQL] Add unionByName in Dataset

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18300 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18300: [SPARK-21043][SQL] Add unionByName in Dataset

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18300 **[Test build #78385 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78385/testReport)** for PR 18300 at commit

[GitHub] spark issue #18377: [SPARK-18016][SQL][CATALYST][BRANCH-2.2] Code Generation...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18377 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18354: [SPARK-18016][SQL][CATALYST][BRANCH-2.1] Code Generation...

2017-06-21 Thread bdrillard
Github user bdrillard commented on the issue: https://github.com/apache/spark/pull/18354 @dongjoon-hyun I've prepared the PR for the branch-2.2 backport, #18377. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #18377: [SPARK-18016][SQL][CATALYST][BRANCH-2.2] Code Gen...

2017-06-21 Thread bdrillard
GitHub user bdrillard opened a pull request: https://github.com/apache/spark/pull/18377 [SPARK-18016][SQL][CATALYST][BRANCH-2.2] Code Generation: Constant Pool Limit - Class Splitting ## What changes were proposed in this pull request? This is a backport patch for Spark

[GitHub] spark pull request #18162: [SPARK-20923] turn tracking of TaskMetrics._updat...

2017-06-21 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18162#discussion_r123273222 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala --- @@ -528,7 +528,13 @@ class JobProgressListener(conf: SparkConf)

[GitHub] spark issue #18375: [SPARK-21144][SQL] Check if the data schema and partitio...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18375 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78388/ Test FAILed. ---

[GitHub] spark issue #18375: [SPARK-21144][SQL] Check if the data schema and partitio...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18375 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18375: [SPARK-21144][SQL] Check if the data schema and partitio...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18375 **[Test build #78388 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78388/testReport)** for PR 18375 at commit

[GitHub] spark issue #18118: [SPARK-20199][ML] : Provided featureSubsetStrategy to GB...

2017-06-21 Thread pralabhkumar
Github user pralabhkumar commented on the issue: https://github.com/apache/spark/pull/18118 @MLnick Thanks for reviewing . I have added comment . Please review them --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #18118: [SPARK-20199][ML] : Provided featureSubsetStrateg...

2017-06-21 Thread pralabhkumar
Github user pralabhkumar commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r123269246 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -359,38 +365,6 @@ private[ml] trait TreeEnsembleParams extends

[GitHub] spark issue #17139: [SPARK-19486][CORE](try 3) Investigate using multiple th...

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/17139 @witgo Are you still working on this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18374: [MINOR][DOC] modified issue link and updated stat...

2017-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18374 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18118: [SPARK-20199][ML] : Provided featureSubsetStrategy to GB...

2017-06-21 Thread pralabhkumar
Github user pralabhkumar commented on the issue: https://github.com/apache/spark/pull/18118 @sethah Thanks for reviewing the pull request . - Change the title to obey the proper format [SPARK-20199][ML] ... - Response : Done - Change title to

[GitHub] spark pull request #18372: [MINOR][DOCS] Add lost tag for configuration...

2017-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18372 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18374: [MINOR][DOC] modified issue link and updated status

2017-06-21 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18374 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #14601: [SPARK-13979][Core] Killed executor is re spawned withou...

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/14601 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14601: [SPARK-13979][Core] Killed executor is re spawned withou...

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/14601 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #18367: [SQL][Doc] Fix documentation of lpad

2017-06-21 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/18367#discussion_r123265927 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -2350,7 +2350,7 @@ object functions { def unbase64(e: Column): Column =

[GitHub] spark issue #14601: [SPARK-13979][Core] Killed executor is re spawned withou...

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/14601 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14601: [SPARK-13979][Core] Killed executor is re spawned withou...

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/14601 @agsachin Are you still working on this? And if it is so, would you please update the description and provide some snapshot to demo the behaviors before & after the changes? It would also be

[GitHub] spark pull request #18118: [SPARK-20199][ML] : Provided featureSubsetStrateg...

2017-06-21 Thread pralabhkumar
Github user pralabhkumar commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r123265283 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/GBTClassifier.scala --- @@ -192,6 +196,9 @@ object GBTClassifier extends

[GitHub] spark issue #18372: [MINOR][DOCS] Add lost tag for configuration.md

2017-06-21 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18372 Merged to master/2.2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #18118: [SPARK-20199][ML] : Provided featureSubsetStrateg...

2017-06-21 Thread pralabhkumar
Github user pralabhkumar commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r123264432 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/GBTClassifier.scala --- @@ -136,6 +136,10 @@ class GBTClassifier @Since("1.4.0") (

[GitHub] spark pull request #18118: [SPARK-20199][ML] : Provided featureSubsetStrateg...

2017-06-21 Thread pralabhkumar
Github user pralabhkumar commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r123264336 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/GradientBoostedTrees.scala --- @@ -319,8 +327,10 @@ private[spark] object

[GitHub] spark pull request #18118: [SPARK-20199][ML] : Provided featureSubsetStrateg...

2017-06-21 Thread pralabhkumar
Github user pralabhkumar commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r123264390 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/tree/GradientBoostedTrees.scala --- @@ -49,14 +49,16 @@ import org.apache.spark.rdd.RDD

[GitHub] spark pull request #18118: [SPARK-20199][ML] : Provided featureSubsetStrateg...

2017-06-21 Thread pralabhkumar
Github user pralabhkumar commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r123264302 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/GradientBoostedTrees.scala --- @@ -284,11 +290,13 @@ private[spark] object

[GitHub] spark pull request #18118: [SPARK-20199][ML] : Provided featureSubsetStrateg...

2017-06-21 Thread pralabhkumar
Github user pralabhkumar commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r123264215 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/GradientBoostedTrees.scala --- @@ -73,19 +75,21 @@ private[spark] object

[GitHub] spark pull request #18118: [SPARK-20199][ML] : Provided featureSubsetStrateg...

2017-06-21 Thread pralabhkumar
Github user pralabhkumar commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r123264263 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/GradientBoostedTrees.scala --- @@ -284,11 +290,13 @@ private[spark] object

[GitHub] spark issue #17113: [SPARK-13669][SPARK-20898][Core] Improve the blacklist m...

2017-06-21 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/17113 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17113: [SPARK-13669][SPARK-20898][Core] Improve the blacklist m...

2017-06-21 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/17113 these failures definitely look unrelated. I'll kick once more to try to get clean run. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #16456: [SPARK-18994] clean up the local directories for applica...

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/16456 Should we close this? @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18162: [SPARK-20923] turn tracking of TaskMetrics._updatedBlock...

2017-06-21 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/18162 sorry missed that you had commented, yes we can change that --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #18162: [SPARK-20923] turn tracking of TaskMetrics._updat...

2017-06-21 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18162#discussion_r123262316 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala --- @@ -528,7 +528,13 @@ class JobProgressListener(conf: SparkConf)

[GitHub] spark issue #18118: [SPARK-20199][ML] : Provided featureSubsetStrategy to GB...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18118 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18118: [SPARK-20199][ML] : Provided featureSubsetStrategy to GB...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18118 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78384/ Test PASSed. ---

[GitHub] spark issue #18118: [SPARK-20199][ML] : Provided featureSubsetStrategy to GB...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18118 **[Test build #78384 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78384/testReport)** for PR 18118 at commit

[GitHub] spark issue #16677: [SPARK-19355][SQL] Use map output statistices to improve...

2017-06-21 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16677 @jiangxb1987 Sure. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16677: [SPARK-19355][SQL] Use map output statistices to improve...

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/16677 @viirya Could you please bring this up to date? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15821 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78383/ Test PASSed. ---

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15821 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18327: [SPARK-21047] Add test suites for complicated cas...

2017-06-21 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/18327#discussion_r123258919 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/vectorized/ColumnarBatchSuite.scala --- @@ -739,6 +739,123 @@ class ColumnarBatchSuite

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15821 **[Test build #78383 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78383/testReport)** for PR 15821 at commit

[GitHub] spark issue #18376: [SPARK-21161][CORE] Make the parseHostPort method tolera...

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18376 IMO a port should always be a number, we should not accept the invalid port format. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request #18118: [SPARK-20199][ML] : Provided featureSubsetStrateg...

2017-06-21 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r123257746 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -359,38 +365,6 @@ private[ml] trait TreeEnsembleParams extends

[GitHub] spark pull request #18118: [SPARK-20199][ML] : Provided featureSubsetStrateg...

2017-06-21 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r123257669 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -359,38 +365,6 @@ private[ml] trait TreeEnsembleParams extends

[GitHub] spark issue #18376: [SPARK-21161][CORE] Make the parseHostPort method tolera...

2017-06-21 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18376 This isn't a valid fix IMHO and I would close this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15417: [SPARK-17851][SQL][TESTS] Make sure all test sqls in cat...

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/15417 This is ready for review. @gatorsmile @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #17074: [SPARK-18646][REPL] Set parent classloader as nul...

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/17074#discussion_r123254715 --- Diff: repl/src/main/scala/org/apache/spark/repl/ExecutorClassLoader.scala --- @@ -38,13 +38,15 @@ import org.apache.spark.util.{ParentClassLoader,

[GitHub] spark pull request #18092: [SPARK-20640][CORE]Make rpc timeout and retry for...

2017-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18092 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17074: [SPARK-18646][REPL] Set parent classloader as nul...

2017-06-21 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/17074#discussion_r123255131 --- Diff: repl/src/main/scala/org/apache/spark/repl/ExecutorClassLoader.scala --- @@ -38,13 +38,15 @@ import org.apache.spark.util.{ParentClassLoader,

[GitHub] spark issue #18092: [SPARK-20640][CORE]Make rpc timeout and retry for shuffl...

2017-06-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18092 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18334: [SPARK-21127] [SQL] Update statistics after data changin...

2017-06-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18334 **[Test build #78389 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78389/testReport)** for PR 18334 at commit

[GitHub] spark issue #18334: [SPARK-21127] [SQL] Update statistics after data changin...

2017-06-21 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/18334 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18376: [SPARK-21161][CORE] Make the parseHostPort method tolera...

2017-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18376 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #18376: [SPARK-21161][CORE] Make the parseHostPort method...

2017-06-21 Thread janplus
GitHub user janplus opened a pull request: https://github.com/apache/spark/pull/18376 [SPARK-21161][CORE] Make the parseHostPort method tolerate non digital charactors ## What changes were proposed in this pull request? Fix the following port parse bug when querying Solr

<    1   2   3   4   5   6   >