[jira] [Updated] (SPARK-16163) Statistics of logical plan is super slow on large query

[ https://issues.apache.org/jira/browse/SPARK-16163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-16163: --- Affects Version/s: 2.0.0 > Statistics of logical plan is super slow on large query >

[jira] [Created] (SPARK-16163) Statistics of logical plan is super slow on large query

Davies Liu created SPARK-16163: -- Summary: Statistics of logical plan is super slow on large query Key: SPARK-16163 URL: https://issues.apache.org/jira/browse/SPARK-16163 Project: Spark Issue

[jira] [Commented] (SPARK-16065) Throw a exception "java.lang.ClassNotFoundException" when run the spark-submit

[ https://issues.apache.org/jira/browse/SPARK-16065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345797#comment-15345797 ] Donghai Yu commented on SPARK-16065: Below is the codes of test.scala, and the line 22 is

[jira] [Resolved] (SPARK-16162) Remove dead code: class OrcTableScan

[ https://issues.apache.org/jira/browse/SPARK-16162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16162. - Resolution: Fixed Assignee: Brian Cho Fix Version/s: 2.0.0 > Remove dead code:

[jira] [Commented] (SPARK-16149) API consistency discussion: CountVectorizer.{minDF -> minDocFreq, minTF -> minTermFreq}

[ https://issues.apache.org/jira/browse/SPARK-16149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345736#comment-15345736 ] yuhao yang commented on SPARK-16149: For the general guideline, I would vote for consistency with

[jira] [Assigned] (SPARK-16162) Remove dead code: class OrcTableScan

[ https://issues.apache.org/jira/browse/SPARK-16162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16162: Assignee: (was: Apache Spark) > Remove dead code: class OrcTableScan >

[jira] [Assigned] (SPARK-16162) Remove dead code: class OrcTableScan

[ https://issues.apache.org/jira/browse/SPARK-16162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16162: Assignee: Apache Spark > Remove dead code: class OrcTableScan >

[jira] [Commented] (SPARK-16162) Remove dead code: class OrcTableScan

[ https://issues.apache.org/jira/browse/SPARK-16162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345689#comment-15345689 ] Apache Spark commented on SPARK-16162: -- User 'dafrista' has created a pull request for this issue:

[jira] [Created] (SPARK-16162) Remove dead code: class OrcTableScan

Brian Cho created SPARK-16162: - Summary: Remove dead code: class OrcTableScan Key: SPARK-16162 URL: https://issues.apache.org/jira/browse/SPARK-16162 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345655#comment-15345655 ] Wenchen Fan commented on SPARK-15345: - cc [~rxin] should we resolve this ticket? > SparkSession's

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345652#comment-15345652 ] Jeff Zhang commented on SPARK-15345: It has been resolved in

[jira] [Closed] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang closed SPARK-15345. -- Resolution: Fixed > SparkSession's conf doesn't take effect when there's already an existing >

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345639#comment-15345639 ] Wenchen Fan commented on SPARK-15345: - is this still a problem? > SparkSession's conf doesn't take

[jira] [Assigned] (SPARK-15899) file scheme should be used correctly

[ https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15899: Assignee: Apache Spark > file scheme should be used correctly >

[jira] [Assigned] (SPARK-15899) file scheme should be used correctly

[ https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15899: Assignee: (was: Apache Spark) > file scheme should be used correctly >

[jira] [Commented] (SPARK-15899) file scheme should be used correctly

[ https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345630#comment-15345630 ] Apache Spark commented on SPARK-15899: -- User 'avulanov' has created a pull request for this issue:

[jira] [Updated] (SPARK-15230) Back quoted column with dot in it fails when running distinct on dataframe

[ https://issues.apache.org/jira/browse/SPARK-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15230: Assignee: Bo Meng > Back quoted column with dot in it fails when running distinct on dataframe >

[jira] [Resolved] (SPARK-15230) Back quoted column with dot in it fails when running distinct on dataframe

[ https://issues.apache.org/jira/browse/SPARK-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15230. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13140

[jira] [Commented] (SPARK-15899) file scheme should be used correctly

[ https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345620#comment-15345620 ] Kazuaki Ishizaki commented on SPARK-15899: -- I think so. As [~sowen] proposed, we may need a

[jira] [Commented] (SPARK-15899) file scheme should be used correctly

[ https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345611#comment-15345611 ] Alexander Ulanov commented on SPARK-15899: -- `user.dir` on Windows starts with a letter: scala>

[jira] [Issue Comment Deleted] (SPARK-15705) Spark won't read ORC schema from metastore for partitioned tables

[ https://issues.apache.org/jira/browse/SPARK-15705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-15705: --- Comment: was deleted (was: I will take a look at it. ) > Spark won't read ORC schema from metastore

[jira] [Assigned] (SPARK-16161) Ambiguous error message for unsupported correlated predicate subqueries

[ https://issues.apache.org/jira/browse/SPARK-16161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16161: Assignee: Apache Spark > Ambiguous error message for unsupported correlated predicate

[jira] [Commented] (SPARK-16161) Ambiguous error message for unsupported correlated predicate subqueries

[ https://issues.apache.org/jira/browse/SPARK-16161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345558#comment-15345558 ] Apache Spark commented on SPARK-16161: -- User 'ioana-delaney' has created a pull request for this

[jira] [Assigned] (SPARK-16161) Ambiguous error message for unsupported correlated predicate subqueries

[ https://issues.apache.org/jira/browse/SPARK-16161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16161: Assignee: (was: Apache Spark) > Ambiguous error message for unsupported correlated

[jira] [Issue Comment Deleted] (SPARK-14351) Optimize ImpurityAggregator for decision trees

[ https://issues.apache.org/jira/browse/SPARK-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-14351: Comment: was deleted (was: Here are my thoughts: Also ccing [~sethah] since he has seen this part

[jira] [Resolved] (SPARK-16159) Move RDD creation logic from FileSourceStrategy.apply

[ https://issues.apache.org/jira/browse/SPARK-16159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16159. - Resolution: Fixed Fix Version/s: 2.0.0 > Move RDD creation logic from

[jira] [Created] (SPARK-16161) Ambiguous error message for unsupported correlated predicate subqueries

Ioana Delaney created SPARK-16161: - Summary: Ambiguous error message for unsupported correlated predicate subqueries Key: SPARK-16161 URL: https://issues.apache.org/jira/browse/SPARK-16161 Project:

[jira] [Commented] (SPARK-15705) Spark won't read ORC schema from metastore for partitioned tables

[ https://issues.apache.org/jira/browse/SPARK-15705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345533#comment-15345533 ] Jeff Zhang commented on SPARK-15705: I will take a look at it. > Spark won't read ORC schema from

[jira] [Updated] (SPARK-16024) add tests for table creation with column comment

[ https://issues.apache.org/jira/browse/SPARK-16024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16024: Assignee: Xiao Li > add tests for table creation with column comment >

[jira] [Resolved] (SPARK-16024) add tests for table creation with column comment

[ https://issues.apache.org/jira/browse/SPARK-16024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16024. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13764

[jira] [Commented] (SPARK-16160) Last remembered metadata window per dstream is not cleared upon context graceful stop

[ https://issues.apache.org/jira/browse/SPARK-16160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345460#comment-15345460 ] Apache Spark commented on SPARK-16160: -- User 'ahmed-mahran' has created a pull request for this

[jira] [Assigned] (SPARK-16160) Last remembered metadata window per dstream is not cleared upon context graceful stop

[ https://issues.apache.org/jira/browse/SPARK-16160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16160: Assignee: (was: Apache Spark) > Last remembered metadata window per dstream is not

[jira] [Assigned] (SPARK-16160) Last remembered metadata window per dstream is not cleared upon context graceful stop

[ https://issues.apache.org/jira/browse/SPARK-16160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16160: Assignee: Apache Spark > Last remembered metadata window per dstream is not cleared upon

[jira] [Created] (SPARK-16160) Last remembered metadata window per dstream is not cleared upon context graceful stop

Ahmed Mahran created SPARK-16160: Summary: Last remembered metadata window per dstream is not cleared upon context graceful stop Key: SPARK-16160 URL: https://issues.apache.org/jira/browse/SPARK-16160

[jira] [Commented] (SPARK-16085) Spark stand-alone ui redirects to RM application master UI for yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345445#comment-15345445 ] Saisai Shao commented on SPARK-16085: - [~yeshavora], it is the expected behavior, the spark UI will

[jira] [Commented] (SPARK-9478) Add class weights to Random Forest

[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345447#comment-15345447 ] Yuewei Na commented on SPARK-9478: -- Hi [~sethah]. Actually, the code I PR has been used in our company

[jira] [Commented] (SPARK-16032) Audit semantics of various insertion operations related to partitioned tables

[ https://issues.apache.org/jira/browse/SPARK-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345443#comment-15345443 ] Yin Huai commented on SPARK-16032: -- Let's look at two examples (tests were done using the 2.0 branch

[jira] [Assigned] (SPARK-13709) Spark unable to decode Avro when partitioned

[ https://issues.apache.org/jira/browse/SPARK-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13709: Assignee: Apache Spark > Spark unable to decode Avro when partitioned >

[jira] [Assigned] (SPARK-13709) Spark unable to decode Avro when partitioned

[ https://issues.apache.org/jira/browse/SPARK-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13709: Assignee: (was: Apache Spark) > Spark unable to decode Avro when partitioned >

[jira] [Commented] (SPARK-13709) Spark unable to decode Avro when partitioned

[ https://issues.apache.org/jira/browse/SPARK-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345442#comment-15345442 ] Apache Spark commented on SPARK-13709: -- User 'liancheng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16125) YarnClusterSuite test cluster mode incorrectly

[ https://issues.apache.org/jira/browse/SPARK-16125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16125: Assignee: (was: Apache Spark) > YarnClusterSuite test cluster mode incorrectly >

[jira] [Assigned] (SPARK-16125) YarnClusterSuite test cluster mode incorrectly

[ https://issues.apache.org/jira/browse/SPARK-16125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16125: Assignee: Apache Spark > YarnClusterSuite test cluster mode incorrectly >

[jira] [Commented] (SPARK-16125) YarnClusterSuite test cluster mode incorrectly

[ https://issues.apache.org/jira/browse/SPARK-16125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345438#comment-15345438 ] Apache Spark commented on SPARK-16125: -- User 'renozhang' has created a pull request for this issue:

[jira] [Commented] (SPARK-16152) `In` predicate does not work with null values

[ https://issues.apache.org/jira/browse/SPARK-16152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345424#comment-15345424 ] kevin yu commented on SPARK-16152: -- Hello Ashar: I think it is working as design, it is added by this

[jira] [Updated] (SPARK-16131) initialize internal logger lazily instead of manual null check

[ https://issues.apache.org/jira/browse/SPARK-16131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-16131: - Assignee: Prajwal Tuladhar > initialize internal logger lazily instead of manual null check >

[jira] [Resolved] (SPARK-16131) initialize internal logger lazily instead of manual null check

[ https://issues.apache.org/jira/browse/SPARK-16131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-16131. -- Resolution: Fixed Fix Version/s: 2.0.0 > initialize internal logger lazily instead of

[jira] [Commented] (SPARK-11744) bin/pyspark --version doesn't return version and exit

[ https://issues.apache.org/jira/browse/SPARK-11744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345354#comment-15345354 ] Yasir Arfat commented on SPARK-11744: - I have Problem with running the Python code using the pyspark

[jira] [Commented] (SPARK-15899) file scheme should be used correctly

[ https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345355#comment-15345355 ] Reynold Xin commented on SPARK-15899: - Does this work if we just always do file:///? > file scheme

[jira] [Resolved] (SPARK-16155) Remove package grouping in genjavadoc

[ https://issues.apache.org/jira/browse/SPARK-16155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16155. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Updated] (SPARK-16153) A single-line ScalaDoc and @deprecate annotation would break genjavadoc

[ https://issues.apache.org/jira/browse/SPARK-16153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16153: -- Fix Version/s: (was: 2.0.0) 2.0.1 2.1.0 > A

[jira] [Resolved] (SPARK-16153) A single-line ScalaDoc and @deprecate annotation would break genjavadoc

[ https://issues.apache.org/jira/browse/SPARK-16153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16153. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13855

[jira] [Updated] (SPARK-16159) Move RDD creation logic from FileSourceStrategy.apply

[ https://issues.apache.org/jira/browse/SPARK-16159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16159: Summary: Move RDD creation logic from FileSourceStrategy.apply (was: Move partitioning logic out

[jira] [Assigned] (SPARK-16158) Support pluggable dynamic allocation heuristics

[ https://issues.apache.org/jira/browse/SPARK-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16158: Assignee: Apache Spark > Support pluggable dynamic allocation heuristics >

[jira] [Assigned] (SPARK-16158) Support pluggable dynamic allocation heuristics

[ https://issues.apache.org/jira/browse/SPARK-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16158: Assignee: (was: Apache Spark) > Support pluggable dynamic allocation heuristics >

[jira] [Commented] (SPARK-16158) Support pluggable dynamic allocation heuristics

[ https://issues.apache.org/jira/browse/SPARK-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345309#comment-15345309 ] Apache Spark commented on SPARK-16158: -- User 'nezihyigitbasi' has created a pull request for this

[jira] [Assigned] (SPARK-16159) Move partitioning logic out of FileSourceStrategy.apply

[ https://issues.apache.org/jira/browse/SPARK-16159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16159: Assignee: Apache Spark (was: Reynold Xin) > Move partitioning logic out of

[jira] [Assigned] (SPARK-16159) Move partitioning logic out of FileSourceStrategy.apply

[ https://issues.apache.org/jira/browse/SPARK-16159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16159: Assignee: Reynold Xin (was: Apache Spark) > Move partitioning logic out of

[jira] [Commented] (SPARK-16159) Move partitioning logic out of FileSourceStrategy.apply

[ https://issues.apache.org/jira/browse/SPARK-16159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345306#comment-15345306 ] Apache Spark commented on SPARK-16159: -- User 'rxin' has created a pull request for this issue:

[jira] [Updated] (SPARK-16159) Move partitioning logic out of FileSourceStrategy.apply

[ https://issues.apache.org/jira/browse/SPARK-16159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16159: Summary: Move partitioning logic out of FileSourceStrategy.apply (was: Break partitioning logic

[jira] [Updated] (SPARK-16159) Break partitioning logic from FileSourceStrategy.apply

[ https://issues.apache.org/jira/browse/SPARK-16159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16159: Description: We embed partitioning logic in FileSourceStrategy.apply, making the function very

[jira] [Created] (SPARK-16159) Break partitioning logic from FileSourceStrategy.apply

Reynold Xin created SPARK-16159: --- Summary: Break partitioning logic from FileSourceStrategy.apply Key: SPARK-16159 URL: https://issues.apache.org/jira/browse/SPARK-16159 Project: Spark Issue

[jira] [Commented] (SPARK-15885) Provide links to executor logs from stage details page in UI

[ https://issues.apache.org/jira/browse/SPARK-15885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345290#comment-15345290 ] Apache Spark commented on SPARK-15885: -- User 'tmagrino' has created a pull request for this issue:

[jira] [Created] (SPARK-16158) Support pluggable dynamic allocation heuristics

Nezih Yigitbasi created SPARK-16158: --- Summary: Support pluggable dynamic allocation heuristics Key: SPARK-16158 URL: https://issues.apache.org/jira/browse/SPARK-16158 Project: Spark Issue

[jira] [Commented] (SPARK-16157) Add New Methods for Comments in StructField and StructType

[ https://issues.apache.org/jira/browse/SPARK-16157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345275#comment-15345275 ] Apache Spark commented on SPARK-16157: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16157) Add New Methods for Comments in StructField and StructType

[ https://issues.apache.org/jira/browse/SPARK-16157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16157: Assignee: (was: Apache Spark) > Add New Methods for Comments in StructField and

[jira] [Assigned] (SPARK-16157) Add New Methods for Comments in StructField and StructType

[ https://issues.apache.org/jira/browse/SPARK-16157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16157: Assignee: Apache Spark > Add New Methods for Comments in StructField and StructType >

[jira] [Commented] (SPARK-15581) MLlib 2.1 Roadmap

[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345264#comment-15345264 ] Alexander Ulanov commented on SPARK-15581: -- The current implementation of multilayer perceptron

[jira] [Updated] (SPARK-16157) Add New Methods for Comments in StructField and StructType

[ https://issues.apache.org/jira/browse/SPARK-16157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-16157: Description: Currently, the column-related comment attribute is stored in {{Metadata}}. For example,

[jira] [Created] (SPARK-16157) Add New Methods for Comments in StructField and StructType

Xiao Li created SPARK-16157: --- Summary: Add New Methods for Comments in StructField and StructType Key: SPARK-16157 URL: https://issues.apache.org/jira/browse/SPARK-16157 Project: Spark Issue Type:

[jira] [Commented] (SPARK-16140) Group k-means method in generated doc

[ https://issues.apache.org/jira/browse/SPARK-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345254#comment-15345254 ] Xin Ren commented on SPARK-16140: - Maybe I can take this one as a warm-up, thanks Xiangrui :) > Group

[jira] [Commented] (SPARK-16147) Add package docs to packages under spark.ml

[ https://issues.apache.org/jira/browse/SPARK-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345246#comment-15345246 ] Xin Ren commented on SPARK-16147: - hi Xiangrui, I can help on this if you need more hands. :) > Add

[jira] [Commented] (SPARK-16154) Update spark.ml and spark.mllib package docs

[ https://issues.apache.org/jira/browse/SPARK-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345239#comment-15345239 ] Apache Spark commented on SPARK-16154: -- User 'mengxr' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16154) Update spark.ml and spark.mllib package docs

[ https://issues.apache.org/jira/browse/SPARK-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16154: Assignee: Xiangrui Meng (was: Apache Spark) > Update spark.ml and spark.mllib package

[jira] [Assigned] (SPARK-16154) Update spark.ml and spark.mllib package docs

[ https://issues.apache.org/jira/browse/SPARK-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16154: Assignee: Apache Spark (was: Xiangrui Meng) > Update spark.ml and spark.mllib package

[jira] [Commented] (SPARK-11134) Flaky test: o.a.s.launcher.LauncherBackendSuite

[ https://issues.apache.org/jira/browse/SPARK-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345233#comment-15345233 ] Marcelo Vanzin commented on SPARK-11134: [~tmagrino] all looks good here. If you could run the

[jira] [Commented] (SPARK-16146) Spark application failed by Yarn preempting

[ https://issues.apache.org/jira/browse/SPARK-16146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345232#comment-15345232 ] Cong Feng commented on SPARK-16146: --- Hi Sean, In our test case, normally one job will get 10 executors

[jira] [Commented] (SPARK-9478) Add class weights to Random Forest

[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345208#comment-15345208 ] Seth Hendrickson commented on SPARK-9478: - Thanks for your timely feedback! There are many use

[jira] [Commented] (SPARK-16148) TaskLocation does not allow for Executor ID's with underscores

[ https://issues.apache.org/jira/browse/SPARK-16148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345192#comment-15345192 ] Apache Spark commented on SPARK-16148: -- User 'tmagrino' has created a pull request for this issue:

[jira] [Created] (SPARK-16156) RowMatrıx Covariance

Hayri Volkan Agun created SPARK-16156: - Summary: RowMatrıx Covariance Key: SPARK-16156 URL: https://issues.apache.org/jira/browse/SPARK-16156 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14351) Optimize ImpurityAggregator for decision trees

[ https://issues.apache.org/jira/browse/SPARK-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345182#comment-15345182 ] Manoj Kumar commented on SPARK-14351: - Here are my thoughts: Also ccing [~sethah] since he has seen

[jira] [Commented] (SPARK-16146) Spark application failed by Yarn preempting

[ https://issues.apache.org/jira/browse/SPARK-16146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345172#comment-15345172 ] Nick Peterson commented on SPARK-16146: --- We see this error logged, and it fails the currently

[jira] [Commented] (SPARK-11134) Flaky test: o.a.s.launcher.LauncherBackendSuite

[ https://issues.apache.org/jira/browse/SPARK-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345147#comment-15345147 ] Marcelo Vanzin commented on SPARK-11134: Let me try on the current branch-1.6 to see if anything

[jira] [Commented] (SPARK-16146) Spark application failed by Yarn preempting

[ https://issues.apache.org/jira/browse/SPARK-16146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345141#comment-15345141 ] Sean Owen commented on SPARK-16146: --- Yes, though enough failures and retries will cause the app to give

[jira] [Assigned] (SPARK-16148) TaskLocation does not allow for Executor ID's with underscores

[ https://issues.apache.org/jira/browse/SPARK-16148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16148: Assignee: Apache Spark > TaskLocation does not allow for Executor ID's with underscores >

[jira] [Assigned] (SPARK-16148) TaskLocation does not allow for Executor ID's with underscores

[ https://issues.apache.org/jira/browse/SPARK-16148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16148: Assignee: (was: Apache Spark) > TaskLocation does not allow for Executor ID's with

[jira] [Commented] (SPARK-16148) TaskLocation does not allow for Executor ID's with underscores

[ https://issues.apache.org/jira/browse/SPARK-16148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345139#comment-15345139 ] Apache Spark commented on SPARK-16148: -- User 'tmagrino' has created a pull request for this issue:

[jira] [Commented] (SPARK-16146) Spark application failed by Yarn preempting

[ https://issues.apache.org/jira/browse/SPARK-16146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345138#comment-15345138 ] Nick Peterson commented on SPARK-16146: --- Shouldn't the executors -- given that the external spark

[jira] [Commented] (SPARK-11134) Flaky test: o.a.s.launcher.LauncherBackendSuite

[ https://issues.apache.org/jira/browse/SPARK-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345131#comment-15345131 ] Sean Owen commented on SPARK-11134: --- No, at best reopen this one, but maybe wait for a comment. >

[jira] [Resolved] (SPARK-16078) from_utc_timestamp/to_utc_timestamp may give different result in different timezone

[ https://issues.apache.org/jira/browse/SPARK-16078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16078. --- Resolution: Resolved > from_utc_timestamp/to_utc_timestamp may give different result

[jira] [Commented] (SPARK-11134) Flaky test: o.a.s.launcher.LauncherBackendSuite

[ https://issues.apache.org/jira/browse/SPARK-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345121#comment-15345121 ] Tom Magrino commented on SPARK-11134: - I'm currently experiencing similar issues with the current

[jira] [Assigned] (SPARK-16155) Remove package grouping in genjavadoc

[ https://issues.apache.org/jira/browse/SPARK-16155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16155: Assignee: Apache Spark (was: Xiangrui Meng) > Remove package grouping in genjavadoc >

[jira] [Commented] (SPARK-16155) Remove package grouping in genjavadoc

[ https://issues.apache.org/jira/browse/SPARK-16155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345113#comment-15345113 ] Apache Spark commented on SPARK-16155: -- User 'mengxr' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16155) Remove package grouping in genjavadoc

[ https://issues.apache.org/jira/browse/SPARK-16155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16155: Assignee: Xiangrui Meng (was: Apache Spark) > Remove package grouping in genjavadoc >

[jira] [Comment Edited] (SPARK-9478) Add class weights to Random Forest

[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345105#comment-15345105 ] Yuewei Na edited comment on SPARK-9478 at 6/22/16 8:28 PM: --- Hi [~sethah], thanks

[jira] [Commented] (SPARK-9478) Add class weights to Random Forest

[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345105#comment-15345105 ] Yuewei Na commented on SPARK-9478: -- Hi [~sethah], thanks a lot for your comment on my PR and your

[jira] [Created] (SPARK-16155) Remove package grouping in genjavadoc

Xiangrui Meng created SPARK-16155: - Summary: Remove package grouping in genjavadoc Key: SPARK-16155 URL: https://issues.apache.org/jira/browse/SPARK-16155 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-16137) Random Forest wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-16137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-16137: -- Comment: was deleted (was: User 'j4munoz' has created a pull request for this issue:

[jira] [Resolved] (SPARK-15672) R programming guide update

[ https://issues.apache.org/jira/browse/SPARK-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-15672. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13660

[jira] [Updated] (SPARK-15672) R programming guide update

[ https://issues.apache.org/jira/browse/SPARK-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15672: -- Assignee: Kai Jiang > R programming guide update > -- > >

[jira] [Created] (SPARK-16154) Update spark.ml and spark.mllib package docs

Xiangrui Meng created SPARK-16154: - Summary: Update spark.ml and spark.mllib package docs Key: SPARK-16154 URL: https://issues.apache.org/jira/browse/SPARK-16154 Project: Spark Issue Type:

  1   2   3   >