[jira] [Created] (SPARK-12894) Add deploy instructions for Python in Kinesis integration doc

Shixiong Zhu created SPARK-12894: Summary: Add deploy instructions for Python in Kinesis integration doc Key: SPARK-12894 URL: https://issues.apache.org/jira/browse/SPARK-12894 Project: Spark

[jira] [Commented] (SPARK-12894) Add deploy instructions for Python in Kinesis integration doc

[ https://issues.apache.org/jira/browse/SPARK-12894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106022#comment-15106022 ] Apache Spark commented on SPARK-12894: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12894) Add deploy instructions for Python in Kinesis integration doc

[ https://issues.apache.org/jira/browse/SPARK-12894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12894: Assignee: Shixiong Zhu (was: Apache Spark) > Add deploy instructions for Python in

[jira] [Created] (SPARK-12895) Implement TaskMetrics using accumulators

Andrew Or created SPARK-12895: - Summary: Implement TaskMetrics using accumulators Key: SPARK-12895 URL: https://issues.apache.org/jira/browse/SPARK-12895 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-12876) Race condition when driver rapidly shutdown after started.

[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106111#comment-15106111 ] jeffonia Tung commented on SPARK-12876: --- I've tested it's still happen in 1.4.0, and this time in

[jira] [Resolved] (SPARK-12889) Rename ParserDialect -> ParserInterface

[ https://issues.apache.org/jira/browse/SPARK-12889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12889. - Resolution: Fixed Fix Version/s: 2.0.0 > Rename ParserDialect -> ParserInterface >

[jira] [Comment Edited] (SPARK-12890) Spark SQL query related to only partition fields should not scan the whole data.

[ https://issues.apache.org/jira/browse/SPARK-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106124#comment-15106124 ] Simeon Simeonov edited comment on SPARK-12890 at 1/19/16 2:07 AM: -- I've

[jira] [Commented] (SPARK-12890) Spark SQL query related to only partition fields should not scan the whole data.

[ https://issues.apache.org/jira/browse/SPARK-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106124#comment-15106124 ] Simeon Simeonov commented on SPARK-12890: - I've experienced this issue with a multi-level

[jira] [Commented] (SPARK-12864) initialize executorIdCounter after ApplicationMaster killed for max number of executor failures reached

[ https://issues.apache.org/jira/browse/SPARK-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106129#comment-15106129 ] iward commented on SPARK-12864: --- Yeah, you are right. When AM is exited, All executors will be exited, but

[jira] [Assigned] (SPARK-12894) Add deploy instructions for Python in Kinesis integration doc

[ https://issues.apache.org/jira/browse/SPARK-12894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12894: Assignee: Apache Spark (was: Shixiong Zhu) > Add deploy instructions for Python in

[jira] [Resolved] (SPARK-12814) Add deploy instructions for Python in flume integration doc

[ https://issues.apache.org/jira/browse/SPARK-12814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-12814. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1 > Add deploy

[jira] [Assigned] (SPARK-12854) Vectorize Parquet reader

[ https://issues.apache.org/jira/browse/SPARK-12854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12854: Assignee: (was: Apache Spark) > Vectorize Parquet reader > >

[jira] [Created] (SPARK-12893) RM redirects to incorrect URL in Spark HistoryServer for yarn-cluster mode

Saisai Shao created SPARK-12893: --- Summary: RM redirects to incorrect URL in Spark HistoryServer for yarn-cluster mode Key: SPARK-12893 URL: https://issues.apache.org/jira/browse/SPARK-12893 Project:

[jira] [Assigned] (SPARK-12893) RM redirects to incorrect URL in Spark HistoryServer for yarn-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12893: Assignee: (was: Apache Spark) > RM redirects to incorrect URL in Spark HistoryServer

[jira] [Commented] (SPARK-12893) RM redirects to incorrect URL in Spark HistoryServer for yarn-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105996#comment-15105996 ] Apache Spark commented on SPARK-12893: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12893) RM redirects to incorrect URL in Spark HistoryServer for yarn-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12893: Assignee: Apache Spark > RM redirects to incorrect URL in Spark HistoryServer for

[jira] [Resolved] (SPARK-12894) Add deploy instructions for Python in Kinesis integration doc

[ https://issues.apache.org/jira/browse/SPARK-12894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-12894. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1 > Add deploy

[jira] [Updated] (SPARK-12895) Implement TaskMetrics using accumulators

[ https://issues.apache.org/jira/browse/SPARK-12895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12895: -- Description: We need to first do this before we can avoid sending TaskMetrics from the executors to

[jira] [Updated] (SPARK-12896) Send only accumulator updates, not TaskMetrics, to the driver

[ https://issues.apache.org/jira/browse/SPARK-12896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12896: -- Description: Currently in Spark there are two different things that the executors send to the driver,

[jira] [Created] (SPARK-12896) Send only accumulator updates, not TaskMetrics, to the driver

Andrew Or created SPARK-12896: - Summary: Send only accumulator updates, not TaskMetrics, to the driver Key: SPARK-12896 URL: https://issues.apache.org/jira/browse/SPARK-12896 Project: Spark

[jira] [Created] (SPARK-12892) Support plugging in Spark scheduler

Timothy Chen created SPARK-12892: Summary: Support plugging in Spark scheduler Key: SPARK-12892 URL: https://issues.apache.org/jira/browse/SPARK-12892 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12854) Vectorize Parquet reader

[ https://issues.apache.org/jira/browse/SPARK-12854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105978#comment-15105978 ] Apache Spark commented on SPARK-12854: -- User 'nongli' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12854) Vectorize Parquet reader

[ https://issues.apache.org/jira/browse/SPARK-12854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12854: Assignee: Apache Spark > Vectorize Parquet reader > > >

[jira] [Updated] (SPARK-12893) RM redirects to incorrect URL in Spark HistoryServer for yarn-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-12893: Description: This will cause application not found error, the screenshot shows below:

[jira] [Commented] (SPARK-12883) 1.6 Dynamic allocation doc still refers to 1.2

[ https://issues.apache.org/jira/browse/SPARK-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106005#comment-15106005 ] Saisai Shao commented on SPARK-12883: - I think this doc is still valid, current way of setting a

[jira] [Resolved] (SPARK-12700) SortMergeJoin and BroadcastHashJoin should support condition

[ https://issues.apache.org/jira/browse/SPARK-12700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12700. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10653

[jira] [Resolved] (SPARK-12885) Rename 3 fields in ShuffleWriteMetrics

[ https://issues.apache.org/jira/browse/SPARK-12885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12885. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10811

[jira] [Updated] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10620: --- Assignee: Andrew Or > Look into whether accumulator mechanism can replace TaskMetrics >

[jira] [Assigned] (SPARK-12898) Consider having dummyCallSite for HiveTableScan

[ https://issues.apache.org/jira/browse/SPARK-12898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12898: Assignee: (was: Apache Spark) > Consider having dummyCallSite for HiveTableScan >

[jira] [Assigned] (SPARK-12898) Consider having dummyCallSite for HiveTableScan

[ https://issues.apache.org/jira/browse/SPARK-12898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12898: Assignee: Apache Spark > Consider having dummyCallSite for HiveTableScan >

[jira] [Commented] (SPARK-12898) Consider having dummyCallSite for HiveTableScan

[ https://issues.apache.org/jira/browse/SPARK-12898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106226#comment-15106226 ] Apache Spark commented on SPARK-12898: -- User 'rajeshbalamohan' has created a pull request for this

[jira] [Assigned] (SPARK-12682) Hive will fail if the schema of a parquet table has a very wide schema

[ https://issues.apache.org/jira/browse/SPARK-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12682: Assignee: Apache Spark > Hive will fail if the schema of a parquet table has a very wide

[jira] [Assigned] (SPARK-12682) Hive will fail if the schema of a parquet table has a very wide schema

[ https://issues.apache.org/jira/browse/SPARK-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12682: Assignee: (was: Apache Spark) > Hive will fail if the schema of a parquet table has a

[jira] [Commented] (SPARK-12682) Hive will fail if the schema of a parquet table has a very wide schema

[ https://issues.apache.org/jira/browse/SPARK-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106242#comment-15106242 ] Apache Spark commented on SPARK-12682: -- User 'sameeragarwal' has created a pull request for this

[jira] [Resolved] (SPARK-12841) UnresolvedException with cast

[ https://issues.apache.org/jira/browse/SPARK-12841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12841. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull request

[jira] [Created] (SPARK-12897) spark ui with tachyon show all Stream Blocks

astralidea created SPARK-12897: -- Summary: spark ui with tachyon show all Stream Blocks Key: SPARK-12897 URL: https://issues.apache.org/jira/browse/SPARK-12897 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12841) UnresolvedException with cast

[ https://issues.apache.org/jira/browse/SPARK-12841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106265#comment-15106265 ] Yin Huai commented on SPARK-12841: -- https://github.com/apache/spark/pull/10781 is the fix for master. >

[jira] [Resolved] (SPARK-12668) Renaming CSV options to be similar to Pandas and R

[ https://issues.apache.org/jira/browse/SPARK-12668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12668. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.0.0 > Renaming CSV

[jira] [Deleted] (SPARK-12900) Add support for compression option

[ https://issues.apache.org/jira/browse/SPARK-12900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin deleted SPARK-12900: > Add support for compression option > -- > > Key:

[jira] [Created] (SPARK-12900) Add support for compression option

Reynold Xin created SPARK-12900: --- Summary: Add support for compression option Key: SPARK-12900 URL: https://issues.apache.org/jira/browse/SPARK-12900 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-12864) initialize executorIdCounter after ApplicationMaster killed for max number of executor failures reached

[ https://issues.apache.org/jira/browse/SPARK-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106214#comment-15106214 ] Saisai Shao commented on SPARK-12864: - So the problem should be that: {{BlockManager}} should be

[jira] [Created] (SPARK-12898) Consider having dummyCallSite for HiveTableScan

Rajesh Balamohan created SPARK-12898: Summary: Consider having dummyCallSite for HiveTableScan Key: SPARK-12898 URL: https://issues.apache.org/jira/browse/SPARK-12898 Project: Spark

[jira] [Created] (SPARK-12899) Spark Data Security

Luciano Resende created SPARK-12899: --- Summary: Spark Data Security Key: SPARK-12899 URL: https://issues.apache.org/jira/browse/SPARK-12899 Project: Spark Issue Type: Epic

[jira] [Updated] (SPARK-11944) Python API for mllib.clustering.BisectingKMeans

[ https://issues.apache.org/jira/browse/SPARK-11944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11944: -- Shepherd: Joseph K. Bradley > Python API for mllib.clustering.BisectingKMeans >

[jira] [Commented] (SPARK-12901) Refector options to be correctly formed in a case class

[ https://issues.apache.org/jira/browse/SPARK-12901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106354#comment-15106354 ] Hyukjin Kwon commented on SPARK-12901: -- Ah.. got it. > Refector options to be correctly formed in a

[jira] [Assigned] (SPARK-12770) Implement rules for branch elimination for CaseWhen in SimplifyConditionals

[ https://issues.apache.org/jira/browse/SPARK-12770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-12770: --- Assignee: Reynold Xin > Implement rules for branch elimination for CaseWhen in

[jira] [Updated] (SPARK-12901) Refector options to be correctly formed in a case class

[ https://issues.apache.org/jira/browse/SPARK-12901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-12901: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-12420 > Refector options to be

[jira] [Created] (SPARK-12901) Refector options to be correctly formed in a case class

Hyukjin Kwon created SPARK-12901: Summary: Refector options to be correctly formed in a case class Key: SPARK-12901 URL: https://issues.apache.org/jira/browse/SPARK-12901 Project: Spark

[jira] [Commented] (SPARK-12901) Refector options to be correctly formed in a case class

[ https://issues.apache.org/jira/browse/SPARK-12901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106329#comment-15106329 ] Reynold Xin commented on SPARK-12901: - Also I don't think these options need to be case classes. >

[jira] [Commented] (SPARK-12901) Refector options to be correctly formed in a case class

[ https://issues.apache.org/jira/browse/SPARK-12901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106327#comment-15106327 ] Reynold Xin commented on SPARK-12901: - Actually after looking at it again, I think the CSVOptions

[jira] [Commented] (SPARK-12901) Refector options to be correctly formed in a case class

[ https://issues.apache.org/jira/browse/SPARK-12901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106347#comment-15106347 ] Hyukjin Kwon commented on SPARK-12901: -- Sure. > Refector options to be correctly formed in a case

[jira] [Reopened] (SPARK-12901) Refector options to be correctly formed in a case class

[ https://issues.apache.org/jira/browse/SPARK-12901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-12901: -- > Refector options to be correctly formed in a case class >

[jira] [Commented] (SPARK-9976) create function do not work

[ https://issues.apache.org/jira/browse/SPARK-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106385#comment-15106385 ] ocean commented on SPARK-9976: -- The second problem is: some temporary udf function which extends UDF can

[jira] [Commented] (SPARK-12864) initialize executorIdCounter after ApplicationMaster killed for max number of executor failures reached

[ https://issues.apache.org/jira/browse/SPARK-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106295#comment-15106295 ] iward commented on SPARK-12864: --- I don't think so. Why don't fix this conflict executor id ? If we fix it,

[jira] [Commented] (SPARK-12901) Refector options to be correctly formed in a case class

[ https://issues.apache.org/jira/browse/SPARK-12901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106310#comment-15106310 ] Hyukjin Kwon commented on SPARK-12901: -- I will work on this. > Refector options to be correctly

[jira] [Resolved] (SPARK-12901) Refector options to be correctly formed in a case class

[ https://issues.apache.org/jira/browse/SPARK-12901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-12901. -- Resolution: Invalid > Refector options to be correctly formed in a case class >

[jira] [Commented] (SPARK-12901) Refector options to be correctly formed in a case class

[ https://issues.apache.org/jira/browse/SPARK-12901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106350#comment-15106350 ] Reynold Xin commented on SPARK-12901: - It would still be great if you can refactor it so: 1.

[jira] [Assigned] (SPARK-12770) Implement rules for branch elimination for CaseWhen in SimplifyConditionals

[ https://issues.apache.org/jira/browse/SPARK-12770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12770: Assignee: Apache Spark (was: Reynold Xin) > Implement rules for branch elimination for

[jira] [Commented] (SPARK-12770) Implement rules for branch elimination for CaseWhen in SimplifyConditionals

[ https://issues.apache.org/jira/browse/SPARK-12770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106364#comment-15106364 ] Apache Spark commented on SPARK-12770: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12770) Implement rules for branch elimination for CaseWhen in SimplifyConditionals

[ https://issues.apache.org/jira/browse/SPARK-12770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12770: Assignee: Reynold Xin (was: Apache Spark) > Implement rules for branch elimination for

[jira] [Commented] (SPARK-9976) create function do not work

[ https://issues.apache.org/jira/browse/SPARK-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106372#comment-15106372 ] ocean commented on SPARK-9976: -- Now I am migrating from HIVE to Sparksql. Now I encountered two problem.

[jira] [Commented] (SPARK-12845) During join Spark should pushdown predicates on joining column to both tables

[ https://issues.apache.org/jira/browse/SPARK-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106377#comment-15106377 ] Maciej Bryński commented on SPARK-12845: In some cases it should be possible to have such a logic

[jira] [Created] (SPARK-12902) Visualization and metrics for generated operators

Davies Liu created SPARK-12902: -- Summary: Visualization and metrics for generated operators Key: SPARK-12902 URL: https://issues.apache.org/jira/browse/SPARK-12902 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-12902) Visualization and metrics for generated operators

[ https://issues.apache.org/jira/browse/SPARK-12902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12902: Assignee: Apache Spark (was: Davies Liu) > Visualization and metrics for generated

[jira] [Assigned] (SPARK-12902) Visualization and metrics for generated operators

[ https://issues.apache.org/jira/browse/SPARK-12902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12902: Assignee: Davies Liu (was: Apache Spark) > Visualization and metrics for generated

[jira] [Commented] (SPARK-12902) Visualization and metrics for generated operators

[ https://issues.apache.org/jira/browse/SPARK-12902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106382#comment-15106382 ] Apache Spark commented on SPARK-12902: -- User 'davies' has created a pull request for this issue:

[jira] [Commented] (SPARK-12884) Move *Metrics and *Accum* classes to their own files

[ https://issues.apache.org/jira/browse/SPARK-12884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105824#comment-15105824 ] Apache Spark commented on SPARK-12884: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12884) Move *Metrics and *Accum* classes to their own files

[ https://issues.apache.org/jira/browse/SPARK-12884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12884: Assignee: Andrew Or (was: Apache Spark) > Move *Metrics and *Accum* classes to their own

[jira] [Assigned] (SPARK-12884) Move *Metrics and *Accum* classes to their own files

[ https://issues.apache.org/jira/browse/SPARK-12884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12884: Assignee: Apache Spark (was: Andrew Or) > Move *Metrics and *Accum* classes to their own

[jira] [Updated] (SPARK-8519) Blockify distance computation in k-means

[ https://issues.apache.org/jira/browse/SPARK-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8519: - Shepherd: Xiangrui Meng Assignee: Yanbo Liang (was: Apache Spark) Target

[jira] [Commented] (SPARK-12299) Remove history serving functionality from standalone Master

[ https://issues.apache.org/jira/browse/SPARK-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105845#comment-15105845 ] Bryan Cutler commented on SPARK-12299: -- I'd be happy to work on this since I recently made some

[jira] [Assigned] (SPARK-12889) Rename ParserDialect -> ParserInterface

[ https://issues.apache.org/jira/browse/SPARK-12889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12889: Assignee: Reynold Xin (was: Apache Spark) > Rename ParserDialect -> ParserInterface >

[jira] [Commented] (SPARK-12889) Rename ParserDialect -> ParserInterface

[ https://issues.apache.org/jira/browse/SPARK-12889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105874#comment-15105874 ] Apache Spark commented on SPARK-12889: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12889) Rename ParserDialect -> ParserInterface

[ https://issues.apache.org/jira/browse/SPARK-12889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12889: Assignee: Apache Spark (was: Reynold Xin) > Rename ParserDialect -> ParserInterface >

[jira] [Created] (SPARK-12890) Spark SQL query related to only partition fields should not scan the whole data.

Prakash Chockalingam created SPARK-12890: Summary: Spark SQL query related to only partition fields should not scan the whole data. Key: SPARK-12890 URL: https://issues.apache.org/jira/browse/SPARK-12890

[jira] [Created] (SPARK-12882) simplify bucket tests and add more comments

Wenchen Fan created SPARK-12882: --- Summary: simplify bucket tests and add more comments Key: SPARK-12882 URL: https://issues.apache.org/jira/browse/SPARK-12882 Project: Spark Issue Type:

[jira] [Created] (SPARK-12883) 1.6 Dynamic allocation doc still refers to 1.2

Manoj Samel created SPARK-12883: --- Summary: 1.6 Dynamic allocation doc still refers to 1.2 Key: SPARK-12883 URL: https://issues.apache.org/jira/browse/SPARK-12883 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

[ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-12346. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by

[jira] [Commented] (SPARK-12881) Enable sub-expression Elimination in generated mutable projection

[ https://issues.apache.org/jira/browse/SPARK-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105818#comment-15105818 ] Apache Spark commented on SPARK-12881: -- User 'davies' has created a pull request for this issue:

[jira] [Created] (SPARK-12891) Add support for complex types in ColumnarBatch

Nong Li created SPARK-12891: --- Summary: Add support for complex types in ColumnarBatch Key: SPARK-12891 URL: https://issues.apache.org/jira/browse/SPARK-12891 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105772#comment-15105772 ] Daniel Siegmann commented on SPARK-4105: I had this happen in Spark 1.5.0. It only happened once

[jira] [Assigned] (SPARK-12786) Actor demo does not demonstrate usable code

[ https://issues.apache.org/jira/browse/SPARK-12786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12786: Assignee: (was: Apache Spark) > Actor demo does not demonstrate usable code >

[jira] [Assigned] (SPARK-12786) Actor demo does not demonstrate usable code

[ https://issues.apache.org/jira/browse/SPARK-12786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12786: Assignee: Apache Spark > Actor demo does not demonstrate usable code >

[jira] [Commented] (SPARK-12786) Actor demo does not demonstrate usable code

[ https://issues.apache.org/jira/browse/SPARK-12786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105802#comment-15105802 ] Apache Spark commented on SPARK-12786: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-12841) UnresolvedException with cast

[ https://issues.apache.org/jira/browse/SPARK-12841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105925#comment-15105925 ] Apache Spark commented on SPARK-12841: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-10975) Shuffle files left behind on Mesos without dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105769#comment-15105769 ] Fede Bar commented on SPARK-10975: -- Hi, this issue is not quite resolved actually, please see the ticket

[jira] [Assigned] (SPARK-12881) Enable sub-expression Elimination in generated mutable projection

[ https://issues.apache.org/jira/browse/SPARK-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12881: Assignee: Davies Liu (was: Apache Spark) > Enable sub-expression Elimination in

[jira] [Assigned] (SPARK-12881) Enable sub-expression Elimination in generated mutable projection

[ https://issues.apache.org/jira/browse/SPARK-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12881: Assignee: Apache Spark (was: Davies Liu) > Enable sub-expression Elimination in

[jira] [Created] (SPARK-12885) Rename 3 fields in ShuffleWriteMetrics

Andrew Or created SPARK-12885: - Summary: Rename 3 fields in ShuffleWriteMetrics Key: SPARK-12885 URL: https://issues.apache.org/jira/browse/SPARK-12885 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-10985) Avoid passing evicted blocks throughout BlockManager / CacheManager

[ https://issues.apache.org/jira/browse/SPARK-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10985. --- Resolution: Fixed Assignee: Josh Rosen Fix Version/s: 2.0.0 Target

[jira] [Created] (SPARK-12888) benchmark the new hash expression

Wenchen Fan created SPARK-12888: --- Summary: benchmark the new hash expression Key: SPARK-12888 URL: https://issues.apache.org/jira/browse/SPARK-12888 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-12881) Enable sub-expression Elimination in generated mutable projection

Davies Liu created SPARK-12881: -- Summary: Enable sub-expression Elimination in generated mutable projection Key: SPARK-12881 URL: https://issues.apache.org/jira/browse/SPARK-12881 Project: Spark

[jira] [Assigned] (SPARK-12882) simplify bucket tests and add more comments

[ https://issues.apache.org/jira/browse/SPARK-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12882: Assignee: Apache Spark > simplify bucket tests and add more comments >

[jira] [Assigned] (SPARK-12882) simplify bucket tests and add more comments

[ https://issues.apache.org/jira/browse/SPARK-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12882: Assignee: (was: Apache Spark) > simplify bucket tests and add more comments >

[jira] [Commented] (SPARK-12882) simplify bucket tests and add more comments

[ https://issues.apache.org/jira/browse/SPARK-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105793#comment-15105793 ] Apache Spark commented on SPARK-12882: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-12883) 1.6 Dynamic allocation doc still refers to 1.2

[ https://issues.apache.org/jira/browse/SPARK-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12883: -- Priority: Trivial (was: Minor) [~manojsamel] this isn't really worth a JIRA if it's that trivial a

[jira] [Issue Comment Deleted] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10620: -- Comment: was deleted (was: User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12885) Rename 3 fields in ShuffleWriteMetrics

[ https://issues.apache.org/jira/browse/SPARK-12885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12885: Assignee: Andrew Or (was: Apache Spark) > Rename 3 fields in ShuffleWriteMetrics >

[jira] [Issue Comment Deleted] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10620: -- Comment: was deleted (was: User 'andrewor14' has created a pull request for this issue:

[jira] [Created] (SPARK-12887) Do not expose var's in TaskMetrics

Andrew Or created SPARK-12887: - Summary: Do not expose var's in TaskMetrics Key: SPARK-12887 URL: https://issues.apache.org/jira/browse/SPARK-12887 Project: Spark Issue Type: Sub-task

<    1   2   3   >