[jira] [Commented] (SPARK-12957) Derive and propagate data constrains in logical plan

[ https://issues.apache.org/jira/browse/SPARK-12957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188856#comment-15188856 ] Sameer Agarwal commented on SPARK-12957: [~ksunitha] I've attached a copy of the design document

[jira] [Closed] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-13798. --- Resolution: Later > Replace Aggregate by Project if no Aggregate Function exists >

[jira] [Updated] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13798: Description: If the Aggregate does not have any aggregate expression, it is useless. We can replace

[jira] [Updated] (SPARK-12957) Derive and propagate data constrains in logical plan

[ https://issues.apache.org/jira/browse/SPARK-12957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-12957: --- Attachment: ConstraintPropagationinSparkSQL.pdf Design Document > Derive and propagate data

[jira] [Reopened] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-13798: - > Replace Aggregate by Project if no Aggregate Function exists >

[jira] [Closed] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-13798. --- Resolution: Invalid > Replace Aggregate by Project if no Aggregate Function exists >

[jira] [Updated] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13798: Description: If the Aggregate does not have any aggregate expression, it is useless. We can replace

[jira] [Commented] (SPARK-13134) add 'spark.streaming.kafka.partition.multiplier' into SparkConf

[ https://issues.apache.org/jira/browse/SPARK-13134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188834#comment-15188834 ] Sean Owen commented on SPARK-13134: --- I don't understand why there are two JIRAs here, or why you

[jira] [Resolved] (SPARK-13706) Python Example for Train Validation Split Missing

[ https://issues.apache.org/jira/browse/SPARK-13706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-13706. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11547

[jira] [Updated] (SPARK-13796) Lock release errors occur frequently in executor logs

[ https://issues.apache.org/jira/browse/SPARK-13796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13796: -- Priority: Minor (was: Major) Do you have more detail on how to reproduce it? It's good that you think

[jira] [Commented] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188819#comment-15188819 ] Apache Spark commented on SPARK-13798: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13797) Eliminate Unnecessary Window

[ https://issues.apache.org/jira/browse/SPARK-13797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13797: Assignee: (was: Apache Spark) > Eliminate Unnecessary Window >

[jira] [Assigned] (SPARK-13797) Eliminate Unnecessary Window

[ https://issues.apache.org/jira/browse/SPARK-13797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13797: Assignee: Apache Spark > Eliminate Unnecessary Window > > >

[jira] [Commented] (SPARK-13797) Eliminate Unnecessary Window

[ https://issues.apache.org/jira/browse/SPARK-13797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188818#comment-15188818 ] Apache Spark commented on SPARK-13797: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13798: Assignee: Apache Spark > Replace Aggregate by Project if no Aggregate Function exists >

[jira] [Assigned] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13798: Assignee: (was: Apache Spark) > Replace Aggregate by Project if no Aggregate Function

[jira] [Updated] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13798: Description: If the Aggregate does not have any aggregate expression, it is useless. We can replace

[jira] [Created] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

Xiao Li created SPARK-13798: --- Summary: Replace Aggregate by Project if no Aggregate Function exists Key: SPARK-13798 URL: https://issues.apache.org/jira/browse/SPARK-13798 Project: Spark Issue

[jira] [Created] (SPARK-13797) Eliminate Unnecessary Window

Xiao Li created SPARK-13797: --- Summary: Eliminate Unnecessary Window Key: SPARK-13797 URL: https://issues.apache.org/jira/browse/SPARK-13797 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-13797) Eliminate Unnecessary Window

[ https://issues.apache.org/jira/browse/SPARK-13797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13797: Description: If the Window does not have any window expression, it is useless. It might happen after

[jira] [Updated] (SPARK-13430) Expose ml summary function in PySpark for classification and regression models

[ https://issues.apache.org/jira/browse/SPARK-13430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-13430: --- Assignee: Bryan Cutler > Expose ml summary function in PySpark for classification and

[jira] [Commented] (SPARK-12626) MLlib 2.0 Roadmap

[ https://issues.apache.org/jira/browse/SPARK-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188774#comment-15188774 ] Nick Pentreath commented on SPARK-12626: [~dbtsai] ok thanks - would like to take a look when

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188761#comment-15188761 ] Praveen Devarao commented on SPARK-12177: - Hi Cody, The last time when I got TopicParition and

[jira] [Commented] (SPARK-13796) Lock release errors occur frequently in executor logs

[ https://issues.apache.org/jira/browse/SPARK-13796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188762#comment-15188762 ] Nishkam Ravi commented on SPARK-13796: -- Running with master from March 7th

[jira] [Created] (SPARK-13796) Lock release errors occur frequently in executor logs

Nishkam Ravi created SPARK-13796: Summary: Lock release errors occur frequently in executor logs Key: SPARK-13796 URL: https://issues.apache.org/jira/browse/SPARK-13796 Project: Spark Issue

[jira] [Commented] (SPARK-9289) OrcPartitionDiscoverySuite is slow to run

[ https://issues.apache.org/jira/browse/SPARK-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188710#comment-15188710 ] Dongjoon Hyun commented on SPARK-9289: -- Oh, it wasn't fast enough. I see. Thank you any way. >

[jira] [Assigned] (SPARK-13793) PipeRDD doesn't propagate exceptions while reading parent RDD

[ https://issues.apache.org/jira/browse/SPARK-13793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13793: Assignee: (was: Apache Spark) > PipeRDD doesn't propagate exceptions while reading

[jira] [Commented] (SPARK-13793) PipeRDD doesn't propagate exceptions while reading parent RDD

[ https://issues.apache.org/jira/browse/SPARK-13793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188660#comment-15188660 ] Apache Spark commented on SPARK-13793: -- User 'tejasapatil' has created a pull request for this

[jira] [Updated] (SPARK-13793) PipedRDD doesn't propagate exceptions while reading parent RDDd

[ https://issues.apache.org/jira/browse/SPARK-13793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-13793: Summary: PipedRDD doesn't propagate exceptions while reading parent RDDd (was: PipeRDD doesn't

[jira] [Assigned] (SPARK-13793) PipeRDD doesn't propagate exceptions while reading parent RDD

[ https://issues.apache.org/jira/browse/SPARK-13793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13793: Assignee: Apache Spark > PipeRDD doesn't propagate exceptions while reading parent RDD >

[jira] [Commented] (SPARK-13795) ClassCast Exception while attempting to show() a DataFrame

[ https://issues.apache.org/jira/browse/SPARK-13795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188636#comment-15188636 ] Ganesh Krishnan commented on SPARK-13795: - This is similar to this Scala bug:

[jira] [Created] (SPARK-13795) ClassCast Exception while attempting to show() a DataFrame

Ganesh Krishnan created SPARK-13795: --- Summary: ClassCast Exception while attempting to show() a DataFrame Key: SPARK-13795 URL: https://issues.apache.org/jira/browse/SPARK-13795 Project: Spark

[jira] [Deleted] (SPARK-10813) API design: high level class structuring regarding windowed and non-windowed streams

[ https://issues.apache.org/jira/browse/SPARK-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin deleted SPARK-10813: > API design: high level class structuring regarding windowed and non-windowed > streams >

[jira] [Resolved] (SPARK-13146) API for managing streaming dataframes

[ https://issues.apache.org/jira/browse/SPARK-13146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13146. - Resolution: Fixed Fix Version/s: 2.0.0 > API for managing streaming dataframes >

[jira] [Deleted] (SPARK-10819) Logical plan: determine logical operators needed

[ https://issues.apache.org/jira/browse/SPARK-10819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin deleted SPARK-10819: > Logical plan: determine logical operators needed >

[jira] [Deleted] (SPARK-10818) Query optimization: investigate whether we need a separate optimizer from Spark SQL's

[ https://issues.apache.org/jira/browse/SPARK-10818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin deleted SPARK-10818: > Query optimization: investigate whether we need a separate optimizer from > Spark SQL's >

[jira] [Commented] (SPARK-13794) Rename DataFrameWriter.stream DataFrameWriter.startStream

[ https://issues.apache.org/jira/browse/SPARK-13794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188598#comment-15188598 ] Apache Spark commented on SPARK-13794: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13794) Rename DataFrameWriter.stream DataFrameWriter.startStream

[ https://issues.apache.org/jira/browse/SPARK-13794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13794: Assignee: Apache Spark (was: Reynold Xin) > Rename DataFrameWriter.stream

[jira] [Assigned] (SPARK-13794) Rename DataFrameWriter.stream DataFrameWriter.startStream

[ https://issues.apache.org/jira/browse/SPARK-13794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13794: Assignee: Reynold Xin (was: Apache Spark) > Rename DataFrameWriter.stream

[jira] [Created] (SPARK-13794) Rename DataFrameWriter.stream DataFrameWriter.startStream

Reynold Xin created SPARK-13794: --- Summary: Rename DataFrameWriter.stream DataFrameWriter.startStream Key: SPARK-13794 URL: https://issues.apache.org/jira/browse/SPARK-13794 Project: Spark

[jira] [Commented] (SPARK-12117) Column Aliases are Ignored in callUDF while using struct()

[ https://issues.apache.org/jira/browse/SPARK-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188593#comment-15188593 ] Liang-Chi Hsieh commented on SPARK-12117: - As I revisit this PR and find that this bug is already

[jira] [Comment Edited] (SPARK-12345) Mesos cluster mode is broken

[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188589#comment-15188589 ] Eran Withana edited comment on SPARK-12345 at 3/10/16 3:20 AM: --- is the

[jira] [Comment Edited] (SPARK-12345) Mesos cluster mode is broken

[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188589#comment-15188589 ] Eran Withana edited comment on SPARK-12345 at 3/10/16 3:19 AM: --- is the

[jira] [Comment Edited] (SPARK-12345) Mesos cluster mode is broken

[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188589#comment-15188589 ] Eran Withana edited comment on SPARK-12345 at 3/10/16 3:16 AM: --- is the

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188589#comment-15188589 ] Eran Withana commented on SPARK-12345: -- is the resolution to this issue available in Spark 1.6.0

[jira] [Resolved] (SPARK-13766) Inconsistent file extensions and omitted file extensions written by CSV, TEXT and JSON data sources

[ https://issues.apache.org/jira/browse/SPARK-13766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13766. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.0.0 > Inconsistent

[jira] [Resolved] (SPARK-9289) OrcPartitionDiscoverySuite is slow to run

[ https://issues.apache.org/jira/browse/SPARK-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9289. Resolution: Not A Problem > OrcPartitionDiscoverySuite is slow to run >

[jira] [Commented] (SPARK-9289) OrcPartitionDiscoverySuite is slow to run

[ https://issues.apache.org/jira/browse/SPARK-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188583#comment-15188583 ] Reynold Xin commented on SPARK-9289: Still pretty long but let me close this. >

[jira] [Created] (SPARK-13793) PipeRDD doesn't propagate exceptions while reading parent RDD

Tejas Patil created SPARK-13793: --- Summary: PipeRDD doesn't propagate exceptions while reading parent RDD Key: SPARK-13793 URL: https://issues.apache.org/jira/browse/SPARK-13793 Project: Spark

[jira] [Commented] (SPARK-7420) Flaky test: o.a.s.streaming.JobGeneratorSuite "Do not clear received block data too soon"

[ https://issues.apache.org/jira/browse/SPARK-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188574#comment-15188574 ] Apache Spark commented on SPARK-7420: - User 'lw-lin' has created a pull request for this issue:

[jira] [Reopened] (SPARK-13760) Fix BigDecimal constructor for FloatType

[ https://issues.apache.org/jira/browse/SPARK-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-13760: -- > Fix BigDecimal constructor for FloatType > > >

[jira] [Commented] (SPARK-9289) OrcPartitionDiscoverySuite is slow to run

[ https://issues.apache.org/jira/browse/SPARK-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188567#comment-15188567 ] Dongjoon Hyun commented on SPARK-9289: -- Hi, [~rxin]. As of today, this issue seems to be solved. If

[jira] [Resolved] (SPARK-13760) Fix BigDecimal constructor for FloatType

[ https://issues.apache.org/jira/browse/SPARK-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-13760. -- Resolution: Later > Fix BigDecimal constructor for FloatType >

[jira] [Commented] (SPARK-13760) Fix BigDecimal constructor for FloatType

[ https://issues.apache.org/jira/browse/SPARK-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188568#comment-15188568 ] Yin Huai commented on SPARK-13760: -- Set the resolution to later. Maybe we want to revisit it after we

[jira] [Closed] (SPARK-13760) Fix BigDecimal constructor for FloatType

[ https://issues.apache.org/jira/browse/SPARK-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal closed SPARK-13760. -- Resolution: Won't Fix > Fix BigDecimal constructor for FloatType >

[jira] [Assigned] (SPARK-13760) Fix BigDecimal constructor for FloatType

[ https://issues.apache.org/jira/browse/SPARK-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13760: Assignee: Apache Spark (was: Sameer Agarwal) > Fix BigDecimal constructor for FloatType

[jira] [Assigned] (SPARK-13760) Fix BigDecimal constructor for FloatType

[ https://issues.apache.org/jira/browse/SPARK-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13760: Assignee: Sameer Agarwal (was: Apache Spark) > Fix BigDecimal constructor for FloatType

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188556#comment-15188556 ] Zhongshuai Pei commented on SPARK-4105: --- I had this happen in Spark 1.5.2 [~joshrosen]

[jira] [Reopened] (SPARK-13760) Fix BigDecimal constructor for FloatType

[ https://issues.apache.org/jira/browse/SPARK-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-13760: -- > Fix BigDecimal constructor for FloatType > > >

[jira] [Commented] (SPARK-13760) Fix BigDecimal constructor for FloatType

[ https://issues.apache.org/jira/browse/SPARK-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188555#comment-15188555 ] Yin Huai commented on SPARK-13760: -- Seems https://github.com/apache/spark/pull/11597 broke the scala

[jira] [Updated] (SPARK-13760) Fix BigDecimal constructor for FloatType

[ https://issues.apache.org/jira/browse/SPARK-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13760: - Fix Version/s: (was: 1.6.2) (was: 2.0.0) > Fix BigDecimal constructor for

[jira] [Created] (SPARK-13792) Limit logging of bad records

Hossein Falaki created SPARK-13792: -- Summary: Limit logging of bad records Key: SPARK-13792 URL: https://issues.apache.org/jira/browse/SPARK-13792 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-13760) Fix BigDecimal constructor for FloatType

[ https://issues.apache.org/jira/browse/SPARK-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13760: - Assignee: Sameer Agarwal > Fix BigDecimal constructor for FloatType >

[jira] [Updated] (SPARK-13760) Fix BigDecimal constructor for FloatType

[ https://issues.apache.org/jira/browse/SPARK-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13760: - Fix Version/s: (was: 1.6.1) 1.6.2 > Fix BigDecimal constructor for FloatType >

[jira] [Resolved] (SPARK-13760) Fix BigDecimal constructor for FloatType

[ https://issues.apache.org/jira/browse/SPARK-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-13760. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-13492) Configure a custom webui_url for the Spark Mesos Framework

[ https://issues.apache.org/jira/browse/SPARK-13492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13492: -- Assignee: Sergiusz Urbaniak (was: Andrew Or) > Configure a custom webui_url for the Spark Mesos

[jira] [Assigned] (SPARK-13492) Configure a custom webui_url for the Spark Mesos Framework

[ https://issues.apache.org/jira/browse/SPARK-13492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-13492: - Assignee: Andrew Or > Configure a custom webui_url for the Spark Mesos Framework >

[jira] [Resolved] (SPARK-13492) Configure a custom webui_url for the Spark Mesos Framework

[ https://issues.apache.org/jira/browse/SPARK-13492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13492. --- Resolution: Fixed Fix Version/s: 2.0.0 > Configure a custom webui_url for the Spark Mesos

[jira] [Resolved] (SPARK-13775) history server sort by completed time by default

[ https://issues.apache.org/jira/browse/SPARK-13775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13775. --- Resolution: Fixed Assignee: Zhuo Liu Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-13778) Master's ApplicationPage displays wrong application executor state when a worker is lost

[ https://issues.apache.org/jira/browse/SPARK-13778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13778. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Master's

[jira] [Commented] (SPARK-13791) Add MetadataLog and HDFSMetadataLog

[ https://issues.apache.org/jira/browse/SPARK-13791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188467#comment-15188467 ] Apache Spark commented on SPARK-13791: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13791) Add MetadataLog and HDFSMetadataLog

[ https://issues.apache.org/jira/browse/SPARK-13791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13791: Assignee: Shixiong Zhu (was: Apache Spark) > Add MetadataLog and HDFSMetadataLog >

[jira] [Assigned] (SPARK-13791) Add MetadataLog and HDFSMetadataLog

[ https://issues.apache.org/jira/browse/SPARK-13791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13791: Assignee: Apache Spark (was: Shixiong Zhu) > Add MetadataLog and HDFSMetadataLog >

[jira] [Created] (SPARK-13791) Add MetadataLog and HDFSMetadataLog

Shixiong Zhu created SPARK-13791: Summary: Add MetadataLog and HDFSMetadataLog Key: SPARK-13791 URL: https://issues.apache.org/jira/browse/SPARK-13791 Project: Spark Issue Type: Improvement

[jira] [Issue Comment Deleted] (SPARK-13782) Model export/import for spark.ml: BisectingKMeans

[ https://issues.apache.org/jira/browse/SPARK-13782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-13782: -- Comment: was deleted (was: Hi, [~josephkb]. May I work on this issue?) > Model export/import

[jira] [Resolved] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-13747. -- Resolution: Fixed Fix Version/s: 2.0.0 > Concurrent execution in SQL doesn't work with

[jira] [Assigned] (SPARK-13790) Speed up ColumnVector's getDecimal

[ https://issues.apache.org/jira/browse/SPARK-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13790: Assignee: Apache Spark > Speed up ColumnVector's getDecimal >

[jira] [Commented] (SPARK-13790) Speed up ColumnVector's getDecimal

[ https://issues.apache.org/jira/browse/SPARK-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188451#comment-15188451 ] Apache Spark commented on SPARK-13790: -- User 'nongli' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13790) Speed up ColumnVector's getDecimal

[ https://issues.apache.org/jira/browse/SPARK-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13790: Assignee: (was: Apache Spark) > Speed up ColumnVector's getDecimal >

[jira] [Commented] (SPARK-12555) Datasets: data is corrupted when input data is reordered

[ https://issues.apache.org/jira/browse/SPARK-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188447#comment-15188447 ] Luciano Resende commented on SPARK-12555: - This issue is still reproducible in Spark 1.6.x but

[jira] [Created] (SPARK-13790) Speed up ColumnVector's getDecimal

Nong Li created SPARK-13790: --- Summary: Speed up ColumnVector's getDecimal Key: SPARK-13790 URL: https://issues.apache.org/jira/browse/SPARK-13790 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12555) Datasets: data is corrupted when input data is reordered

[ https://issues.apache.org/jira/browse/SPARK-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12555: Assignee: (was: Apache Spark) > Datasets: data is corrupted when input data is

[jira] [Commented] (SPARK-12555) Datasets: data is corrupted when input data is reordered

[ https://issues.apache.org/jira/browse/SPARK-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188438#comment-15188438 ] Apache Spark commented on SPARK-12555: -- User 'lresende' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12555) Datasets: data is corrupted when input data is reordered

[ https://issues.apache.org/jira/browse/SPARK-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12555: Assignee: Apache Spark > Datasets: data is corrupted when input data is reordered >

[jira] [Assigned] (SPARK-13787) Feature importances for decision trees in Python

[ https://issues.apache.org/jira/browse/SPARK-13787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13787: Assignee: (was: Apache Spark) > Feature importances for decision trees in Python >

[jira] [Commented] (SPARK-13787) Feature importances for decision trees in Python

[ https://issues.apache.org/jira/browse/SPARK-13787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188414#comment-15188414 ] Apache Spark commented on SPARK-13787: -- User 'sethah' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13787) Feature importances for decision trees in Python

[ https://issues.apache.org/jira/browse/SPARK-13787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13787: Assignee: Apache Spark > Feature importances for decision trees in Python >

[jira] [Commented] (SPARK-13311) prettyString of IN is not good

[ https://issues.apache.org/jira/browse/SPARK-13311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188412#comment-15188412 ] Apache Spark commented on SPARK-13311: -- User 'davies' has created a pull request for this issue:

[jira] [Updated] (SPARK-13125) makes the ratio of KafkaRDD partition to kafka topic partition configurable.

[ https://issues.apache.org/jira/browse/SPARK-13125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengcanbin updated SPARK-13125: Attachment: 13134.patch > makes the ratio of KafkaRDD partition to kafka topic partition

[jira] [Updated] (SPARK-13134) add 'spark.streaming.kafka.partition.multiplier' into SparkConf

[ https://issues.apache.org/jira/browse/SPARK-13134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengcanbin updated SPARK-13134: Attachment: 13134.patch > add 'spark.streaming.kafka.partition.multiplier' into SparkConf >

[jira] [Commented] (SPARK-13783) Model export/import for spark.ml: GBTs

[ https://issues.apache.org/jira/browse/SPARK-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188358#comment-15188358 ] yuhao yang commented on SPARK-13783: I'm interested. > Model export/import for spark.ml: GBTs >

[jira] [Assigned] (SPARK-13430) Expose ml summary function in PySpark for classification and regression models

[ https://issues.apache.org/jira/browse/SPARK-13430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13430: Assignee: Apache Spark > Expose ml summary function in PySpark for classification and

[jira] [Commented] (SPARK-13430) Expose ml summary function in PySpark for classification and regression models

[ https://issues.apache.org/jira/browse/SPARK-13430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188336#comment-15188336 ] Apache Spark commented on SPARK-13430: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-13430) Expose ml summary function in PySpark for classification and regression models

[ https://issues.apache.org/jira/browse/SPARK-13430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13430: Assignee: (was: Apache Spark) > Expose ml summary function in PySpark for

[jira] [Assigned] (SPARK-13761) Deprecate validateParams

[ https://issues.apache.org/jira/browse/SPARK-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13761: Assignee: Apache Spark > Deprecate validateParams > > >

[jira] [Assigned] (SPARK-13761) Deprecate validateParams

[ https://issues.apache.org/jira/browse/SPARK-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13761: Assignee: (was: Apache Spark) > Deprecate validateParams > >

[jira] [Commented] (SPARK-13761) Deprecate validateParams

[ https://issues.apache.org/jira/browse/SPARK-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188329#comment-15188329 ] Apache Spark commented on SPARK-13761: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Commented] (SPARK-13068) Extend pyspark ml paramtype conversion to support lists

[ https://issues.apache.org/jira/browse/SPARK-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188319#comment-15188319 ] Joseph K. Bradley commented on SPARK-13068: --- You're right that the current implementation would

[jira] [Assigned] (SPARK-13789) Infer additional constraints from attribute equality

[ https://issues.apache.org/jira/browse/SPARK-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13789: Assignee: (was: Apache Spark) > Infer additional constraints from attribute equality

[jira] [Commented] (SPARK-13789) Infer additional constraints from attribute equality

[ https://issues.apache.org/jira/browse/SPARK-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188307#comment-15188307 ] Apache Spark commented on SPARK-13789: -- User 'sameeragarwal' has created a pull request for this

  1   2   3   >