[jira] [Resolved] (SPARK-3947) Support UDAF

[ https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3947. Resolution: Fixed Fix Version/s: 1.5.0 Support UDAF Key:

[jira] [Resolved] (SPARK-3056) Sort-based Aggregation

[ https://issues.apache.org/jira/browse/SPARK-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3056. Resolution: Fixed Assignee: Yin Huai Fix Version/s: 1.5.0 Sort-based Aggregation

[jira] [Updated] (SPARK-8838) Add config to enable/disable merging part-files when merging parquet schema

[ https://issues.apache.org/jira/browse/SPARK-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8838: -- Assignee: Liang-Chi Hsieh Add config to enable/disable merging part-files when merging parquet schema

[jira] [Updated] (SPARK-8756) Keep cached information and avoid re-calculating footers in ParquetRelation2

[ https://issues.apache.org/jira/browse/SPARK-8756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8756: -- Assignee: Liang-Chi Hsieh Keep cached information and avoid re-calculating footers in ParquetRelation2

[jira] [Commented] (SPARK-9250) ./dev/change-scala-version.sh should offer guidance what versions are accepted, i.e. 2.10 or 2.11

[ https://issues.apache.org/jira/browse/SPARK-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636628#comment-14636628 ] François Garillot commented on SPARK-9250: -- This

[jira] [Commented] (SPARK-9250) ./dev/change-scala-version.sh should offer guidance what versions are accepted, i.e. 2.10 or 2.11

[ https://issues.apache.org/jira/browse/SPARK-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636656#comment-14636656 ] Apache Spark commented on SPARK-9250: - User 'huitseeker' has created a pull request

[jira] [Assigned] (SPARK-9250) ./dev/change-scala-version.sh should offer guidance what versions are accepted, i.e. 2.10 or 2.11

[ https://issues.apache.org/jira/browse/SPARK-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9250: --- Assignee: (was: Apache Spark) ./dev/change-scala-version.sh should offer guidance what

[jira] [Commented] (SPARK-6777) Implement backwards-compatibility rules in Parquet schema converters

[ https://issues.apache.org/jira/browse/SPARK-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636689#comment-14636689 ] Cheng Lian commented on SPARK-6777: --- Will pay attention to this in the future. Thanks

[jira] [Issue Comment Deleted] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9182: -- Comment: was deleted (was: I'm looking into this.) filter and groupBy on DataFrames are not passed

[jira] [Commented] (SPARK-9249) local variable assigned but may not be used

[ https://issues.apache.org/jira/browse/SPARK-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636579#comment-14636579 ] Chanchal Singh commented on SPARK-9249: --- can u just explain what exactly need to be

[jira] [Created] (SPARK-9252) Spark client application must be restarted if the cluster (yarn) gets restarted

Sarto Mihai created SPARK-9252: -- Summary: Spark client application must be restarted if the cluster (yarn) gets restarted Key: SPARK-9252 URL: https://issues.apache.org/jira/browse/SPARK-9252 Project:

[jira] [Commented] (SPARK-8999) Support non-temporal sequence in PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636625#comment-14636625 ] Apache Spark commented on SPARK-8999: - User 'zhangjiajin' has created a pull request

[jira] [Assigned] (SPARK-8999) Support non-temporal sequence in PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8999: --- Assignee: (was: Apache Spark) Support non-temporal sequence in PrefixSpan

[jira] [Assigned] (SPARK-9250) ./dev/change-scala-version.sh should offer guidance what versions are accepted, i.e. 2.10 or 2.11

[ https://issues.apache.org/jira/browse/SPARK-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9250: --- Assignee: Apache Spark ./dev/change-scala-version.sh should offer guidance what versions

[jira] [Commented] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636688#comment-14636688 ] Cheng Lian commented on SPARK-9182: --- I'm looking into this. filter and groupBy on

[jira] [Commented] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636686#comment-14636686 ] Cheng Lian commented on SPARK-9182: --- I'm looking into this. filter and groupBy on

[jira] [Commented] (SPARK-9236) Left Outer Join with empty JavaPairRDD returns empty RDD

[ https://issues.apache.org/jira/browse/SPARK-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636752#comment-14636752 ] François Garillot commented on SPARK-9236: -- I have added two tests as the last

[jira] [Updated] (SPARK-8838) Add config to enable/disable merging part-files when merging parquet schema

[ https://issues.apache.org/jira/browse/SPARK-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8838: -- Shepherd: Cheng Lian (was: liancheng) Add config to enable/disable merging part-files when merging

[jira] [Assigned] (SPARK-8999) Support non-temporal sequence in PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8999: --- Assignee: Apache Spark Support non-temporal sequence in PrefixSpan

[jira] [Comment Edited] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636919#comment-14636919 ] Earthson Lu edited comment on SPARK-8332 at 7/22/15 1:40 PM: -

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636919#comment-14636919 ] Earthson Lu commented on SPARK-8332: I recompiled spark with fasterxml.jackson 2.5.3,

[jira] [Commented] (SPARK-9236) Left Outer Join with empty JavaPairRDD returns empty RDD

[ https://issues.apache.org/jira/browse/SPARK-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636926#comment-14636926 ] Vitalii Slobodianyk commented on SPARK-9236: Sure, I created a repo

[jira] [Commented] (SPARK-4366) Aggregation Improvement

[ https://issues.apache.org/jira/browse/SPARK-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636387#comment-14636387 ] Apache Spark commented on SPARK-4366: - User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-9131) UDFs change data values

[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636498#comment-14636498 ] Reynold Xin commented on SPARK-9131: Would it be possible to upload it to s3 or

[jira] [Commented] (SPARK-9236) Left Outer Join with empty JavaPairRDD returns empty RDD

[ https://issues.apache.org/jira/browse/SPARK-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636872#comment-14636872 ] François Garillot commented on SPARK-9236: -- Note that of my two added tests, one

[jira] [Comment Edited] (SPARK-9236) Left Outer Join with empty JavaPairRDD returns empty RDD

[ https://issues.apache.org/jira/browse/SPARK-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636872#comment-14636872 ] François Garillot edited comment on SPARK-9236 at 7/22/15 12:58 PM:

[jira] [Commented] (SPARK-9002) KryoSerializer initialization does not include 'Array[Int]'

[ https://issues.apache.org/jira/browse/SPARK-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636832#comment-14636832 ] Benjamin Fradet commented on SPARK-9002: [~rake] are you planning on opening a PR?

[jira] [Assigned] (SPARK-9263) Add Spark Submit flag to exclude dependencies when using --packages

[ https://issues.apache.org/jira/browse/SPARK-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9263: --- Assignee: (was: Apache Spark) Add Spark Submit flag to exclude dependencies when using

[jira] [Assigned] (SPARK-9263) Add Spark Submit flag to exclude dependencies when using --packages

[ https://issues.apache.org/jira/browse/SPARK-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9263: --- Assignee: Apache Spark Add Spark Submit flag to exclude dependencies when using --packages

[jira] [Commented] (SPARK-9263) Add Spark Submit flag to exclude dependencies when using --packages

[ https://issues.apache.org/jira/browse/SPARK-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637591#comment-14637591 ] Apache Spark commented on SPARK-9263: - User 'brkyvz' has created a pull request for

[jira] [Commented] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637600#comment-14637600 ] Sean Owen commented on SPARK-9255: -- This looks like the kind of problem you get when you

[jira] [Updated] (SPARK-9237) Added Top N Column Values for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9237: - Component/s: SQL I suppose my question is how commonly used this would be, to justify actually adding it

[jira] [Updated] (SPARK-9046) Decimal type support improvement and bug fix

[ https://issues.apache.org/jira/browse/SPARK-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9046: Summary: Decimal type support improvement and bug fix (was: Decimal type support improvement) Decimal

[jira] [Created] (SPARK-9264) When dealing with Union/Intersect/Except, we cast FloatType/DoubleType to the wrong DecimalType

Yin Huai created SPARK-9264: --- Summary: When dealing with Union/Intersect/Except, we cast FloatType/DoubleType to the wrong DecimalType Key: SPARK-9264 URL: https://issues.apache.org/jira/browse/SPARK-9264

[jira] [Assigned] (SPARK-9260) Standalone scheduling can overflow a worker with cores

[ https://issues.apache.org/jira/browse/SPARK-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9260: --- Assignee: Apache Spark (was: Nishkam Ravi) Standalone scheduling can overflow a worker

[jira] [Commented] (SPARK-9260) Standalone scheduling can overflow a worker with cores

[ https://issues.apache.org/jira/browse/SPARK-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637762#comment-14637762 ] Apache Spark commented on SPARK-9260: - User 'nishkamravi2' has created a pull request

[jira] [Resolved] (SPARK-9244) Increase some default memory limits

[ https://issues.apache.org/jira/browse/SPARK-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-9244. -- Resolution: Fixed Fix Version/s: 1.5.0 Increase some default memory limits

[jira] [Updated] (SPARK-9265) Dataframe.limit joined with another dataframe can be non-deterministic

[ https://issues.apache.org/jira/browse/SPARK-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9265: --- Assignee: (was: Reynold Xin) Dataframe.limit joined with another dataframe can be

[jira] [Commented] (SPARK-9237) Added Top N Column Values for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637871#comment-14637871 ] Ted Malaska commented on SPARK-9237: It is very common in banks, to do data quality

[jira] [Updated] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-9255: --- Description: This is a very strange case involving timestamp I can run the program on Windows using dev

[jira] [Comment Edited] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637336#comment-14637336 ] Paul Wu edited comment on SPARK-9255 at 7/22/15 6:52 PM: - The

[jira] [Updated] (SPARK-9260) Standalone scheduling can overflow a worker with cores

[ https://issues.apache.org/jira/browse/SPARK-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9260: - Attachment: Screen Shot 2015-07-22 at 12.06.21 PM.png Standalone scheduling can overflow a worker with

[jira] [Commented] (SPARK-6192) Enhance MLlib's Python API (GSoC 2015)

[ https://issues.apache.org/jira/browse/SPARK-6192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638078#comment-14638078 ] K S Sreenivasa Raghavan commented on SPARK-6192: I am interested in python

[jira] [Resolved] (SPARK-9144) Remove DAGScheduler.runLocallyWithinThread and spark.localExecution.enabled

[ https://issues.apache.org/jira/browse/SPARK-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9144. Resolution: Fixed Fix Version/s: 1.5.0 Remove DAGScheduler.runLocallyWithinThread and

[jira] [Updated] (SPARK-9144) Remove DAGScheduler.runLocallyWithinThread and spark.localExecution.enabled

[ https://issues.apache.org/jira/browse/SPARK-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9144: --- Labels: releasenotes (was: ) Remove DAGScheduler.runLocallyWithinThread and

[jira] [Commented] (SPARK-9192) add initialization phase for nondeterministic expression

[ https://issues.apache.org/jira/browse/SPARK-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638140#comment-14638140 ] Cheng Lian commented on SPARK-9192: --- Yeah, it makes sense. Thanks! add initialization

[jira] [Commented] (SPARK-9270) spark.app.name is not honored by spark-shell and pyspark

[ https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638185#comment-14638185 ] Sean Owen commented on SPARK-9270: -- Seems very related to, or almost a duplicate of

[jira] [Commented] (SPARK-9036) SparkListenerExecutorMetricsUpdate messages not included in JsonProtocol

[ https://issues.apache.org/jira/browse/SPARK-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638160#comment-14638160 ] Sean Owen commented on SPARK-9036: -- Precisely, in this case I figure credit, such as it

[jira] [Assigned] (SPARK-9069) Remove unlimited DecimalType

[ https://issues.apache.org/jira/browse/SPARK-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9069: --- Assignee: Apache Spark (was: Davies Liu) Remove unlimited DecimalType

[jira] [Commented] (SPARK-9069) Remove unlimited DecimalType

[ https://issues.apache.org/jira/browse/SPARK-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638165#comment-14638165 ] Apache Spark commented on SPARK-9069: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-9069) Remove unlimited DecimalType

[ https://issues.apache.org/jira/browse/SPARK-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9069: --- Assignee: Davies Liu (was: Apache Spark) Remove unlimited DecimalType

[jira] [Created] (SPARK-9271) Concurrency bug triggered by partition predicate push-down

Cheng Lian created SPARK-9271: - Summary: Concurrency bug triggered by partition predicate push-down Key: SPARK-9271 URL: https://issues.apache.org/jira/browse/SPARK-9271 Project: Spark Issue

[jira] [Assigned] (SPARK-8668) expr function to convert SQL expression into a Column

[ https://issues.apache.org/jira/browse/SPARK-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8668: --- Assignee: Apache Spark expr function to convert SQL expression into a Column

[jira] [Resolved] (SPARK-8364) Add crosstab to SparkR DataFrames

[ https://issues.apache.org/jira/browse/SPARK-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8364. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Assigned] (SPARK-9264) When dealing with Union/Intersect/Except, we cast FloatType/DoubleType to the wrong DecimalType

[ https://issues.apache.org/jira/browse/SPARK-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-9264: - Assignee: Davies Liu When dealing with Union/Intersect/Except, we cast FloatType/DoubleType to

[jira] [Assigned] (SPARK-8668) expr function to convert SQL expression into a Column

[ https://issues.apache.org/jira/browse/SPARK-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8668: --- Assignee: (was: Apache Spark) expr function to convert SQL expression into a Column

[jira] [Resolved] (SPARK-9262) Treat Scala compiler warnings as errors

[ https://issues.apache.org/jira/browse/SPARK-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9262. Resolution: Fixed Fix Version/s: 1.5.0 Treat Scala compiler warnings as errors

[jira] [Commented] (SPARK-8668) expr function to convert SQL expression into a Column

[ https://issues.apache.org/jira/browse/SPARK-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638126#comment-14638126 ] Apache Spark commented on SPARK-8668: - User 'JDrit' has created a pull request for

[jira] [Updated] (SPARK-9180) Accept --name option in spark-submit

[ https://issues.apache.org/jira/browse/SPARK-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9180: - Assignee: Kenichi Maehashi Accept --name option in spark-submit

[jira] [Created] (SPARK-9270) spark.app.name is not honored by spark-shell and pyspark

Cheolsoo Park created SPARK-9270: Summary: spark.app.name is not honored by spark-shell and pyspark Key: SPARK-9270 URL: https://issues.apache.org/jira/browse/SPARK-9270 Project: Spark Issue

[jira] [Commented] (SPARK-9270) spark.app.name is not honored by spark-shell and pyspark

[ https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638187#comment-14638187 ] Cheolsoo Park commented on SPARK-9270: -- Oh it is. I missed it. So spark-shell is

[jira] [Comment Edited] (SPARK-9270) spark.app.name is not honored by spark-shell and pyspark

[ https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638187#comment-14638187 ] Cheolsoo Park edited comment on SPARK-9270 at 7/23/15 5:43 AM:

[jira] [Updated] (SPARK-4234) Always do paritial aggregation

[ https://issues.apache.org/jira/browse/SPARK-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4234: - Assignee: Cheng Hao Always do paritial aggregation ---

[jira] [Commented] (SPARK-9036) SparkListenerExecutorMetricsUpdate messages not included in JsonProtocol

[ https://issues.apache.org/jira/browse/SPARK-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637768#comment-14637768 ] Ryan Williams commented on SPARK-9036: -- [~srowen] did you just assign this to me

[jira] [Created] (SPARK-9263) Add Spark Submit flag to exclude dependencies when using --packages

Burak Yavuz created SPARK-9263: -- Summary: Add Spark Submit flag to exclude dependencies when using --packages Key: SPARK-9263 URL: https://issues.apache.org/jira/browse/SPARK-9263 Project: Spark

[jira] [Commented] (SPARK-9252) Spark client application must be restarted if the cluster (yarn) gets restarted

[ https://issues.apache.org/jira/browse/SPARK-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637632#comment-14637632 ] Sean Owen commented on SPARK-9252: -- I think this is more of a question for user@ rather

[jira] [Assigned] (SPARK-8977) Define the RateEstimator interface, and implement the ReceiverRateController

[ https://issues.apache.org/jira/browse/SPARK-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8977: --- Assignee: Apache Spark Define the RateEstimator interface, and implement the

[jira] [Commented] (SPARK-8977) Define the RateEstimator interface, and implement the ReceiverRateController

[ https://issues.apache.org/jira/browse/SPARK-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637662#comment-14637662 ] Apache Spark commented on SPARK-8977: - User 'dragos' has created a pull request for

[jira] [Assigned] (SPARK-9261) StreamingTab calls public APIs in Spark core that expose shaded classes

[ https://issues.apache.org/jira/browse/SPARK-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9261: --- Assignee: Apache Spark StreamingTab calls public APIs in Spark core that expose shaded

[jira] [Commented] (SPARK-9261) StreamingTab calls public APIs in Spark core that expose shaded classes

[ https://issues.apache.org/jira/browse/SPARK-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637677#comment-14637677 ] Apache Spark commented on SPARK-9261: - User 'vanzin' has created a pull request for

[jira] [Updated] (SPARK-9265) Dataframe.limit joined with another dataframe can be non-deterministic

[ https://issues.apache.org/jira/browse/SPARK-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9265: - Description: {code} import org.apache.spark.sql._ import org.apache.spark.sql.functions._ val

[jira] [Created] (SPARK-9265) Dataframe.limit joined with another dataframe can be non-deterministic

Tathagata Das created SPARK-9265: Summary: Dataframe.limit joined with another dataframe can be non-deterministic Key: SPARK-9265 URL: https://issues.apache.org/jira/browse/SPARK-9265 Project: Spark

[jira] [Resolved] (SPARK-9227) Add option to set logging level in Spark Context Constructor

[ https://issues.apache.org/jira/browse/SPARK-9227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9227. -- Resolution: Won't Fix Add option to set logging level in Spark Context Constructor

[jira] [Updated] (SPARK-9196) DatetimeExpressionsSuite: function current_timestamp is flaky

[ https://issues.apache.org/jira/browse/SPARK-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9196: - Component/s: Tests SQL DatetimeExpressionsSuite: function current_timestamp is flaky

[jira] [Resolved] (SPARK-8536) Generalize LDA to asymmetric doc-topic priors

[ https://issues.apache.org/jira/browse/SPARK-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-8536. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7575

[jira] [Updated] (SPARK-9244) Increase some default memory limits

[ https://issues.apache.org/jira/browse/SPARK-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9244: - Priority: Minor (was: Major) Component/s: Spark Core Increase some default memory limits

[jira] [Updated] (SPARK-9203) Make filesystem pluggable in BlockStore and BlockManager

[ https://issues.apache.org/jira/browse/SPARK-9203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9203: - Component/s: Block Manager Make filesystem pluggable in BlockStore and BlockManager

[jira] [Assigned] (SPARK-9260) Standalone scheduling can overflow a worker with cores

[ https://issues.apache.org/jira/browse/SPARK-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9260: --- Assignee: Nishkam Ravi (was: Apache Spark) Standalone scheduling can overflow a worker

[jira] [Commented] (SPARK-9265) Dataframe.limit joined with another dataframe can be non-deterministic

[ https://issues.apache.org/jira/browse/SPARK-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637786#comment-14637786 ] Tathagata Das commented on SPARK-9265: -- cc [~andrewor14], who helped be generate this

[jira] [Commented] (SPARK-9244) Increase some default memory limits

[ https://issues.apache.org/jira/browse/SPARK-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637619#comment-14637619 ] Sean Owen commented on SPARK-9244: -- The default driver memory was similarly raised a

[jira] [Assigned] (SPARK-8977) Define the RateEstimator interface, and implement the ReceiverRateController

[ https://issues.apache.org/jira/browse/SPARK-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8977: --- Assignee: (was: Apache Spark) Define the RateEstimator interface, and implement the

[jira] [Assigned] (SPARK-9261) StreamingTab calls public APIs in Spark core that expose shaded classes

[ https://issues.apache.org/jira/browse/SPARK-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9261: --- Assignee: (was: Apache Spark) StreamingTab calls public APIs in Spark core that expose

[jira] [Updated] (SPARK-9206) ClassCastException using HiveContext with GoogleHadoopFileSystem as fs.defaultFS

[ https://issues.apache.org/jira/browse/SPARK-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9206: - Assignee: Dennis Huo ClassCastException using HiveContext with GoogleHadoopFileSystem as fs.defaultFS

[jira] [Updated] (SPARK-9081) fillna/dropna should also fill/drop NaN values in addition to null values

[ https://issues.apache.org/jira/browse/SPARK-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9081: - Assignee: Yijie Shen fillna/dropna should also fill/drop NaN values in addition to null values

[jira] [Updated] (SPARK-9204) Add default params test to linear regression

[ https://issues.apache.org/jira/browse/SPARK-9204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9204: - Assignee: holdenk Add default params test to linear regression

[jira] [Updated] (SPARK-9157) Implement code generation for Substring

[ https://issues.apache.org/jira/browse/SPARK-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9157: - Assignee: Tarek Auel Implement code generation for Substring ---

[jira] [Updated] (SPARK-9036) SparkListenerExecutorMetricsUpdate messages not included in JsonProtocol

[ https://issues.apache.org/jira/browse/SPARK-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9036: - Assignee: Ryan Williams SparkListenerExecutorMetricsUpdate messages not included in JsonProtocol

[jira] [Updated] (SPARK-9264) When dealing with Union/Intersect/Except, we cast FloatType/DoubleType to the wrong DecimalType

[ https://issues.apache.org/jira/browse/SPARK-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9264: Description: The problem is

[jira] [Created] (SPARK-9266) Prevent managed memory leak detected exception from masking original exception

Josh Rosen created SPARK-9266: - Summary: Prevent managed memory leak detected exception from masking original exception Key: SPARK-9266 URL: https://issues.apache.org/jira/browse/SPARK-9266 Project:

[jira] [Updated] (SPARK-9265) Dataframe.limit joined with another dataframe can be non-deterministic

[ https://issues.apache.org/jira/browse/SPARK-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9265: --- Priority: Critical (was: Major) Dataframe.limit joined with another dataframe can be

[jira] [Commented] (SPARK-9265) Dataframe.limit joined with another dataframe can be non-deterministic

[ https://issues.apache.org/jira/browse/SPARK-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637876#comment-14637876 ] Reynold Xin commented on SPARK-9265: Updating the title since it is not exactly a data

[jira] [Resolved] (SPARK-8975) Implement a mechanism to send a new rate from the driver to the block generator

[ https://issues.apache.org/jira/browse/SPARK-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-8975. -- Resolution: Fixed Fix Version/s: 1.5.0 Implement a mechanism to send a new rate from

[jira] [Commented] (SPARK-9266) Prevent managed memory leak detected exception from masking original exception

[ https://issues.apache.org/jira/browse/SPARK-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637893#comment-14637893 ] Apache Spark commented on SPARK-9266: - User 'JoshRosen' has created a pull request for

[jira] [Updated] (SPARK-9256) Message delay causes Master crash upon registering application

[ https://issues.apache.org/jira/browse/SPARK-9256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Scott updated SPARK-9256: --- Priority: Major (was: Minor) Message delay causes Master crash upon registering application

[jira] [Resolved] (SPARK-9223) Support model save/load in Python's LDA

[ https://issues.apache.org/jira/browse/SPARK-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9223. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7587

[jira] [Created] (SPARK-9268) Params.setDefault should not keep varargs annotation

Joseph K. Bradley created SPARK-9268: Summary: Params.setDefault should not keep varargs annotation Key: SPARK-9268 URL: https://issues.apache.org/jira/browse/SPARK-9268 Project: Spark

[jira] [Commented] (SPARK-9268) Params.setDefault should not keep varargs annotation

[ https://issues.apache.org/jira/browse/SPARK-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637973#comment-14637973 ] Apache Spark commented on SPARK-9268: - User 'jkbradley' has created a pull request for

[jira] [Assigned] (SPARK-9268) Params.setDefault should not keep varargs annotation

[ https://issues.apache.org/jira/browse/SPARK-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9268: --- Assignee: Apache Spark (was: Joseph K. Bradley) Params.setDefault should not keep varargs

[jira] [Assigned] (SPARK-9268) Params.setDefault should not keep varargs annotation

[ https://issues.apache.org/jira/browse/SPARK-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9268: --- Assignee: Joseph K. Bradley (was: Apache Spark) Params.setDefault should not keep varargs

[jira] [Resolved] (SPARK-8484) Add TrainValidationSplit to ml.tuning

[ https://issues.apache.org/jira/browse/SPARK-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8484. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7337

<    1   2   3   >