[jira] [Updated] (SPARK-14285) Improve user experience for typed aggregate functions in Scala

[ https://issues.apache.org/jira/browse/SPARK-14285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14285: Summary: Improve user experience for typed aggregate functions in Scala (was: Improve user

[jira] [Resolved] (SPARK-14285) Improve user experience for typed aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-14285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14285. - Resolution: Fixed Fix Version/s: 2.0.0 > Improve user experience for typed aggregate

[jira] [Resolved] (SPARK-14251) Add SQL command for printing out generated code for debugging

[ https://issues.apache.org/jira/browse/SPARK-14251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14251. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0 > Add SQL command

[jira] [Resolved] (SPARK-14138) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

[ https://issues.apache.org/jira/browse/SPARK-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14138. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12108

[jira] [Resolved] (SPARK-14244) Physical Window operator uses global SizeBasedWindowFunction.n attribute generated on both driver and executor side

[ https://issues.apache.org/jira/browse/SPARK-14244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14244. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12040

[jira] [Commented] (SPARK-14245) webUI should display the user

[ https://issues.apache.org/jira/browse/SPARK-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222713#comment-15222713 ] Dongjoon Hyun commented on SPARK-14245: --- I see. Thank you! > webUI should display the user >

[jira] [Commented] (SPARK-13992) Add support for off-heap caching

[ https://issues.apache.org/jira/browse/SPARK-13992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222706#comment-15222706 ] Apache Spark commented on SPARK-13992: -- User 'lw-lin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-14308) Remove unused mllib tree classes and move private classes to ML

[ https://issues.apache.org/jira/browse/SPARK-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14308. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12097

[jira] [Commented] (SPARK-14245) webUI should display the user

[ https://issues.apache.org/jira/browse/SPARK-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222702#comment-15222702 ] Alex Bozarth commented on SPARK-14245: -- I don't know what you mean by "real" application submitter.

[jira] [Commented] (SPARK-14245) webUI should display the user

[ https://issues.apache.org/jira/browse/SPARK-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222697#comment-15222697 ] Dongjoon Hyun commented on SPARK-14245: --- Hi, [~ajbozarth]. I'm just curious. Does your PR show the

[jira] [Updated] (SPARK-14338) Improve `SimplifyConditionals` rule to handle `null` in IF/CASEWHEN

[ https://issues.apache.org/jira/browse/SPARK-14338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-14338: -- Description: Currently, `SimplifyConditionals` handles `true` and `false` to optimize

[jira] [Assigned] (SPARK-14341) Throw exception on unsupported Create/Drop Macro DDL commands

[ https://issues.apache.org/jira/browse/SPARK-14341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14341: Assignee: Apache Spark > Throw exception on unsupported Create/Drop Macro DDL commands >

[jira] [Commented] (SPARK-14341) Throw exception on unsupported Create/Drop Macro DDL commands

[ https://issues.apache.org/jira/browse/SPARK-14341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222688#comment-15222688 ] Apache Spark commented on SPARK-14341: -- User 'bomeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14341) Throw exception on unsupported Create/Drop Macro DDL commands

[ https://issues.apache.org/jira/browse/SPARK-14341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14341: Assignee: (was: Apache Spark) > Throw exception on unsupported Create/Drop Macro DDL

[jira] [Created] (SPARK-14341) Throw exception on unsupported Create/Drop Macro DDL commands

Bo Meng created SPARK-14341: --- Summary: Throw exception on unsupported Create/Drop Macro DDL commands Key: SPARK-14341 URL: https://issues.apache.org/jira/browse/SPARK-14341 Project: Spark Issue

[jira] [Updated] (SPARK-14338) Improve `SimplifyConditionals` rule to handle `null` in IF/CASEWHEN

[ https://issues.apache.org/jira/browse/SPARK-14338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-14338: -- Description: Currently, `SimplifyConditionals` handles `true` and `false` to optimize

[jira] [Commented] (SPARK-14340) Add Scala Example and Description for ml.BisectingKMeans

[ https://issues.apache.org/jira/browse/SPARK-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222670#comment-15222670 ] Apache Spark commented on SPARK-14340: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-14340) Add Scala Example and Description for ml.BisectingKMeans

[ https://issues.apache.org/jira/browse/SPARK-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14340: Assignee: (was: Apache Spark) > Add Scala Example and Description for

[jira] [Created] (SPARK-14340) Add Scala Example and Description for ml.BisectingKMeans

zhengruifeng created SPARK-14340: Summary: Add Scala Example and Description for ml.BisectingKMeans Key: SPARK-14340 URL: https://issues.apache.org/jira/browse/SPARK-14340 Project: Spark

[jira] [Assigned] (SPARK-14340) Add Scala Example and Description for ml.BisectingKMeans

[ https://issues.apache.org/jira/browse/SPARK-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14340: Assignee: Apache Spark > Add Scala Example and Description for ml.BisectingKMeans >

[jira] [Commented] (SPARK-14339) Add python examples for DCT,MinMaxScaler,MaxAbsScaler

[ https://issues.apache.org/jira/browse/SPARK-14339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222669#comment-15222669 ] Apache Spark commented on SPARK-14339: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-14339) Add python examples for DCT,MinMaxScaler,MaxAbsScaler

[ https://issues.apache.org/jira/browse/SPARK-14339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14339: Assignee: (was: Apache Spark) > Add python examples for DCT,MinMaxScaler,MaxAbsScaler

[jira] [Assigned] (SPARK-14339) Add python examples for DCT,MinMaxScaler,MaxAbsScaler

[ https://issues.apache.org/jira/browse/SPARK-14339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14339: Assignee: Apache Spark > Add python examples for DCT,MinMaxScaler,MaxAbsScaler >

[jira] [Created] (SPARK-14339) Add python examples for DCT,MinMaxScaler,MaxAbsScaler

zhengruifeng created SPARK-14339: Summary: Add python examples for DCT,MinMaxScaler,MaxAbsScaler Key: SPARK-14339 URL: https://issues.apache.org/jira/browse/SPARK-14339 Project: Spark Issue

[jira] [Commented] (SPARK-7861) Python wrapper for OneVsRest

[ https://issues.apache.org/jira/browse/SPARK-7861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222667#comment-15222667 ] Apache Spark commented on SPARK-7861: - User 'yinxusen' has created a pull request for this issue:

[jira] [Updated] (SPARK-14338) Improve `SimplifyConditionals` rule to handle `null` in IF/CASEWHEN

[ https://issues.apache.org/jira/browse/SPARK-14338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-14338: -- Description: Currently, `SimplifyConditionals` handles `true` and `false` to optimize

[jira] [Comment Edited] (SPARK-14302) Python examples code merge and clean up

[ https://issues.apache.org/jira/browse/SPARK-14302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222649#comment-15222649 ] Saikat Kanjilal edited comment on SPARK-14302 at 4/2/16 2:09 AM: - next

[jira] [Commented] (SPARK-14123) Function related commands

[ https://issues.apache.org/jira/browse/SPARK-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222650#comment-15222650 ] Apache Spark commented on SPARK-14123: -- User 'yhuai' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-14302) Python examples code merge and clean up

[ https://issues.apache.org/jira/browse/SPARK-14302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222649#comment-15222649 ] Saikat Kanjilal edited comment on SPARK-14302 at 4/2/16 2:04 AM: - next

[jira] [Commented] (SPARK-14302) Python examples code merge and clean up

[ https://issues.apache.org/jira/browse/SPARK-14302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222649#comment-15222649 ] Saikat Kanjilal commented on SPARK-14302: - next question, which of the directories should contain

[jira] [Commented] (SPARK-14083) Analyze JVM bytecode and turn closures into Catalyst expressions

[ https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222648#comment-15222648 ] Liang-Chi Hsieh commented on SPARK-14083: - I think this optimization now just consider the

[jira] [Commented] (SPARK-14083) Analyze JVM bytecode and turn closures into Catalyst expressions

[ https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222634#comment-15222634 ] Kazuaki Ishizaki commented on SPARK-14083: -- Good point. On the other hand, should we follow JVM

[jira] [Resolved] (SPARK-7425) spark.ml Predictor should support other numeric types for label

[ https://issues.apache.org/jira/browse/SPARK-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7425. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10355

[jira] [Commented] (SPARK-14125) View related commands

[ https://issues.apache.org/jira/browse/SPARK-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222615#comment-15222615 ] Xiao Li commented on SPARK-14125: - My changes on `Alter View` has to be based on `Alter Table`. Waiting

[jira] [Commented] (SPARK-14083) Analyze JVM bytecode and turn closures into Catalyst expressions

[ https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222611#comment-15222611 ] Josh Rosen commented on SPARK-14083: Null-handling is going to present a major design challenge here.

[jira] [Assigned] (SPARK-14245) webUI should display the user

[ https://issues.apache.org/jira/browse/SPARK-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14245: Assignee: (was: Apache Spark) > webUI should display the user >

[jira] [Commented] (SPARK-14245) webUI should display the user

[ https://issues.apache.org/jira/browse/SPARK-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222560#comment-15222560 ] Apache Spark commented on SPARK-14245: -- User 'ajbozarth' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14245) webUI should display the user

[ https://issues.apache.org/jira/browse/SPARK-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14245: Assignee: Apache Spark > webUI should display the user > - >

[jira] [Commented] (SPARK-14338) Improve `SimplifyConditionals` rule to handle `null` in IF/CASEWHEN

[ https://issues.apache.org/jira/browse/SPARK-14338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222553#comment-15222553 ] Apache Spark commented on SPARK-14338: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-14338) Improve `SimplifyConditionals` rule to handle `null` in IF/CASEWHEN

[ https://issues.apache.org/jira/browse/SPARK-14338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14338: Assignee: (was: Apache Spark) > Improve `SimplifyConditionals` rule to handle `null`

[jira] [Updated] (SPARK-14337) Push down casts beneath CaseWhen and If expressions

[ https://issues.apache.org/jira/browse/SPARK-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14337: --- Component/s: Optimizer > Push down casts beneath CaseWhen and If expressions >

[jira] [Assigned] (SPARK-14338) Improve `SimplifyConditionals` rule to handle `null` in IF/CASEWHEN

[ https://issues.apache.org/jira/browse/SPARK-14338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14338: Assignee: Apache Spark > Improve `SimplifyConditionals` rule to handle `null` in

[jira] [Created] (SPARK-14338) Improve `SimplifyConditionals` rule to handle `null` in IF/CASEWHEN

Dongjoon Hyun created SPARK-14338: - Summary: Improve `SimplifyConditionals` rule to handle `null` in IF/CASEWHEN Key: SPARK-14338 URL: https://issues.apache.org/jira/browse/SPARK-14338 Project: Spark

[jira] [Closed] (SPARK-13246) Avro 1.7.7 Schema.parse race condition hangs task

[ https://issues.apache.org/jira/browse/SPARK-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] koert kuipers closed SPARK-13246. - Resolution: Workaround Workaround is build spark with hadoop included (not provided). > Avro

[jira] [Commented] (SPARK-14129) [Table related commands] Alter table

[ https://issues.apache.org/jira/browse/SPARK-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222524#comment-15222524 ] Apache Spark commented on SPARK-14129: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14337) Push down casts beneath CaseWhen and If expressions

[ https://issues.apache.org/jira/browse/SPARK-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14337: Assignee: Apache Spark (was: Josh Rosen) > Push down casts beneath CaseWhen and If

[jira] [Assigned] (SPARK-14337) Push down casts beneath CaseWhen and If expressions

[ https://issues.apache.org/jira/browse/SPARK-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14337: Assignee: Josh Rosen (was: Apache Spark) > Push down casts beneath CaseWhen and If

[jira] [Commented] (SPARK-14337) Push down casts beneath CaseWhen and If expressions

[ https://issues.apache.org/jira/browse/SPARK-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222518#comment-15222518 ] Apache Spark commented on SPARK-14337: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Resolved] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

[ https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13241. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11326

[jira] [Updated] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

[ https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13241: -- Assignee: Alex Bozarth > add long--formatted timestamps to >

[jira] [Updated] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

[ https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13241: -- Priority: Minor (was: Major) > add long--formatted timestamps to >

[jira] [Created] (SPARK-14337) Push down casts beneath CaseWhen and If expressions

Josh Rosen created SPARK-14337: -- Summary: Push down casts beneath CaseWhen and If expressions Key: SPARK-14337 URL: https://issues.apache.org/jira/browse/SPARK-14337 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14288) Memory Sink

[ https://issues.apache.org/jira/browse/SPARK-14288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222498#comment-15222498 ] Apache Spark commented on SPARK-14288: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14288) Memory Sink

[ https://issues.apache.org/jira/browse/SPARK-14288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14288: Assignee: Michael Armbrust (was: Apache Spark) > Memory Sink > --- > >

[jira] [Assigned] (SPARK-14288) Memory Sink

[ https://issues.apache.org/jira/browse/SPARK-14288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14288: Assignee: Apache Spark (was: Michael Armbrust) > Memory Sink > --- > >

[jira] [Commented] (SPARK-12436) If all values of a JSON field is null, JSON's inferSchema should return NullType instead of StringType

[ https://issues.apache.org/jira/browse/SPARK-12436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222496#comment-15222496 ] Reynold Xin commented on SPARK-12436: - OK got it. One thing is that while type inference is great for

[jira] [Updated] (SPARK-13825) Upgrade to Scala 2.11.8

[ https://issues.apache.org/jira/browse/SPARK-13825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13825: -- Assignee: Jacek Laskowski > Upgrade to Scala 2.11.8 > --- > > Key:

[jira] [Resolved] (SPARK-12857) Streaming tab in web UI uses records and events interchangeably

[ https://issues.apache.org/jira/browse/SPARK-12857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12857. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12032

[jira] [Updated] (SPARK-12857) Streaming tab in web UI uses records and events interchangeably

[ https://issues.apache.org/jira/browse/SPARK-12857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12857: -- Assignee: Liwei Lin > Streaming tab in web UI uses records and events interchangeably >

[jira] [Resolved] (SPARK-13825) Upgrade to Scala 2.11.8

[ https://issues.apache.org/jira/browse/SPARK-13825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13825. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11681

[jira] [Resolved] (SPARK-14255) Streaming Aggregation

[ https://issues.apache.org/jira/browse/SPARK-14255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14255. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12048

[jira] [Commented] (SPARK-13784) Model export/import for spark.ml: RandomForests

[ https://issues.apache.org/jira/browse/SPARK-13784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222427#comment-15222427 ] Apache Spark commented on SPARK-13784: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222412#comment-15222412 ] Miles Crawford commented on SPARK-14209: Yes. I'm still committed to helping you - was just

[jira] [Resolved] (SPARK-14316) StateStoreCoordinator should extend ThreadSafeRpcEndpoint

[ https://issues.apache.org/jira/browse/SPARK-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-14316. -- Resolution: Fixed Fix Version/s: 2.0.0 > StateStoreCoordinator should extend

[jira] [Commented] (SPARK-14249) Change MLReader.read to be a property for PySpark

[ https://issues.apache.org/jira/browse/SPARK-14249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222402#comment-15222402 ] Miao Wang commented on SPARK-14249: --- [~josephkb]: I did a research and tested adding the classproperty

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222401#comment-15222401 ] Marcelo Vanzin commented on SPARK-14209: So, I don't know what to say. Your log configuration is

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222396#comment-15222396 ] Miles Crawford commented on SPARK-14209: yes, we definitely use logback - if you look at the top

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222393#comment-15222393 ] Marcelo Vanzin commented on SPARK-14209: bq. All we're doing in terms of logging is placing a

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222389#comment-15222389 ] Miles Crawford commented on SPARK-14209: Can you be a bit more specific about the default log

[jira] [Assigned] (SPARK-12569) DecisionTreeRegressor: provide variance of prediction: Python API

[ https://issues.apache.org/jira/browse/SPARK-12569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12569: Assignee: Apache Spark > DecisionTreeRegressor: provide variance of prediction: Python

[jira] [Commented] (SPARK-12569) DecisionTreeRegressor: provide variance of prediction: Python API

[ https://issues.apache.org/jira/browse/SPARK-12569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222386#comment-15222386 ] Apache Spark commented on SPARK-12569: -- User 'wangmiao1981' has created a pull request for this

[jira] [Assigned] (SPARK-12569) DecisionTreeRegressor: provide variance of prediction: Python API

[ https://issues.apache.org/jira/browse/SPARK-12569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12569: Assignee: (was: Apache Spark) > DecisionTreeRegressor: provide variance of

[jira] [Created] (SPARK-14336) Add more unit tests for buffer release in off-heap-caching codepaths

Josh Rosen created SPARK-14336: -- Summary: Add more unit tests for buffer release in off-heap-caching codepaths Key: SPARK-14336 URL: https://issues.apache.org/jira/browse/SPARK-14336 Project: Spark

[jira] [Resolved] (SPARK-13992) Add support for off-heap caching

[ https://issues.apache.org/jira/browse/SPARK-13992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-13992. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11805

[jira] [Commented] (SPARK-13845) BlockStatus and StreamBlockId keep on growing result driver OOM

[ https://issues.apache.org/jira/browse/SPARK-13845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222370#comment-15222370 ] Andrew Or commented on SPARK-13845: --- Thanks josh > BlockStatus and StreamBlockId keep on growing

[jira] [Closed] (SPARK-14100) Merge StringIndexer and StringIndexerModel

[ https://issues.apache.org/jira/browse/SPARK-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-14100. - Resolution: Not A Problem > Merge StringIndexer and StringIndexerModel >

[jira] [Closed] (SPARK-14033) Merging Estimator & Model

[ https://issues.apache.org/jira/browse/SPARK-14033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-14033. - Resolution: Not A Problem Target Version/s: (was: 2.0.0) > Merging Estimator

[jira] [Commented] (SPARK-14033) Merging Estimator & Model

[ https://issues.apache.org/jira/browse/SPARK-14033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222364#comment-15222364 ] Joseph K. Bradley commented on SPARK-14033: --- I discussed this with [~mengxr] and [~matei], and

[jira] [Resolved] (SPARK-12864) Fetch failure from AM restart

[ https://issues.apache.org/jira/browse/SPARK-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-12864. --- Resolution: Fixed Fix Version/s: 2.0.0 > Fetch failure from AM restart >

[jira] [Resolved] (SPARK-13845) BlockStatus and StreamBlockId keep on growing result driver OOM

[ https://issues.apache.org/jira/browse/SPARK-13845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-13845. Resolution: Fixed Fix Version/s: 1.6.2 Marking as fixed for 1.6.2 because [~andrewor14]

[jira] [Resolved] (SPARK-12181) Check Cached unaligned-access capability before using Unsafe

[ https://issues.apache.org/jira/browse/SPARK-12181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12181. Resolution: Fixed Assignee: Ted Yu Fix Version/s: 2.0.0 Marking as fixed for 2.0.0

[jira] [Updated] (SPARK-13674) Add wholestage codegen support to Sample

[ https://issues.apache.org/jira/browse/SPARK-13674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13674: --- Fix Version/s: (was: 2.1.0) 2.0.0 > Add wholestage codegen support to Sample

[jira] [Updated] (SPARK-13674) Add wholestage codegen support to Sample

[ https://issues.apache.org/jira/browse/SPARK-13674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13674: --- Assignee: Liang-Chi Hsieh > Add wholestage codegen support to Sample >

[jira] [Resolved] (SPARK-13674) Add wholestage codegen support to Sample

[ https://issues.apache.org/jira/browse/SPARK-13674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13674. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 11517

[jira] [Assigned] (SPARK-12384) Allow -Xms to be set differently then -Xmx

[ https://issues.apache.org/jira/browse/SPARK-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12384: Assignee: Dhruve Ashar (was: Apache Spark) > Allow -Xms to be set differently then -Xmx

[jira] [Commented] (SPARK-12384) Allow -Xms to be set differently then -Xmx

[ https://issues.apache.org/jira/browse/SPARK-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222327#comment-15222327 ] Apache Spark commented on SPARK-12384: -- User 'dhruve' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12384) Allow -Xms to be set differently then -Xmx

[ https://issues.apache.org/jira/browse/SPARK-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12384: Assignee: Apache Spark (was: Dhruve Ashar) > Allow -Xms to be set differently then -Xmx

[jira] [Updated] (SPARK-13352) BlockFetch does not scale well on large block

[ https://issues.apache.org/jira/browse/SPARK-13352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13352: Priority: Critical (was: Major) > BlockFetch does not scale well on large block >

[jira] [Assigned] (SPARK-14334) Add toLocalIterator for Dataset

[ https://issues.apache.org/jira/browse/SPARK-14334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14334: Assignee: Apache Spark (was: Davies Liu) > Add toLocalIterator for Dataset >

[jira] [Assigned] (SPARK-14334) Add toLocalIterator for Dataset

[ https://issues.apache.org/jira/browse/SPARK-14334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14334: Assignee: Davies Liu (was: Apache Spark) > Add toLocalIterator for Dataset >

[jira] [Commented] (SPARK-14334) Add toLocalIterator for Dataset

[ https://issues.apache.org/jira/browse/SPARK-14334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222318#comment-15222318 ] Apache Spark commented on SPARK-14334: -- User 'davies' has created a pull request for this issue:

[jira] [Created] (SPARK-14335) Describe function command returns wrong output because some of built-in functions are not in function registry.

Yin Huai created SPARK-14335: Summary: Describe function command returns wrong output because some of built-in functions are not in function registry. Key: SPARK-14335 URL:

[jira] [Created] (SPARK-14334) Add toLocalIterator for Dataset

Davies Liu created SPARK-14334: -- Summary: Add toLocalIterator for Dataset Key: SPARK-14334 URL: https://issues.apache.org/jira/browse/SPARK-14334 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-14160) Windowing for structured streaming

[ https://issues.apache.org/jira/browse/SPARK-14160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14160: - Assignee: Burak Yavuz > Windowing for structured streaming >

[jira] [Resolved] (SPARK-14160) Windowing for structured streaming

[ https://issues.apache.org/jira/browse/SPARK-14160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14160. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12008

[jira] [Resolved] (SPARK-14070) Use ORC data source for SQL queries on ORC tables

[ https://issues.apache.org/jira/browse/SPARK-14070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14070. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11891

[jira] [Resolved] (SPARK-14191) Fix Expand operator constraints

[ https://issues.apache.org/jira/browse/SPARK-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14191. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11995

[jira] [Resolved] (SPARK-13995) Extract correct IsNotNull constraints for Expression

[ https://issues.apache.org/jira/browse/SPARK-13995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13995. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11809

[jira] [Updated] (SPARK-14305) PySpark ml.clustering BisectingKMeans support export/import

[ https://issues.apache.org/jira/browse/SPARK-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-14305: -- Assignee: Yanbo Liang > PySpark ml.clustering BisectingKMeans support export/import >

[jira] [Resolved] (SPARK-14305) PySpark ml.clustering BisectingKMeans support export/import

[ https://issues.apache.org/jira/browse/SPARK-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-14305. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12112

  1   2   >