[jira] [Commented] (SPARK-22726) Basic tests for Binary Comparison and ImplicitTypeCasts

[ https://issues.apache.org/jira/browse/SPARK-22726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281478#comment-16281478 ] Apache Spark commented on SPARK-22726: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-22726) Basic tests for Binary Comparison and ImplicitTypeCasts

[ https://issues.apache.org/jira/browse/SPARK-22726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22726: Assignee: Xiao Li (was: Apache Spark) > Basic tests for Binary Comparison and ImplicitTyp

[jira] [Assigned] (SPARK-22726) Basic tests for Binary Comparison and ImplicitTypeCasts

[ https://issues.apache.org/jira/browse/SPARK-22726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22726: Assignee: Apache Spark (was: Xiao Li) > Basic tests for Binary Comparison and ImplicitTyp

[jira] [Created] (SPARK-22727) spark.executor.instances's default value should be 2

liuzhaokun created SPARK-22727: -- Summary: spark.executor.instances's default value should be 2 Key: SPARK-22727 URL: https://issues.apache.org/jira/browse/SPARK-22727 Project: Spark Issue Type

[jira] [Assigned] (SPARK-22727) spark.executor.instances's default value should be 2

[ https://issues.apache.org/jira/browse/SPARK-22727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22727: Assignee: Apache Spark > spark.executor.instances's default value should be 2 >

[jira] [Assigned] (SPARK-22727) spark.executor.instances's default value should be 2

[ https://issues.apache.org/jira/browse/SPARK-22727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22727: Assignee: (was: Apache Spark) > spark.executor.instances's default value should be 2

[jira] [Commented] (SPARK-22727) spark.executor.instances's default value should be 2

[ https://issues.apache.org/jira/browse/SPARK-22727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281534#comment-16281534 ] Apache Spark commented on SPARK-22727: -- User 'liu-zhaokun' has created a pull reques

[jira] [Updated] (SPARK-22126) Fix model-specific optimization support for ML tuning

[ https://issues.apache.org/jira/browse/SPARK-22126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-22126: --- Description: Fix model-specific optimization support for ML tuning. This is discussed in SPARK-19357

[jira] [Updated] (SPARK-22126) Fix model-specific optimization support for ML tuning

[ https://issues.apache.org/jira/browse/SPARK-22126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-22126: --- Description: Fix model-specific optimization support for ML tuning. This is discussed in SPARK-19357

[jira] [Resolved] (SPARK-22721) BytesToBytesMap peak memory usage not accurate after reset()

[ https://issues.apache.org/jira/browse/SPARK-22721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-22721. --- Resolution: Fixed Assignee: Juliusz Sompolski Fix Version/s: 2.3.0 >

[jira] [Created] (SPARK-22728) Unify artifact access for (mesos, standalone and yarn) when HDFS is available

Stavros Kontopoulos created SPARK-22728: --- Summary: Unify artifact access for (mesos, standalone and yarn) when HDFS is available Key: SPARK-22728 URL: https://issues.apache.org/jira/browse/SPARK-22728

[jira] [Commented] (SPARK-22728) Unify artifact access for (mesos, standalone and yarn) when HDFS is available

[ https://issues.apache.org/jira/browse/SPARK-22728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281771#comment-16281771 ] Stavros Kontopoulos commented on SPARK-22728: - [~arand][~susanxhuynh] FYI. >

[jira] [Resolved] (SPARK-22672) Refactor ORC Tests

[ https://issues.apache.org/jira/browse/SPARK-22672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22672. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19882 [https://githu

[jira] [Assigned] (SPARK-22672) Refactor ORC Tests

[ https://issues.apache.org/jira/browse/SPARK-22672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22672: --- Assignee: Dongjoon Hyun > Refactor ORC Tests > -- > > Key: S

[jira] [Resolved] (SPARK-22703) ColumnarRow should be an immutable view

[ https://issues.apache.org/jira/browse/SPARK-22703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22703. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19898 [https://githu

[jira] [Resolved] (SPARK-22705) Reduce # of mutable variables in Case, Coalesce, and In

[ https://issues.apache.org/jira/browse/SPARK-22705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22705. - Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.3.0 > Reduce # of m

[jira] [Created] (SPARK-22729) Add getTruncateQuery to JdbcDialect

Daniel van der Ende created SPARK-22729: --- Summary: Add getTruncateQuery to JdbcDialect Key: SPARK-22729 URL: https://issues.apache.org/jira/browse/SPARK-22729 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-22618) RDD.unpersist can cause fatal exception when used with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-22618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22618. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19836 [https://githu

[jira] [Assigned] (SPARK-22729) Add getTruncateQuery to JdbcDialect

[ https://issues.apache.org/jira/browse/SPARK-22729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22729: Assignee: Apache Spark > Add getTruncateQuery to JdbcDialect > ---

[jira] [Assigned] (SPARK-22729) Add getTruncateQuery to JdbcDialect

[ https://issues.apache.org/jira/browse/SPARK-22729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22729: Assignee: (was: Apache Spark) > Add getTruncateQuery to JdbcDialect >

[jira] [Commented] (SPARK-22729) Add getTruncateQuery to JdbcDialect

[ https://issues.apache.org/jira/browse/SPARK-22729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281819#comment-16281819 ] Apache Spark commented on SPARK-22729: -- User 'danielvdende' has created a pull reque

[jira] [Resolved] (SPARK-22712) Use `buildReaderWithPartitionValues` in native OrcFileFormat

[ https://issues.apache.org/jira/browse/SPARK-22712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22712. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19907 [https://githu

[jira] [Assigned] (SPARK-22712) Use `buildReaderWithPartitionValues` in native OrcFileFormat

[ https://issues.apache.org/jira/browse/SPARK-22712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22712: --- Assignee: Dongjoon Hyun > Use `buildReaderWithPartitionValues` in native OrcFileFormat > ---

[jira] [Assigned] (SPARK-22618) RDD.unpersist can cause fatal exception when used with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-22618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22618: --- Assignee: Brad > RDD.unpersist can cause fatal exception when used with dynamic allocation >

[jira] [Assigned] (SPARK-22699) Avoid the generation of useless mutable states by GenerateSafeProjection

[ https://issues.apache.org/jira/browse/SPARK-22699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22699: --- Assignee: Marco Gaido > Avoid the generation of useless mutable states by GenerateSafeProjec

[jira] [Resolved] (SPARK-22699) Avoid the generation of useless mutable states by GenerateSafeProjection

[ https://issues.apache.org/jira/browse/SPARK-22699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22699. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19914 [https://githu

[jira] [Resolved] (SPARK-22696) Avoid the generation of useless mutable states by objects functions

[ https://issues.apache.org/jira/browse/SPARK-22696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22696. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19908 [https://githu

[jira] [Assigned] (SPARK-22696) Avoid the generation of useless mutable states by objects functions

[ https://issues.apache.org/jira/browse/SPARK-22696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22696: --- Assignee: Marco Gaido > Avoid the generation of useless mutable states by objects functions

[jira] [Assigned] (SPARK-22690) Imputer inherit HasOutputCols

[ https://issues.apache.org/jira/browse/SPARK-22690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath reassigned SPARK-22690: -- Assignee: zhengruifeng > Imputer inherit HasOutputCols > -

[jira] [Updated] (SPARK-22690) Imputer inherit HasOutputCols

[ https://issues.apache.org/jira/browse/SPARK-22690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-22690: --- Fix Version/s: 2.3.0 > Imputer inherit HasOutputCols > - > >

[jira] [Resolved] (SPARK-22690) Imputer inherit HasOutputCols

[ https://issues.apache.org/jira/browse/SPARK-22690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-22690. Resolution: Fixed > Imputer inherit HasOutputCols > - > >

[jira] [Assigned] (SPARK-21672) Remove SHS-specific application / attempt data structures

[ https://issues.apache.org/jira/browse/SPARK-21672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21672: Assignee: (was: Apache Spark) > Remove SHS-specific application / attempt data structu

[jira] [Assigned] (SPARK-21672) Remove SHS-specific application / attempt data structures

[ https://issues.apache.org/jira/browse/SPARK-21672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21672: Assignee: Apache Spark > Remove SHS-specific application / attempt data structures > -

[jira] [Commented] (SPARK-21672) Remove SHS-specific application / attempt data structures

[ https://issues.apache.org/jira/browse/SPARK-21672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281898#comment-16281898 ] Apache Spark commented on SPARK-21672: -- User 'smurakozi' has created a pull request

[jira] [Commented] (SPARK-21074) Parquet files are read fully even though only count() is requested

[ https://issues.apache.org/jira/browse/SPARK-21074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281901#comment-16281901 ] Steve Loughran commented on SPARK-21074: Is there any update on this? # I'd lik

[jira] [Resolved] (SPARK-22660) Use position() and limit() to fix ambiguity issue in scala-2.12

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22660. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19854 [https://github.co

[jira] [Assigned] (SPARK-22660) Use position() and limit() to fix ambiguity issue in scala-2.12

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22660: - Assignee: liyunzhang > Use position() and limit() to fix ambiguity issue in scala-2.12 > ---

[jira] [Commented] (SPARK-20555) Incorrect handling of Oracle's decimal types via JDBC

[ https://issues.apache.org/jira/browse/SPARK-20555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282128#comment-16282128 ] Shankar Kandaswamy commented on SPARK-20555: [~gfeher] May i know if first is

[jira] [Updated] (SPARK-22725) df.select on a Stream is broken, vs a List

[ https://issues.apache.org/jira/browse/SPARK-22725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22725: -- Priority: Minor (was: Major) > df.select on a Stream is broken, vs a List > --

[jira] [Updated] (SPARK-21787) Support for pushing down filters for DateType in native OrcFileFormat

[ https://issues.apache.org/jira/browse/SPARK-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21787: -- Summary: Support for pushing down filters for DateType in native OrcFileFormat (was: Support f

[jira] [Commented] (SPARK-22680) SparkSQL scan all partitions when the specified partitions are not exists in parquet formatted table

[ https://issues.apache.org/jira/browse/SPARK-22680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282248#comment-16282248 ] Nan Zhu commented on SPARK-22680: - how you observed that spark scans all partitions? I tr

[jira] [Comment Edited] (SPARK-20555) Incorrect handling of Oracle's decimal types via JDBC

[ https://issues.apache.org/jira/browse/SPARK-20555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282128#comment-16282128 ] Shankar Kandaswamy edited comment on SPARK-20555 at 12/7/17 4:50 PM: --

[jira] [Resolved] (SPARK-22719) refactor ConstantPropagation

[ https://issues.apache.org/jira/browse/SPARK-22719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22719. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.3.0 > refactor ConstantPropag

[jira] [Created] (SPARK-22730) Add support for non-integer image formats

Tomas Nykodym created SPARK-22730: - Summary: Add support for non-integer image formats Key: SPARK-22730 URL: https://issues.apache.org/jira/browse/SPARK-22730 Project: Spark Issue Type: Impro

[jira] [Commented] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282312#comment-16282312 ] Tomas Nykodym commented on SPARK-21866: --- I've created a separate ticket to add supp

[jira] [Created] (SPARK-22731) Add a test for ROWID type to OracleIntegrationSuite

Xiao Li created SPARK-22731: --- Summary: Add a test for ROWID type to OracleIntegrationSuite Key: SPARK-22731 URL: https://issues.apache.org/jira/browse/SPARK-22731 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-22688) Upgrade Janino version to 3.0.8

[ https://issues.apache.org/jira/browse/SPARK-22688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282433#comment-16282433 ] Apache Spark commented on SPARK-22688: -- User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-22452) DataSourceV2Options should have getInt, getBoolean, etc.

[ https://issues.apache.org/jira/browse/SPARK-22452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282252#comment-16282252 ] Apache Spark commented on SPARK-22452: -- User 'skambha' has created a pull request fo

[jira] [Updated] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-22187: -- Fix Version/s: (was: 2.3.0) > Update unsaferow format for saved state such that we can set

[jira] [Commented] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282628#comment-16282628 ] Tathagata Das commented on SPARK-22187: --- I am reverting this because this will brea

[jira] [Created] (SPARK-22732) Add DataSourceV2 streaming APIs

Jose Torres created SPARK-22732: --- Summary: Add DataSourceV2 streaming APIs Key: SPARK-22732 URL: https://issues.apache.org/jira/browse/SPARK-22732 Project: Spark Issue Type: Sub-task

[jira] [Reopened] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reopened SPARK-22187: --- > Update unsaferow format for saved state such that we can set timeouts when > state is null > -

[jira] [Comment Edited] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282628#comment-16282628 ] Tathagata Das edited comment on SPARK-22187 at 12/7/17 10:33 PM: --

[jira] [Assigned] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22187: Assignee: Tathagata Das (was: Apache Spark) > Update unsaferow format for saved state suc

[jira] [Assigned] (SPARK-22732) Add DataSourceV2 streaming APIs

[ https://issues.apache.org/jira/browse/SPARK-22732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22732: Assignee: (was: Apache Spark) > Add DataSourceV2 streaming APIs >

[jira] [Assigned] (SPARK-22732) Add DataSourceV2 streaming APIs

[ https://issues.apache.org/jira/browse/SPARK-22732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22732: Assignee: Apache Spark > Add DataSourceV2 streaming APIs > ---

[jira] [Commented] (SPARK-22732) Add DataSourceV2 streaming APIs

[ https://issues.apache.org/jira/browse/SPARK-22732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282634#comment-16282634 ] Apache Spark commented on SPARK-22732: -- User 'joseph-torres' has created a pull requ

[jira] [Commented] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282633#comment-16282633 ] Apache Spark commented on SPARK-22187: -- User 'tdas' has created a pull request for t

[jira] [Assigned] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22187: Assignee: Apache Spark (was: Tathagata Das) > Update unsaferow format for saved state suc

[jira] [Resolved] (SPARK-22688) Upgrade Janino version to 3.0.8

[ https://issues.apache.org/jira/browse/SPARK-22688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22688. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.3.0 2

[jira] [Commented] (SPARK-22126) Fix model-specific optimization support for ML tuning

[ https://issues.apache.org/jira/browse/SPARK-22126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282699#comment-16282699 ] Joseph K. Bradley commented on SPARK-22126: --- Continuing the discussion from the

[jira] [Assigned] (SPARK-22733) refactor StreamExecution for extensibility

[ https://issues.apache.org/jira/browse/SPARK-22733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22733: Assignee: (was: Apache Spark) > refactor StreamExecution for extensibility > -

[jira] [Created] (SPARK-22733) refactor StreamExecution for extensibility

Jose Torres created SPARK-22733: --- Summary: refactor StreamExecution for extensibility Key: SPARK-22733 URL: https://issues.apache.org/jira/browse/SPARK-22733 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-22733) refactor StreamExecution for extensibility

[ https://issues.apache.org/jira/browse/SPARK-22733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22733: Assignee: Apache Spark > refactor StreamExecution for extensibility >

[jira] [Commented] (SPARK-22733) refactor StreamExecution for extensibility

[ https://issues.apache.org/jira/browse/SPARK-22733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282739#comment-16282739 ] Apache Spark commented on SPARK-22733: -- User 'joseph-torres' has created a pull requ

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282764#comment-16282764 ] Marcelo Vanzin commented on SPARK-7736: --- Make sure all you guys are running apps in

[jira] [Commented] (SPARK-8418) Add single- and multi-value support to ML Transformers

[ https://issues.apache.org/jira/browse/SPARK-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282796#comment-16282796 ] Joseph K. Bradley commented on SPARK-8418: -- Agreed; thanks! > Add single- and mu

[jira] [Commented] (SPARK-22721) BytesToBytesMap peak memory usage not accurate after reset()

[ https://issues.apache.org/jira/browse/SPARK-22721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282566#comment-16282566 ] Apache Spark commented on SPARK-22721: -- User 'juliuszsompolski' has created a pull r

[jira] [Created] (SPARK-22735) Add VectorSizeHint to ML features documentation

Bago Amirbekian created SPARK-22735: --- Summary: Add VectorSizeHint to ML features documentation Key: SPARK-22735 URL: https://issues.apache.org/jira/browse/SPARK-22735 Project: Spark Issue T

[jira] [Created] (SPARK-22734) Create Python API for VectorSizeHint

Bago Amirbekian created SPARK-22734: --- Summary: Create Python API for VectorSizeHint Key: SPARK-22734 URL: https://issues.apache.org/jira/browse/SPARK-22734 Project: Spark Issue Type: Improv

[jira] [Assigned] (SPARK-21787) Support for pushing down filters for DateType in native OrcFileFormat

[ https://issues.apache.org/jira/browse/SPARK-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21787: --- Assignee: Dongjoon Hyun > Support for pushing down filters for DateType in native OrcFileFor

[jira] [Resolved] (SPARK-21787) Support for pushing down filters for DateType in native OrcFileFormat

[ https://issues.apache.org/jira/browse/SPARK-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21787. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18995 [https://githu

[jira] [Commented] (SPARK-22660) Use position() and limit() to fix ambiguity issue in scala-2.12

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282919#comment-16282919 ] liyunzhang commented on SPARK-22660: thanks for [~srowen] ,[~viirya] and [~hyukjin.kw

[jira] [Created] (SPARK-22736) Consider caching decoded dictionaries in VectorizedColumnReader

Henry Robinson created SPARK-22736: -- Summary: Consider caching decoded dictionaries in VectorizedColumnReader Key: SPARK-22736 URL: https://issues.apache.org/jira/browse/SPARK-22736 Project: Spark

[jira] [Updated] (SPARK-22688) Upgrade Janino version to 3.0.8

[ https://issues.apache.org/jira/browse/SPARK-22688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22688: -- Fix Version/s: 2.1.3 > Upgrade Janino version to 3.0.8 > --- > >

[jira] [Commented] (SPARK-22126) Fix model-specific optimization support for ML tuning

[ https://issues.apache.org/jira/browse/SPARK-22126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283038#comment-16283038 ] Weichen Xu commented on SPARK-22126: [~josephkb] For 2nd type: suppose there is a sin

[jira] [Created] (SPARK-22737) Simplity OneVsRest transform

zhengruifeng created SPARK-22737: Summary: Simplity OneVsRest transform Key: SPARK-22737 URL: https://issues.apache.org/jira/browse/SPARK-22737 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-22737) Simplity OneVsRest transform

[ https://issues.apache.org/jira/browse/SPARK-22737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22737: Assignee: Apache Spark > Simplity OneVsRest transform > > >

[jira] [Assigned] (SPARK-22737) Simplity OneVsRest transform

[ https://issues.apache.org/jira/browse/SPARK-22737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22737: Assignee: (was: Apache Spark) > Simplity OneVsRest transform > ---

[jira] [Commented] (SPARK-22737) Simplity OneVsRest transform

[ https://issues.apache.org/jira/browse/SPARK-22737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283048#comment-16283048 ] Apache Spark commented on SPARK-22737: -- User 'zhengruifeng' has created a pull reque

[jira] [Commented] (SPARK-22647) Docker files for image creation

[ https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283092#comment-16283092 ] Yang Wang commented on SPARK-22647: --- The current Dockerfiles is based on [openjdk:8-al

[jira] [Commented] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283097#comment-16283097 ] Shixiong Zhu commented on SPARK-22187: -- Reverted by https://github.com/apache/spark/

[jira] [Updated] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-22187: - Target Version/s: (was: 2.3.0) > Update unsaferow format for saved state such that we can set t

[jira] [Resolved] (SPARK-22452) DataSourceV2Options should have getInt, getBoolean, etc.

[ https://issues.apache.org/jira/browse/SPARK-22452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22452. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19921 [https://githu

[jira] [Assigned] (SPARK-22452) DataSourceV2Options should have getInt, getBoolean, etc.

[ https://issues.apache.org/jira/browse/SPARK-22452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22452: --- Assignee: Sunitha Kambhampati > DataSourceV2Options should have getInt, getBoolean, etc. > -

[jira] [Commented] (SPARK-22126) Fix model-specific optimization support for ML tuning

[ https://issues.apache.org/jira/browse/SPARK-22126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283145#comment-16283145 ] Bago Amirbekian commented on SPARK-22126: - Joseph, the way I read your comment is