[jira] [Resolved] (SPARK-18188) Add checksum for block of broadcast

[ https://issues.apache.org/jira/browse/SPARK-18188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-18188. -- Resolution: Fixed Fix Version/s: 2.1.0 > Add checksum for block of broadcast >

[jira] [Created] (SPARK-18619) Make QuantileDiscretizer/Bucketizer/StringIndexer shared HasHandleInvalid

Yanbo Liang created SPARK-18619: --- Summary: Make QuantileDiscretizer/Bucketizer/StringIndexer shared HasHandleInvalid Key: SPARK-18619 URL: https://issues.apache.org/jira/browse/SPARK-18619 Project:

[jira] [Commented] (SPARK-18460) Include triggerDetails in StreamingQueryStatus.json

[ https://issues.apache.org/jira/browse/SPARK-18460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704609#comment-15704609 ] Sean Owen commented on SPARK-18460: --- Oh, was this being held open pending a back port to 2.0.x? Still

[jira] [Commented] (SPARK-17897) not isnotnull is converted to the always false condition isnotnull && not isnotnull

[ https://issues.apache.org/jira/browse/SPARK-17897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704608#comment-15704608 ] Apache Spark commented on SPARK-17897: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17897) not isnotnull is converted to the always false condition isnotnull && not isnotnull

[ https://issues.apache.org/jira/browse/SPARK-17897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17897: Assignee: Apache Spark > not isnotnull is converted to the always false condition

[jira] [Assigned] (SPARK-17897) not isnotnull is converted to the always false condition isnotnull && not isnotnull

[ https://issues.apache.org/jira/browse/SPARK-17897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17897: Assignee: (was: Apache Spark) > not isnotnull is converted to the always false

[jira] [Updated] (SPARK-18619) Make QuantileDiscretizer/Bucketizer/StringIndexer inherit from HasHandleInvalid

[ https://issues.apache.org/jira/browse/SPARK-18619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-18619: Summary: Make QuantileDiscretizer/Bucketizer/StringIndexer inherit from HasHandleInvalid (was:

[jira] [Commented] (SPARK-18629) Fix numPartition of JDBCSuite Testcase

[ https://issues.apache.org/jira/browse/SPARK-18629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706226#comment-15706226 ] Apache Spark commented on SPARK-18629: -- User 'weiqingy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18629) Fix numPartition of JDBCSuite Testcase

[ https://issues.apache.org/jira/browse/SPARK-18629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18629: Assignee: (was: Apache Spark) > Fix numPartition of JDBCSuite Testcase >

[jira] [Assigned] (SPARK-18629) Fix numPartition of JDBCSuite Testcase

[ https://issues.apache.org/jira/browse/SPARK-18629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18629: Assignee: Apache Spark > Fix numPartition of JDBCSuite Testcase >

[jira] [Commented] (SPARK-17064) Reconsider spark.job.interruptOnCancel

[ https://issues.apache.org/jira/browse/SPARK-17064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706464#comment-15706464 ] Apache Spark commented on SPARK-17064: -- User 'markhamstra' has created a pull request for this

[jira] [Created] (SPARK-18634) Issues with exploding Python UDFs

Burak Yavuz created SPARK-18634: --- Summary: Issues with exploding Python UDFs Key: SPARK-18634 URL: https://issues.apache.org/jira/browse/SPARK-18634 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-18632) AggregateFunction should not ImplicitCastInputTypes

[ https://issues.apache.org/jira/browse/SPARK-18632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18632: Assignee: Herman van Hovell (was: Apache Spark) > AggregateFunction should not

[jira] [Comment Edited] (SPARK-18637) Stateful UDF should be considered as nondeterministic

[ https://issues.apache.org/jira/browse/SPARK-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706928#comment-15706928 ] Herman van Hovell edited comment on SPARK-18637 at 11/29/16 11:35 PM:

[jira] [Comment Edited] (SPARK-18637) Stateful UDF should be considered as nondeterministic

[ https://issues.apache.org/jira/browse/SPARK-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706961#comment-15706961 ] Zhan Zhang edited comment on SPARK-18637 at 11/29/16 11:52 PM: ---

[jira] [Commented] (SPARK-18637) Stateful UDF should be considered as nondeterministic

[ https://issues.apache.org/jira/browse/SPARK-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706961#comment-15706961 ] Zhan Zhang commented on SPARK-18637: [~hvanhovell] It is an annotation. /** * UDFType annotations

[jira] [Commented] (SPARK-18475) Be able to provide higher parallelization for StructuredStreaming Kafka Source

[ https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706758#comment-15706758 ] Cody Koeninger commented on SPARK-18475: Burak hasn't empirically shown that it is of benefit for

[jira] [Created] (SPARK-18636) UnsafeShuffleWriter and DiskBlockObjectWriter do not consider encryption / compression in metrics

Marcelo Vanzin created SPARK-18636: -- Summary: UnsafeShuffleWriter and DiskBlockObjectWriter do not consider encryption / compression in metrics Key: SPARK-18636 URL:

[jira] [Created] (SPARK-18638) Upgrade sbt to 0.13.13

Weiqing Yang created SPARK-18638: Summary: Upgrade sbt to 0.13.13 Key: SPARK-18638 URL: https://issues.apache.org/jira/browse/SPARK-18638 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-18553) Executor loss may cause TaskSetManager to be leaked

[ https://issues.apache.org/jira/browse/SPARK-18553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-18553: --- Fix Version/s: 2.2.0 2.1.0 > Executor loss may cause TaskSetManager to be leaked

[jira] [Commented] (SPARK-18475) Be able to provide higher parallelization for StructuredStreaming Kafka Source

[ https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706814#comment-15706814 ] Cody Koeninger commented on SPARK-18475: Glad you agree it shouldn't be enabled by default. If

[jira] [Created] (SPARK-18637) Stateful UDF should be considered as nondeterministic

Zhan Zhang created SPARK-18637: -- Summary: Stateful UDF should be considered as nondeterministic Key: SPARK-18637 URL: https://issues.apache.org/jira/browse/SPARK-18637 Project: Spark Issue

[jira] [Commented] (SPARK-18637) Stateful UDF should be considered as nondeterministic

[ https://issues.apache.org/jira/browse/SPARK-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706928#comment-15706928 ] Herman van Hovell commented on SPARK-18637: --- {{UDFType}} is a Hive contruct right? > Stateful

[jira] [Commented] (SPARK-18475) Be able to provide higher parallelization for StructuredStreaming Kafka Source

[ https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706692#comment-15706692 ] Michael Armbrust commented on SPARK-18475: -- I think that this suggestion was closed prematurely.

[jira] [Reopened] (SPARK-18475) Be able to provide higher parallelization for StructuredStreaming Kafka Source

[ https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-18475: -- > Be able to provide higher parallelization for StructuredStreaming Kafka Source >

[jira] [Commented] (SPARK-16551) Accumulator Examples should demonstrate different use case from UDAFs

[ https://issues.apache.org/jira/browse/SPARK-16551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706764#comment-15706764 ] Ruiming Zhou commented on SPARK-16551: -- I can look at this issue. > Accumulator Examples should

[jira] [Resolved] (SPARK-18614) Incorrect predicate pushdown from ExistenceJoin

[ https://issues.apache.org/jira/browse/SPARK-18614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18614. --- Resolution: Fixed Assignee: Nattavut Sutyanyong Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-18637) Stateful UDF should be considered as nondeterministic

[ https://issues.apache.org/jira/browse/SPARK-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706905#comment-15706905 ] Zhan Zhang commented on SPARK-18637: Here is the comments from UDFType /** * If a UDF stores

[jira] [Resolved] (SPARK-18631) Avoid making data skew worse in ExchangeCoordinator

[ https://issues.apache.org/jira/browse/SPARK-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18631. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16065

[jira] [Updated] (SPARK-18637) Stateful UDF should be considered as nondeterministic

[ https://issues.apache.org/jira/browse/SPARK-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated SPARK-18637: --- Component/s: SQL > Stateful UDF should be considered as nondeterministic >

[jira] [Commented] (SPARK-18637) Stateful UDF should be considered as nondeterministic

[ https://issues.apache.org/jira/browse/SPARK-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706935#comment-15706935 ] Apache Spark commented on SPARK-18637: -- User 'zhzhan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18637) Stateful UDF should be considered as nondeterministic

[ https://issues.apache.org/jira/browse/SPARK-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18637: Assignee: Apache Spark > Stateful UDF should be considered as nondeterministic >

[jira] [Commented] (SPARK-18475) Be able to provide higher parallelization for StructuredStreaming Kafka Source

[ https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706788#comment-15706788 ] Burak Yavuz commented on SPARK-18475: - I'd be happy to share performance results. You're right, I

[jira] [Assigned] (SPARK-18637) Stateful UDF should be considered as nondeterministic

[ https://issues.apache.org/jira/browse/SPARK-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18637: Assignee: (was: Apache Spark) > Stateful UDF should be considered as nondeterministic

[jira] [Assigned] (SPARK-18638) Upgrade sbt to 0.13.13

[ https://issues.apache.org/jira/browse/SPARK-18638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18638: Assignee: Apache Spark > Upgrade sbt to 0.13.13 > -- > >

[jira] [Commented] (SPARK-18638) Upgrade sbt to 0.13.13

[ https://issues.apache.org/jira/browse/SPARK-18638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707063#comment-15707063 ] Apache Spark commented on SPARK-18638: -- User 'weiqingy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18638) Upgrade sbt to 0.13.13

[ https://issues.apache.org/jira/browse/SPARK-18638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18638: Assignee: (was: Apache Spark) > Upgrade sbt to 0.13.13 > -- > >

[jira] [Commented] (SPARK-18622) Missing Reference in Multi Union Clauses Cause by TypeCoercion

[ https://issues.apache.org/jira/browse/SPARK-18622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706342#comment-15706342 ] Apache Spark commented on SPARK-18622: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18622) Missing Reference in Multi Union Clauses Cause by TypeCoercion

[ https://issues.apache.org/jira/browse/SPARK-18622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18622: Assignee: Apache Spark > Missing Reference in Multi Union Clauses Cause by TypeCoercion >

[jira] [Assigned] (SPARK-18622) Missing Reference in Multi Union Clauses Cause by TypeCoercion

[ https://issues.apache.org/jira/browse/SPARK-18622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18622: Assignee: (was: Apache Spark) > Missing Reference in Multi Union Clauses Cause by

[jira] [Commented] (SPARK-18502) Spark does not handle columns that contain backquote (`)

[ https://issues.apache.org/jira/browse/SPARK-18502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706389#comment-15706389 ] Barry Becker commented on SPARK-18502: -- Is there a way to escape the backtick when it appears in a

[jira] [Updated] (SPARK-18634) Corruption and Correctness issues with exploding Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-18634: Summary: Corruption and Correctness issues with exploding Python UDFs (was: Issues with exploding

[jira] [Updated] (SPARK-18634) Corruption and Correctness issues with exploding Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-18634: Description: There are some weird issues with exploding Python UDFs in SparkSQL. There are 2

[jira] [Assigned] (SPARK-18633) Add multiclass logistic regression summary python example and document

[ https://issues.apache.org/jira/browse/SPARK-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18633: Assignee: (was: Apache Spark) > Add multiclass logistic regression summary python

[jira] [Commented] (SPARK-18633) Add multiclass logistic regression summary python example and document

[ https://issues.apache.org/jira/browse/SPARK-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706365#comment-15706365 ] Apache Spark commented on SPARK-18633: -- User 'wangmiao1981' has created a pull request for this

[jira] [Commented] (SPARK-18502) Spark does not handle columns that contain backquote (`)

[ https://issues.apache.org/jira/browse/SPARK-18502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706385#comment-15706385 ] Kazuaki Ishizaki commented on SPARK-18502: -- I can reproduce this exception using the following

[jira] [Assigned] (SPARK-18631) Avoid making data skew worse in ExchangeCoordinator

[ https://issues.apache.org/jira/browse/SPARK-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18631: Assignee: Mark Hamstra (was: Apache Spark) > Avoid making data skew worse in

[jira] [Commented] (SPARK-18631) Avoid making data skew worse in ExchangeCoordinator

[ https://issues.apache.org/jira/browse/SPARK-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706495#comment-15706495 ] Apache Spark commented on SPARK-18631: -- User 'markhamstra' has created a pull request for this

[jira] [Assigned] (SPARK-18631) Avoid making data skew worse in ExchangeCoordinator

[ https://issues.apache.org/jira/browse/SPARK-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18631: Assignee: Apache Spark (was: Mark Hamstra) > Avoid making data skew worse in

[jira] [Created] (SPARK-18635) Partition name/values not escaped correctly in some cases

Eric Liang created SPARK-18635: -- Summary: Partition name/values not escaped correctly in some cases Key: SPARK-18635 URL: https://issues.apache.org/jira/browse/SPARK-18635 Project: Spark Issue

[jira] [Commented] (SPARK-18352) Parse normal, multi-line JSON files (not just JSON Lines)

[ https://issues.apache.org/jira/browse/SPARK-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706213#comment-15706213 ] Josh Rosen commented on SPARK-18352: Yeah, I'll update my patch to roll back my JSON changes so it

[jira] [Updated] (SPARK-18632) AggregateFunction should not ImplicitCastInputTypes

[ https://issues.apache.org/jira/browse/SPARK-18632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18632: Target Version/s: 2.2.0 > AggregateFunction should not ImplicitCastInputTypes >

[jira] [Updated] (SPARK-18635) Partition name/values not escaped correctly in some cases

[ https://issues.apache.org/jira/browse/SPARK-18635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Liang updated SPARK-18635: --- Target Version/s: 2.1.0 Priority: Critical (was: Major) > Partition name/values not

[jira] [Commented] (SPARK-17897) not isnotnull is converted to the always false condition isnotnull && not isnotnull

[ https://issues.apache.org/jira/browse/SPARK-17897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706606#comment-15706606 ] Apache Spark commented on SPARK-17897: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18633) Add multiclass logistic regression summary python example and document

[ https://issues.apache.org/jira/browse/SPARK-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18633: Assignee: Apache Spark > Add multiclass logistic regression summary python example and

[jira] [Updated] (SPARK-18468) Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757 Persist Parquet relation with decimal column

[ https://issues.apache.org/jira/browse/SPARK-18468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18468: - Target Version/s: (was: 2.1.0) > Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757

[jira] [Created] (SPARK-18633) Add multiclass logistic regression summary python example and document

Miao Wang created SPARK-18633: - Summary: Add multiclass logistic regression summary python example and document Key: SPARK-18633 URL: https://issues.apache.org/jira/browse/SPARK-18633 Project: Spark

[jira] [Commented] (SPARK-17064) Reconsider spark.job.interruptOnCancel

[ https://issues.apache.org/jira/browse/SPARK-17064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706502#comment-15706502 ] Mark Hamstra commented on SPARK-17064: -- Ignore above PR comment -- wrong JIRA ticket at first >

[jira] [Commented] (SPARK-18159) Stand-alone cluster, supervised app: restart of worker hosting the driver causes app to run twice

[ https://issues.apache.org/jira/browse/SPARK-18159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706276#comment-15706276 ] Igor Zaytsev commented on SPARK-18159: -- Reproduced the issue with version 1.6.2 though not with

[jira] [Created] (SPARK-18632) AggregateFunction should not ImplicitCastInputTypes

Herman van Hovell created SPARK-18632: - Summary: AggregateFunction should not ImplicitCastInputTypes Key: SPARK-18632 URL: https://issues.apache.org/jira/browse/SPARK-18632 Project: Spark

[jira] [Resolved] (SPARK-18498) Clean up HDFSMetadataLog API for better testing

[ https://issues.apache.org/jira/browse/SPARK-18498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-18498. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15924

[jira] [Resolved] (SPARK-18592) Move DT/RF/GBT Param setter methods to subclasses

[ https://issues.apache.org/jira/browse/SPARK-18592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-18592. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 Issue

[jira] [Updated] (SPARK-18634) Corruption and Correctness issues with exploding Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-18634: Description: There are some weird issues with exploding Python UDFs in SparkSQL. There are 2

[jira] [Updated] (SPARK-18634) Corruption and Correctness issues with exploding Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-18634: Description: There are some weird issues with exploding Python UDFs in SparkSQL. There are 2

[jira] [Updated] (SPARK-18545) Verify number of hive client RPCs in PartitionedTablePerfStatsSuite

[ https://issues.apache.org/jira/browse/SPARK-18545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Liang updated SPARK-18545: --- Issue Type: Sub-task (was: Test) Parent: SPARK-17861 > Verify number of hive client RPCs in

[jira] [Updated] (SPARK-18507) Major performance regression in SHOW PARTITIONS on partitioned Hive tables

[ https://issues.apache.org/jira/browse/SPARK-18507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Liang updated SPARK-18507: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-17861 > Major performance regression in SHOW

[jira] [Commented] (SPARK-17916) CSV data source treats empty string as null no matter what nullValue option is

[ https://issues.apache.org/jira/browse/SPARK-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704736#comment-15704736 ] Jork Zijlstra commented on SPARK-17916: --- I also have the same issue in 2.0.1. This code seems to be

[jira] [Created] (SPARK-18620) Spark Streaming + Kinesis : Receiver MaxRate is violated

david przybill created SPARK-18620: -- Summary: Spark Streaming + Kinesis : Receiver MaxRate is violated Key: SPARK-18620 URL: https://issues.apache.org/jira/browse/SPARK-18620 Project: Spark

[jira] [Created] (SPARK-18622) Missing Reference in Multi Union Clauses Cause by TypeCoercion

Yerui Sun created SPARK-18622: - Summary: Missing Reference in Multi Union Clauses Cause by TypeCoercion Key: SPARK-18622 URL: https://issues.apache.org/jira/browse/SPARK-18622 Project: Spark

[jira] [Comment Edited] (SPARK-18618) SparkR model predict should support type as a argument

[ https://issues.apache.org/jira/browse/SPARK-18618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704741#comment-15704741 ] Yanbo Liang edited comment on SPARK-18618 at 11/29/16 9:14 AM: --- Currently

[jira] [Resolved] (SPARK-18558) spark-csv: infer data type for mixed integer/null columns causes exception

[ https://issues.apache.org/jira/browse/SPARK-18558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18558. --- Resolution: Cannot Reproduce > spark-csv: infer data type for mixed integer/null columns causes

[jira] [Created] (SPARK-18624) Implict cast between ArrayTypes

Jiang Xingbo created SPARK-18624: Summary: Implict cast between ArrayTypes Key: SPARK-18624 URL: https://issues.apache.org/jira/browse/SPARK-18624 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-18625) OneVsRestModel should support setFeaturesCol and setPredictionCol

zhengruifeng created SPARK-18625: Summary: OneVsRestModel should support setFeaturesCol and setPredictionCol Key: SPARK-18625 URL: https://issues.apache.org/jira/browse/SPARK-18625 Project: Spark

[jira] [Commented] (SPARK-18618) SparkR model predict should support type as a argument

[ https://issues.apache.org/jira/browse/SPARK-18618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704698#comment-15704698 ] Felix Cheung commented on SPARK-18618: -- Sounds like a good idea. Does the existing types in

[jira] [Updated] (SPARK-18621) PySQL SQL Types (aka Dataframa Schema) have __repr__() with Scala and not Python representation

[ https://issues.apache.org/jira/browse/SPARK-18621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Romi Kuntsman updated SPARK-18621: -- Description: When using Python's repr() on an object, the expected result is a string that

[jira] [Updated] (SPARK-18625) OneVsRestModel should support setFeaturesCol and setPredictionCol

[ https://issues.apache.org/jira/browse/SPARK-18625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-18625: - Component/s: ML > OneVsRestModel should support setFeaturesCol and setPredictionCol >

[jira] [Updated] (SPARK-18220) ClassCastException occurs when using select query on ORC file

[ https://issues.apache.org/jira/browse/SPARK-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-18220: Priority: Blocker (was: Major) > ClassCastException occurs when using select query on ORC file >

[jira] [Reopened] (SPARK-18220) ClassCastException occurs when using select query on ORC file

[ https://issues.apache.org/jira/browse/SPARK-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-18220: - Assignee: Wenchen Fan > ClassCastException occurs when using select query on ORC file >

[jira] [Comment Edited] (SPARK-17916) CSV data source treats empty string as null no matter what nullValue option is

[ https://issues.apache.org/jira/browse/SPARK-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704736#comment-15704736 ] Jork Zijlstra edited comment on SPARK-17916 at 11/29/16 9:04 AM: - I also

[jira] [Comment Edited] (SPARK-17916) CSV data source treats empty string as null no matter what nullValue option is

[ https://issues.apache.org/jira/browse/SPARK-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704736#comment-15704736 ] Jork Zijlstra edited comment on SPARK-17916 at 11/29/16 9:05 AM: - I also

[jira] [Commented] (SPARK-16986) "Started" time, "Completed" time and "Last Updated" time in history server UI are not user local time

[ https://issues.apache.org/jira/browse/SPARK-16986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704807#comment-15704807 ] Sean Owen commented on SPARK-16986: --- Really you could call this a duplicate. There are several other

[jira] [Created] (SPARK-18623) Add `returnNullable` to `StaticInvoke` and modify it to handle properly.

Takuya Ueshin created SPARK-18623: - Summary: Add `returnNullable` to `StaticInvoke` and modify it to handle properly. Key: SPARK-18623 URL: https://issues.apache.org/jira/browse/SPARK-18623 Project:

[jira] [Assigned] (SPARK-18624) Implict cast between ArrayTypes

[ https://issues.apache.org/jira/browse/SPARK-18624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18624: Assignee: Apache Spark > Implict cast between ArrayTypes >

[jira] [Commented] (SPARK-18291) SparkR glm predict should output original label when family = "binomial"

[ https://issues.apache.org/jira/browse/SPARK-18291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704906#comment-15704906 ] Apache Spark commented on SPARK-18291: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-18527) UDAFPercentile (bigint, array) needs explicity cast to double

[ https://issues.apache.org/jira/browse/SPARK-18527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704934#comment-15704934 ] Fabian Boehnlein commented on SPARK-18527: -- Thanks [~hvanhovell]. Will be interesting to compare

[jira] [Resolved] (SPARK-3359) `sbt/sbt unidoc` doesn't work with Java 8

[ https://issues.apache.org/jira/browse/SPARK-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3359. -- Resolution: Fixed Fix Version/s: 2.1.1 Issue resolved by pull request 16013

[jira] [Commented] (SPARK-18625) OneVsRestModel should support setFeaturesCol and setPredictionCol

[ https://issues.apache.org/jira/browse/SPARK-18625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704990#comment-15704990 ] Apache Spark commented on SPARK-18625: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-18625) OneVsRestModel should support setFeaturesCol and setPredictionCol

[ https://issues.apache.org/jira/browse/SPARK-18625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18625: Assignee: Apache Spark > OneVsRestModel should support setFeaturesCol and

[jira] [Assigned] (SPARK-18625) OneVsRestModel should support setFeaturesCol and setPredictionCol

[ https://issues.apache.org/jira/browse/SPARK-18625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18625: Assignee: (was: Apache Spark) > OneVsRestModel should support setFeaturesCol and

[jira] [Commented] (SPARK-17897) not isnotnull is converted to the always false condition isnotnull && not isnotnull

[ https://issues.apache.org/jira/browse/SPARK-17897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705036#comment-15705036 ] Apache Spark commented on SPARK-17897: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-16986) "Started" time, "Completed" time and "Last Updated" time in history server UI are not user local time

[ https://issues.apache.org/jira/browse/SPARK-16986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704891#comment-15704891 ] Denis Bolshakov commented on SPARK-16986: - Thx, I've set a `duplicated by` link. > "Started"

[jira] [Commented] (SPARK-18624) Implict cast between ArrayTypes

[ https://issues.apache.org/jira/browse/SPARK-18624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704905#comment-15704905 ] Apache Spark commented on SPARK-18624: -- User 'jiangxb1987' has created a pull request for this

[jira] [Assigned] (SPARK-18624) Implict cast between ArrayTypes

[ https://issues.apache.org/jira/browse/SPARK-18624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18624: Assignee: (was: Apache Spark) > Implict cast between ArrayTypes >

[jira] [Created] (SPARK-18621) PySQL SQL Types (aka Dataframa Schema) have __repr__() with Scala and not Python representation

Romi Kuntsman created SPARK-18621: - Summary: PySQL SQL Types (aka Dataframa Schema) have __repr__() with Scala and not Python representation Key: SPARK-18621 URL: https://issues.apache.org/jira/browse/SPARK-18621

[jira] [Comment Edited] (SPARK-17916) CSV data source treats empty string as null no matter what nullValue option is

[ https://issues.apache.org/jira/browse/SPARK-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704736#comment-15704736 ] Jork Zijlstra edited comment on SPARK-17916 at 11/29/16 9:05 AM: - I also

[jira] [Commented] (SPARK-18618) SparkR model predict should support type as a argument

[ https://issues.apache.org/jira/browse/SPARK-18618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704741#comment-15704741 ] Yanbo Liang commented on SPARK-18618: - Currently ML glm supports {{type = c("link", "response")}}.

[jira] [Assigned] (SPARK-18623) Add `returnNullable` to `StaticInvoke` and modify it to handle properly.

[ https://issues.apache.org/jira/browse/SPARK-18623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18623: Assignee: (was: Apache Spark) > Add `returnNullable` to `StaticInvoke` and modify it

[jira] [Commented] (SPARK-18623) Add `returnNullable` to `StaticInvoke` and modify it to handle properly.

[ https://issues.apache.org/jira/browse/SPARK-18623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704842#comment-15704842 ] Apache Spark commented on SPARK-18623: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18623) Add `returnNullable` to `StaticInvoke` and modify it to handle properly.

[ https://issues.apache.org/jira/browse/SPARK-18623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18623: Assignee: Apache Spark > Add `returnNullable` to `StaticInvoke` and modify it to handle

[jira] [Commented] (SPARK-16986) "Started" time, "Completed" time and "Last Updated" time in history server UI are not user local time

[ https://issues.apache.org/jira/browse/SPARK-16986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704845#comment-15704845 ] Denis Bolshakov commented on SPARK-16986: - Could you please attach to this one? Just to see full

  1   2   3   >