[jira] [Created] (SPARK-22579) BlockManager.getRemoteValues and BlockManager.getRemoteBytes should be implemented using streaming

Eyal Farago created SPARK-22579: --- Summary: BlockManager.getRemoteValues and BlockManager.getRemoteBytes should be implemented using streaming Key: SPARK-22579 URL: https://issues.apache.org/jira/browse/SPARK-22579

[jira] [Updated] (SPARK-22560) Must create spark session directly to connect to hive

[ https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ran Mingxuan updated SPARK-22560: - Affects Version/s: 2.2.0 > Must create spark session directly to connect to hive > --

[jira] [Comment Edited] (SPARK-22560) Must create spark session directly to connect to hive

[ https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16262093#comment-16262093 ] Ran Mingxuan edited comment on SPARK-22560 at 11/22/17 7:47 AM: ---

[jira] [Commented] (SPARK-22560) Must create spark session directly to connect to hive

[ https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16262093#comment-16262093 ] Ran Mingxuan commented on SPARK-22560: -- I think the problem is introduced by org.apa

[jira] [Created] (SPARK-22578) CSV with quoted line breaks not correctly parsed

Carlos Barahona created SPARK-22578: --- Summary: CSV with quoted line breaks not correctly parsed Key: SPARK-22578 URL: https://issues.apache.org/jira/browse/SPARK-22578 Project: Spark Issue

[jira] [Updated] (SPARK-22543) fix java 64kb compile error for deeply nested expressions

[ https://issues.apache.org/jira/browse/SPARK-22543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22543: Target Version/s: 2.3.0 (was: 2.2.1, 2.3.0) > fix java 64kb compile error for deeply nested expressions >

[jira] [Resolved] (SPARK-22548) Incorrect nested AND expression pushed down to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-22548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22548. - Resolution: Fixed Assignee: Jia Li Fix Version/s: 2.3.0 2.2.1

[jira] [Updated] (SPARK-22560) Must create spark session directly to connect to hive

[ https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ran Mingxuan updated SPARK-22560: - Description: In a java project I have to use both JavaSparkContext and SparkSession. I find the

[jira] [Commented] (SPARK-22560) Must create spark session directly to connect to hive

[ https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261887#comment-16261887 ] Ran Mingxuan commented on SPARK-22560: -- [~srowen] Thank you for your reply. Maybe I

[jira] [Commented] (SPARK-22374) STS ran into OOM in a secure cluster

[ https://issues.apache.org/jira/browse/SPARK-22374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261875#comment-16261875 ] Dongjoon Hyun commented on SPARK-22374: --- Thank you for advice. I'll consider that.

[jira] [Updated] (SPARK-22510) Exceptions caused by 64KB JVM bytecode or constant pool entry limits

[ https://issues.apache.org/jira/browse/SPARK-22510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22510: - Description: Codegen can throw an exception due to the 64KB JVM bytecode or 64K constant

[jira] [Updated] (SPARK-22510) Exceptions caused by 64KB JVM bytecode or 64K constant pool entry limit

[ https://issues.apache.org/jira/browse/SPARK-22510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22510: - Summary: Exceptions caused by 64KB JVM bytecode or 64K constant pool entry limit (was:

[jira] [Updated] (SPARK-22510) Exceptions caused by 64KB JVM bytecode or constant pool entry limits

[ https://issues.apache.org/jira/browse/SPARK-22510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22510: - Summary: Exceptions caused by 64KB JVM bytecode or constant pool entry limits (was: Exc

[jira] [Commented] (SPARK-22575) Making Spark Thrift Server clean up its cache

[ https://issues.apache.org/jira/browse/SPARK-22575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261808#comment-16261808 ] Oz Ben-Ami commented on SPARK-22575: We are not explicitly caching any tables, only r

[jira] [Commented] (SPARK-22575) Making Spark Thrift Server clean up its cache

[ https://issues.apache.org/jira/browse/SPARK-22575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261557#comment-16261557 ] Marco Gaido commented on SPARK-22575: - does it happen because you are caching some ta

[jira] [Resolved] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22500. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull req

[jira] [Assigned] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22500: --- Assignee: Kazuaki Ishizaki > 64KB JVM bytecode limit problem with cast > ---

[jira] [Commented] (SPARK-22374) STS ran into OOM in a secure cluster

[ https://issues.apache.org/jira/browse/SPARK-22374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261444#comment-16261444 ] Steve Loughran commented on SPARK-22374: We need to do something about this, it i

[jira] [Assigned] (SPARK-22475) show histogram in DESC COLUMN command

[ https://issues.apache.org/jira/browse/SPARK-22475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22475: --- Assignee: Marco Gaido > show histogram in DESC COLUMN command >

[jira] [Resolved] (SPARK-22475) show histogram in DESC COLUMN command

[ https://issues.apache.org/jira/browse/SPARK-22475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22475. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19774 [https://githu

[jira] [Resolved] (SPARK-22576) Spark SQL locate returns incorrect value when the start position is negative

[ https://issues.apache.org/jira/browse/SPARK-22576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22576. --- Resolution: Not A Problem Yes, there's nothing about HiveQL (which Spark follows) or Spark SQL that

[jira] [Resolved] (SPARK-22165) Type conflicts between dates, timestamps and date in partition column

[ https://issues.apache.org/jira/browse/SPARK-22165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22165. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19389 [https://githu

[jira] [Assigned] (SPARK-22165) Type conflicts between dates, timestamps and date in partition column

[ https://issues.apache.org/jira/browse/SPARK-22165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22165: --- Assignee: Hyukjin Kwon > Type conflicts between dates, timestamps and date in partition colu

[jira] [Commented] (SPARK-20586) Add deterministic to ScalaUDF

[ https://issues.apache.org/jira/browse/SPARK-20586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261393#comment-16261393 ] Bago Amirbekian commented on SPARK-20586: - Also a follow up questions, are the pe

[jira] [Commented] (SPARK-20586) Add deterministic to ScalaUDF

[ https://issues.apache.org/jira/browse/SPARK-20586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261377#comment-16261377 ] Bago Amirbekian commented on SPARK-20586: - Is there some documentation somewhere

[jira] [Commented] (SPARK-22576) Spark SQL locate returns incorrect value when the start position is negative

[ https://issues.apache.org/jira/browse/SPARK-22576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261347#comment-16261347 ] Marco Gaido commented on SPARK-22576: - I see, but this is SAP Sysbase. Why do you thi

[jira] [Commented] (SPARK-22576) Spark SQL locate returns incorrect value when the start position is negative

[ https://issues.apache.org/jira/browse/SPARK-22576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261313#comment-16261313 ] Yuxin Cao commented on SPARK-22576: --- http://infocenter.sybase.com/help/index.jsp?topic=

[jira] [Created] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

Thomas Graves created SPARK-22577: - Summary: executor page blacklist status should update with TaskSet level blacklisting Key: SPARK-22577 URL: https://issues.apache.org/jira/browse/SPARK-22577 Projec

[jira] [Commented] (SPARK-22526) Spark hangs while reading binary files from S3

[ https://issues.apache.org/jira/browse/SPARK-22526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261292#comment-16261292 ] Steve Loughran commented on SPARK-22526: S3a uses the AWS S3 client, which uses h

[jira] [Commented] (SPARK-22576) Spark SQL locate returns incorrect value when the start position is negative

[ https://issues.apache.org/jira/browse/SPARK-22576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261293#comment-16261293 ] Marco Gaido commented on SPARK-22576: - why do you expect locate to work like this and

[jira] [Assigned] (SPARK-22521) VectorIndexerModel support handle unseen categories via handleInvalid: Python API

[ https://issues.apache.org/jira/browse/SPARK-22521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reassigned SPARK-22521: --- Assignee: Weichen Xu > VectorIndexerModel support handle unseen categories via handleInvalid: Python

[jira] [Resolved] (SPARK-22521) VectorIndexerModel support handle unseen categories via handleInvalid: Python API

[ https://issues.apache.org/jira/browse/SPARK-22521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-22521. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19753 [https://github.com/ap

[jira] [Updated] (SPARK-22576) Spark SQL locate returns incorrect value when the start position is negative

[ https://issues.apache.org/jira/browse/SPARK-22576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Cao updated SPARK-22576: -- Summary: Spark SQL locate returns incorrect value when the start position is negative (was: Spark SQL

[jira] [Created] (SPARK-22576) Spark SQL locate returns incorrect value when position is negative

Yuxin Cao created SPARK-22576: - Summary: Spark SQL locate returns incorrect value when position is negative Key: SPARK-22576 URL: https://issues.apache.org/jira/browse/SPARK-22576 Project: Spark

subscribe

[jira] [Created] (SPARK-22575) Making Spark Thrift Server clean up its cache

Oz Ben-Ami created SPARK-22575: -- Summary: Making Spark Thrift Server clean up its cache Key: SPARK-22575 URL: https://issues.apache.org/jira/browse/SPARK-22575 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-22574) Wrong request causing Spark Dispatcher going inactive

[ https://issues.apache.org/jira/browse/SPARK-22574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260954#comment-16260954 ] Apache Spark commented on SPARK-22574: -- User 'Gschiavon' has created a pull request

[jira] [Assigned] (SPARK-22574) Wrong request causing Spark Dispatcher going inactive

[ https://issues.apache.org/jira/browse/SPARK-22574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22574: Assignee: Apache Spark > Wrong request causing Spark Dispatcher going inactive > -

[jira] [Assigned] (SPARK-22574) Wrong request causing Spark Dispatcher going inactive

[ https://issues.apache.org/jira/browse/SPARK-22574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22574: Assignee: (was: Apache Spark) > Wrong request causing Spark Dispatcher going inactive

[jira] [Created] (SPARK-22574) Wrong request causing Spark Dispatcher going inactive

German Schiavon Matteo created SPARK-22574: -- Summary: Wrong request causing Spark Dispatcher going inactive Key: SPARK-22574 URL: https://issues.apache.org/jira/browse/SPARK-22574 Project: Spa

[jira] [Commented] (SPARK-22323) Design doc for different types of pandas_udf

[ https://issues.apache.org/jira/browse/SPARK-22323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260924#comment-16260924 ] Li Jin commented on SPARK-22323: I believe this is done. (At least my original indention

[jira] [Resolved] (SPARK-22323) Design doc for different types of pandas_udf

[ https://issues.apache.org/jira/browse/SPARK-22323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin resolved SPARK-22323. Resolution: Fixed > Design doc for different types of pandas_udf >

[jira] [Commented] (SPARK-22516) CSV Read breaks: When "multiLine" = "true", if "comment" option is set as last line's first character

[ https://issues.apache.org/jira/browse/SPARK-22516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260904#comment-16260904 ] Marco Gaido commented on SPARK-22516: - [~crkumaresh24] I can't reproduce the issue wi

[jira] [Assigned] (SPARK-22566) Better error message for `_merge_type` in Pandas to Spark DF conversion

[ https://issues.apache.org/jira/browse/SPARK-22566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22566: Assignee: (was: Apache Spark) > Better error message for `_merge_type` in Pandas to Sp

[jira] [Assigned] (SPARK-22566) Better error message for `_merge_type` in Pandas to Spark DF conversion

[ https://issues.apache.org/jira/browse/SPARK-22566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22566: Assignee: Apache Spark > Better error message for `_merge_type` in Pandas to Spark DF conv

[jira] [Commented] (SPARK-22566) Better error message for `_merge_type` in Pandas to Spark DF conversion

[ https://issues.apache.org/jira/browse/SPARK-22566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260889#comment-16260889 ] Apache Spark commented on SPARK-22566: -- User 'gberger' has created a pull request fo

[jira] [Assigned] (SPARK-22552) Cannot Union multiple kafka streams

[ https://issues.apache.org/jira/browse/SPARK-22552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22552: - Assignee: (was: Shixiong Zhu) Priority: Minor (was: Major) Fix Version/s:

[jira] [Commented] (SPARK-22572) spark-shell does not re-initialize on :replay

[ https://issues.apache.org/jira/browse/SPARK-22572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260759#comment-16260759 ] Mark Petruska commented on SPARK-22572: --- [~srowen]: Can I ask you to look at https:

[jira] [Assigned] (SPARK-22572) spark-shell does not re-initialize on :replay

[ https://issues.apache.org/jira/browse/SPARK-22572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22572: Assignee: Apache Spark > spark-shell does not re-initialize on :replay > -

[jira] [Assigned] (SPARK-22572) spark-shell does not re-initialize on :replay

[ https://issues.apache.org/jira/browse/SPARK-22572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22572: Assignee: (was: Apache Spark) > spark-shell does not re-initialize on :replay > --

[jira] [Commented] (SPARK-22572) spark-shell does not re-initialize on :replay

[ https://issues.apache.org/jira/browse/SPARK-22572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260756#comment-16260756 ] Apache Spark commented on SPARK-22572: -- User 'mpetruska' has created a pull request

[jira] [Resolved] (SPARK-20133) User guide for spark.ml.stat.ChiSquareTest

[ https://issues.apache.org/jira/browse/SPARK-20133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20133. --- Resolution: Not A Problem > User guide for spark.ml.stat.ChiSquareTest >

[jira] [Commented] (SPARK-22572) spark-shell does not re-initialize on :replay

[ https://issues.apache.org/jira/browse/SPARK-22572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260736#comment-16260736 ] Sean Owen commented on SPARK-22572: --- Yes, I think this is just how it is. The way Spark

[jira] [Commented] (SPARK-22528) History service and non-HDFS filesystems

[ https://issues.apache.org/jira/browse/SPARK-22528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260727#comment-16260727 ] paul mackles commented on SPARK-22528: -- In case anyone else bumps into this, I recei

[jira] [Commented] (SPARK-22568) Split pair RDDs by keys - an efficient (maybe?) substitute to groupByKey

[ https://issues.apache.org/jira/browse/SPARK-22568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260701#comment-16260701 ] Sean Owen commented on SPARK-22568: --- To filter individually you would have to collect d

[jira] [Resolved] (SPARK-22571) How to connect to secure(Kerberos) kafka broker using native KafkaConsumer api in Spark Streamming application

[ https://issues.apache.org/jira/browse/SPARK-22571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22571. --- Resolution: Invalid This should go to the mailing list. > How to connect to secure(Kerberos) kafka b

[jira] [Resolved] (SPARK-22569) Clean up caller of splitExpressions and addMutableState

[ https://issues.apache.org/jira/browse/SPARK-22569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22569. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19790 [https://githu

[jira] [Updated] (SPARK-22538) SQLTransformer.transform(inputDataFrame) uncaches inputDataFrame

[ https://issues.apache.org/jira/browse/SPARK-22538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22538: Fix Version/s: (was: 2.2.2) 2.2.1 > SQLTransformer.transform(inputDataFrame)

[jira] [Updated] (SPARK-22498) 64KB JVM bytecode limit problem with concat

[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22498: Fix Version/s: (was: 2.2.2) 2.2.1 > 64KB JVM bytecode limit problem with con

[jira] [Updated] (SPARK-22549) 64KB JVM bytecode limit problem with concat_ws

[ https://issues.apache.org/jira/browse/SPARK-22549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22549: Fix Version/s: (was: 2.2.2) 2.2.1 > 64KB JVM bytecode limit problem with con

[jira] [Updated] (SPARK-22494) Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception

[ https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22494: Fix Version/s: (was: 2.2.2) 2.2.1 > Coalesce and AtLeastNNonNulls can cause

[jira] [Updated] (SPARK-22501) 64KB JVM bytecode limit problem with in

[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22501: Fix Version/s: (was: 2.2.2) 2.2.1 > 64KB JVM bytecode limit problem with in

[jira] [Updated] (SPARK-22550) 64KB JVM bytecode limit problem with elt

[ https://issues.apache.org/jira/browse/SPARK-22550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22550: Fix Version/s: (was: 2.2.2) 2.2.1 > 64KB JVM bytecode limit problem with elt

[jira] [Updated] (SPARK-22508) 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

[ https://issues.apache.org/jira/browse/SPARK-22508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22508: Fix Version/s: (was: 2.2.2) 2.2.1 > 64KB JVM bytecode limit problem with Gen

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22499: Fix Version/s: (was: 2.2.2) 2.2.1 > 64KB JVM bytecode limit problem with lea

[jira] [Assigned] (SPARK-22550) 64KB JVM bytecode limit problem with elt

[ https://issues.apache.org/jira/browse/SPARK-22550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22550: --- Assignee: Kazuaki Ishizaki > 64KB JVM bytecode limit problem with elt >

[jira] [Resolved] (SPARK-22550) 64KB JVM bytecode limit problem with elt

[ https://issues.apache.org/jira/browse/SPARK-22550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22550. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 Issue resolved by pull req

[jira] [Commented] (SPARK-22568) Split pair RDDs by keys - an efficient (maybe?) substitute to groupByKey

[ https://issues.apache.org/jira/browse/SPARK-22568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260616#comment-16260616 ] Éderson Cássio commented on SPARK-22568: Thanks for your response. How can I filt

[jira] [Updated] (SPARK-22573) SQL Planner is including unnecessary columns in the projection

[ https://issues.apache.org/jira/browse/SPARK-22573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajkishore Hembram updated SPARK-22573: --- Description: While I was running TPC-H query 18 for benchmarking, I observed that the

[jira] [Updated] (SPARK-22573) SQL Planner is including unnecessary columns in the projection

[ https://issues.apache.org/jira/browse/SPARK-22573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajkishore Hembram updated SPARK-22573: --- Description: While I was running TPC-H query 18 for benchmarking, I observed that the

[jira] [Created] (SPARK-22573) SQL Planner is including unnecessary columns in the projection

Rajkishore Hembram created SPARK-22573: -- Summary: SQL Planner is including unnecessary columns in the projection Key: SPARK-22573 URL: https://issues.apache.org/jira/browse/SPARK-22573 Project: S

[jira] [Assigned] (SPARK-22508) 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

[ https://issues.apache.org/jira/browse/SPARK-22508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22508: --- Assignee: Kazuaki Ishizaki > 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.cr

[jira] [Resolved] (SPARK-22508) 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

[ https://issues.apache.org/jira/browse/SPARK-22508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22508. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 Issue resolved by pull req

[jira] [Created] (SPARK-22572) spark-shell does not re-initialize on :replay

Mark Petruska created SPARK-22572: - Summary: spark-shell does not re-initialize on :replay Key: SPARK-22572 URL: https://issues.apache.org/jira/browse/SPARK-22572 Project: Spark Issue Type: B

[jira] [Commented] (SPARK-18859) Catalyst codegen does not mark column as nullable when it should. Causes NPE

[ https://issues.apache.org/jira/browse/SPARK-18859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260481#comment-16260481 ] Anurag Agarwal commented on SPARK-18859: Another workaround for prostgres databas

[jira] [Resolved] (SPARK-22541) Dataframes: applying multiple filters one after another using udfs and accumulators results in faulty accumulators

[ https://issues.apache.org/jira/browse/SPARK-22541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22541. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19787 [https://githu

[jira] [Assigned] (SPARK-22541) Dataframes: applying multiple filters one after another using udfs and accumulators results in faulty accumulators

[ https://issues.apache.org/jira/browse/SPARK-22541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22541: --- Assignee: Liang-Chi Hsieh > Dataframes: applying multiple filters one after another using ud

[jira] [Commented] (SPARK-22564) csv reader no longer logs errors

[ https://issues.apache.org/jira/browse/SPARK-22564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260428#comment-16260428 ] Adrian Bridgett commented on SPARK-22564: - I guess this should be closed as won't

[jira] [Commented] (SPARK-22564) csv reader no longer logs errors

[ https://issues.apache.org/jira/browse/SPARK-22564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260424#comment-16260424 ] Adrian Bridgett commented on SPARK-22564: - Ah, I had an old copy of CSVRelation.s