[jira] [Created] (SPARK-22579) BlockManager.getRemoteValues and BlockManager.getRemoteBytes should be implemented using streaming

Eyal Farago created SPARK-22579: --- Summary: BlockManager.getRemoteValues and BlockManager.getRemoteBytes should be implemented using streaming Key: SPARK-22579 URL: https://issues.apache.org/jira/browse/SPARK-22579

[jira] [Updated] (SPARK-22560) Must create spark session directly to connect to hive

[ https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ran Mingxuan updated SPARK-22560: - Affects Version/s: 2.2.0 > Must create spark session directly to connect to hive >

[jira] [Comment Edited] (SPARK-22560) Must create spark session directly to connect to hive

[ https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262093#comment-16262093 ] Ran Mingxuan edited comment on SPARK-22560 at 11/22/17 7:47 AM: I think

[jira] [Commented] (SPARK-22560) Must create spark session directly to connect to hive

[ https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262093#comment-16262093 ] Ran Mingxuan commented on SPARK-22560: -- I think the problem is introduced by

[jira] [Created] (SPARK-22578) CSV with quoted line breaks not correctly parsed

Carlos Barahona created SPARK-22578: --- Summary: CSV with quoted line breaks not correctly parsed Key: SPARK-22578 URL: https://issues.apache.org/jira/browse/SPARK-22578 Project: Spark Issue

[jira] [Updated] (SPARK-22543) fix java 64kb compile error for deeply nested expressions

[ https://issues.apache.org/jira/browse/SPARK-22543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22543: Target Version/s: 2.3.0 (was: 2.2.1, 2.3.0) > fix java 64kb compile error for deeply nested expressions >

[jira] [Resolved] (SPARK-22548) Incorrect nested AND expression pushed down to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-22548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22548. - Resolution: Fixed Assignee: Jia Li Fix Version/s: 2.3.0 2.2.1

[jira] [Updated] (SPARK-22560) Must create spark session directly to connect to hive

[ https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ran Mingxuan updated SPARK-22560: - Description: In a java project I have to use both JavaSparkContext and SparkSession. I find

[jira] [Commented] (SPARK-22560) Must create spark session directly to connect to hive

[ https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261887#comment-16261887 ] Ran Mingxuan commented on SPARK-22560: -- [~srowen] Thank you for your reply. Maybe I should declare

[jira] [Commented] (SPARK-22374) STS ran into OOM in a secure cluster

[ https://issues.apache.org/jira/browse/SPARK-22374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261875#comment-16261875 ] Dongjoon Hyun commented on SPARK-22374: --- Thank you for advice. I'll consider that. > STS ran into

[jira] [Updated] (SPARK-22510) Exceptions caused by 64KB JVM bytecode or constant pool entry limits

[ https://issues.apache.org/jira/browse/SPARK-22510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22510: - Description: Codegen can throw an exception due to the 64KB JVM bytecode or 64K constant

[jira] [Updated] (SPARK-22510) Exceptions caused by 64KB JVM bytecode or 64K constant pool entry limit

[ https://issues.apache.org/jira/browse/SPARK-22510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22510: - Summary: Exceptions caused by 64KB JVM bytecode or 64K constant pool entry limit (was:

[jira] [Updated] (SPARK-22510) Exceptions caused by 64KB JVM bytecode or constant pool entry limits

[ https://issues.apache.org/jira/browse/SPARK-22510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22510: - Summary: Exceptions caused by 64KB JVM bytecode or constant pool entry limits (was:

[jira] [Commented] (SPARK-22575) Making Spark Thrift Server clean up its cache

[ https://issues.apache.org/jira/browse/SPARK-22575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261808#comment-16261808 ] Oz Ben-Ami commented on SPARK-22575: We are not explicitly caching any tables, only running SQL

[jira] [Commented] (SPARK-22575) Making Spark Thrift Server clean up its cache

[ https://issues.apache.org/jira/browse/SPARK-22575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261557#comment-16261557 ] Marco Gaido commented on SPARK-22575: - does it happen because you are caching some tables and never

[jira] [Resolved] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22500. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull

[jira] [Assigned] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22500: --- Assignee: Kazuaki Ishizaki > 64KB JVM bytecode limit problem with cast >

[jira] [Commented] (SPARK-22374) STS ran into OOM in a secure cluster

[ https://issues.apache.org/jira/browse/SPARK-22374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261444#comment-16261444 ] Steve Loughran commented on SPARK-22374: We need to do something about this, it is dangerously

[jira] [Assigned] (SPARK-22475) show histogram in DESC COLUMN command

[ https://issues.apache.org/jira/browse/SPARK-22475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22475: --- Assignee: Marco Gaido > show histogram in DESC COLUMN command >

[jira] [Resolved] (SPARK-22475) show histogram in DESC COLUMN command

[ https://issues.apache.org/jira/browse/SPARK-22475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22475. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19774

[jira] [Resolved] (SPARK-22576) Spark SQL locate returns incorrect value when the start position is negative

[ https://issues.apache.org/jira/browse/SPARK-22576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22576. --- Resolution: Not A Problem Yes, there's nothing about HiveQL (which Spark follows) or Spark SQL that

[jira] [Resolved] (SPARK-22165) Type conflicts between dates, timestamps and date in partition column

[ https://issues.apache.org/jira/browse/SPARK-22165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22165. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19389

[jira] [Assigned] (SPARK-22165) Type conflicts between dates, timestamps and date in partition column

[ https://issues.apache.org/jira/browse/SPARK-22165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22165: --- Assignee: Hyukjin Kwon > Type conflicts between dates, timestamps and date in partition

[jira] [Commented] (SPARK-20586) Add deterministic to ScalaUDF

[ https://issues.apache.org/jira/browse/SPARK-20586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261393#comment-16261393 ] Bago Amirbekian commented on SPARK-20586: - Also a follow up questions, are the performance

[jira] [Commented] (SPARK-20586) Add deterministic to ScalaUDF

[ https://issues.apache.org/jira/browse/SPARK-20586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261377#comment-16261377 ] Bago Amirbekian commented on SPARK-20586: - Is there some documentation somewhere about the right

[jira] [Commented] (SPARK-22576) Spark SQL locate returns incorrect value when the start position is negative

[ https://issues.apache.org/jira/browse/SPARK-22576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261347#comment-16261347 ] Marco Gaido commented on SPARK-22576: - I see, but this is SAP Sysbase. Why do you think Spark should

[jira] [Commented] (SPARK-22576) Spark SQL locate returns incorrect value when the start position is negative

[ https://issues.apache.org/jira/browse/SPARK-22576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261313#comment-16261313 ] Yuxin Cao commented on SPARK-22576: ---

[jira] [Created] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

Thomas Graves created SPARK-22577: - Summary: executor page blacklist status should update with TaskSet level blacklisting Key: SPARK-22577 URL: https://issues.apache.org/jira/browse/SPARK-22577

[jira] [Commented] (SPARK-22526) Spark hangs while reading binary files from S3

[ https://issues.apache.org/jira/browse/SPARK-22526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261292#comment-16261292 ] Steve Loughran commented on SPARK-22526: S3a uses the AWS S3 client, which uses httpclient

[jira] [Commented] (SPARK-22576) Spark SQL locate returns incorrect value when the start position is negative

[ https://issues.apache.org/jira/browse/SPARK-22576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261293#comment-16261293 ] Marco Gaido commented on SPARK-22576: - why do you expect locate to work like this and not as it is

[jira] [Assigned] (SPARK-22521) VectorIndexerModel support handle unseen categories via handleInvalid: Python API

[ https://issues.apache.org/jira/browse/SPARK-22521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reassigned SPARK-22521: --- Assignee: Weichen Xu > VectorIndexerModel support handle unseen categories via handleInvalid:

[jira] [Resolved] (SPARK-22521) VectorIndexerModel support handle unseen categories via handleInvalid: Python API

[ https://issues.apache.org/jira/browse/SPARK-22521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-22521. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19753

[jira] [Updated] (SPARK-22576) Spark SQL locate returns incorrect value when the start position is negative

[ https://issues.apache.org/jira/browse/SPARK-22576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Cao updated SPARK-22576: -- Summary: Spark SQL locate returns incorrect value when the start position is negative (was: Spark SQL

[jira] [Created] (SPARK-22576) Spark SQL locate returns incorrect value when position is negative

Yuxin Cao created SPARK-22576: - Summary: Spark SQL locate returns incorrect value when position is negative Key: SPARK-22576 URL: https://issues.apache.org/jira/browse/SPARK-22576 Project: Spark

subscribe

[jira] [Created] (SPARK-22575) Making Spark Thrift Server clean up its cache

Oz Ben-Ami created SPARK-22575: -- Summary: Making Spark Thrift Server clean up its cache Key: SPARK-22575 URL: https://issues.apache.org/jira/browse/SPARK-22575 Project: Spark Issue Type:

[jira] [Commented] (SPARK-22574) Wrong request causing Spark Dispatcher going inactive

[ https://issues.apache.org/jira/browse/SPARK-22574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260954#comment-16260954 ] Apache Spark commented on SPARK-22574: -- User 'Gschiavon' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22574) Wrong request causing Spark Dispatcher going inactive

[ https://issues.apache.org/jira/browse/SPARK-22574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22574: Assignee: Apache Spark > Wrong request causing Spark Dispatcher going inactive >

[jira] [Assigned] (SPARK-22574) Wrong request causing Spark Dispatcher going inactive

[ https://issues.apache.org/jira/browse/SPARK-22574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22574: Assignee: (was: Apache Spark) > Wrong request causing Spark Dispatcher going inactive

[jira] [Created] (SPARK-22574) Wrong request causing Spark Dispatcher going inactive

German Schiavon Matteo created SPARK-22574: -- Summary: Wrong request causing Spark Dispatcher going inactive Key: SPARK-22574 URL: https://issues.apache.org/jira/browse/SPARK-22574 Project:

[jira] [Commented] (SPARK-22323) Design doc for different types of pandas_udf

[ https://issues.apache.org/jira/browse/SPARK-22323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260924#comment-16260924 ] Li Jin commented on SPARK-22323: I believe this is done. (At least my original indention for this). The

[jira] [Resolved] (SPARK-22323) Design doc for different types of pandas_udf

[ https://issues.apache.org/jira/browse/SPARK-22323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin resolved SPARK-22323. Resolution: Fixed > Design doc for different types of pandas_udf >

[jira] [Commented] (SPARK-22516) CSV Read breaks: When "multiLine" = "true", if "comment" option is set as last line's first character

[ https://issues.apache.org/jira/browse/SPARK-22516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260904#comment-16260904 ] Marco Gaido commented on SPARK-22516: - [~crkumaresh24] I can't reproduce the issue with the new file

[jira] [Assigned] (SPARK-22566) Better error message for `_merge_type` in Pandas to Spark DF conversion

[ https://issues.apache.org/jira/browse/SPARK-22566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22566: Assignee: (was: Apache Spark) > Better error message for `_merge_type` in Pandas to

[jira] [Assigned] (SPARK-22566) Better error message for `_merge_type` in Pandas to Spark DF conversion

[ https://issues.apache.org/jira/browse/SPARK-22566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22566: Assignee: Apache Spark > Better error message for `_merge_type` in Pandas to Spark DF

[jira] [Commented] (SPARK-22566) Better error message for `_merge_type` in Pandas to Spark DF conversion

[ https://issues.apache.org/jira/browse/SPARK-22566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260889#comment-16260889 ] Apache Spark commented on SPARK-22566: -- User 'gberger' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22552) Cannot Union multiple kafka streams

[ https://issues.apache.org/jira/browse/SPARK-22552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22552: - Assignee: (was: Shixiong Zhu) Priority: Minor (was: Major) Fix Version/s:

[jira] [Commented] (SPARK-22572) spark-shell does not re-initialize on :replay

[ https://issues.apache.org/jira/browse/SPARK-22572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260759#comment-16260759 ] Mark Petruska commented on SPARK-22572: --- [~srowen]: Can I ask you to look at

[jira] [Assigned] (SPARK-22572) spark-shell does not re-initialize on :replay

[ https://issues.apache.org/jira/browse/SPARK-22572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22572: Assignee: Apache Spark > spark-shell does not re-initialize on :replay >

[jira] [Assigned] (SPARK-22572) spark-shell does not re-initialize on :replay

[ https://issues.apache.org/jira/browse/SPARK-22572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22572: Assignee: (was: Apache Spark) > spark-shell does not re-initialize on :replay >

[jira] [Commented] (SPARK-22572) spark-shell does not re-initialize on :replay

[ https://issues.apache.org/jira/browse/SPARK-22572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260756#comment-16260756 ] Apache Spark commented on SPARK-22572: -- User 'mpetruska' has created a pull request for this issue:

[jira] [Resolved] (SPARK-20133) User guide for spark.ml.stat.ChiSquareTest

[ https://issues.apache.org/jira/browse/SPARK-20133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20133. --- Resolution: Not A Problem > User guide for spark.ml.stat.ChiSquareTest >

[jira] [Commented] (SPARK-22572) spark-shell does not re-initialize on :replay

[ https://issues.apache.org/jira/browse/SPARK-22572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260736#comment-16260736 ] Sean Owen commented on SPARK-22572: --- Yes, I think this is just how it is. The way Spark is initialized

[jira] [Commented] (SPARK-22528) History service and non-HDFS filesystems

[ https://issues.apache.org/jira/browse/SPARK-22528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260727#comment-16260727 ] paul mackles commented on SPARK-22528: -- In case anyone else bumps into this, I received some

[jira] [Commented] (SPARK-22568) Split pair RDDs by keys - an efficient (maybe?) substitute to groupByKey

[ https://issues.apache.org/jira/browse/SPARK-22568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260701#comment-16260701 ] Sean Owen commented on SPARK-22568: --- To filter individually you would have to collect distinct values

[jira] [Resolved] (SPARK-22571) How to connect to secure(Kerberos) kafka broker using native KafkaConsumer api in Spark Streamming application

[ https://issues.apache.org/jira/browse/SPARK-22571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22571. --- Resolution: Invalid This should go to the mailing list. > How to connect to secure(Kerberos) kafka

[jira] [Resolved] (SPARK-22569) Clean up caller of splitExpressions and addMutableState

[ https://issues.apache.org/jira/browse/SPARK-22569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22569. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19790

[jira] [Updated] (SPARK-22538) SQLTransformer.transform(inputDataFrame) uncaches inputDataFrame

[ https://issues.apache.org/jira/browse/SPARK-22538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22538: Fix Version/s: (was: 2.2.2) 2.2.1 >

[jira] [Updated] (SPARK-22498) 64KB JVM bytecode limit problem with concat

[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22498: Fix Version/s: (was: 2.2.2) 2.2.1 > 64KB JVM bytecode limit problem with

[jira] [Updated] (SPARK-22549) 64KB JVM bytecode limit problem with concat_ws

[ https://issues.apache.org/jira/browse/SPARK-22549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22549: Fix Version/s: (was: 2.2.2) 2.2.1 > 64KB JVM bytecode limit problem with

[jira] [Updated] (SPARK-22494) Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception

[ https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22494: Fix Version/s: (was: 2.2.2) 2.2.1 > Coalesce and AtLeastNNonNulls can cause

[jira] [Updated] (SPARK-22501) 64KB JVM bytecode limit problem with in

[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22501: Fix Version/s: (was: 2.2.2) 2.2.1 > 64KB JVM bytecode limit problem with in

[jira] [Updated] (SPARK-22550) 64KB JVM bytecode limit problem with elt

[ https://issues.apache.org/jira/browse/SPARK-22550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22550: Fix Version/s: (was: 2.2.2) 2.2.1 > 64KB JVM bytecode limit problem with

[jira] [Updated] (SPARK-22508) 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

[ https://issues.apache.org/jira/browse/SPARK-22508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22508: Fix Version/s: (was: 2.2.2) 2.2.1 > 64KB JVM bytecode limit problem with

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22499: Fix Version/s: (was: 2.2.2) 2.2.1 > 64KB JVM bytecode limit problem with

[jira] [Assigned] (SPARK-22550) 64KB JVM bytecode limit problem with elt

[ https://issues.apache.org/jira/browse/SPARK-22550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22550: --- Assignee: Kazuaki Ishizaki > 64KB JVM bytecode limit problem with elt >

[jira] [Resolved] (SPARK-22550) 64KB JVM bytecode limit problem with elt

[ https://issues.apache.org/jira/browse/SPARK-22550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22550. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 Issue resolved by pull

[jira] [Commented] (SPARK-22568) Split pair RDDs by keys - an efficient (maybe?) substitute to groupByKey

[ https://issues.apache.org/jira/browse/SPARK-22568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260616#comment-16260616 ] Éderson Cássio commented on SPARK-22568: Thanks for your response. How can I filter by each

[jira] [Updated] (SPARK-22573) SQL Planner is including unnecessary columns in the projection

[ https://issues.apache.org/jira/browse/SPARK-22573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajkishore Hembram updated SPARK-22573: --- Description: While I was running TPC-H query 18 for benchmarking, I observed that

[jira] [Updated] (SPARK-22573) SQL Planner is including unnecessary columns in the projection

[ https://issues.apache.org/jira/browse/SPARK-22573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajkishore Hembram updated SPARK-22573: --- Description: While I was running TPC-H query 18 for benchmarking, I observed that

[jira] [Created] (SPARK-22573) SQL Planner is including unnecessary columns in the projection

Rajkishore Hembram created SPARK-22573: -- Summary: SQL Planner is including unnecessary columns in the projection Key: SPARK-22573 URL: https://issues.apache.org/jira/browse/SPARK-22573 Project:

[jira] [Assigned] (SPARK-22508) 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

[ https://issues.apache.org/jira/browse/SPARK-22508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22508: --- Assignee: Kazuaki Ishizaki > 64KB JVM bytecode limit problem with

[jira] [Resolved] (SPARK-22508) 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

[ https://issues.apache.org/jira/browse/SPARK-22508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22508. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 Issue resolved by pull

[jira] [Created] (SPARK-22572) spark-shell does not re-initialize on :replay

Mark Petruska created SPARK-22572: - Summary: spark-shell does not re-initialize on :replay Key: SPARK-22572 URL: https://issues.apache.org/jira/browse/SPARK-22572 Project: Spark Issue Type:

[jira] [Commented] (SPARK-18859) Catalyst codegen does not mark column as nullable when it should. Causes NPE

[ https://issues.apache.org/jira/browse/SPARK-18859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260481#comment-16260481 ] Anurag Agarwal commented on SPARK-18859: Another workaround for prostgres databases can be to

[jira] [Resolved] (SPARK-22541) Dataframes: applying multiple filters one after another using udfs and accumulators results in faulty accumulators

[ https://issues.apache.org/jira/browse/SPARK-22541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22541. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19787

[jira] [Assigned] (SPARK-22541) Dataframes: applying multiple filters one after another using udfs and accumulators results in faulty accumulators

[ https://issues.apache.org/jira/browse/SPARK-22541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22541: --- Assignee: Liang-Chi Hsieh > Dataframes: applying multiple filters one after another using

[jira] [Commented] (SPARK-22564) csv reader no longer logs errors

[ https://issues.apache.org/jira/browse/SPARK-22564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260428#comment-16260428 ] Adrian Bridgett commented on SPARK-22564: - I guess this should be closed as won't fix. Maybe a

[jira] [Commented] (SPARK-22564) csv reader no longer logs errors

[ https://issues.apache.org/jira/browse/SPARK-22564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260424#comment-16260424 ] Adrian Bridgett commented on SPARK-22564: - Ah, I had an old copy of CSVRelation.scala from before