[jira] [Assigned] (SPARK-22668) CodegenContext.splitExpressions() creates incorrect results with global variable arguments

[ https://issues.apache.org/jira/browse/SPARK-22668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22668: Assignee: (was: Apache Spark) > CodegenContext.splitExpressions() creates incorrect re

[jira] [Commented] (SPARK-22668) CodegenContext.splitExpressions() creates incorrect results with global variable arguments

[ https://issues.apache.org/jira/browse/SPARK-22668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275439#comment-16275439 ] Apache Spark commented on SPARK-22668: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-22668) CodegenContext.splitExpressions() creates incorrect results with global variable arguments

[ https://issues.apache.org/jira/browse/SPARK-22668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22668: Assignee: Apache Spark > CodegenContext.splitExpressions() creates incorrect results with

[jira] [Commented] (SPARK-8418) Add single- and multi-value support to ML Transformers

[ https://issues.apache.org/jira/browse/SPARK-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275426#comment-16275426 ] Nick Pentreath commented on SPARK-8418: --- *1 I’m ok with throwing an exception. We ca

[jira] [Resolved] (SPARK-22651) Calling ImageSchema.readImages initiate multiple Hive clients

[ https://issues.apache.org/jira/browse/SPARK-22651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22651. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19845 [https://git

[jira] [Assigned] (SPARK-22651) Calling ImageSchema.readImages initiate multiple Hive clients

[ https://issues.apache.org/jira/browse/SPARK-22651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22651: Assignee: Hyukjin Kwon > Calling ImageSchema.readImages initiate multiple Hive clients > -

[jira] [Commented] (SPARK-22673) InMemoryRelation should utilize on-disk table stats whenever possible

[ https://issues.apache.org/jira/browse/SPARK-22673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275141#comment-16275141 ] Apache Spark commented on SPARK-22673: -- User 'CodingCat' has created a pull request

[jira] [Assigned] (SPARK-22673) InMemoryRelation should utilize on-disk table stats whenever possible

[ https://issues.apache.org/jira/browse/SPARK-22673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22673: Assignee: (was: Apache Spark) > InMemoryRelation should utilize on-disk table stats wh

[jira] [Assigned] (SPARK-22673) InMemoryRelation should utilize on-disk table stats whenever possible

[ https://issues.apache.org/jira/browse/SPARK-22673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22673: Assignee: Apache Spark > InMemoryRelation should utilize on-disk table stats whenever poss

[jira] [Created] (SPARK-22673) InMemoryRelation should utilize on-disk table stats whenever possible

Nan Zhu created SPARK-22673: --- Summary: InMemoryRelation should utilize on-disk table stats whenever possible Key: SPARK-22673 URL: https://issues.apache.org/jira/browse/SPARK-22673 Project: Spark

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275066#comment-16275066 ] Dmitriy Reshetnikov commented on SPARK-7736: Spark 2.2 still facing that issue

[jira] [Assigned] (SPARK-22672) Move OrcTest to `sql/core`

[ https://issues.apache.org/jira/browse/SPARK-22672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22672: Assignee: Apache Spark > Move OrcTest to `sql/core` > -- > >

[jira] [Commented] (SPARK-22672) Move OrcTest to `sql/core`

[ https://issues.apache.org/jira/browse/SPARK-22672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275053#comment-16275053 ] Apache Spark commented on SPARK-22672: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-22672) Move OrcTest to `sql/core`

[ https://issues.apache.org/jira/browse/SPARK-22672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22672: Assignee: (was: Apache Spark) > Move OrcTest to `sql/core` > -

[jira] [Commented] (SPARK-8418) Add single- and multi-value support to ML Transformers

[ https://issues.apache.org/jira/browse/SPARK-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275049#comment-16275049 ] Joseph K. Bradley commented on SPARK-8418: -- I just glanced through the various PR

[jira] [Created] (SPARK-22672) Move OrcTest to `sql/core`

Dongjoon Hyun created SPARK-22672: - Summary: Move OrcTest to `sql/core` Key: SPARK-22672 URL: https://issues.apache.org/jira/browse/SPARK-22672 Project: Spark Issue Type: Task Compo

[jira] [Resolved] (SPARK-22638) Use a separate query for StreamingQueryListenerBus

[ https://issues.apache.org/jira/browse/SPARK-22638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-22638. -- Resolution: Fixed Fix Version/s: 2.3.0 > Use a separate query for StreamingQueryListener

[jira] [Assigned] (SPARK-22671) SortMergeJoin read more data when wholeStageCodegen is off compared with when it is on

[ https://issues.apache.org/jira/browse/SPARK-22671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22671: Assignee: (was: Apache Spark) > SortMergeJoin read more data when wholeStageCodegen is

[jira] [Commented] (SPARK-16139) Audit tests for leaked threads

[ https://issues.apache.org/jira/browse/SPARK-16139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274647#comment-16274647 ] Gabor Somogyi commented on SPARK-16139: --- I would like to solve this ticket. Please

[jira] [Assigned] (SPARK-22671) SortMergeJoin read more data when wholeStageCodegen is off compared with when it is on

[ https://issues.apache.org/jira/browse/SPARK-22671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22671: Assignee: Apache Spark > SortMergeJoin read more data when wholeStageCodegen is off compar

[jira] [Commented] (SPARK-22671) SortMergeJoin read more data when wholeStageCodegen is off compared with when it is on

[ https://issues.apache.org/jira/browse/SPARK-22671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274646#comment-16274646 ] Apache Spark commented on SPARK-22671: -- User 'gczsjdy' has created a pull request fo

[jira] [Created] (SPARK-22671) SortMergeJoin read more data when wholeStageCodegen is off compared with when it is on

Chenzhao Guo created SPARK-22671: Summary: SortMergeJoin read more data when wholeStageCodegen is off compared with when it is on Key: SPARK-22671 URL: https://issues.apache.org/jira/browse/SPARK-22671

[jira] [Commented] (SPARK-22267) Spark SQL incorrectly reads ORC file when column order is different

[ https://issues.apache.org/jira/browse/SPARK-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274588#comment-16274588 ] Mark Petruska commented on SPARK-22267: --- All evidence suggests that this is a hive

[jira] [Commented] (SPARK-20299) NullPointerException when null and string are in a tuple while encoding Dataset

[ https://issues.apache.org/jira/browse/SPARK-20299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274586#comment-16274586 ] Marco Gaido commented on SPARK-20299: - I found the problems. I think some checks are

[jira] [Commented] (SPARK-22267) Spark SQL incorrectly reads ORC file when column order is different

[ https://issues.apache.org/jira/browse/SPARK-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274526#comment-16274526 ] Wenchen Fan commented on SPARK-22267: - just to confirm, is it a hive bug or a Spark o

[jira] [Commented] (SPARK-22387) propagate session configs to data source read/write options

[ https://issues.apache.org/jira/browse/SPARK-22387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274456#comment-16274456 ] Apache Spark commented on SPARK-22387: -- User 'jiangxb1987' has created a pull reques

[jira] [Assigned] (SPARK-22387) propagate session configs to data source read/write options

[ https://issues.apache.org/jira/browse/SPARK-22387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22387: Assignee: (was: Apache Spark) > propagate session configs to data source read/write op

[jira] [Assigned] (SPARK-22387) propagate session configs to data source read/write options

[ https://issues.apache.org/jira/browse/SPARK-22387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22387: Assignee: Apache Spark > propagate session configs to data source read/write options > ---

[jira] [Commented] (SPARK-22267) Spark SQL incorrectly reads ORC file when column order is different

[ https://issues.apache.org/jira/browse/SPARK-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274447#comment-16274447 ] Mark Petruska commented on SPARK-22267: --- Hi [~dongjoon], sorry for the late reply.

[jira] [Commented] (SPARK-22669) Avoid unnecessary function calls in code generation

[ https://issues.apache.org/jira/browse/SPARK-22669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274388#comment-16274388 ] Apache Spark commented on SPARK-22669: -- User 'mgaido91' has created a pull request f

[jira] [Assigned] (SPARK-22669) Avoid unnecessary function calls in code generation

[ https://issues.apache.org/jira/browse/SPARK-22669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22669: Assignee: Apache Spark > Avoid unnecessary function calls in code generation > ---

[jira] [Assigned] (SPARK-22669) Avoid unnecessary function calls in code generation

[ https://issues.apache.org/jira/browse/SPARK-22669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22669: Assignee: (was: Apache Spark) > Avoid unnecessary function calls in code generation >

[jira] [Commented] (SPARK-22670) Not able to create table in HIve with SparkSession when JavaSparkContext is already initialized.

[ https://issues.apache.org/jira/browse/SPARK-22670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274353#comment-16274353 ] Sean Owen commented on SPARK-22670: --- This is because you already created and configured

[jira] [Assigned] (SPARK-22634) Update Bouncy castle dependency

[ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22634: Assignee: (was: Apache Spark) > Update Bouncy castle dependency >

[jira] [Commented] (SPARK-22634) Update Bouncy castle dependency

[ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274349#comment-16274349 ] Apache Spark commented on SPARK-22634: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-22634) Update Bouncy castle dependency

[ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22634: Assignee: Apache Spark > Update Bouncy castle dependency > ---

[jira] [Created] (SPARK-22670) Not able to create table in HIve with SparkSession when JavaSparkContext is already initialized.

Naresh Meena created SPARK-22670: Summary: Not able to create table in HIve with SparkSession when JavaSparkContext is already initialized. Key: SPARK-22670 URL: https://issues.apache.org/jira/browse/SPARK-22670

[jira] [Commented] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274310#comment-16274310 ] Steve Loughran commented on SPARK-22657: No, more that we need to change how that

[jira] [Resolved] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22393. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19846 [https://github.co

[jira] [Assigned] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22393: - Assignee: Mark Petruska > spark-shell can't find imported types in class constructors, extends c

[jira] [Resolved] (SPARK-22664) The logs about "Connected to Zookeeper" in ReliableKafkaReceiver.scala are in wrong position

[ https://issues.apache.org/jira/browse/SPARK-22664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22664. --- Resolution: Not A Problem > The logs about "Connected to Zookeeper" in ReliableKafkaReceiver.scala a

[jira] [Updated] (SPARK-22668) CodegenContext.splitExpressions() creates incorrect results with global variable arguments

[ https://issues.apache.org/jira/browse/SPARK-22668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22668: - Summary: CodegenContext.splitExpressions() creates incorrect results with global variable

[jira] [Updated] (SPARK-22668) CodegenContext.splitExpressions() creates incorrect results with global variable arguments

[ https://issues.apache.org/jira/browse/SPARK-22668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22668: - Description: {{CodegenContext.splitExpressions()}} creates incorrect results with argumen

[jira] [Updated] (SPARK-22635) FileNotFoundException again while reading ORC files containing special characters

[ https://issues.apache.org/jira/browse/SPARK-22635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22635: - Fix Version/s: 2.2.2 > FileNotFoundException again while reading ORC files containing special >

[jira] [Updated] (SPARK-22146) FileNotFoundException while reading ORC files containing '%'

[ https://issues.apache.org/jira/browse/SPARK-22146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22146: - Fix Version/s: 2.2.2 > FileNotFoundException while reading ORC files containing '%' > ---

[jira] [Created] (SPARK-22669) Avoid unnecessary function calls in code generation

Marco Gaido created SPARK-22669: --- Summary: Avoid unnecessary function calls in code generation Key: SPARK-22669 URL: https://issues.apache.org/jira/browse/SPARK-22669 Project: Spark Issue Type:

[jira] [Commented] (SPARK-22489) Shouldn't change broadcast join buildSide if user clearly specified

[ https://issues.apache.org/jira/browse/SPARK-22489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274135#comment-16274135 ] Apache Spark commented on SPARK-22489: -- User 'wangyum' has created a pull request fo

[jira] [Commented] (SPARK-22668) CodegenContext.splitExpression() creates incorrect results with global variable arguments

[ https://issues.apache.org/jira/browse/SPARK-22668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274128#comment-16274128 ] Kazuaki Ishizaki commented on SPARK-22668: -- I am working for this. > CodegenCon

[jira] [Created] (SPARK-22668) CodegenContext.splitExpression() creates incorrect results with global variable arguments

Kazuaki Ishizaki created SPARK-22668: Summary: CodegenContext.splitExpression() creates incorrect results with global variable arguments Key: SPARK-22668 URL: https://issues.apache.org/jira/browse/SPARK-22668