[jira] [Commented] (SPARK-23628) WholeStageCodegen can generate methods with too many params

[ https://issues.apache.org/jira/browse/SPARK-23628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392651#comment-16392651 ] Apache Spark commented on SPARK-23628: -- User 'mgaido91' has created a pull request f

[jira] [Created] (SPARK-23639) SparkSQL CLI fails talk to Kerberized metastore when use proxy user

Kent Yao created SPARK-23639: Summary: SparkSQL CLI fails talk to Kerberized metastore when use proxy user Key: SPARK-23639 URL: https://issues.apache.org/jira/browse/SPARK-23639 Project: Spark

[jira] [Assigned] (SPARK-23639) SparkSQL CLI fails talk to Kerberized metastore when use proxy user

[ https://issues.apache.org/jira/browse/SPARK-23639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23639: Assignee: Apache Spark > SparkSQL CLI fails talk to Kerberized metastore when use proxy us

[jira] [Commented] (SPARK-23639) SparkSQL CLI fails talk to Kerberized metastore when use proxy user

[ https://issues.apache.org/jira/browse/SPARK-23639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392680#comment-16392680 ] Apache Spark commented on SPARK-23639: -- User 'yaooqinn' has created a pull request f

[jira] [Assigned] (SPARK-23639) SparkSQL CLI fails talk to Kerberized metastore when use proxy user

[ https://issues.apache.org/jira/browse/SPARK-23639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23639: Assignee: (was: Apache Spark) > SparkSQL CLI fails talk to Kerberized metastore when u

[jira] [Created] (SPARK-23640) Hadoop config may override spark config

Yuming Wang created SPARK-23640: --- Summary: Hadoop config may override spark config Key: SPARK-23640 URL: https://issues.apache.org/jira/browse/SPARK-23640 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-23641) Wrong username when making relative path to Hive LOAD DATA absolute

Andrei Badea created SPARK-23641: Summary: Wrong username when making relative path to Hive LOAD DATA absolute Key: SPARK-23641 URL: https://issues.apache.org/jira/browse/SPARK-23641 Project: Spark

[jira] [Updated] (SPARK-23641) Wrong username when making relative path to Hive LOAD DATA absolute

[ https://issues.apache.org/jira/browse/SPARK-23641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrei Badea updated SPARK-23641: - Description: We have an application deployed in yarn-cluster mode. At some point, the applicatio

[jira] [Assigned] (SPARK-23640) Hadoop config may override spark config

[ https://issues.apache.org/jira/browse/SPARK-23640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23640: Assignee: (was: Apache Spark) > Hadoop config may override spark config >

[jira] [Commented] (SPARK-23640) Hadoop config may override spark config

[ https://issues.apache.org/jira/browse/SPARK-23640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392741#comment-16392741 ] Apache Spark commented on SPARK-23640: -- User 'wangyum' has created a pull request fo

[jira] [Assigned] (SPARK-23640) Hadoop config may override spark config

[ https://issues.apache.org/jira/browse/SPARK-23640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23640: Assignee: Apache Spark > Hadoop config may override spark config > ---

[jira] [Updated] (SPARK-23640) Hadoop config may override spark config

[ https://issues.apache.org/jira/browse/SPARK-23640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23640: Description: More details: https://github.com/apache/spark/pull/20785#issue-173982312 > Hadoop con

[jira] [Commented] (SPARK-23588) Add interpreted execution for CatalystToExternalMap expression

[ https://issues.apache.org/jira/browse/SPARK-23588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392768#comment-16392768 ] Takeshi Yamamuro commented on SPARK-23588: -- I'm working on this. > Add interpre

[jira] [Assigned] (SPARK-23588) Add interpreted execution for CatalystToExternalMap expression

[ https://issues.apache.org/jira/browse/SPARK-23588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23588: - Assignee: Takeshi Yamamuro > Add interpreted execution for CatalystToExternalMap

[jira] [Updated] (SPARK-23641) Wrong username when making relative path to Hive LOAD DATA absolute

[ https://issues.apache.org/jira/browse/SPARK-23641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrei Badea updated SPARK-23641: - Priority: Minor (was: Major) > Wrong username when making relative path to Hive LOAD DATA absolu

[jira] [Updated] (SPARK-23641) Wrong username when making relative path to Hive LOAD DATA absolute

[ https://issues.apache.org/jira/browse/SPARK-23641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrei Badea updated SPARK-23641: - Description: We have an application deployed in yarn-cluster mode. At some point, the applicatio

[jira] [Updated] (SPARK-23436) Incorrect Date column Inference in partition discovery

[ https://issues.apache.org/jira/browse/SPARK-23436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23436: - Fix Version/s: 2.3.1 > Incorrect Date column Inference in partition discovery > -

[jira] [Updated] (SPARK-23633) Update Pandas UDFs section in sql-programming-guide

[ https://issues.apache.org/jira/browse/SPARK-23633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23633: - Target Version/s: 2.4.0 Fix Version/s: (was: 2.4.0) > Update Pandas UDFs section in s

[jira] [Commented] (SPARK-18496) java.lang.AssertionError: assertion failed

[ https://issues.apache.org/jira/browse/SPARK-18496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392844#comment-16392844 ] Biswajit Nayak commented on SPARK-18496: Has this issue been fixed ? We are facin

[jira] [Resolved] (SPARK-23600) conda_panda_example test fails to import panda lib with Spark 2.3

[ https://issues.apache.org/jira/browse/SPARK-23600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Supreeth Sharma resolved SPARK-23600. - Resolution: Won't Fix > conda_panda_example test fails to import panda lib with Spark 2.3

[jira] [Commented] (SPARK-23600) conda_panda_example test fails to import panda lib with Spark 2.3

[ https://issues.apache.org/jira/browse/SPARK-23600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392847#comment-16392847 ] Supreeth Sharma commented on SPARK-23600: - I have mistakenly created this jira.

[jira] [Issue Comment Deleted] (SPARK-18496) java.lang.AssertionError: assertion failed

[ https://issues.apache.org/jira/browse/SPARK-18496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Biswajit Nayak updated SPARK-18496: --- Comment: was deleted (was: Has this issue been fixed ? We are facing the same error in spark

[jira] [Commented] (SPARK-14681) Provide label/impurity stats for spark.ml decision tree nodes

[ https://issues.apache.org/jira/browse/SPARK-14681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392942#comment-16392942 ] Apache Spark commented on SPARK-14681: -- User 'WeichenXu123' has created a pull reque

[jira] [Assigned] (SPARK-21030) extend hint syntax to support any expression for Python and R

[ https://issues.apache.org/jira/browse/SPARK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21030: Assignee: Apache Spark > extend hint syntax to support any expression for Python and R > -

[jira] [Commented] (SPARK-21030) extend hint syntax to support any expression for Python and R

[ https://issues.apache.org/jira/browse/SPARK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393086#comment-16393086 ] Apache Spark commented on SPARK-21030: -- User 'DylanGuedes' has created a pull reques

[jira] [Assigned] (SPARK-21030) extend hint syntax to support any expression for Python and R

[ https://issues.apache.org/jira/browse/SPARK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21030: Assignee: (was: Apache Spark) > extend hint syntax to support any expression for Pytho

[jira] [Commented] (SPARK-23610) Cast of ArrayType of NullType to ArrayType of nullable material type does not work

[ https://issues.apache.org/jira/browse/SPARK-23610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393173#comment-16393173 ] Kazuaki Ishizaki commented on SPARK-23610: -- The following code works without an

[jira] [Commented] (SPARK-23556) design doc for write side

[ https://issues.apache.org/jira/browse/SPARK-23556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393300#comment-16393300 ] Jose Torres commented on SPARK-23556: - Doc:  https://docs.google.com/document/d/1PJYf

[jira] [Updated] (SPARK-23636) [SPARK 2.2] | Kafka Consumer | KafkaUtils.createRDD throws Exception - java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access

[ https://issues.apache.org/jira/browse/SPARK-23636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak updated SPARK-23636: --- Description: h2.   h2. Summary   While using the KafkaUtils.createRDD API - we receive below listed error, 

[jira] [Updated] (SPARK-23636) [SPARK 2.2] | Kafka Consumer | KafkaUtils.createRDD throws Exception - java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access

[ https://issues.apache.org/jira/browse/SPARK-23636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak updated SPARK-23636: --- Description: h2.   h2. Summary   While using the KafkaUtils.createRDD API - we receive below listed error, 

[jira] [Updated] (SPARK-23636) [SPARK 2.2] | Kafka Consumer | KafkaUtils.createRDD throws Exception - java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access

[ https://issues.apache.org/jira/browse/SPARK-23636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak updated SPARK-23636: --- Description: h2.   h2. Summary   While using the KafkaUtils.createRDD API - we receive below listed error, 

[jira] [Updated] (SPARK-23636) [SPARK 2.2] | Kafka Consumer | KafkaUtils.createRDD throws Exception - java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access

[ https://issues.apache.org/jira/browse/SPARK-23636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak updated SPARK-23636: --- Description: h2.   h2. Summary   While using the KafkaUtils.createRDD API - we receive below listed error, 

[jira] [Updated] (SPARK-23636) [SPARK 2.2] | Kafka Consumer | KafkaUtils.createRDD throws Exception - java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access

[ https://issues.apache.org/jira/browse/SPARK-23636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak updated SPARK-23636: --- Description: h2.   h2. Summary   While using the KafkaUtils.createRDD API - we receive below listed error, 

[jira] [Assigned] (SPARK-23630) Spark-on-YARN missing user customizations of hadoop config

[ https://issues.apache.org/jira/browse/SPARK-23630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23630: -- Assignee: Marcelo Vanzin > Spark-on-YARN missing user customizations of hadoop config

[jira] [Resolved] (SPARK-23630) Spark-on-YARN missing user customizations of hadoop config

[ https://issues.apache.org/jira/browse/SPARK-23630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23630. Resolution: Fixed Fix Version/s: 2.3.1 2.4.0 Issue resolved by pu

[jira] [Commented] (SPARK-23605) Conflicting dependencies for janino in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393620#comment-16393620 ] Thirumal Rao Raghunath commented on SPARK-23605: Is there a workaround fo

[jira] [Resolved] (SPARK-23628) WholeStageCodegen can generate methods with too many params

[ https://issues.apache.org/jira/browse/SPARK-23628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-23628. - Resolution: Fixed Assignee: Marco Gaido Fix Version/s: 2.4.0 2.

[jira] [Commented] (SPARK-23510) Support read data from Hive 2.2 and Hive 2.3 metastore

[ https://issues.apache.org/jira/browse/SPARK-23510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393690#comment-16393690 ] Apache Spark commented on SPARK-23510: -- User 'gatorsmile' has created a pull request

[jira] [Created] (SPARK-23642) isZero scaladoc for LongAccumulator describes wrong method

Sean created SPARK-23642: Summary: isZero scaladoc for LongAccumulator describes wrong method Key: SPARK-23642 URL: https://issues.apache.org/jira/browse/SPARK-23642 Project: Spark Issue Type: Docume

[jira] [Updated] (SPARK-23642) isZero scaladoc for LongAccumulator describes wrong method

[ https://issues.apache.org/jira/browse/SPARK-23642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean updated SPARK-23642: - Labels: pull-request-available (was: patch pull-request-available) > isZero scaladoc for LongAccumulator describ

[jira] [Updated] (SPARK-23642) isZero scaladoc for LongAccumulator describes wrong method

[ https://issues.apache.org/jira/browse/SPARK-23642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean updated SPARK-23642: - Flags: (was: Patch) > isZero scaladoc for LongAccumulator describes wrong method >

[jira] [Commented] (SPARK-23605) Conflicting dependencies for janino in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393793#comment-16393793 ] Kazuaki Ishizaki commented on SPARK-23605: -- Would it be possible to post a progr

[jira] [Comment Edited] (SPARK-23605) Conflicting dependencies for janino in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393793#comment-16393793 ] Kazuaki Ishizaki edited comment on SPARK-23605 at 3/9/18 11:30 PM:

[jira] [Resolved] (SPARK-23624) Revise doc of method pushFilters

[ https://issues.apache.org/jira/browse/SPARK-23624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23624. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.4.0 2.3.1

[jira] [Commented] (SPARK-23605) Conflicting dependencies for janino in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393881#comment-16393881 ] Tao Liu commented on SPARK-23605: - [~thirumalrao] the only pom change I had to make to re

[jira] [Commented] (SPARK-23605) Conflicting dependencies for janino in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393917#comment-16393917 ] Thirumal Rao Raghunath commented on SPARK-23605: Thanks [~t73liu] . Your

[jira] [Commented] (SPARK-23605) Conflicting dependencies for janino in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393929#comment-16393929 ] Tao Liu commented on SPARK-23605: - [~kiszk] The dependency conflict only appears for me w

[jira] [Updated] (SPARK-23605) Conflicting dependencies for janino in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Liu updated SPARK-23605: Attachment: pom.xml > Conflicting dependencies for janino in 2.3.0 > --

[jira] [Comment Edited] (SPARK-23605) Conflicting dependencies for janino in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393929#comment-16393929 ] Tao Liu edited comment on SPARK-23605 at 3/10/18 1:43 AM: -- [~kis

[jira] [Commented] (SPARK-23605) Conflicting dependencies for janino in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16394035#comment-16394035 ] Kazuaki Ishizaki commented on SPARK-23605: -- Thank you for providing information.

[jira] [Commented] (SPARK-23618) docker-image-tool.sh Fails While Building Image

[ https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16394044#comment-16394044 ] Apache Spark commented on SPARK-23618: -- User 'jooseong' has created a pull request f

[jira] [Assigned] (SPARK-23618) docker-image-tool.sh Fails While Building Image

[ https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23618: Assignee: (was: Apache Spark) > docker-image-tool.sh Fails While Building Image >

[jira] [Assigned] (SPARK-23618) docker-image-tool.sh Fails While Building Image

[ https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23618: Assignee: Apache Spark > docker-image-tool.sh Fails While Building Image > ---