[jira] [Commented] (SPARK-25461) PySpark Pandas UDF outputs incorrect results when input columns contain None

[ https://issues.apache.org/jira/browse/SPARK-25461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629831#comment-16629831 ] Liang-Chi Hsieh commented on SPARK-25461: - That's said I'm not sure if this can

[jira] [Assigned] (SPARK-25282) Fix support for spark-shell with K8s

[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25282: Assignee: (was: Apache Spark) > Fix support for spark-shell with K8s > --

[jira] [Assigned] (SPARK-25282) Fix support for spark-shell with K8s

[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25282: Assignee: Apache Spark > Fix support for spark-shell with K8s > -

[jira] [Commented] (SPARK-25282) Fix support for spark-shell with K8s

[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629833#comment-16629833 ] Apache Spark commented on SPARK-25282: -- User 'ScrapCodes' has created a pull reques

[jira] [Resolved] (SPARK-25522) Improve type promotion for input arguments of elementAt function

[ https://issues.apache.org/jira/browse/SPARK-25522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25522. - Resolution: Fixed Fix Version/s: (was: 2.4.0) 2.5.0 Issue resolved

[jira] [Updated] (SPARK-25282) Fix support for spark-shell with K8s

[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25282: Issue Type: Improvement (was: Bug) > Fix support for spark-shell with K8s > -

[jira] [Assigned] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode.

[ https://issues.apache.org/jira/browse/SPARK-25543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25543: Assignee: (was: Apache Spark) > Confusing log messages at DEBUG level, in K8s mode. >

[jira] [Commented] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode.

[ https://issues.apache.org/jira/browse/SPARK-25543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629836#comment-16629836 ] Apache Spark commented on SPARK-25543: -- User 'ScrapCodes' has created a pull reques

[jira] [Assigned] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode.

[ https://issues.apache.org/jira/browse/SPARK-25543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25543: Assignee: Apache Spark > Confusing log messages at DEBUG level, in K8s mode. > --

[jira] [Created] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs

ABHISHEK KUMAR GUPTA created SPARK-25550: Summary: [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs Key: SPARK-25550 URL: https://issues.apache.or

[jira] [Updated] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs

[ https://issues.apache.org/jira/browse/SPARK-25550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-25550: - Attachment: Screenshot from 2018-09-27 12-17-44.png > [Spark Job History] Enviro

[jira] [Updated] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs

[ https://issues.apache.org/jira/browse/SPARK-25550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-25550: - Attachment: Screenshot from 2018-09-27 12-19-05.png > [Spark Job History] Enviro

[jira] [Resolved] (SPARK-25314) Invalid PythonUDF - requires attributes from more than one child - in "on" join condition

[ https://issues.apache.org/jira/browse/SPARK-25314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25314. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22326 [https://gith

[jira] [Assigned] (SPARK-25314) Invalid PythonUDF - requires attributes from more than one child - in "on" join condition

[ https://issues.apache.org/jira/browse/SPARK-25314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25314: --- Assignee: Li Yuanjian > Invalid PythonUDF - requires attributes from more than one child -

[jira] [Commented] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs

[ https://issues.apache.org/jira/browse/SPARK-25550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629841#comment-16629841 ] ABHISHEK KUMAR GUPTA commented on SPARK-25550: -- images are attched > [Spar

[jira] [Commented] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs

[ https://issues.apache.org/jira/browse/SPARK-25550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629848#comment-16629848 ] shivusondur commented on SPARK-25550: - i am working on this, soon will raise MR > [

[jira] [Commented] (SPARK-25515) Add a config property for disabling auto deletion of PODS for debugging.

[ https://issues.apache.org/jira/browse/SPARK-25515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629857#comment-16629857 ] Prashant Sharma commented on SPARK-25515: - Also looking for an option in Kuberne

[jira] [Commented] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors

[ https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629859#comment-16629859 ] Rann Tao commented on SPARK-23002: -- got It. thanks! :) [~Adam Wang] > SparkUI inconsis

[jira] [Assigned] (SPARK-25458) Support FOR ALL COLUMNS in ANALYZE TABLE

[ https://issues.apache.org/jira/browse/SPARK-25458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25458: Assignee: (was: Apache Spark) > Support FOR ALL COLUMNS in ANALYZE TABLE > -

[jira] [Commented] (SPARK-25458) Support FOR ALL COLUMNS in ANALYZE TABLE

[ https://issues.apache.org/jira/browse/SPARK-25458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629863#comment-16629863 ] Apache Spark commented on SPARK-25458: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-25458) Support FOR ALL COLUMNS in ANALYZE TABLE

[ https://issues.apache.org/jira/browse/SPARK-25458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25458: Assignee: Apache Spark > Support FOR ALL COLUMNS in ANALYZE TABLE >

[jira] [Commented] (SPARK-25458) Support FOR ALL COLUMNS in ANALYZE TABLE

[ https://issues.apache.org/jira/browse/SPARK-25458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629866#comment-16629866 ] Apache Spark commented on SPARK-25458: -- User 'dilipbiswal' has created a pull reque

[jira] [Commented] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs

[ https://issues.apache.org/jira/browse/SPARK-25550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629869#comment-16629869 ] Apache Spark commented on SPARK-25550: -- User 'shivusondur' has created a pull reque

[jira] [Assigned] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs

[ https://issues.apache.org/jira/browse/SPARK-25550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25550: Assignee: (was: Apache Spark) > [Spark Job History] Environment Page of Spark Job His

[jira] [Assigned] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs

[ https://issues.apache.org/jira/browse/SPARK-25550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25550: Assignee: Apache Spark > [Spark Job History] Environment Page of Spark Job History UI sh

[jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

[ https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629946#comment-16629946 ] Eugeniu commented on SPARK-18112: - RE: https://issues.apache.org/jira/browse/SPARK-1811

[jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

[ https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630002#comment-16630002 ] Hyukjin Kwon commented on SPARK-18112: -- Have you provided the jars into {{spark.sql

[jira] [Commented] (SPARK-25523) Multi thread execute sparkSession.read().jdbc(url, table, properties) problem

[ https://issues.apache.org/jira/browse/SPARK-25523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630018#comment-16630018 ] Hyukjin Kwon commented on SPARK-25523: -- Can you narrow down the problem? Looks hard

[jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

[ https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630024#comment-16630024 ] Eugeniu commented on SPARK-18112: - Tried setting it to "maven" and then to "/usr/lib/hiv

[jira] [Commented] (SPARK-25524) Spark datasource for image/libsvm user guide

[ https://issues.apache.org/jira/browse/SPARK-25524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630026#comment-16630026 ] Hyukjin Kwon commented on SPARK-25524: -- How does it relate to SPARK-25347? > Spark

[jira] [Commented] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630044#comment-16630044 ] Jungtaek Lim commented on SPARK-10816: -- [~marmbrus] Could you please provide your

[jira] [Commented] (SPARK-25545) CSV loading with DROPMALFORMED mode doesn't correctly drop rows that do not confirm to non-nullable schema fields

[ https://issues.apache.org/jira/browse/SPARK-25545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630050#comment-16630050 ] Hyukjin Kwon commented on SPARK-25545: -- The problem is, we convert that into nullab

[jira] [Resolved] (SPARK-25545) CSV loading with DROPMALFORMED mode doesn't correctly drop rows that do not confirm to non-nullable schema fields

[ https://issues.apache.org/jira/browse/SPARK-25545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25545. -- Resolution: Duplicate > CSV loading with DROPMALFORMED mode doesn't correctly drop rows that d

[jira] [Created] (SPARK-25551) Remove unused InSubquery expression

Marco Gaido created SPARK-25551: --- Summary: Remove unused InSubquery expression Key: SPARK-25551 URL: https://issues.apache.org/jira/browse/SPARK-25551 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

[ https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630053#comment-16630053 ] Jungtaek Lim commented on SPARK-25380: -- [~spektom] I guess physical plan descripti

[jira] [Assigned] (SPARK-25551) Remove unused InSubquery expression

[ https://issues.apache.org/jira/browse/SPARK-25551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25551: Assignee: Apache Spark > Remove unused InSubquery expression > --

[jira] [Commented] (SPARK-25551) Remove unused InSubquery expression

[ https://issues.apache.org/jira/browse/SPARK-25551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630054#comment-16630054 ] Apache Spark commented on SPARK-25551: -- User 'mgaido91' has created a pull request

[jira] [Commented] (SPARK-25551) Remove unused InSubquery expression

[ https://issues.apache.org/jira/browse/SPARK-25551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630056#comment-16630056 ] Apache Spark commented on SPARK-25551: -- User 'mgaido91' has created a pull request

[jira] [Assigned] (SPARK-25551) Remove unused InSubquery expression

[ https://issues.apache.org/jira/browse/SPARK-25551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25551: Assignee: (was: Apache Spark) > Remove unused InSubquery expression > ---

[jira] [Commented] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs

[ https://issues.apache.org/jira/browse/SPARK-25550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630083#comment-16630083 ] Apache Spark commented on SPARK-25550: -- User 'shivusondur' has created a pull reque

[jira] [Commented] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs

[ https://issues.apache.org/jira/browse/SPARK-25550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630085#comment-16630085 ] Apache Spark commented on SPARK-25550: -- User 'shivusondur' has created a pull reque

[jira] [Commented] (SPARK-25545) CSV loading with DROPMALFORMED mode doesn't correctly drop rows that do not confirm to non-nullable schema fields

[ https://issues.apache.org/jira/browse/SPARK-25545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630087#comment-16630087 ] Steven Bakhtiari commented on SPARK-25545: -- Hi [~hyukjin.kwon] - is there any r

[jira] [Assigned] (SPARK-23401) Improve test cases for all supported types and unsupported types

[ https://issues.apache.org/jira/browse/SPARK-23401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23401: Assignee: Apache Spark > Improve test cases for all supported types and unsupported types

[jira] [Assigned] (SPARK-23401) Improve test cases for all supported types and unsupported types

[ https://issues.apache.org/jira/browse/SPARK-23401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23401: Assignee: (was: Apache Spark) > Improve test cases for all supported types and unsupp

[jira] [Commented] (SPARK-23401) Improve test cases for all supported types and unsupported types

[ https://issues.apache.org/jira/browse/SPARK-23401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630103#comment-16630103 ] Apache Spark commented on SPARK-23401: -- User 'AlexanderKoryagin' has created a pull

[jira] [Commented] (SPARK-23401) Improve test cases for all supported types and unsupported types

[ https://issues.apache.org/jira/browse/SPARK-23401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630105#comment-16630105 ] Apache Spark commented on SPARK-23401: -- User 'AlexanderKoryagin' has created a pull

[jira] [Assigned] (SPARK-25542) Flaky test: OpenHashMapSuite

[ https://issues.apache.org/jira/browse/SPARK-25542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25542: Assignee: Apache Spark > Flaky test: OpenHashMapSuite > > >

[jira] [Assigned] (SPARK-25542) Flaky test: OpenHashMapSuite

[ https://issues.apache.org/jira/browse/SPARK-25542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25542: Assignee: (was: Apache Spark) > Flaky test: OpenHashMapSuite > --

[jira] [Commented] (SPARK-25542) Flaky test: OpenHashMapSuite

[ https://issues.apache.org/jira/browse/SPARK-25542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630110#comment-16630110 ] Apache Spark commented on SPARK-25542: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-19950) nullable ignored when df.load() is executed for file-based data source

[ https://issues.apache.org/jira/browse/SPARK-19950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630113#comment-16630113 ] Steven Bakhtiari commented on SPARK-19950: -- Is there any movement on this issue

[jira] [Commented] (SPARK-25542) Flaky test: OpenHashMapSuite

[ https://issues.apache.org/jira/browse/SPARK-25542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630111#comment-16630111 ] Apache Spark commented on SPARK-25542: -- User 'viirya' has created a pull request fo

[jira] [Comment Edited] (SPARK-19950) nullable ignored when df.load() is executed for file-based data source

[ https://issues.apache.org/jira/browse/SPARK-19950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630113#comment-16630113 ] Steven Bakhtiari edited comment on SPARK-19950 at 9/27/18 10:13 AM: --

[jira] [Created] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

Nuno Azevedo created SPARK-25552: Summary: Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory Key: SPARK-25552 URL: https://issues.apache.org/jira/browse/SPARK-25552 Projec

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Attachment: Spark1.6-50GB.png > Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 5

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Attachment: Spark2.3-50GB.png > Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 5

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Attachment: Spark2.3-70GB.png > Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 5

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Description: After upgrading from Spark 1.6.3 to 2.3.0 our jobs started to need about 50% more

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Environment: Original found in an AWS Kubernetes environment with Spark Embedded. Also happens

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Environment: Originally found in an AWS Kubernetes environment with Spark Embedded. Also happen

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Environment: Original found in an AWS Kubernetes environment with Spark Embedded.   Also happe

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Environment: Originally found in an AWS Kubernetes environment with Spark Embedded. Also happen

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Component/s: Java API > Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more

[jira] [Commented] (SPARK-25501) Kafka delegation token support

[ https://issues.apache.org/jira/browse/SPARK-25501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630222#comment-16630222 ] Gabor Somogyi commented on SPARK-25501: --- [~merlin] I know it's an important featur

[jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

[ https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630233#comment-16630233 ] Hyukjin Kwon commented on SPARK-18112: -- It uses Hive fork (1.2.1) jar at that point

[jira] [Commented] (SPARK-25501) Kafka delegation token support

[ https://issues.apache.org/jira/browse/SPARK-25501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630237#comment-16630237 ] Gabor Somogyi commented on SPARK-25501: --- SPIP just linked. > Kafka delegation tok

[jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

[ https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630236#comment-16630236 ] Hyukjin Kwon commented on SPARK-18112: -- Such things should be asked to mailing list

[jira] [Assigned] (SPARK-25551) Remove unused InSubquery expression

[ https://issues.apache.org/jira/browse/SPARK-25551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25551: --- Assignee: Marco Gaido > Remove unused InSubquery expression > -

[jira] [Resolved] (SPARK-25551) Remove unused InSubquery expression

[ https://issues.apache.org/jira/browse/SPARK-25551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25551. - Resolution: Fixed Fix Version/s: 2.5.0 Issue resolved by pull request 22556 [https://gith

[jira] [Updated] (SPARK-25522) Improve type promotion for input arguments of elementAt function

[ https://issues.apache.org/jira/browse/SPARK-25522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-25522: Fix Version/s: (was: 2.5.0) 2.4.0 > Improve type promotion for input argum

[jira] [Created] (SPARK-25553) Add EmptyInterpolatedStringChecker to scalastyle-config.xml

Yuming Wang created SPARK-25553: --- Summary: Add EmptyInterpolatedStringChecker to scalastyle-config.xml Key: SPARK-25553 URL: https://issues.apache.org/jira/browse/SPARK-25553 Project: Spark Is

[jira] [Assigned] (SPARK-21436) Take advantage of known partioner for distinct on RDDs

[ https://issues.apache.org/jira/browse/SPARK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21436: --- Assignee: holdenk > Take advantage of known partioner for distinct on RDDs > --

[jira] [Resolved] (SPARK-21436) Take advantage of known partioner for distinct on RDDs

[ https://issues.apache.org/jira/browse/SPARK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21436. - Resolution: Fixed Fix Version/s: 2.5.0 Issue resolved by pull request 22010 [https://gith

[jira] [Resolved] (SPARK-21743) top-most limit should not cause memory leak

[ https://issues.apache.org/jira/browse/SPARK-21743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21743. - Resolution: Fixed Fix Version/s: 2.4.0 > top-most limit should not cause memory leak > --

[jira] [Assigned] (SPARK-25553) Add EmptyInterpolatedStringChecker to scalastyle-config.xml

[ https://issues.apache.org/jira/browse/SPARK-25553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25553: Assignee: Apache Spark > Add EmptyInterpolatedStringChecker to scalastyle-config.xml > --

[jira] [Commented] (SPARK-25553) Add EmptyInterpolatedStringChecker to scalastyle-config.xml

[ https://issues.apache.org/jira/browse/SPARK-25553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630400#comment-16630400 ] Apache Spark commented on SPARK-25553: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-25553) Add EmptyInterpolatedStringChecker to scalastyle-config.xml

[ https://issues.apache.org/jira/browse/SPARK-25553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630401#comment-16630401 ] Apache Spark commented on SPARK-25553: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-25553) Add EmptyInterpolatedStringChecker to scalastyle-config.xml

[ https://issues.apache.org/jira/browse/SPARK-25553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25553: Assignee: (was: Apache Spark) > Add EmptyInterpolatedStringChecker to scalastyle-conf

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630410#comment-16630410 ] Felix Cheung commented on SPARK-21291: -- Wait. I don’t think saveAsTable is the same

[jira] [Commented] (SPARK-25523) Multi thread execute sparkSession.read().jdbc(url, table, properties) problem

[ https://issues.apache.org/jira/browse/SPARK-25523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630421#comment-16630421 ] huanghuai commented on SPARK-25523: --- Sorry, I know this question is hard to understand

[jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

[ https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630472#comment-16630472 ] Tavis Barr commented on SPARK-18112: Why are you even asking these questions?  I hav

[jira] [Updated] (SPARK-25553) Add EmptyInterpolatedStringChecker to scalastyle-config.xml

[ https://issues.apache.org/jira/browse/SPARK-25553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25553: -- Priority: Minor (was: Major) > Add EmptyInterpolatedStringChecker to scalastyle-config.xml >

[jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

[ https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630485#comment-16630485 ] Hyukjin Kwon commented on SPARK-18112: -- At that code you pointed out, Spark's Hive

[jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

[ https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630487#comment-16630487 ] Hyukjin Kwon commented on SPARK-18112: -- I asked questions because i'm pretty sure i

[jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

[ https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630542#comment-16630542 ] Hyukjin Kwon commented on SPARK-18112: -- To be more specific, the code you guys poin

[jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

[ https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630543#comment-16630543 ] Hyukjin Kwon commented on SPARK-18112: -- Also, take a look for the codes, open JIRAs

[jira] [Created] (SPARK-25554) Avro logical types get ignored in SchemaConverters.toSqlType

Yanan Li created SPARK-25554: Summary: Avro logical types get ignored in SchemaConverters.toSqlType Key: SPARK-25554 URL: https://issues.apache.org/jira/browse/SPARK-25554 Project: Spark Issue T

[jira] [Updated] (SPARK-25415) Make plan change log in RuleExecutor configurable by SQLConf

[ https://issues.apache.org/jira/browse/SPARK-25415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25415: - Fix Version/s: (was: 3.0.0) 2.5.0 > Make plan change log in RuleExecutor

[jira] [Commented] (SPARK-25501) Kafka delegation token support

[ https://issues.apache.org/jira/browse/SPARK-25501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630672#comment-16630672 ] Mingjie Tang commented on SPARK-25501: -- [~gsomogyi] thanks so much for your hard wo

[jira] [Created] (SPARK-25555) Generic constructs for windowing and support for custom windows

Arun Mahadevan created SPARK-2: -- Summary: Generic constructs for windowing and support for custom windows Key: SPARK-2 URL: https://issues.apache.org/jira/browse/SPARK-2 Project: Spark

[jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

[ https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630689#comment-16630689 ] Eugeniu commented on SPARK-18112: - _"The problem here looks, you guys completely replace

[jira] [Resolved] (SPARK-25546) RDDInfo uses SparkEnv before it may have been initialized

[ https://issues.apache.org/jira/browse/SPARK-25546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25546. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22558 [https://

[jira] [Assigned] (SPARK-25546) RDDInfo uses SparkEnv before it may have been initialized

[ https://issues.apache.org/jira/browse/SPARK-25546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25546: - Assignee: Marcelo Vanzin > RDDInfo uses SparkEnv before it may have been initialized >

[jira] [Commented] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630697#comment-16630697 ] Arun Mahadevan commented on SPARK-10816: Reiterating earlier point. "map/flapMap

[jira] [Assigned] (SPARK-25454) Division between operands with negative scale can cause precision loss

[ https://issues.apache.org/jira/browse/SPARK-25454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25454: Assignee: (was: Apache Spark) > Division between operands with negative scale can cau

[jira] [Assigned] (SPARK-25454) Division between operands with negative scale can cause precision loss

[ https://issues.apache.org/jira/browse/SPARK-25454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25454: Assignee: Apache Spark > Division between operands with negative scale can cause precisio

[jira] [Commented] (SPARK-25392) [Spark Job History]Inconsistent behaviour for pool details in spark web UI and history server page

[ https://issues.apache.org/jira/browse/SPARK-25392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630779#comment-16630779 ] Apache Spark commented on SPARK-25392: -- User 'sandeep-katta' has created a pull req

[jira] [Assigned] (SPARK-25392) [Spark Job History]Inconsistent behaviour for pool details in spark web UI and history server page

[ https://issues.apache.org/jira/browse/SPARK-25392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25392: Assignee: (was: Apache Spark) > [Spark Job History]Inconsistent behaviour for pool de

[jira] [Assigned] (SPARK-25392) [Spark Job History]Inconsistent behaviour for pool details in spark web UI and history server page

[ https://issues.apache.org/jira/browse/SPARK-25392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25392: Assignee: Apache Spark > [Spark Job History]Inconsistent behaviour for pool details in sp

[jira] [Commented] (SPARK-25392) [Spark Job History]Inconsistent behaviour for pool details in spark web UI and history server page

[ https://issues.apache.org/jira/browse/SPARK-25392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630781#comment-16630781 ] Apache Spark commented on SPARK-25392: -- User 'sandeep-katta' has created a pull req

[jira] [Resolved] (SPARK-25533) Inconsistent message for Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2

[ https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25533. Resolution: Fixed Fix Version/s: 2.4.0 2.3.3 > Inconsistent mess

  1   2   >