[jira] [Commented] (SPARK-31730) Flaky test: org.apache.spark.scheduler.BarrierTaskContextSuite

[ https://issues.apache.org/jira/browse/SPARK-31730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176065#comment-17176065 ] Hyukjin Kwon commented on SPARK-31730: -- FYI, I saw this one more time today in Jenk

[jira] [Assigned] (SPARK-31703) Changes made by SPARK-26985 break reading parquet files correctly in BigEndian architectures (AIX + LinuxPPC64)

[ https://issues.apache.org/jira/browse/SPARK-31703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31703: --- Assignee: Tin Hang To > Changes made by SPARK-26985 break reading parquet files correctly i

[jira] [Resolved] (SPARK-31703) Changes made by SPARK-26985 break reading parquet files correctly in BigEndian architectures (AIX + LinuxPPC64)

[ https://issues.apache.org/jira/browse/SPARK-31703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31703. - Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull re

[jira] [Updated] (SPARK-32598) See driver logs in Spark history server in standalone mode

[ https://issues.apache.org/jira/browse/SPARK-32598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Ganesh updated SPARK-32598: -- Description: Driver logs are not coming in history server in spark standalone mode. Checked i

[jira] [Updated] (SPARK-32598) See driver logs in Spark history server in standalone mode

[ https://issues.apache.org/jira/browse/SPARK-32598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Ganesh updated SPARK-32598: -- Attachment: image-2020-08-12-11-50-01-899.png > See driver logs in Spark history server in sta

[jira] [Created] (SPARK-32598) See driver logs in Spark history server in standalone mode

Sriram Ganesh created SPARK-32598: - Summary: See driver logs in Spark history server in standalone mode Key: SPARK-32598 URL: https://issues.apache.org/jira/browse/SPARK-32598 Project: Spark

[jira] [Commented] (SPARK-32596) Clear Ivy resolution files as part of the finally block

[ https://issues.apache.org/jira/browse/SPARK-32596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176041#comment-17176041 ] Hyukjin Kwon commented on SPARK-32596: -- [~mridulm80], I resolved the JIRA manually.

[jira] [Resolved] (SPARK-32596) Clear Ivy resolution files as part of the finally block

[ https://issues.apache.org/jira/browse/SPARK-32596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32596. -- Fix Version/s: 3.1.0 Assignee: Venkata krishnan Sowrirajan Resolution: Fixed F

[jira] [Updated] (SPARK-32597) Tune Event Drop in Async Event Queue

[ https://issues.apache.org/jira/browse/SPARK-32597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saurabh Chawla updated SPARK-32597: --- Description: There are scenarios where we have seen the event drop in spark, resulting in t

[jira] [Updated] (SPARK-32597) Tune Event Drop in Async Event Queue

[ https://issues.apache.org/jira/browse/SPARK-32597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saurabh Chawla updated SPARK-32597: --- Description: There are scenarios where we have seen the event drop in spark, resulting in t

[jira] [Assigned] (SPARK-32597) Tune Event Drop in Async Event Queue

[ https://issues.apache.org/jira/browse/SPARK-32597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32597: Assignee: (was: Apache Spark) > Tune Event Drop in Async Event Queue > --

[jira] [Commented] (SPARK-32597) Tune Event Drop in Async Event Queue

[ https://issues.apache.org/jira/browse/SPARK-32597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176037#comment-17176037 ] Apache Spark commented on SPARK-32597: -- User 'SaurabhChawla100' has created a pull

[jira] [Assigned] (SPARK-32597) Tune Event Drop in Async Event Queue

[ https://issues.apache.org/jira/browse/SPARK-32597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32597: Assignee: Apache Spark > Tune Event Drop in Async Event Queue > -

[jira] [Resolved] (SPARK-32400) Test coverage of HiveScripTransformationExec

[ https://issues.apache.org/jira/browse/SPARK-32400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32400. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29401 [https://gith

[jira] [Assigned] (SPARK-32400) Test coverage of HiveScripTransformationExec

[ https://issues.apache.org/jira/browse/SPARK-32400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32400: --- Assignee: angerszhu > Test coverage of HiveScripTransformationExec > --

[jira] [Created] (SPARK-32597) Tune Event Drop in Async Event Queue

Saurabh Chawla created SPARK-32597: -- Summary: Tune Event Drop in Async Event Queue Key: SPARK-32597 URL: https://issues.apache.org/jira/browse/SPARK-32597 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-32289) Chinese characters are garbled when opening csv files with Excel

[ https://issues.apache.org/jira/browse/SPARK-32289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32289: Attachment: Workaround.png > Chinese characters are garbled when opening csv files with Excel > --

[jira] [Comment Edited] (SPARK-32526) Let sql/catalyst module tests pass for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172091#comment-17172091 ] Yang Jie edited comment on SPARK-32526 at 8/12/20, 5:09 AM:

[jira] [Resolved] (SPARK-32594) Insert wrong dates to Hive tables

[ https://issues.apache.org/jira/browse/SPARK-32594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32594. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-32594) Insert wrong dates to Hive tables

[ https://issues.apache.org/jira/browse/SPARK-32594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32594: Assignee: Maxim Gekk > Insert wrong dates to Hive tables > --

[jira] [Comment Edited] (SPARK-32582) Spark SQL Infer Schema Performance

[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175981#comment-17175981 ] Lantao Jin edited comment on SPARK-32582 at 8/12/20, 4:31 AM:

[jira] [Commented] (SPARK-32582) Spark SQL Infer Schema Performance

[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175981#comment-17175981 ] Lantao Jin commented on SPARK-32582: {quote} I remember I investigated this issue a

[jira] [Resolved] (SPARK-32586) Fix NumberFormatException error message when ansi is enabled

[ https://issues.apache.org/jira/browse/SPARK-32586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32586. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-32586) Fix NumberFormatException error message when ansi is enabled

[ https://issues.apache.org/jira/browse/SPARK-32586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32586: Assignee: Yuming Wang > Fix NumberFormatException error message when ansi is enabled > --

[jira] [Commented] (SPARK-25557) ORC predicate pushdown for nested fields

[ https://issues.apache.org/jira/browse/SPARK-25557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175921#comment-17175921 ] Apache Spark commented on SPARK-25557: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-25557) ORC predicate pushdown for nested fields

[ https://issues.apache.org/jira/browse/SPARK-25557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175920#comment-17175920 ] Apache Spark commented on SPARK-25557: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-32596) Clear Ivy resolution files as part of the finally block

[ https://issues.apache.org/jira/browse/SPARK-32596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175889#comment-17175889 ] Apache Spark commented on SPARK-32596: -- User 'venkata91' has created a pull request

[jira] [Assigned] (SPARK-32596) Clear Ivy resolution files as part of the finally block

[ https://issues.apache.org/jira/browse/SPARK-32596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32596: Assignee: (was: Apache Spark) > Clear Ivy resolution files as part of the finally blo

[jira] [Commented] (SPARK-32596) Clear Ivy resolution files as part of the finally block

[ https://issues.apache.org/jira/browse/SPARK-32596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175888#comment-17175888 ] Apache Spark commented on SPARK-32596: -- User 'venkata91' has created a pull request

[jira] [Assigned] (SPARK-32596) Clear Ivy resolution files as part of the finally block

[ https://issues.apache.org/jira/browse/SPARK-32596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32596: Assignee: Apache Spark > Clear Ivy resolution files as part of the finally block > --

[jira] [Created] (SPARK-32596) Clear Ivy resolution files as part of the finally block

Venkata krishnan Sowrirajan created SPARK-32596: --- Summary: Clear Ivy resolution files as part of the finally block Key: SPARK-32596 URL: https://issues.apache.org/jira/browse/SPARK-32596

[jira] [Commented] (SPARK-32180) Getting Started - Installation

[ https://issues.apache.org/jira/browse/SPARK-32180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175834#comment-17175834 ] Apache Spark commented on SPARK-32180: -- User 'rohitmishr1484' has created a pull re

[jira] [Assigned] (SPARK-32180) Getting Started - Installation

[ https://issues.apache.org/jira/browse/SPARK-32180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32180: Assignee: Apache Spark > Getting Started - Installation > --

[jira] [Assigned] (SPARK-32180) Getting Started - Installation

[ https://issues.apache.org/jira/browse/SPARK-32180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32180: Assignee: (was: Apache Spark) > Getting Started - Installation >

[jira] [Commented] (SPARK-32595) Do truncate and append atomically in JDBCWriteBuilder

[ https://issues.apache.org/jira/browse/SPARK-32595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175831#comment-17175831 ] Huaxin Gao commented on SPARK-32595: cc [~maxgekk] > Do truncate and append atomica

[jira] [Created] (SPARK-32595) Do truncate and append atomically in JDBCWriteBuilder

Huaxin Gao created SPARK-32595: -- Summary: Do truncate and append atomically in JDBCWriteBuilder Key: SPARK-32595 URL: https://issues.apache.org/jira/browse/SPARK-32595 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-32594) Insert wrong dates to Hive tables

[ https://issues.apache.org/jira/browse/SPARK-32594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32594: Assignee: Apache Spark > Insert wrong dates to Hive tables >

[jira] [Commented] (SPARK-32594) Insert wrong dates to Hive tables

[ https://issues.apache.org/jira/browse/SPARK-32594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175827#comment-17175827 ] Apache Spark commented on SPARK-32594: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-32594) Insert wrong dates to Hive tables

[ https://issues.apache.org/jira/browse/SPARK-32594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32594: Assignee: (was: Apache Spark) > Insert wrong dates to Hive tables > -

[jira] [Commented] (SPARK-32594) Insert wrong dates to Hive tables

[ https://issues.apache.org/jira/browse/SPARK-32594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175820#comment-17175820 ] Maxim Gekk commented on SPARK-32594: I am working on a fix > Insert wrong dates to

[jira] [Created] (SPARK-32594) Insert wrong dates to Hive tables

Maxim Gekk created SPARK-32594: -- Summary: Insert wrong dates to Hive tables Key: SPARK-32594 URL: https://issues.apache.org/jira/browse/SPARK-32594 Project: Spark Issue Type: Bug Compo

[jira] [Commented] (SPARK-32593) JDBC nested columns support

[ https://issues.apache.org/jira/browse/SPARK-32593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175796#comment-17175796 ] Huaxin Gao commented on SPARK-32593: cc [~maxgekk] > JDBC nested columns support >

[jira] [Commented] (SPARK-32592) Make `DataFrameReader.table` take the specified options

[ https://issues.apache.org/jira/browse/SPARK-32592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175795#comment-17175795 ] Huaxin Gao commented on SPARK-32592: cc [~maxgekk] > Make `DataFrameReader.table` t

[jira] [Commented] (SPARK-32590) Remove fullOutput from RowDataSourceScanExec

[ https://issues.apache.org/jira/browse/SPARK-32590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175792#comment-17175792 ] Huaxin Gao commented on SPARK-32590: cc [~maxgekk] > Remove fullOutput from RowData

[jira] [Created] (SPARK-32593) JDBC nested columns support

Huaxin Gao created SPARK-32593: -- Summary: JDBC nested columns support Key: SPARK-32593 URL: https://issues.apache.org/jira/browse/SPARK-32593 Project: Spark Issue Type: Sub-task Compon

[jira] [Created] (SPARK-32592) Make `DataFrameReader.table` take the specified options

Huaxin Gao created SPARK-32592: -- Summary: Make `DataFrameReader.table` take the specified options Key: SPARK-32592 URL: https://issues.apache.org/jira/browse/SPARK-32592 Project: Spark Issue Typ

[jira] [Created] (SPARK-32591) Add better api docs for stage level scheduling Resources

Thomas Graves created SPARK-32591: - Summary: Add better api docs for stage level scheduling Resources Key: SPARK-32591 URL: https://issues.apache.org/jira/browse/SPARK-32591 Project: Spark Is

[jira] [Created] (SPARK-32590) Remove fullOutput from RowDataSourceScanExec

Huaxin Gao created SPARK-32590: -- Summary: Remove fullOutput from RowDataSourceScanExec Key: SPARK-32590 URL: https://issues.apache.org/jira/browse/SPARK-32590 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-32540) Eliminate filter clause in aggregate

[ https://issues.apache.org/jira/browse/SPARK-32540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32540. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29369 [https://gith

[jira] [Assigned] (SPARK-32540) Eliminate filter clause in aggregate

[ https://issues.apache.org/jira/browse/SPARK-32540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32540: --- Assignee: jiaan.geng > Eliminate filter clause in aggregate > -

[jira] [Commented] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175672#comment-17175672 ] L. C. Hsieh commented on SPARK-32580: - Yeah, this looks like related to nested colum

[jira] [Commented] (SPARK-32583) PySpark Structured Streaming Testing Support

[ https://issues.apache.org/jira/browse/SPARK-32583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175658#comment-17175658 ] Felix Kizhakkel Jose commented on SPARK-32583: -- [~hyukjin.kwon] I couldn't

[jira] [Commented] (SPARK-27997) kubernetes client token expired

[ https://issues.apache.org/jira/browse/SPARK-27997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175605#comment-17175605 ] ramesh krishnan m commented on SPARK-27997: --- I can share the PR branch with a

[jira] [Commented] (SPARK-27997) kubernetes client token expired

[ https://issues.apache.org/jira/browse/SPARK-27997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175604#comment-17175604 ] Janek Bevendorff commented on SPARK-27997: -- Cool, thanks. How long will it take

[jira] [Comment Edited] (SPARK-27997) kubernetes client token expired

[ https://issues.apache.org/jira/browse/SPARK-27997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175601#comment-17175601 ] rameshkrishnan muthusamy edited comment on SPARK-27997 at 8/11/20, 2:16 PM: --

[jira] [Commented] (SPARK-27997) kubernetes client token expired

[ https://issues.apache.org/jira/browse/SPARK-27997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175601#comment-17175601 ] rameshkrishnan muthusamy commented on SPARK-27997: -- [~phoerious] I have

[jira] [Created] (SPARK-32589) NoSuchElementException: None.get for needsUnsafeRowConversion

Adam Binford created SPARK-32589: Summary: NoSuchElementException: None.get for needsUnsafeRowConversion Key: SPARK-32589 URL: https://issues.apache.org/jira/browse/SPARK-32589 Project: Spark

[jira] [Commented] (SPARK-27997) kubernetes client token expired

[ https://issues.apache.org/jira/browse/SPARK-27997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175598#comment-17175598 ] Janek Bevendorff commented on SPARK-27997: -- Is there any progress on this issue

[jira] [Commented] (SPARK-32250) Reenable MasterSuite's "Master should avoid dead loop while launching executor failed in Worker"

[ https://issues.apache.org/jira/browse/SPARK-32250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175563#comment-17175563 ] Apache Spark commented on SPARK-32250: -- User 'Ngone51' has created a pull request f

[jira] [Commented] (SPARK-32250) Reenable MasterSuite's "Master should avoid dead loop while launching executor failed in Worker"

[ https://issues.apache.org/jira/browse/SPARK-32250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175559#comment-17175559 ] Apache Spark commented on SPARK-32250: -- User 'Ngone51' has created a pull request f

[jira] [Commented] (SPARK-27510) Master fall into dead loop while launching executor failed in Worker

[ https://issues.apache.org/jira/browse/SPARK-27510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175560#comment-17175560 ] Apache Spark commented on SPARK-27510: -- User 'Ngone51' has created a pull request f

[jira] [Commented] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1717#comment-1717 ] Takeshi Yamamuro commented on SPARK-32580: -- We are planning to release v3.0.1 s

[jira] [Commented] (SPARK-32530) SPIP: Kotlin support for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-32530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175547#comment-17175547 ] Holden Karau commented on SPARK-32530: -- I can understand the desire to have this be

[jira] [Commented] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175545#comment-17175545 ] Ayrat Sadreev commented on SPARK-32580: --- When it will be published? The error is

[jira] [Commented] (SPARK-32588) SizeEstimator class not always properly initialized in tests.

[ https://issues.apache.org/jira/browse/SPARK-32588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175507#comment-17175507 ] Apache Spark commented on SPARK-32588: -- User 'mundaym' has created a pull request f

[jira] [Assigned] (SPARK-32588) SizeEstimator class not always properly initialized in tests.

[ https://issues.apache.org/jira/browse/SPARK-32588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32588: Assignee: (was: Apache Spark) > SizeEstimator class not always properly initialized i

[jira] [Assigned] (SPARK-32588) SizeEstimator class not always properly initialized in tests.

[ https://issues.apache.org/jira/browse/SPARK-32588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32588: Assignee: Apache Spark > SizeEstimator class not always properly initialized in tests. >

[jira] [Resolved] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32580. -- Fix Version/s: 3.0.1 Resolution: Fixed > Issue accessing a column values after

[jira] [Commented] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175505#comment-17175505 ] Takeshi Yamamuro commented on SPARK-32580: -- Yea, in branch-3.0, it seems this i

[jira] [Created] (SPARK-32588) SizeEstimator class not always properly initialized in tests.

Michael Munday created SPARK-32588: -- Summary: SizeEstimator class not always properly initialized in tests. Key: SPARK-32588 URL: https://issues.apache.org/jira/browse/SPARK-32588 Project: Spark

[jira] [Created] (SPARK-32587) SPARK SQL writing to JDBC target with bit datatype using Dataframe is writing NULL values

Mohit Dave created SPARK-32587: -- Summary: SPARK SQL writing to JDBC target with bit datatype using Dataframe is writing NULL values Key: SPARK-32587 URL: https://issues.apache.org/jira/browse/SPARK-32587

[jira] [Commented] (SPARK-32352) Partially push down support data filter if it mixed in partition filters

[ https://issues.apache.org/jira/browse/SPARK-32352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175434#comment-17175434 ] Apache Spark commented on SPARK-32352: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-32352) Partially push down support data filter if it mixed in partition filters

[ https://issues.apache.org/jira/browse/SPARK-32352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32352: Assignee: (was: Apache Spark) > Partially push down support data filter if it mixed i

[jira] [Assigned] (SPARK-32352) Partially push down support data filter if it mixed in partition filters

[ https://issues.apache.org/jira/browse/SPARK-32352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32352: Assignee: Apache Spark > Partially push down support data filter if it mixed in partition

[jira] [Commented] (SPARK-32352) Partially push down support data filter if it mixed in partition filters

[ https://issues.apache.org/jira/browse/SPARK-32352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175432#comment-17175432 ] Apache Spark commented on SPARK-32352: -- User 'AngersZh' has created a pull requ

[jira] [Comment Edited] (SPARK-32582) Spark SQL Infer Schema Performance

[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175428#comment-17175428 ] Jarred Li edited comment on SPARK-32582 at 8/11/20, 10:07 AM:

[jira] [Commented] (SPARK-32582) Spark SQL Infer Schema Performance

[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175428#comment-17175428 ] Jarred Li commented on SPARK-32582: --- I think this is one limitation of ORC file infer

[jira] [Commented] (SPARK-32562) Pyspark drop duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-32562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175387#comment-17175387 ] Hyukjin Kwon commented on SPARK-32562: -- It's very easy to do as you suggested. You

[jira] [Updated] (SPARK-32562) Pyspark drop duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-32562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32562: - Target Version/s: (was: 3.0.0) > Pyspark drop duplicate columns >

[jira] [Commented] (SPARK-32562) Pyspark drop duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-32562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175388#comment-17175388 ] Hyukjin Kwon commented on SPARK-32562: -- BTW, please avoid setting Target version ne

[jira] [Resolved] (SPARK-32562) Pyspark drop duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-32562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32562. -- Resolution: Won't Fix > Pyspark drop duplicate columns > -- > >

[jira] [Commented] (SPARK-32572) Run all the tests at once, instead of having separate entrypoints.

[ https://issues.apache.org/jira/browse/SPARK-32572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175376#comment-17175376 ] Hyukjin Kwon commented on SPARK-32572: -- [~fokko] the problem is that PySpark runs t

[jira] [Commented] (SPARK-32577) Fix the config value for shuffled hash join in test in-joins.sql

[ https://issues.apache.org/jira/browse/SPARK-32577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175370#comment-17175370 ] Hyukjin Kwon commented on SPARK-32577: -- Please go ahead and fix > Fix the config v

[jira] [Updated] (SPARK-32400) Test coverage of HiveScripTransformationExec

[ https://issues.apache.org/jira/browse/SPARK-32400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32400: -- Description: Add more test case for script transformation to make use case more clear. Doing below th

[jira] [Comment Edited] (SPARK-32582) Spark SQL Infer Schema Performance

[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175165#comment-17175165 ] Jarred Li edited comment on SPARK-32582 at 8/11/20, 7:06 AM: -

[jira] [Comment Edited] (SPARK-32582) Spark SQL Infer Schema Performance

[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175165#comment-17175165 ] Jarred Li edited comment on SPARK-32582 at 8/11/20, 7:05 AM: -

[jira] [Commented] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175293#comment-17175293 ] Hyukjin Kwon commented on SPARK-32580: -- Seems it was accidentally fixed somewhere i

[jira] [Comment Edited] (SPARK-32582) Spark SQL Infer Schema Performance

[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175165#comment-17175165 ] Jarred Li edited comment on SPARK-32582 at 8/11/20, 6:59 AM: -