[jira] [Assigned] (SPARK-33669) Wrong error message from YARN application state monitor when sc.stop in yarn client mode

[ https://issues.apache.org/jira/browse/SPARK-33669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-33669: --- Assignee: Su Qilong > Wrong error message from YARN application state

[jira] [Resolved] (SPARK-33669) Wrong error message from YARN application state monitor when sc.stop in yarn client mode

[ https://issues.apache.org/jira/browse/SPARK-33669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-33669. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request

[jira] [Commented] (SPARK-33710) Shuffle Index use Guava cache OOM, Yarn NodeManage GC Alarm

[ https://issues.apache.org/jira/browse/SPARK-33710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246329#comment-17246329 ] liangtianlun commented on SPARK-33710: -- Thank you. I'll change it into English > Shuffle Index use

[jira] [Updated] (SPARK-33710) Shuffle Index use Guava cache OOM, Yarn NodeManage GC Alarm

[ https://issues.apache.org/jira/browse/SPARK-33710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liangtianlun updated SPARK-33710: - Description: h2. CDH6.3 Yarn nodemanger frequently GC, and then the dump file is generated due

[jira] [Commented] (SPARK-33702) Result of add "unused-locals" compile arg to scalac

[ https://issues.apache.org/jira/browse/SPARK-33702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246322#comment-17246322 ] Yang Jie commented on SPARK-33702: -- Let me check this > Result of add "unused-locals" compile arg to

[jira] [Commented] (SPARK-33710) Shuffle Index缓存内存泄漏OOM

[ https://issues.apache.org/jira/browse/SPARK-33710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246318#comment-17246318 ] Yang Jie commented on SPARK-33710: -- [~tianlun]  Maybe need to change the description to English, not

[jira] [Commented] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246294#comment-17246294 ] Chao Ma commented on SPARK-8582:

[jira] [Assigned] (SPARK-33703) Migrate MSCK REPAIR TABLE to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33703: --- Assignee: Terry Kim > Migrate MSCK REPAIR TABLE to the new resolution framework >

[jira] [Resolved] (SPARK-33703) Migrate MSCK REPAIR TABLE to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33703. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30664

[jira] [Commented] (SPARK-33657) After spark sql is executed to generate hdfs data, the relevant status information is printed

[ https://issues.apache.org/jira/browse/SPARK-33657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246279#comment-17246279 ] Apache Spark commented on SPARK-33657: -- User 'guixiaowen' has created a pull request for this

[jira] [Updated] (SPARK-33707) Support multiple types of function partition pruning on hive metastore

[ https://issues.apache.org/jira/browse/SPARK-33707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33707: Affects Version/s: (was: 2.4.3) (was: 2.3.4)

[jira] [Updated] (SPARK-33707) Support multiple types of function partition pruning on hive metastore

[ https://issues.apache.org/jira/browse/SPARK-33707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33707: Parent: SPARK-33537 Issue Type: Sub-task (was: Improvement) > Support multiple types of

[jira] [Resolved] (SPARK-33584) Partition predicate pushdown into Hive metastore support cast string type to date type

[ https://issues.apache.org/jira/browse/SPARK-33584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-33584. - Resolution: Won't Fix > Partition predicate pushdown into Hive metastore support cast string

[jira] [Reopened] (SPARK-33707) Support multiple types of function partition pruning on hive metastore

[ https://issues.apache.org/jira/browse/SPARK-33707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang reopened SPARK-33707: --- [~hyukjin.kwon] thanks for your time, I have resolved some commonly used functions  and I will submit

[jira] [Assigned] (SPARK-33717) deprecate spark.launcher.childConectionTimeout

[ https://issues.apache.org/jira/browse/SPARK-33717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33717: Assignee: (was: Apache Spark) > deprecate spark.launcher.childConectionTimeout >

[jira] [Assigned] (SPARK-33717) deprecate spark.launcher.childConectionTimeout

[ https://issues.apache.org/jira/browse/SPARK-33717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33717: Assignee: Apache Spark > deprecate spark.launcher.childConectionTimeout >

[jira] [Commented] (SPARK-33717) deprecate spark.launcher.childConectionTimeout

[ https://issues.apache.org/jira/browse/SPARK-33717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246253#comment-17246253 ] Apache Spark commented on SPARK-33717: -- User 'jsoref' has created a pull request for this issue:

[jira] [Created] (SPARK-33717) deprecate spark.launcher.childConectionTimeout

Josh Soref created SPARK-33717: -- Summary: deprecate spark.launcher.childConectionTimeout Key: SPARK-33717 URL: https://issues.apache.org/jira/browse/SPARK-33717 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-33639) The external table does not specify a location

[ https://issues.apache.org/jira/browse/SPARK-33639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33639. -- Resolution: Incomplete No feedback from the reporter. > The external table does not specify

[jira] [Commented] (SPARK-33705) Three cases always fail in hive-thriftserver module

[ https://issues.apache.org/jira/browse/SPARK-33705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246216#comment-17246216 ] Apache Spark commented on SPARK-33705: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33705) Three cases always fail in hive-thriftserver module

[ https://issues.apache.org/jira/browse/SPARK-33705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33705: Assignee: (was: Apache Spark) > Three cases always fail in hive-thriftserver module

[jira] [Commented] (SPARK-33705) Three cases always fail in hive-thriftserver module

[ https://issues.apache.org/jira/browse/SPARK-33705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246215#comment-17246215 ] Apache Spark commented on SPARK-33705: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33705) Three cases always fail in hive-thriftserver module

[ https://issues.apache.org/jira/browse/SPARK-33705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33705: Assignee: Apache Spark > Three cases always fail in hive-thriftserver module >

[jira] [Updated] (SPARK-33702) Result of add "unused-locals" compile arg to scalac

[ https://issues.apache.org/jira/browse/SPARK-33702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33702: - Affects Version/s: 3.1.0 > Result of add "unused-locals" compile arg to scalac >

[jira] [Commented] (SPARK-33707) Support multiple types of function partition pruning on hive metastore

[ https://issues.apache.org/jira/browse/SPARK-33707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246211#comment-17246211 ] Hyukjin Kwon commented on SPARK-33707: -- I doubt if this is something we should do. Supported

[jira] [Resolved] (SPARK-33707) Support multiple types of function partition pruning on hive metastore

[ https://issues.apache.org/jira/browse/SPARK-33707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33707. -- Resolution: Won't Fix > Support multiple types of function partition pruning on hive

[jira] [Commented] (SPARK-33707) Support multiple types of function partition pruning on hive metastore

[ https://issues.apache.org/jira/browse/SPARK-33707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246212#comment-17246212 ] Hyukjin Kwon commented on SPARK-33707: -- cc [~yumwang] FYI > Support multiple types of function

[jira] [Commented] (SPARK-33708) Error display of Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-33708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246210#comment-17246210 ] Hyukjin Kwon commented on SPARK-33708: -- [~AlberyZJG], Spark 2.3 is EOL. Are you able to test in

[jira] [Resolved] (SPARK-33708) Error display of Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-33708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33708. -- Resolution: Incomplete > Error display of Spark SQL > -- > >

[jira] [Commented] (SPARK-32797) Install mypy on the Jenkins CI workers

[ https://issues.apache.org/jira/browse/SPARK-32797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246209#comment-17246209 ] Hyukjin Kwon commented on SPARK-32797: -- We need this for Python 3 in master and branch-3.1 >

[jira] [Commented] (SPARK-33242) Install numpydoc in Jenkins machines

[ https://issues.apache.org/jira/browse/SPARK-33242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246208#comment-17246208 ] Hyukjin Kwon commented on SPARK-33242: -- Python 2 is dropped in the master and branch-3.1. So,

[jira] [Commented] (SPARK-33702) Result of add "unused-locals" compile arg to scalac

[ https://issues.apache.org/jira/browse/SPARK-33702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246207#comment-17246207 ] Hyukjin Kwon commented on SPARK-33702: -- If there are not a lot of false positives, I think it's

[jira] [Commented] (SPARK-33702) Result of add "unused-locals" compile arg to scalac

[ https://issues.apache.org/jira/browse/SPARK-33702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246206#comment-17246206 ] Hyukjin Kwon commented on SPARK-33702: -- [~LuciferYang], how many false positives are there? >

[jira] [Commented] (SPARK-33441) Add "unused-import" compile arg to scalac and remove all unused imports in Scala code

[ https://issues.apache.org/jira/browse/SPARK-33441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246205#comment-17246205 ] Hyukjin Kwon commented on SPARK-33441: -- Java side it's done in

[jira] [Commented] (SPARK-32391) Install pydata_sphinx_theme in Jenkins machines

[ https://issues.apache.org/jira/browse/SPARK-32391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246203#comment-17246203 ] Hyukjin Kwon commented on SPARK-32391: -- Thank you [~shaneknapp]! > Install pydata_sphinx_theme in

[jira] [Commented] (SPARK-27495) SPIP: Support Stage level resource configuration and scheduling

[ https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246204#comment-17246204 ] Hyukjin Kwon commented on SPARK-27495: -- [~tgraves] SGTM > SPIP: Support Stage level resource

[jira] [Resolved] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33044. -- Resolution: Fixed > Add a Jenkins build and test job for Scala 2.13 >

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246202#comment-17246202 ] Hyukjin Kwon commented on SPARK-33044: -- Awesome! > Add a Jenkins build and test job for Scala 2.13

[jira] [Commented] (SPARK-33712) Remove `Spark Packaging` jobs from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-33712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246193#comment-17246193 ] Hyukjin Kwon commented on SPARK-33712: -- Thanks [~shaneknapp] and [~dongjoon]! > Remove `Spark

[jira] [Commented] (SPARK-27339) Decimal up cast to higher scale fails while reading parquet to Dataset

[ https://issues.apache.org/jira/browse/SPARK-27339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246191#comment-17246191 ] Bala KS commented on SPARK-27339: - Do we have any workaround for this issue?  > Decimal up cast to

[jira] [Commented] (SPARK-21454) Decimal up cast to higher scale fails while reading parquet to Dataset

[ https://issues.apache.org/jira/browse/SPARK-21454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246190#comment-17246190 ] Bala KS commented on SPARK-21454: - [~wrschneider99] - How did you resolve this ? We are facing the same

[jira] [Commented] (SPARK-33712) Remove `Spark Packaging` jobs from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-33712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246178#comment-17246178 ] Dongjoon Hyun commented on SPARK-33712: --- Thank you so much, [~shaneknapp]! :) > Remove `Spark

[jira] [Comment Edited] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246168#comment-17246168 ] Shane Knapp edited comment on SPARK-33044 at 12/8/20, 9:59 PM: --- branch-3.1

[jira] [Updated] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-33044: Attachment: Screen Shot 2020-12-08 at 1.58.07 PM.png > Add a Jenkins build and test job for Scala

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246168#comment-17246168 ] Shane Knapp commented on SPARK-33044: - branch-3.1 jobs + all scala 2.13 builds are done!   !Screen

[jira] [Updated] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-33044: Attachment: Screen Shot 2020-12-08 at 1.56.59 PM.png > Add a Jenkins build and test job for Scala

[jira] [Created] (SPARK-33716) Decommissioning Race Condition during Pod Snapshot

Holden Karau created SPARK-33716: Summary: Decommissioning Race Condition during Pod Snapshot Key: SPARK-33716 URL: https://issues.apache.org/jira/browse/SPARK-33716 Project: Spark Issue

[jira] [Created] (SPARK-33715) Error about cores being limiting resource confusing

Thomas Graves created SPARK-33715: - Summary: Error about cores being limiting resource confusing Key: SPARK-33715 URL: https://issues.apache.org/jira/browse/SPARK-33715 Project: Spark Issue

[jira] [Resolved] (SPARK-33695) Bump Jackson to 2.10.5 and databind to 2.10.5.1

[ https://issues.apache.org/jira/browse/SPARK-33695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33695. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30656

[jira] [Resolved] (SPARK-32110) -0.0 vs 0.0 is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32110. --- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-32110) -0.0 vs 0.0 is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32110: - Assignee: Wenchen Fan > -0.0 vs 0.0 is inconsistent > --- > >

[jira] [Resolved] (SPARK-33712) Remove `Spark Packaging` jobs from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-33712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-33712. - Resolution: Fixed > Remove `Spark Packaging` jobs from Jenkins >

[jira] [Assigned] (SPARK-33712) Remove `Spark Packaging` jobs from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-33712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp reassigned SPARK-33712: --- Assignee: Shane Knapp > Remove `Spark Packaging` jobs from Jenkins >

[jira] [Commented] (SPARK-33712) Remove `Spark Packaging` jobs from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-33712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246112#comment-17246112 ] Shane Knapp commented on SPARK-33712: - ok, this is done done.  :) > Remove `Spark Packaging` jobs

[jira] [Assigned] (SPARK-33713) Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names

[ https://issues.apache.org/jira/browse/SPARK-33713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp reassigned SPARK-33713: --- Assignee: Shane Knapp > Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names

[jira] [Commented] (SPARK-33712) Remove `Spark Packaging` jobs from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-33712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246104#comment-17246104 ] Shane Knapp commented on SPARK-33712: - done, pending my PR w/the jenkins job configs. > Remove

[jira] [Commented] (SPARK-33712) Remove `Spark Packaging` jobs from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-33712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246103#comment-17246103 ] Shane Knapp commented on SPARK-33712: - oh, awesome!  i'll take care of this now.  :) > Remove

[jira] [Comment Edited] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246092#comment-17246092 ] Attila Zsolt Piros edited comment on SPARK-33711 at 12/8/20, 7:21 PM:

[jira] [Assigned] (SPARK-33714) Migrate ALTER VIEW ... SET/UNSET TBLPROPERTIES to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33714: Assignee: (was: Apache Spark) > Migrate ALTER VIEW ... SET/UNSET TBLPROPERTIES to

[jira] [Commented] (SPARK-33714) Migrate ALTER VIEW ... SET/UNSET TBLPROPERTIES to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246094#comment-17246094 ] Apache Spark commented on SPARK-33714: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33714) Migrate ALTER VIEW ... SET/UNSET TBLPROPERTIES to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33714: Assignee: Apache Spark > Migrate ALTER VIEW ... SET/UNSET TBLPROPERTIES to new

[jira] [Commented] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246093#comment-17246093 ] Apache Spark commented on SPARK-33711: -- User 'attilapiros' has created a pull request for this

[jira] [Commented] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246092#comment-17246092 ] Attila Zsolt Piros commented on SPARK-33711: Yes, it does. I have updated the affected

[jira] [Updated] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-33711: --- Affects Version/s: 2.3.4 > Race condition in Spark k8s Pod lifecycle manager that

[jira] [Assigned] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33711: Assignee: (was: Apache Spark) > Race condition in Spark k8s Pod lifecycle manager

[jira] [Assigned] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33711: Assignee: Apache Spark > Race condition in Spark k8s Pod lifecycle manager that leads

[jira] [Commented] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246091#comment-17246091 ] Apache Spark commented on SPARK-33711: -- User 'attilapiros' has created a pull request for this

[jira] [Created] (SPARK-33714) Migrate ALTER VIEW ... SET/UNSET TBLPROPERTIES to new resolution framework

Terry Kim created SPARK-33714: - Summary: Migrate ALTER VIEW ... SET/UNSET TBLPROPERTIES to new resolution framework Key: SPARK-33714 URL: https://issues.apache.org/jira/browse/SPARK-33714 Project: Spark

[jira] [Updated] (SPARK-33713) Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names

[ https://issues.apache.org/jira/browse/SPARK-33713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33713: -- Description: We removed `hive-1.2` profile since branch-3.1. So, we can simplify the Jenkins

[jira] [Updated] (SPARK-33713) Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names

[ https://issues.apache.org/jira/browse/SPARK-33713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33713: -- Description: We removed `hive-1.2` profile since branch-3.1. > Remove `hive-2.3` post fix at

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246076#comment-17246076 ] Dongjoon Hyun commented on SPARK-33044: --- BTW, I filed the followings too. - SPARK-33712 (Remove

[jira] [Updated] (SPARK-33713) Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names

[ https://issues.apache.org/jira/browse/SPARK-33713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33713: -- Summary: Remove `hive-2.3` post fix at master/branch-3.1 Jenkins job names (was: Remove

[jira] [Created] (SPARK-33713) Remove `hive-2.3` post fix at master/branch-3.1 Jenkins jobs

Dongjoon Hyun created SPARK-33713: - Summary: Remove `hive-2.3` post fix at master/branch-3.1 Jenkins jobs Key: SPARK-33713 URL: https://issues.apache.org/jira/browse/SPARK-33713 Project: Spark

[jira] [Commented] (SPARK-33712) Remove `Spark Packaging` jobs from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-33712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246071#comment-17246071 ] Dongjoon Hyun commented on SPARK-33712: --- cc [~shaneknapp], [~srowen], [~hyukjin.kwon] > Remove

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246069#comment-17246069 ] Dongjoon Hyun commented on SPARK-33044: --- Thanks, [~shaneknapp]. Yes, (1) branch-3.1 and master.

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246067#comment-17246067 ] Sean R. Owen commented on SPARK-33044: -- Yes 3.1 and master would be good - at least master. I think

[jira] [Created] (SPARK-33712) Remove `Spark Packaging` jobs from Jenkins

Dongjoon Hyun created SPARK-33712: - Summary: Remove `Spark Packaging` jobs from Jenkins Key: SPARK-33712 URL: https://issues.apache.org/jira/browse/SPARK-33712 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246050#comment-17246050 ] Dongjoon Hyun commented on SPARK-33711: --- BTW, does it exist at branch-2.3, too? > Race condition

[jira] [Updated] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33711: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Bug) > Race condition in Spark k8s

[jira] [Commented] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246049#comment-17246049 ] Dongjoon Hyun commented on SPARK-33711: --- Thank you, [~attilapiros]! > Race condition in Spark

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246045#comment-17246045 ] Shane Knapp commented on SPARK-33044: - ping [~LuciferYang] [~dongjoon] [~srowen] > Add a Jenkins

[jira] [Commented] (SPARK-32391) Install pydata_sphinx_theme in Jenkins machines

[ https://issues.apache.org/jira/browse/SPARK-32391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246044#comment-17246044 ] Shane Knapp commented on SPARK-32391: - yeah, i'll be getting to this (and the other package reqs) in

[jira] [Assigned] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp reassigned SPARK-33044: --- Assignee: Shane Knapp > Add a Jenkins build and test job for Scala 2.13 >

[jira] [Commented] (SPARK-33675) Add GitHub Action job to publish snapshot

[ https://issues.apache.org/jira/browse/SPARK-33675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246038#comment-17246038 ] Apache Spark commented on SPARK-33675: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-33675) Add GitHub Action job to publish snapshot

[ https://issues.apache.org/jira/browse/SPARK-33675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246037#comment-17246037 ] Apache Spark commented on SPARK-33675: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-33711: --- Affects Version/s: (was: 3.0.1) 3.2.0

[jira] [Updated] (SPARK-33711) Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-33711: --- Summary: Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

[jira] [Commented] (SPARK-33711) Race condition in Spark k8s Pod lifecycle management that leads to shutdowns

[ https://issues.apache.org/jira/browse/SPARK-33711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245993#comment-17245993 ] Attila Zsolt Piros commented on SPARK-33711: I am working on this and soon I will open a PR.

[jira] [Created] (SPARK-33711) Race condition in Spark k8s Pod lifecycle management that leads to shutdowns

Attila Zsolt Piros created SPARK-33711: -- Summary: Race condition in Spark k8s Pod lifecycle management that leads to shutdowns Key: SPARK-33711 URL: https://issues.apache.org/jira/browse/SPARK-33711

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245969#comment-17245969 ] Simon edited comment on SPARK-33571 at 12/8/20, 4:14 PM: - [~maxgekk] Thanks for

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245969#comment-17245969 ] Simon edited comment on SPARK-33571 at 12/8/20, 4:13 PM: - [~maxgekk] Thanks for

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245969#comment-17245969 ] Simon edited comment on SPARK-33571 at 12/8/20, 4:13 PM: - [~maxgekk] Thanks for

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245969#comment-17245969 ] Simon edited comment on SPARK-33571 at 12/8/20, 4:13 PM: - [~maxgekk] Thanks for

[jira] [Commented] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245969#comment-17245969 ] Simon commented on SPARK-33571: --- [~maxgekk] Thanks for taking the time to look into this, for the updates

[jira] [Commented] (SPARK-27495) SPIP: Support Stage level resource configuration and scheduling

[ https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245951#comment-17245951 ] Thomas Graves commented on SPARK-27495: --- the main functionality is all in, it probably makes more

[jira] [Resolved] (SPARK-33685) Migrate DROP VIEW to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33685. - Fix Version/s: 3.2.0 Assignee: Terry Kim Resolution: Fixed > Migrate DROP VIEW

[jira] [Assigned] (SPARK-32110) -0.0 vs 0.0 is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32110: Assignee: (was: Apache Spark) > -0.0 vs 0.0 is inconsistent >

[jira] [Assigned] (SPARK-32110) -0.0 vs 0.0 is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32110: Assignee: Apache Spark > -0.0 vs 0.0 is inconsistent > --- > >

[jira] [Commented] (SPARK-32110) -0.0 vs 0.0 is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245900#comment-17245900 ] Apache Spark commented on SPARK-32110: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33688) Migrate SHOW TABLE EXTENDED to new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-33688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33688. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30645

  1   2   >