[jira] [Commented] (SPARK-30689) Allow custom resource scheduling to work with YARN versions that don't support custom resource scheduling

[ https://issues.apache.org/jira/browse/SPARK-30689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111814#comment-17111814 ] Apache Spark commented on SPARK-30689: -- User 'Ngone51' has created a pull request f

[jira] [Commented] (SPARK-30689) Allow custom resource scheduling to work with YARN versions that don't support custom resource scheduling

[ https://issues.apache.org/jira/browse/SPARK-30689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111813#comment-17111813 ] Apache Spark commented on SPARK-30689: -- User 'Ngone51' has created a pull request f

[jira] [Commented] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111807#comment-17111807 ] Hyukjin Kwon commented on SPARK-31693: -- Awesome!! > Investigate AmpLab Jenkins ser

[jira] [Resolved] (SPARK-31766) Add Spark version prefix to K8s UUID test image tag

[ https://issues.apache.org/jira/browse/SPARK-31766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31766. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28587 [https://gi

[jira] [Assigned] (SPARK-31766) Add Spark version prefix to K8s UUID test image tag

[ https://issues.apache.org/jira/browse/SPARK-31766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31766: Assignee: Dongjoon Hyun > Add Spark version prefix to K8s UUID test image tag > -

[jira] [Updated] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31693: -- Affects Version/s: 3.0.0 2.4.6 > Investigate AmpLab Jenkins server netw

[jira] [Resolved] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31693. --- Resolution: Fixed > Investigate AmpLab Jenkins server network issue > --

[jira] [Assigned] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31693: - Assignee: Shane Knapp > Investigate AmpLab Jenkins server network issue > -

[jira] [Commented] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111794#comment-17111794 ] Dongjoon Hyun commented on SPARK-31693: --- Wow. Thank you so much, [~shaneknapp]! Go

[jira] [Resolved] (SPARK-31767) Remove ResourceInformation in pyspark module's namespace

[ https://issues.apache.org/jira/browse/SPARK-31767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31767. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28589 [https://

[jira] [Assigned] (SPARK-31767) Remove ResourceInformation in pyspark module's namespace

[ https://issues.apache.org/jira/browse/SPARK-31767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31767: - Assignee: Hyukjin Kwon > Remove ResourceInformation in pyspark module's namespace > ---

[jira] [Commented] (SPARK-31768) add getMetrics in Evaluators

[ https://issues.apache.org/jira/browse/SPARK-31768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111771#comment-17111771 ] Apache Spark commented on SPARK-31768: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-31768) add getMetrics in Evaluators

[ https://issues.apache.org/jira/browse/SPARK-31768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31768: Assignee: Apache Spark > add getMetrics in Evaluators > > >

[jira] [Commented] (SPARK-31768) add getMetrics in Evaluators

[ https://issues.apache.org/jira/browse/SPARK-31768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111772#comment-17111772 ] Apache Spark commented on SPARK-31768: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-31768) add getMetrics in Evaluators

[ https://issues.apache.org/jira/browse/SPARK-31768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31768: Assignee: (was: Apache Spark) > add getMetrics in Evaluators > --

[jira] [Updated] (SPARK-31748) Document resource module in PySpark doc and rename/move classes

[ https://issues.apache.org/jira/browse/SPARK-31748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31748: - Fix Version/s: (was: 3.1.0) 3.0.0 > Document resource module in PySpark d

[jira] [Commented] (SPARK-31767) Remove ResourceInformation in pyspark module's namespace

[ https://issues.apache.org/jira/browse/SPARK-31767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111762#comment-17111762 ] Apache Spark commented on SPARK-31767: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-31767) Remove ResourceInformation in pyspark module's namespace

[ https://issues.apache.org/jira/browse/SPARK-31767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31767: Assignee: Apache Spark > Remove ResourceInformation in pyspark module's namespace > -

[jira] [Commented] (SPARK-31767) Remove ResourceInformation in pyspark module's namespace

[ https://issues.apache.org/jira/browse/SPARK-31767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111761#comment-17111761 ] Apache Spark commented on SPARK-31767: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-31767) Remove ResourceInformation in pyspark module's namespace

[ https://issues.apache.org/jira/browse/SPARK-31767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31767: Assignee: (was: Apache Spark) > Remove ResourceInformation in pyspark module's namesp

[jira] [Created] (SPARK-31768) add getMetrics in Evaluators

Huaxin Gao created SPARK-31768: -- Summary: add getMetrics in Evaluators Key: SPARK-31768 URL: https://issues.apache.org/jira/browse/SPARK-31768 Project: Spark Issue Type: Improvement Co

[jira] [Commented] (SPARK-31440) Improve SQL Rest API

[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111747#comment-17111747 ] Apache Spark commented on SPARK-31440: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-31440) Improve SQL Rest API

[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111748#comment-17111748 ] Apache Spark commented on SPARK-31440: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-27142) Provide REST API for SQL level information

[ https://issues.apache.org/jira/browse/SPARK-27142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111745#comment-17111745 ] Apache Spark commented on SPARK-27142: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-27142) Provide REST API for SQL level information

[ https://issues.apache.org/jira/browse/SPARK-27142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111746#comment-17111746 ] Apache Spark commented on SPARK-27142: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-31767) Remove ResourceInformation in pyspark module's namespace

Hyukjin Kwon created SPARK-31767: Summary: Remove ResourceInformation in pyspark module's namespace Key: SPARK-31767 URL: https://issues.apache.org/jira/browse/SPARK-31767 Project: Spark Issu

[jira] [Commented] (SPARK-31766) Add Spark version prefix to K8s UUID test image tag

[ https://issues.apache.org/jira/browse/SPARK-31766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111730#comment-17111730 ] Apache Spark commented on SPARK-31766: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-31766) Add Spark version prefix to K8s UUID test image tag

[ https://issues.apache.org/jira/browse/SPARK-31766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111729#comment-17111729 ] Apache Spark commented on SPARK-31766: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-31766) Add Spark version prefix to K8s UUID test image tag

[ https://issues.apache.org/jira/browse/SPARK-31766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31766: Assignee: (was: Apache Spark) > Add Spark version prefix to K8s UUID test image tag >

[jira] [Assigned] (SPARK-31766) Add Spark version prefix to K8s UUID test image tag

[ https://issues.apache.org/jira/browse/SPARK-31766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31766: Assignee: Apache Spark > Add Spark version prefix to K8s UUID test image tag > --

[jira] [Created] (SPARK-31766) Add Spark version prefix to K8s UUID test image tag

Dongjoon Hyun created SPARK-31766: - Summary: Add Spark version prefix to K8s UUID test image tag Key: SPARK-31766 URL: https://issues.apache.org/jira/browse/SPARK-31766 Project: Spark Issue T

[jira] [Resolved] (SPARK-31706) add back the support of streaming update mode

[ https://issues.apache.org/jira/browse/SPARK-31706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31706. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28523 [https://gith

[jira] [Commented] (SPARK-31748) Document resource module in PySpark doc and rename/move classes

[ https://issues.apache.org/jira/browse/SPARK-31748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111715#comment-17111715 ] Apache Spark commented on SPARK-31748: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-31765) Upgrade HtmlUnit >= 2.37.0

[ https://issues.apache.org/jira/browse/SPARK-31765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111705#comment-17111705 ] Apache Spark commented on SPARK-31765: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-31765) Upgrade HtmlUnit >= 2.37.0

[ https://issues.apache.org/jira/browse/SPARK-31765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31765: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade HtmlUnit >= 2.37.0 >

[jira] [Assigned] (SPARK-31765) Upgrade HtmlUnit >= 2.37.0

[ https://issues.apache.org/jira/browse/SPARK-31765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31765: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade HtmlUnit >= 2.37.0 >

[jira] [Comment Edited] (SPARK-31754) Spark Structured Streaming: NullPointerException in Stream Stream join

[ https://issues.apache.org/jira/browse/SPARK-31754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111696#comment-17111696 ] Jungtaek Lim edited comment on SPARK-31754 at 5/20/20, 2:50 AM: --

[jira] [Created] (SPARK-31765) Upgrade HtmlUnit >= 2.37.0

Kousuke Saruta created SPARK-31765: -- Summary: Upgrade HtmlUnit >= 2.37.0 Key: SPARK-31765 URL: https://issues.apache.org/jira/browse/SPARK-31765 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-31440) Improve SQL Rest API

[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31440: - Fix Version/s: 3.0.0 > Improve SQL Rest API > > > Key: SPAR

[jira] [Updated] (SPARK-31750) Eliminate UpCast if child's dataType is DecimalType

[ https://issues.apache.org/jira/browse/SPARK-31750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31750: - Fix Version/s: 3.0.0 > Eliminate UpCast if child's dataType is DecimalType > ---

[jira] [Comment Edited] (SPARK-31754) Spark Structured Streaming: NullPointerException in Stream Stream join

[ https://issues.apache.org/jira/browse/SPARK-31754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111696#comment-17111696 ] Jungtaek Lim edited comment on SPARK-31754 at 5/20/20, 2:21 AM: --

[jira] [Commented] (SPARK-31754) Spark Structured Streaming: NullPointerException in Stream Stream join

[ https://issues.apache.org/jira/browse/SPARK-31754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111696#comment-17111696 ] Jungtaek Lim commented on SPARK-31754: -- Looks like the row itself is null which sho

[jira] [Resolved] (SPARK-31750) Eliminate UpCast if child's dataType is DecimalType

[ https://issues.apache.org/jira/browse/SPARK-31750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31750. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28572 [https://gi

[jira] [Assigned] (SPARK-31750) Eliminate UpCast if child's dataType is DecimalType

[ https://issues.apache.org/jira/browse/SPARK-31750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31750: Assignee: wuyi > Eliminate UpCast if child's dataType is DecimalType > --

[jira] [Comment Edited] (SPARK-31694) Add SupportsPartitions Catalog APIs on DataSourceV2

[ https://issues.apache.org/jira/browse/SPARK-31694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111675#comment-17111675 ] YoungGyu Chun edited comment on SPARK-31694 at 5/20/20, 1:43 AM: -

[jira] [Commented] (SPARK-31694) Add SupportsPartitions Catalog APIs on DataSourceV2

[ https://issues.apache.org/jira/browse/SPARK-31694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111675#comment-17111675 ] YoungGyu Chun commented on SPARK-31694: --- Hi [~Jackey Lee],   Can you explain how

[jira] [Comment Edited] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111645#comment-17111645 ] Shane Knapp edited comment on SPARK-31693 at 5/20/20, 12:31 AM: --

[jira] [Commented] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111645#comment-17111645 ] Shane Knapp commented on SPARK-31693: - this is done, and the maven builds are all us

[jira] [Comment Edited] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111645#comment-17111645 ] Shane Knapp edited comment on SPARK-31693 at 5/20/20, 12:29 AM: --

[jira] [Resolved] (SPARK-31748) Document resource module in PySpark doc and rename/move classes

[ https://issues.apache.org/jira/browse/SPARK-31748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31748. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28569 [https://

[jira] [Assigned] (SPARK-31748) Document resource module in PySpark doc and rename/move classes

[ https://issues.apache.org/jira/browse/SPARK-31748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31748: - Assignee: Hyukjin Kwon > Document resource module in PySpark doc and rename/move classe

[jira] [Assigned] (SPARK-31730) Flaky test: org.apache.spark.scheduler.BarrierTaskContextSuite

[ https://issues.apache.org/jira/browse/SPARK-31730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31730: Assignee: (was: Apache Spark) > Flaky test: org.apache.spark.scheduler.BarrierTaskCon

[jira] [Assigned] (SPARK-31730) Flaky test: org.apache.spark.scheduler.BarrierTaskContextSuite

[ https://issues.apache.org/jira/browse/SPARK-31730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31730: Assignee: Apache Spark > Flaky test: org.apache.spark.scheduler.BarrierTaskContextSuite >

[jira] [Commented] (SPARK-31730) Flaky test: org.apache.spark.scheduler.BarrierTaskContextSuite

[ https://issues.apache.org/jira/browse/SPARK-31730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111609#comment-17111609 ] Apache Spark commented on SPARK-31730: -- User 'jiangxb1987' has created a pull reque

[jira] [Commented] (SPARK-31236) Spark error while consuming data from Kinesis direct end point

[ https://issues.apache.org/jira/browse/SPARK-31236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111607#comment-17111607 ] Apache Spark commented on SPARK-31236: -- User 'tprabh509' has created a pull request

[jira] [Assigned] (SPARK-31236) Spark error while consuming data from Kinesis direct end point

[ https://issues.apache.org/jira/browse/SPARK-31236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31236: Assignee: (was: Apache Spark) > Spark error while consuming data from Kinesis direct

[jira] [Commented] (SPARK-31236) Spark error while consuming data from Kinesis direct end point

[ https://issues.apache.org/jira/browse/SPARK-31236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111606#comment-17111606 ] Apache Spark commented on SPARK-31236: -- User 'tprabh509' has created a pull request

[jira] [Assigned] (SPARK-31236) Spark error while consuming data from Kinesis direct end point

[ https://issues.apache.org/jira/browse/SPARK-31236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31236: Assignee: Apache Spark > Spark error while consuming data from Kinesis direct end point >

[jira] [Commented] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111567#comment-17111567 ] Shane Knapp commented on SPARK-31693: - i'm also going to need to restart jenkins onc

[jira] [Commented] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111561#comment-17111561 ] Shane Knapp commented on SPARK-31693: - ok, i had a nagging suspicion that i knew wha

[jira] [Commented] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111537#comment-17111537 ] Apache Spark commented on SPARK-31764: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111536#comment-17111536 ] Apache Spark commented on SPARK-31764: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31764: Assignee: Kousuke Saruta (was: Apache Spark) > JsonProtocol doesn't write RDDInfo#isBarr

[jira] [Assigned] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

[ https://issues.apache.org/jira/browse/SPARK-31764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31764: Assignee: Apache Spark (was: Kousuke Saruta) > JsonProtocol doesn't write RDDInfo#isBarr

[jira] [Created] (SPARK-31764) JsonProtocol doesn't write RDDInfo#isBarrier

Kousuke Saruta created SPARK-31764: -- Summary: JsonProtocol doesn't write RDDInfo#isBarrier Key: SPARK-31764 URL: https://issues.apache.org/jira/browse/SPARK-31764 Project: Spark Issue Type:

[jira] [Created] (SPARK-31763) DataFrame.inputFiles() not Available

Felix Kizhakkel Jose created SPARK-31763: Summary: DataFrame.inputFiles() not Available Key: SPARK-31763 URL: https://issues.apache.org/jira/browse/SPARK-31763 Project: Spark Issue Ty

[jira] [Commented] (SPARK-31693) Investigate AmpLab Jenkins server network issue

[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111505#comment-17111505 ] Shane Knapp commented on SPARK-31693: - i pinged the infra ticket again... we're sti

[jira] [Commented] (SPARK-31762) Fix perf regression of date/timestamp formatting in toHiveString

[ https://issues.apache.org/jira/browse/SPARK-31762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111487#comment-17111487 ] Apache Spark commented on SPARK-31762: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-31762) Fix perf regression of date/timestamp formatting in toHiveString

[ https://issues.apache.org/jira/browse/SPARK-31762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111486#comment-17111486 ] Apache Spark commented on SPARK-31762: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-31762) Fix perf regression of date/timestamp formatting in toHiveString

[ https://issues.apache.org/jira/browse/SPARK-31762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31762: Assignee: (was: Apache Spark) > Fix perf regression of date/timestamp formatting in t

[jira] [Assigned] (SPARK-31762) Fix perf regression of date/timestamp formatting in toHiveString

[ https://issues.apache.org/jira/browse/SPARK-31762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31762: Assignee: Apache Spark > Fix perf regression of date/timestamp formatting in toHiveString

[jira] [Created] (SPARK-31762) Fix perf regression of date/timestamp formatting in toHiveString

Maxim Gekk created SPARK-31762: -- Summary: Fix perf regression of date/timestamp formatting in toHiveString Key: SPARK-31762 URL: https://issues.apache.org/jira/browse/SPARK-31762 Project: Spark

[jira] [Updated] (SPARK-31399) Closure cleaner broken in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-31399: Fix Version/s: 2.4.6 > Closure cleaner broken in Scala 2.12 > > >

[jira] [Commented] (SPARK-31761) Sql Div operator can result in incorrect output for int_min

[ https://issues.apache.org/jira/browse/SPARK-31761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111304#comment-17111304 ] Kuhu Shukla commented on SPARK-31761: - Thanks [~sandeep.katta2007] for the quick res

[jira] [Commented] (SPARK-28098) Native ORC reader doesn't support subdirectories with Hive tables

[ https://issues.apache.org/jira/browse/SPARK-28098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111303#comment-17111303 ] lithiumlee-_- commented on SPARK-28098: --- Also not support subdirectories which gen

[jira] [Commented] (SPARK-31761) Sql Div operator can result in incorrect output for int_min

[ https://issues.apache.org/jira/browse/SPARK-31761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111294#comment-17111294 ] Sandeep Katta commented on SPARK-31761: --- [~kshukla] thanks for raising this, I cro

[jira] [Commented] (SPARK-31754) Spark Structured Streaming: NullPointerException in Stream Stream join

[ https://issues.apache.org/jira/browse/SPARK-31754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111221#comment-17111221 ] Puviarasu commented on SPARK-31754: --- Hello [~kabhwan], Thank you for your response. Pl

[jira] [Updated] (SPARK-31754) Spark Structured Streaming: NullPointerException in Stream Stream join

[ https://issues.apache.org/jira/browse/SPARK-31754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puviarasu updated SPARK-31754: -- Attachment: CodeGen.txt > Spark Structured Streaming: NullPointerException in Stream Stream join > ---

[jira] [Assigned] (SPARK-31684) Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the table

[ https://issues.apache.org/jira/browse/SPARK-31684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31684: --- Assignee: Kent Yao > Overwrite partition failed with 'WRONG FS' when the target partition i

[jira] [Resolved] (SPARK-31684) Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the table

[ https://issues.apache.org/jira/browse/SPARK-31684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31684. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28511 [https://gith

[jira] [Created] (SPARK-31761) Sql Div operator can result in incorrect output for int_min

Kuhu Shukla created SPARK-31761: --- Summary: Sql Div operator can result in incorrect output for int_min Key: SPARK-31761 URL: https://issues.apache.org/jira/browse/SPARK-31761 Project: Spark Is

[jira] [Assigned] (SPARK-31759) Support configurable max number of rotate logs for spark daemons

[ https://issues.apache.org/jira/browse/SPARK-31759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31759: Assignee: (was: Apache Spark) > Support configurable max number of rotate logs for sp

[jira] [Commented] (SPARK-31759) Support configurable max number of rotate logs for spark daemons

[ https://issues.apache.org/jira/browse/SPARK-31759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111033#comment-17111033 ] Apache Spark commented on SPARK-31759: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-31759) Support configurable max number of rotate logs for spark daemons

[ https://issues.apache.org/jira/browse/SPARK-31759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31759: Assignee: Apache Spark > Support configurable max number of rotate logs for spark daemons

[jira] [Created] (SPARK-31760) Consolidating Single Table Predicates

Yuming Wang created SPARK-31760: --- Summary: Consolidating Single Table Predicates Key: SPARK-31760 URL: https://issues.apache.org/jira/browse/SPARK-31760 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-31759) Support configurable rotate logs for spark daemons

Kent Yao created SPARK-31759: Summary: Support configurable rotate logs for spark daemons Key: SPARK-31759 URL: https://issues.apache.org/jira/browse/SPARK-31759 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-31759) Support configurable max number of rotate logs for spark daemons

[ https://issues.apache.org/jira/browse/SPARK-31759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-31759: - Summary: Support configurable max number of rotate logs for spark daemons (was: Support configurable ro

[jira] [Created] (SPARK-31758) Incorrect timestamp parsing from JSON

Tomi Ruokola created SPARK-31758: Summary: Incorrect timestamp parsing from JSON Key: SPARK-31758 URL: https://issues.apache.org/jira/browse/SPARK-31758 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-31721) Assert optimized plan is initialized before tracking the execution of planning

[ https://issues.apache.org/jira/browse/SPARK-31721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-31721. --- Fix Version/s: 3.0.0 Assignee: Ali Afroozeh Resolution: Fixed > Asse

[jira] [Resolved] (SPARK-30472) [SQL] ANSI SQL: Throw exception on format invalid and overflow when casting String to IntegerType.

[ https://issues.apache.org/jira/browse/SPARK-30472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-30472. - Fix Version/s: 3.0.0 Resolution: Duplicate > [SQL] ANSI SQL: Throw exception on format in

[jira] [Commented] (SPARK-25784) Infer filters from constraints after rewriting predicate subquery

[ https://issues.apache.org/jira/browse/SPARK-25784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110929#comment-17110929 ] Yuming Wang commented on SPARK-25784: - Teradata support this optimization: https://d

[jira] [Commented] (SPARK-31757) Improve HistoryServerDiskManager.updateAccessTime()

[ https://issues.apache.org/jira/browse/SPARK-31757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110926#comment-17110926 ] Apache Spark commented on SPARK-31757: -- User 'jiangxb1987' has created a pull reque

[jira] [Commented] (SPARK-31757) Improve HistoryServerDiskManager.updateAccessTime()

[ https://issues.apache.org/jira/browse/SPARK-31757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110925#comment-17110925 ] Apache Spark commented on SPARK-31757: -- User 'jiangxb1987' has created a pull reque

[jira] [Assigned] (SPARK-31757) Improve HistoryServerDiskManager.updateAccessTime()

[ https://issues.apache.org/jira/browse/SPARK-31757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31757: Assignee: (was: Apache Spark) > Improve HistoryServerDiskManager.updateAccessTime()

[jira] [Assigned] (SPARK-31757) Improve HistoryServerDiskManager.updateAccessTime()

[ https://issues.apache.org/jira/browse/SPARK-31757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31757: Assignee: Apache Spark > Improve HistoryServerDiskManager.updateAccessTime() > -

[jira] [Updated] (SPARK-31756) Add real headless browser support for UI test

[ https://issues.apache.org/jira/browse/SPARK-31756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31756: --- Description: In the current master, there are two problems for UI test. 1. Lots of tests es

[jira] [Created] (SPARK-31757) Improve HistoryServerDiskManager.updateAccessTime()

Xingbo Jiang created SPARK-31757: Summary: Improve HistoryServerDiskManager.updateAccessTime() Key: SPARK-31757 URL: https://issues.apache.org/jira/browse/SPARK-31757 Project: Spark Issue Ty

[jira] [Updated] (SPARK-31651) Improve handling the case where different barrier sync types in a single sync

[ https://issues.apache.org/jira/browse/SPARK-31651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-31651: - Issue Type: Bug (was: Improvement) > Improve handling the case where different barrier sync typ

[jira] [Resolved] (SPARK-31651) Improve handling the case where different barrier sync types in a single sync

[ https://issues.apache.org/jira/browse/SPARK-31651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-31651. -- Fix Version/s: 3.0.0 Resolution: Fixed > Improve handling the case where different barr

[jira] [Commented] (SPARK-31651) Improve handling the case where different barrier sync types in a single sync

[ https://issues.apache.org/jira/browse/SPARK-31651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110917#comment-17110917 ] Xingbo Jiang commented on SPARK-31651: -- Resolved by https://github.com/apache/spark

  1   2   >