[jira] [Commented] (SPARK-32489) Pass all `core` module UTs in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-32489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167677#comment-17167677 ] Apache Spark commented on SPARK-32489: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-32489) Pass all `core` module UTs in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-32489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32489: Assignee: Apache Spark > Pass all `core` module UTs in Scala 2.13 > -

[jira] [Commented] (SPARK-32489) Pass all `core` module UTs in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-32489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167676#comment-17167676 ] Apache Spark commented on SPARK-32489: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-32489) Pass all `core` module UTs in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-32489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32489: Assignee: (was: Apache Spark) > Pass all `core` module UTs in Scala 2.13 > --

[jira] [Updated] (SPARK-32489) Pass all `core` module UTs in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-32489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32489: -- Description: {code} $ dev/change-scala-version.sh 2.13 $ build/mvn test -pl core --am -Pscala-

[jira] [Assigned] (SPARK-32412) Unify error handling for spark thrift server operations

[ https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32412: --- Assignee: Kent Yao > Unify error handling for spark thrift server operations >

[jira] [Resolved] (SPARK-32412) Unify error handling for spark thrift server operations

[ https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32412. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29204 [https://gith

[jira] [Created] (SPARK-32489) Pass all `core` module UTs in Scala 2.12

Dongjoon Hyun created SPARK-32489: - Summary: Pass all `core` module UTs in Scala 2.12 Key: SPARK-32489 URL: https://issues.apache.org/jira/browse/SPARK-32489 Project: Spark Issue Type: Sub-ta

[jira] [Updated] (SPARK-32489) Pass all `core` module UTs in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-32489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32489: -- Summary: Pass all `core` module UTs in Scala 2.13 (was: Pass all `core` module UTs in Scala 2

[jira] [Commented] (SPARK-32406) Support reset one particular configuration

[ https://issues.apache.org/jira/browse/SPARK-32406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167672#comment-17167672 ] Apache Spark commented on SPARK-32406: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-32406) Support reset one particular configuration

[ https://issues.apache.org/jira/browse/SPARK-32406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167670#comment-17167670 ] Apache Spark commented on SPARK-32406: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-32396) Support the BATCH_READ capability by JDBCTable

[ https://issues.apache.org/jira/browse/SPARK-32396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167669#comment-17167669 ] Maxim Gekk commented on SPARK-32396: I am working on it. > Support the BATCH_READ c

[jira] [Resolved] (SPARK-32478) Error message to show the schema mismatch in gapply with Arrow vectorization

[ https://issues.apache.org/jira/browse/SPARK-32478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32478. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-32478) Error message to show the schema mismatch in gapply with Arrow vectorization

[ https://issues.apache.org/jira/browse/SPARK-32478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32478: Assignee: Hyukjin Kwon > Error message to show the schema mismatch in gapply with Arrow v

[jira] [Assigned] (SPARK-32431) The .schema() API behaves incorrectly for nested schemas that have column duplicates in case-insensitive mode

[ https://issues.apache.org/jira/browse/SPARK-32431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32431: --- Assignee: Maxim Gekk > The .schema() API behaves incorrectly for nested schemas that have c

[jira] [Resolved] (SPARK-32431) The .schema() API behaves incorrectly for nested schemas that have column duplicates in case-insensitive mode

[ https://issues.apache.org/jira/browse/SPARK-32431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32431. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29234 [https://gith

[jira] [Updated] (SPARK-32469) ApplyColumnarRulesAndInsertTransitions should be idempotent

[ https://issues.apache.org/jira/browse/SPARK-32469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32469: Description: It's good hygiene to keep rules idempotent, even if we know the rule is going to be

[jira] [Updated] (SPARK-32469) ApplyColumnarRulesAndInsertTransitions should be idempotent

[ https://issues.apache.org/jira/browse/SPARK-32469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32469: Description: It's good hygiene to keep rules idempotent, even if we know the rule is going to be

[jira] [Updated] (SPARK-32469) ApplyColumnarRulesAndInsertTransitions should be idempotent

[ https://issues.apache.org/jira/browse/SPARK-32469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32469: Description: It's good hygiene to keep rules idempotent, even if we know the rule is going to be

[jira] [Commented] (SPARK-29314) ProgressReporter.extractStateOperatorMetrics should not overwrite updated as 0 when it actually runs a batch even with no data

[ https://issues.apache.org/jira/browse/SPARK-29314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167644#comment-17167644 ] Sandeep Katta commented on SPARK-29314: --- ya my bad, not required to backport > Pr

[jira] [Commented] (SPARK-29314) ProgressReporter.extractStateOperatorMetrics should not overwrite updated as 0 when it actually runs a batch even with no data

[ https://issues.apache.org/jira/browse/SPARK-29314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167642#comment-17167642 ] Jungtaek Lim commented on SPARK-29314: -- [~sandeep.katta2007] Did you encounter some

[jira] [Commented] (SPARK-32486) Issue with deserialization and persist api in latest spark java versions

[ https://issues.apache.org/jira/browse/SPARK-32486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167614#comment-17167614 ] Dinesh Kumar commented on SPARK-32486: -- Hey, Its happening in all the higher versio

[jira] [Resolved] (SPARK-32455) LogisticRegressionModel prediction optimization

[ https://issues.apache.org/jira/browse/SPARK-32455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-32455. Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29255 [https://github

[jira] [Assigned] (SPARK-32455) LogisticRegressionModel prediction optimization

[ https://issues.apache.org/jira/browse/SPARK-32455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-32455: -- Assignee: zhengruifeng > LogisticRegressionModel prediction optimization > --

[jira] [Assigned] (SPARK-32488) Use @parser::members and @lexer::members to avoid generating unused code

[ https://issues.apache.org/jira/browse/SPARK-32488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32488: Assignee: (was: Apache Spark) > Use @parser::members and @lexer::members to avoid gen

[jira] [Assigned] (SPARK-32488) Use @parser::members and @lexer::members to avoid generating unused code

[ https://issues.apache.org/jira/browse/SPARK-32488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32488: Assignee: Apache Spark > Use @parser::members and @lexer::members to avoid generating unu

[jira] [Commented] (SPARK-32488) Use @parser::members and @lexer::members to avoid generating unused code

[ https://issues.apache.org/jira/browse/SPARK-32488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167596#comment-17167596 ] Apache Spark commented on SPARK-32488: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-32488) Use @parser::members and @lexer::members to avoid generating unused code

[ https://issues.apache.org/jira/browse/SPARK-32488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167597#comment-17167597 ] Apache Spark commented on SPARK-32488: -- User 'maropu' has created a pull request fo

[jira] [Created] (SPARK-32488) Use @parser::members and @lexer::members to avoid generating unused code

Takeshi Yamamuro created SPARK-32488: Summary: Use @parser::members and @lexer::members to avoid generating unused code Key: SPARK-32488 URL: https://issues.apache.org/jira/browse/SPARK-32488 Proj

[jira] [Resolved] (SPARK-32010) Thread leaks in pinned thread mode

[ https://issues.apache.org/jira/browse/SPARK-32010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32010. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28968 [https://gi

[jira] [Assigned] (SPARK-32248) Recover JDK 11 builds in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32248: - Assignee: Dongjoon Hyun (was: Hyukjin Kwon) > Recover JDK 11 builds in Github Actions

[jira] [Resolved] (SPARK-32248) Recover JDK 11 builds in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32248. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29295 [https://

[jira] [Assigned] (SPARK-32248) Recover JDK 11 builds in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32248: - Assignee: Hyukjin Kwon > Recover JDK 11 builds in Github Actions >

[jira] [Resolved] (SPARK-32487) Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource

[ https://issues.apache.org/jira/browse/SPARK-32487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32487. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29293 [https://

[jira] [Assigned] (SPARK-32248) Recover JDK 11 builds in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32248: Assignee: (was: Apache Spark) > Recover JDK 11 builds in Github Actions > ---

[jira] [Assigned] (SPARK-32248) Recover JDK 11 builds in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32248: Assignee: Apache Spark > Recover JDK 11 builds in Github Actions > --

[jira] [Commented] (SPARK-32248) Recover JDK 11 builds in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167566#comment-17167566 ] Apache Spark commented on SPARK-32248: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167563#comment-17167563 ] Apache Spark commented on SPARK-32160: -- User 'ueshin' has created a pull request fo

[jira] [Commented] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167564#comment-17167564 ] Apache Spark commented on SPARK-32160: -- User 'ueshin' has created a pull request fo

[jira] [Commented] (SPARK-32385) Publish a "bill of materials" (BOM) descriptor for Spark with correct versions of various dependencies

[ https://issues.apache.org/jira/browse/SPARK-32385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167527#comment-17167527 ] Vladimir Matveev commented on SPARK-32385: -- [~hyukjin.kwon] almost: those are j

[jira] [Assigned] (SPARK-32487) Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource

[ https://issues.apache.org/jira/browse/SPARK-32487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32487: - Assignee: Dongjoon Hyun > Remove javax.ws.rs.NotFoundException from `import` in > Stag

[jira] [Resolved] (SPARK-32397) Snapshot artifacts can have differing timestamps, making it hard to consume

[ https://issues.apache.org/jira/browse/SPARK-32397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-32397. - Fix Version/s: 3.1.0 2.4.7 3.0.1 Resolution: Fixed Issue re

[jira] [Assigned] (SPARK-32487) Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource

[ https://issues.apache.org/jira/browse/SPARK-32487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32487: Assignee: Apache Spark > Remove javax.ws.rs.NotFoundException from `import` in > StagesR

[jira] [Assigned] (SPARK-32487) Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource

[ https://issues.apache.org/jira/browse/SPARK-32487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32487: Assignee: (was: Apache Spark) > Remove javax.ws.rs.NotFoundException from `import` in

[jira] [Commented] (SPARK-32487) Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource

[ https://issues.apache.org/jira/browse/SPARK-32487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167509#comment-17167509 ] Apache Spark commented on SPARK-32487: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-32487) Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource

Dongjoon Hyun created SPARK-32487: - Summary: Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource Key: SPARK-32487 URL: https://issues.apache.org/jira/browse/SPARK-32487

[jira] [Comment Edited] (SPARK-32385) Publish a "bill of materials" (BOM) descriptor for Spark with correct versions of various dependencies

[ https://issues.apache.org/jira/browse/SPARK-32385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167504#comment-17167504 ] DB Tsai edited comment on SPARK-32385 at 7/29/20, 9:04 PM: --- +1

[jira] [Commented] (SPARK-32385) Publish a "bill of materials" (BOM) descriptor for Spark with correct versions of various dependencies

[ https://issues.apache.org/jira/browse/SPARK-32385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167504#comment-17167504 ] DB Tsai commented on SPARK-32385: - +1 This will be very useful for users to include Spar

[jira] [Resolved] (SPARK-32465) How do I get the SPARK shuffle monitoring indicator?

[ https://issues.apache.org/jira/browse/SPARK-32465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32465. -- Resolution: Invalid > How do I get the SPARK shuffle monitoring indicator? > -

[jira] [Commented] (SPARK-27335) cannot collect() from Correlation.corr

[ https://issues.apache.org/jira/browse/SPARK-27335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167475#comment-17167475 ] Ian Cook commented on SPARK-27335: -- Regarding the workaround code that [~natalinobusa]

[jira] [Commented] (SPARK-32465) How do I get the SPARK shuffle monitoring indicator?

[ https://issues.apache.org/jira/browse/SPARK-32465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167471#comment-17167471 ] Rohit Mishra commented on SPARK-32465: -- [~MOBIN], Can you please ask questions usin

[jira] [Commented] (SPARK-32403) SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement

[ https://issues.apache.org/jira/browse/SPARK-32403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167461#comment-17167461 ] Rohit Mishra commented on SPARK-32403: -- [~angerszhuuu], Can you please add a descri

[jira] [Resolved] (SPARK-32332) AQE doesn't adequately allow for Columnar Processing extension

[ https://issues.apache.org/jira/browse/SPARK-32332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-32332. --- Fix Version/s: 3.1.0 Assignee: Wenchen Fan Resolution: Fixed > AQE doesn't a

[jira] [Commented] (SPARK-32469) ApplyColumnarRulesAndInsertTransitions should be idempotent

[ https://issues.apache.org/jira/browse/SPARK-32469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167455#comment-17167455 ] Rohit Mishra commented on SPARK-32469: -- [~cloud_fan], Can you please add a descript

[jira] [Commented] (SPARK-32444) Infer filters from DPP

[ https://issues.apache.org/jira/browse/SPARK-32444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167451#comment-17167451 ] Rohit Mishra commented on SPARK-32444: -- [~yumwang], Can you please add a descriptio

[jira] [Commented] (SPARK-32445) Make NullType.sql as VOID to support hive

[ https://issues.apache.org/jira/browse/SPARK-32445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167447#comment-17167447 ] Rohit Mishra commented on SPARK-32445: -- [~ulysses], Can you please add a descriptio

[jira] [Resolved] (SPARK-30322) Add stage level scheduling docs

[ https://issues.apache.org/jira/browse/SPARK-30322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-30322. --- Fix Version/s: 3.1.0 Assignee: Thomas Graves Resolution: Fixed > Add stage l

[jira] [Commented] (SPARK-32485) RecordBinaryComparatorSuite test failures on big-endian systems

[ https://issues.apache.org/jira/browse/SPARK-32485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167440#comment-17167440 ] Rohit Mishra commented on SPARK-32485: -- [~mundaym], can you please add environment

[jira] [Updated] (SPARK-32470) Remove task result size check for shuffle map stage

[ https://issues.apache.org/jira/browse/SPARK-32470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32470: -- Affects Version/s: 2.4.6 3.0.0 > Remove task result size check for shuf

[jira] [Commented] (SPARK-32346) Support filters pushdown in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167390#comment-17167390 ] Gengliang Wang commented on SPARK-32346: This issue is resolved in https://githu

[jira] [Resolved] (SPARK-32476) ResourceAllocator.availableAddrs should be deterministic

[ https://issues.apache.org/jira/browse/SPARK-32476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32476. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29281 [https://

[jira] [Resolved] (SPARK-32346) Support filters pushdown in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-32346. Resolution: Fixed > Support filters pushdown in Avro datasource >

[jira] [Updated] (SPARK-32470) Remove task result size check for shuffle map stage

[ https://issues.apache.org/jira/browse/SPARK-32470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Xue updated SPARK-32470: Description: The task result of a shuffle map stage is not the query result but instead is only map statu

[jira] [Commented] (SPARK-25770) support SparkDataFrame pretty print

[ https://issues.apache.org/jira/browse/SPARK-25770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167324#comment-17167324 ] S Daniel Zafar commented on SPARK-25770: [~adrian555], what would your preferred

[jira] [Commented] (SPARK-30255) Support explain mode in SparkR df.explain

[ https://issues.apache.org/jira/browse/SPARK-30255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167320#comment-17167320 ] Hyukjin Kwon commented on SPARK-30255: -- Please go ahead and directly open a PR. We

[jira] [Commented] (SPARK-30255) Support explain mode in SparkR df.explain

[ https://issues.apache.org/jira/browse/SPARK-30255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167316#comment-17167316 ] S Daniel Zafar commented on SPARK-30255: Hello- I would like to knock this one o

[jira] [Commented] (SPARK-30322) Add stage level scheduling docs

[ https://issues.apache.org/jira/browse/SPARK-30322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167307#comment-17167307 ] Apache Spark commented on SPARK-30322: -- User 'tgravescs' has created a pull request

[jira] [Assigned] (SPARK-30322) Add stage level scheduling docs

[ https://issues.apache.org/jira/browse/SPARK-30322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30322: Assignee: Apache Spark > Add stage level scheduling docs > --

[jira] [Commented] (SPARK-30322) Add stage level scheduling docs

[ https://issues.apache.org/jira/browse/SPARK-30322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167306#comment-17167306 ] Apache Spark commented on SPARK-30322: -- User 'tgravescs' has created a pull request

[jira] [Assigned] (SPARK-30322) Add stage level scheduling docs

[ https://issues.apache.org/jira/browse/SPARK-30322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30322: Assignee: (was: Apache Spark) > Add stage level scheduling docs > ---

[jira] [Resolved] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-12172. -- Resolution: Won't Fix Sounds like a WontFix for the foreseeable future, but could be reopened

[jira] [Commented] (SPARK-32481) Support truncate table to move the data to trash

[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167300#comment-17167300 ] Sean R. Owen commented on SPARK-32481: -- Please add a description > Support truncat

[jira] [Resolved] (SPARK-32208) SparkSQL throw Illegal character exception when load certain abnormal path of HDFS

[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32208. -- Fix Version/s: (was: 2.4.3) Resolution: Invalid > SparkSQL throw Illegal character

[jira] [Updated] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-32227: - Fix Version/s: (was: 3.0.1) > Bug in load-spark-env.cmd with Spark 3.0.0 >

[jira] [Updated] (SPARK-32299) Decide SMJ Join Orientation adaptively

[ https://issues.apache.org/jira/browse/SPARK-32299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-32299: - Fix Version/s: (was: 3.1.0) Target Version/s: (was: 3.1.0) > Decide SMJ Join Orient

[jira] [Resolved] (SPARK-32486) Issue with deserialization and persist api in latest spark java versions

[ https://issues.apache.org/jira/browse/SPARK-32486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32486. -- Fix Version/s: (was: 2.3.3) Resolution: Invalid Please don't set Blocker, Target ve

[jira] [Updated] (SPARK-32346) Support filters pushdown in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-32346: - Fix Version/s: (was: 3.1.0) > Support filters pushdown in Avro datasource >

[jira] [Assigned] (SPARK-32449) Add summary to MultilayerPerceptronClassificationModel

[ https://issues.apache.org/jira/browse/SPARK-32449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-32449: Assignee: Huaxin Gao > Add summary to MultilayerPerceptronClassificationModel > -

[jira] [Resolved] (SPARK-32449) Add summary to MultilayerPerceptronClassificationModel

[ https://issues.apache.org/jira/browse/SPARK-32449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32449. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29250 [https://gi

[jira] [Created] (SPARK-32486) Issue with deserialization and persist api in latest spark java versions

Dinesh Kumar created SPARK-32486: Summary: Issue with deserialization and persist api in latest spark java versions Key: SPARK-32486 URL: https://issues.apache.org/jira/browse/SPARK-32486 Project: Spa

[jira] [Updated] (SPARK-30322) Add stage level scheduling docs

[ https://issues.apache.org/jira/browse/SPARK-30322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-30322: -- Description: Add stage level scheduling docs. > Add stage level scheduling docs >

[jira] [Resolved] (SPARK-32477) JsonProtocol.accumulablesToJson should be deterministic

[ https://issues.apache.org/jira/browse/SPARK-32477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32477. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29282 [https://

[jira] [Commented] (SPARK-30276) Support Filter expression allows simultaneous use of DISTINCT

[ https://issues.apache.org/jira/browse/SPARK-30276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167265#comment-17167265 ] Apache Spark commented on SPARK-30276: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-29314) ProgressReporter.extractStateOperatorMetrics should not overwrite updated as 0 when it actually runs a batch even with no data

[ https://issues.apache.org/jira/browse/SPARK-29314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167243#comment-17167243 ] Sandeep Katta commented on SPARK-29314: --- [~kabhwan] [~brkyvz] this is required to

[jira] [Created] (SPARK-32485) RecordBinaryComparatorSuite test failures on big-endian systems

Michael Munday created SPARK-32485: -- Summary: RecordBinaryComparatorSuite test failures on big-endian systems Key: SPARK-32485 URL: https://issues.apache.org/jira/browse/SPARK-32485 Project: Spark

[jira] [Commented] (SPARK-32470) Remove task result size check for shuffle map stage

[ https://issues.apache.org/jira/browse/SPARK-32470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167233#comment-17167233 ] Thomas Graves commented on SPARK-32470: --- Please add a description to the Jira as t

[jira] [Resolved] (SPARK-32175) Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

[ https://issues.apache.org/jira/browse/SPARK-32175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-32175. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed > Fix the order betwe

[jira] [Commented] (SPARK-32032) Eliminate deprecated poll(long) API calls to avoid infinite wait in driver

[ https://issues.apache.org/jira/browse/SPARK-32032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167214#comment-17167214 ] Gabor Somogyi commented on SPARK-32032: --- I'm working on the solution. > Eliminate

[jira] [Commented] (SPARK-32032) Eliminate deprecated poll(long) API calls to avoid infinite wait in driver

[ https://issues.apache.org/jira/browse/SPARK-32032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167213#comment-17167213 ] Gabor Somogyi commented on SPARK-32032: --- I've renamed the jira because the solutio

[jira] [Updated] (SPARK-32032) Eliminate deprecated poll(long) API calls to avoid infinite wait in driver

[ https://issues.apache.org/jira/browse/SPARK-32032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-32032: -- Summary: Eliminate deprecated poll(long) API calls to avoid infinite wait in driver (was: Use

[jira] [Commented] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167194#comment-17167194 ] Apache Spark commented on SPARK-32484: -- User 'prgitpr' has created a pull request f

[jira] [Commented] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167192#comment-17167192 ] pp commented on SPARK-32484: [https://github.com/apache/spark/pull/29290] > Not accurate Lo

[jira] [Assigned] (SPARK-32482) Eliminate deprecated poll(long) API calls to avoid infinite wait in tests

[ https://issues.apache.org/jira/browse/SPARK-32482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32482: Assignee: Apache Spark > Eliminate deprecated poll(long) API calls to avoid infinite wait

[jira] [Assigned] (SPARK-32482) Eliminate deprecated poll(long) API calls to avoid infinite wait in tests

[ https://issues.apache.org/jira/browse/SPARK-32482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32482: Assignee: (was: Apache Spark) > Eliminate deprecated poll(long) API calls to avoid in

[jira] [Commented] (SPARK-32482) Eliminate deprecated poll(long) API calls to avoid infinite wait in tests

[ https://issues.apache.org/jira/browse/SPARK-32482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167190#comment-17167190 ] Apache Spark commented on SPARK-32482: -- User 'gaborgsomogyi' has created a pull req

[jira] [Commented] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167184#comment-17167184 ] Apache Spark commented on SPARK-32484: -- User 'prgitpr' has created a pull request f

[jira] [Assigned] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32484: Assignee: Apache Spark > Not accurate Log Info in BroadcastExchangeExec.scala > ---

[jira] [Commented] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167183#comment-17167183 ] Apache Spark commented on SPARK-32484: -- User 'prgitpr' has created a pull request f

[jira] [Assigned] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32484: Assignee: (was: Apache Spark) > Not accurate Log Info in BroadcastExchangeExec.scal

[jira] [Created] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

pp created SPARK-32484: -- Summary: Not accurate Log Info in BroadcastExchangeExec.scala Key: SPARK-32484 URL: https://issues.apache.org/jira/browse/SPARK-32484 Project: Spark Issue Type: Bug

  1   2   >