[jira] [Updated] (SPARK-32469) ApplyColumnarRulesAndInsertTransitions should be idempotent

[ https://issues.apache.org/jira/browse/SPARK-32469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32469: Description: It's good hygiene to keep rules idempotent, even if we know the rule is going to be

[jira] [Updated] (SPARK-32469) ApplyColumnarRulesAndInsertTransitions should be idempotent

[ https://issues.apache.org/jira/browse/SPARK-32469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32469: Description: It's good hygiene to keep rules idempotent, even if we know the rule is going to be

[jira] [Updated] (SPARK-32469) ApplyColumnarRulesAndInsertTransitions should be idempotent

[ https://issues.apache.org/jira/browse/SPARK-32469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32469: Description: It's good hygiene to keep rules idempotent, even if we know the rule is going to be

[jira] [Commented] (SPARK-29314) ProgressReporter.extractStateOperatorMetrics should not overwrite updated as 0 when it actually runs a batch even with no data

[ https://issues.apache.org/jira/browse/SPARK-29314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167644#comment-17167644 ] Sandeep Katta commented on SPARK-29314: --- ya my bad, not required to backport >

[jira] [Commented] (SPARK-29314) ProgressReporter.extractStateOperatorMetrics should not overwrite updated as 0 when it actually runs a batch even with no data

[ https://issues.apache.org/jira/browse/SPARK-29314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167642#comment-17167642 ] Jungtaek Lim commented on SPARK-29314: -- [~sandeep.katta2007] Did you encounter some issue regarding

[jira] [Commented] (SPARK-32486) Issue with deserialization and persist api in latest spark java versions

[ https://issues.apache.org/jira/browse/SPARK-32486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167614#comment-17167614 ] Dinesh Kumar commented on SPARK-32486: -- Hey, Its happening in all the higher versions. Can you

[jira] [Resolved] (SPARK-32455) LogisticRegressionModel prediction optimization

[ https://issues.apache.org/jira/browse/SPARK-32455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-32455. Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29255

[jira] [Assigned] (SPARK-32455) LogisticRegressionModel prediction optimization

[ https://issues.apache.org/jira/browse/SPARK-32455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-32455: -- Assignee: zhengruifeng > LogisticRegressionModel prediction optimization >

[jira] [Assigned] (SPARK-32488) Use @parser::members and @lexer::members to avoid generating unused code

[ https://issues.apache.org/jira/browse/SPARK-32488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32488: Assignee: (was: Apache Spark) > Use @parser::members and @lexer::members to avoid

[jira] [Assigned] (SPARK-32488) Use @parser::members and @lexer::members to avoid generating unused code

[ https://issues.apache.org/jira/browse/SPARK-32488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32488: Assignee: Apache Spark > Use @parser::members and @lexer::members to avoid generating

[jira] [Commented] (SPARK-32488) Use @parser::members and @lexer::members to avoid generating unused code

[ https://issues.apache.org/jira/browse/SPARK-32488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167596#comment-17167596 ] Apache Spark commented on SPARK-32488: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-32488) Use @parser::members and @lexer::members to avoid generating unused code

[ https://issues.apache.org/jira/browse/SPARK-32488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167597#comment-17167597 ] Apache Spark commented on SPARK-32488: -- User 'maropu' has created a pull request for this issue:

[jira] [Created] (SPARK-32488) Use @parser::members and @lexer::members to avoid generating unused code

Takeshi Yamamuro created SPARK-32488: Summary: Use @parser::members and @lexer::members to avoid generating unused code Key: SPARK-32488 URL: https://issues.apache.org/jira/browse/SPARK-32488

[jira] [Resolved] (SPARK-32010) Thread leaks in pinned thread mode

[ https://issues.apache.org/jira/browse/SPARK-32010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32010. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28968

[jira] [Assigned] (SPARK-32248) Recover JDK 11 builds in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32248: - Assignee: Dongjoon Hyun (was: Hyukjin Kwon) > Recover JDK 11 builds in Github Actions

[jira] [Resolved] (SPARK-32248) Recover JDK 11 builds in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32248. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29295

[jira] [Assigned] (SPARK-32248) Recover JDK 11 builds in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32248: - Assignee: Hyukjin Kwon > Recover JDK 11 builds in Github Actions >

[jira] [Resolved] (SPARK-32487) Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource

[ https://issues.apache.org/jira/browse/SPARK-32487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32487. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29293

[jira] [Assigned] (SPARK-32248) Recover JDK 11 builds in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32248: Assignee: (was: Apache Spark) > Recover JDK 11 builds in Github Actions >

[jira] [Assigned] (SPARK-32248) Recover JDK 11 builds in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32248: Assignee: Apache Spark > Recover JDK 11 builds in Github Actions >

[jira] [Commented] (SPARK-32248) Recover JDK 11 builds in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167566#comment-17167566 ] Apache Spark commented on SPARK-32248: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167563#comment-17167563 ] Apache Spark commented on SPARK-32160: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167564#comment-17167564 ] Apache Spark commented on SPARK-32160: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-32385) Publish a "bill of materials" (BOM) descriptor for Spark with correct versions of various dependencies

[ https://issues.apache.org/jira/browse/SPARK-32385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167527#comment-17167527 ] Vladimir Matveev commented on SPARK-32385: -- [~hyukjin.kwon] almost: those are just lists of the

[jira] [Assigned] (SPARK-32487) Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource

[ https://issues.apache.org/jira/browse/SPARK-32487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32487: - Assignee: Dongjoon Hyun > Remove javax.ws.rs.NotFoundException from `import` in >

[jira] [Resolved] (SPARK-32397) Snapshot artifacts can have differing timestamps, making it hard to consume

[ https://issues.apache.org/jira/browse/SPARK-32397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-32397. - Fix Version/s: 3.1.0 2.4.7 3.0.1 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-32487) Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource

[ https://issues.apache.org/jira/browse/SPARK-32487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32487: Assignee: Apache Spark > Remove javax.ws.rs.NotFoundException from `import` in >

[jira] [Assigned] (SPARK-32487) Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource

[ https://issues.apache.org/jira/browse/SPARK-32487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32487: Assignee: (was: Apache Spark) > Remove javax.ws.rs.NotFoundException from `import`

[jira] [Commented] (SPARK-32487) Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource

[ https://issues.apache.org/jira/browse/SPARK-32487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167509#comment-17167509 ] Apache Spark commented on SPARK-32487: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-32487) Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource

Dongjoon Hyun created SPARK-32487: - Summary: Remove javax.ws.rs.NotFoundException from `import` in StagesResource/OneApplicationResource Key: SPARK-32487 URL: https://issues.apache.org/jira/browse/SPARK-32487

[jira] [Comment Edited] (SPARK-32385) Publish a "bill of materials" (BOM) descriptor for Spark with correct versions of various dependencies

[ https://issues.apache.org/jira/browse/SPARK-32385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167504#comment-17167504 ] DB Tsai edited comment on SPARK-32385 at 7/29/20, 9:04 PM: --- +1 This will be

[jira] [Commented] (SPARK-32385) Publish a "bill of materials" (BOM) descriptor for Spark with correct versions of various dependencies

[ https://issues.apache.org/jira/browse/SPARK-32385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167504#comment-17167504 ] DB Tsai commented on SPARK-32385: - +1 This will be very useful for users to include Spark as deps.  

[jira] [Resolved] (SPARK-32465) How do I get the SPARK shuffle monitoring indicator?

[ https://issues.apache.org/jira/browse/SPARK-32465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32465. -- Resolution: Invalid > How do I get the SPARK shuffle monitoring indicator? >

[jira] [Commented] (SPARK-27335) cannot collect() from Correlation.corr

[ https://issues.apache.org/jira/browse/SPARK-27335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167475#comment-17167475 ] Ian Cook commented on SPARK-27335: -- Regarding the workaround code that [~natalinobusa] posted above: In

[jira] [Commented] (SPARK-32465) How do I get the SPARK shuffle monitoring indicator?

[ https://issues.apache.org/jira/browse/SPARK-32465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167471#comment-17167471 ] Rohit Mishra commented on SPARK-32465: -- [~MOBIN], Can you please ask questions using the mailing

[jira] [Commented] (SPARK-32403) SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement

[ https://issues.apache.org/jira/browse/SPARK-32403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167461#comment-17167461 ] Rohit Mishra commented on SPARK-32403: -- [~angerszhuuu], Can you please add a description? > SCRIP

[jira] [Resolved] (SPARK-32332) AQE doesn't adequately allow for Columnar Processing extension

[ https://issues.apache.org/jira/browse/SPARK-32332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-32332. --- Fix Version/s: 3.1.0 Assignee: Wenchen Fan Resolution: Fixed > AQE doesn't

[jira] [Commented] (SPARK-32469) ApplyColumnarRulesAndInsertTransitions should be idempotent

[ https://issues.apache.org/jira/browse/SPARK-32469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167455#comment-17167455 ] Rohit Mishra commented on SPARK-32469: -- [~cloud_fan], Can you please add a description while you

[jira] [Commented] (SPARK-32444) Infer filters from DPP

[ https://issues.apache.org/jira/browse/SPARK-32444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167451#comment-17167451 ] Rohit Mishra commented on SPARK-32444: -- [~yumwang], Can you please add a description? > Infer

[jira] [Commented] (SPARK-32445) Make NullType.sql as VOID to support hive

[ https://issues.apache.org/jira/browse/SPARK-32445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167447#comment-17167447 ] Rohit Mishra commented on SPARK-32445: -- [~ulysses], Can you please add a description?  > Make

[jira] [Resolved] (SPARK-30322) Add stage level scheduling docs

[ https://issues.apache.org/jira/browse/SPARK-30322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-30322. --- Fix Version/s: 3.1.0 Assignee: Thomas Graves Resolution: Fixed > Add stage

[jira] [Commented] (SPARK-32485) RecordBinaryComparatorSuite test failures on big-endian systems

[ https://issues.apache.org/jira/browse/SPARK-32485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167440#comment-17167440 ] Rohit Mishra commented on SPARK-32485: -- [~mundaym], can you please add environment detail and steps

[jira] [Updated] (SPARK-32470) Remove task result size check for shuffle map stage

[ https://issues.apache.org/jira/browse/SPARK-32470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32470: -- Affects Version/s: 2.4.6 3.0.0 > Remove task result size check for

[jira] [Commented] (SPARK-32346) Support filters pushdown in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167390#comment-17167390 ] Gengliang Wang commented on SPARK-32346: This issue is resolved in

[jira] [Resolved] (SPARK-32476) ResourceAllocator.availableAddrs should be deterministic

[ https://issues.apache.org/jira/browse/SPARK-32476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32476. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29281

[jira] [Resolved] (SPARK-32346) Support filters pushdown in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-32346. Resolution: Fixed > Support filters pushdown in Avro datasource >

[jira] [Updated] (SPARK-32470) Remove task result size check for shuffle map stage

[ https://issues.apache.org/jira/browse/SPARK-32470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Xue updated SPARK-32470: Description: The task result of a shuffle map stage is not the query result but instead is only map

[jira] [Commented] (SPARK-25770) support SparkDataFrame pretty print

[ https://issues.apache.org/jira/browse/SPARK-25770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167324#comment-17167324 ] S Daniel Zafar commented on SPARK-25770: [~adrian555], what would your preferred print look

[jira] [Commented] (SPARK-30255) Support explain mode in SparkR df.explain

[ https://issues.apache.org/jira/browse/SPARK-30255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167320#comment-17167320 ] Hyukjin Kwon commented on SPARK-30255: -- Please go ahead and directly open a PR. We don't usually

[jira] [Commented] (SPARK-30255) Support explain mode in SparkR df.explain

[ https://issues.apache.org/jira/browse/SPARK-30255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167316#comment-17167316 ] S Daniel Zafar commented on SPARK-30255: Hello- I would like to knock this one out as a first

[jira] [Commented] (SPARK-30322) Add stage level scheduling docs

[ https://issues.apache.org/jira/browse/SPARK-30322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167307#comment-17167307 ] Apache Spark commented on SPARK-30322: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Assigned] (SPARK-30322) Add stage level scheduling docs

[ https://issues.apache.org/jira/browse/SPARK-30322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30322: Assignee: Apache Spark > Add stage level scheduling docs >

[jira] [Commented] (SPARK-30322) Add stage level scheduling docs

[ https://issues.apache.org/jira/browse/SPARK-30322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167306#comment-17167306 ] Apache Spark commented on SPARK-30322: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Assigned] (SPARK-30322) Add stage level scheduling docs

[ https://issues.apache.org/jira/browse/SPARK-30322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30322: Assignee: (was: Apache Spark) > Add stage level scheduling docs >

[jira] [Resolved] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-12172. -- Resolution: Won't Fix Sounds like a WontFix for the foreseeable future, but could be reopened

[jira] [Commented] (SPARK-32481) Support truncate table to move the data to trash

[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167300#comment-17167300 ] Sean R. Owen commented on SPARK-32481: -- Please add a description > Support truncate table to move

[jira] [Resolved] (SPARK-32208) SparkSQL throw Illegal character exception when load certain abnormal path of HDFS

[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32208. -- Fix Version/s: (was: 2.4.3) Resolution: Invalid > SparkSQL throw Illegal

[jira] [Updated] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-32227: - Fix Version/s: (was: 3.0.1) > Bug in load-spark-env.cmd with Spark 3.0.0 >

[jira] [Updated] (SPARK-32299) Decide SMJ Join Orientation adaptively

[ https://issues.apache.org/jira/browse/SPARK-32299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-32299: - Fix Version/s: (was: 3.1.0) Target Version/s: (was: 3.1.0) > Decide SMJ Join

[jira] [Resolved] (SPARK-32486) Issue with deserialization and persist api in latest spark java versions

[ https://issues.apache.org/jira/browse/SPARK-32486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32486. -- Fix Version/s: (was: 2.3.3) Resolution: Invalid Please don't set Blocker, Target

[jira] [Updated] (SPARK-32346) Support filters pushdown in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-32346: - Fix Version/s: (was: 3.1.0) > Support filters pushdown in Avro datasource >

[jira] [Assigned] (SPARK-32449) Add summary to MultilayerPerceptronClassificationModel

[ https://issues.apache.org/jira/browse/SPARK-32449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-32449: Assignee: Huaxin Gao > Add summary to MultilayerPerceptronClassificationModel >

[jira] [Resolved] (SPARK-32449) Add summary to MultilayerPerceptronClassificationModel

[ https://issues.apache.org/jira/browse/SPARK-32449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32449. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29250

[jira] [Created] (SPARK-32486) Issue with deserialization and persist api in latest spark java versions

Dinesh Kumar created SPARK-32486: Summary: Issue with deserialization and persist api in latest spark java versions Key: SPARK-32486 URL: https://issues.apache.org/jira/browse/SPARK-32486 Project:

[jira] [Updated] (SPARK-30322) Add stage level scheduling docs

[ https://issues.apache.org/jira/browse/SPARK-30322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-30322: -- Description: Add stage level scheduling docs. > Add stage level scheduling docs >

[jira] [Resolved] (SPARK-32477) JsonProtocol.accumulablesToJson should be deterministic

[ https://issues.apache.org/jira/browse/SPARK-32477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32477. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29282

[jira] [Commented] (SPARK-30276) Support Filter expression allows simultaneous use of DISTINCT

[ https://issues.apache.org/jira/browse/SPARK-30276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167265#comment-17167265 ] Apache Spark commented on SPARK-30276: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-29314) ProgressReporter.extractStateOperatorMetrics should not overwrite updated as 0 when it actually runs a batch even with no data

[ https://issues.apache.org/jira/browse/SPARK-29314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167243#comment-17167243 ] Sandeep Katta commented on SPARK-29314: --- [~kabhwan] [~brkyvz] this is required to backport to 2.4

[jira] [Created] (SPARK-32485) RecordBinaryComparatorSuite test failures on big-endian systems

Michael Munday created SPARK-32485: -- Summary: RecordBinaryComparatorSuite test failures on big-endian systems Key: SPARK-32485 URL: https://issues.apache.org/jira/browse/SPARK-32485 Project: Spark

[jira] [Commented] (SPARK-32470) Remove task result size check for shuffle map stage

[ https://issues.apache.org/jira/browse/SPARK-32470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167233#comment-17167233 ] Thomas Graves commented on SPARK-32470: --- Please add a description to the Jira as to why > Remove

[jira] [Resolved] (SPARK-32175) Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

[ https://issues.apache.org/jira/browse/SPARK-32175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-32175. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed > Fix the order

[jira] [Commented] (SPARK-32032) Eliminate deprecated poll(long) API calls to avoid infinite wait in driver

[ https://issues.apache.org/jira/browse/SPARK-32032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167214#comment-17167214 ] Gabor Somogyi commented on SPARK-32032: --- I'm working on the solution. > Eliminate deprecated

[jira] [Commented] (SPARK-32032) Eliminate deprecated poll(long) API calls to avoid infinite wait in driver

[ https://issues.apache.org/jira/browse/SPARK-32032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167213#comment-17167213 ] Gabor Somogyi commented on SPARK-32032: --- I've renamed the jira because the solution is not simply

[jira] [Updated] (SPARK-32032) Eliminate deprecated poll(long) API calls to avoid infinite wait in driver

[ https://issues.apache.org/jira/browse/SPARK-32032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-32032: -- Summary: Eliminate deprecated poll(long) API calls to avoid infinite wait in driver (was:

[jira] [Commented] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167194#comment-17167194 ] Apache Spark commented on SPARK-32484: -- User 'prgitpr' has created a pull request for this issue:

[jira] [Commented] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167192#comment-17167192 ] pp commented on SPARK-32484: [https://github.com/apache/spark/pull/29290] > Not accurate Log Info in

[jira] [Assigned] (SPARK-32482) Eliminate deprecated poll(long) API calls to avoid infinite wait in tests

[ https://issues.apache.org/jira/browse/SPARK-32482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32482: Assignee: Apache Spark > Eliminate deprecated poll(long) API calls to avoid infinite

[jira] [Assigned] (SPARK-32482) Eliminate deprecated poll(long) API calls to avoid infinite wait in tests

[ https://issues.apache.org/jira/browse/SPARK-32482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32482: Assignee: (was: Apache Spark) > Eliminate deprecated poll(long) API calls to avoid

[jira] [Commented] (SPARK-32482) Eliminate deprecated poll(long) API calls to avoid infinite wait in tests

[ https://issues.apache.org/jira/browse/SPARK-32482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167190#comment-17167190 ] Apache Spark commented on SPARK-32482: -- User 'gaborgsomogyi' has created a pull request for this

[jira] [Commented] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167184#comment-17167184 ] Apache Spark commented on SPARK-32484: -- User 'prgitpr' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32484: Assignee: Apache Spark > Not accurate Log Info in BroadcastExchangeExec.scala >

[jira] [Commented] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167183#comment-17167183 ] Apache Spark commented on SPARK-32484: -- User 'prgitpr' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

[ https://issues.apache.org/jira/browse/SPARK-32484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32484: Assignee: (was: Apache Spark) > Not accurate Log Info in

[jira] [Created] (SPARK-32484) Not accurate Log Info in BroadcastExchangeExec.scala

pp created SPARK-32484: -- Summary: Not accurate Log Info in BroadcastExchangeExec.scala Key: SPARK-32484 URL: https://issues.apache.org/jira/browse/SPARK-32484 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-27830) Show Spark version at app lists of Spark History UI

[ https://issues.apache.org/jira/browse/SPARK-27830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167171#comment-17167171 ] Apache Spark commented on SPARK-27830: -- User 'liucht-inspur' has created a pull request for this

[jira] [Commented] (SPARK-21708) use sbt 1.x

[ https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167168#comment-17167168 ] Apache Spark commented on SPARK-21708: -- User 'gemelen' has created a pull request for this issue:

[jira] [Commented] (SPARK-32483) spark-shell: error: value topByKey is not a member of org.apache.spark.rdd.RDD[(String, (String, Double))]

[ https://issues.apache.org/jira/browse/SPARK-32483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167158#comment-17167158 ] JinxinTang commented on SPARK-32483: [~ukiml] Please `import

[jira] [Created] (SPARK-32483) spark-shell: error: value topByKey is not a member of org.apache.spark.rdd.RDD[(String, (String, Double))]

manley created SPARK-32483: -- Summary: spark-shell: error: value topByKey is not a member of org.apache.spark.rdd.RDD[(String, (String, Double))] Key: SPARK-32483 URL: https://issues.apache.org/jira/browse/SPARK-32483

[jira] [Created] (SPARK-32482) Eliminate deprecated poll(long) API calls to avoid infinite wait in tests

Gabor Somogyi created SPARK-32482: - Summary: Eliminate deprecated poll(long) API calls to avoid infinite wait in tests Key: SPARK-32482 URL: https://issues.apache.org/jira/browse/SPARK-32482 Project:

[jira] [Commented] (SPARK-32479) Fix the slicing logic in createDataFrame when converting pandas dataframe to arrow table

[ https://issues.apache.org/jira/browse/SPARK-32479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167113#comment-17167113 ] Liang Zhang commented on SPARK-32479: - https://github.com/apache/spark/pull/29284 is ready for

[jira] [Issue Comment Deleted] (SPARK-32479) Fix the slicing logic in createDataFrame when converting pandas dataframe to arrow table

[ https://issues.apache.org/jira/browse/SPARK-32479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Zhang updated SPARK-32479: Comment: was deleted (was: https://github.com/apache/spark/pull/29284 is ready for review.

[jira] [Commented] (SPARK-32479) Fix the slicing logic in createDataFrame when converting pandas dataframe to arrow table

[ https://issues.apache.org/jira/browse/SPARK-32479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167112#comment-17167112 ] Apache Spark commented on SPARK-32479: -- User 'liangz1' has created a pull request for this issue:

[jira] [Commented] (SPARK-32480) Support insert overwrite to move the data to trash

[ https://issues.apache.org/jira/browse/SPARK-32480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167105#comment-17167105 ] Udbhav Agrawal commented on SPARK-32480: I will raise a MR to support this. > Support insert

[jira] [Commented] (SPARK-32481) Support truncate table to move the data to trash

[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167106#comment-17167106 ] Udbhav Agrawal commented on SPARK-32481: I will raise MR to support this. > Support truncate

[jira] [Created] (SPARK-32481) Support truncate table to move the data to trash

jobit mathew created SPARK-32481: Summary: Support truncate table to move the data to trash Key: SPARK-32481 URL: https://issues.apache.org/jira/browse/SPARK-32481 Project: Spark Issue Type:

[jira] [Created] (SPARK-32480) Support insert overwrite to move the data to trash

jobit mathew created SPARK-32480: Summary: Support insert overwrite to move the data to trash Key: SPARK-32480 URL: https://issues.apache.org/jira/browse/SPARK-32480 Project: Spark Issue

[jira] [Updated] (SPARK-32479) Fix the slicing logic in createDataFrame when converting pandas dataframe to arrow table

[ https://issues.apache.org/jira/browse/SPARK-32479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Zhang updated SPARK-32479: Description: h1. Problem: In

[jira] [Assigned] (SPARK-32479) Fix the slicing logic in createDataFrame when converting pandas dataframe to arrow table

[ https://issues.apache.org/jira/browse/SPARK-32479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-32479: -- Assignee: Liang Zhang > Fix the slicing logic in createDataFrame when converting pandas

[jira] [Created] (SPARK-32479) Fix the slicing logic in createDataFrame when converting pandas dataframe to arrow table

Liang Zhang created SPARK-32479: --- Summary: Fix the slicing logic in createDataFrame when converting pandas dataframe to arrow table Key: SPARK-32479 URL: https://issues.apache.org/jira/browse/SPARK-32479

[jira] [Resolved] (SPARK-32355) 使用Structured Streaming窗口统计不能实现topN

[ https://issues.apache.org/jira/browse/SPARK-32355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32355. -- Resolution: Incomplete > 使用Structured Streaming窗口统计不能实现topN >

  1   2   >