[jira] [Assigned] (SPARK-35039) Remove Spark-version related codes from main codes.

2021-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35039: Assignee: Takuya Ueshin > Remove Spark-version related codes from main codes. >

[jira] [Resolved] (SPARK-35039) Remove Spark-version related codes from main codes.

2021-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35039. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32138

[jira] [Assigned] (SPARK-35035) Port Koalas internal implementation unit tests into PySpark

2021-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35035: Assignee: Xinrong Meng > Port Koalas internal implementation unit tests into PySpark >

[jira] [Resolved] (SPARK-35035) Port Koalas internal implementation unit tests into PySpark

2021-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35035. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32137

[jira] [Assigned] (SPARK-35055) Fix BitSet.union

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35055: Assignee: (was: Apache Spark) > Fix BitSet.union > > >

[jira] [Commented] (SPARK-35055) Fix BitSet.union

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320707#comment-17320707 ] Apache Spark commented on SPARK-35055: -- User 'sigmod' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35055) Fix BitSet.union

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35055: Assignee: Apache Spark > Fix BitSet.union > > > Key:

[jira] [Created] (SPARK-35055) Fix BitSet.union

2021-04-13 Thread Yingyi Bu (Jira)
Yingyi Bu created SPARK-35055: - Summary: Fix BitSet.union Key: SPARK-35055 URL: https://issues.apache.org/jira/browse/SPARK-35055 Project: Spark Issue Type: Sub-task Components:

[jira] [Resolved] (SPARK-35048) Distribute GitHub Actions workflows to fork repositories to share the resources

2021-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35048. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32092

[jira] [Assigned] (SPARK-35048) Distribute GitHub Actions workflows to fork repositories to share the resources

2021-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35048: Assignee: Hyukjin Kwon > Distribute GitHub Actions workflows to fork repositories to

[jira] [Resolved] (SPARK-35033) Port Koalas plot unit tests into PySpark

2021-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35033. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32151

[jira] [Assigned] (SPARK-35033) Port Koalas plot unit tests into PySpark

2021-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35033: Assignee: Xinrong Meng > Port Koalas plot unit tests into PySpark >

[jira] [Resolved] (SPARK-35050) Deprecate Apache Mesos as resource manager

2021-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35050. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32150

[jira] [Created] (SPARK-35054) Getting Critical Vulnerability CVE-2021-20231 on spark 3.0.0 branch

2021-04-13 Thread Shashank Jain (Jira)
Shashank Jain created SPARK-35054: - Summary: Getting Critical Vulnerability CVE-2021-20231 on spark 3.0.0 branch Key: SPARK-35054 URL: https://issues.apache.org/jira/browse/SPARK-35054 Project: Spark

[jira] [Commented] (SPARK-35052) Use static treePatternBitSet for Leaf expressions like AttributeReference and Literal

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320657#comment-17320657 ] Apache Spark commented on SPARK-35052: -- User 'sigmod' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35052) Use static treePatternBitSet for Leaf expressions like AttributeReference and Literal

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35052: Assignee: (was: Apache Spark) > Use static treePatternBitSet for Leaf expressions

[jira] [Commented] (SPARK-35052) Use static treePatternBitSet for Leaf expressions like AttributeReference and Literal

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320656#comment-17320656 ] Apache Spark commented on SPARK-35052: -- User 'sigmod' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35052) Use static treePatternBitSet for Leaf expressions like AttributeReference and Literal

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35052: Assignee: Apache Spark > Use static treePatternBitSet for Leaf expressions like

[jira] [Commented] (SPARK-34716) Support ANSI SQL intervals by the aggregate function `sum`

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320655#comment-17320655 ] Apache Spark commented on SPARK-34716: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-34577) Cannot drop/add columns from/to a dataset of v2 `DESCRIBE NAMESPACE`

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320647#comment-17320647 ] Apache Spark commented on SPARK-34577: -- User 'AngersZh' has created a pull request for this

[jira] [Updated] (SPARK-35053) Spark UI Stages->Tasks should show local launch time

2021-04-13 Thread LiDongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiDongwei updated SPARK-35053: -- Description: Hello! The launch time of the task displayed on the Spark Stage tab is the UTC time

[jira] [Created] (SPARK-35053) Spark UI Stages->Tasks should show local launch time

2021-04-13 Thread LiDongwei (Jira)
LiDongwei created SPARK-35053: - Summary: Spark UI Stages->Tasks should show local launch time Key: SPARK-35053 URL: https://issues.apache.org/jira/browse/SPARK-35053 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-34977) LIST FILES/JARS/ARCHIVES cannot handle multiple arguments properly when at least one path is quoted.

2021-04-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-34977. Fix Version/s: 3.2.0 Resolution: Fixed This issue is resolved in

[jira] [Issue Comment Deleted] (SPARK-34495) Add DedicatedJVMTest test tag

2021-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34495: - Comment: was deleted (was: User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-34995) Port/integrate Koalas remaining codes into PySpark

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320620#comment-17320620 ] Apache Spark commented on SPARK-34995: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34995) Port/integrate Koalas remaining codes into PySpark

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34995: Assignee: Apache Spark > Port/integrate Koalas remaining codes into PySpark >

[jira] [Commented] (SPARK-34995) Port/integrate Koalas remaining codes into PySpark

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320619#comment-17320619 ] Apache Spark commented on SPARK-34995: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34995) Port/integrate Koalas remaining codes into PySpark

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34995: Assignee: (was: Apache Spark) > Port/integrate Koalas remaining codes into PySpark >

[jira] [Commented] (SPARK-34495) Add DedicatedJVMTest test tag

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320617#comment-17320617 ] Apache Spark commented on SPARK-34495: -- User 'itholic' has created a pull request for this issue:

[jira] [Resolved] (SPARK-35012) Port Koalas DataFrame related unit tests into PySpark

2021-04-13 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-35012. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Assigned] (SPARK-35034) Port Koalas miscellaneous unit tests into PySpark

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35034: Assignee: Apache Spark > Port Koalas miscellaneous unit tests into PySpark >

[jira] [Assigned] (SPARK-35034) Port Koalas miscellaneous unit tests into PySpark

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35034: Assignee: (was: Apache Spark) > Port Koalas miscellaneous unit tests into PySpark >

[jira] [Commented] (SPARK-35034) Port Koalas miscellaneous unit tests into PySpark

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320523#comment-17320523 ] Apache Spark commented on SPARK-35034: -- User 'xinrong-databricks' has created a pull request for

[jira] [Comment Edited] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

2021-04-13 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-13860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320450#comment-17320450 ] koert kuipers edited comment on SPARK-13860 at 4/13/21, 6:38 PM: - this

[jira] [Comment Edited] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

2021-04-13 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-13860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320450#comment-17320450 ] koert kuipers edited comment on SPARK-13860 at 4/13/21, 6:33 PM: - this

[jira] [Commented] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

2021-04-13 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-13860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320450#comment-17320450 ] koert kuipers commented on SPARK-13860: --- this is what i now see: {code:java} scala> Seq(1.0,

[jira] [Assigned] (SPARK-35049) Remove unused MapOutputTracker in BlockStoreShuffleReader

2021-04-13 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-35049: --- Assignee: angerszhu > Remove unused MapOutputTracker in

[jira] [Resolved] (SPARK-35049) Remove unused MapOutputTracker in BlockStoreShuffleReader

2021-04-13 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-35049. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request

[jira] [Created] (SPARK-35052) Use static treePatternBitSet for Leaf expressions like AttributeReference and Literal

2021-04-13 Thread Yingyi Bu (Jira)
Yingyi Bu created SPARK-35052: - Summary: Use static treePatternBitSet for Leaf expressions like AttributeReference and Literal Key: SPARK-35052 URL: https://issues.apache.org/jira/browse/SPARK-35052

[jira] [Commented] (SPARK-34925) Spark shell failed to access external file to read content

2021-04-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320317#comment-17320317 ] Steve Loughran commented on SPARK-34925: you've got an s3a config option set to 100M but the

[jira] [Created] (SPARK-35051) Add a day-time interval to a date

2021-04-13 Thread Max Gekk (Jira)
Max Gekk created SPARK-35051: Summary: Add a day-time interval to a date Key: SPARK-35051 URL: https://issues.apache.org/jira/browse/SPARK-35051 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-35051) Add a day-time interval to a date

2021-04-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35051: - Description: Support adding of DayTimeIntervalType values to DATE values. (was: Support adding of

[jira] [Assigned] (SPARK-35051) Add a day-time interval to a date

2021-04-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35051: Assignee: (was: Max Gekk) > Add a day-time interval to a date >

[jira] [Resolved] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-13 Thread Lauri Koobas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lauri Koobas resolved SPARK-34993. -- Resolution: Not A Problem Things seem to be OK. Some seemingly OK JSON strings are actually

[jira] [Assigned] (SPARK-35033) Port Koalas plot unit tests into PySpark

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35033: Assignee: (was: Apache Spark) > Port Koalas plot unit tests into PySpark >

[jira] [Commented] (SPARK-35033) Port Koalas plot unit tests into PySpark

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320289#comment-17320289 ] Apache Spark commented on SPARK-35033: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-35033) Port Koalas plot unit tests into PySpark

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35033: Assignee: Apache Spark > Port Koalas plot unit tests into PySpark >

[jira] [Resolved] (SPARK-33604) Group exception messages in sql/execution

2021-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33604. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31920

[jira] [Assigned] (SPARK-33604) Group exception messages in sql/execution

2021-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33604: --- Assignee: jiaan.geng > Group exception messages in sql/execution >

[jira] [Commented] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320196#comment-17320196 ] Kousuke Saruta commented on SPARK-34993: The reason {code:java} "\\asd", "\\kkk" and "asd\\"

[jira] [Assigned] (SPARK-35050) Deprecate Apache Mesos as resource manager

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35050: Assignee: Apache Spark (was: Sean R. Owen) > Deprecate Apache Mesos as resource manager

[jira] [Commented] (SPARK-35050) Deprecate Apache Mesos as resource manager

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320193#comment-17320193 ] Apache Spark commented on SPARK-35050: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35050) Deprecate Apache Mesos as resource manager

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35050: Assignee: Sean R. Owen (was: Apache Spark) > Deprecate Apache Mesos as resource manager

[jira] [Created] (SPARK-35050) Deprecate Apache Mesos as resource manager

2021-04-13 Thread Sean R. Owen (Jira)
Sean R. Owen created SPARK-35050: Summary: Deprecate Apache Mesos as resource manager Key: SPARK-35050 URL: https://issues.apache.org/jira/browse/SPARK-35050 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-34947) Streaming write to a V2 table should invalidate its associated cache

2021-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34947: --- Assignee: Chao Sun > Streaming write to a V2 table should invalidate its associated cache

[jira] [Resolved] (SPARK-34947) Streaming write to a V2 table should invalidate its associated cache

2021-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34947. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32039

[jira] [Assigned] (SPARK-35014) A foldable expression could not be replaced by an AttributeReference

2021-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35014: --- Assignee: Yingyi Bu > A foldable expression could not be replaced by an AttributeReference

[jira] [Resolved] (SPARK-35014) A foldable expression could not be replaced by an AttributeReference

2021-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35014. - Fix Version/s: 3.0.3 3.1.2 3.2.0 Resolution: Fixed

[jira] [Assigned] (SPARK-35045) Add an internal option to control input buffer in univocity

2021-04-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35045: Assignee: Hyukjin Kwon > Add an internal option to control input buffer in univocity >

[jira] [Resolved] (SPARK-35045) Add an internal option to control input buffer in univocity

2021-04-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35045. -- Fix Version/s: 3.0.3 3.1.2 3.2.0 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-35043) Support traversal pruning in resolve functions in AnalysisHelper

2021-04-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35043: -- Assignee: Yingyi Bu > Support traversal pruning in resolve functions in

[jira] [Resolved] (SPARK-35043) Support traversal pruning in resolve functions in AnalysisHelper

2021-04-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35043. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32135

[jira] [Assigned] (SPARK-35041) Revise the overflow in UTF8String

2021-04-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35041: Assignee: ulysses you > Revise the overflow in UTF8String > - >

[jira] [Resolved] (SPARK-35041) Revise the overflow in UTF8String

2021-04-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35041. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32142

[jira] [Commented] (SPARK-28227) Spark can’t support TRANSFORM with aggregation

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320055#comment-17320055 ] Apache Spark commented on SPARK-28227: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-28227) Spark can’t support TRANSFORM with aggregation

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320056#comment-17320056 ] Apache Spark commented on SPARK-28227: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-35049) Remove unused MapOutputTracker in BlockStoreShuffleReader

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35049: Assignee: Apache Spark > Remove unused MapOutputTracker in BlockStoreShuffleReader >

[jira] [Commented] (SPARK-35049) Remove unused MapOutputTracker in BlockStoreShuffleReader

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320048#comment-17320048 ] Apache Spark commented on SPARK-35049: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-35049) Remove unused MapOutputTracker in BlockStoreShuffleReader

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35049: Assignee: (was: Apache Spark) > Remove unused MapOutputTracker in

[jira] [Commented] (SPARK-35049) Remove unused MapOutputTracker in BlockStoreShuffleReader

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320047#comment-17320047 ] Apache Spark commented on SPARK-35049: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-13 Thread Lauri Koobas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320046#comment-17320046 ] Lauri Koobas commented on SPARK-34993: -- Ok, most that makes sense :) Thank you. That still leaves

[jira] [Created] (SPARK-35049) Remove unused MapOutputTracker in BlockStoreShuffleReader

2021-04-13 Thread angerszhu (Jira)
angerszhu created SPARK-35049: - Summary: Remove unused MapOutputTracker in BlockStoreShuffleReader Key: SPARK-35049 URL: https://issues.apache.org/jira/browse/SPARK-35049 Project: Spark Issue

[jira] [Updated] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-13 Thread Lauri Koobas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lauri Koobas updated SPARK-34993: - Attachment: image-2021-04-13-12-07-26-391.png > from_json() acts differently on created and

[jira] [Assigned] (SPARK-35047) Allow Json datasources to write non-ascii characters as codepoints

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35047: Assignee: Kousuke Saruta (was: Apache Spark) > Allow Json datasources to write

[jira] [Commented] (SPARK-35047) Allow Json datasources to write non-ascii characters as codepoints

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319996#comment-17319996 ] Apache Spark commented on SPARK-35047: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-35047) Allow Json datasources to write non-ascii characters as codepoints

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319994#comment-17319994 ] Apache Spark commented on SPARK-35047: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35047) Allow Json datasources to write non-ascii characters as codepoints

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35047: Assignee: Apache Spark (was: Kousuke Saruta) > Allow Json datasources to write

[jira] [Updated] (SPARK-35047) Allow Json datasources to write non-ascii characters as codepoints

2021-04-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35047: --- Summary: Allow Json datasources to write non-ascii characters as codepoints (was: Allow

[jira] [Updated] (SPARK-35048) Distribute GitHub Actions workflows to fork repositories to share the resources

2021-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35048: - Priority: Critical (was: Major) > Distribute GitHub Actions workflows to fork repositories to

[jira] [Assigned] (SPARK-35048) Distribute GitHub Actions workflows to fork repositories to share the resources

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35048: Assignee: (was: Apache Spark) > Distribute GitHub Actions workflows to fork

[jira] [Assigned] (SPARK-35048) Distribute GitHub Actions workflows to fork repositories to share the resources

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35048: Assignee: Apache Spark > Distribute GitHub Actions workflows to fork repositories to

[jira] [Commented] (SPARK-35048) Distribute GitHub Actions workflows to fork repositories to share the resources

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319991#comment-17319991 ] Apache Spark commented on SPARK-35048: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-35048) Distribute GitHub Actions workflows to fork repositories to share the resources

2021-04-13 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-35048: Summary: Distribute GitHub Actions workflows to fork repositories to share the resources Key: SPARK-35048 URL: https://issues.apache.org/jira/browse/SPARK-35048

[jira] [Created] (SPARK-35047) Allow Json datasources to write non-ascii characters as code points

2021-04-13 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35047: -- Summary: Allow Json datasources to write non-ascii characters as code points Key: SPARK-35047 URL: https://issues.apache.org/jira/browse/SPARK-35047 Project:

[jira] [Created] (SPARK-35046) Wrong memory allocation on standalone mode cluster

2021-04-13 Thread Mohamadreza Rostami (Jira)
Mohamadreza Rostami created SPARK-35046: --- Summary: Wrong memory allocation on standalone mode cluster Key: SPARK-35046 URL: https://issues.apache.org/jira/browse/SPARK-35046 Project: Spark

[jira] [Assigned] (SPARK-28379) Correlated scalar subqueries must be aggregated

2021-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28379: --- Assignee: Allison Wang > Correlated scalar subqueries must be aggregated >

[jira] [Resolved] (SPARK-28379) Correlated scalar subqueries must be aggregated

2021-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28379. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32111

[jira] [Commented] (SPARK-34916) Support traversal pruning in the transform function family

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319980#comment-17319980 ] Apache Spark commented on SPARK-34916: -- User 'gengliangwang' has created a pull request for this

[jira] [Comment Edited] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319958#comment-17319958 ] Kousuke Saruta edited comment on SPARK-34993 at 4/13/21, 7:14 AM: -- Hi

[jira] [Comment Edited] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319958#comment-17319958 ] Kousuke Saruta edited comment on SPARK-34993 at 4/13/21, 7:01 AM: -- Hi

[jira] [Assigned] (SPARK-34990) Add a test for Parquet Modular Encryption in Spark

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34990: Assignee: Apache Spark > Add a test for Parquet Modular Encryption in Spark >

[jira] [Assigned] (SPARK-34990) Add a test for Parquet Modular Encryption in Spark

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34990: Assignee: (was: Apache Spark) > Add a test for Parquet Modular Encryption in Spark >

[jira] [Commented] (SPARK-34990) Add a test for Parquet Modular Encryption in Spark

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319963#comment-17319963 ] Apache Spark commented on SPARK-34990: -- User 'andersonm-ibm' has created a pull request for this

[jira] [Commented] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319958#comment-17319958 ] Kousuke Saruta commented on SPARK-34993: Hi [~laurikoobas]. I think all of the results is

[jira] [Updated] (SPARK-35042) Support traversal pruning in transform/resolve functions and their call sites

2021-04-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35042: --- Affects Version/s: (was: 3.1.0) 3.2.0 > Support traversal

[jira] [Assigned] (SPARK-35045) Add an internal option to control input buffer in univocity

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35045: Assignee: (was: Apache Spark) > Add an internal option to control input buffer in

[jira] [Commented] (SPARK-35045) Add an internal option to control input buffer in univocity

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319956#comment-17319956 ] Apache Spark commented on SPARK-35045: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-35045) Add an internal option to control input buffer in univocity

2021-04-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35045: Assignee: Apache Spark > Add an internal option to control input buffer in univocity >

[jira] [Commented] (SPARK-35042) Support traversal pruning in transform/resolve functions and their call sites

2021-04-13 Thread Yingyi Bu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319950#comment-17319950 ] Yingyi Bu commented on SPARK-35042: --- >> [~buyingyi] Shall we use a bigger title and include 

[jira] [Comment Edited] (SPARK-35042) Support traversal pruning in transform/resolve functions and their call sites

2021-04-13 Thread Yingyi Bu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319950#comment-17319950 ] Yingyi Bu edited comment on SPARK-35042 at 4/13/21, 6:42 AM: - >> [~buyingyi] 

  1   2   >