[jira] [Commented] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095093#comment-17095093 ] Xiao Li commented on SPARK-31480: - let me assign it to [~dkbiswal]  > Improve the EXPLAIN FORMATTED's

[jira] [Assigned] (SPARK-31567) Update AppVeyor Rtools to 4.0.0

[ https://issues.apache.org/jira/browse/SPARK-31567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31567: Assignee: Dongjoon Hyun > Update AppVeyor Rtools to 4.0.0 >

[jira] [Resolved] (SPARK-31567) Update AppVeyor Rtools to 4.0.0

[ https://issues.apache.org/jira/browse/SPARK-31567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31567. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28358

[jira] [Updated] (SPARK-31567) Update AppVeyor Rtools to 4.0.0

[ https://issues.apache.org/jira/browse/SPARK-31567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31567: -- Summary: Update AppVeyor Rtools to 4.0.0 (was: Update AppVeyor R version to 4.0.0) > Update

[jira] [Updated] (SPARK-31567) Update AppVeyor Rtools to 4.0.0

[ https://issues.apache.org/jira/browse/SPARK-31567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31567: -- Description: This is a preparation for upgrade to R. > Update AppVeyor Rtools to 4.0.0 >

[jira] [Closed] (SPARK-31591) namePrefix could be null in Utils.createDirectory

[ https://issues.apache.org/jira/browse/SPARK-31591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-31591. - > namePrefix could be null in Utils.createDirectory >

[jira] [Resolved] (SPARK-31182) PairRDD support aggregateByKeyWithinPartitions

[ https://issues.apache.org/jira/browse/SPARK-31182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-31182. -- Resolution: Not A Problem > PairRDD support aggregateByKeyWithinPartitions >

[jira] [Created] (SPARK-31600) Error message from DataFrame creation is misleading.

Olexiy Oryeshko created SPARK-31600: --- Summary: Error message from DataFrame creation is misleading. Key: SPARK-31600 URL: https://issues.apache.org/jira/browse/SPARK-31600 Project: Spark

[jira] [Resolved] (SPARK-30261) Should not change owner of hive table for some commands like 'alter' operation

[ https://issues.apache.org/jira/browse/SPARK-30261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-30261. -- Target Version/s: 2.4.3, 2.3.0 (was: 2.3.0, 2.4.3) Resolution: Duplicate > Should

[jira] [Resolved] (SPARK-31591) namePrefix could be null in Utils.createDirectory

[ https://issues.apache.org/jira/browse/SPARK-31591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31591. -- Resolution: Not A Problem See:

[jira] [Commented] (SPARK-31595) Spark sql cli should allow unescaped quote mark in quoted string

[ https://issues.apache.org/jira/browse/SPARK-31595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094980#comment-17094980 ] Adrian Wang commented on SPARK-31595: - [~Ankitraj] Thanks, I have already created a pull request on

[jira] [Resolved] (SPARK-31584) NullPointerException when parsing event log with InMemoryStore

[ https://issues.apache.org/jira/browse/SPARK-31584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-31584. Target Version/s: 3.0.0, 3.0.1, 3.1.0 (was: 3.0.1) Assignee: Baohe Zhang

[jira] [Resolved] (SPARK-31556) Document LIKE clause in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-31556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31556. -- Fix Version/s: 3.0.0 Assignee: Huaxin Gao Resolution: Fixed Resolved

[jira] [Commented] (SPARK-26365) spark-submit for k8s cluster doesn't propagate exit code

[ https://issues.apache.org/jira/browse/SPARK-26365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094932#comment-17094932 ] Lorenzo Pisani commented on SPARK-26365: I'm also seeing this behavior specifically with a

[jira] [Commented] (SPARK-31599) Reading from S3 (Structured Streaming Bucket) Fails after Compaction

[ https://issues.apache.org/jira/browse/SPARK-31599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094925#comment-17094925 ] Jungtaek Lim commented on SPARK-31599: -- Oh sorry I should guide to user@ mailing list, my bad.

[jira] [Commented] (SPARK-31599) Reading from S3 (Structured Streaming Bucket) Fails after Compaction

[ https://issues.apache.org/jira/browse/SPARK-31599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094917#comment-17094917 ] Felix Kizhakkel Jose commented on SPARK-31599: -- How do I do that?  > Reading from S3

[jira] [Commented] (SPARK-31599) Reading from S3 (Structured Streaming Bucket) Fails after Compaction

[ https://issues.apache.org/jira/browse/SPARK-31599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094915#comment-17094915 ] Jungtaek Lim commented on SPARK-31599: -- Please post a mail thread on dev@ mailing list. This looks

[jira] [Commented] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094893#comment-17094893 ] Sunil Kumar Chakrapani commented on SPARK-8333: --- Any plans to fix this issue for Spark

[jira] [Updated] (SPARK-31549) Pyspark SparkContext.cancelJobGroup do not work correctly

[ https://issues.apache.org/jira/browse/SPARK-31549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-31549: -- Target Version/s: 3.0.0 > Pyspark SparkContext.cancelJobGroup do not work correctly >

[jira] [Commented] (SPARK-31595) Spark sql cli should allow unescaped quote mark in quoted string

[ https://issues.apache.org/jira/browse/SPARK-31595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094830#comment-17094830 ] Ankit Raj Boudh commented on SPARK-31595: - [~adrian-wang], can i start working on this issue ?

[jira] [Commented] (SPARK-31591) namePrefix could be null in Utils.createDirectory

[ https://issues.apache.org/jira/browse/SPARK-31591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094829#comment-17094829 ] Ankit Raj Boudh commented on SPARK-31591: - [~cltlfcjin], It's ok Thank you for raising PR :) >

[jira] [Updated] (SPARK-31599) Reading from S3 (Structured Streaming Bucket) Fails after Compaction

[ https://issues.apache.org/jira/browse/SPARK-31599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Kizhakkel Jose updated SPARK-31599: - Description: I have a S3 bucket which has data streamed (Parquet format) to it

[jira] [Created] (SPARK-31599) Reading from S3 (Structured Streaming Bucket) Fails after Compaction

Felix Kizhakkel Jose created SPARK-31599: Summary: Reading from S3 (Structured Streaming Bucket) Fails after Compaction Key: SPARK-31599 URL: https://issues.apache.org/jira/browse/SPARK-31599

[jira] [Updated] (SPARK-30741) The data returned from SAS using JDBC reader contains column label

[ https://issues.apache.org/jira/browse/SPARK-30741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Liu updated SPARK-30741: - Attachment: ExamplesFromSASSupport.png > The data returned from SAS using JDBC reader contains column

[jira] [Updated] (SPARK-30741) The data returned from SAS using JDBC reader contains column label

[ https://issues.apache.org/jira/browse/SPARK-30741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Liu updated SPARK-30741: - Attachment: ReplyFromSASSupport.png > The data returned from SAS using JDBC reader contains column

[jira] [Reopened] (SPARK-30741) The data returned from SAS using JDBC reader contains column label

[ https://issues.apache.org/jira/browse/SPARK-30741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Liu reopened SPARK-30741: -- *Problem:* The spark JDBC reader read SAS data incorrectly, and returned the data with the column names

[jira] [Resolved] (SPARK-31339) Changed PipelineModel(...) to self.cls(...) in pyspark.ml.pipeline.PipelineModelReader.load()

[ https://issues.apache.org/jira/browse/SPARK-31339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31339. -- Resolution: Not A Problem > Changed PipelineModel(...) to self.cls(...) in >

[jira] [Resolved] (SPARK-31165) Multiple wrong references in Dockerfile for k8s

[ https://issues.apache.org/jira/browse/SPARK-31165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31165. -- Resolution: Not A Problem > Multiple wrong references in Dockerfile for k8s >

[jira] [Resolved] (SPARK-31149) PySpark job not killing Spark Daemon processes after the executor is killed due to OOM

[ https://issues.apache.org/jira/browse/SPARK-31149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31149. -- Resolution: Won't Fix > PySpark job not killing Spark Daemon processes after the executor is

[jira] [Resolved] (SPARK-30133) Support DELETE Jar and DELETE File functionality in spark

[ https://issues.apache.org/jira/browse/SPARK-30133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30133. -- Resolution: Won't Fix > Support DELETE Jar and DELETE File functionality in spark >

[jira] [Resolved] (SPARK-30135) Add documentation for DELETE JAR and DELETE File command

[ https://issues.apache.org/jira/browse/SPARK-30135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30135. -- Resolution: Won't Fix > Add documentation for DELETE JAR and DELETE File command >

[jira] [Resolved] (SPARK-30134) DELETE JAR should remove from addedJars list and from classpath

[ https://issues.apache.org/jira/browse/SPARK-30134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30134. -- Resolution: Won't Fix > DELETE JAR should remove from addedJars list and from classpath >

[jira] [Resolved] (SPARK-30137) Support DELETE file

[ https://issues.apache.org/jira/browse/SPARK-30137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30137. -- Resolution: Won't Fix > Support DELETE file > > > Key:

[jira] [Resolved] (SPARK-30136) DELETE JAR should also remove the jar from executor classPath

[ https://issues.apache.org/jira/browse/SPARK-30136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30136. -- Resolution: Won't Fix > DELETE JAR should also remove the jar from executor classPath >

[jira] [Created] (SPARK-31598) LegacySimpleTimestampFormatter incorrectly interprets pre-Gregorian timestamps

Bruce Robbins created SPARK-31598: - Summary: LegacySimpleTimestampFormatter incorrectly interprets pre-Gregorian timestamps Key: SPARK-31598 URL: https://issues.apache.org/jira/browse/SPARK-31598

[jira] [Commented] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

[ https://issues.apache.org/jira/browse/SPARK-31592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094669#comment-17094669 ] Yunbo Fan commented on SPARK-31592: --- I checked my executor log again and I find the executor got NPE

[jira] [Updated] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

[ https://issues.apache.org/jira/browse/SPARK-31592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yunbo Fan updated SPARK-31592: -- Affects Version/s: (was: 2.4.5) 2.4.3 > bufferPoolsBySize in

[jira] [Resolved] (SPARK-29458) Document scalar functions usage in APIs in SQL getting started.

[ https://issues.apache.org/jira/browse/SPARK-29458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29458. -- Fix Version/s: 3.0.0 Assignee: Huaxin Gao Resolution: Fixed Resolved by

[jira] [Comment Edited] (SPARK-31583) grouping_id calculation should be improved

[ https://issues.apache.org/jira/browse/SPARK-31583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094651#comment-17094651 ] Costas Piliotis edited comment on SPARK-31583 at 4/28/20, 4:16 PM: ---

[jira] [Commented] (SPARK-31583) grouping_id calculation should be improved

[ https://issues.apache.org/jira/browse/SPARK-31583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094651#comment-17094651 ] Costas Piliotis commented on SPARK-31583: - [~maropu] I'm trying to avoid referencing the

[jira] [Updated] (SPARK-31519) Cast in having aggregate expressions returns the wrong result

[ https://issues.apache.org/jira/browse/SPARK-31519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31519: -- Labels: correctness (was: ) > Cast in having aggregate expressions returns the wrong result

[jira] [Updated] (SPARK-31534) Text for tooltip should be escaped

[ https://issues.apache.org/jira/browse/SPARK-31534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31534: -- Fix Version/s: 3.0.0 > Text for tooltip should be escaped >

[jira] [Commented] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094627#comment-17094627 ] Dongjoon Hyun commented on SPARK-29048: --- This is reverted via

[jira] [Updated] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29048: -- Fix Version/s: (was: 3.0.0) > Query optimizer slow when using Column.isInCollection()

[jira] [Reopened] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-29048: --- Assignee: (was: Weichen Xu) > Query optimizer slow when using Column.isInCollection()

[jira] [Updated] (SPARK-31404) file source backward compatibility after calendar switch

[ https://issues.apache.org/jira/browse/SPARK-31404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31404: Summary: file source backward compatibility after calendar switch (was: file source backward

[jira] [Updated] (SPARK-31404) file source backward compatibility issues after switching to Proleptic Gregorian calendar

[ https://issues.apache.org/jira/browse/SPARK-31404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31404: Summary: file source backward compatibility issues after switching to Proleptic Gregorian

[jira] [Commented] (SPARK-31597) extracting day from intervals should be interval.days + days in interval.microsecond

[ https://issues.apache.org/jira/browse/SPARK-31597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094560#comment-17094560 ] Kent Yao commented on SPARK-31597: -- work log manually [https://github.com/apache/spark/pull/28396] >

[jira] [Comment Edited] (SPARK-31597) extracting day from intervals should be interval.days + days in interval.microsecond

[ https://issues.apache.org/jira/browse/SPARK-31597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094560#comment-17094560 ] Kent Yao edited comment on SPARK-31597 at 4/28/20, 2:30 PM: work logged

[jira] [Assigned] (SPARK-31553) Wrong result of isInCollection for large collections

[ https://issues.apache.org/jira/browse/SPARK-31553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31553: --- Assignee: Maxim Gekk > Wrong result of isInCollection for large collections >

[jira] [Resolved] (SPARK-31553) Wrong result of isInCollection for large collections

[ https://issues.apache.org/jira/browse/SPARK-31553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31553. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28388

[jira] [Resolved] (SPARK-31586) Replace expression TimeSub(l, r) with TimeAdd(l -r)

[ https://issues.apache.org/jira/browse/SPARK-31586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31586. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28381

[jira] [Assigned] (SPARK-31586) Replace expression TimeSub(l, r) with TimeAdd(l -r)

[ https://issues.apache.org/jira/browse/SPARK-31586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31586: --- Assignee: Kent Yao > Replace expression TimeSub(l, r) with TimeAdd(l -r) >

[jira] [Created] (SPARK-31597) extracting day from intervals should be interval.days + days in interval.microsecond

Kent Yao created SPARK-31597: Summary: extracting day from intervals should be interval.days + days in interval.microsecond Key: SPARK-31597 URL: https://issues.apache.org/jira/browse/SPARK-31597

[jira] [Updated] (SPARK-31596) Generate SQL Configurations from hive module to configuration doc

[ https://issues.apache.org/jira/browse/SPARK-31596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-31596: - Description: ATT > Generate SQL Configurations from hive module to configuration doc >

[jira] [Created] (SPARK-31596) Generate SQL Configurations from hive module to configuration doc

Kent Yao created SPARK-31596: Summary: Generate SQL Configurations from hive module to configuration doc Key: SPARK-31596 URL: https://issues.apache.org/jira/browse/SPARK-31596 Project: Spark

[jira] [Created] (SPARK-31595) Spark sql cli should allow unescaped quote mark in quoted string

Adrian Wang created SPARK-31595: --- Summary: Spark sql cli should allow unescaped quote mark in quoted string Key: SPARK-31595 URL: https://issues.apache.org/jira/browse/SPARK-31595 Project: Spark

[jira] [Commented] (SPARK-31594) Do not display rand/randn seed numbers in schema

[ https://issues.apache.org/jira/browse/SPARK-31594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094362#comment-17094362 ] Takeshi Yamamuro commented on SPARK-31594: -- I'm working on this

[jira] [Updated] (SPARK-31594) Do not display rand/randn seed numbers in schema

[ https://issues.apache.org/jira/browse/SPARK-31594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31594: - Summary: Do not display rand/randn seed numbers in schema (was: Do not display

[jira] [Created] (SPARK-31594) Do not display rand/randn seed in schema

Takeshi Yamamuro created SPARK-31594: Summary: Do not display rand/randn seed in schema Key: SPARK-31594 URL: https://issues.apache.org/jira/browse/SPARK-31594 Project: Spark Issue Type:

[jira] [Created] (SPARK-31593) Remove unnecessary streaming query progress update

Genmao Yu created SPARK-31593: - Summary: Remove unnecessary streaming query progress update Key: SPARK-31593 URL: https://issues.apache.org/jira/browse/SPARK-31593 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

[ https://issues.apache.org/jira/browse/SPARK-31592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yunbo Fan updated SPARK-31592: -- Description: Currently, bufferPoolsBySize in HeapMemoryAllocator uses a Map type whose value type is 

[jira] [Created] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

Yunbo Fan created SPARK-31592: - Summary: bufferPoolsBySize in HeapMemoryAllocator should be thread safe Key: SPARK-31592 URL: https://issues.apache.org/jira/browse/SPARK-31592 Project: Spark

[jira] [Resolved] (SPARK-26924) Fix CRAN hack as soon as Arrow is available on CRAN

[ https://issues.apache.org/jira/browse/SPARK-26924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26924. -- Resolution: Duplicate > Fix CRAN hack as soon as Arrow is available on CRAN >

[jira] [Commented] (SPARK-31583) grouping_id calculation should be improved

[ https://issues.apache.org/jira/browse/SPARK-31583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094284#comment-17094284 ] Takeshi Yamamuro commented on SPARK-31583: -- [~cpiliotis] Hi, thanks for your report! Just a

[jira] [Comment Edited] (SPARK-31583) grouping_id calculation should be improved

[ https://issues.apache.org/jira/browse/SPARK-31583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094284#comment-17094284 ] Takeshi Yamamuro edited comment on SPARK-31583 at 4/28/20, 8:28 AM:

[jira] [Updated] (SPARK-31573) Use fixed=TRUE where possible for internal efficiency

[ https://issues.apache.org/jira/browse/SPARK-31573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31573: - Issue Type: Bug (was: Documentation) > Use fixed=TRUE where possible for internal efficiency >

[jira] [Resolved] (SPARK-31573) Use fixed=TRUE where possible for internal efficiency

[ https://issues.apache.org/jira/browse/SPARK-31573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31573. -- Assignee: Michael Chirico Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-31573) Use fixed=TRUE where possible for internal efficiency

[ https://issues.apache.org/jira/browse/SPARK-31573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31573: - Fix Version/s: 3.0.0 > Use fixed=TRUE where possible for internal efficiency >

[jira] [Resolved] (SPARK-31519) Cast in having aggregate expressions returns the wrong result

[ https://issues.apache.org/jira/browse/SPARK-31519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31519. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28294

[jira] [Assigned] (SPARK-31519) Cast in having aggregate expressions returns the wrong result

[ https://issues.apache.org/jira/browse/SPARK-31519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31519: --- Assignee: Yuanjian Li > Cast in having aggregate expressions returns the wrong result >

[jira] [Commented] (SPARK-30868) Throw Exception if runHive(sql) failed

[ https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094274#comment-17094274 ] Yuming Wang commented on SPARK-30868: - Issue resolved by pull request 27644

[jira] [Resolved] (SPARK-30868) Throw Exception if runHive(sql) failed

[ https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-30868. - Fix Version/s: 3.0.0 Resolution: Fixed > Throw Exception if runHive(sql) failed >

[jira] [Assigned] (SPARK-30868) Throw Exception if runHive(sql) failed

[ https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-30868: --- Assignee: Jackey Lee > Throw Exception if runHive(sql) failed >

[jira] [Resolved] (SPARK-31524) Add metric to the split number for skew partition when enable AQE

[ https://issues.apache.org/jira/browse/SPARK-31524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31524. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28109

[jira] [Assigned] (SPARK-31524) Add metric to the split number for skew partition when enable AQE

[ https://issues.apache.org/jira/browse/SPARK-31524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31524: --- Assignee: Ke Jia > Add metric to the split number for skew partition when enable AQE >

[jira] [Commented] (SPARK-26199) Long expressions cause mutate to fail

[ https://issues.apache.org/jira/browse/SPARK-26199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094232#comment-17094232 ] Michael Chirico commented on SPARK-26199: - Just saw this.

[jira] [Commented] (SPARK-31586) Replace expression TimeSub(l, r) with TimeAdd(l -r)

[ https://issues.apache.org/jira/browse/SPARK-31586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094231#comment-17094231 ] Kent Yao commented on SPARK-31586: -- Hi [~Ankitraj],  PR is ready 

[jira] [Updated] (SPARK-31589) Use `r-lib/actions/setup-r` in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-31589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31589: -- Fix Version/s: 2.4.6 > Use `r-lib/actions/setup-r` in GitHub Action >

[jira] [Updated] (SPARK-31583) grouping_id calculation should be improved

[ https://issues.apache.org/jira/browse/SPARK-31583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31583: - Component/s: (was: Spark Core) SQL > grouping_id calculation

[jira] [Updated] (SPARK-31583) grouping_id calculation should be improved

[ https://issues.apache.org/jira/browse/SPARK-31583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31583: - Affects Version/s: (was: 2.4.5) 3.1.0 > grouping_id

[jira] [Commented] (SPARK-31586) Replace expression TimeSub(l, r) with TimeAdd(l -r)

[ https://issues.apache.org/jira/browse/SPARK-31586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094217#comment-17094217 ] Ankit Raj Boudh commented on SPARK-31586: - Hi Kent Yao, are you working on this issue ?, if not

[jira] [Commented] (SPARK-31591) namePrefix could be null in Utils.createDirectory

[ https://issues.apache.org/jira/browse/SPARK-31591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094215#comment-17094215 ] Lantao Jin commented on SPARK-31591: https://github.com/apache/spark/pull/28385 > namePrefix could

[jira] [Commented] (SPARK-31591) namePrefix could be null in Utils.createDirectory

[ https://issues.apache.org/jira/browse/SPARK-31591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094214#comment-17094214 ] Lantao Jin commented on SPARK-31591: [~Ankitraj] I have already filed a PR. > namePrefix could be

[jira] [Commented] (SPARK-31591) namePrefix could be null in Utils.createDirectory

[ https://issues.apache.org/jira/browse/SPARK-31591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094210#comment-17094210 ] Ankit Raj Boudh commented on SPARK-31591: - Hi [~cltlfcjin] , I will start working on this issue. 

[jira] [Commented] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094200#comment-17094200 ] Michael Chirico commented on SPARK-31517: - The issue is the use of deparse() in mutate;

[jira] [Commented] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094193#comment-17094193 ] Michael Chirico commented on SPARK-31517: - Separating the window to its own step works: window

[jira] [Commented] (SPARK-31583) grouping_id calculation should be improved

[ https://issues.apache.org/jira/browse/SPARK-31583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094188#comment-17094188 ] Takeshi Yamamuro commented on SPARK-31583: -- ok, I'll take a look. > grouping_id calculation

[jira] [Created] (SPARK-31591) namePrefix could be null in Utils.createDirectory

Lantao Jin created SPARK-31591: -- Summary: namePrefix could be null in Utils.createDirectory Key: SPARK-31591 URL: https://issues.apache.org/jira/browse/SPARK-31591 Project: Spark Issue Type: