[jira] [Created] (SPARK-44345) Only log unknown shuffle map output as error when shuffle migration disabled

2023-07-08 Thread Zhongwei Zhu (Jira)
Zhongwei Zhu created SPARK-44345: Summary: Only log unknown shuffle map output as error when shuffle migration disabled Key: SPARK-44345 URL: https://issues.apache.org/jira/browse/SPARK-44345

[jira] [Commented] (SPARK-44339) spark3-shell errors org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table . Permission denied: user [AD user] does not have [SELECT]

2023-07-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741340#comment-17741340 ] Yuming Wang commented on SPARK-44339: - It seems it's cloudera spark issue. > spark3-shell errors

[jira] [Updated] (SPARK-44339) spark3-shell errors org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table . Permission denied: user [AD user] does not have [SELECT] p

2023-07-08 Thread Amar Gurung (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Gurung updated SPARK-44339: Summary: spark3-shell errors org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch

[jira] [Resolved] (SPARK-44321) Move ParseException to SQL/API

2023-07-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44321. --- Fix Version/s: 3.5.0 Resolution: Fixed > Move ParseException to SQL/API >

[jira] [Comment Edited] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values

2023-07-08 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740726#comment-17740726 ] koert kuipers edited comment on SPARK-37829 at 7/8/23 4:19 PM: --- since this

[jira] [Commented] (SPARK-35635) concurrent insert statements from multiple beeline fail with job aborted exception

2023-07-08 Thread jeanlyn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741309#comment-17741309 ] jeanlyn commented on SPARK-35635: - When the tasks are running concurrently, the "_temporary" will be

[jira] [Commented] (SPARK-35635) concurrent insert statements from multiple beeline fail with job aborted exception

2023-07-08 Thread jeanlyn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741296#comment-17741296 ] jeanlyn commented on SPARK-35635: - We encounter the same issue when concurrent writing in deference

[jira] [Created] (SPARK-44344) Prepare RowEncoder for the move to sql/api

2023-07-08 Thread Jira
Herman van Hövell created SPARK-44344: - Summary: Prepare RowEncoder for the move to sql/api Key: SPARK-44344 URL: https://issues.apache.org/jira/browse/SPARK-44344 Project: Spark Issue

[jira] [Commented] (SPARK-44331) Add bitmap functions to Scala and Python

2023-07-08 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741287#comment-17741287 ] BingKun Pan commented on SPARK-44331: - I work on it. > Add bitmap functions to Scala and Python >

[jira] [Created] (SPARK-44343) Separate encoder inference from expression encoder generation in ScalaReflection

2023-07-08 Thread Jira
Herman van Hövell created SPARK-44343: - Summary: Separate encoder inference from expression encoder generation in ScalaReflection Key: SPARK-44343 URL: https://issues.apache.org/jira/browse/SPARK-44343

[jira] [Commented] (SPARK-44329) Add hll_sketch_agg, hll_union_agg, to_varchar, try_aes_decrypt to Scala and Python

2023-07-08 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741285#comment-17741285 ] BingKun Pan commented on SPARK-44329: - I work on it > Add hll_sketch_agg, hll_union_agg,

[jira] [Updated] (SPARK-44332) Fix the sorting error of Executor ID Column on Executors UI Page

2023-07-08 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44332: Summary: Fix the sorting error of Executor ID Column on Executors UI Page (was: Fix the sorting

[jira] [Updated] (SPARK-44332) Fix the sorting error of Executor ID Column on Executor Page

2023-07-08 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44332: Summary: Fix the sorting error of Executor ID Column on Executor Page (was: Fix the sorting

[jira] [Updated] (SPARK-44332) Fix the sorting error of ExecutorID on Executor Page

2023-07-08 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44332: Summary: Fix the sorting error of ExecutorID on Executor Page (was: The Executor ID should start

[jira] [Commented] (SPARK-44342) Replace SQLContext with SparkSession for GenTPCDSData

2023-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741258#comment-17741258 ] ASF GitHub Bot commented on SPARK-44342: User 'beliefer' has created a pull request for this

[jira] [Commented] (SPARK-44342) Replace SQLContext with SparkSession for GenTPCDSData

2023-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741259#comment-17741259 ] ASF GitHub Bot commented on SPARK-44342: User 'beliefer' has created a pull request for this

[jira] [Updated] (SPARK-44342) Replace SQLContext with SparkSession for GenTPCDSData

2023-07-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-44342: --- Description: The SQLContext is an old API for Spark SQL. But > Replace SQLContext with

[jira] [Updated] (SPARK-44342) Replace SQLContext with SparkSession for GenTPCDSData

2023-07-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-44342: --- Description: The SQLContext is an old API for Spark SQL. But GenTPCDSData still use it directly.

[jira] [Created] (SPARK-44342) Replace SQLContext with SparkSession for GenTPCDSData

2023-07-08 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-44342: -- Summary: Replace SQLContext with SparkSession for GenTPCDSData Key: SPARK-44342 URL: https://issues.apache.org/jira/browse/SPARK-44342 Project: Spark Issue

[jira] [Commented] (SPARK-44341) Define the computing logic through PartitionEvaluator API and use it in WindowExec

2023-07-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741251#comment-17741251 ] jiaan.geng commented on SPARK-44341: I'm working on. > Define the computing logic through

[jira] [Created] (SPARK-44341) Define the computing logic through PartitionEvaluator API and use it in WindowExec

2023-07-08 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-44341: -- Summary: Define the computing logic through PartitionEvaluator API and use it in WindowExec Key: SPARK-44341 URL: https://issues.apache.org/jira/browse/SPARK-44341

[jira] [Commented] (SPARK-43907) Add SQL functions into Scala, Python and R API

2023-07-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741246#comment-17741246 ] Ruifeng Zheng commented on SPARK-43907: --- [~beliefer][~LuciferYang][~panbingkun][~ivoson] many