[jira] [Comment Edited] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160284#comment-17160284 ] JinxinTang edited comment on SPARK-32347 at 7/18/20, 12:22 AM: ---

[jira] [Commented] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160284#comment-17160284 ] JinxinTang commented on SPARK-32347: Same the CTE issue as https://issues.apache.org

[jira] [Created] (SPARK-32354) Fix & re-enable failing R K8s tests

Holden Karau created SPARK-32354: Summary: Fix & re-enable failing R K8s tests Key: SPARK-32354 URL: https://issues.apache.org/jira/browse/SPARK-32354 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-21040) On executor/worker decommission consider speculatively re-launching current tasks

[ https://issues.apache.org/jira/browse/SPARK-21040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-21040. -- Fix Version/s: 3.1.0 Resolution: Fixed > On executor/worker decommission consider specu

[jira] [Commented] (SPARK-21040) On executor/worker decommission consider speculatively re-launching current tasks

[ https://issues.apache.org/jira/browse/SPARK-21040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160266#comment-17160266 ] Holden Karau commented on SPARK-21040: -- Thanks for fixing this! > On executor/work

[jira] [Assigned] (SPARK-21040) On executor/worker decommission consider speculatively re-launching current tasks

[ https://issues.apache.org/jira/browse/SPARK-21040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-21040: Assignee: Prakhar Jain > On executor/worker decommission consider speculatively re-launch

[jira] [Commented] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160207#comment-17160207 ] Chen Zhang commented on SPARK-32317: The DECIMAL type in Parquet is stored by INT32,

[jira] [Resolved] (SPARK-32326) R version is too old on Jenkins k8s PRB

[ https://issues.apache.org/jira/browse/SPARK-32326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-32326. - Resolution: Fixed > R version is too old on Jenkins k8s PRB > --

[jira] [Commented] (SPARK-32326) R version is too old on Jenkins k8s PRB

[ https://issues.apache.org/jira/browse/SPARK-32326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160182#comment-17160182 ] Shane Knapp commented on SPARK-32326: - {quote}jenkins@research-jenkins-worker-09:~$

[jira] [Assigned] (SPARK-29909) Drop Python 2 and Python 3.4 and 3.5.

[ https://issues.apache.org/jira/browse/SPARK-29909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29909: Assignee: (was: Apache Spark) > Drop Python 2 and Python 3.4 and 3.5. > -

[jira] [Assigned] (SPARK-29909) Drop Python 2 and Python 3.4 and 3.5.

[ https://issues.apache.org/jira/browse/SPARK-29909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29909: Assignee: Apache Spark > Drop Python 2 and Python 3.4 and 3.5. >

[jira] [Commented] (SPARK-29909) Drop Python 2 and Python 3.4 and 3.5.

[ https://issues.apache.org/jira/browse/SPARK-29909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160173#comment-17160173 ] Apache Spark commented on SPARK-29909: -- User 'srowen' has created a pull request fo

[jira] [Resolved] (SPARK-32353) Update docker/spark-test and clean up unused stuff

[ https://issues.apache.org/jira/browse/SPARK-32353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32353. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-32353) Update docker/spark-test and clean up unused stuff

[ https://issues.apache.org/jira/browse/SPARK-32353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32353: - Assignee: William Hyun > Update docker/spark-test and clean up unused stuff > -

[jira] [Commented] (SPARK-32353) Update docker/spark-test and clean up unused stuff

[ https://issues.apache.org/jira/browse/SPARK-32353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160139#comment-17160139 ] Apache Spark commented on SPARK-32353: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-32353) Update docker/spark-test and clean up unused stuff

[ https://issues.apache.org/jira/browse/SPARK-32353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32353: Assignee: Apache Spark > Update docker/spark-test and clean up unused stuff > ---

[jira] [Assigned] (SPARK-32353) Update docker/spark-test and clean up unused stuff

[ https://issues.apache.org/jira/browse/SPARK-32353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32353: Assignee: (was: Apache Spark) > Update docker/spark-test and clean up unused stuff >

[jira] [Commented] (SPARK-32353) Update docker/spark-test and clean up unused stuff

[ https://issues.apache.org/jira/browse/SPARK-32353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160138#comment-17160138 ] Apache Spark commented on SPARK-32353: -- User 'williamhyun' has created a pull reque

[jira] [Created] (SPARK-32353) Update docker/spark-test and clean up unused stuff

William Hyun created SPARK-32353: Summary: Update docker/spark-test and clean up unused stuff Key: SPARK-32353 URL: https://issues.apache.org/jira/browse/SPARK-32353 Project: Spark Issue Type

[jira] [Commented] (SPARK-30996) Able to write parquet file subsequently unable to read

[ https://issues.apache.org/jira/browse/SPARK-30996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160129#comment-17160129 ] Nathan Grand commented on SPARK-30996: -- Someone seems have started working on that

[jira] [Commented] (SPARK-30996) Able to write parquet file subsequently unable to read

[ https://issues.apache.org/jira/browse/SPARK-30996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160126#comment-17160126 ] Sean R. Owen commented on SPARK-30996: -- See https://github.com/apache/spark/pull/27

[jira] [Commented] (SPARK-30996) Able to write parquet file subsequently unable to read

[ https://issues.apache.org/jira/browse/SPARK-30996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160124#comment-17160124 ] Nathan Grand commented on SPARK-30996: -- [~srowen] Can you explain why this was clos

[jira] [Commented] (SPARK-32352) Partially push down support data filter if it mixed in partition filters

[ https://issues.apache.org/jira/browse/SPARK-32352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160119#comment-17160119 ] Gengliang Wang commented on SPARK-32352: Well we already have https://github.com

[jira] [Assigned] (SPARK-32350) Add batch write support on LevelDB to improve performance of HybridStore

[ https://issues.apache.org/jira/browse/SPARK-32350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32350: Assignee: (was: Apache Spark) > Add batch write support on LevelDB to improve perform

[jira] [Commented] (SPARK-32350) Add batch write support on LevelDB to improve performance of HybridStore

[ https://issues.apache.org/jira/browse/SPARK-32350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160091#comment-17160091 ] Apache Spark commented on SPARK-32350: -- User 'baohe-zhang' has created a pull reque

[jira] [Assigned] (SPARK-32350) Add batch write support on LevelDB to improve performance of HybridStore

[ https://issues.apache.org/jira/browse/SPARK-32350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32350: Assignee: (was: Apache Spark) > Add batch write support on LevelDB to improve perform

[jira] [Commented] (SPARK-32349) [UI] Reduce unnecessary allexecutors call when render stage page executor summary

[ https://issues.apache.org/jira/browse/SPARK-32349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160090#comment-17160090 ] Apache Spark commented on SPARK-32349: -- User 'warrenzhu25' has created a pull reque

[jira] [Assigned] (SPARK-32350) Add batch write support on LevelDB to improve performance of HybridStore

[ https://issues.apache.org/jira/browse/SPARK-32350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32350: Assignee: Apache Spark > Add batch write support on LevelDB to improve performance of Hyb

[jira] [Assigned] (SPARK-32349) [UI] Reduce unnecessary allexecutors call when render stage page executor summary

[ https://issues.apache.org/jira/browse/SPARK-32349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32349: Assignee: Apache Spark > [UI] Reduce unnecessary allexecutors call when render stage page

[jira] [Commented] (SPARK-32349) [UI] Reduce unnecessary allexecutors call when render stage page executor summary

[ https://issues.apache.org/jira/browse/SPARK-32349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160089#comment-17160089 ] Apache Spark commented on SPARK-32349: -- User 'warrenzhu25' has created a pull reque

[jira] [Resolved] (SPARK-30996) Able to write parquet file subsequently unable to read

[ https://issues.apache.org/jira/browse/SPARK-30996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30996. -- Resolution: Not A Problem > Able to write parquet file subsequently unable to read > -

[jira] [Assigned] (SPARK-32349) [UI] Reduce unnecessary allexecutors call when render stage page executor summary

[ https://issues.apache.org/jira/browse/SPARK-32349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32349: Assignee: (was: Apache Spark) > [UI] Reduce unnecessary allexecutors call when render

[jira] [Resolved] (SPARK-32298) tree models prediction optimization

[ https://issues.apache.org/jira/browse/SPARK-32298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32298. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29095 [https://gi

[jira] [Assigned] (SPARK-32298) tree models prediction optimization

[ https://issues.apache.org/jira/browse/SPARK-32298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-32298: Assignee: zhengruifeng > tree models prediction optimization > --

[jira] [Updated] (SPARK-32350) Add batch write support on LevelDB to improve performance of HybridStore

[ https://issues.apache.org/jira/browse/SPARK-32350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baohe Zhang updated SPARK-32350: Description: The idea is to improve the performance of HybridStore by adding batch write support

[jira] [Resolved] (SPARK-32329) Rename HADOOP2_MODULE_PROFILES to HADOOP_MODULE_PROFILES

[ https://issues.apache.org/jira/browse/SPARK-32329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32329. -- Fix Version/s: 3.1.0 Assignee: William Hyun Resolution: Fixed Resolved by http

[jira] [Updated] (SPARK-32352) Partially push down support data filter if it mixed in partition filters

[ https://issues.apache.org/jira/browse/SPARK-32352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32352: Description: We support partially push partition filters since SPARK-28169. We can also support p

[jira] [Updated] (SPARK-32352) Partially push down support data filter if it mixed in partition filters

[ https://issues.apache.org/jira/browse/SPARK-32352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32352: Description: We support partially push partition filters since SPARK-28169. We can also support p

[jira] [Updated] (SPARK-32352) Partially push down support data filter if it mixed in partition filters

[ https://issues.apache.org/jira/browse/SPARK-32352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32352: Description: We support partially push partition filters since SPARK-28169. We can also support p

[jira] [Updated] (SPARK-32352) Partially push down support data filter if it mixed in partition filters

[ https://issues.apache.org/jira/browse/SPARK-32352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32352: Summary: Partially push down support data filter if it mixed in partition filters (was: Partiall

[jira] [Created] (SPARK-32352) Partially push down support data filter

Yuming Wang created SPARK-32352: --- Summary: Partially push down support data filter Key: SPARK-32352 URL: https://issues.apache.org/jira/browse/SPARK-32352 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-32351) Partially pushed partition filters are not explained

Yuming Wang created SPARK-32351: --- Summary: Partially pushed partition filters are not explained Key: SPARK-32351 URL: https://issues.apache.org/jira/browse/SPARK-32351 Project: Spark Issue Type

[jira] [Commented] (SPARK-32345) SemanticException Failed to get a spark session: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create Spark client for Spark session

[ https://issues.apache.org/jira/browse/SPARK-32345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160058#comment-17160058 ] Yuming Wang commented on SPARK-32345: - Did you set {{spark.sql.hive.metastore.versio

[jira] [Created] (SPARK-32350) Add batch write support on LevelDB to improve performance of HybridStore

Baohe Zhang created SPARK-32350: --- Summary: Add batch write support on LevelDB to improve performance of HybridStore Key: SPARK-32350 URL: https://issues.apache.org/jira/browse/SPARK-32350 Project: Spark

[jira] [Created] (SPARK-32349) [UI] Reduce unnecessary allexecutors call when render stage page executor summary

Zhongwei Zhu created SPARK-32349: Summary: [UI] Reduce unnecessary allexecutors call when render stage page executor summary Key: SPARK-32349 URL: https://issues.apache.org/jira/browse/SPARK-32349 Pro

[jira] [Created] (SPARK-32348) Get tests working for Scala 2.13 build

Sean R. Owen created SPARK-32348: Summary: Get tests working for Scala 2.13 build Key: SPARK-32348 URL: https://issues.apache.org/jira/browse/SPARK-32348 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160037#comment-17160037 ] Apache Spark commented on SPARK-29292: -- User 'srowen' has created a pull request fo

[jira] [Updated] (SPARK-32334) Investigate commonizing Columnar and Row data transformations

[ https://issues.apache.org/jira/browse/SPARK-32334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-32334: Description: We introduced more Columnar Support with SPARK-27396. With that we recognized that t

[jira] [Updated] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-32347: --- Description: The bug is very easily reproduced: run the following same code in Spark 2.4.3. and in

[jira] [Updated] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-32347: --- Description: The bug is very easily reproduced: run the following same code in Spark 2.4.3. and in

[jira] [Created] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

Ihor Bobak created SPARK-32347: -- Summary: BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4) Key: SPARK-32347 URL: https://issues.apache.org/jira/browse/SPARK-32347

[jira] [Updated] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ihor Bobak updated SPARK-32347: --- Attachment: 2020-07-17 17_46_32-Window.png 2020-07-17 17_49_27-Window.png

[jira] [Updated] (SPARK-32018) Fix UnsafeRow set overflowed decimal

[ https://issues.apache.org/jira/browse/SPARK-32018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32018: -- Fix Version/s: 2.4.7 > Fix UnsafeRow set overflowed decimal >

[jira] [Assigned] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32257: Assignee: Apache Spark > [SQL Parser] Report Error for invalid usage of SET command > ---

[jira] [Assigned] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32257: Assignee: (was: Apache Spark) > [SQL Parser] Report Error for invalid usage of SET co

[jira] [Commented] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159972#comment-17159972 ] Apache Spark commented on SPARK-32257: -- User 'maropu' has created a pull request fo

[jira] [Assigned] (SPARK-30616) Introduce TTL config option for SQL Metadata Cache

[ https://issues.apache.org/jira/browse/SPARK-30616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30616: --- Assignee: Yaroslav Tkachenko > Introduce TTL config option for SQL Metadata Cache > ---

[jira] [Resolved] (SPARK-30616) Introduce TTL config option for SQL Metadata Cache

[ https://issues.apache.org/jira/browse/SPARK-30616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30616. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28852 [https://gith

[jira] [Assigned] (SPARK-32346) Support filters pushdown in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32346: Assignee: Apache Spark (was: Maxim Gekk) > Support filters pushdown in Avro datasource >

[jira] [Commented] (SPARK-32346) Support filters pushdown in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159915#comment-17159915 ] Apache Spark commented on SPARK-32346: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-32346) Support filters pushdown in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32346: Assignee: Maxim Gekk (was: Apache Spark) > Support filters pushdown in Avro datasource >

[jira] [Commented] (SPARK-32346) Support filters pushdown in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159911#comment-17159911 ] Maxim Gekk commented on SPARK-32346: I am working on this > Support filters pushdow

[jira] [Created] (SPARK-32346) Support filters pushdown in Avro datasource

Maxim Gekk created SPARK-32346: -- Summary: Support filters pushdown in Avro datasource Key: SPARK-32346 URL: https://issues.apache.org/jira/browse/SPARK-32346 Project: Spark Issue Type: Improveme

[jira] [Updated] (SPARK-32346) Support filters pushdown in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32346: --- Description: (was: * Implement the `SupportsPushDownFilters` interface in `JsonScanBuilder` * A

[jira] [Created] (SPARK-32345) SemanticException Failed to get a spark session: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create Spark client for Spark session

任建亭 created SPARK-32345: --- Summary: SemanticException Failed to get a spark session: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create Spark client for Spark session Key: SPARK-32345 URL: https://issues.apa

[jira] [Comment Edited] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159864#comment-17159864 ] JinxinTang edited comment on SPARK-32317 at 7/17/20, 11:12 AM: ---

[jira] [Comment Edited] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159864#comment-17159864 ] JinxinTang edited comment on SPARK-32317 at 7/17/20, 11:11 AM: ---

[jira] [Comment Edited] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159864#comment-17159864 ] JinxinTang edited comment on SPARK-32317 at 7/17/20, 11:07 AM: ---

[jira] [Commented] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159864#comment-17159864 ] JinxinTang commented on SPARK-32317: Yes, maybe we should check the decimal schema a

[jira] [Commented] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159849#comment-17159849 ] Krish commented on SPARK-32317: --- Yes, but the biggest problem that I see here is, spark is

[jira] [Issue Comment Deleted] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JinxinTang updated SPARK-32317: --- Comment: was deleted (was: Seems a little hard to solve, because current spark use `org.apache.parq

[jira] [Commented] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159796#comment-17159796 ] JinxinTang commented on SPARK-32317: Seems a little hard to solve, because current s

[jira] [Commented] (SPARK-15118) Spark SQLConf should support loading hive properties in hive-site.xml

[ https://issues.apache.org/jira/browse/SPARK-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159772#comment-17159772 ] Apache Spark commented on SPARK-15118: -- User 'StefanXiepj' has created a pull reque

[jira] [Commented] (SPARK-15118) Spark SQLConf should support loading hive properties in hive-site.xml

[ https://issues.apache.org/jira/browse/SPARK-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159770#comment-17159770 ] Apache Spark commented on SPARK-15118: -- User 'StefanXiepj' has created a pull reque

[jira] [Assigned] (SPARK-15118) Spark SQLConf should support loading hive properties in hive-site.xml

[ https://issues.apache.org/jira/browse/SPARK-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15118: Assignee: (was: Apache Spark) > Spark SQLConf should support loading hive properties

[jira] [Assigned] (SPARK-15118) Spark SQLConf should support loading hive properties in hive-site.xml

[ https://issues.apache.org/jira/browse/SPARK-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15118: Assignee: Apache Spark > Spark SQLConf should support loading hive properties in hive-sit

[jira] [Comment Edited] (SPARK-28367) Kafka connector infinite wait because metadata never updated

[ https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17087498#comment-17087498 ] Gabor Somogyi edited comment on SPARK-28367 at 7/17/20, 7:36 AM: -

[jira] [Resolved] (SPARK-29693) Bucket map join if the one's bucket number is the multiple of the other

[ https://issues.apache.org/jira/browse/SPARK-29693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-29693. - Resolution: Duplicate > Bucket map join if the one's bucket number is the multiple of the other

[jira] [Assigned] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

[ https://issues.apache.org/jira/browse/SPARK-32344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32344: Assignee: (was: Apache Spark) > Unevaluable expr is set to FIRST/LAST ignoreNullsExpr

[jira] [Assigned] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

[ https://issues.apache.org/jira/browse/SPARK-32344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32344: Assignee: Apache Spark > Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinc

[jira] [Commented] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

[ https://issues.apache.org/jira/browse/SPARK-32344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159739#comment-17159739 ] Apache Spark commented on SPARK-32344: -- User 'maropu' has created a pull request fo

[jira] [Updated] (SPARK-15118) Spark SQLConf should support loading hive properties in hive-site.xml

[ https://issues.apache.org/jira/browse/SPARK-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiepengjie updated SPARK-15118: --- Summary: Spark SQLConf should support loading hive properties in hive-site.xml (was: spark couldn'

[jira] [Updated] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

[ https://issues.apache.org/jira/browse/SPARK-32344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32344: - Priority: Minor (was: Major) > Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in

[jira] [Created] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

Takeshi Yamamuro created SPARK-32344: Summary: Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates Key: SPARK-32344 URL: https://issues.apache.org/jira/browse/SPARK-32344