[jira] [Commented] (SPARK-31648) Filtering is supported only on partition keys of type string Issue
[ https://issues.apache.org/jira/browse/SPARK-31648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100820#comment-17100820 ] angerszhu commented on SPARK-31648: --- [~Rajesh Tadi] Can you show your reproduce detail code process? I can't reproduce this in 2.4.0 and master branch > Filtering is supported only on partition keys of type string Issue > -- > > Key: SPARK-31648 > URL: https://issues.apache.org/jira/browse/SPARK-31648 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.4.4 >Reporter: Rajesh Tadi >Priority: Major > Attachments: Spark Bug.txt > > > When I submit a SQL with partition filter I see the below error. I tried > setting Spark Configuration spark.sql.hive.manageFilesourcePartitions to > false but I still see the same issue. > java.lang.RuntimeException: Caught Hive MetaException attempting to get > partition metadata by filter from Hive. > java.lang.reflect.InvocationTargetException: > org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported > only on partition keys of type string > org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported > only on partition keys of type string > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-31648) Filtering is supported only on partition keys of type string Issue
[ https://issues.apache.org/jira/browse/SPARK-31648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100789#comment-17100789 ] Rajesh Tadi commented on SPARK-31648: - [~angerszhuuu] I have tried creating a table using Spark-SQL and Dataframes in Scala as well. Both the ways I see the same issue. > Filtering is supported only on partition keys of type string Issue > -- > > Key: SPARK-31648 > URL: https://issues.apache.org/jira/browse/SPARK-31648 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.4.4 >Reporter: Rajesh Tadi >Priority: Major > Attachments: Spark Bug.txt > > > When I submit a SQL with partition filter I see the below error. I tried > setting Spark Configuration spark.sql.hive.manageFilesourcePartitions to > false but I still see the same issue. > java.lang.RuntimeException: Caught Hive MetaException attempting to get > partition metadata by filter from Hive. > java.lang.reflect.InvocationTargetException: > org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported > only on partition keys of type string > org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported > only on partition keys of type string > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-31648) Filtering is supported only on partition keys of type string Issue
[ https://issues.apache.org/jira/browse/SPARK-31648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100639#comment-17100639 ] angerszhu commented on SPARK-31648: --- [~Rajesh Tadi] Anyway to reproduce this bug? > Filtering is supported only on partition keys of type string Issue > -- > > Key: SPARK-31648 > URL: https://issues.apache.org/jira/browse/SPARK-31648 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.4.4 >Reporter: Rajesh Tadi >Priority: Major > Attachments: Spark Bug.txt > > > When I submit a SQL with partition filter I see the below error. I tried > setting Spark Configuration spark.sql.hive.manageFilesourcePartitions to > false but I still see the same issue. > java.lang.RuntimeException: Caught Hive MetaException attempting to get > partition metadata by filter from Hive. > java.lang.reflect.InvocationTargetException: > org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported > only on partition keys of type string > org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported > only on partition keys of type string > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-31648) Filtering is supported only on partition keys of type string Issue
[ https://issues.apache.org/jira/browse/SPARK-31648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100629#comment-17100629 ] Rajesh Tadi commented on SPARK-31648: - [~angerszhuuu] Below is the SQL I have used. select * from testdb.partbuck_test where country_cd='India'; My table structure will look similar as below. Schema: ++--+--+ |col_name |data_type |comment| ++--+--+ |ID |bigint |null | |NAME |string |null | |. |... |null | |. |... |null | |. |... |null | |COUNTRY_CD |string |null | |# Partition Information | | | |# col_name |data_type |comment| |COUNTRY_CD |string |null | ++--+--+ > Filtering is supported only on partition keys of type string Issue > -- > > Key: SPARK-31648 > URL: https://issues.apache.org/jira/browse/SPARK-31648 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.4.4 >Reporter: Rajesh Tadi >Priority: Major > Attachments: Spark Bug.txt > > > When I submit a SQL with partition filter I see the below error. I tried > setting Spark Configuration spark.sql.hive.manageFilesourcePartitions to > false but I still see the same issue. > java.lang.RuntimeException: Caught Hive MetaException attempting to get > partition metadata by filter from Hive. > java.lang.reflect.InvocationTargetException: > org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported > only on partition keys of type string > org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported > only on partition keys of type string > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-31648) Filtering is supported only on partition keys of type string Issue
[ https://issues.apache.org/jira/browse/SPARK-31648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100551#comment-17100551 ] angerszhu commented on SPARK-31648: --- [~Rajesh Tadi] Can you show your sql and table schema detail? > Filtering is supported only on partition keys of type string Issue > -- > > Key: SPARK-31648 > URL: https://issues.apache.org/jira/browse/SPARK-31648 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.4.4 >Reporter: Rajesh Tadi >Priority: Major > Attachments: Spark Bug.txt > > > When I submit a SQL with partition filter I see the below error. I tried > setting Spark Configuration spark.sql.hive.manageFilesourcePartitions to > false but I still see the same issue. > java.lang.RuntimeException: Caught Hive MetaException attempting to get > partition metadata by filter from Hive. > java.lang.reflect.InvocationTargetException: > org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported > only on partition keys of type string > org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported > only on partition keys of type string > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
