[jira] [Created] (FLINK-22092) Prevent HiveCatalog from reading hive-site in classpath
Rui Li created FLINK-22092: -- Summary: Prevent HiveCatalog from reading hive-site in classpath Key: FLINK-22092 URL: https://issues.apache.org/jira/browse/FLINK-22092 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li Fix For: 1.13.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22102) Throw meaningful exceptions for features we don't support
Rui Li created FLINK-22102: -- Summary: Throw meaningful exceptions for features we don't support Key: FLINK-22102 URL: https://issues.apache.org/jira/browse/FLINK-22102 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li Fix For: 1.13.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22107) Include antlr into hive connector uber jars
Rui Li created FLINK-22107: -- Summary: Include antlr into hive connector uber jars Key: FLINK-22107 URL: https://issues.apache.org/jira/browse/FLINK-22107 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li Fix For: 1.13.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22119) Update document for hive dialect
Rui Li created FLINK-22119: -- Summary: Update document for hive dialect Key: FLINK-22119 URL: https://issues.apache.org/jira/browse/FLINK-22119 Project: Flink Issue Type: Sub-task Components: Connectors / Hive, Documentation Reporter: Rui Li Fix For: 1.13.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22170) Manual test for hive dialect
Rui Li created FLINK-22170: -- Summary: Manual test for hive dialect Key: FLINK-22170 URL: https://issues.apache.org/jira/browse/FLINK-22170 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li Fix For: 1.13.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22341) Describe table doesn't work with hive dialect
Rui Li created FLINK-22341: -- Summary: Describe table doesn't work with hive dialect Key: FLINK-22341 URL: https://issues.apache.org/jira/browse/FLINK-22341 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li Fix For: 1.13.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22383) HiveParser may fail to call Flink functions
Rui Li created FLINK-22383: -- Summary: HiveParser may fail to call Flink functions Key: FLINK-22383 URL: https://issues.apache.org/jira/browse/FLINK-22383 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22402) Add hive dialect test in sql-client
Rui Li created FLINK-22402: -- Summary: Add hive dialect test in sql-client Key: FLINK-22402 URL: https://issues.apache.org/jira/browse/FLINK-22402 Project: Flink Issue Type: Sub-task Components: Tests Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22446) Relocate dependencies in hive connector uber jar
Rui Li created FLINK-22446: -- Summary: Relocate dependencies in hive connector uber jar Key: FLINK-22446 URL: https://issues.apache.org/jira/browse/FLINK-22446 Project: Flink Issue Type: Task Components: Connectors / Hive Affects Versions: 1.13.0 Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22512) Can't call current_timestamp with hive dialect for hive-3.1
Rui Li created FLINK-22512: -- Summary: Can't call current_timestamp with hive dialect for hive-3.1 Key: FLINK-22512 URL: https://issues.apache.org/jira/browse/FLINK-22512 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22606) Simplify the usage of SessionState
Rui Li created FLINK-22606: -- Summary: Simplify the usage of SessionState Key: FLINK-22606 URL: https://issues.apache.org/jira/browse/FLINK-22606 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li Hive SessionState is used by hive dialect. Starting a SessionState involves some heavy operations like creating scratch folders and instantiating an HMS client. We should investigate how to reduce these operations. It's of course better to completely get rid of SessionState. But that's difficult to achieve because some hive functions rely on it. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22657) HiveParserDDLSemanticAnalyzer can directly return operations
Rui Li created FLINK-22657: -- Summary: HiveParserDDLSemanticAnalyzer can directly return operations Key: FLINK-22657 URL: https://issues.apache.org/jira/browse/FLINK-22657 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li There's no need to first generate some "desc" and later convert to operation with DDLOperationConverter -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22661) HiveInputFormatPartitionReader can return invalid data
Rui Li created FLINK-22661: -- Summary: HiveInputFormatPartitionReader can return invalid data Key: FLINK-22661 URL: https://issues.apache.org/jira/browse/FLINK-22661 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22726) Hive GROUPING__ID returns different value in older versions
Rui Li created FLINK-22726: -- Summary: Hive GROUPING__ID returns different value in older versions Key: FLINK-22726 URL: https://issues.apache.org/jira/browse/FLINK-22726 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li Assignee: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22760) HiveParser::setCurrentTimestamp fails with hive-3.1.2
Rui Li created FLINK-22760: -- Summary: HiveParser::setCurrentTimestamp fails with hive-3.1.2 Key: FLINK-22760 URL: https://issues.apache.org/jira/browse/FLINK-22760 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li Assignee: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22812) Fix hive issues in sql-connector-hive jars
Rui Li created FLINK-22812: -- Summary: Fix hive issues in sql-connector-hive jars Key: FLINK-22812 URL: https://issues.apache.org/jira/browse/FLINK-22812 Project: Flink Issue Type: Improvement Components: Connectors / Hive Environment: Since we provide uber jars for hive connector, this gives us a chance to fix some hive issues on our side. Reporter: Rui Li Assignee: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18867) Generic table stored in Hive catalog is incompatible between 1.10 and 1.11
Rui Li created FLINK-18867: -- Summary: Generic table stored in Hive catalog is incompatible between 1.10 and 1.11 Key: FLINK-18867 URL: https://issues.apache.org/jira/browse/FLINK-18867 Project: Flink Issue Type: Bug Components: Connectors / Hive Affects Versions: 1.11.1 Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18882) Investigate supporting Hive interval type
Rui Li created FLINK-18882: -- Summary: Investigate supporting Hive interval type Key: FLINK-18882 URL: https://issues.apache.org/jira/browse/FLINK-18882 Project: Flink Issue Type: Improvement Components: Connectors / Hive Reporter: Rui Li Some UDF returns interval results, and such UDF cannot be called via Flink because interval type is not supported at the moment. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18900) HiveCatalog should error out when listing partitions with an invalid spec
Rui Li created FLINK-18900: -- Summary: HiveCatalog should error out when listing partitions with an invalid spec Key: FLINK-18900 URL: https://issues.apache.org/jira/browse/FLINK-18900 Project: Flink Issue Type: Bug Components: Connectors / Hive Affects Versions: 1.11.1 Reporter: Rui Li Fix For: 1.12.0, 1.11.2 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18930) Translate "Hive Dialect" page of "Hive Integration" into Chinese
Rui Li created FLINK-18930: -- Summary: Translate "Hive Dialect" page of "Hive Integration" into Chinese Key: FLINK-18930 URL: https://issues.apache.org/jira/browse/FLINK-18930 Project: Flink Issue Type: Sub-task Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18931) Translate "Hive Streaming" page of "Hive Integration" into Chinese
Rui Li created FLINK-18931: -- Summary: Translate "Hive Streaming" page of "Hive Integration" into Chinese Key: FLINK-18931 URL: https://issues.apache.org/jira/browse/FLINK-18931 Project: Flink Issue Type: Sub-task Components: Connectors / Hive, Documentation Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18942) HiveTableSink shouldn't try to create BulkWriter factory when using MR writer
Rui Li created FLINK-18942: -- Summary: HiveTableSink shouldn't try to create BulkWriter factory when using MR writer Key: FLINK-18942 URL: https://issues.apache.org/jira/browse/FLINK-18942 Project: Flink Issue Type: Bug Components: Connectors / Hive Affects Versions: 1.11.1 Reporter: Rui Li Fix For: 1.11.2 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18981) Support column comment for Hive tables
Rui Li created FLINK-18981: -- Summary: Support column comment for Hive tables Key: FLINK-18981 URL: https://issues.apache.org/jira/browse/FLINK-18981 Project: Flink Issue Type: Task Components: Connectors / Hive Reporter: Rui Li Fix For: 1.12.0 Start working on this once FLINK-18958 is done -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18995) Some Hive functions fail because they need to access SessionState
Rui Li created FLINK-18995: -- Summary: Some Hive functions fail because they need to access SessionState Key: FLINK-18995 URL: https://issues.apache.org/jira/browse/FLINK-18995 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li Fix For: 1.12.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18999) Temporary generic table doesn't work with HiveCatalog
Rui Li created FLINK-18999: -- Summary: Temporary generic table doesn't work with HiveCatalog Key: FLINK-18999 URL: https://issues.apache.org/jira/browse/FLINK-18999 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li Fix For: 1.12.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19004) Fail to call Hive percentile function together with distinct aggregate call
Rui Li created FLINK-19004: -- Summary: Fail to call Hive percentile function together with distinct aggregate call Key: FLINK-19004 URL: https://issues.apache.org/jira/browse/FLINK-19004 Project: Flink Issue Type: Bug Components: Connectors / Hive, Table SQL / Planner Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19042) HiveTableSourceITCase fails if object reuse is enabled
Rui Li created FLINK-19042: -- Summary: HiveTableSourceITCase fails if object reuse is enabled Key: FLINK-19042 URL: https://issues.apache.org/jira/browse/FLINK-19042 Project: Flink Issue Type: Test Components: Connectors / Hive, Tests Reporter: Rui Li {{testNonPartitionStreamingSourceWithVectorizedReader}} fails because print table sink cannot process {{ColumnarRowData}} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19061) HiveCatalog fails to get partition column stats if partition value contains special characters
Rui Li created FLINK-19061: -- Summary: HiveCatalog fails to get partition column stats if partition value contains special characters Key: FLINK-19061 URL: https://issues.apache.org/jira/browse/FLINK-19061 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li Fix For: 1.12.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19071) Some Hive window functions are not supported
Rui Li created FLINK-19071: -- Summary: Some Hive window functions are not supported Key: FLINK-19071 URL: https://issues.apache.org/jira/browse/FLINK-19071 Project: Flink Issue Type: Task Components: Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19070) Hive connector should throw a meaningful exception if user reads/writes ACID tables
Rui Li created FLINK-19070: -- Summary: Hive connector should throw a meaningful exception if user reads/writes ACID tables Key: FLINK-19070 URL: https://issues.apache.org/jira/browse/FLINK-19070 Project: Flink Issue Type: Improvement Components: Connectors / Hive Reporter: Rui Li Fix For: 1.12.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19292) HiveCatalog should support specifying Hadoop conf dir with configuration
Rui Li created FLINK-19292: -- Summary: HiveCatalog should support specifying Hadoop conf dir with configuration Key: FLINK-19292 URL: https://issues.apache.org/jira/browse/FLINK-19292 Project: Flink Issue Type: Task Components: Connectors / Hive Reporter: Rui Li Fix For: 1.12.0, 1.11.3 HiveCatalog currently relies on {{HADOOP_CONF_DIR}} env variable to load Hadoop configurations. Users may find it helpful to be able to set the conf dir with a configuration property. The configuration, when set, should take precedence over the env variable. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19361) Create a synchronized metastore client to talk to a remote HMS
Rui Li created FLINK-19361: -- Summary: Create a synchronized metastore client to talk to a remote HMS Key: FLINK-19361 URL: https://issues.apache.org/jira/browse/FLINK-19361 Project: Flink Issue Type: Task Components: Connectors / Hive Reporter: Rui Li Fix For: 1.12.0, 1.11.3 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19365) Migrate Hive table source to new source interface
Rui Li created FLINK-19365: -- Summary: Migrate Hive table source to new source interface Key: FLINK-19365 URL: https://issues.apache.org/jira/browse/FLINK-19365 Project: Flink Issue Type: Task Components: Connectors / Hive Reporter: Rui Li Fix For: 1.12.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19368) TableEnvHiveConnectorITCase fails with Hive-3.x
Rui Li created FLINK-19368: -- Summary: TableEnvHiveConnectorITCase fails with Hive-3.x Key: FLINK-19368 URL: https://issues.apache.org/jira/browse/FLINK-19368 Project: Flink Issue Type: Test Components: Connectors / Hive, Tests Reporter: Rui Li Fix For: 1.12.0 Failed test cases are {{testBatchTransactionalTable}} and {{testStreamTransactionalTable}}. It fails to create the ACID table. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19406) Casting row time to timestamp loses nullability info
Rui Li created FLINK-19406: -- Summary: Casting row time to timestamp loses nullability info Key: FLINK-19406 URL: https://issues.apache.org/jira/browse/FLINK-19406 Project: Flink Issue Type: Bug Components: Table SQL / Planner Reporter: Rui Li Fix For: 1.12.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19470) ParquetColumnarRowSplitReader::reachEnd returns false after it has reached end
Rui Li created FLINK-19470: -- Summary: ParquetColumnarRowSplitReader::reachEnd returns false after it has reached end Key: FLINK-19470 URL: https://issues.apache.org/jira/browse/FLINK-19470 Project: Flink Issue Type: Bug Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile) Reporter: Rui Li Fix For: 1.12.0 After a {{ParquetColumnarRowSplitReader}} has reached its end, calling {{reachEnd}} again gets false. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19702) Avoid using HiveConf::hiveSiteURL
Rui Li created FLINK-19702: -- Summary: Avoid using HiveConf::hiveSiteURL Key: FLINK-19702 URL: https://issues.apache.org/jira/browse/FLINK-19702 Project: Flink Issue Type: Improvement Components: Connectors / Hive Reporter: Rui Li Fix For: 1.12.0 We're relying on this static field to set path to hive-site.xml. This can be error-prone if users create multiple HiveCatalog instances in their programs. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19867) Validation fails for UDF that accepts var-args
Rui Li created FLINK-19867: -- Summary: Validation fails for UDF that accepts var-args Key: FLINK-19867 URL: https://issues.apache.org/jira/browse/FLINK-19867 Project: Flink Issue Type: Bug Components: Table SQL / API Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19888) Migrate Hive source to FLIP-27 source interface for streaming
Rui Li created FLINK-19888: -- Summary: Migrate Hive source to FLIP-27 source interface for streaming Key: FLINK-19888 URL: https://issues.apache.org/jira/browse/FLINK-19888 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li Fix For: 1.12.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19891) ScalarOperatorGens should generate a not-null type for IS NULL and IS NOT NULL
Rui Li created FLINK-19891: -- Summary: ScalarOperatorGens should generate a not-null type for IS NULL and IS NOT NULL Key: FLINK-19891 URL: https://issues.apache.org/jira/browse/FLINK-19891 Project: Flink Issue Type: Bug Components: Table SQL / Planner Reporter: Rui Li Fix For: 1.12.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19965) Refactor HiveMapredSplitReader to adapt to the new hive source
Rui Li created FLINK-19965: -- Summary: Refactor HiveMapredSplitReader to adapt to the new hive source Key: FLINK-19965 URL: https://issues.apache.org/jira/browse/FLINK-19965 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li Fix For: 1.12.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20062) ContinuousHiveSplitEnumerator should be lock-free
Rui Li created FLINK-20062: -- Summary: ContinuousHiveSplitEnumerator should be lock-free Key: FLINK-20062 URL: https://issues.apache.org/jira/browse/FLINK-20062 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li Fix For: 1.12.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20349) Query fails with "A conflict is detected. This is unexpected."
Rui Li created FLINK-20349: -- Summary: Query fails with "A conflict is detected. This is unexpected." Key: FLINK-20349 URL: https://issues.apache.org/jira/browse/FLINK-20349 Project: Flink Issue Type: Bug Components: Table SQL / Planner Reporter: Rui Li Fix For: 1.13.0 The test case to reproduce: {code} @Test public void test() throws Exception { tableEnv.executeSql("create table src(key string,val string)"); tableEnv.executeSql("SELECT sum(char_length(src5.src1_value)) FROM " + "(SELECT src3.*, src4.val as src4_value, src4.key as src4_key FROM src src4 JOIN " + "(SELECT src2.*, src1.key as src1_key, src1.val as src1_value FROM src src1 JOIN src src2 ON src1.key = src2.key) src3 " + "ON src3.src1_key = src4.key) src5").collect(); } {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20419) Insert fails due to failure to generate execution plan
Rui Li created FLINK-20419: -- Summary: Insert fails due to failure to generate execution plan Key: FLINK-20419 URL: https://issues.apache.org/jira/browse/FLINK-20419 Project: Flink Issue Type: Bug Components: Table SQL / Planner Reporter: Rui Li Test case to reproduce: {code} @Test public void test() throws Exception { tableEnv.executeSql("create table src(x int)"); tableEnv.executeSql("create table dest(x int) partitioned by (p string,q string)"); tableEnv.executeSql("insert into dest select x,'0','0' from src order by x").await(); } {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20448) Obsolete generated avro classes
Rui Li created FLINK-20448: -- Summary: Obsolete generated avro classes Key: FLINK-20448 URL: https://issues.apache.org/jira/browse/FLINK-20448 Project: Flink Issue Type: Test Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile) Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20486) Hive temporal join shouldn't require a minimal 1h monitor interval
Rui Li created FLINK-20486: -- Summary: Hive temporal join shouldn't require a minimal 1h monitor interval Key: FLINK-20486 URL: https://issues.apache.org/jira/browse/FLINK-20486 Project: Flink Issue Type: Improvement Components: Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20537) Failed to call Hive UDF with string literal arguments
Rui Li created FLINK-20537: -- Summary: Failed to call Hive UDF with string literal arguments Key: FLINK-20537 URL: https://issues.apache.org/jira/browse/FLINK-20537 Project: Flink Issue Type: Bug Components: Connectors / Hive Affects Versions: 1.12.0 Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20549) New ExecutionContext doesn't inherit classloader from previous context
Rui Li created FLINK-20549: -- Summary: New ExecutionContext doesn't inherit classloader from previous context Key: FLINK-20549 URL: https://issues.apache.org/jira/browse/FLINK-20549 Project: Flink Issue Type: Bug Components: Table SQL / Client Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20563) Support built-in functions for Hive versions prior to 1.2.0
Rui Li created FLINK-20563: -- Summary: Support built-in functions for Hive versions prior to 1.2.0 Key: FLINK-20563 URL: https://issues.apache.org/jira/browse/FLINK-20563 Project: Flink Issue Type: Improvement Components: Connectors / Hive Reporter: Rui Li Currently Hive built-in functions are supported only for Hive-1.2.0 and later. We should investigate how to lift this limitation. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20572) HiveCatalog should be a standalone module
Rui Li created FLINK-20572: -- Summary: HiveCatalog should be a standalone module Key: FLINK-20572 URL: https://issues.apache.org/jira/browse/FLINK-20572 Project: Flink Issue Type: Improvement Components: Connectors / Hive Reporter: Rui Li Fix For: 1.13.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20667) Configurable batch size for vectorized reader
Rui Li created FLINK-20667: -- Summary: Configurable batch size for vectorized reader Key: FLINK-20667 URL: https://issues.apache.org/jira/browse/FLINK-20667 Project: Flink Issue Type: Improvement Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile) Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20680) Fails to call var-arg function with no parameters
Rui Li created FLINK-20680: -- Summary: Fails to call var-arg function with no parameters Key: FLINK-20680 URL: https://issues.apache.org/jira/browse/FLINK-20680 Project: Flink Issue Type: Bug Components: Table SQL / API Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20722) Fail to insert into hive table due to ClassCastException
Rui Li created FLINK-20722: -- Summary: Fail to insert into hive table due to ClassCastException Key: FLINK-20722 URL: https://issues.apache.org/jira/browse/FLINK-20722 Project: Flink Issue Type: Bug Components: Table SQL / Runtime Reporter: Rui Li Fix For: 1.13.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20761) Cannot read hive table/partition whose location path contains comma
Rui Li created FLINK-20761: -- Summary: Cannot read hive table/partition whose location path contains comma Key: FLINK-20761 URL: https://issues.apache.org/jira/browse/FLINK-20761 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20765) ScalarOperatorGens doesn't set proper nullability for result type of generated expressions
Rui Li created FLINK-20765: -- Summary: ScalarOperatorGens doesn't set proper nullability for result type of generated expressions Key: FLINK-20765 URL: https://issues.apache.org/jira/browse/FLINK-20765 Project: Flink Issue Type: Bug Components: Table SQL / Planner Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20813) SQL Client should create modules with user class loader
Rui Li created FLINK-20813: -- Summary: SQL Client should create modules with user class loader Key: FLINK-20813 URL: https://issues.apache.org/jira/browse/FLINK-20813 Project: Flink Issue Type: Bug Components: Table SQL / Client Reporter: Rui Li Fix For: 1.13.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20822) Don't check whether a function is generic in hive catalog
Rui Li created FLINK-20822: -- Summary: Don't check whether a function is generic in hive catalog Key: FLINK-20822 URL: https://issues.apache.org/jira/browse/FLINK-20822 Project: Flink Issue Type: Task Components: Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20844) Support add jar in SQL client
Rui Li created FLINK-20844: -- Summary: Support add jar in SQL client Key: FLINK-20844 URL: https://issues.apache.org/jira/browse/FLINK-20844 Project: Flink Issue Type: New Feature Components: Table SQL / Client Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23010) HivePartitionFetcherContextBase::getComparablePartitionValueList can return partitions that don't exist
Rui Li created FLINK-23010: -- Summary: HivePartitionFetcherContextBase::getComparablePartitionValueList can return partitions that don't exist Key: FLINK-23010 URL: https://issues.apache.org/jira/browse/FLINK-23010 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li Assignee: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23032) Refactor HiveSource to make it usable in data stream job
Rui Li created FLINK-23032: -- Summary: Refactor HiveSource to make it usable in data stream job Key: FLINK-23032 URL: https://issues.apache.org/jira/browse/FLINK-23032 Project: Flink Issue Type: Improvement Components: Connectors / Hive Reporter: Rui Li Assignee: Rui Li Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23168) Catalog shouldn't merge properties for alter DB operation
Rui Li created FLINK-23168: -- Summary: Catalog shouldn't merge properties for alter DB operation Key: FLINK-23168 URL: https://issues.apache.org/jira/browse/FLINK-23168 Project: Flink Issue Type: Improvement Components: Connectors / Hive, Table SQL / API Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23178) Raise an error for writing stream data into partitioned hive/FS tables without a partition committer
Rui Li created FLINK-23178: -- Summary: Raise an error for writing stream data into partitioned hive/FS tables without a partition committer Key: FLINK-23178 URL: https://issues.apache.org/jira/browse/FLINK-23178 Project: Flink Issue Type: Improvement Components: Connectors / FileSystem, Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23224) Support timestamp_ltz type in hive connector
Rui Li created FLINK-23224: -- Summary: Support timestamp_ltz type in hive connector Key: FLINK-23224 URL: https://issues.apache.org/jira/browse/FLINK-23224 Project: Flink Issue Type: New Feature Components: Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23316) There's no test for custom PartitionCommitPolicy
Rui Li created FLINK-23316: -- Summary: There's no test for custom PartitionCommitPolicy Key: FLINK-23316 URL: https://issues.apache.org/jira/browse/FLINK-23316 Project: Flink Issue Type: Improvement Components: Table SQL / Ecosystem Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23752) Add document for using HiveSource API
Rui Li created FLINK-23752: -- Summary: Add document for using HiveSource API Key: FLINK-23752 URL: https://issues.apache.org/jira/browse/FLINK-23752 Project: Flink Issue Type: Improvement Components: Connectors / Hive, Documentation Reporter: Rui Li Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23897) Fix obsolete doc about creating hive table with flink
Rui Li created FLINK-23897: -- Summary: Fix obsolete doc about creating hive table with flink Key: FLINK-23897 URL: https://issues.apache.org/jira/browse/FLINK-23897 Project: Flink Issue Type: Bug Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17198) DDL and DML compatibility for Hive connector
Rui Li created FLINK-17198: -- Summary: DDL and DML compatibility for Hive connector Key: FLINK-17198 URL: https://issues.apache.org/jira/browse/FLINK-17198 Project: Flink Issue Type: New Feature Components: Connectors / Hive, Table SQL / Client Reporter: Rui Li Fix For: 1.11.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17209) Allow users to specify dialect in sql-client yaml
Rui Li created FLINK-17209: -- Summary: Allow users to specify dialect in sql-client yaml Key: FLINK-17209 URL: https://issues.apache.org/jira/browse/FLINK-17209 Project: Flink Issue Type: Sub-task Components: Table SQL / Client Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17210) Implement database DDLs for Hive dialect
Rui Li created FLINK-17210: -- Summary: Implement database DDLs for Hive dialect Key: FLINK-17210 URL: https://issues.apache.org/jira/browse/FLINK-17210 Project: Flink Issue Type: Sub-task Components: Connectors / Hive, Table SQL / Client Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17387) Implement LookupableTableSource for Hive connector
Rui Li created FLINK-17387: -- Summary: Implement LookupableTableSource for Hive connector Key: FLINK-17387 URL: https://issues.apache.org/jira/browse/FLINK-17387 Project: Flink Issue Type: New Feature Components: Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17431) Implement table DDLs for Hive dialect part 1
Rui Li created FLINK-17431: -- Summary: Implement table DDLs for Hive dialect part 1 Key: FLINK-17431 URL: https://issues.apache.org/jira/browse/FLINK-17431 Project: Flink Issue Type: Sub-task Reporter: Rui Li Fix For: 1.11.0 Will cover CREATE, DROP, DESCRIBE, SHOW table in this ticket. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17448) Implement table DDLs for Hive dialect part2
Rui Li created FLINK-17448: -- Summary: Implement table DDLs for Hive dialect part2 Key: FLINK-17448 URL: https://issues.apache.org/jira/browse/FLINK-17448 Project: Flink Issue Type: Sub-task Components: Connectors / Hive, Table SQL / API Reporter: Rui Li Fix For: 1.11.0 Will cover ALTER table in this ticket -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17449) Implement ADD/DROP partitions
Rui Li created FLINK-17449: -- Summary: Implement ADD/DROP partitions Key: FLINK-17449 URL: https://issues.apache.org/jira/browse/FLINK-17449 Project: Flink Issue Type: Sub-task Components: Connectors / Hive, Table SQL / API Reporter: Rui Li Introduce ADD/DROP partitions operations. Will only implement syntax for the Hive parser in this ticket. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17450) Implement function DDLs for Hive dialect
Rui Li created FLINK-17450: -- Summary: Implement function DDLs for Hive dialect Key: FLINK-17450 URL: https://issues.apache.org/jira/browse/FLINK-17450 Project: Flink Issue Type: Sub-task Components: Connectors / Hive, Table SQL / API Reporter: Rui Li Fix For: 1.11.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17451) Implement view DDLs for Hive dialect
Rui Li created FLINK-17451: -- Summary: Implement view DDLs for Hive dialect Key: FLINK-17451 URL: https://issues.apache.org/jira/browse/FLINK-17451 Project: Flink Issue Type: Sub-task Components: Connectors / Hive, Table SQL / API Reporter: Rui Li Fix For: 1.11.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17452) Support creating Hive tables with constraints
Rui Li created FLINK-17452: -- Summary: Support creating Hive tables with constraints Key: FLINK-17452 URL: https://issues.apache.org/jira/browse/FLINK-17452 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17456) Update hive connector tests to execute DDL & DML via TableEnvironment
Rui Li created FLINK-17456: -- Summary: Update hive connector tests to execute DDL & DML via TableEnvironment Key: FLINK-17456 URL: https://issues.apache.org/jira/browse/FLINK-17456 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li Fix For: 1.11.0 In hive connector tests, currently we delegate DDLs and some DMLs to the hive shell. With hive parser in place, we should be able to execute those DDLs and DMLs on Flink side. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17457) Manage Hive metadata via Flink DDL
Rui Li created FLINK-17457: -- Summary: Manage Hive metadata via Flink DDL Key: FLINK-17457 URL: https://issues.apache.org/jira/browse/FLINK-17457 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li To implement hive dialect, we encode lots of DDL semantics as properties. We should decide whether/how to allow users to directly use these properties in Flink DDL to achieve the same semantics. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17666) Insert into partitioned table can fail with select *
Rui Li created FLINK-17666: -- Summary: Insert into partitioned table can fail with select * Key: FLINK-17666 URL: https://issues.apache.org/jira/browse/FLINK-17666 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17667) Implement INSERT for Hive dialect
Rui Li created FLINK-17667: -- Summary: Implement INSERT for Hive dialect Key: FLINK-17667 URL: https://issues.apache.org/jira/browse/FLINK-17667 Project: Flink Issue Type: Sub-task Components: Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17786) Cannot switch dialect in SQL CLI
Rui Li created FLINK-17786: -- Summary: Cannot switch dialect in SQL CLI Key: FLINK-17786 URL: https://issues.apache.org/jira/browse/FLINK-17786 Project: Flink Issue Type: Bug Components: Table SQL / Client Reporter: Rui Li Fix For: 1.11.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17867) Fix Hive-3.1.1 test
Rui Li created FLINK-17867: -- Summary: Fix Hive-3.1.1 test Key: FLINK-17867 URL: https://issues.apache.org/jira/browse/FLINK-17867 Project: Flink Issue Type: Test Components: Connectors / Hive Reporter: Rui Li Fix For: 1.11.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17937) Change some hive connector tests to IT cases
Rui Li created FLINK-17937: -- Summary: Change some hive connector tests to IT cases Key: FLINK-17937 URL: https://issues.apache.org/jira/browse/FLINK-17937 Project: Flink Issue Type: Test Components: Connectors / Hive, Tests Reporter: Rui Li Fix For: 1.11.0 Hive connector tests that use {{FlinkStandaloneHiveRunner}} should be IT cases. Besides, changing them to IT cases can avoid lib conflicts because we'll be using the shaded jars. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17941) Switching database doesn't work from SQL CLI
Rui Li created FLINK-17941: -- Summary: Switching database doesn't work from SQL CLI Key: FLINK-17941 URL: https://issues.apache.org/jira/browse/FLINK-17941 Project: Flink Issue Type: Bug Components: Table SQL / Client Reporter: Rui Li Fix For: 1.11.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17965) Hive dialect doesn't properly handle special character escaping with SQL CLI
Rui Li created FLINK-17965: -- Summary: Hive dialect doesn't properly handle special character escaping with SQL CLI Key: FLINK-17965 URL: https://issues.apache.org/jira/browse/FLINK-17965 Project: Flink Issue Type: Bug Components: Table SQL / Client Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18009) Select an invalid column crashes the SQL CLI
Rui Li created FLINK-18009: -- Summary: Select an invalid column crashes the SQL CLI Key: FLINK-18009 URL: https://issues.apache.org/jira/browse/FLINK-18009 Project: Flink Issue Type: Bug Components: Table SQL / Client Reporter: Rui Li To reproduce: just select a non-existing column from table in SQL CLI -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18030) Hive UDF doesn't accept empty string literal parameter
Rui Li created FLINK-18030: -- Summary: Hive UDF doesn't accept empty string literal parameter Key: FLINK-18030 URL: https://issues.apache.org/jira/browse/FLINK-18030 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li Fix For: 1.12.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18046) Decimal column stats not supported for Hive table
Rui Li created FLINK-18046: -- Summary: Decimal column stats not supported for Hive table Key: FLINK-18046 URL: https://issues.apache.org/jira/browse/FLINK-18046 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li Fix For: 1.11.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18197) Add more logs for hive streaming integration
Rui Li created FLINK-18197: -- Summary: Add more logs for hive streaming integration Key: FLINK-18197 URL: https://issues.apache.org/jira/browse/FLINK-18197 Project: Flink Issue Type: Task Components: Connectors / FileSystem, Connectors / Hive Reporter: Rui Li Fix For: 1.11.0 Should add more logs for Hive table streaming source/sink and lookup join. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18258) Implement SHOW PARTITIONS for Hive dialect
Rui Li created FLINK-18258: -- Summary: Implement SHOW PARTITIONS for Hive dialect Key: FLINK-18258 URL: https://issues.apache.org/jira/browse/FLINK-18258 Project: Flink Issue Type: Task Components: Connectors / Hive, Table SQL / Client, Table SQL / Planner Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18272) FileSystemLookupFunction can fail if the file gets updated/deleted while cache is reloaded
Rui Li created FLINK-18272: -- Summary: FileSystemLookupFunction can fail if the file gets updated/deleted while cache is reloaded Key: FLINK-18272 URL: https://issues.apache.org/jira/browse/FLINK-18272 Project: Flink Issue Type: Bug Components: FileSystems Reporter: Rui Li Fix For: 1.11.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18300) SQL Client doesn't support ALTER VIEW
Rui Li created FLINK-18300: -- Summary: SQL Client doesn't support ALTER VIEW Key: FLINK-18300 URL: https://issues.apache.org/jira/browse/FLINK-18300 Project: Flink Issue Type: Bug Components: Table SQL / Client Reporter: Rui Li Fix For: 1.11.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18313) Hive dialect doc should mention that views created in Flink cannot be used in Hive
Rui Li created FLINK-18313: -- Summary: Hive dialect doc should mention that views created in Flink cannot be used in Hive Key: FLINK-18313 URL: https://issues.apache.org/jira/browse/FLINK-18313 Project: Flink Issue Type: Task Components: Connectors / Hive, Documentation Reporter: Rui Li Fix For: 1.11.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18445) Short circuit join condition for lookup join
Rui Li created FLINK-18445: -- Summary: Short circuit join condition for lookup join Key: FLINK-18445 URL: https://issues.apache.org/jira/browse/FLINK-18445 Project: Flink Issue Type: Improvement Components: Table SQL / Planner Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18516) Improve error message for rank function in streaming mode
Rui Li created FLINK-18516: -- Summary: Improve error message for rank function in streaming mode Key: FLINK-18516 URL: https://issues.apache.org/jira/browse/FLINK-18516 Project: Flink Issue Type: Improvement Components: Table SQL / Planner Reporter: Rui Li The following query currently fails with NPE: {code} create table foo (x int,y string,p as proctime()) with ...; select x,y,row_number() over (partition by x order by p) from foo; {code} which can be difficult for users to figure out the reason of the failure. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18529) Query Hive table and filter by timestamp partition doesn't work
Rui Li created FLINK-18529: -- Summary: Query Hive table and filter by timestamp partition doesn't work Key: FLINK-18529 URL: https://issues.apache.org/jira/browse/FLINK-18529 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18644) Remove scala-shell doc for hive connector
Rui Li created FLINK-18644: -- Summary: Remove scala-shell doc for hive connector Key: FLINK-18644 URL: https://issues.apache.org/jira/browse/FLINK-18644 Project: Flink Issue Type: Task Components: Connectors / Hive, Documentation Affects Versions: 1.10.1 Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18678) Hive connector fails to create vector orc reader if user specifies incorrect hive version
Rui Li created FLINK-18678: -- Summary: Hive connector fails to create vector orc reader if user specifies incorrect hive version Key: FLINK-18678 URL: https://issues.apache.org/jira/browse/FLINK-18678 Project: Flink Issue Type: Improvement Components: Connectors / Hive, Formats (JSON, Avro, Parquet, ORC, SequenceFile) Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18682) Vector orc reader cannot read Hive 2.0.0 table
Rui Li created FLINK-18682: -- Summary: Vector orc reader cannot read Hive 2.0.0 table Key: FLINK-18682 URL: https://issues.apache.org/jira/browse/FLINK-18682 Project: Flink Issue Type: Bug Components: Connectors / Hive, Formats (JSON, Avro, Parquet, ORC, SequenceFile) Affects Versions: 1.11.1 Reporter: Rui Li -- This message was sent by Atlassian Jira (v8.3.4#803005)