[jira] [Created] (FLINK-36049) Add CompiledPlan annotations to BatchExecSortLimit
Jim Hughes created FLINK-36049: -- Summary: Add CompiledPlan annotations to BatchExecSortLimit Key: FLINK-36049 URL: https://issues.apache.org/jira/browse/FLINK-36049 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes Fix For: 2.0.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-36048) Add CompiledPlan annotations to BatchExecRank
Jim Hughes created FLINK-36048: -- Summary: Add CompiledPlan annotations to BatchExecRank Key: FLINK-36048 URL: https://issues.apache.org/jira/browse/FLINK-36048 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes Fix For: 2.0.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-36047) Add CompiledPlan annotations to BatchExecOverAggregate
Jim Hughes created FLINK-36047: -- Summary: Add CompiledPlan annotations to BatchExecOverAggregate Key: FLINK-36047 URL: https://issues.apache.org/jira/browse/FLINK-36047 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes Fix For: 2.0.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-36003) Add CompiledPlan annotations to BatchExecExpand and BatchExecSortAggregate
Jim Hughes created FLINK-36003: -- Summary: Add CompiledPlan annotations to BatchExecExpand and BatchExecSortAggregate Key: FLINK-36003 URL: https://issues.apache.org/jira/browse/FLINK-36003 Project: Flink Issue Type: Sub-task Components: Table SQL / Planner Reporter: Jim Hughes Assignee: Jim Hughes Fix For: 2.0.0 In addition to the annotations, implement the BatchCompiledPlan test for these operators. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-36002) Add CompiledPlan annotations to BatchExecMatch
Jim Hughes created FLINK-36002: -- Summary: Add CompiledPlan annotations to BatchExecMatch Key: FLINK-36002 URL: https://issues.apache.org/jira/browse/FLINK-36002 Project: Flink Issue Type: Sub-task Components: Table SQL / Planner Reporter: Jim Hughes Assignee: Jim Hughes Fix For: 2.0.0 In addition to the annotations, implement the BatchCompiledPlan test for this operator. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35944) Add CompiledPlan annotations to BatchExecUnion
Jim Hughes created FLINK-35944: -- Summary: Add CompiledPlan annotations to BatchExecUnion Key: FLINK-35944 URL: https://issues.apache.org/jira/browse/FLINK-35944 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes In addition to the annotations, implement the BatchCompiledPlan test for this operator. For this operator, the BatchExecHashAggregate operator must be annotated as well. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35943) Add CompiledPlan annotations to BatchExecHashJoin and BatchExecNestedLoopJoin
Jim Hughes created FLINK-35943: -- Summary: Add CompiledPlan annotations to BatchExecHashJoin and BatchExecNestedLoopJoin Key: FLINK-35943 URL: https://issues.apache.org/jira/browse/FLINK-35943 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes In addition to the annotations, implement the BatchCompiledPlan test for these two operators. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35942) Add CompiledPlan annotations to BatchExecSort
Jim Hughes created FLINK-35942: -- Summary: Add CompiledPlan annotations to BatchExecSort Key: FLINK-35942 URL: https://issues.apache.org/jira/browse/FLINK-35942 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes In addition to the annotations, implement the BatchCompiledPlan test for this operator. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35941) Add CompiledPlan annotations to BatchExecLimit
Jim Hughes created FLINK-35941: -- Summary: Add CompiledPlan annotations to BatchExecLimit Key: FLINK-35941 URL: https://issues.apache.org/jira/browse/FLINK-35941 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes In addition to the annotations, implement the BatchCompiledPlan test for this operator. Additionally, tests for the TableSource operator will be pulled into this work. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35934) Add CompiledPlan annotations to BatchExecValues
Jim Hughes created FLINK-35934: -- Summary: Add CompiledPlan annotations to BatchExecValues Key: FLINK-35934 URL: https://issues.apache.org/jira/browse/FLINK-35934 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35923) Add CompiledPlan annotations to BatchExecSort
Jim Hughes created FLINK-35923: -- Summary: Add CompiledPlan annotations to BatchExecSort Key: FLINK-35923 URL: https://issues.apache.org/jira/browse/FLINK-35923 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes Fix For: 2.0.0 In addition to the annotations, implement the BatchCompiledPlan test for this operator. Since this is the first operator, exchange operator must be annotated as well. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35799) Add CompiledPlan annotations to BatchExecCalc
Jim Hughes created FLINK-35799: -- Summary: Add CompiledPlan annotations to BatchExecCalc Key: FLINK-35799 URL: https://issues.apache.org/jira/browse/FLINK-35799 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes In addition to the annotations, implement the BatchCompiledPlan test for this operator. Since this is the first operator, sink and source operators must be annotated as well. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35798) Implement a BatchCompiledPlanTestBase
Jim Hughes created FLINK-35798: -- Summary: Implement a BatchCompiledPlanTestBase Key: FLINK-35798 URL: https://issues.apache.org/jira/browse/FLINK-35798 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes The goal of BatchCompiledPlanTestBase has two golas: 1. Take TableTestPrograms and produce compiled plans for the latest version of the operator being tested. 2. Load all compiled plans from disk and execute them against the first batch of data described by the TableTestProgram. This will ensure that there are no errors in serialization or deserialization for the operator under test. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35797) FLIP-456: CompiledPlan support for Batch Execution Mode
Jim Hughes created FLINK-35797: -- Summary: FLIP-456: CompiledPlan support for Batch Execution Mode Key: FLINK-35797 URL: https://issues.apache.org/jira/browse/FLINK-35797 Project: Flink Issue Type: New Feature Reporter: Jim Hughes Assignee: Jim Hughes The CompiledPlan feature, introduced in FLIP-190: Support Version Upgrades for Table API & SQL Programs, supports only streaming execution mode. Batch ExecNodes were explicitly excluded from the JSON plan (aka CompiledPlan). This ticket will cover adding CompiledPlan support for the Batch ExecNodes. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35725) Translate new DISTRIBUTED BY documentation into Chinese
Jim Hughes created FLINK-35725: -- Summary: Translate new DISTRIBUTED BY documentation into Chinese Key: FLINK-35725 URL: https://issues.apache.org/jira/browse/FLINK-35725 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes In Flink 1.20, FLIP-376 adds DISTRIBUTED BY. The documentation PR is here: https://github.com/apache/flink/pull/24929 and it should be translated into Chinese. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35585) Add documentation for distribution
Jim Hughes created FLINK-35585: -- Summary: Add documentation for distribution Key: FLINK-35585 URL: https://issues.apache.org/jira/browse/FLINK-35585 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Add documentation for ALTER TABLE, CREATE TABLE, and the sink abilities. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34173) Implement CatalogTable.Builder
Jim Hughes created FLINK-34173: -- Summary: Implement CatalogTable.Builder Key: FLINK-34173 URL: https://issues.apache.org/jira/browse/FLINK-34173 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34172) Add support for altering a distribution via ALTER TABLE
Jim Hughes created FLINK-34172: -- Summary: Add support for altering a distribution via ALTER TABLE Key: FLINK-34172 URL: https://issues.apache.org/jira/browse/FLINK-34172 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34067) Fix javacc warnings in flink-sql-parser
Jim Hughes created FLINK-34067: -- Summary: Fix javacc warnings in flink-sql-parser Key: FLINK-34067 URL: https://issues.apache.org/jira/browse/FLINK-34067 Project: Flink Issue Type: Improvement Reporter: Jim Hughes Assignee: Jim Hughes While extending the Flink SQL parser, I noticed these two warnings: ``` [INFO] --- javacc:2.4:javacc (javacc) @ flink-sql-parser --- Java Compiler Compiler Version 4.0 (Parser Generator) (type "javacc" with no arguments for help) Reading from file .../flink-table/flink-sql-parser/target/generated-sources/javacc/Parser.jj . . . Note: UNICODE_INPUT option is specified. Please make sure you create the parser/lexer using a Reader with the correct character encoding. Warning: Choice conflict involving two expansions at line 2043, column 13 and line 2052, column 9 respectively. A common prefix is: "IF" Consider using a lookahead of 2 for earlier expansion. Warning: Choice conflict involving two expansions at line 2097, column 13 and line 2105, column 8 respectively. A common prefix is: "IF" Consider using a lookahead of 2 for earlier expansion. ``` As the warning suggestions, adding `LOOKAHEAD(2)` in a few places addresses the warning. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33918) Fix AsyncSinkWriterThrottlingTest test failure
Jim Hughes created FLINK-33918: -- Summary: Fix AsyncSinkWriterThrottlingTest test failure Key: FLINK-33918 URL: https://issues.apache.org/jira/browse/FLINK-33918 Project: Flink Issue Type: Bug Affects Versions: 1.19.0 Reporter: Jim Hughes >From >[https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55700&view=logs&j=1c002d28-a73d-5309-26ee-10036d8476b4&t=d1c117a6-8f13-5466-55f0-d48dbb767fcd] ``` Dec 20 03:09:03 03:09:03.411 [ERROR] org.apache.flink.connector.base.sink.writer.AsyncSinkWriterThrottlingTest.testSinkThroughputShouldThrottleToHalfBatchSize -- Time elapsed: 0.879 s <<< ERROR! Dec 20 03:09:03 java.lang.IllegalStateException: Illegal thread detected. This method must be called from inside the mailbox thread! Dec 20 03:09:03 at org.apache.flink.streaming.runtime.tasks.mailbox.TaskMailboxImpl.checkIsMailboxThread(TaskMailboxImpl.java:262) Dec 20 03:09:03 at org.apache.flink.streaming.runtime.tasks.mailbox.TaskMailboxImpl.take(TaskMailboxImpl.java:137) Dec 20 03:09:03 at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxExecutorImpl.yield(MailboxExecutorImpl.java:84) Dec 20 03:09:03 at org.apache.flink.connector.base.sink.writer.AsyncSinkWriter.flush(AsyncSinkWriter.java:367) Dec 20 03:09:03 at org.apache.flink.connector.base.sink.writer.AsyncSinkWriter.lambda$registerCallback$3(AsyncSinkWriter.java:315) Dec 20 03:09:03 at org.apache.flink.streaming.runtime.tasks.TestProcessingTimeService$CallbackTask.onProcessingTime(TestProcessingTimeService.java:199) Dec 20 03:09:03 at org.apache.flink.streaming.runtime.tasks.TestProcessingTimeService.setCurrentTime(TestProcessingTimeService.java:76) Dec 20 03:09:03 at org.apache.flink.connector.base.sink.writer.AsyncSinkWriterThrottlingTest.testSinkThroughputShouldThrottleToHalfBatchSize(AsyncSinkWriterThrottlingTest.java:64) Dec 20 03:09:03 at java.lang.reflect.Method.invoke(Method.java:498) ``` -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33805) Implement restore tests for OverAggregate node
Jim Hughes created FLINK-33805: -- Summary: Implement restore tests for OverAggregate node Key: FLINK-33805 URL: https://issues.apache.org/jira/browse/FLINK-33805 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33777) ParquetTimestampITCase>FsStreamingSinkITCaseBase failing in CI
Jim Hughes created FLINK-33777: -- Summary: ParquetTimestampITCase>FsStreamingSinkITCaseBase failing in CI Key: FLINK-33777 URL: https://issues.apache.org/jira/browse/FLINK-33777 Project: Flink Issue Type: Bug Reporter: Jim Hughes >From this CI run: >[https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55334&view=logs&j=2e8cb2f7-b2d3-5c62-9c05-cd756d33a819&t=2dd510a3-5041-5201-6dc3-54d310f68906] ``` Dec 07 19:57:30 19:57:30.026 [ERROR] Errors: Dec 07 19:57:30 19:57:30.026 [ERROR] ParquetTimestampITCase>FsStreamingSinkITCaseBase.testNonPart:84->FsStreamingSinkITCaseBase.testPartitionCustomFormatDate:151->FsStreamingSinkITCaseBase.test:186 » Validation Dec 07 19:57:30 19:57:30.026 [ERROR] ParquetTimestampITCase>FsStreamingSinkITCaseBase.testPart:89->FsStreamingSinkITCaseBase.testPartitionCustomFormatDate:151->FsStreamingSinkITCaseBase.test:186 » Validation Dec 07 19:57:30 19:57:30.026 [ERROR] ParquetTimestampITCase>FsStreamingSinkITCaseBase.testPartitionWithBasicDate:126->FsStreamingSinkITCaseBase.test:186 » Validation ``` The errors each appear somewhat similar: ``` Dec 07 19:54:43 19:54:43.934 [ERROR] org.apache.flink.formats.parquet.ParquetTimestampITCase.testPartitionWithBasicDate Time elapsed: 1.822 s <<< ERROR! Dec 07 19:54:43 org.apache.flink.table.api.ValidationException: Unable to find a field named 'f0' in the physical data type derived from the given type information for schema declaration. Make sure that the type information is not a generic raw type. Currently available fields are: [a, b, c, d, e] Dec 07 19:54:43 at org.apache.flink.table.catalog.SchemaTranslator.patchDataTypeFromColumn(SchemaTranslator.java:350) Dec 07 19:54:43 at org.apache.flink.table.catalog.SchemaTranslator.patchDataTypeFromDeclaredSchema(SchemaTranslator.java:337) Dec 07 19:54:43 at org.apache.flink.table.catalog.SchemaTranslator.createConsumingResult(SchemaTranslator.java:235) Dec 07 19:54:43 at org.apache.flink.table.catalog.SchemaTranslator.createConsumingResult(SchemaTranslator.java:180) Dec 07 19:54:43 at org.apache.flink.table.api.bridge.internal.AbstractStreamTableEnvironmentImpl.fromStreamInternal(AbstractStreamTableEnvironmentImpl.java:141) Dec 07 19:54:43 at org.apache.flink.table.api.bridge.scala.internal.StreamTableEnvironmentImpl.createTemporaryView(StreamTableEnvironmentImpl.scala:121) Dec 07 19:54:43 at org.apache.flink.table.planner.runtime.stream.FsStreamingSinkITCaseBase.test(FsStreamingSinkITCaseBase.scala:186) Dec 07 19:54:43 at org.apache.flink.table.planner.runtime.stream.FsStreamingSinkITCaseBase.testPartitionWithBasicDate(FsStreamingSinkITCaseBase.scala:126) ``` -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33767) Implement restore tests for TemporalJoin node
Jim Hughes created FLINK-33767: -- Summary: Implement restore tests for TemporalJoin node Key: FLINK-33767 URL: https://issues.apache.org/jira/browse/FLINK-33767 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33758) Implement restore tests for TemporalSort node
Jim Hughes created FLINK-33758: -- Summary: Implement restore tests for TemporalSort node Key: FLINK-33758 URL: https://issues.apache.org/jira/browse/FLINK-33758 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33757) Implement restore tests for Rank node
Jim Hughes created FLINK-33757: -- Summary: Implement restore tests for Rank node Key: FLINK-33757 URL: https://issues.apache.org/jira/browse/FLINK-33757 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33756) Missing record with CUMULATE/HOP windows using an optimization
Jim Hughes created FLINK-33756: -- Summary: Missing record with CUMULATE/HOP windows using an optimization Key: FLINK-33756 URL: https://issues.apache.org/jira/browse/FLINK-33756 Project: Flink Issue Type: Bug Reporter: Jim Hughes I have seen an optimization cause a window fail to emit a record. With the optimization `TABLE_OPTIMIZER_DISTINCT_AGG_SPLIT_ENABLED` set to true, the configuration AggregatePhaseStrategy.TWO_PHASE set, using a HOP or CUMULATE window with an offset, a record can be sent which causes one of the multiple active windows to fail to emit a record. The link code modifies the `WindowAggregateJsonITCase` to demonstrate the case. The test `testDistinctSplitDisabled` shows the expected behavior. The test `testDistinctSplitEnabled` tests the above configurations and shows that one record is missing from the output. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33676) Implement restore tests for WindowAggregate node
Jim Hughes created FLINK-33676: -- Summary: Implement restore tests for WindowAggregate node Key: FLINK-33676 URL: https://issues.apache.org/jira/browse/FLINK-33676 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33667) Implement restore tests for MatchRecognize node
Jim Hughes created FLINK-33667: -- Summary: Implement restore tests for MatchRecognize node Key: FLINK-33667 URL: https://issues.apache.org/jira/browse/FLINK-33667 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes Assignee: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33601) Implement restore tests for Expand node
Jim Hughes created FLINK-33601: -- Summary: Implement restore tests for Expand node Key: FLINK-33601 URL: https://issues.apache.org/jira/browse/FLINK-33601 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33521) Implement restore tests for PythonCalc node
Jim Hughes created FLINK-33521: -- Summary: Implement restore tests for PythonCalc node Key: FLINK-33521 URL: https://issues.apache.org/jira/browse/FLINK-33521 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33488) Implement restore tests for Deduplicate node
Jim Hughes created FLINK-33488: -- Summary: Implement restore tests for Deduplicate node Key: FLINK-33488 URL: https://issues.apache.org/jira/browse/FLINK-33488 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33470) Implement restore tests for Join node
Jim Hughes created FLINK-33470: -- Summary: Implement restore tests for Join node Key: FLINK-33470 URL: https://issues.apache.org/jira/browse/FLINK-33470 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33469) Implement restore tests for Limit node
Jim Hughes created FLINK-33469: -- Summary: Implement restore tests for Limit node Key: FLINK-33469 URL: https://issues.apache.org/jira/browse/FLINK-33469 Project: Flink Issue Type: Sub-task Reporter: Jim Hughes -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-32691) SELECT fcn does not work with an unset catalog or database
Jim Hughes created FLINK-32691: -- Summary: SELECT fcn does not work with an unset catalog or database Key: FLINK-32691 URL: https://issues.apache.org/jira/browse/FLINK-32691 Project: Flink Issue Type: Bug Reporter: Jim Hughes Fix For: 1.18.0 Relative to https://issues.apache.org/jira/browse/FLINK-32584, function lookup fails without the catalog and database set. -- This message was sent by Atlassian Jira (v8.20.10#820010)
