Rui Li created FLINK-34147:
--
Summary: TimestampData to/from LocalDateTime is ambiguous
Key: FLINK-34147
URL: https://issues.apache.org/jira/browse/FLINK-34147
Project: Flink
Issue Type: Bug
unity to take the next steps.
> >
> > [1]:
> >
> https://github.com/apache/flink/blob/678370b18e1b6c4a23e5ce08f8efd05675a0cc17/flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/planner/delegation/hive/HiveParser.java#L348
> > [2]:https://issues.apache.org/jira/browse/FLINK-26681
> > [3]:https://issues.apache.org/jira/browse/FLINK-31413
> > [4]:https://issues.apache.org/jira/browse/FLINK-30064
> >
> >
> >
> > Best regards,
> > Yuxia
> >
>
>
> --
>
> Best,
> Benchao Li
>
--
Best regards!
Rui Li
> > in miscellaneous contributions, including PR reviews, document
> > > enhancement,
> > > > mailing list services and meetup/FF talks.
> > > >
> > > > Please join me in congratulating Yangze Guo for becoming a Flink
> > > committer!
> > > >
> > > > Thank you~
> > > >
> > > > Xintong Song
> > >
> >
>
--
Best regards!
Rui Li
t; > > > He is also the maintainer of flink-cdc-connectors[1] project which
> > helps
> > > a
> > > > lot for users building a real-time data warehouse and data lake.
> > > >
> > > > Please join me in congratulating Leonard for becoming a Flink
> > committer!
> > > >
> > > > Cheers,
> > > > Jark Wu
> > > >
> > > > [1]: https://github.com/ververica/flink-cdc-connectors
> > >
> >
>
--
Best regards!
Rui Li
Rui Li created FLINK-23897:
--
Summary: Fix obsolete doc about creating hive table with flink
Key: FLINK-23897
URL: https://issues.apache.org/jira/browse/FLINK-23897
Project: Flink
Issue Type: Bug
Rui Li created FLINK-23752:
--
Summary: Add document for using HiveSource API
Key: FLINK-23752
URL: https://issues.apache.org/jira/browse/FLINK-23752
Project: Flink
Issue Type: Improvement
Rui Li created FLINK-23316:
--
Summary: There's no test for custom PartitionCommitPolicy
Key: FLINK-23316
URL: https://issues.apache.org/jira/browse/FLINK-23316
Project: Flink
Issue Type: Improvement
nity activities such as helping manage releases, discussing
> > questions on dev@list, supporting users and giving talks at conferences.
> >
> > Please join me in congratulating Yuan for becoming a Flink committer!
> >
> > Cheers,
> > Yu
> >
>
--
Best regards!
Rui Li
;>> Yang has been a very active contributor for more than two years,
> > mainly
> > > >>> focusing on Flink's deployment components. He's a main contributor
> > and
> > > >>> maintainer of Flink's native Kubernetes deployment and native
> > > Kubernetes
> > > >>> HA. He's also very active on the mailing lists, participating in
> > > >>> discussions and helping with user questions.
> > > >>>
> > > >>> Please join me in congratulating Yang Wang for becoming a Flink
> > > >> committer!
> > > >>>
> > > >>> Thank you~
> > > >>>
> > > >>> Xintong Song
> > > >>>
> > > >>
> > > >>
> > >
> > >
> >
>
>
> --
>
> Best,
> Benchao Li
>
--
Best regards!
Rui Li
> > >>>>>>
> > >>>>>> Xintong Song
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren
> > >>>> wrote:
> > >>>>>>
> > >>>>>>> Congratulations Guowei!
> > >>>>>>>
> > >>>>>>> --
> > >>>>>>> Best Regards,
> > >>>>>>>
> > >>>>>>> Qingsheng Ren
> > >>>>>>> Email: renqs...@gmail.com
> > >>>>>>> 2021年7月7日 +0800 09:30 Leonard Xu ，写道：
> > >>>>>>>> Congratulations! Guowei Ma
> > >>>>>>>>
> > >>>>>>>> Best,
> > >>>>>>>> Leonard
> > >>>>>>>>
> > >>>>>>>>> ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young дµÀ£º
> > >>>>>>>>>
> > >>>>>>>>> Hi all!
> > >>>>>>>>>
> > >>>>>>>>> I'm very happy to announce that Guowei Ma has joined the
> > >> Flink
> > >>>> PMC!
> > >>>>>>>>>
> > >>>>>>>>> Congratulations and welcome Guowei!
> > >>>>>>>>>
> > >>>>>>>>> Best,
> > >>>>>>>>> Kurt
> > >>>>>>>>
> > >>>>>>>
> > >>>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>
> > >
> >
> >
>
> --
>
> Best,
> Benchao Li
>
--
Best regards!
Rui Li
Rui Li created FLINK-23224:
--
Summary: Support timestamp_ltz type in hive connector
Key: FLINK-23224
URL: https://issues.apache.org/jira/browse/FLINK-23224
Project: Flink
Issue Type: New Feature
> > > > the
> > > > > > > > > > > > > > > > new created JIRA because we could not block
> > > other
> > > > > > commit
> > > >
Rui Li created FLINK-23178:
--
Summary: Raise an error for writing stream data into partitioned
hive/FS tables without a partition committer
Key: FLINK-23178
URL: https://issues.apache.org/jira/browse/FLINK-23178
Rui Li created FLINK-23168:
--
Summary: Catalog shouldn't merge properties for alter DB operation
Key: FLINK-23168
URL: https://issues.apache.org/jira/browse/FLINK-23168
Project: Flink
Issue Type
Rui Li created FLINK-23032:
--
Summary: Refactor HiveSource to make it usable in data stream job
Key: FLINK-23032
URL: https://issues.apache.org/jira/browse/FLINK-23032
Project: Flink
Issue Type
Rui Li created FLINK-23010:
--
Summary:
HivePartitionFetcherContextBase::getComparablePartitionValueList can return
partitions that don't exist
Key: FLINK-23010
URL: https://issues.apache.org/jira/browse/FLINK-23010
Rui Li created FLINK-22812:
--
Summary: Fix hive issues in sql-connector-hive jars
Key: FLINK-22812
URL: https://issues.apache.org/jira/browse/FLINK-22812
Project: Flink
Issue Type: Improvement
Rui Li created FLINK-22760:
--
Summary: HiveParser::setCurrentTimestamp fails with hive-3.1.2
Key: FLINK-22760
URL: https://issues.apache.org/jira/browse/FLINK-22760
Project: Flink
Issue Type: Bug
Rui Li created FLINK-22726:
--
Summary: Hive GROUPING__ID returns different value in older
versions
Key: FLINK-22726
URL: https://issues.apache.org/jira/browse/FLINK-22726
Project: Flink
Issue Type
Rui Li created FLINK-22661:
--
Summary: HiveInputFormatPartitionReader can return invalid data
Key: FLINK-22661
URL: https://issues.apache.org/jira/browse/FLINK-22661
Project: Flink
Issue Type: Bug
Rui Li created FLINK-22657:
--
Summary: HiveParserDDLSemanticAnalyzer can directly return
operations
Key: FLINK-22657
URL: https://issues.apache.org/jira/browse/FLINK-22657
Project: Flink
Issue Type
Rui Li created FLINK-22606:
--
Summary: Simplify the usage of SessionState
Key: FLINK-22606
URL: https://issues.apache.org/jira/browse/FLINK-22606
Project: Flink
Issue Type: Sub-task
>> >> distributed, high-performing, always-available, and accurate data
>> streaming
>> >> applications.
>> >>
>> >> The release is available for download at:
>> >> https://flink.apache.org/downloads.html
>> >>
>> >> Please check out the release blog post for an overview of the
>> >> improvements for this bugfix release:
>> >> https://flink.apache.org/news/2021/05/03/release-1.13.0.html
>> >>
>> >> The full release notes are available in Jira:
>> >>
>> >>
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12349287
>> >>
>> >> We would like to thank all contributors of the Apache Flink community
>> who
>> >> made this release possible!
>> >>
>> >> Regards,
>> >> Guowei & Dawid
>> >>
>> >>
>> >
>> >
>>
>
--
Best regards!
Rui Li
Rui Li created FLINK-22512:
--
Summary: Can't call current_timestamp with hive dialect for
hive-3.1
Key: FLINK-22512
URL: https://issues.apache.org/jira/browse/FLINK-22512
Project: Flink
Issue Type
convert the file type to textfile type to run. But orc throw this exception.
>
> Or I missing any dependency on the flink lib? Or class file conflict?
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
--
Best regards!
Rui Li
an even be updated after 1.13 is released.
> So we don't need to cancel the RC for this.
>
> Best,
> Jark
>
> [1]:
>
> https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/connectors/table/hive/overview/
>
> On Sun, 25 Apr 2021 at 13:47, Rui Li wrote:
>
>
Rui Li created FLINK-22446:
--
Summary: Relocate dependencies in hive connector uber jar
Key: FLINK-22446
URL: https://issues.apache.org/jira/browse/FLINK-22446
Project: Flink
Issue Type: Task
> [4]
> https://repository.apache.org/content/repositories/orgapacheflink-1420/
> [5] https://github.com/apache/flink/tree/release-1.13.0-rc2
> [6] https://github.com/apache/flink-web/pull/436
>
--
Best regards!
Rui Li
Thanks everyone! Looking forward to making more contributions~
On Thu, Apr 22, 2021 at 6:23 PM Shengkai Fang wrote:
> Congratulations Rui! =-=
>
> Best,
> Shengkai
>
> Leonard Xu 于2021年4月22日周四 下午3:09写道：
>
> > Congratulations Rui Li !
> >
> > Best,
&
Rui Li created FLINK-22402:
--
Summary: Add hive dialect test in sql-client
Key: FLINK-22402
URL: https://issues.apache.org/jira/browse/FLINK-22402
Project: Flink
Issue Type: Sub-task
Rui Li created FLINK-22383:
--
Summary: HiveParser may fail to call Flink functions
Key: FLINK-22383
URL: https://issues.apache.org/jira/browse/FLINK-22383
Project: Flink
Issue Type: Sub-task
Rui Li created FLINK-22341:
--
Summary: Describe table doesn't work with hive dialect
Key: FLINK-22341
URL: https://issues.apache.org/jira/browse/FLINK-22341
Project: Flink
Issue Type: Bug
> >>>> StreamExecutionEnvironment bsEnv =
> >>>> StreamExecutionEnvironment.getExecutionEnvironment();
> >>>> bsEnv.enableCheckpointing(1);
> >>>> StreamTableEnvironment tEnv = StreamTableEnvironment.create(bsEnv);
> >>>> DataStream dataStream = bsEnv.addSource(new MySource())
> >>>>
> >>>> //构造hive catalog
> >>>> String name = "myhive";
> >>>> String defaultDatabase = "default";
> >>>> String hiveConfDir = "/Users/user/work/hive/conf"; // a local path
> >>>> String version = "3.1.2";
> >>>>
> >>>> HiveCatalog hive = new HiveCatalog(name, defaultDatabase, hiveConfDir,
> >>>> version);
> >>>> tEnv.registerCatalog("myhive", hive);
> >>>> tEnv.useCatalog("myhive");
> >>>> tEnv.getConfig().setSqlDialect(SqlDialect.HIVE);
> >>>> tEnv.useDatabase("db1");
> >>>>
> >>>> tEnv.createTemporaryView("users", dataStream);
> >>>>
> >>>> String hiveSql = "CREATE external TABLE fs_table (\n" +
> >>>> " user_id STRING,\n" +
> >>>> " order_amount DOUBLE" +
> >>>> ") partitioned by (dt string,h string,m string) " +
> >>>> "stored as ORC " +
> >>>> "TBLPROPERTIES (\n" +
> >>>> " 'partition.time-extractor.timestamp-pattern'='$dt $h:$m:00',\n" +
> >>>> " 'sink.partition-commit.delay'='0s',\n" +
> >>>> " 'sink.partition-commit.trigger'='partition-time',\n" +
> >>>> " 'sink.partition-commit.policy.kind'='metastore'" +
> >>>> ")";
> >>>> tEnv.executeSql(hiveSql);
> >>>>
> >>>> String insertSql = "SELECT * FROM users";
> >>>> tEnv.executeSql(insertSql);
> >>>> ```
> >>>>
> >>>> And this is my flink configuration：
> >>>> ```
> >>>> jobmanager.memory.process.size: 1600m
> >>>> taskmanager.memory.process.size 4096m
> >>>> taskmanager.numberOfTaskSlots: 1
> >>>> parallelism.default: 1
> >>>> ```
> >>>>
> >>>> And the exception is: java.util.concurrent.completionException:
> >>>> org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailable and
> >>>> request to ResourceManager for new slot failed.
> >>>>
> >>>> According the exception message, it means the resource is in
> sufficient,
> >>>> but the hadoop resource is enough, memory is 300+g, cores is 72, and
> the
> >>>> usage rate is lower about 30%.
> >>>>
> >>>> I have tried increase the taskmanager slot at flink run command with
> >>>> `flink run -ys`, but it is not effective.
> >>>>
> >>>> Here is the environment:
> >>>> flink version: 1.12.0
> >>>> java: 1.8
> >>>>
> >>>> Please check what’s the problem is, really appreciate it. Thanks.
>
>
--
Best regards!
Rui Li
Rui Li created FLINK-22170:
--
Summary: Manual test for hive dialect
Key: FLINK-22170
URL: https://issues.apache.org/jira/browse/FLINK-22170
Project: Flink
Issue Type: Sub-task
Components
Rui Li created FLINK-22119:
--
Summary: Update document for hive dialect
Key: FLINK-22119
URL: https://issues.apache.org/jira/browse/FLINK-22119
Project: Flink
Issue Type: Sub-task
Rui Li created FLINK-22107:
--
Summary: Include antlr into hive connector uber jars
Key: FLINK-22107
URL: https://issues.apache.org/jira/browse/FLINK-22107
Project: Flink
Issue Type: Sub-task
Rui Li created FLINK-22102:
--
Summary: Throw meaningful exceptions for features we don't support
Key: FLINK-22102
URL: https://issues.apache.org/jira/browse/FLINK-22102
Project: Flink
Issue Type
Rui Li created FLINK-22092:
--
Summary: Prevent HiveCatalog from reading hive-site in classpath
Key: FLINK-22092
URL: https://issues.apache.org/jira/browse/FLINK-22092
Project: Flink
Issue Type: Bug
Rui Li created FLINK-21998:
--
Summary: Copy more code from hive and move them to a dedicated
package
Key: FLINK-21998
URL: https://issues.apache.org/jira/browse/FLINK-21998
Project: Flink
Issue
Rui Li created FLINK-21888:
--
Summary: Maintain our own ASTNode class
Key: FLINK-21888
URL: https://issues.apache.org/jira/browse/FLINK-21888
Project: Flink
Issue Type: Sub-task
Components
Rui Li created FLINK-21808:
--
Summary: Support DQL in HiveParser
Key: FLINK-21808
URL: https://issues.apache.org/jira/browse/FLINK-21808
Project: Flink
Issue Type: Sub-task
Components
Rui Li created FLINK-21727:
--
Summary: Support DDL in HiveParser
Key: FLINK-21727
URL: https://issues.apache.org/jira/browse/FLINK-21727
Project: Flink
Issue Type: Sub-task
Components
Rui Li created FLINK-21656:
--
Summary: Add antlr parser for hive dialect
Key: FLINK-21656
URL: https://issues.apache.org/jira/browse/FLINK-21656
Project: Flink
Issue Type: Sub-task
Rui Li created FLINK-21637:
--
Summary: Wrong results when filtering by timestamp type
Key: FLINK-21637
URL: https://issues.apache.org/jira/browse/FLINK-21637
Project: Flink
Issue Type: Bug
Rui Li created FLINK-21592:
--
Summary: RemoveSingleAggregateRule fails due to nullability
mismatch
Key: FLINK-21592
URL: https://issues.apache.org/jira/browse/FLINK-21592
Project: Flink
Issue Type
Rui Li created FLINK-21590:
--
Summary: Avoid hive logs in the SQL client console
Key: FLINK-21590
URL: https://issues.apache.org/jira/browse/FLINK-21590
Project: Flink
Issue Type: Improvement
21 at 10:30, Leonard Xu wrote:
> >
> > > +1 (non-binding)
> > >
> > > The updated FLIP looks well.
> > >
> > > Best,
> > > Leonard
> > >
> > >
> > > > 在 2021年3月2日，22:27，Shengkai Fang 写道：
> > > >
> > > > already updated the FLIP[2]. It seems the vote has lasted for a long
> > > time.
> > >
> > >
> >
>
--
Best regards!
Rui Li
Rui Li created FLINK-21531:
--
Summary: Introduce pluggable Parser
Key: FLINK-21531
URL: https://issues.apache.org/jira/browse/FLINK-21531
Project: Flink
Issue Type: Sub-task
Components
Rui Li created FLINK-21529:
--
Summary: FLIP-152: Hive Query Syntax Compatibility
Key: FLINK-21529
URL: https://issues.apache.org/jira/browse/FLINK-21529
Project: Flink
Issue Type: New Feature
; > > > > UDAF support (FLIP-137), Python UDTF support (FLINK-14500),
> row-based
> > > > > Operations support in Python Table API (FLINK-20479), etc. He is
> also
> > > > > actively helping on answering questions in the user mailing list,
> > > helping
> > > > > on the release check, monitoring the status of the azure pipeline,
> > etc.
> > > > >
> > > > > Please join me in congratulating Wei Zhong and Xingbo Huang for
> > > becoming
> > > > > Flink committers!
> > > > >
> > > > > Regards,
> > > > > Dian
> > > >
> > >
> >
>
--
Best regards!
Rui Li
;
> >> The vote will be open for 72 hours, until Feb. 25 2021 12:00 AM UTC+8,
> >> unless there's an objection.
> >>
> >> Best,
> >> Shengkai
> >>
> >
>
>
--
Best regards!
Rui Li
> > +1
> > >
> > > Best,
> > > Kurt
> > >
> > >
> > > On Sun, Feb 7, 2021 at 7:24 PM Rui Li wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > I think we have reached some consensus on
vid Heise <
> > >> ar...@apache.org>
> > >>>>>>>> wrote:
> > >>>>>>>>>>>>> Congrats! Well deserved.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> On Wed, Feb 10, 2021 at 1:54 PM Yun Gao
> > >>>>>>>> > >>>>>>>>>>>
> > >>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Congratulations Roman!
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Best,
> > >>>>>>>>>>>>>> Yun
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> --Original Mail --
> > >>>>>>>>>>>>>> Sender:Till Rohrmann
> > >>>>>>>>>>>>>> Send Date:Wed Feb 10 20:53:21 2021
> > >>>>>>>>>>>>>> Recipients:dev
> > >>>>>>>>>>>>>> CC:Khachatryan Roman , Roman
> > >>>>>>>>>> Khachatryan
> > >>>>>>>>>>>> <
> > >>>>>>>>>>>>>> ro...@apache.org>
> > >>>>>>>>>>>>>> Subject:Re: [ANNOUNCE] Welcome Roman Khachatryan a new
> > >> Apache
> > >>>>>>> Flink
> > >>>>>>>>>>>>>> Committer
> > >>>>>>>>>>>>>> Congratulations Roman :-)
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Cheers,
> > >>>>>>>>>>>>>> Till
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> On Wed, Feb 10, 2021 at 1:01 PM Konstantin Knauf <
> > >>>>>>>> kna...@apache.org>
> > >>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Congratulations Roman!
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> On Wed, Feb 10, 2021 at 11:29 AM Piotr Nowojski <
> > >>>>>>>>>>>> pnowoj...@apache.org>
> > >>>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Hi everyone,
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> I'm very happy to announce that Roman Khachatryan has
> > >>>> accepted
> > >>>>>>>> the
> > >>>>>>>>>>>>>>>> invitation to
> > >>>>>>>>>>>>>>>> become a Flink committer.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Roman has been recently active in the runtime parts of
> > >> the
> > >>>>>>> Flink.
> > >>>>>>>>>>>> He is
> > >>>>>>>>>>>>>>> one
> > >>>>>>>>>>>>>>>> of the main developers behind FLIP-76 Unaligned
> > >>> Checkpoints,
> > >>>>>>>>>>>> FLIP-151
> > >>>>>>>>>>>>>>>> Incremental Heap/FS State Backend [3] and providing a
> > >>> faster
> > >>>>>>>>>>>>>>> checkpointing
> > >>>>>>>>>>>>>>>> mechanism in FLIP-158.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Please join me in congratulating Roman for becoming a
> > >> Flink
> > >>>>>>>>>>>> committer!
> > >>>>>>>>>>>>>>>> Best,
> > >>>>>>>>>>>>>>>> Piotrek
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> [1]
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-76%3A+Unaligned+Checkpoints
> > >>>>>>>>>>>>>>>> [2]
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-151%3A+Incremental+snapshots+for+heap-based+state+backend
> > >>>>>>>>>>>>>>>> [3]
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-158%3A+Generalized+incremental+checkpoints
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> --
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Konstantin Knauf
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> https://twitter.com/snntrable
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> https://github.com/knaufk
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>
> > >>>>>>>
> > >>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>
> >
> >
>
--
Best regards!
Rui Li
> properties in again the schema can be resolved in a later stage.
>
> Regards,
> Timo
>
> On 09.02.21 14:07, Rui Li wrote:
> > Hi Timo,
> >
> > Thanks for the FLIP. It looks good to me overall. I have two questions.
> > 1. When should we use a resolved sche
>>
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-164%3A+Improve+Schema+Handling+in+Catalogs
> >>>
> >>>
> >>> The FLIP updates the class hierarchy to achieve the following goals:
> >>>
> >>> - make it visible whether a schema is resolved or unresolved and when
> >>> the resolution happens
> >>> - offer a unified API for FLIP-129, FLIP-136, and catalogs
> >>> - allow arbitrary data types and expressions in the schema for
> >>> watermark spec or columns
> >>> - have access to other catalogs for declaring a data type or
> >>> expression via CatalogManager
> >>> - a cleaned up TableSchema
> >>> - remain backwards compatible in the persisted properties and API
> >>>
> >>> Looking forward to your feedback.
> >>>
> >>> Thanks,
> >>> Timo
> >>
> >>
> >
>
>
--
Best regards!
Rui Li
dml-sync` `table.multi-stmt-sync`? Or other
> opinions?
> > >>
> > >> Regards,
> > >> Timo
> > >>
> > >> On 09.02.21 08:50, Shengkai Fang wrote:
> > >>> Hi, all.
> > >>>
> > >>> I think it may cause user confused. The main problem is we have no
> > means
> > >>> to detect the conflict configuration, e.g. users set the option true
> > and
> > >>> use `TableResult#await` together.
> > >>>
> > >>> Best,
> > >>> Shengkai.
> > >>>
> > >>
> > >>
> > >
> >
> >
>
--
Best regards!
Rui Li
including `executeSql`, `StatementSet`,
> `Table#executeInsert`, etc.).
> This can also make SQL CLI easy to support this configuration by passing
> through to the TableEnv.
>
> Best,
> Jark
>
> On Tue, 9 Feb 2021 at 10:07, Rui Li wrote:
>
>> Hi,
>>
>> Glad to see
behavior?
On Mon, Feb 8, 2021 at 11:28 PM Jark Wu wrote:
> Ah, I just forgot the option name.
>
> I'm also fine with `table.dml-async`.
>
> What do you think @Rui Li @Shengkai Fang
> ?
>
> Best,
> Jark
>
> On Mon, 8 Feb 2021 at 23:06, Timo Walther wrote:
>
>&
/FLIP-152%3A+Hive+Query+Syntax+Compatibility
[2]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-152-Hive-Query-Syntax-Compatibility-td46928.html
--
Best regards!
Rui Li
;>>>> more inputs:
> > >>>>> We want to introduce sql-gateway into the Flink project (see
> FLIP-24
> > &
> > >>>>> FLIP-91 for more info [1] [2]). In the "gateway" mode, the CLI
> client
> > >>> and
> &
Hi Jingsong, Godfrey and Jark,
I have updated the FLIP to incorporate your suggestions. Please let me know
if you have further comments. Thank you.
On Wed, Feb 3, 2021 at 4:51 PM Rui Li wrote:
> Thanks Godfrey & Jark for your comments!
>
> Since both of you mentioned the naming
r SQL commands such as
> `SHOW
> >>> CATALOGS`, `SHOW TABLES`, etc. [2].
> >>>
> >>> 5) EXPLAIN [ExplainDetail[, ExplainDetail]*]
> >>>
> >>> We should keep the details in sync with
> >>> `org.apache.flink.ta
>>>>> I would like to add the module to the enabled list by default,
> the
> >> > >> main
> >> > >>>>> reasons are:
> >> > >>>>> 1) Reordering is an advanced requirement, adding modules needs
> >> &g
code, and the framework and the code will be very simple.
> >
> > Regarding the "Go Beyond Hive" section, is that the scope of this FLIP ?
> > Could you list all the extensions and give some examples ?
> >
> > One minor suggestion about the name of ParserImplFact
> > > 2. Queries cannot involve tables/views from multiple catalogs.
> > > > I assume this is because hive parser and analyzer doesn't support
> > > > referring to a name with "x.y.z" fashion? Since
> > > > we can control all the behaviors by le
>
> > > > Regarding #3, I'm fine with mapping modules purely by name, and I
> think
> > > > Jark raised a good point on making the module name a simple
> identifier
> > > > instead of a string literal. For backward compatibility,
starting the discussion in the mailing
> list.
>
> Here are my thoughts:
>
> 1) syntax to reorder modules
> I agree with Rui Li it would be quite useful if we can have some syntax to
> reorder modules.
> I slightly prefer `USE MODULES x, y, z` than `RELOAD MODULES x, y, z`,
> becaus
one in the batch mode. Users can set
> this option false and the client will process the next job until the
> current job finishes. The default value of this option is false, which
> means the client will execute the next job when the current job is
> submitted.
>
> Best,
> Shengkai
; to analyze the data. Users should use queries in the interactive mode.
>
> Best,
> Shengkai
>
> Rui Li 于2021年1月29日周五 下午3:18写道：
>
>> Thanks Shengkai for bringing up this discussion. I think it covers a lot
>> of useful features which will dramatically improve the us
refer to FLIP-163[1].
> >
> > Look forward to your feedback.
> >
> >
> > Best,
> > Shengkai
> >
> > [1]
> >
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-163%3A+SQL+Client+Improvements
> >
>
>
> --
>
> *With kind regards
>
> Sebastian Liu 刘洋
> Institute of Computing Technology, Chinese Academy of Science
> Mobile\WeChat: +86—15201613655
> E-mail: liuyang0...@gmail.com
> QQ: 3239559*
>
--
Best regards!
Rui Li
Rui Li created FLINK-21185:
--
Summary: Introduce a new interface for catalog to listen on
temporary object operations
Key: FLINK-21185
URL: https://issues.apache.org/jira/browse/FLINK-21185
Project: Flink
Rui Li created FLINK-21184:
--
Summary: Support temporary table/function for hive connector
Key: FLINK-21184
URL: https://issues.apache.org/jira/browse/FLINK-21184
Project: Flink
Issue Type: New
r
> > > could be placed in connector related code, so reflection is not needed
> and
> > > is more extendable.
> > >
> > >
> > >
> > > Both options have to handle how to specify the HiveConf to use. In Hive
> > > connector, user could specify both hiveConfDir and hadoopConfDir when
> > > creating HiveCatalog. The hadoopConfDir may not the same as the Hadoop
> > > configuration in HadoopModule.
> > >
> > > Looking forward to your suggestions.
> > >
> > > --
> > > Best regards!
> > > Jie Wang
> > >
> > >
> >
>
--
Best regards!
Rui Li
Rui Li created FLINK-21083:
--
Summary: Streaming write partitioned table needs to handle null
partition value
Key: FLINK-21083
URL: https://issues.apache.org/jira/browse/FLINK-21083
Project: Flink
gt;>
>>
>> Both options have to handle how to specify the HiveConf to use. In Hive
>> connector, user could specify both hiveConfDir and hadoopConfDir when
>> creating HiveCatalog. The hadoopConfDir may not the same as the Hadoop
>> configuration in HadoopModule.
>>
>> Looking forward to your suggestions.
>>
>> --
>> Best regards!
>> Jie Wang
>>
>>
--
Best regards!
Rui Li
Rui Li created FLINK-20920:
--
Summary: Document how to connect to kerberized HMS
Key: FLINK-20920
URL: https://issues.apache.org/jira/browse/FLINK-20920
Project: Flink
Issue Type: Task
to make sure temp table/function is processed by
the TableFactory/FunctionDefinitionFactory associated with the catalog.
Looking forward to your suggestions.
--
Best regards!
Rui Li
Rui Li created FLINK-20844:
--
Summary: Support add jar in SQL client
Key: FLINK-20844
URL: https://issues.apache.org/jira/browse/FLINK-20844
Project: Flink
Issue Type: New Feature
Rui Li created FLINK-20822:
--
Summary: Don't check whether a function is generic in hive catalog
Key: FLINK-20822
URL: https://issues.apache.org/jira/browse/FLINK-20822
Project: Flink
Issue Type
Rui Li created FLINK-20813:
--
Summary: SQL Client should create modules with user class loader
Key: FLINK-20813
URL: https://issues.apache.org/jira/browse/FLINK-20813
Project: Flink
Issue Type: Bug
Rui Li created FLINK-20765:
--
Summary: ScalarOperatorGens doesn't set proper nullability for
result type of generated expressions
Key: FLINK-20765
URL: https://issues.apache.org/jira/browse/FLINK-20765
Rui Li created FLINK-20761:
--
Summary: Cannot read hive table/partition whose location path
contains comma
Key: FLINK-20761
URL: https://issues.apache.org/jira/browse/FLINK-20761
Project: Flink
Rui Li created FLINK-20722:
--
Summary: Fail to insert into hive table due to ClassCastException
Key: FLINK-20722
URL: https://issues.apache.org/jira/browse/FLINK-20722
Project: Flink
Issue Type: Bug
Rui Li created FLINK-20680:
--
Summary: Fails to call var-arg function with no parameters
Key: FLINK-20680
URL: https://issues.apache.org/jira/browse/FLINK-20680
Project: Flink
Issue Type: Bug
Rui Li created FLINK-20667:
--
Summary: Configurable batch size for vectorized reader
Key: FLINK-20667
URL: https://issues.apache.org/jira/browse/FLINK-20667
Project: Flink
Issue Type: Improvement
Rui Li created FLINK-20572:
--
Summary: HiveCatalog should be a standalone module
Key: FLINK-20572
URL: https://issues.apache.org/jira/browse/FLINK-20572
Project: Flink
Issue Type: Improvement
l
> >>>
> >>> Please check out the release blog post for an overview of the
> improvements
> >>> for this bugfix release:
> >>> https://flink.apache.org/news/2020/12/10/release-1.12.0.html
> >>>
> >>> The full release notes are available in Jira:
> >>>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12348263
> >>>
> >>> We would like to thank all contributors of the Apache Flink community
> who
> >>> made this release possible!
> >>>
> >>> Regards,
> >>> Dian & Robert
> >>
> >
>
--
Best regards!
Rui Li
, fully use hive's dialect including
> > query part. The kafka table could be a temporary table or saved in
> default
> > memory catalog.
> >
> >
> > [1] http://apache-flink.147419.n8.nabble.com/calcite-td9059.html#a9118
> > [2]
> http://apache-flink.14741
Rui Li created FLINK-20563:
--
Summary: Support built-in functions for Hive versions prior to
1.2.0
Key: FLINK-20563
URL: https://issues.apache.org/jira/browse/FLINK-20563
Project: Flink
Issue Type
aved in default
> memory catalog.
>
>
> [1] http://apache-flink.147419.n8.nabble.com/calcite-td9059.html#a9118
> [2] http://apache-flink.147419.n8.nabble.com/hive-sql-flink-11-td9116.html
> [3]
>
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-to-i
Rui Li created FLINK-20549:
--
Summary: New ExecutionContext doesn't inherit classloader from
previous context
Key: FLINK-20549
URL: https://issues.apache.org/jira/browse/FLINK-20549
Project: Flink
Rui Li created FLINK-20537:
--
Summary: Failed to call Hive UDF with string literal arguments
Key: FLINK-20537
URL: https://issues.apache.org/jira/browse/FLINK-20537
Project: Flink
Issue Type: Bug
Rui Li created FLINK-20486:
--
Summary: Hive temporal join shouldn't require a minimal 1h monitor
interval
Key: FLINK-20486
URL: https://issues.apache.org/jira/browse/FLINK-20486
Project: Flink
>
> > >> The vote will be open for at least 72 hours. It is adopted by majority
> > >> approval, with at least 3 PMC affirmative votes.
> > >>
> > >> Thanks,
> > >> Dian & Robert
> > >>
> > >> [1a]
> > >>
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12348263
> > >> [1b] https://github.com/apache/flink/pull/14195
> > >> [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.12.0-rc3/
> > >> [3] https://dist.apache.org/repos/dist/release/flink/KEYS
> > >> [4]
> > >>
> https://repository.apache.org/content/repositories/orgapacheflink-1404
> > >> [5] https://github.com/apache/flink/releases/tag/release-1.12.0-rc3
> > >>
> > >>
> >
>
--
Best regards!
Rui Li
it even
easier for users to migrate to Flink. More details are in the FLIP wiki
page [1]. Looking forward to your feedback!
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-152%3A+Hive+Query+Syntax+Compatibility
--
Best regards!
Rui Li
Rui Li created FLINK-20448:
--
Summary: Obsolete generated avro classes
Key: FLINK-20448
URL: https://issues.apache.org/jira/browse/FLINK-20448
Project: Flink
Issue Type: Test
Components
Rui Li created FLINK-20419:
--
Summary: Insert fails due to failure to generate execution plan
Key: FLINK-20419
URL: https://issues.apache.org/jira/browse/FLINK-20419
Project: Flink
Issue Type: Bug
Rui Li created FLINK-20349:
--
Summary: Query fails with "A conflict is detected. This is
unexpected."
Key: FLINK-20349
URL: https://issues.apache.org/jira/browse/FLINK-20349
Project: Flink
rge number of bash e2e tests that are just
> >>>> parameterized
> >>>>> differently. If we would start migrating them to Java, we could move
> a
> >>>>> larger proportion of tests over to the new Java framework, and tackle
> >>> the
> >>>>> more involved bash tests later (kerberized yarn, kubernetes, ...).
> >>>>>
> >>>>> Let me know what you think!
> >>>>>
> >>>>> Best,
> >>>>> Robert
> >>>>>
> >>>>>
> >>>>> PS: If you are wondering why I'm bringing this up now: I'm spending
> >>>> quite a
> >>>>> lot of time trying to figure out really hard to debug issues with our
> >>>> bash
> >>>>> testing infra.
> >>>>> Also, it is very difficult to introduce something generic for all
> tests
> >>>>> (such as a test-timeout, using docker as the preferred deployment
> >>> method
> >>>>> etc.) since the tests often don't share common tooling.
> >>>>> Speaking about tooling: there are a lot of utilities everywhere,
> >>>> sometimes
> >>>>> duplicated, with different features / stability etc.
> >>>>> I believe bash is not the right tool for a project this size (in
> terms
> >>> of
> >>>>> developers and lines of code)
> >>>>>
> >>>>
> >>>
> >
>
>
--
Best regards!
Rui Li
Rui Li created FLINK-20062:
--
Summary: ContinuousHiveSplitEnumerator should be lock-free
Key: FLINK-20062
URL: https://issues.apache.org/jira/browse/FLINK-20062
Project: Flink
Issue Type: Sub-task
1 - 100 of 298 matches
Mail list logo
