Rui Li created FLINK-16740:
--
Summary: OrcSplitReaderUtil::logicalTypeToOrcType fails to create
decimal type with precision < 10
Key: FLINK-16740
URL: https://issues.apache.org/jira/browse/FLINK-16
Rui Li created FLINK-16732:
--
Summary: Failed to call Hive UDF with constant return value
Key: FLINK-16732
URL: https://issues.apache.org/jira/browse/FLINK-16732
Project: Flink
Issue Type: Bug
Rui Li created FLINK-16682:
--
Summary: Make batch size configurable for orc reader
Key: FLINK-16682
URL: https://issues.apache.org/jira/browse/FLINK-16682
Project: Flink
Issue Type: Task
Rui Li created FLINK-16652:
--
Summary: Hive 3.1.1 test is broken
Key: FLINK-16652
URL: https://issues.apache.org/jira/browse/FLINK-16652
Project: Flink
Issue Type: Test
Components
Rui Li created FLINK-16647:
--
Summary: Miss file extension when inserting to hive table with
compression
Key: FLINK-16647
URL: https://issues.apache.org/jira/browse/FLINK-16647
Project: Flink
Issue
Rui Li created FLINK-16618:
--
Summary: Cannot use Hive GenericUDFBaseNumeric with Flink
Key: FLINK-16618
URL: https://issues.apache.org/jira/browse/FLINK-16618
Project: Flink
Issue Type: Bug
Rui Li created FLINK-16568:
--
Summary: Cannot call Hive UDAF that requires constant arguments
Key: FLINK-16568
URL: https://issues.apache.org/jira/browse/FLINK-16568
Project: Flink
Issue Type: Bug
Rui Li created FLINK-16559:
--
Summary: Cannot create Hive avro table in test
Key: FLINK-16559
URL: https://issues.apache.org/jira/browse/FLINK-16559
Project: Flink
Issue Type: Bug
Rui Li created FLINK-16532:
--
Summary: Cannot insert white space characters as partition value
for Hive table
Key: FLINK-16532
URL: https://issues.apache.org/jira/browse/FLINK-16532
Project: Flink
Rui Li created FLINK-16452:
--
Summary: Insert into static partition doesn't support order by or
limit
Key: FLINK-16452
URL: https://issues.apache.org/jira/browse/FLINK-16452
Project: Flink
Rui Li created FLINK-16433:
--
Summary: TableEnvironment doesn't clear buffered operations when
it fails to translate the operation
Key: FLINK-16433
URL: https://issues.apache.org/jira/browse/FLINK-
Rui Li created FLINK-16412:
--
Summary: Disallow embedded metastore in HiveCatalog production code
Key: FLINK-16412
URL: https://issues.apache.org/jira/browse/FLINK-16412
Project: Flink
Issue Type
Rui Li created FLINK-16291:
--
Summary: Count(*) doesn't work with Hive module
Key: FLINK-16291
URL: https://issues.apache.org/jira/browse/FLINK-16291
Project: Flink
Issue Type
Rui Li created FLINK-16275:
--
Summary: AggsHandlerCodeGenerator can fail with custom module
Key: FLINK-16275
URL: https://issues.apache.org/jira/browse/FLINK-16275
Project: Flink
Issue Type: Bug
Rui Li created FLINK-16268:
--
Summary: Failed to run rank over window with Hive built-in
functions
Key: FLINK-16268
URL: https://issues.apache.org/jira/browse/FLINK-16268
Project: Flink
Issue Type
Rui Li created FLINK-16197:
--
Summary: Failed to query partitioned table when partition folder
is removed
Key: FLINK-16197
URL: https://issues.apache.org/jira/browse/FLINK-16197
Project: Flink
Rui Li created FLINK-16196:
--
Summary: FlinkStandaloneHiveRunner leaks HMS process
Key: FLINK-16196
URL: https://issues.apache.org/jira/browse/FLINK-16196
Project: Flink
Issue Type: Test
very
> active in both dev
> and user mailing lists, helped discussing designs and answering users
> questions, also
> helped to verify various releases.
>
> Congratulations Jingsong!
>
> Best, Kurt
> (on behalf of the Flink PMC)
>
>
>
--
Best regards!
Rui Li
Rui Li created FLINK-16120:
--
Summary: Update the hive section of the connectors doc
Key: FLINK-16120
URL: https://issues.apache.org/jira/browse/FLINK-16120
Project: Flink
Issue Type: Task
Rui Li created FLINK-16055:
--
Summary: Avoid catalog functions when listing Hive built-in
functions
Key: FLINK-16055
URL: https://issues.apache.org/jira/browse/FLINK-16055
Project: Flink
Issue Type
Rui Li created FLINK-15965:
--
Summary: DATE literal issue in static partition spec
Key: FLINK-15965
URL: https://issues.apache.org/jira/browse/FLINK-15965
Project: Flink
Issue Type: Bug
gt; > >> >> * all artifacts to be deployed to the Maven Central Repository [4],
> > >> >> * source code tag "release-1.10.0-rc3" [5],
> > >> >> * website pull request listing the new release and adding
> > announcement
> > >> blog
> > >> >> post [6][7].
> > >> >>
> > >> >> The vote will be open for at least 72 hours. It is adopted by
> > majority
> > >> >> approval, with at least 3 PMC affirmative votes.
> > >> >>
> > >> >> Thanks,
> > >> >> Yu & Gary
> > >> >>
> > >> >> [1]
> > >> >>
> > >>
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12345845
> > >> <
> > >>
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12345845
> > >> >
> > >> >> [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.10.0-rc3/
> <
> > >> https://dist.apache.org/repos/dist/dev/flink/flink-1.10.0-rc3/>
> > >> >> [3] https://dist.apache.org/repos/dist/release/flink/KEYS <
> > >> https://dist.apache.org/repos/dist/release/flink/KEYS>
> > >> >> [4]
> > >>
> https://repository.apache.org/content/repositories/orgapacheflink-1333
> > <
> > >>
> https://repository.apache.org/content/repositories/orgapacheflink-1333>
> > >> >> [5]
> https://github.com/apache/flink/releases/tag/release-1.10.0-rc3
> > <
> > >> https://github.com/apache/flink/releases/tag/release-1.10.0-rc3>
> > >> >> [6] https://github.com/apache/flink-web/pull/302 <
> > >> https://github.com/apache/flink-web/pull/302>
> > >> >> [7] https://github.com/apache/flink-web/pull/301 <
> > >> https://github.com/apache/flink-web/pull/301>
> > >> >
> > >>
> > >>
> >
>
--
Best regards!
Rui Li
gt; >>>>> return a List or ConfigOptionGroup that contains the
> >> >>>>> validation logic as mentioned in the validation part of
> FLIP-54[1].
> >> But
> >> >>>>> currently our config options are not rich enough to have a unified
> >> >>>>> validation. Additionally, the factory should return some
> properties
> >> >>>>> such
> >> >>>>> as "supports event-time" for the schema validation outside of the
> >> >>>>> factory itself.
> >> >>>>>
> >> >>>>> Regards,
> >> >>>>> Timo
> >> >>>>>
> >> >>>>> [1]
> >> >>>>>
> >> >>>>>
> >>
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-54%3A+Evolve+ConfigOption+and+Configuration
> >> >>>>>
> >> >>>>>
> >> >>>>>
> >> >>>>> On 16.01.20 00:51, Bowen Li wrote:
> >> >>>>>> Hi Jingsong,
> >> >>>>>>
> >> >>>>>> The 1st and 2nd pain points you described are very valid, as I'm
> >> more
> >> >>>>>> familiar with them. I agree these are shortcomings of the current
> >> >>>>> Flink SQL
> >> >>>>>> design.
> >> >>>>>>
> >> >>>>>> A couple comments on your 1st proposal:
> >> >>>>>>
> >> >>>>>> 1. is it better to have explicit APIs like
> >> >>>>> "createBatchTableSource(...)"
> >> >>>>>> and "createStreamingTableSource(...)" in TableSourceFactory
> (would
> >> be
> >> >>>>>> similar for sink factory) to let planner handle which mode
> >> (streaming
> >> >>>>> vs
> >> >>>>>> batch) of source should be instantiated? That way we don't need
> to
> >> >>>>> always
> >> >>>>>> let connector developers handling an if-else on isStreamingMode.
> >> >>>>>> 2. I'm not sure of the benefits to have a CatalogTableContext
> >> class.
> >> >>>>> The
> >> >>>>>> path, table, and config are fairly independent of each other. So
> >> why
> >> >>>>> not
> >> >>>>>> pass the config in as 3rd parameter as
> `createXxxTableSource(path,
> >> >>>>>> catalogTable, tableConfig)?
> >> >>>>>>
> >> >>>>>>
> >> >>>>>> On Tue, Jan 14, 2020 at 7:03 PM Jingsong Li <
> >> jingsongl...@gmail.com>
> >> >>>>> wrote:
> >> >>>>>>
> >> >>>>>>> Hi dev,
> >> >>>>>>>
> >> >>>>>>> I'd like to kick off a discussion on the improvement of
> >> >>>>> TableSourceFactory
> >> >>>>>>> and TableSinkFactory.
> >> >>>>>>>
> >> >>>>>>> Motivation:
> >> >>>>>>> Now the main needs and problems are:
> >> >>>>>>> 1.Connector can't get TableConfig [1], and some behaviors really
> >> >>>>> need to be
> >> >>>>>>> controlled by the user's table configuration. In the era of
> >> catalog,
> >> >>>>> we
> >> >>>>>>> can't put these config in connector properties, which is too
> >> >>>>> inconvenient.
> >> >>>>>>> 2.Connector can't know if this is batch or stream execution
> mode.
> >> >>>>> But the
> >> >>>>>>> sink implementation of batch and stream is totally different. I
> >> >>>>> understand
> >> >>>>>>> there is an update mode property now, but it splits the batch
> and
> >> >>>>> stream in
> >> >>>>>>> the catalog dimension. In fact, this information can be obtained
> >> >>>>> through
> >> >>>>>>> the current TableEnvironment.
> >> >>>>>>> 3.No interface to call validation. Now our validation is more
> util
> >> >>>>> classes.
> >> >>>>>>> It depends on whether or not the connector calls. Now we have
> some
> >> >>>>> new
> >> >>>>>>> validations to add, such as [2], which is really confuse uses,
> >> even
> >> >>>>>>> developers. Another problem is that our SQL update (DDL) does
> not
> >> >>>>> have
> >> >>>>>>> validation [3]. It is better to report an error when executing
> >> DDL,
> >> >>>>>>> otherwise it will confuse the user.
> >> >>>>>>>
> >> >>>>>>> Proposed change draft for 1 and 2:
> >> >>>>>>>
> >> >>>>>>> interface CatalogTableContext {
> >> >>>>>>> ObjectPath getTablePath();
> >> >>>>>>> CatalogTable getTable();
> >> >>>>>>> ReadableConfig getTableConfig();
> >> >>>>>>> boolean isStreamingMode();
> >> >>>>>>> }
> >> >>>>>>>
> >> >>>>>>> public interface TableSourceFactory extends TableFactory {
> >> >>>>>>>
> >> >>>>>>> default TableSource
> createTableSource(CatalogTableContext
> >> >>>>> context) {
> >> >>>>>>> return createTableSource(context.getTablePath(),
> >> >>>>> context.getTable());
> >> >>>>>>> }
> >> >>>>>>>
> >> >>>>>>> ..
> >> >>>>>>> }
> >> >>>>>>>
> >> >>>>>>> Proposed change draft for 3:
> >> >>>>>>>
> >> >>>>>>> public interface TableFactory {
> >> >>>>>>>
> >> >>>>>>> TableValidators validators();
> >> >>>>>>>
> >> >>>>>>> interface TableValidators {
> >> >>>>>>> ConnectorDescriptorValidator connectorValidator();
> >> >>>>>>> TableSchemaValidator schemaValidator();
> >> >>>>>>> FormatDescriptorValidator formatValidator();
> >> >>>>>>> }
> >> >>>>>>> }
> >> >>>>>>>
> >> >>>>>>> What do you think?
> >> >>>>>>>
> >> >>>>>>> [1] https://issues.apache.org/jira/browse/FLINK-15290
> >> >>>>>>> [2]
> >> >>>>>>>
> >> >>>>>>>
> >> >>>>>
> >>
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-A-mechanism-to-validate-the-precision-of-columns-for-connectors-td36552.html#a36556
> >> >>>>>>> [3] https://issues.apache.org/jira/browse/FLINK-15509
> >> >>>>>>>
> >> >>>>>>> Best,
> >> >>>>>>> Jingsong Lee
> >> >>>>>>>
> >> >>>>>>
> >> >>>>>
> >> >>>>>
> >> >>>>
> >> >>>> --
> >> >>>> Best, Jingsong Lee
> >> >>>>
> >> >>>
> >> >>>
> >> >>> --
> >> >>> Best, Jingsong Lee
> >> >>>
> >> >>
> >> >>
> >> >> --
> >> >> Best, Jingsong Lee
> >> >>
> >> >
> >> >
> >>
> >>
> >
> > --
> > Best, Jingsong Lee
> >
>
>
> --
> Best, Jingsong Lee
>
--
Best regards!
Rui Li
t available on every machine. We need to upload so
> many jars.
> - A separate classloader maybe hard to work too, our flink-connector-hive
> need hive jars, we may need to deal with flink-connector-hive jar spacial
> too.
> CC: Rui Li
>
> I think the best system to integrate with
Rui Li created FLINK-15901:
--
Summary: Support partitioned generic table in HiveCatalog
Key: FLINK-15901
URL: https://issues.apache.org/jira/browse/FLINK-15901
Project: Flink
Issue Type: Task
the release.
>
> Please join in me congratulating Dian for becoming a Flink committer !
>
> Best,
> Jincheng(on behalf of the Flink PMC)
>
--
Best regards!
Rui Li
Rui Li created FLINK-15547:
--
Summary: Support access to Hive avro table
Key: FLINK-15547
URL: https://issues.apache.org/jira/browse/FLINK-15547
Project: Flink
Issue Type: Task
Components
Rui Li created FLINK-15546:
--
Summary: Obscure error message in ScalarOperatorGens::generateCast
Key: FLINK-15546
URL: https://issues.apache.org/jira/browse/FLINK-15546
Project: Flink
Issue Type
Rui Li created FLINK-15539:
--
Summary: Allow user to choose planner for scala shell
Key: FLINK-15539
URL: https://issues.apache.org/jira/browse/FLINK-15539
Project: Flink
Issue Type: Improvement
Rui Li created FLINK-15533:
--
Summary: Writing DataStream as text file fails due to output path
already exists
Key: FLINK-15533
URL: https://issues.apache.org/jira/browse/FLINK-15533
Project: Flink
Rui Li created FLINK-15515:
--
Summary: Document that Hive connector should be used with blink
planner
Key: FLINK-15515
URL: https://issues.apache.org/jira/browse/FLINK-15515
Project: Flink
Issue
Rui Li created FLINK-15482:
--
Summary: Hive functions should use TypeInfoDataTypeConverter to
convert data type to type info
Key: FLINK-15482
URL: https://issues.apache.org/jira/browse/FLINK-15482
Project
t;>>>>> >> to blink planner manually when every time start a SQL CLI. And
>>>>>>>> it's
>>>>>>>> >> surprising to see unsupported
>>>>>>>> >> exception if they trying out the new features but not switch
>>>>>>>> planner.
>>>>>>>> >>
>>>>>>>> >> SQL CLI is a very important entrypoint for trying out new
>>>>>>>> feautures and
>>>>>>>> >> prototyping for users.
>>>>>>>> >> In order to give new planner more exposures, I would like to
>>>>>>>> suggest to set
>>>>>>>> >> default planner
>>>>>>>> >> for SQL Client to Blink planner before 1.10 release.
>>>>>>>> >>
>>>>>>>> >> The approach is just changing the default SQL CLI yaml
>>>>>>>> configuration[5]. In
>>>>>>>> >> this way, the existing
>>>>>>>> >> environment is still compatible and unaffected.
>>>>>>>> >>
>>>>>>>> >> Changing the default planner for the whole Table API & SQL is
>>>>>>>> another topic
>>>>>>>> >> and is out of scope of this discussion.
>>>>>>>> >>
>>>>>>>> >> What do you think?
>>>>>>>> >>
>>>>>>>> >> Best,
>>>>>>>> >> Jark
>>>>>>>> >>
>>>>>>>> >> [1]:
>>>>>>>> >>
>>>>>>>> https://ci.apache.org/projects/flink/flink-docs-master/dev/table/streaming/joins.html#join-with-a-temporal-table
>>>>>>>> >> [2]:
>>>>>>>> >>
>>>>>>>> https://ci.apache.org/projects/flink/flink-docs-master/dev/table/sql/queries.html#top-n
>>>>>>>> >> [3]:
>>>>>>>> >>
>>>>>>>> https://ci.apache.org/projects/flink/flink-docs-master/dev/table/sql/queries.html#deduplication
>>>>>>>> >> [4]:
>>>>>>>> >>
>>>>>>>> https://ci.apache.org/projects/flink/flink-docs-master/dev/table/tuning/streaming_aggregation_optimization.html
>>>>>>>> >> [5]:
>>>>>>>> >>
>>>>>>>> https://github.com/apache/flink/blob/master/flink-table/flink-sql-client/conf/sql-client-defaults.yaml#L100
>>>>>>>> >
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Best, Jingsong Lee
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Best Regards
>>>>>>
>>>>>> Jeff Zhang
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Benoît Paris
>>>>> Ingénieur Machine Learning Explicable
>>>>> Tél : +33 6 60 74 23 00
>>>>> http://benoit.paris
>>>>> http://explicable.ml
>>>>>
>>>>
>>
>> --
>>
>> Benchao Li
>> School of Electronics Engineering and Computer Science, Peking University
>> Tel:+86-15650713730
>> Email: libenc...@gmail.com; libenc...@pku.edu.cn
>>
>>
--
Best regards!
Rui Li
Rui Li created FLINK-15468:
--
Summary: INSERT OVERWRITE not supported from SQL CLI
Key: FLINK-15468
URL: https://issues.apache.org/jira/browse/FLINK-15468
Project: Flink
Issue Type: Bug
Rui Li created FLINK-15464:
--
Summary: HiveTableSourceTest::testPartitionFilterDateTimestamp
fails with Hive 1.x
Key: FLINK-15464
URL: https://issues.apache.org/jira/browse/FLINK-15464
Project: Flink
Rui Li created FLINK-15453:
--
Summary: Remove unneeded HiveShim methods
Key: FLINK-15453
URL: https://issues.apache.org/jira/browse/FLINK-15453
Project: Flink
Issue Type: Task
Components
Rui Li created FLINK-15391:
--
Summary: DATE and TIMESTAMP partition columns don't work
Key: FLINK-15391
URL: https://issues.apache.org/jira/browse/FLINK-15391
Project: Flink
Issue Type
Rui Li created FLINK-15342:
--
Summary: Verify querying Hive view
Key: FLINK-15342
URL: https://issues.apache.org/jira/browse/FLINK-15342
Project: Flink
Issue Type: Test
Components
Rui Li created FLINK-15322:
--
Summary: Parquet test fails with Hive versions prior to 1.2.0
Key: FLINK-15322
URL: https://issues.apache.org/jira/browse/FLINK-15322
Project: Flink
Issue Type: Test
Rui Li created FLINK-15290:
--
Summary: Need a way to turn off vectorized orc reader for SQL CLI
Key: FLINK-15290
URL: https://issues.apache.org/jira/browse/FLINK-15290
Project: Flink
Issue Type: Bug
Rui Li created FLINK-15287:
--
Summary: Vectorized orc reader fails with Hive 2.0.1
Key: FLINK-15287
URL: https://issues.apache.org/jira/browse/FLINK-15287
Project: Flink
Issue Type: Bug
Rui Li created FLINK-15245:
--
Summary: Flink running in one cluster cannot write data to Hive
tables in another cluster
Key: FLINK-15245
URL: https://issues.apache.org/jira/browse/FLINK-15245
Project: Flink
Rui Li created FLINK-15239:
--
Summary: TM Metaspace memory leak
Key: FLINK-15239
URL: https://issues.apache.org/jira/browse/FLINK-15239
Project: Flink
Issue Type: Bug
Components: Table SQL
t;
> > >>>> So I’m
> > >>>>
> > >>>> +1 to remove the hive dialect limitations for INSERT OVERWRITE and
> > >> INSERT
> > >>>> PARTITION
> > >>>> +0 to add yaml dialect conf to SQL-CLI because FLIP-89 is not
> finished
> > >>>> yet, we better do this until FLIP-89 is resolved.
> > >>>>
> > >>>> Best,
> > >>>> Danny Chan
> > >>>> 在 2019年12月11日 +0800 PM5:29,Jingsong Li ,写道:
> > >>>>> Hi Dev,
> > >>>>>
> > >>>>> After cutting out the branch of 1.10, I tried the following
> functions
> > >>> of
> > >>>>> SQL-CLI and found that it does not support:
> > >>>>> - insert overwrite
> > >>>>> - PARTITION (partcol1=val1, partcol2=val2 ...)
> > >>>>> The SQL pattern is:
> > >>>>> INSERT { INTO | OVERWRITE } TABLE tablename1 [PARTITION
> > >> (partcol1=val1,
> > >>>>> partcol2=val2 ...) select_statement1 FROM from_statement;
> > >>>>> It is a surprise to me.
> > >>>>> The reason is that we only allow these two grammars in hive
> dialect.
> > >>> And
> > >>>>> SQL-CLI does not have an interface to switch dialects.
> > >>>>>
> > >>>>> Because it directly hinders the SQL-CLI's insert syntax in hive
> > >>>> integration
> > >>>>> and seriously hinders the practicability of SQL-CLI.
> > >>>>> And we have introduced these two grammars in FLIP-63 [1] to Flink.
> > >>>>> Here are my question:
> > >>>>> 1.Should we remove hive dialect limitation for these two grammars?
> > >>>>> 2.Should we fix this in 1.10?
> > >>>>>
> > >>>>> [1]
> > >>>>>
> > >>>>
> > >>>
> > >>
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support
> > >>>>>
> > >>>>> Best,
> > >>>>> Jingsong Lee
> > >>>>
> > >>>
> > >>
> > >>
> > >> --
> > >> Best, Jingsong Lee
> > >>
> > >
> >
> >
>
> --
> Best, Jingsong Lee
>
--
Best regards!
Rui Li
e an interface to switch dialects.
>> >
>> > Because it directly hinders the SQL-CLI's insert syntax in hive
>> integration
>> > and seriously hinders the practicability of SQL-CLI.
>> > And we have introduced these two grammars in FLIP-63 [1] to Flink.
>> > Here are my question:
>> > 1.Should we remove hive dialect limitation for these two grammars?
>> > 2.Should we fix this in 1.10?
>> >
>> > [1]
>> >
>> >
>> https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support
>> >
>> > Best,
>> > Jingsong Lee
>> >
>>
>
--
Best regards!
Rui Li
Rui Li created FLINK-15186:
--
Summary: Column names and nullability mismatch when querying
CatalogViews
Key: FLINK-15186
URL: https://issues.apache.org/jira/browse/FLINK-15186
Project: Flink
Issue
Rui Li created FLINK-15167:
--
Summary: SQL CLI library option doesn't work for Hive connector
Key: FLINK-15167
URL: https://issues.apache.org/jira/browse/FLINK-15167
Project: Flink
Issue Type
Rui Li created FLINK-15128:
--
Summary: Document support for Hive timestamp type
Key: FLINK-15128
URL: https://issues.apache.org/jira/browse/FLINK-15128
Project: Flink
Issue Type: Task
Rui Li created FLINK-15106:
--
Summary: Hive 3.x tests leave metastore_db folder under build
directory
Key: FLINK-15106
URL: https://issues.apache.org/jira/browse/FLINK-15106
Project: Flink
Issue
Rui Li created FLINK-15002:
--
Summary: Add catalog API to get partition by filter
Key: FLINK-15002
URL: https://issues.apache.org/jira/browse/FLINK-15002
Project: Flink
Issue Type: Task
Rui Li created FLINK-14897:
--
Summary: HiveTableOutputFormat fails to finalize on master
Key: FLINK-14897
URL: https://issues.apache.org/jira/browse/FLINK-14897
Project: Flink
Issue Type: Bug
Rui Li created FLINK-14847:
--
Summary: Support retrieving Hive PK constraints
Key: FLINK-14847
URL: https://issues.apache.org/jira/browse/FLINK-14847
Project: Flink
Issue Type: Task
Rui Li created FLINK-14796:
--
Summary: Add document about limitations of different Hive versions
Key: FLINK-14796
URL: https://issues.apache.org/jira/browse/FLINK-14796
Project: Flink
Issue Type
Rui Li created FLINK-14715:
--
Summary: HiveModuleTest fails with Hive-3.1.1
Key: FLINK-14715
URL: https://issues.apache.org/jira/browse/FLINK-14715
Project: Flink
Issue Type: Test
Rui Li created FLINK-14710:
--
Summary: Decide column nullability according to Hive constraints
Key: FLINK-14710
URL: https://issues.apache.org/jira/browse/FLINK-14710
Project: Flink
Issue Type
k.apache.org,写道:
> > >
> > > Congrats Jark!
> >
>
--
Best regards!
Rui Li
Rui Li created FLINK-14673:
--
Summary: Shouldn't expect HMS client to throw
NoSuchObjectException for non-existing function
Key: FLINK-14673
URL: https://issues.apache.org/jira/browse/FLINK-14673
Pr
iption.
>
> Best,
> Terry Wang
>
>
>
> > 2019年11月7日 15:40,Rui Li 写道:
> >
> > Thanks Terry for driving this forward.
> > Got one question about DESCRIBE DATABASE: the results display comment and
> > description of a database. While comment can be sp
n the discussion thread[2].
> > >>>>
> > >>>> The vote will be open for at least 72 hours. I'll try to close it by
> > >>>> 2019-11-08 14:30 UTC, unless there is an objection or not enough
> > votes.
> > >>>>
> > >>>> [1]
> > >>>>
> > >>>
> > >>
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP+69+-+Flink+SQL+DDL+Enhancement
> > >>>> <
> > >>>>
> > >>>
> > >>
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP+69+-+Flink+SQL+DDL+Enhancement
> > >>>>>
> > >>>> [2]
> > >>>>
> > >>>
> > >>
> >
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-69-Flink-SQL-DDL-Enhancement-td33090.html
> > >>>> <
> > >>>>
> > >>>
> > >>
> >
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-69-Flink-SQL-DDL-Enhancement-td33090.html
> > >>>>>
> > >>>> Best,
> > >>>> Terry Wang
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>
> > >>> --
> > >>> Xuefu Zhang
> > >>>
> > >>> "In Honey We Trust!"
> > >>>
> > >>
> >
> >
>
--
Best regards!
Rui Li
Rui Li created FLINK-14605:
--
Summary: Use Hive-1.1.0 as the profile to test against 1.1.x
Key: FLINK-14605
URL: https://issues.apache.org/jira/browse/FLINK-14605
Project: Flink
Issue Type: Test
Rui Li created FLINK-14588:
--
Summary: Support Hive version 1.0.0 and 1.0.1
Key: FLINK-14588
URL: https://issues.apache.org/jira/browse/FLINK-14588
Project: Flink
Issue Type: Task
>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> Best Regards
> >>>>>>>>>>>> Peter Huang
> >>>>>>>>>>>>
> >>>>>>>>>>>> On Mon, Oct 28, 2019 at 9:19 AM Rong Rong <
> walter...@gmail.com
> >>>
> >>>>>>> wrote:
> >>>>>>>>>>>>
> >>>>>>>>>>>>> Congratulations Becket!!
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> --
> >>>>>>>>>>>>> Rong
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Mon, Oct 28, 2019, 7:53 AM Jark Wu
> >> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Congratulations Becket!
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Best,
> >>>>>>>>>>>>>> Jark
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Mon, 28 Oct 2019 at 20:26, Benchao Li <
> >> libenc...@gmail.com>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Congratulations Becket.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Dian Fu 于2019年10月28日周一 下午7:22写道:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Congrats, Becket.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> 在 2019年10月28日,下午6:07,Fabian Hueske
> >> 写道:
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> Hi everyone,
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> I'm happy to announce that Becket Qin has joined the
> Flink
> >>>>>> PMC.
> >>>>>>>>>>>>>>>>> Let's congratulate and welcome Becket as a new member of
> >> the
> >>>>>>>>>>>> Flink
> >>>>>>>>>>>>>> PMC!
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> Cheers,
> >>>>>>>>>>>>>>>>> Fabian
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> --
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Benchao Li
> >>>>>>>>>>>>>>> School of Electronics Engineering and Computer Science,
> >> Peking
> >>>>>>>>>>>>> University
> >>>>>>>>>>>>>>> Tel:+86-15650713730
> >>>>>>>>>>>>>>> Email: libenc...@gmail.com; libenc...@pku.edu.cn
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>> Xuefu Zhang
> >>>>>>>>>>
> >>>>>>>>>> "In Honey We Trust!"
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>
> >>>
> >>
> >> --
> >> Best, Jingsong Lee
> >>
> >>
>
>
--
Best regards!
Rui Li
Rui Li created FLINK-14526:
--
Summary: Support Hive version 1.1.0 and 1.1.1
Key: FLINK-14526
URL: https://issues.apache.org/jira/browse/FLINK-14526
Project: Flink
Issue Type: Task
Rui Li created FLINK-14397:
--
Summary: Failed to run Hive UDTF with ClassCastException
Key: FLINK-14397
URL: https://issues.apache.org/jira/browse/FLINK-14397
Project: Flink
Issue Type: Bug
built-in function.
> > > >> */
> > > >> Optional getObjectIdentifier()
> > > >> }
> > > >>
> > > >> class ObjectIdentifier implements FunctionIdentifier {
> > > >> Optional getObjectIdentifier() {
> > > >> return Optional.of(this);
> > > >> }
> > > >> }
> > > >>
> > > >> class SystemFunctionIdentifier implements FunctionIdentifier {...}
> > > >>
> > > >> WDYT?
> > > >>
> > > >> On Wed, 25 Sep 2019, 04:50 Xuefu Z, wrote:
> > > >>
> > > >> > +1. LGTM
> > > >> >
> > > >> > On Tue, Sep 24, 2019 at 6:09 AM Terry Wang
> > > wrote:
> > > >> >
> > > >> > > +1
> > > >> > >
> > > >> > > Best,
> > > >> > > Terry Wang
> > > >> > >
> > > >> > >
> > > >> > >
> > > >> > > > 在 2019年9月24日,上午10:42,Kurt Young 写道:
> > > >> > > >
> > > >> > > > +1
> > > >> > > >
> > > >> > > > Best,
> > > >> > > > Kurt
> > > >> > > >
> > > >> > > >
> > > >> > > > On Tue, Sep 24, 2019 at 2:30 AM Bowen Li >
> > > >> wrote:
> > > >> > > >
> > > >> > > >> Hi all,
> > > >> > > >>
> > > >> > > >> I'd like to start a voting thread for FLIP-57 [1], which
> we've
> > > >> reached
> > > >> > > >> consensus in [2].
> > > >> > > >>
> > > >> > > >> This voting will be open for minimum 3 days till 6:30pm UTC,
> > Sep
> > > >> 26.
> > > >> > > >>
> > > >> > > >> Thanks,
> > > >> > > >> Bowen
> > > >> > > >>
> > > >> > > >> [1]
> > > >> > > >>
> > > >> > > >>
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-57%3A+Rework+FunctionCatalog
> > > >> > > >> [2]
> > > >> > > >>
> > > >> > > >>
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-57-Rework-FunctionCatalog-td32291.html#a32613
> > > >> > > >>
> > > >> > >
> > > >> > >
> > > >> >
> > > >> > --
> > > >> > Xuefu Zhang
> > > >> >
> > > >> > "In Honey We Trust!"
> > > >> >
> > > >>
> > > >
> > >
> >
>
--
Best regards!
Rui Li
A+Rework+of+the+Expression+Design
> > > >>>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>
> > >
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support
> > > >>>>>
> > > >>>>> Discussion thread:
> > > >>>>> <
> > > >>>>>
> > > >>>>
> > > >>
> > >
> >
> https://lists.apache.org/thread.html/65078bad6e047578d502e1e5d92026f13fd9648725f5b74ed330@%3Cdev.flink.apache.org%3E
> > > >>>>>>
> > > >>>>> <
> > > >>>>>
> > > >>>>
> > > >>
> > >
> >
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-51-Rework-of-the-Expression-Design-td31653.html
> > > >>>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>
> > >
> >
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-63-Rework-table-partition-support-td32770.html
> > > >>>>>
> > > >>>>> Google Doc:
> > > >>>>> <
> > > >>>>>
> > > >>>>
> > > >>
> > >
> >
> https://docs.google.com/document/d/1yFDyquMo_-VZ59vyhaMshpPtg7p87b9IYdAtMXv5XmM/edit?usp=sharing
> > > >>>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>
> > >
> >
> https://docs.google.com/document/d/15R3vZ1R_pAHcvJkRx_CWleXgl08WL3k_ZpnWSdzP7GY/edit?usp=sharing
> > > >>>>>
> > > >>>>> Thanks,
> > > >>>>>
> > > >>>>> Best,
> > > >>>>> Jingsong Lee
> > > >>>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>> --
> > > >>> Best, Jingsong Lee
> > > >>>
> > > >>
> > > >>
> > > >> --
> > > >> Best, Jingsong Lee
> > > >>
> > >
> > >
> >
>
>
> --
> Xuefu Zhang
>
> "In Honey We Trust!"
>
--
Best regards!
Rui Li
Rui Li created FLINK-14148:
--
Summary: Investigate pushing predicate/projection to underlying
Hive input format
Key: FLINK-14148
URL: https://issues.apache.org/jira/browse/FLINK-14148
Project: Flink
Rui Li created FLINK-14129:
--
Summary: HiveTableSource should implement ProjectableTableSource
Key: FLINK-14129
URL: https://issues.apache.org/jira/browse/FLINK-14129
Project: Flink
Issue Type
Rui Li created FLINK-14089:
--
Summary: SQL CLI doesn't support explain DMLs
Key: FLINK-14089
URL: https://issues.apache.org/jira/browse/FLINK-14089
Project: Flink
Issue Type
Rui Li created FLINK-13826:
--
Summary: Support INSERT OVERWRITE for Hive connector
Key: FLINK-13826
URL: https://issues.apache.org/jira/browse/FLINK-13826
Project: Flink
Issue Type: Bug
Rui Li created FLINK-13814:
--
Summary: HiveTableSink should strip quotes from partition values
Key: FLINK-13814
URL: https://issues.apache.org/jira/browse/FLINK-13814
Project: Flink
Issue Type: Bug
Rui Li created FLINK-13747:
--
Summary: Remove some TODOs in Hive connector
Key: FLINK-13747
URL: https://issues.apache.org/jira/browse/FLINK-13747
Project: Flink
Issue Type: Bug
Components
Rui Li created FLINK-13711:
--
Summary: Hive array values not properly displayed in SQL CLI
Key: FLINK-13711
URL: https://issues.apache.org/jira/browse/FLINK-13711
Project: Flink
Issue Type: Bug
Rui Li created FLINK-13693:
--
Summary: Identifiers are not properly handled in some DDLs
Key: FLINK-13693
URL: https://issues.apache.org/jira/browse/FLINK-13693
Project: Flink
Issue Type: Bug
Rui Li created FLINK-13653:
--
Summary: ResultStore should avoid using RowTypeInfo when creating
a result
Key: FLINK-13653
URL: https://issues.apache.org/jira/browse/FLINK-13653
Project: Flink
Issue
Rui Li created FLINK-13549:
--
Summary: Unable to query Hive table with char or varchar columns
Key: FLINK-13549
URL: https://issues.apache.org/jira/browse/FLINK-13549
Project: Flink
Issue Type: Bug
Rui Li created FLINK-13534:
--
Summary: Unable to query Hive table with decimal column
Key: FLINK-13534
URL: https://issues.apache.org/jira/browse/FLINK-13534
Project: Flink
Issue Type: Bug
Rui Li created FLINK-13526:
--
Summary: Switching to a non existing database crashes sql-client
Key: FLINK-13526
URL: https://issues.apache.org/jira/browse/FLINK-13526
Project: Flink
Issue Type: Bug
Rui Li created FLINK-13424:
--
Summary: HiveCatalog should add hive version in conf
Key: FLINK-13424
URL: https://issues.apache.org/jira/browse/FLINK-13424
Project: Flink
Issue Type: Bug
Rui Li created FLINK-13352:
--
Summary: Using hive connector with hive-1.2.1 needs libfb303 jar
Key: FLINK-13352
URL: https://issues.apache.org/jira/browse/FLINK-13352
Project: Flink
Issue Type: Bug
Rui Li created FLINK-13303:
--
Summary: Add e2e test for hive connector
Key: FLINK-13303
URL: https://issues.apache.org/jira/browse/FLINK-13303
Project: Flink
Issue Type: Bug
Components
Rui Li created FLINK-13255:
--
Summary: Exclude hive connector from JDK9 profile
Key: FLINK-13255
URL: https://issues.apache.org/jira/browse/FLINK-13255
Project: Flink
Issue Type: Bug
Rui Li created FLINK-13192:
--
Summary: Add tests for different Hive table formats
Key: FLINK-13192
URL: https://issues.apache.org/jira/browse/FLINK-13192
Project: Flink
Issue Type: Sub-task
Rui Li created FLINK-13170:
--
Summary: Planner should get table factory from catalog when
creating sink for CatalogTable
Key: FLINK-13170
URL: https://issues.apache.org/jira/browse/FLINK-13170
Project: Flink
Rui Li created FLINK-13110:
--
Summary: Fix Hive-1.2.1 build
Key: FLINK-13110
URL: https://issues.apache.org/jira/browse/FLINK-13110
Project: Flink
Issue Type: Sub-task
Reporter: Rui Li
Rui Li created FLINK-13090:
--
Summary: Test Hive connector with hive runner
Key: FLINK-13090
URL: https://issues.apache.org/jira/browse/FLINK-13090
Project: Flink
Issue Type: Sub-task
Rui Li created FLINK-13069:
--
Summary: HiveTableSink should implement OverwritableTableSink
Key: FLINK-13069
URL: https://issues.apache.org/jira/browse/FLINK-13069
Project: Flink
Issue Type: Sub
Rui Li created FLINK-13068:
--
Summary: HiveTableSink should implement PartitionableTableSink
Key: FLINK-13068
URL: https://issues.apache.org/jira/browse/FLINK-13068
Project: Flink
Issue Type: Sub
Rui Li created FLINK-13012:
--
Summary: Handle default partition name of Hive table
Key: FLINK-13012
URL: https://issues.apache.org/jira/browse/FLINK-13012
Project: Flink
Issue Type: Sub-task
Rui Li created FLINK-12995:
--
Summary: Add Hive-1.2.1 build to Travis
Key: FLINK-12995
URL: https://issues.apache.org/jira/browse/FLINK-12995
Project: Flink
Issue Type: Sub-task
Reporter
Rui Li created FLINK-12970:
--
Summary: Support writing Hive complex types
Key: FLINK-12970
URL: https://issues.apache.org/jira/browse/FLINK-12970
Project: Flink
Issue Type: Sub-task
Rui Li created FLINK-12727:
--
Summary: Make HiveTableOutputFormat support writing partitioned
tables
Key: FLINK-12727
URL: https://issues.apache.org/jira/browse/FLINK-12727
Project: Flink
Issue
Rui Li created FLINK-12715:
--
Summary: Hive-1.2.1 build is broken
Key: FLINK-12715
URL: https://issues.apache.org/jira/browse/FLINK-12715
Project: Flink
Issue Type: Sub-task
Reporter
Rui Li created FLINK-12705:
--
Summary: Allow user to specify the Hive version in use
Key: FLINK-12705
URL: https://issues.apache.org/jira/browse/FLINK-12705
Project: Flink
Issue Type: Sub-task
Rui Li created FLINK-12664:
--
Summary: Implement TableSink to write Hive tables
Key: FLINK-12664
URL: https://issues.apache.org/jira/browse/FLINK-12664
Project: Flink
Issue Type: Sub-task
Rui Li created FLINK-12649:
--
Summary: Add a shim layer to support multiple versions of HMS
Key: FLINK-12649
URL: https://issues.apache.org/jira/browse/FLINK-12649
Project: Flink
Issue Type: Sub
Rui Li created FLINK-12568:
--
Summary: Implement TableSink and OutputFormat to write Hive tables
Key: FLINK-12568
URL: https://issues.apache.org/jira/browse/FLINK-12568
Project: Flink
Issue Type
Rui Li created FLINK-12554:
--
Summary: Create TableFactory for Hive connector
Key: FLINK-12554
URL: https://issues.apache.org/jira/browse/FLINK-12554
Project: Flink
Issue Type: Sub-task
Hi team,
Could someone add me as a contributor? My JIRA username is lirui.
Thanks!
--
Best regards!
Rui Li
201 - 299 of 299 matches
Mail list logo