RE: SQL CLI and JDBC

2019-04-16 Thread Hanan Yehudai
Yes, I Know . Going to replace this with Kafka once the approach will work for me 😊 -Original Message- From: Fabian Hueske Sent: 15 April 2019 11:46 To: dev Subject: Re: SQL CLI and JDBC Hi, I don't have much experience with Calcite connectors. One potential problem might be fetc

[jira] [Created] (FLINK-12210) Fix a bug in AbstractPagedInputView.readLine

2019-04-16 Thread Liya Fan (JIRA)
Liya Fan created FLINK-12210: Summary: Fix a bug in AbstractPagedInputView.readLine Key: FLINK-12210 URL: https://issues.apache.org/jira/browse/FLINK-12210 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-12211) Add more it cases to blink batch

2019-04-16 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-12211: Summary: Add more it cases to blink batch Key: FLINK-12211 URL: https://issues.apache.org/jira/browse/FLINK-12211 Project: Flink Issue Type: New Feature

Re: [Discuss][FLINK-8297]A solution for FLINK-8297 Timebased RocksDBListState

2019-04-16 Thread Andrey Zagrebin
Hi Faxian, True, we can resolve timestamp conflicts putting values into the same row, good point. Then re-ordering in case of internal clock jump changes behaviour comparing with the list state we have now. In this case, it can be similar to dispersing elements by hash and we can call it a bag, no

Re: Contributor permission Request

2019-04-16 Thread Fabian Hueske
Hi, Welcome to the Flink community! I gave you contributor permissions for Jira. Best, Fabian Am Di., 16. Apr. 2019 um 04:20 Uhr schrieb Kevin Tang < kevin.shang...@gmail.com>: > Hi, > I want to contribute to Apache Flink. > Would you please give me the contributor permission? > My JIRA ID is t

[jira] [Created] (FLINK-12212) Clarify documentation about async checkpointing

2019-04-16 Thread Konstantin Knauf (JIRA)
Konstantin Knauf created FLINK-12212: Summary: Clarify documentation about async checkpointing Key: FLINK-12212 URL: https://issues.apache.org/jira/browse/FLINK-12212 Project: Flink Issue

[jira] [Created] (FLINK-12213) Pass TaskManagerMetricGroup into constructor of NetworkEnvironment

2019-04-16 Thread zhijiang (JIRA)
zhijiang created FLINK-12213: Summary: Pass TaskManagerMetricGroup into constructor of NetworkEnvironment Key: FLINK-12213 URL: https://issues.apache.org/jira/browse/FLINK-12213 Project: Flink I

[jira] [Created] (FLINK-12214) Add JobListener to capture job submission process

2019-04-16 Thread Jeff Zhang (JIRA)
Jeff Zhang created FLINK-12214: -- Summary: Add JobListener to capture job submission process Key: FLINK-12214 URL: https://issues.apache.org/jira/browse/FLINK-12214 Project: Flink Issue Type: New

Re: Contributor permission Request

2019-04-16 Thread Konstantinos Papadopoulos
Hi Fabian, How can I also get contributor permissions for Jira? Thanks in advance, Konstantinos On Tue, Apr 16, 2019 at 1:38 PM Fabian Hueske wrote: > Hi, > > Welcome to the Flink community! > I gave you contributor permissions for Jira. > > Best, Fabian > > Am Di., 16. Apr. 2019 um 04:20 Uhr

Re: Contributor permission Request

2019-04-16 Thread Fabian Hueske
Hi Konstantinos, You need a Jira account and share your user id. We will then add it to the Contributor group and from then on Jira issues can be assigned to you. Best, Fabian Am Di., 16. Apr. 2019 um 14:20 Uhr schrieb Konstantinos Papadopoulos < kpapadopoulos1...@gmail.com>: > Hi Fabian, > >

Re: Contributor permission Request

2019-04-16 Thread Konstantinos Papadopoulos
Hi Fabian, I already have a Jira account and my user ID is kpapadopoul. Could you please add me to the Contributor group? Best, Konstantinos On Tue, Apr 16, 2019 at 3:27 PM Fabian Hueske wrote: > Hi Konstantinos, > > You need a Jira account and share your user id. > We will then add it to the

for subcribe

2019-04-16 Thread Tyrion W
for subcribe

Re: Contributor permission Request

2019-04-16 Thread Fabian Hueske
Hi Konstantinos, I've given you contributor permissions for Jira. Best, Fabian Am Di., 16. Apr. 2019 um 14:31 Uhr schrieb Konstantinos Papadopoulos < kpapadopoulos1...@gmail.com>: > Hi Fabian, > > I already have a Jira account and my user ID is kpapadopoul. > Could you please add me to the Cont

Re: [DISCUSS] Adaptive Parallelism of Job Vertex

2019-04-16 Thread Till Rohrmann
Hi Bo Wang, thanks for proposing this design document. I think it is an interesting idea to improve Flink's execution efficiency. At the moment, the community is actively working on making Flink's scheduler pluggable. Once this is possible, we could try this feature out by implementing a schedule

[DISCUSS] [FLINK SQL] External catalog for Confluent Kafka

2019-04-16 Thread Artsem Semianenka
Hi guys! I'm working on External Catalog for Confluent Kafka. The main idea to register the external catalog which provides the list of Kafka topics and execute SQL queries like : Select * form kafka.topic_name I'm going to receive the table schema from Confluent schema registry. The main disadva

Using guava ImmutableMap Serializer from magro/kyro-serializers

2019-04-16 Thread vijikarthi
Hello, I am using Flink 1.7.2. I wrote a small application which uses KeyedProcessFunction to maintain application state. The state value object is using Guava's (version 18.0.50) ImmutableMap to create a copy of the map instance as part of its constructor. I am using "de.javakaffee:kryo-seriali

Re: [Discuss][FLINK-8297]A solution for FLINK-8297 Timebased RocksDBListState

2019-04-16 Thread SHI Xiaogang
Hi all, I can provide more details about the private solution mentioned by Yun. We noticed that the re-ordering of elements due to internal clock jump will break the semantics of LIST. So we decide not to use timestamp in the keys. Instead, we format the key in a list state as STATE_NAME#SEQUENC

[jira] [Created] (FLINK-12215) Introduce SqlProcessFunction for blink streaming runtime

2019-04-16 Thread Jark Wu (JIRA)
Jark Wu created FLINK-12215: --- Summary: Introduce SqlProcessFunction for blink streaming runtime Key: FLINK-12215 URL: https://issues.apache.org/jira/browse/FLINK-12215 Project: Flink Issue Type: Ne

Re: Using guava ImmutableMap Serializer from magro/kyro-serializers

2019-04-16 Thread JingsongLee
Hi @Vijay Srinivasaraghavan, as far as I know, kryo need register all implementation classes instead of abstract class or interface. You can see the detail in de.javakaffee.kryoserializers.guava.ImmutableMapSerializer.registerSerializers. Maybe you can try do same thing to ExecutionConfig like

[jira] [Created] (FLINK-12216) Respect the number of bytes from input parameters in HybridMemorySegment

2019-04-16 Thread Liya Fan (JIRA)
Liya Fan created FLINK-12216: Summary: Respect the number of bytes from input parameters in HybridMemorySegment Key: FLINK-12216 URL: https://issues.apache.org/jira/browse/FLINK-12216 Project: Flink

Re: Introducing Flink's Plugin mechanism

2019-04-16 Thread Rong Rong
Hi All, Sorry for joining the discussion late. Thanks Piotrek for initiating this effort. I recall reporting a very similar bug years ago[1] that was not easily solvable at the time, so +1 on this feature goes beyond just FileSystem :-) I think this would definitely be beneficial as a useful way

[jira] [Created] (FLINK-12217) OperationTreeBuilder.map() should perform ExpressionResolver.resolve()

2019-04-16 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-12217: --- Summary: OperationTreeBuilder.map() should perform ExpressionResolver.resolve() Key: FLINK-12217 URL: https://issues.apache.org/jira/browse/FLINK-12217 Project: Flink

Re: [DISCUSS] [FLINK SQL] External catalog for Confluent Kafka

2019-04-16 Thread Dawid Wysakowicz
Hi Artsem, I think it totally makes sense to have a catalog for the Schema Registry. It is also good to hear you want to contribute that. There is few important things to consider though: 1. The Catalog interface is currently under rework. You make take a look at the corresponding FLIP-30[1], and

[jira] [Created] (FLINK-12218) Report more record information in IOMetrics for Speculative Schedule

2019-04-16 Thread BoWang (JIRA)
BoWang created FLINK-12218: -- Summary: Report more record information in IOMetrics for Speculative Schedule Key: FLINK-12218 URL: https://issues.apache.org/jira/browse/FLINK-12218 Project: Flink Iss