Re: Flink SQL Client Kafka keyed serialization

2018-10-24 Thread Dominik Wosiński
Hey Fabian, Thanks for that, I have somehow missed the mail with the improvements description. Best, Dom. wt., 23 paź 2018 o 21:46 Fabian Hueske napisał(a): > Hi Dom, > > I think support for Kafka keys would be covered by Timo's proposal for > improvements of the source / sink connectors [1].

[jira] [Created] (FLINK-10661) Initial credit should be configured in a separate parameter

2018-10-24 Thread zhijiang (JIRA)
zhijiang created FLINK-10661: Summary: Initial credit should be configured in a separate parameter Key: FLINK-10661 URL: https://issues.apache.org/jira/browse/FLINK-10661 Project: Flink Issue Ty

[jira] [Created] (FLINK-10662) Refactor the ChannelSelector interface for single selected channel

2018-10-24 Thread zhijiang (JIRA)
zhijiang created FLINK-10662: Summary: Refactor the ChannelSelector interface for single selected channel Key: FLINK-10662 URL: https://issues.apache.org/jira/browse/FLINK-10662 Project: Flink I

[jira] [Created] (FLINK-10663) Closing StreamingFileSink can cause NPE

2018-10-24 Thread Gary Yao (JIRA)
Gary Yao created FLINK-10663: Summary: Closing StreamingFileSink can cause NPE Key: FLINK-10663 URL: https://issues.apache.org/jira/browse/FLINK-10663 Project: Flink Issue Type: Bug Com

[jira] [Created] (FLINK-10664) Flink: Checkpointing fails with S3 exception - Please reduce your request rate

2018-10-24 Thread Pawel Bartoszek (JIRA)
Pawel Bartoszek created FLINK-10664: --- Summary: Flink: Checkpointing fails with S3 exception - Please reduce your request rate Key: FLINK-10664 URL: https://issues.apache.org/jira/browse/FLINK-10664

[jira] [Created] (FLINK-10665) Port YARNSessionFIFOITCase#testJavaAPI to new codebase

2018-10-24 Thread TisonKun (JIRA)
TisonKun created FLINK-10665: Summary: Port YARNSessionFIFOITCase#testJavaAPI to new codebase Key: FLINK-10665 URL: https://issues.apache.org/jira/browse/FLINK-10665 Project: Flink Issue Type: Su

[jira] [Created] (FLINK-10666) Port YarnClusterDescriptorTest to new codebase

2018-10-24 Thread TisonKun (JIRA)
TisonKun created FLINK-10666: Summary: Port YarnClusterDescriptorTest to new codebase Key: FLINK-10666 URL: https://issues.apache.org/jira/browse/FLINK-10666 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-10667) Clean up Scala 2.10 remnants

2018-10-24 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-10667: -- Summary: Clean up Scala 2.10 remnants Key: FLINK-10667 URL: https://issues.apache.org/jira/browse/FLINK-10667 Project: Flink Issue Type: Bug Affects

[jira] [Created] (FLINK-10668) Streaming File Sink E2E test fails because not all legitimate exceptions are excluded

2018-10-24 Thread Gary Yao (JIRA)
Gary Yao created FLINK-10668: Summary: Streaming File Sink E2E test fails because not all legitimate exceptions are excluded Key: FLINK-10668 URL: https://issues.apache.org/jira/browse/FLINK-10668 Project

Question over Incremental Snapshot vs Full Snapshot in rocksDb state backend

2018-10-24 Thread chandan prakash
Hi, I am new to Flink. Was looking into the code to understand how Flink does FullSnapshot and Incremental Snapshot using RocksDB What I understood: 1. *For full snapshot, we call RocksDb snapshot api* which basically an iterator handle to the entries in RocksDB instance. We iterate over every ent

[jira] [Created] (FLINK-10669) Exceptions & errors are not properly checked in logs

2018-10-24 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-10669: Summary: Exceptions & errors are not properly checked in logs Key: FLINK-10669 URL: https://issues.apache.org/jira/browse/FLINK-10669 Project: Flink

[jira] [Created] (FLINK-10670) Fix Correlate codegen error

2018-10-24 Thread Ruidong Li (JIRA)
Ruidong Li created FLINK-10670: -- Summary: Fix Correlate codegen error Key: FLINK-10670 URL: https://issues.apache.org/jira/browse/FLINK-10670 Project: Flink Issue Type: Bug Components:

Re: Question over Incremental Snapshot vs Full Snapshot in rocksDb state backend

2018-10-24 Thread Tzu-Li (Gordon) Tai
Hi, I’m forwarding this question to Stefan (cc’ed). He would most likely be able to answer your question, as he has done substantial work in the RocksDB state backends. Cheers, Gordon On 24 October 2018 at 8:47:24 PM, chandan prakash (chandanbaran...@gmail.com) wrote: Hi, I am new to Flink.

[ANNOUNCE] Flink Forward San Francisco 2019 - Call for Presentations is now open

2018-10-24 Thread Till Rohrmann
Hi everybody, the Call for Presentations for Flink Forward San Francisco 2019 is now open! Apply by November 30 to share your compelling Flink use case, best practices, and latest developments with the community on April 1-2 in San Francisco, CA. Submit your proposal: https://flink-forward.org/ca

Re: Question over Incremental Snapshot vs Full Snapshot in rocksDb state backend

2018-10-24 Thread chandan prakash
Thanks Tzu-Li for redirecting. Would also like to be corrected if my any inference from the code is incorrect or incomplete. I am sure it will help to clear doubts of more developers like me :) Thanks in advance. Regards, Chandan On Wed, Oct 24, 2018 at 9:19 PM Tzu-Li (Gordon) Tai wrote: > Hi

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-10-24 Thread Zhang, Xuefu
Hi all, To wrap up the discussion, I have attached a PDF describing the proposal, which is also attached to FLINK-10556 [1]. Please feel free to watch that JIRA to track the progress. Please also let me know if you have additional comments or questions. Thanks, Xuefu [1] https://issues.apache

[jira] [Created] (FLINK-10671) rest monitoring api Savepoint status call fails if akka.ask.timeout < checkpoint duration

2018-10-24 Thread Cliff Resnick (JIRA)
Cliff Resnick created FLINK-10671: - Summary: rest monitoring api Savepoint status call fails if akka.ask.timeout < checkpoint duration Key: FLINK-10671 URL: https://issues.apache.org/jira/browse/FLINK-10671

[jira] [Created] (FLINK-10672) Task stuck while writing output to flink

2018-10-24 Thread Ankur Goenka (JIRA)
Ankur Goenka created FLINK-10672: Summary: Task stuck while writing output to flink Key: FLINK-10672 URL: https://issues.apache.org/jira/browse/FLINK-10672 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-10673) Table API / SQL UIDs not the only one

2018-10-24 Thread Fan weiwen (JIRA)
Fan weiwen created FLINK-10673: -- Summary: Table API / SQL UIDs not the only one Key: FLINK-10673 URL: https://issues.apache.org/jira/browse/FLINK-10673 Project: Flink Issue Type: Bug C

[jira] [Created] (FLINK-10674) DistinctAccumulator.remove lead to NPE

2018-10-24 Thread ambition (JIRA)
ambition created FLINK-10674: Summary: DistinctAccumulator.remove lead to NPE Key: FLINK-10674 URL: https://issues.apache.org/jira/browse/FLINK-10674 Project: Flink Issue Type: Bug Comp