[jira] [Created] (FLINK-3948) EventTimeWindowCheckpointingITCase Fails with Core Dump

2016-05-20 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-3948: --- Summary: EventTimeWindowCheckpointingITCase Fails with Core Dump Key: FLINK-3948 URL: https://issues.apache.org/jira/browse/FLINK-3948 Project: Flink I

[jira] [Created] (FLINK-3947) Provide low level access to RocksDB state backend

2016-05-20 Thread Elias Levy (JIRA)
Elias Levy created FLINK-3947: - Summary: Provide low level access to RocksDB state backend Key: FLINK-3947 URL: https://issues.apache.org/jira/browse/FLINK-3947 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-3946) State API Should Support Data Expiration

2016-05-20 Thread Elias Levy (JIRA)
Elias Levy created FLINK-3946: - Summary: State API Should Support Data Expiration Key: FLINK-3946 URL: https://issues.apache.org/jira/browse/FLINK-3946 Project: Flink Issue Type: Improvement

Re: buffering in operators, implementing statistics

2016-05-20 Thread Stavros Kontopoulos
Hi thnx for the feedback. So there is a limitation due to parallel windows implementation. No intentions to change that somehow to accommodate similar estimations? WindowAll in practice is used as step in the pipeline? I mean since its inherently not parallel cannot scale correct? Although there

[jira] [Created] (FLINK-3945) Degree annotation for directed graphs

2016-05-20 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-3945: - Summary: Degree annotation for directed graphs Key: FLINK-3945 URL: https://issues.apache.org/jira/browse/FLINK-3945 Project: Flink Issue Type: Improvement

Re: buffering in operators, implementing statistics

2016-05-20 Thread Aljoscha Krettek
Hi, with how the window API currently works this can only be done for non-parallel windows. For keyed windows everything that happens is scoped to the key of the elements: window contents are kept in per-key state, triggers fire on a per-key basis. Therefore a count-min sketch cannot be used becaus

Blogpost on Flink's SQL support

2016-05-20 Thread Fabian Hueske
Hi everybody, I wrote a blog post about the SQL efforts of the Flink community and would like to get your feedback. You can read and comment the Google doc: https://docs.google.com/document/d/1xy6d9w6Gjm8Bsh9SJbGuTZsulBJxmdIXhESJ4dV2jEY I am planning to publish the post around next Tuesday. Lo

Re: Preparing Table API & SQL for Flink 1.1.0

2016-05-20 Thread Vasiliki Kalavri
Hey all, @Fabian: thanks for compiling the list of issues and trying out TPC-H I think it would be nice to include the first 5 from your list in 1.1.0. What about FLINK-3656 (re-working the tests)? Do we want to do this before the release as well? Great to see Timo willing to coordinate and Yijie

Re: Preparing Table API & SQL for Flink 1.1.0

2016-05-20 Thread Ufuk Celebi
On Fri, May 20, 2016 at 3:32 PM, Timo Walther wrote: > What are the plans for 1.1.0 release so far? Hey Timo, following the 3 months release schedule, a release would be due soon (June 8th). My personal opinion is that exact date is probably a little optimistic, but June sounds about right. We

Re: Preparing Table API & SQL for Flink 1.1.0

2016-05-20 Thread Timo Walther
Hi Fabian, thank you for summarizing the most important issues. I already worked on FLINK-3152 / FLINK-3580 but stopped in favor of FLINK-3859. I will open a PR for FLINK-3859 very soon, just need to rebase it onto the latest validation layer and do some testing. Unfortunately I'm on vacation

[jira] [Created] (FLINK-3944) Add optimization rules to reorder Cartesian products and joins

2016-05-20 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-3944: Summary: Add optimization rules to reorder Cartesian products and joins Key: FLINK-3944 URL: https://issues.apache.org/jira/browse/FLINK-3944 Project: Flink

Re: Preparing Table API & SQL for Flink 1.1.0

2016-05-20 Thread Yijie Shen
Hi Fabian, The priority seems reasonable to me. I skimmed through your TPCH branch and find data type and related functions would be quite important to enable most of TPC-H queries. I would try out your TPC-H branch and pick up some issues you filed these two days for the 1.1.0 release. Hope thi

[jira] [Created] (FLINK-3943) Add support for EXCEPT (set minus)

2016-05-20 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-3943: Summary: Add support for EXCEPT (set minus) Key: FLINK-3943 URL: https://issues.apache.org/jira/browse/FLINK-3943 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-3942) Add support for INTERSECT

2016-05-20 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-3942: Summary: Add support for INTERSECT Key: FLINK-3942 URL: https://issues.apache.org/jira/browse/FLINK-3942 Project: Flink Issue Type: New Feature Com

[jira] [Created] (FLINK-3941) Add support for UNION (with duplicate elimination)

2016-05-20 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-3941: Summary: Add support for UNION (with duplicate elimination) Key: FLINK-3941 URL: https://issues.apache.org/jira/browse/FLINK-3941 Project: Flink Issue Type:

[jira] [Created] (FLINK-3940) Add support for ORDER BY OFFSET FETCH

2016-05-20 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-3940: Summary: Add support for ORDER BY OFFSET FETCH Key: FLINK-3940 URL: https://issues.apache.org/jira/browse/FLINK-3940 Project: Flink Issue Type: Bug