Re: [DISCUSS] Development of SQL OVER / Table API Row Windows for streaming tables

Hello Fabian, Your plan looks good, I totally agree with your points. While I am working on FLINK-4680, I had the similar concerns about the semantics of TumbleRows and SessionRows. It is much clear if we define these windows as SlideRows with PARTITION BY clause. Regarding to the implementation

[Dev] Issue related to importing org.apache.flink.types.Row

Hi, I'm currently working on Flink InputFormat related implementation. So I have written class as follows. public class MyInputFormat extends RichInputFormat implements ResultTypeQueryable { But here I'm getting error with *Row *parameter. I can't import that

Re: [DISCUSS] Development of SQL OVER / Table API Row Windows for streaming tables

Hi Fabian, Thanks for bringing up this discussion and the nice approach to avoid overlapping contributions. All of these make sense to me. But I have some questions. Q1: If I understand correctly, we will not support TumbleRows and SessionRows at the beginning. But maybe support them as a

Re: [Dev] Flink 'InputFormat' Interface execution related problem

Hi, Thanks for your help. Since Our data source has database tables architecture I have a thought of follow that 'JDBCInputFormat' in Flink. It would be great if you can provide some information regarding how that JDBCInputFormat execution happens? Thanks, Pawan On Mon, Jan 23, 2017 at 4:18 PM,

Re: [DISCUSS] Development of SQL OVER / Table API Row Windows for streaming tables

Hi, We are also interested in streaming sql and very willing to participate and contribute. We are now in progress and we will also contribute to calcite to push forward the window and stream-join support. -- Sender: Fabian Hueske [mailto:fhue...@gmail.com] Send Time: 2017年1月24日

Re: [DISCUSS] Development of SQL OVER / Table API Row Windows for streaming tables

Hi Haohui, our plan was in fact to piggy-back on Calcite and use the TUMBLE function [1] once is it is available (CALCITE-1345 [2]). Unfortunately, this issue does not seem to be very active, so I don't know what the progress is. I would suggest to move the discussion about group windows to a

Re: [DISCUSS] Development of SQL OVER / Table API Row Windows for streaming tables

Hi Fabian, FLINK-4692 has added the support for tumbling window and we are excited to try it out and expose it as a SQL construct. Just curious -- what's your thought on the SQL syntax on tumbling window? Implementation wise it might make sense to think tumbling window as a special case of the

Re: [DISCUSS] Development of SQL OVER / Table API Row Windows for streaming tables

+1 We are also quite interested in these features and would love to participate and contribute. ~Haohui On Mon, Jan 23, 2017 at 7:31 AM Fabian Hueske wrote: > Hi everybody, > > it seems that currently several contributors are working on new features > for the streaming

Re: Strange segfaults in Flink 1.2 (probably not RocksDB related)

@Robert is this about "hot code replace" in the JVM? On Mon, Jan 23, 2017 at 1:11 PM, Robert Metzger wrote: > I think I saw similar segfaults when rebuilding Flink while Flink daemons > were running out of the build-target repository. After the flink-dist jar > has been

[jira] [Created] (FLINK-5618) Add queryable state documentation

Ufuk Celebi created FLINK-5618: -- Summary: Add queryable state documentation Key: FLINK-5618 URL: https://issues.apache.org/jira/browse/FLINK-5618 Project: Flink Issue Type: Improvement

[DISCUSS] Development of SQL OVER / Table API Row Windows for streaming tables

Hi everybody, it seems that currently several contributors are working on new features for the streaming Table API / SQL around row windows (as defined in FLIP-11 [1]) and SQL OVER-style window (FLINK-4678, FLINK-4679, FLINK-4680, FLINK-5584). Since these efforts overlap quite a bit I spent some

[jira] [Created] (FLINK-5617) Check new public APIs in 1.2 release

Robert Metzger created FLINK-5617: - Summary: Check new public APIs in 1.2 release Key: FLINK-5617 URL: https://issues.apache.org/jira/browse/FLINK-5617 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-5616) YarnPreConfiguredMasterHaServicesTest fails sometimes

Aljoscha Krettek created FLINK-5616: --- Summary: YarnPreConfiguredMasterHaServicesTest fails sometimes Key: FLINK-5616 URL: https://issues.apache.org/jira/browse/FLINK-5616 Project: Flink

Re: [Discuss] Some problem Unit test

[1] Maven Surefire: multiple executions and debugging https://blog-rmannibucau.rhcloud.com/#/post/maven-surefire-debugging-execution > On Jan 23, 2017, at 17:17, sjk wrote: > > Hi, all > >

Re: Strange segfaults in Flink 1.2 (probably not RocksDB related)

I think I saw similar segfaults when rebuilding Flink while Flink daemons were running out of the build-target repository. After the flink-dist jar has been rebuild and I tried stopping the daemons, they were running into these segfaults. On Mon, Jan 23, 2017 at 12:02 PM, Gyula Fóra

[jira] [Created] (FLINK-5615) queryable state: execute the QueryableStateITCase for all three state back-ends

Nico Kruber created FLINK-5615: -- Summary: queryable state: execute the QueryableStateITCase for all three state back-ends Key: FLINK-5615 URL: https://issues.apache.org/jira/browse/FLINK-5615 Project:

Re: Strange segfaults in Flink 1.2 (probably not RocksDB related)

Hi, I tried it with and without RocksDB, no difference. Also tried with the newest JDK version, still fails for that specific topology. On the other hand after I made some other changes in the topology (somwhere else) I can't reproduce it anymore. So it seems to be a very specific thing. To me it

[jira] [Created] (FLINK-5613) QueryableState: requesting a non-existing key in RocksDBStateBackend is not consistent with the MemoryStateBackend and FsStateBackend

Nico Kruber created FLINK-5613: -- Summary: QueryableState: requesting a non-existing key in RocksDBStateBackend is not consistent with the MemoryStateBackend and FsStateBackend Key: FLINK-5613 URL:

Re: [Dev] Flink 'InputFormat' Interface execution related problem

Hi Pawan, I don't this this works. The InputSplits are generated by the JobManager, i.e., not in parallel by a single process. After the parallel InputFormats have been started on the TaskManagers, they request InputSplits and open() them. If there are no InputSplits there is no work to be done

Re: [DISCUSS] proposal for the User Defined AGGregate (UDAGG)

Thanks for the clarification Shaoxuan. Cheers, Fabian 2017-01-22 4:08 GMT+01:00 Shaoxuan Wang : > Hi Fabian, > Thanks for the carefully checking on the proposal. > Yes, code generation is in my plan. As shown in "2.3 UDAGG interface", the > input and return types of the new

Re: GlobFilePathFilter NotSerializableException

Hello, this appears to be a bug in Flink. The problem is that the PathMatcher objects in the GlobFilePathFilter all contain a reference to the encapsulating class. The easiest solution to this would be to build the PathMatcher after they were shipped within the filterPath method. Since this

[jira] [Created] (FLINK-5612) GlobPathFilter not-serializable exception

Chesnay Schepler created FLINK-5612: --- Summary: GlobPathFilter not-serializable exception Key: FLINK-5612 URL: https://issues.apache.org/jira/browse/FLINK-5612 Project: Flink Issue Type:

[jira] [Created] (FLINK-5611) Add QueryableStateException type

Ufuk Celebi created FLINK-5611: -- Summary: Add QueryableStateException type Key: FLINK-5611 URL: https://issues.apache.org/jira/browse/FLINK-5611 Project: Flink Issue Type: Improvement

Re: Taking time off

Hi Max! I may be repeating the previous writers but Thanks a lot for the work and all the contributions to the projects both at the technical and at the community level! Cheers, Kostas > On Jan 23, 2017, at 9:28 AM, Till Rohrmann wrote: > > I totally agree with the

Re: 答复: [DISCUSS] Apache Flink 1.2.0 RC0 (Non-voting testing release candidate)

Hi all, I would like to do a proper voting RC1 early this week. >From the issues mentioned here, most of them have pull requests or were changed to a lower priority. Once we've merged all outstanding PRs, I'll create the next RC. Regards, Robert On Mon, Jan 16, 2017 at 12:13 PM, Fabian Hueske

[Discuss] Some problem Unit test

Hi, all Surefire plugin default execute `default-test` when mvn test. There two execution in Flink’s surefire plugin configure, default-test and integration-tests. I have three problem about unit test: 1. As default-test and integration-tests are mutual exclusion, when I local execute “mvn

[jira] [Created] (FLINK-5609) Add last update time to docs

Ufuk Celebi created FLINK-5609: -- Summary: Add last update time to docs Key: FLINK-5609 URL: https://issues.apache.org/jira/browse/FLINK-5609 Project: Flink Issue Type: Improvement

Re: Taking time off

I totally agree with the previous writers. Thanks a lot for all your effort and all the best for your future. Cheers, Till On Sat, Jan 21, 2017 at 5:13 PM, Ufuk Celebi wrote: > I totally did not see this email. Sorry! Thanks for all your hard work > and the great discussions