Hi Flink Team,
First, I would like to thank for such a wonderful tool and appreciate your
efforts.
I am developing an application where I am processing stream of geolocations
and detecting geofence if exactly 3 events are inside geofence. The code is
something like this:-
Pattern geofencePattern
Hequn Cheng created FLINK-10983:
---
Summary: NonHAQueryableStateFsBackendITCase failed when run mvn
install
Key: FLINK-10983
URL: https://issues.apache.org/jira/browse/FLINK-10983
Project: Flink
Hi Jiangjie,
Thanks for initiating this great proposal！
Interactive Programming is very useful and user friendly in case of your
examples.
Moreover， especially when a business has to be executed in several stages
with dependencies，such as the pipeline of Flink ML, in order to utilize the
Hi Xingcan,
These a great points. We are on the same page regarding potential
capabilities of the proposed changes. There are actually two main parts in
the proposal, the API and the underlying service. Both parts can be
extended in the future.
We made a few design choices when draft the doc to
Hi Xingcan,
I think you probably misunderstood our proposal. The proposed “cache()” API
basically infers the data is only available for its session, but not
forever available for other sessions to access. It will be cleaned when the
session exits. “cache” does not imply the underlying
YUZHOU HONG created FLINK-10982:
---
Summary: Test DataStream to Table for Flink 1.6.2
Key: FLINK-10982
URL: https://issues.apache.org/jira/browse/FLINK-10982
Project: Flink
Issue Type: Test
Thanks Piotrek,
> void SplitReader#addSplit(Split)
> boolean SplitReader#doesWantMoreSplits()
I have two questions about this API.
1. What if the SplitReader implementation cannot easily add a split to read
on the fly?
2. Does Flink have to be involved in splits assignment?
I am wondering if it
Yun Gao created FLINK-10981:
---
Summary: Add or modify metrics to show the maximum usage of
InputBufferPool/OutputBufferPool to help debugging back pressure
Key: FLINK-10981
URL:
Hi guys:
Could somebody give me contributor permissions? my jira username is :
zhongwei.
Thanks.
sunjincheng created FLINK-10979:
---
Summary: Add support for group keys in Unbounded
Aggregate/FlatAggregate operator
Key: FLINK-10979
URL: https://issues.apache.org/jira/browse/FLINK-10979
Project:
sunjincheng created FLINK-10978:
---
Summary: Add UnBounded FlatAggregate operator to batch Table API
Key: FLINK-10978
URL: https://issues.apache.org/jira/browse/FLINK-10978
Project: Flink
Issue
sunjincheng created FLINK-10977:
---
Summary: Add UnBounded FlatAggregate operator to streaming Table
API
Key: FLINK-10977
URL: https://issues.apache.org/jira/browse/FLINK-10977
Project: Flink
sunjincheng created FLINK-10976:
---
Summary: Add Aggregate operator to Table API
Key: FLINK-10976
URL: https://issues.apache.org/jira/browse/FLINK-10976
Project: Flink
Issue Type: Sub-task
sunjincheng created FLINK-10975:
---
Summary: Add support for TimeAttribute in Map/FlatMap operator
Key: FLINK-10975
URL: https://issues.apache.org/jira/browse/FLINK-10975
Project: Flink
Issue
sunjincheng created FLINK-10974:
---
Summary: Add FlatMap to TableAPI
Key: FLINK-10974
URL: https://issues.apache.org/jira/browse/FLINK-10974
Project: Flink
Issue Type: Sub-task
sunjincheng created FLINK-10973:
---
Summary: Add Map operator to Table API
Key: FLINK-10973
URL: https://issues.apache.org/jira/browse/FLINK-10973
Project: Flink
Issue Type: Sub-task
sunjincheng created FLINK-10972:
---
Summary: Enhancements to Flink Table API
Key: FLINK-10972
URL: https://issues.apache.org/jira/browse/FLINK-10972
Project: Flink
Issue Type: Improvement
Hi Piotrek，
#1）We have unbounded and bounded group window aggregate, for unbounded case
we should early fire the result with retract message, we can not using
watermark, because unbounded aggregate never finished. (for improvement we
can introduce micro-batch in feature), for bounded window we
Ufuk Celebi created FLINK-10971:
---
Summary: Dependency convergence issue when building
flink-s3-fs-presto
Key: FLINK-10971
URL: https://issues.apache.org/jira/browse/FLINK-10971
Project: Flink
Steven Zhen Wu created FLINK-10969:
--
Summary: expose API or metric for total number of keys stored in
state backend
Key: FLINK-10969
URL: https://issues.apache.org/jira/browse/FLINK-10969
Project:
JIN SUN created FLINK-10968:
---
Summary: Implement TaskManager Entrypoint
Key: FLINK-10968
URL: https://issues.apache.org/jira/browse/FLINK-10968
Project: Flink
Issue Type: Sub-task
Thanks Chesnay for going through the release notes. I've updated them
accordingly.
Concerning the test dependency and the LICENSE/NOTICE files, I'm looking
into it and will report back.
Cheers,
Till
On Wed, Nov 21, 2018 at 3:46 PM Chesnay Schepler wrote:
> Our LICENSE/NOTICE files in the
Ismael Juma created FLINK-10967:
---
Summary: Update kafka dependency to 2.1.0
Key: FLINK-10967
URL: https://issues.apache.org/jira/browse/FLINK-10967
Project: Flink
Issue Type: Bug
vinoyang created FLINK-10966:
Summary: Optimize the release blocking logic in BarrierBuffer
Key: FLINK-10966
URL: https://issues.apache.org/jira/browse/FLINK-10966
Project: Flink
Issue Type:
Hi all,
Thanks for the replies.
@Becket I think whether putting the persist/cache methods in a separated util
class or inside the DataSet/Table depends on what we want to introduce. The
former one sounds more like a data storage component where users may even
somehow get a stored
Folks,
We've been having a tough time building a spring boot app (Jar) to get
our Flink jobs running in our Flink Cluster.
The Spring Application Context is always getting set to null - while the
flink job is running - did anyone had luck with this ?. Any help would
be appreciated.
Thanks
shaomeng.wang created FLINK-10965:
-
Summary: suggest that change $resultTypeTerm to Object at
org.apache.flink.table.codegen.calls.ScalarFunctionCallGen:104
Key: FLINK-10965
URL:
Seth Wiesman created FLINK-10964:
Summary: sql-client throws exception when pagin through finished
batch query
Key: FLINK-10964
URL: https://issues.apache.org/jira/browse/FLINK-10964
Project: Flink
Our LICENSE/NOTICE files in the binary distribution may also be botched
(and may have been for quite some time).
As per http://www.apache.org/dev/licensing-howto.html#binary "|[...]
LICENSE| and |NOTICE| must *exactly* represent the contents of the
distribution they reside in.", which also
Kostas Kloudas created FLINK-10963:
--
Summary: Cleanup small objects uploaded to S3 as independent
objects
Key: FLINK-10963
URL: https://issues.apache.org/jira/browse/FLINK-10963
Project: Flink
Hello Till,
it's a good point you are bringing up here. One of the reasons why there
> are some irregularities is that the code has grown quite a bit over time.
> Another is that we have established checkstyle rules but they are not yet
> activated for all modules because the initial effort to
Hi again,
> However I don't like the thread mode which starts a thread for each split.
> Starting extra thread in operator is not an ideal way IMO. Especially
> thread count is decided by split count. So I was wondering if there is a
> more elegant way. Do we really want these threads in Flink
I may have found a potential blocker while looking at dependencies:
flink-tests now has a non-optional test dependency on oshi-core, which
is licensed under EPL 1.0.
As per https://issues.apache.org/jira/browse/LEGAL-207, test
dependencies are not exempt from license restrictions.
We thus
Hi Aljoscha,
Good point on the potential optimization in the source. One thing to
clarify, by "adding a minimumTimestamp()/maximumTimestamp() method pair to
the split interface", did you mean "split reader interface"? If so, what
should the readers do if they do not have such additional
Hi Miguel,
it's a good point you are bringing up here. One of the reasons why there
are some irregularities is that the code has grown quite a bit over time.
Another is that we have established checkstyle rules but they are not yet
activated for all modules because the initial effort to fix all
Hi Jincheng,
> #1） No，watermark solves the issue of the late event. Here, the performance
> problem is caused by the update emit mode. i.e.: When current calculation
> result is output, the previous calculation result needs to be retracted.
Hmm, yes I missed this. For time-windowed cases (some
Nico Kruber created FLINK-10962:
---
Summary: Allow correlations between subtask metrics and checkpoint
metrics
Key: FLINK-10962
URL: https://issues.apache.org/jira/browse/FLINK-10962
Project: Flink
Avi Levi created FLINK-10961:
Summary: RuntimeException: Could not extract key when using
closure
Key: FLINK-10961
URL: https://issues.apache.org/jira/browse/FLINK-10961
Project: Flink
Issue
+1
Flavio Pompermaier 于2018年11月21日周三 下午7:24写道：
> +1
>
> On Wed, Nov 21, 2018 at 12:05 PM Saar Bar wrote:
>
> > agree
> >
> > Sent from my iPhone
> >
> > > On 21 Nov 2018, at 13:03, Maximilian Michels wrote:
> > >
> > > Hi!
> > >
> > > Do you think it would make sense to send JIRA
Thomas Wozniakowski created FLINK-10960:
---
Summary: CEP: Job Failure when .times(2) is used
Key: FLINK-10960
URL: https://issues.apache.org/jira/browse/FLINK-10960
Project: Flink
Issue
Hi shaoxuan & Hequn,
Thanks for your suggestion，I'll file the JIRAs later.
We can prepare PRs while continuing to move forward the ongoing discussion.
Regards，
Jincheng
jincheng sun 于2018年11月21日周三 下午7:07写道：
> Hi Piotrek,
> Thanks for your feedback, and thanks for share your thoughts!
>
> #1）
+1
On Wed, Nov 21, 2018 at 12:05 PM Saar Bar wrote:
> agree
>
> Sent from my iPhone
>
> > On 21 Nov 2018, at 13:03, Maximilian Michels wrote:
> >
> > Hi!
> >
> > Do you think it would make sense to send JIRA notifications to a
> separate mailing list? Some people just want to casually follow
Hi Piotrek,
Thanks for your feedback, and thanks for share your thoughts!
#1） No，watermark solves the issue of the late event. Here, the performance
problem is caused by the update emit mode. i.e.: When current calculation
result is output, the previous calculation result needs to be retracted.
agree
Sent from my iPhone
> On 21 Nov 2018, at 13:03, Maximilian Michels wrote:
>
> Hi!
>
> Do you think it would make sense to send JIRA notifications to a separate
> mailing list? Some people just want to casually follow the mailing list and
> it requires a filter to delete all the
Hi!
Do you think it would make sense to send JIRA notifications to a
separate mailing list? Some people just want to casually follow the
mailing list and it requires a filter to delete all the JIRA mails.
We already have an "issues" mailing list which receives the JIRA
notifications:
I looked through the release notes:
Entries that shouldn't be included:
* [FLINK-9983] - Savepoints should count as checkpoints when recovering
o duplicate of FLINK-1035
* [FLINK-10714] - java.lang.IndexOutOfBoundsException when creating a
heap backend snapshot
o closed as "Not a
Hi Becket,
I think the Flink Service is a good abstraction, with which we can easily
build Interactive Programing or some other features.
We might bring the concept of 'Session', then we can think of Flink
Services as system processes and user jobs as user processes, so the
management of life
Yee created FLINK-10959:
---
Summary: most taskmanger in the same node
Key: FLINK-10959
URL: https://issues.apache.org/jira/browse/FLINK-10959
Project: Flink
Issue Type: Bug
Reporter: Yee
Hi,
1.
> In fact, in addition to the design of APIs, there will be various
> performance optimization details, such as: table Aggregate function
> emitValue will generate multiple calculation results, in extreme cases,
> each record will trigger a large number of retract messages, this will have
Hi,
Thank you all for the great proposal and discussion!
I also prefer to move on to the next step, so +1 for opening the JIRAs to
start the work.
We can have more detailed discussion there. Btw, we can start with JIRAs
which we have agreed on.
Best,
Hequn
On Tue, Nov 20, 2018 at 11:38 PM
Hequn Cheng created FLINK-10957:
---
Summary: Adapt documents about DataStream to Table conversion
Key: FLINK-10957
URL: https://issues.apache.org/jira/browse/FLINK-10957
Project: Flink
Issue
Dian Fu created FLINK-10958:
---
Summary: Add overload support for user defined function
Key: FLINK-10958
URL: https://issues.apache.org/jira/browse/FLINK-10958
Project: Flink
Issue Type: Task
52 matches
Mail list logo
