Thanks Jincheng for your effort!
On Sat, 1 Jun 2019 at 05:19, Bowen Li wrote:
> Thanks Jincheng for driving this release!
>
> On Thu, May 30, 2019 at 11:40 PM Terry Wang wrote:
>
> > Wow~ Glad to see this!
> > Thanks Jincheng and Chesnay for your effort!
> >
> > > 在 2019年5月31日,下午1:53,jincheng s
Hi all,
As we mentioned in some conference, such as Flink Forward SF 2019 and QCon
Beijing 2019, our team has implemented "Local aggregation" in our inner
Flink fork. This feature can effectively alleviate data skew.
Currently, keyed streams are widely used to perform aggregating operations
(e.g.
Nice feature.
Looking forward to having it in Flink.
Regards,
Xiaogang
vino yang 于2019年6月3日周一 下午3:31写道:
> Hi all,
>
> As we mentioned in some conference, such as Flink Forward SF 2019 and QCon
> Beijing 2019, our team has implemented "Local aggregation" in our inner
> Flink fork. This feature c
Hi again :)
> - pending.bytes, Gauge
> - pending.messages, Gauge
+1
And true, instead of overloading one of the metric it is better when user can
choose to provide only one of them.
Re 2:
> If I understand correctly, this metric along with the pending mesages /
> bytes would answer the q
Excited and Big +1 for this feature.
SHI Xiaogang 于2019年6月3日周一 下午3:37写道:
> Nice feature.
> Looking forward to having it in Flink.
>
> Regards,
> Xiaogang
>
> vino yang 于2019年6月3日周一 下午3:31写道:
>
> > Hi all,
> >
> > As we mentioned in some conference, such as Flink Forward SF 2019 and
> QCon
> >
Andrey Zagrebin created FLINK-12706:
---
Summary: Introduce ShuffleManager interface and its configuration
Key: FLINK-12706
URL: https://issues.apache.org/jira/browse/FLINK-12706
Project: Flink
Hi,
+1 for the idea from my side. I’ve even attempted to add similar feature quite
some time ago, but didn’t get enough traction [1].
I’ve read through your document and I couldn’t find it mentioning anywhere,
when the pre aggregated result should be emitted down the stream? I think
that’s one
liuzhaokun created FLINK-12707:
--
Summary: Close minicluster will cause memory leak when there are
StreamTask closed abnormal
Key: FLINK-12707
URL: https://issues.apache.org/jira/browse/FLINK-12707
Proje
Hi Piotr,
The localKeyBy API returns an instance of KeyedStream (we just added an
inner flag to identify the local mode) which is Flink has provided before.
Users can call all the APIs(especially *window* APIs) which KeyedStream
provided.
So if users want to use local aggregation, they should cal
Jark Wu created FLINK-12708:
---
Summary: Introduce new Interfaces for source and sink to make
Blink runner work
Key: FLINK-12708
URL: https://issues.apache.org/jira/browse/FLINK-12708
Project: Flink
Hi,
Some portion of the code could be migrated to the new Table API no?
I am saying that because the new API design is based on scikit-learn and
the old one was also inspired by it.
Best,
Stavros
On Wed, May 22, 2019 at 1:24 PM Shaoxuan Wang wrote:
> Another consensus (from the offline discussi
Hi Richard,
I've pulled in Gordon who worked on this feature. He should be able to tell
you about the current limitations of Flink's schema evolution.
Cheers,
Till
On Wed, May 29, 2019 at 1:44 PM Richard Deurwaarder wrote:
> Hello,
>
> I am running into the problem where (avro) schema evolutio
Hi Richard,
Schema evolution for data types that are used as keys is not allowed
because, potentially, if the schema of the key changes, hash codes of keys
may also change and can break partitioning for internal state managed by
Flink.
There are of course some evolution scenarios that would not re
Zhu Zhu created FLINK-12709:
---
Summary: Implement RestartBackoffTimeStrategyFactoryLoader
Key: FLINK-12709
URL: https://issues.apache.org/jira/browse/FLINK-12709
Project: Flink
Issue Type: Sub-task
Thanks a lot to Jincheng and Chesnay and to the community making this
release possible!
Best, Hequn
On Mon, Jun 3, 2019 at 3:16 PM Jark Wu wrote:
> Thanks Jincheng for your effort!
>
> On Sat, 1 Jun 2019 at 05:19, Bowen Li wrote:
>
> > Thanks Jincheng for driving this release!
> >
> > On Thu,
Timo Walther created FLINK-12710:
Summary: Unify built-in and user-defined functions in the API
Key: FLINK-12710
URL: https://issues.apache.org/jira/browse/FLINK-12710
Project: Flink
Issue Ty
Timo Walther created FLINK-12711:
Summary: Separate function implementation and definition
Key: FLINK-12711
URL: https://issues.apache.org/jira/browse/FLINK-12711
Project: Flink
Issue Type: S
Thanks a lot Jincheng and to the community for making this release possible.
Cheers,
Till
On Mon, Jun 3, 2019 at 2:14 PM Hequn Cheng wrote:
> Thanks a lot to Jincheng and Chesnay and to the community making this
> release possible!
>
> Best, Hequn
>
> On Mon, Jun 3, 2019 at 3:16 PM Jark Wu wro
Hi all,
Cascading implemented this “map-side reduce” functionality with an LLR cache.
That worked well, as then the skewed keys would always be in the cache.
The API let you decide the size of the cache, in terms of number of entries.
Having a memory limit would have been better for many of our
Bowen Li created FLINK-12712:
Summary: deprecate ExternalCatalog and its subclasses and impls
Key: FLINK-12712
URL: https://issues.apache.org/jira/browse/FLINK-12712
Project: Flink
Issue Type: Su
Bowen Li created FLINK-12713:
Summary: deprecate descriptor, validator, and factory of
ExternalCatalog
Key: FLINK-12713
URL: https://issues.apache.org/jira/browse/FLINK-12713
Project: Flink
Issu
Wenshuai Hou created FLINK-12714:
Summary: confusion about flink time window
TimeWindow#getWindowStartWithOffset
Key: FLINK-12714
URL: https://issues.apache.org/jira/browse/FLINK-12714
Project: Flink
Hi Ken,
Thanks for your reply.
As I said before, we try to reuse Flink's state concept (fault tolerance
and guarantee "Exactly-Once" semantics). So we did not consider cache.
In addition, if we use Flink's state, the OOM related issue is not a key
problem we need to consider.
Best,
Vino
Ken Kr
Rui Li created FLINK-12715:
--
Summary: Hive-1.2.1 build is broken
Key: FLINK-12715
URL: https://issues.apache.org/jira/browse/FLINK-12715
Project: Flink
Issue Type: Sub-task
Reporter: Rui
Dian Fu created FLINK-12716:
---
Summary: Add an interactive shell for Python Table API
Key: FLINK-12716
URL: https://issues.apache.org/jira/browse/FLINK-12716
Project: Flink
Issue Type: Sub-task
Dian Fu created FLINK-12717:
---
Summary: Add windows support for the Python shell script
Key: FLINK-12717
URL: https://issues.apache.org/jira/browse/FLINK-12717
Project: Flink
Issue Type: Sub-task
Bowen Li created FLINK-12718:
Summary: allow users to specify hive-site.xml location to
configure hive metastore client in HiveCatalog
Key: FLINK-12718
URL: https://issues.apache.org/jira/browse/FLINK-12718
Dian Fu created FLINK-12719:
---
Summary: Add the catalog API for the Python Table API
Key: FLINK-12719
URL: https://issues.apache.org/jira/browse/FLINK-12719
Project: Flink
Issue Type: Sub-task
Dian Fu created FLINK-12720:
---
Summary: Add the Python Table API Sphinx docs
Key: FLINK-12720
URL: https://issues.apache.org/jira/browse/FLINK-12720
Project: Flink
Issue Type: Sub-task
Com
aloyszhang created FLINK-12721:
--
Summary: make flink-json more precisely when handle integer type
Key: FLINK-12721
URL: https://issues.apache.org/jira/browse/FLINK-12721
Project: Flink
Issue Typ
Dian Fu created FLINK-12722:
---
Summary: Adds Python Table API tutorial
Key: FLINK-12722
URL: https://issues.apache.org/jira/browse/FLINK-12722
Project: Flink
Issue Type: Sub-task
Component
Dian Fu created FLINK-12723:
---
Summary: Adds a wiki page about setting up a Python Table API
development environment
Key: FLINK-12723
URL: https://issues.apache.org/jira/browse/FLINK-12723
Project: Flink
Konstantin Knauf created FLINK-12724:
Summary: Add Links to new Concepts Section to Glossary
Key: FLINK-12724
URL: https://issues.apache.org/jira/browse/FLINK-12724
Project: Flink
Issue T
33 matches
Mail list logo