Jeff Zhang created FLINK-31667:
--
Summary: Should not enforce attached mode in RemoteEnvironment &
RemoteStreamEnvironment
Key: FLINK-31667
URL: https://issues.apache.org/jira/browse/FLINK-31667
Pro
gt; is a basic API which almost all flink connectors are built on top of
> > it.
> > >>> The breaking compatibility makes the downstream projects really hard
> to
> > >>> deliver better compatibility to users, unless we iceberg maintain
> > >> different
> > >>> modules for each maintained flink version (That's not the thing that
> we
> > >>> want to do).
> > >>>
> > >>> The last flink upgrading work is also not a good experience (See the
> > >>> discussion (https://github.com/apache/iceberg/pull/1956) and
> comment (
> > >>> https://github.com/apache/iceberg/pull/1956#discussion_r546534299)
> ),
> > >>> because the flink 1.12 also breaks several API that was annotated
> > >>> PublicEvolving in flink 1.11.0, that becomes one of the most
> important
> > >>> reasons leading to the conclusion that stops support flink 1.11.0 in
> > our
> > >>> apache iceberg branch ( Supporting new features [such as flip-27
> > unified
> > >>> iceberg source/sink] that depends the API introduced in flink 1.12 is
> > >>> another reason). To better support the compatibility of downstream
> > >> systems
> > >>> and delivering better experience to flink users, I will strongly
> > suggest
> > >>> the Apache Flink community to pay more attention to ensuring API
> > >>> compatibility.
> > >>>
> > >>>
> > >>> Zheng Hu (openinx)
> > >>>
> > >>> Thanks.
> > >>>
> > >>
> > >
> >
> >
>
--
Best Regards
Jeff Zhang
.14.0.tar.gz
>
> Note that this is only necessary when installing from source. Could also
> refer to [1] for more details.
>
> Regards,
> Dian
>
> [1]
> https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/flinkdev/building/#build-pyflink
>
> > 2021年9月22日 下午10:46，Jeff Z
gt; [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.14.0-rc3
> [3] https://dist.apache.org/repos/dist/release/flink/KEYS
> [4] https://repository.apache.org/content/repositories/orgapacheflink-1451
> [5] https://github.com/apache/flink/releases/tag/release-1.14.0-rc3
> [6] https://github.com/apache/flink-web/pull/466
>
--
Best Regards
Jeff Zhang
cala Shell shortly.
> Thanks all for your input!
>
> Thanks,
>
> Martijn
>
> I'll open up a
>
> On Thu, 16 Sept 2021 at 16:02, Jeff Zhang wrote:
>
>> Hi Martijn,
>>
>> It is a pity that the flink community doesn't have resources to maintain
12349614
> [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.14.0-rc2
> [3] https://dist.apache.org/repos/dist/release/flink/KEYS
> [4] https://repository.apache.org/content/repositories/orgapacheflink-1450
> [5] https://github.com/apache/flink/releases/tag/release-1.14.0-rc2
> [6] https://github.com/apache/flink-web/pull/466
>
--
Best Regards
Jeff Zhang
gt;
> Martijn Visser | Product Manager
>
> mart...@ververica.com
>
> <https://www.ververica.com/>
>
>
> Follow us @VervericaData
>
> --
>
> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> Conference
>
> Stream Processing | Event Driven | Real Time
>
--
Best Regards
Jeff Zhang
-the-easy-way-d9d48a95ae57
The easy way to learn Flink Sql.
Hope it would be helpful for you and welcome to join our community to
discuss with others. http://zeppelin.apache.org/community.html
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-21607:
--
Summary: Twitter table source connector
Key: FLINK-21607
URL: https://issues.apache.org/jira/browse/FLINK-21607
Project: Flink
Issue Type: New Feature
r createJobStatusListener(Properties
> properties);
> > >> >
> > >> > Custom listeners will be created during the
> JobMaster#startScheduling
> > >> > method.
> > >> >
> > >> > If someone would like to implement his own JobStatusListener, he
> will
> > >> > package all the related classes into a standalone jar with a
> > >> >
> > >>
> >
> `META-INF/services/org.apache.flink.runtime.executiongraph.JobStatusListener`
> > >> > file and place it under the `lib/` directory.
> > >> >
> > >> > In addition, I find that there is a Jira ticket similar to what I'm
> > >> > asking: FLINK-17104 but I do not see any comment or update yet. Hope
> > >> anyone
> > >> > could help me move on this feature or give me some suggestions about
> > it.
> > >> >
> > >> > Thanks,
> > >> > Wenhao
> > >> >
> > >>
> > >>
> >
>
--
Best Regards
Jeff Zhang
ase
> newer versions with Scala 2.11 support.
>
> Best,
> Aljoscha
>
> On 2020/09/13 21:48, Jeff Zhang wrote:
> >I would hope we can make scala shell with scala 2.12 before dropping 2.11,
> >many users are still using scala shell to try out new features of flink,
> &g
t;>> have both dropped 2.11 support in recent versions. In fact, Flink's
> >>>>>> universal Kafka connector is stuck on 2.4 because that is the last
> >>>>> version
> >>>>>> with scala 2.11 support.
> >>>>>>
> >>>>>> What are people's thoughts on dropping Scala 2.11? How many are
> >>>>>> still
> >>>>> using
> >>>>>> it in production?
> >>>>>>
> >>>>>> Seth
> >>>>>>
> >>>>>
> >>>>>
> >>>>
> >>>> --
> >>>> Matthieu Bonneviot
> >>>> Senior RD Engineer, DataDome
> >>>> M +33 7 68 29 79 34 <+33+7+68+29+79+34>
> >>>> E matthieu.bonnev...@datadome.co
> >>>> W www.datadome.co
> >>>> <
> >>>>
> http://www.datadome.co?utm_source=WiseStamp_medium=email_term=_content=_campaign=signature
> >>>>
> >>>>>
> >>>>
> >>>> [image: facebook]
> >>>> <
> >>>>
> https://www.facebook.com/datadome/?utm_source=WiseStamp_medium=email_term=_content=_campaign=signature
> >>>>
> >>>>>
> >>>> [image:
> >>>> linkedin]
> >>>> <
> >>>>
> https://fr.linkedin.com/company/datadome?utm_source=WiseStamp_medium=email_term=_content=_campaign=signature
> >>>>
> >>>>>
> >>>> [image:
> >>>> twitter]
> >>>> <
> >>>>
> https://twitter.com/data_dome?utm_source=WiseStamp_medium=email_term=_content=_campaign=signature
> >>>>
> >>>>>
> >>>>
> >>>
> >>
> >
> >
>
>
--
Best Regards
Jeff Zhang
helping Flink users
> to
> > > > solve
> > > > > >their problems (2nd in the all-time ranking, 1st in the last 30
> > > days). A
> > > > > >similar level of activity can be found on the user@ mailing list.
> > > > > >
> > > > > >Please join me in congratulating David for becoming a Flink
> committer!
> > > > > >
> > > > > >Best,
> > > > > >Robert
> > > > >
> > > >
> > >
> >
> >
> > --
> >
> > Arvid Heise | Senior Java Developer
> >
> > <https://www.ververica.com/>
> >
> > Follow us @VervericaData
> >
> > --
> >
> > Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> > Conference
> >
> > Stream Processing | Event Driven | Real Time
> >
> > --
> >
> > Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany
> >
> > --
> > Ververica GmbH
> > Registered at Amtsgericht Charlottenburg: HRB 158244 B
> > Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji
> > (Toni) Cheng
>
--
Best Regards
Jeff Zhang
t;
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12347791
> > [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.10.2-rc2/
> > [3] https://dist.apache.org/repos/dist/release/flink/KEYS
> > [4]
> > https://repository.apache.org/content/repositories/orgapacheflink-1395/
> > [5]
> >
> >
> https://github.com/apache/flink/commit/68bb8b612932e479ca03c7ae7c0080818d89c8a1
> > [6] https://github.com/apache/flink-web/pull/366
> >
>
--
Best Regards
Jeff Zhang
.com/document/d/1ug4K5e2okF5Q2Pzi3qJiUILwwqkn0fVQaQ-Q95HEcJQ/edit#heading=h.x97c6tj78zo0
> Not at this moment, we are working on desr/ser work at the moment. Would be
> good to starts discussion and learn if folks working on related areas and
> align.
>
> Chen
>
> On Sat, Jul 1
approach.
>
> In the long run, we thought out of box thrift format support would benefit
> other folks as well. So the question is if there is already some effort
> around this space we can sync with?
>
> Chen
> Pinterest Data
>
--
Best Regards
Jeff Zhang
gt; > > --
> > > >
> > > > Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> > > > Conference
> > > >
> > > > Stream Processing | Event Driven | Real Time
> > > >
> > > > --
> > > >
> > > > Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany
> > > >
> > > > --
> > > > Ververica GmbH
> > > > Registered at Amtsgericht Charlottenburg: HRB 158244 B
> > > > Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason,
> Ji
> > > > (Toni) Cheng
> > > >
> > >
> >
>
--
Best Regards
Jeff Zhang
tive on Flink's Statebackend component, working
> on
> >>> various improvements, for example the RocksDB memory management for
> 1.10.
> >>> and keeps checking and voting for our releases, and also has
> successfully
> >>> produced two releases(1.10.0&1.10.1) as RM.
> >>>
> >>> Congratulations & Welcome Yu Li!
> >>>
> >>> Best,
> >>> Jincheng (on behalf of the Flink PMC)
> >>
> >>
>
>
>
--
Best Regards
Jeff Zhang
o announce Benchao Li as
> > a
> > new
> > Apache
> > Flink committer.
> >
> > Benchao started contributing to Flink since late 2018. He is
> > very
> > active
> > in
> > Flink SQL component,
> > and has also participated in many discussions, bug fixes. Over
> > the
> > past
> > few
> > months, he helped tremendously in answering user questions in
> > the
> > mailing
> > list.
> >
> > Please join me in congratulating Benchao for becoming a Flink
> > committer!
> >
> > Thanks,
> > Jark
> >
> >
> >
> >
> >
> >
> >
>
>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-18167:
--
Summary: Flink Job hangs there when one vertex is failed and
another is cancelled.
Key: FLINK-18167
URL: https://issues.apache.org/jira/browse/FLINK-18167
Project
link resource management, and have
> also
> >> participated in discussions, bug fixes and answering questions.
> >>
> >> Please join me in congratulating Xintong for becoming a Flink committer!
> >>
> >> Thanks,
> >>
> >> Jiangjie (Becket) Qin
> >>
> >
> >
> > --
> >
> > Best,
> > Benchao Li
>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-17944:
--
Summary: Wrong output in sql client's table mode
Key: FLINK-17944
URL: https://issues.apache.org/jira/browse/FLINK-17944
Project: Flink
Issue Type: Improvement
Jeff Zhang created FLINK-17889:
--
Summary: flink-connector-hive jar contains wrong class in its SPI
config file org.apache.flink.table.factories.TableFactory
Key: FLINK-17889
URL: https://issues.apache.org/jira
Jeff Zhang created FLINK-17870:
--
Summary: scala shell jars are missing to be shipped to cluster
Key: FLINK-17870
URL: https://issues.apache.org/jira/browse/FLINK-17870
Project: Flink
Issue Type
Jeff Zhang created FLINK-17788:
--
Summary: scala shell in yarn mode is broken
Key: FLINK-17788
URL: https://issues.apache.org/jira/browse/FLINK-17788
Project: Flink
Issue Type: Bug
Jeff Zhang created FLINK-17763:
--
Summary: No log files when starting scala-shell
Key: FLINK-17763
URL: https://issues.apache.org/jira/browse/FLINK-17763
Project: Flink
Issue Type: Bug
a vote about it.
> >>>>>>
> >>>>>> The proposal is that the Flink community starts to guarantee
> >>>>>> that @PublicEvolving classes will be API and binary compatible
> >> across
> >>>> bug
> >>>>>> fix releases of the same minor version. This means that a version
> >> x.y.u
> >>>>> is
> >>>>>> API and binary compatible to x.y.v with u <= v wrt all
> >> @PublicEvolving
> >>>>>> classes.
> >>>>>>
> >>>>>> The voting options are the following:
> >>>>>>
> >>>>>> * +1, Provide the above described guarantees
> >>>>>> * -1, Do not provide the above described guarantees (please provide
> >>>>>> specific comments)
> >>>>>>
> >>>>>> The vote will be open for at least 72 hours. It is adopted by
> >> majority
> >>>>>> approval with at least 3 PMC affirmative votes.
> >>>>>>
> >>>>>> [1]
> >>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>
> https://lists.apache.org/thread.html/rb0d0f887b291a490ed3773352c90ddf5f11e3d882dc501e3b8cf0ed0%40%3Cdev.flink.apache.org%3E
> >>>>>>
> >>>>>> Cheers,
> >>>>>> Till
> >>>>>>
> >>>>>
> >>>>>
> >>>>
> >>
>
>
--
Best Regards
Jeff Zhang
terId (yarn app id for instance) that we
> can use to enhance CLI experience in multi cluster (lot of per-job
> clusters) environments. Please let us know what you think! Gyula
>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-17588:
--
Summary: Throw exception when hadoop jar is missing in flink
scala's yarn mode.
Key: FLINK-17588
URL: https://issues.apache.org/jira/browse/FLINK-17588
Project: Flink
e demo as shown in the picture .the parameter named 'env'
> containes all the operators about job ,like sources,maps,etc..
>
> Thank you for your attention.
>
>
>
>
--
Best Regards
Jeff Zhang
nk and Flink ML Pipeline.
> Besides,
> > > Hequn is also very active in the community since the beginning.
> > >
> > > Congratulations, Hequn! Looking forward to your future contributions.
> > >
> > > Thanks,
> > >
> > > Jiangjie (Becket) Qin
> > > (On behalf of the Apache Flink PMC)
> >
> >
>
--
Best Regards
Jeff Zhang
nk-shaded-netty-tcnative-dynamic-2.0.25.Final-9.0.jar
> - flink-sql-client_2.12-1.10.0.jar
> - flink-state-processor-api_2.12-1.10.0.jar
> - flink-swift-fs-hadoop-1.10.0.jar
>
> Current Flink dist is 267M. If we removed everything from opt we would
> go down to 126M. I would reccomend this, because the large majority of
> the files in opt are probably unused.
>
> What do you think?
>
> Best,
> Aljoscha
>
>
--
Best Regards
Jeff Zhang
ttp://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-120-Support-conversion-between-PyFlink-Table-and-Pandas-DataFrame-tt39611.html
> > > <
> > >
> >
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-120-Support-conversion-between-PyFlink-Table-and-Pandas-DataFrame-tt39611.html
> > > >
> >
>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-16969:
--
Summary: Unable to use case class in flink scala shell
Key: FLINK-16969
URL: https://issues.apache.org/jira/browse/FLINK-16969
Project: Flink
Issue Type: Bug
Jeff Zhang created FLINK-16936:
--
Summary: TablEnv creation and planner execution must be in the
same thread
Key: FLINK-16936
URL: https://issues.apache.org/jira/browse/FLINK-16936
Project: Flink
- Konstantin Knauf joined as a committer. You may know him,
> for
> > > > > >> example,
> > > > > >>> from the weekly community updates.
> > > > > >>>
> > > > > >>> - Dawid Wysakowicz joined the PMC. Dawid is one of the main
> > > > developers
> > > > > >> on
> > > > > >>> the Table API.
> > > > > >>>
> > > > > >>> - Zhijiang Wang joined the PMC. Zhijiang is a veteran of
> Flink's
> > > > > >> network
> > > > > >>> / data shuffle system.
> > > > > >>>
> > > > > >>> A warm welcome to your new roles in the Flink project!
> > > > > >>>
> > > > > >>> Best,
> > > > > >>> Stephan
> > > > > >>>
> > > > > >>
> > > > > >>
> > > > > >> --
> > > > > >> Best, Jingsong Lee
> > > > > >>
> > > > >
> > > > >
> > > >
> > >
> >
>
--
Best Regards
Jeff Zhang
this design. Does that make sense to
> you?
>
> Thanks,
> Dian
>
> [1] https://issues.apache.org/jira/browse/FLINK-14807 <
> https://issues.apache.org/jira/browse/FLINK-14807>
> > 在 2020年4月1日，上午11:14，Jeff Zhang 写道：
> >
> > Thanks Dian for driving this, definitel
feedback!
>
> Regards,
> Dian
>
> [1]
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-120%3A+Support+conversion+between+PyFlink+Table+and+Pandas+DataFrame
--
Best Regards
Jeff Zhang
m/RBHa2lTIg5 <https://t.co/sUapN40tvI?amp=1> 4) Advanced
usage https://link.medium.com/CAekyoXIg5 <https://t.co/MXolULmafZ?amp=1>
Welcome to use flink on zeppelin and give feedback and comments.
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-16797:
--
Summary: Flink doesn't merge multiple sinks into one DAG
Key: FLINK-16797
URL: https://issues.apache.org/jira/browse/FLINK-16797
Project: Flink
Issue Type: Bug
Jeff Zhang created FLINK-16604:
--
Summary: Column key in JM configuration is too narrow
Key: FLINK-16604
URL: https://issues.apache.org/jira/browse/FLINK-16604
Project: Flink
Issue Type
t; >
> > [1] https://issues.apache.org/jira/browse/FLINK-16227
> > [2] https://issues.apache.org/jira/browse/FLINK-13396
> > [3] https://issues.apache.org/jira/browse/FLINK-9749
>
--
Best Regards
Jeff Zhang
gt; > scope and even be linked from release notes.
> > > > > > > >
> > > > > > > > Examples from our team to give a more specific idea:
> > > > > > > > * Deprecated checkpoint lock and mailbox model
> > > > > > > > * Revised interface for two phase commit sinks and new JDBC
> > sink
> > > > > > > > * N-ary input operators
> > > > > > > > * Unaligned checkpoints
> > > > > > > > * Operator factories
> > > > > > > > * Plugins
> > > > > > > >
> > > > > > > > These articles would be less formal than a FLIP (but could
> link
> > > to
> > > > > them
> > > > > > > to
> > > > > > > > avoid redundancy) and focus more on how other developers are
> > > > actually
> > > > > > > > impacted by the changes. It can also be used to share
> > experiences
> > > > > > during
> > > > > > > > the implementation.
> > > > > > > >
> > > > > > > > We would like to ask the other teams if they see a benefit of
> > > such
> > > > a
> > > > > > blog
> > > > > > > > and would like to contribute. Bonus points if you could
> provide
> > > > > > examples
> > > > > > > of
> > > > > > > > your topics.
> > > > > > > >
> > > > > > > > Best,
> > > > > > > >
> > > > > > > > Arvid
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> > >
> > > --
> > >
> > > Benchao Li
> > > School of Electronics Engineering and Computer Science, Peking
> University
> > > Tel:+86-15650713730
> > > Email: libenc...@gmail.com; libenc...@pku.edu.cn
> > >
> >
>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-16286:
--
Summary: Support select from nothing
Key: FLINK-16286
URL: https://issues.apache.org/jira/browse/FLINK-16286
Project: Flink
Issue Type: New Feature
Affects
tulations Jingsong! Well deserved.
> > >
> > > Best,
> > > Jark
> > >
> > > On Fri, 21 Feb 2020 at 11:32, zoudan wrote:
> > >
> > >> Congratulations! Jingsong
> > >>
> > >>
> > >> Best,
> > >> Dan Zou
> > >>
> >
> >
>
--
Best Regards
Jeff Zhang
> of Apache Flink 1.10.0, which is the latest major release.
> >>>>>>>>
> >>>>>>>> Apache Flink® is an open-source stream processing framework for
> distributed, high-performing, always-available, and accurate data streaming
> applications.
> >>>>>>>>
> >>>>>>>> The release is available for download at:
> >>>>>>>> https://flink.apache.org/downloads.html
> >>>>>>>>
> >>>>>>>> Please check out the release blog post for an overview of the
> improvements for this new major release:
> >>>>>>>> https://flink.apache.org/news/2020/02/11/release-1.10.0.html
> >>>>>>>>
> >>>>>>>> The full release notes are available in Jira:
> >>>>>>>>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12345845
> >>>>>>>>
> >>>>>>>> We would like to thank all contributors of the Apache Flink
> community who made this release possible!
> >>>>>>>>
> >>>>>>>> Cheers,
> >>>>>>>> Gary & Yu
> >>
> >>
> >
> >
> > --
> > Best, Jingsong Lee
>
--
Best Regards
Jeff Zhang
t; > > > intended were bundled in the flink-shaded-hadoop-2-uber jar, which
> was
> > > > flagged by security checks.
> > > >
> > > > Are there any other changes that people are interested in doing?
> > > >
> > > >
> > > > Regards,
> > > >
> > > > Chesnay
> > > >
> > > >
> > >
> >
>
--
Best Regards
Jeff Zhang
ink-ml-api` and `flink-ml-lib` in opt.
> >>
> >> BTW: I think would be great if bring up a discussion for upload
> >>
> >> multiple
> >>
> >> Jars at the same time. as PyFlink JOB also can have the benefit
> >>
> >> if
> >>
> >> we
> >>
> >> do
> >>
> >> that improvement.
> >>
> >> Best,
> >> Jincheng
> >>
> >>
> >> Hequn Cheng 于2020年1月8日周三
> 上午11:50写道：
> >>
> >>
> >> Hi everyone,
> >>
> >> FLIP-39[1] rebuilds Flink ML pipeline on top of TableAPI
> >>
> >> which
> >>
> >> moves
> >>
> >> Flink
> >>
> >> ML a step further. Base on it, users can develop their ML
> >>
> >> jobs
> >>
> >> and
> >>
> >> more
> >>
> >> and
> >>
> >> more machine learning platforms are providing ML services.
> >>
> >> However, the problem now is the jars of flink-ml-api and
> >>
> >> flink-ml-lib
> >>
> >> are
> >>
> >> only exist on maven repo. Whenever users want to submit ML
> >>
> >> jobs,
> >>
> >> they
> >>
> >> can
> >>
> >> only depend on the ml modules and package a fat jar. This
> >>
> >> would be
> >>
> >> inconvenient especially for the machine learning platforms on
> >>
> >> which
> >>
> >> nearly
> >>
> >> all jobs depend on Flink ML modules and have to package a fat
> >>
> >> jar.
> >>
> >> Given this, it would be better to include jars of
> >>
> >> flink-ml-api
> >>
> >> and
> >>
> >> flink-ml-lib in the `opt` folder, so that users can directly
> >>
> >> use
> >>
> >> the
> >>
> >> jars
> >>
> >> with the binary release. For example, users can move the jars
> >>
> >> into
> >>
> >> the
> >>
> >> `lib` folder or use -j to upload the jars. (Currently, -j
> >>
> >> only
> >>
> >> support
> >>
> >> upload one jar. Supporting multi jars for -j can be discussed
> >>
> >> in
> >>
> >> another
> >>
> >> discussion.)
> >>
> >> Putting the jars in the `opt` folder instead of the `lib`
> >>
> >> folder
> >>
> >> is
> >>
> >> because
> >>
> >> currently, the ml jars are still optional for the Flink
> >>
> >> project by
> >>
> >> default.
> >>
> >> What do you think? Welcome any feedback!
> >>
> >> Best,
> >>
> >> Hequn
> >>
> >> [1]
> >>
> >>
> >>
> >>
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-39+Flink+ML+pipeline+and+ML+libs
> >>
> >>
> >>
>
--
Best Regards
Jeff Zhang
a bit weird to have 2 hooks instead of one.
>
> It would be much nicer if we could somehow go back from JobGraph to
> StreamGraph or at least have an easy way to access source/sink UDFS.
>
> What do you think?
>
> Cheers,
> Gyula
>
--
Best Regards
Jeff Zhang
> https://linuxize.com/post/how-to-list-files-in-linux-using-the-ls-command/
>
>
> Best,
>
> Jingsong Lee
>
> On Thu, Feb 6, 2020 at 3:09 PM Jeff Zhang wrote:
>
> > -1, I just found one critical issue
> > https://issues.apache.org/jira/browse/FLINK-1593
ure/ReleaseNote.jspa?projectId=12315522=12345845
> > > [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.10.0-rc2/
> > > [3] https://dist.apache.org/repos/dist/release/flink/KEYS
> > > [4]
> > https://repository.apache.org/content/repositories/orgapacheflink-1332
> > > [5] https://github.com/apache/flink/releases/tag/release-1.10.0-rc2
> > > [6] https://github.com/apache/flink-web/pull/302
> > > [7] https://github.com/apache/flink-web/pull/301
> > >
> >
>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-15935:
--
Summary: Unable to use watermark when depends both on flink
planner and blink planner
Key: FLINK-15935
URL: https://issues.apache.org/jira/browse/FLINK-15935
Project
; forward to your feedback!
>>>
>>> Best,
>>> Jincheng
>>>
>>> [1]
>>>
>>> https://lists.apache.org/thread.html/4a4d23c449f26b66bc58c71cc1a5c6079c79b5049c6c6744224c5f46%40%3Cdev.flink.apache.org%3E
>>> [2]
>>>
>>> https://lists.apache.org/thread.html/8273a5e8834b788d8ae552a5e177b69e04e96c0446bb90979444deee%40%3Cprivate.flink.apache.org%3E
>>> [3]
>>>
>>> https://lists.apache.org/thread.html/ra27644a4e111476b6041e8969def4322f47d5e0aae8da3ef30cd2926%40%3Cdev.flink.apache.org%3E
>>>
>>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-15858:
--
Summary: Unable to use HiveCatalog and kafka together
Key: FLINK-15858
URL: https://issues.apache.org/jira/browse/FLINK-15858
Project: Flink
Issue Type: Bug
me congratulating Dian for becoming a Flink committer !
>
> Best,
> Jincheng(on behalf of the Flink PMC)
>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-15592:
--
Summary: Streaming sql throw hive related sql when it doesn't use
any hive table
Key: FLINK-15592
URL: https://issues.apache.org/jira/browse/FLINK-15592
Project: Flink
Jeff Zhang created FLINK-15569:
--
Summary: Incorrect sample code in udf document
Key: FLINK-15569
URL: https://issues.apache.org/jira/browse/FLINK-15569
Project: Flink
Issue Type: Improvement
Jeff Zhang created FLINK-15566:
--
Summary: Flink implicitly order the fields in PojoTypeInfo
Key: FLINK-15566
URL: https://issues.apache.org/jira/browse/FLINK-15566
Project: Flink
Issue Type
Jeff Zhang created FLINK-15562:
--
Summary: Unable to create walk through project
Key: FLINK-15562
URL: https://issues.apache.org/jira/browse/FLINK-15562
Project: Flink
Issue Type: Bug
efault planner for the whole Table API & SQL is another
>> topic
>> >> and is out of scope of this discussion.
>> >>
>> >> What do you think?
>> >>
>> >> Best,
>> >> Jark
>> >>
>> >> [1]:
>> >>
>> https://ci.apache.org/projects/flink/flink-docs-master/dev/table/streaming/joins.html#join-with-a-temporal-table
>> >> [2]:
>> >>
>> https://ci.apache.org/projects/flink/flink-docs-master/dev/table/sql/queries.html#top-n
>> >> [3]:
>> >>
>> https://ci.apache.org/projects/flink/flink-docs-master/dev/table/sql/queries.html#deduplication
>> >> [4]:
>> >>
>> https://ci.apache.org/projects/flink/flink-docs-master/dev/table/tuning/streaming_aggregation_optimization.html
>> >> [5]:
>> >>
>> https://github.com/apache/flink/blob/master/flink-table/flink-sql-client/conf/sql-client-defaults.yaml#L100
>> >
>>
>>
>
> --
> Best, Jingsong Lee
>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-15439:
--
Summary: Incorrect SQL Document about DDL support
Key: FLINK-15439
URL: https://issues.apache.org/jira/browse/FLINK-15439
Project: Flink
Issue Type: Bug
Jeff Zhang created FLINK-15395:
--
Summary: No API for execute insert into statement
Key: FLINK-15395
URL: https://issues.apache.org/jira/browse/FLINK-15395
Project: Flink
Issue Type: Bug
Jeff Zhang created FLINK-15384:
--
Summary: Allow to pass
ExecutionEnvironment/StreamExecutionEnvironment to TableEnvironment
Key: FLINK-15384
URL: https://issues.apache.org/jira/browse/FLINK-15384
Jeff Zhang created FLINK-15380:
--
Summary: Unable to set number of TM and number of Slot for
MiniCluster in Scala shell
Key: FLINK-15380
URL: https://issues.apache.org/jira/browse/FLINK-15380
Project
gt; > > > > > > >>
> > > > > > > > > >> I'm very happy to announce that Zhu Zhu accepted the
> offer
> > > of
> > > > > the
> > > > > > > > Flink
> > > > > > > > > PMC
> > > > > > > > > >> to become a committer of the Flink project.
> > > > > > > > > >>
> > > > > > > > > >> Zhu Zhu has been an active community member for more
> than
> > a
> > > > year
> > > > > > > now.
> > > > > > > > > Zhu
> > > > > > > > > >> Zhu played an essential role in the scheduler
> refactoring,
> > > > > helped
> > > > > > > > > >> implementing fine grained recovery, drives FLIP-53 and
> > fixed
> > > > > > various
> > > > > > > > > bugs
> > > > > > > > > >> in the scheduler and runtime. Zhu Zhu also helped the
> > > > community
> > > > > by
> > > > > > > > > >> reporting issues, answering user mails and being active
> on
> > > the
> > > > > dev
> > > > > > > > > mailing
> > > > > > > > > >> list.
> > > > > > > > > >>
> > > > > > > > > >> Congratulations Zhu Zhu!
> > > > > > > > > >>
> > > > > > > > > >> Best, Till
> > > > > > > > > >> (on behalf of the Flink PMC)
> > > > > > > > > >>
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Xuefu Zhang
> > > > > > >
> > > > > > > "In Honey We Trust!"
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
--
Best Regards
Jeff Zhang
though we've supported almost all Hive versions [3] now.
>>
>> I want to hear what the community think about this, and how to achieve it
>> if we believe that's the way to go.
>>
>> Cheers,
>> Bowen
>>
>> [1] https://flink.apache.org/downloads.html
>> [2]
>> https://ci.apache.org/projects/flink/flink-docs-master/dev/table/hive/#dependencies
>> [3]
>> https://ci.apache.org/projects/flink/flink-docs-master/dev/table/hive/#supported-hive-versions
>>
>
--
Best Regards
Jeff Zhang
e notes are available in Jira:
> https://issues.apache.org/jira/projects/FLINK/versions/12346112
>
> We would like to thank all contributors of the Apache Flink community who
> made this release possible!
> Great thanks to @Jincheng as a mentor during this release.
>
> Regards,
> Hequn
>
>
>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-15093:
--
Summary: FLINK-13708 still exist in StreamExecutionEnvironment
Key: FLINK-15093
URL: https://issues.apache.org/jira/browse/FLINK-15093
Project: Flink
Issue Type
> >>>> - I'm working on setting up the full matrix of builds (different
> > >>>> scala,
> > >>>> hadoop etc. versions) for the nightlies
> > >>>>
> > >>>> *Next Steps:*
> > >>>> - I propose to document the entire build system in the Flink Wiki
> > >>>> - Once Azure can cover the same pull request tests as Travis, I
> > >>>> would set
> > >>>> it up to run in parallel (including Flinkbot posting links to
> > >>>> Azure). I
> > >>>> hope that this phase lasts for 1-2 weeks only, so that we do not
> > >>>> have to
> > >>>> maintain things concurrently. I will monitor the build stability
> > >>>> closely,
> > >>>> but would expect some support with debugging potential issues from
> the
> > >>>> contributors.
> > >>>> - Once there are no problems with the new setup, we remove the
> Travis
> > >>>> setup.
> > >>>> - Independently, I will work on triggering builds from master /
> > >>>> release -
> > >>>> branch pushes, as well as cron builds from the master branch ...
> > >>>> all this
> > >>>> will be described in the Wiki.
> > >>>>
> > >>>>
> > >>>> *Timeline:*- Once I have the feeling that people are supportive of
> the
> > >>>> idea, I will start documenting in the Wiki. The first pull requests
> > >>> should
> > >>>> show up after a few more days.
> > >>>> I will do a one month parental leave starting some time later in
> > >>> December,
> > >>>> which will probably delay things a bit. I hope to have everything
> > >>> finished
> > >>>> by end of January.
> > >>>>
> > >>>> I'm happy to hear your thoughts on this work.
> > >>>> If nobody objects, I will start documenting the system and prepare
> > >>>> everything for the migration.
> > >>>>
> > >>>> Best,
> > >>>> Robert
> > >>>>
> > >>>>
> > >>>>
> > >>>> [1]
> > >>>>
> > >>>>
> > >>>
> >
> https://lists.apache.org/thread.html/b90aa518fcabce94f8e1de4132f46120fae613db6e95a2705f1bd1ea@%3Cdev.flink.apache.org%3E
> > >>>
> > >>>> [2] https://issues.apache.org/jira/browse/INFRA-17030
> > >>>> [3] https://github.com/rmetzger/flink/tree/azure_playground
> > >>>> [4]
> > >>>
> https://dev.azure.com/rmetzger/Flink/_build?definitionId=4&_a=summary
> > >
> > >
> > >
> >
> >
>
--
Best Regards
Jeff Zhang
> (exclusive to the new UI), so I wanted to check what people think about
> > > dropping the old UI for 1.10.
> > >
> >
>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-14836:
--
Summary: Unable to set yarn container number for scala shell in
yarn mode
Key: FLINK-14836
URL: https://issues.apache.org/jira/browse/FLINK-14836
Project: Flink
Jeff Zhang created FLINK-14807:
--
Summary: Add Table#collect api for fetching data to client
Key: FLINK-14807
URL: https://issues.apache.org/jira/browse/FLINK-14807
Project: Flink
Issue Type
splay/FLINK/FLIP-59%3A+Enable+execution+configuration+from+Configuration+object
> > > >.
> > > >>
> > > >> The discussion thread can be found here <
> > >
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-59-Enable-execution-configuration-from-Configuration-object-td32359.html
> > > >.
> > > >>
> > > >> This vote will be open for at least 72 hours and requires consensus
> to
> > > be accepted.
> > > >>
> > > >> Best,
> > > >> Dawid
> > >
> > >
>
--
Best Regards
Jeff Zhang
the security mailing
> > list.
> >
> > Looking forward to your feedback!
> >
> > Regards,
> > Dian
> >
> > [1] https://flink.apache.org/community.html
> > [2] https://commons.apache.org/mail-lists.html
> > [3] https://hadoop.apache.org/mailing_lists.html
> > [4] https://spark.apache.org/community.html
> > [5] https://kafka.apache.org/project-security.html
> > [6] https://hive.apache.org/mailing_lists.html
>
--
Best Regards
Jeff Zhang
He has been writing many blogs about Flink,
> > also driving the translation work of Flink website and documentation. He
> is
> > very active in China community as he gives talks about Flink at many
> events
> > in China.
> >
> > Congratulations & Welcome Jark!
> >
> > Best,
> > Jincheng (on behalf of the Flink PMC)
>
>
--
Best Regards
Jeff Zhang
k-mailing-list-archive.1008284.n3.nabble.com/VOTE-Publish-the-PyFlink-into-PyPI-tt31201.html
> [2]
> https://issues.apache.org/jira/browse/FLINK-13011?focusedCommentId=16947307=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16947307
--
Best Regards
Jeff Zhang
> >> The FLIP can be found in [1] and the discussion thread in [2].
> > > >>
> > > >> As per the bylaws, the vote will stay open until Friday 26-10 (3
> days)
> > > >> or until it gets 3 votes.
> > > >>
> > > >> Thank you,
> > > >> Kostas
> > > >>
> > > >> [1]
> > > >>
> > >
> >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=133631524
> > > >> [2]
> > > >>
> > >
> >
> https://lists.apache.org/thread.html/a4dd8e0c7b79350c59f5afefc1bc583dac99abcf94caaa8c22017974@%3Cdev.flink.apache.org%3E
> > > >>
> > >
> > >
> >
>
--
Best Regards
Jeff Zhang
iki.apache.org/confluence/display/FLINK/FLIP-78:+Flink+Python+UDF+Environment+and+Dependency+Management
> > >>>
> > >> [2]
> > >>
> >
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-Python-UDF-Environment-and-Dependency-Management-td33514.html
> > >> <
> > >>
> >
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-Python-UDF-Environment-and-Dependency-Management-td33514.html
> > >>>
> > >>
> > >>
> > >>
> >
> >
>
--
Best Regards
Jeff Zhang
> >
> > > [1]
> > >
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-74%3A+Flink+JobClient+API
> > > [2]
> > >
> >
> https://lists.apache.org/x/thread.html/b2e22a45aeb94a8d06b50c4de078f7b23d9ff08b8226918a1a903768@%3Cdev.flink.apache.org%3E
> > >
> >
>
--
Best Regards
Jeff Zhang
; [3]
> > https://spark.apache.org/news/plan-for-dropping-python-2-support.html
> > > <https://spark.apache.org/news/plan-for-dropping-python-2-support.html
> >
> > > [4]
> > >
> >
> https://lists.apache.org/thread.html/eba6caa58ea79a7ecbc8560d1c680a366b44c531d96ce5c699d41535@%3Cdev.beam.apache.org%3E
> > > <
> > >
> >
> https://lists.apache.org/thread.html/eba6caa58ea79a7ecbc8560d1c680a366b44c531d96ce5c699d41535@%3Cdev.beam.apache.org%3E
> > > >
> > > [5]
> > >
> >
> https://stackoverflow.com/questions/32557920/what-are-type-hints-in-python-3-5
> > > <
> > >
> >
> https://stackoverflow.com/questions/32557920/what-are-type-hints-in-python-3-5
> > > >
> >
>
--
Best Regards
Jeff Zhang
e release process once
> blocker issues has been merged. What do you think?
>
> If there is any other blocker issues need to be fixed in 1.9.1, please let
> me know.
>
> Cheers,
> Jark
>
--
Best Regards
Jeff Zhang
who anyway want to program
> directly to internal classes/interfaces are considered to prepare to
> make adaptations when bump version of Flink.
>
> Best,
> tison.
>
> [1] https://issues.apache.org/jira/browse/FLINK-14096
> [2]
>
> https://github.com/apache/flink/commit/dc9e4494dddfed36432e6bbf6cd3231530bc2e01
>
--
Best Regards
Jeff Zhang
dea Tison!
> >>>>
> >>>> I will create the umbrella issue and post it here so that we are all
> >>>> on the same page!
> >>>>
> >>>> Cheers,
> >>>> Kostas
> >>>>
> >>>>
Kloudas is joining the Flink
>>> PMC.
>>> >> Kostas is contributing to Flink for many years and puts lots of
>>> effort in helping our users and growing the Flink community.
>>> >> Please join me in congratulating Kostas!
>>> >
>>> > congratulation Kostas!
>>> >
>>> > regards.
>>>
>>>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-13951:
--
Summary: Unable to call limit without sort for batch mode
Key: FLINK-13951
URL: https://issues.apache.org/jira/browse/FLINK-13951
Project: Flink
Issue Type
Jeff Zhang created FLINK-13943:
--
Summary: Provide api to convert flink table to java List
Key: FLINK-13943
URL: https://issues.apache.org/jira/browse/FLINK-13943
Project: Flink
Issue Type
> > > > > > > >> > an existing cluster. In this way we are able to
> consider
> > > > > per-job
> > > > > > > > > > issues
> > > > > > > > > > >> > individually an
e(FencedAkkaRpcActor.java:40)
>>> at
>>> akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:165)
>>> at akka.actor.Actor$class.aroundReceive(Actor.scala:502)
>>> at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:95)
>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:526)
>>> at akka.actor.ActorCell.invoke(ActorCell.scala:495)
>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
>>> at akka.dispatch.Mailbox.run(Mailbox.scala:224)
>>> at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
>>> at
>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
>>> at
>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
>>> at
>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
>>>
>>>
>>>
>>>
--
Best Regards
Jeff Zhang
72 hours. Unless there is an
> > >>>>>> objection, I will try to close it by Sept 2, 2019 00:00 UTC if we
> > have
> > >>>>>> received sufficient votes.
> > >>>>>>
> > >>>>>> PS: This doesn't mean that we cannot further improve the design.
> We
> > >> can
> > >>>>>> still discuss the implementation details case by case in the JIRA
> as
> > >> long
> > >>>>>> as it doesn't affect the overall design.
> > >>>>>>
> > >>>>>> [1]
> > >>>>>>
> > >>>>>
> > >>
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-58%3A+Flink+Python+User-Defined+Function+for+Table+API
> > >>>>>> <
> > >>>>>>
> > >>>>>
> > >>
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-58:+Flink+Python+User-Defined+Function+for+Table+API
> > >>>>>>>
> > >>>>>> [2]
> > >>>>>>
> > >>>>>
> > >>
> >
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-Python-User-Defined-Function-for-Table-API-td31673.html
> > >>>>>> <
> > >>>>>>
> > >>>>>
> > >>
> >
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-Python-User-Defined-Function-for-Table-API-td31673.html
> > >>>>>>>
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>> Dian
> > >>>>>
> > >>>
> > >>
> > >>
> >
> >
>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-13851:
--
Summary: Time unit of garbage collection in Flink Web UI is not
displayed
Key: FLINK-13851
URL: https://issues.apache.org/jira/browse/FLINK-13851
Project: Flink
Jeff Zhang created FLINK-13811:
--
Summary: Support converting flink table to pandas dataframe
Key: FLINK-13811
URL: https://issues.apache.org/jira/browse/FLINK-13811
Project: Flink
Issue Type
Jeff Zhang created FLINK-13744:
--
Summary: Improper error message when submit flink job in
yarn-cluster mode without hadoop lib bundled
Key: FLINK-13744
URL: https://issues.apache.org/jira/browse/FLINK-13744
has a good suggestion for "数据汇" which
> corresponds to source ("数据源"). I asked Committer Jark Wu, he is also fine
> with it. I think "数据汇" is a good representation of flow charactiristics so
> I would like to use it.
>
>
> I want to hear more thoughts from the community whether we should
> translate it and what it should be translated into.
>
>
> Thanks,
> WangHW
>
--
Best Regards
Jeff Zhang
aming/WindowJoin.jar
>
>
>
> [1].
>
> https://ci.apache.org/projects/flink/flink-docs-release-1.8/ops/deployment/kubernetes.html
>
> [2].https://github.com/lyft/flinkk8soperator
>
> [3].
>
> https://docs.google.com/document/d/1Zmhui_29VASPcBOEqyMWnF3L6WEWZ4kedrCqya0WaAk/edit#
>
--
Best Regards
Jeff Zhang
Jeff Zhang created FLINK-13659:
--
Summary: Add method listDatabases(catalog) and listTables(catalog,
database) in TableEnvironment
Key: FLINK-13659
URL: https://issues.apache.org/jira/browse/FLINK-13659
Jeff Zhang created FLINK-13645:
--
Summary: Error in code-gen when using blink planner in scala shell
Key: FLINK-13645
URL: https://issues.apache.org/jira/browse/FLINK-13645
Project: Flink
Issue
r of the Flink project.
>
> Hequn has been contributing to Flink for many years, mainly working on
> SQL/Table API features. He's also frequently helping out on the user
> mailing lists and helping check/vote the release.
>
> Congratulations Hequn!
>
> Best, Jincheng
> (on behalf of the Flink PMC)
>
>
>
--
Best Regards
Jeff Zhang
hours. It is adopted by a simple
> > > majority with a minimum of three positive votes.
> > >
> > > See discussion threads for more details [1].
> > >
> > > Thanks,
> > > Jincheng
> > >
> > > [1]
> > >
> >
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Publish-the-PyFlink-into-PyPI-td30095.html
> >
> >
>
--
Best Regards
Jeff Zhang
the document[1].
> > >
> > > 3. Expose ClusterClient as public api or just expose api in
> > > ExecutionEnvironment
> > > and delegate them to ClusterClient? Further, in either way is it worth
> to
> > > introduce a JobClient which is an encapsulation of ClusterClient
it? It would a) solve the dependency problem and
> b) make our build a tiny smidgen more lightweight.
>
> Aljoscha
>
> [1]
> https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E
--
Best Regards
Jeff Zhang
1 - 100 of 192 matches
Mail list logo
