Thanks Till and Thomas, will include fix for both FLINK-17496 and
FLINK-17514 in the next RC.
Best Regards,
Yu
On Tue, 5 May 2020 at 22:10, Thomas Weise wrote:
> I opened a PR to backport the Kinesis fix - it would be nice to include if
> there is another RC:
>
>
Yangze Guo created FLINK-17540:
--
Summary: Adding tests/tools checking the pattern of new
configuration options following the xyz.max/min pattern
Key: FLINK-17540
URL:
Yangze Guo created FLINK-17539:
--
Summary: Migrate the configuration options which do not follow the
xyz.max/min pattern.
Key: FLINK-17539
URL: https://issues.apache.org/jira/browse/FLINK-17539
Project:
Hi community,
Now I have a question about flink checkpoint local directory , our flink
version is 1.6, job mode is
flink on yarn per job . I saw the flink source code , and I find the flink
checkpoint local directory is
/tmp when you didn't config the "state.backend.rocksdb.localdir". But I go
+1 for this
Best,
Congxian
Benchao Li 于2020年5月5日周二 下午5:22写道：
> belated +1
>
> Till Rohrmann 于2020年5月5日周二 下午2:24写道：
>
> > Thanks for all the feedback. I will open the PRs now which change the
> > notification settings of the above-mentioned repositories.
> >
> > Cheers,
> > Till
> >
> > On
Thanks all for involved the discussion.
All opinions are +1 and no -1 until now, so I create a jira ticket to track[1].
@Jark Wu @Jinsong lee
Thanks for your suggestions on compatibility, ancient JDBCOutputFormat,
JDBCInputFormat and ParameterValuesProvider
will keep in old package, and I’ll
Leonard Xu created FLINK-17538:
--
Summary: Refactor flink-hbase connector structure
Key: FLINK-17538
URL: https://issues.apache.org/jira/browse/FLINK-17538
Project: Flink
Issue Type: Improvement
Leonard Xu created FLINK-17537:
--
Summary: Refactor flink-jdbc connector structure
Key: FLINK-17537
URL: https://issues.apache.org/jira/browse/FLINK-17537
Project: Flink
Issue Type: Improvement
Hi, Roc
Thanks for the notice, I'll take a look at it later today.
Best,
Congxian
Roc Marshal 于2020年5月6日周三 上午11:19写道：
> Hi, @klion26 .
>
>
>
>
> I have completed the translation of the page in PR(
> https://github.com/apache/flink/pull/11979) and made corresponding
> improvements according
Hi, @klion26 .
I have completed the translation of the page in
PR(https://github.com/apache/flink/pull/11979) and made corresponding
improvements according to the suggestions of community members. If you have
free time, would you please check it for me?
Thank you for your attention.
Best,
Hi Thomas Weise,
I am not sure why this change will break the existing K8s/container-based
setup.
Since it will output the logs to stdout and log files at the same time, you
could still
use the `kubectl logs` to view the logs. And log collection could just work
as before.
What we could benefit
Yangze Guo created FLINK-17536:
--
Summary: Change the config option of max limitation to
"slotmanager.number-of-slots.max"
Key: FLINK-17536
URL: https://issues.apache.org/jira/browse/FLINK-17536
Project:
Yangze Guo created FLINK-17535:
--
Summary: Treat min/max as part of the hierarchy of config option
Key: FLINK-17535
URL: https://issues.apache.org/jira/browse/FLINK-17535
Project: Flink
Issue
Hi Roc Marshal,
I have a question about making the Yarn deployment ASAP. In my opinion,
using the "ExecutionEnvironment"
instead of "flink run -m yarn-cluster" to deploy a Flink cluster on Yarn do
not help to reduce the time cost. Since
we still need to ship the user jars, flink libs to the HDFS
Thanks Leonard for starting this discussion.
+1 from my side.
> JDBCOutputFormat
Already deprecated, so let it in old package.
> JDBCInputFormat
Not only input format, but also ParameterValuesProvider, looks good to me
for keeping them in old package.
You can wait until the next time you
That sounds like a good refactoring for consistency, +1 from my side
Regards,
Canbin Zheng
zoudan 于2020年5月6日周三 上午9:44写道：
> +1 from my side, it will make jdbc connector unified with other ones.
>
> Best,
> Dan Zou
>
>
> > 在 2020年4月30日，23:16，Jark Wu 写道：
> >
> > Big +1 from my side.
> > The new
+1 from my side, it will make jdbc connector unified with other ones.
Best,
Dan Zou
> 在 2020年4月30日，23:16，Jark Wu 写道：
>
> Big +1 from my side.
> The new structure and class names look nicer now.
>
> Regarding to the compability problem, I have looked into the public APIs in
> flink-jdbc,
Thanks Konstantin for your Faker link.
It looks very interesting and very real.
We can add this generator to datagen source.
Best,
Jingsong Lee
On Fri, May 1, 2020 at 1:00 AM Konstantin Knauf wrote:
> Hi Jark,
>
> my gut feeling is 1), because of its consistency with other connectors
> (does
Jiangjie Qin created FLINK-17534:
Summary: Update the interfaces to PublicEvolving and add
documentation.
Key: FLINK-17534
URL: https://issues.apache.org/jira/browse/FLINK-17534
Project: Flink
Igal Shilman created FLINK-17533:
Summary: Add support for concurrent checkpoints in SateFun
Key: FLINK-17533
URL: https://issues.apache.org/jira/browse/FLINK-17533
Project: Flink
Issue
The downside of change to the default behavior is the breakage of existing
k8s or other container-based production setups.
Logs that are emitted to stdout are visible through kubectl logs and
infrastructure is setup for log collection.
Thanks,
Thomas
On Tue, May 5, 2020 at 6:31 AM Arvid Heise
Great discussion!
I'm also in favor of a single distribution that is optimized for the
initial user experience.
Most advanced users understand how to customize a distribution and many are
probably already building their own. A forcing function for custom builds
is the need to patch the official
Timo Walther created FLINK-17532:
Summary: Update tests to use BatchTestBase#checkTableResult
Key: FLINK-17532
URL: https://issues.apache.org/jira/browse/FLINK-17532
Project: Flink
Issue
Steven Zhen Wu created FLINK-17531:
--
Summary: Add a new checkpoint Guage metric:
elapsedSecondsSinceLastCompletedCheckpoint
Key: FLINK-17531
URL: https://issues.apache.org/jira/browse/FLINK-17531
I agree with Till — this would make more sense somewhere during the
kick-off of the release cycle.
On Tue, May 5, 2020 at 4:44 PM Till Rohrmann wrote:
> I don't think that a post-release step makes sense since the release
> manager of release X won't necessarily be involved in the high level
>
Robert Metzger created FLINK-17530:
--
Summary: Fix illegal reflective access by ClosureCleaner
Key: FLINK-17530
URL: https://issues.apache.org/jira/browse/FLINK-17530
Project: Flink
Issue
Austin Cawley-Edwards created FLINK-17529:
-
Summary: Replace Deprecated RMQ QueueingConsumer
Key: FLINK-17529
URL: https://issues.apache.org/jira/browse/FLINK-17529
Project: Flink
I don't think that a post-release step makes sense since the release
manager of release X won't necessarily be involved in the high level
planning of the release X+1.
Cheers,
Till
On Tue, May 5, 2020 at 2:01 PM Robert Metzger wrote:
> Making the release managers responsible for keeping the
Jark Wu created FLINK-17528:
---
Summary: Use getters instead of RowData#get() utility in
JsonRowDataSerializationSchema
Key: FLINK-17528
URL: https://issues.apache.org/jira/browse/FLINK-17528
Project: Flink
I opened a PR to backport the Kinesis fix - it would be nice to include if
there is another RC:
https://github.com/apache/flink/pull/11998
On Tue, May 5, 2020 at 4:50 AM Till Rohrmann wrote:
> I've opened a PR for FLINK-17514.
>
> Cheers,
> Till
>
> On Tue, May 5, 2020 at 11:46 AM Yu Li
Till Rohrmann created FLINK-17527:
-
Summary: kubernetes-session.sh uses log4j-console.properties
Key: FLINK-17527
URL: https://issues.apache.org/jira/browse/FLINK-17527
Project: Flink
Issue
>From my previous experience with K8s, I'd assume that the cluster itself
already has some ELK attached to it and all stdout/err is collected
automatically.
So if you want to also add logs, I'd make that configurable and I'm torn
what the default should be as both make sense.
However, thinking a
Hi all,
Thanks Aljoscha for bringing this discussion, and thanks all for the
wonderful discussion.
In general, I think improving the user experience is a good idea, and it
seems that we
all agree on that.
Regarding how to achieve this,
I think Aljoscha has brought a good solution, which we have
SQL client is one of the user cases. There are also use cases
like submitting SQL job
to a cluster and then meet the missing connector or format jars error. And
in that case,
it's actually more difficult for users to understand and fix. For example,
user submits a
SQL job to a running cluster with
Jark Wu created FLINK-17526:
---
Summary: Support AVRO serialization and deseriazation schema for
RowData type
Key: FLINK-17526
URL: https://issues.apache.org/jira/browse/FLINK-17526
Project: Flink
@Patrick could you chime in?
We should at least understand the original motivation before simply
changing the way it works.
On Tue, May 5, 2020 at 2:49 PM Stephan Ewen wrote:
> I think Patrick originally introduced the foreground mode, and I believe
> it had indeed something to do with
I think Patrick originally introduced the foreground mode, and I believe it
had indeed something to do with container use and logging.
IIRC the default assumption in docker and Kubernetes is that the logs come
on stdout (or stderr) so after "principle of least astonishment" the idea
was to give a
Jark Wu created FLINK-17525:
---
Summary: Support to parse millisecond and nanoseconds for TIME
type in CSV and JSON format
Key: FLINK-17525
URL: https://issues.apache.org/jira/browse/FLINK-17525
Project:
Robert Metzger created FLINK-17524:
--
Summary: Remove "An illegal reflective access operation has
occurred" on JDK11
Key: FLINK-17524
URL: https://issues.apache.org/jira/browse/FLINK-17524
Project:
Making the release managers responsible for keeping the roadmap up to date
sounds like a good idea to me!
We could add this to the "Creating a Flink Release" Wiki page as a
post-release step.
On Tue, May 5, 2020 at 10:15 AM Marta Paes Moreira
wrote:
> Thanks for bringing this up, Robert.
>
>
I've opened a PR for FLINK-17514.
Cheers,
Till
On Tue, May 5, 2020 at 11:46 AM Yu Li wrote:
> Thanks all for the efforts.
>
> I'm hereby canceling the vote due to FLINK-17514, will prepare another RC
> after the issue is fixed (hopefully soon).
>
> Best Regards,
> Yu
>
>
> On Tue, 5 May 2020
Sorry, I confused JIRA with email.
The Attachment link:
https://gitee.com/RocMarshal/resources4link/blob/master/README.md
The JIRA ID: FLINK-17472
The JIRA link:
https://issues.apache.org/jira/plugins/servlet/mobile#issue/FLINK-17472
Best,
Roc
| |
Roc Marshal
|
|
Could you post the Jira issue here? I don't see it mentioned in this
thread so far.
Best,
Aljoscha
On 05.05.20 12:32, Roc Marshal wrote:
Hi,Aljoscha.I have updated the JIRA according to your suggestion. Thank you very
much.Best,Roc
At 2020-05-05 16:04:01, "Aljoscha Krettek" wrote:
Hi,
For SQL we could leave them in opt/. The SQL client shell script already
does discovery for some jars in opt, for example the main SQL client jar
is not in lib but it's loaded from opt/. We could do the same for the
connector/format jars.
@Timo or @Jark could you confirm whether this would
Hi,Aljoscha.I have updated the JIRA according to your suggestion.
Thank you very much.Best,Roc
At 2020-05-05 16:04:01, "Aljoscha Krettek" wrote:
>Hi,
>
>image attachments don't work on this ML. You will have to upload the
>image somewhere and post a link.
>
>Best,
>Aljoscha
>
>On 02.05.20
Thanks all for the efforts.
I'm hereby canceling the vote due to FLINK-17514, will prepare another RC
after the issue is fixed (hopefully soon).
Best Regards,
Yu
On Tue, 5 May 2020 at 17:28, Till Rohrmann wrote:
> I agree with Aljoscha. This is something we should fix since this is very
>
Dawid Wysakowicz created FLINK-17523:
Summary: Add call expression with a class of UDF
Key: FLINK-17523
URL: https://issues.apache.org/jira/browse/FLINK-17523
Project: Flink
Issue Type:
I agree with Aljoscha. This is something we should fix since this is very
important for Flink's stability. I will prepare a fix for the problem.
Cheers,
Till
On Tue, May 5, 2020 at 10:30 AM Congxian Qiu wrote:
> +1 （no-binding)
> - sha and gpg, ok
> - all pom files point to same version, ok
>
belated +1
Till Rohrmann 于2020年5月5日周二 下午2:24写道：
> Thanks for all the feedback. I will open the PRs now which change the
> notification settings of the above-mentioned repositories.
>
> Cheers,
> Till
>
> On Tue, May 5, 2020 at 6:26 AM Hequn Cheng wrote:
>
> > +1, thanks a lot for driving this.
Gary Yao created FLINK-17522:
Summary: Document flink-jepsen Command Line Options
Key: FLINK-17522
URL: https://issues.apache.org/jira/browse/FLINK-17522
Project: Flink
Issue Type: Improvement
Timo Walther created FLINK-17521:
Summary: Remove `com.ibm.icu` dependency from table-common
Key: FLINK-17521
URL: https://issues.apache.org/jira/browse/FLINK-17521
Project: Flink
Issue
Are you suggesting to add the SQL dependencies to opt/ or lib/?
I thought the argument against opt/ was that it would not be much different
from downloading the additional dependencies.
Moving it to lib/ would justify in my opinion a separate release because of
potential dependency conflicts for
I like this idea because it should improve the experience (and reduce
confusion) for folks having their first flink experience via one of the
docker playgrounds. Right now it gives the impression that something is
broken out-of-the-box.
Regards,
David
On Mon, May 4, 2020 at 6:01 PM Till Rohrmann
Tzu-Li (Gordon) Tai created FLINK-17520:
---
Summary: Extend CompositeTypeSerializerSnapshot to allow composite
serializers to signal migration based on outer configuration
Key: FLINK-17520
URL:
Tzu-Li (Gordon) Tai created FLINK-17519:
---
Summary: Add Java State Bootstrapping E2E test for Stateful
Functions
Key: FLINK-17519
URL: https://issues.apache.org/jira/browse/FLINK-17519
Project:
Tzu-Li (Gordon) Tai created FLINK-17518:
---
Summary: Add HTTP-based request reply protocol E2E test for
Stateful Functions
Key: FLINK-17518
URL: https://issues.apache.org/jira/browse/FLINK-17518
Tzu-Li (Gordon) Tai created FLINK-17517:
---
Summary: Add failure recovery / exactly-once E2E for Stateful
Functions
Key: FLINK-17517
URL: https://issues.apache.org/jira/browse/FLINK-17517
+1 （no-binding)
- sha and gpg, ok
- all pom files point to same version, ok
- build from souce, ok
- LICENCE, ok
- run demo in standalone cluster, ok
Best,
Congxian
Aljoscha Krettek 于2020年5月5日周二 下午3:50写道：
> Unfortunately, I found this bug which prevents the TaskCancelerWatchdog
> [sic] from
Tzu-Li (Gordon) Tai created FLINK-17516:
---
Summary: Add more end-to-end tests for Stateful Functions
Key: FLINK-17516
URL: https://issues.apache.org/jira/browse/FLINK-17516
Project: Flink
Thanks for bringing this up, Robert.
More than updating the roadmap, it would be valuable to discuss how to make
this update systematic. I took care of the last update back in September
and - to be honest - the effort for someone who is not involved in release
planning (or at least for me) feels
Hi,
image attachments don't work on this ML. You will have to upload the
image somewhere and post a link.
Best,
Aljoscha
On 02.05.20 09:16, Jeff Zhang wrote:
Hi Roc,
You can try flink on zeppelin, where you can submit flink job to yarn
directly without starting flink cluster by yourself.
Thanks Till for summarizing!
Another alternative is also to stick to one distribution but remove one
of the very heavy filesystem connectors and add all the mentioned SQL
connectors/formats, which will keep the size of the distribution the
same, or a bit smaller.
Best,
Aljoscha
On 04.05.20
Kostas Kloudas created FLINK-17515:
--
Summary: Move file uploading functionality to a separate class
Key: FLINK-17515
URL: https://issues.apache.org/jira/browse/FLINK-17515
Project: Flink
Unfortunately, I found this bug which prevents the TaskCancelerWatchdog
[sic] from working: https://issues.apache.org/jira/browse/FLINK-17514. I
think it's quite crucial that this failsafe mechanism works correctly.
We should cancel the release and fix it.
Best,
Aljoscha
On 05.05.20 05:55,
Aljoscha Krettek created FLINK-17514:
Summary: TaskCancelerWatchdog does not kill TaskManager
Key: FLINK-17514
URL: https://issues.apache.org/jira/browse/FLINK-17514
Project: Flink
Issue
tillrohrmann commented on pull request #334:
URL: https://github.com/apache/flink-web/pull/334#issuecomment-623894919
Thanks for the review @rmetzger. Merging this PR now.
This is an automated message from the Apache Git
tillrohrmann commented on pull request #86:
URL: https://github.com/apache/flink-shaded/pull/86#issuecomment-623895035
Thanks for the review @rmetzger. Merging this PR now.
This is an automated message from the Apache Git
tillrohrmann opened a new pull request #86:
URL: https://github.com/apache/flink-shaded/pull/86
Send issues and pull request notifications to iss...@flink.apache.org
This is an automated message from the Apache Git Service.
Till Rohrmann created FLINK-17513:
-
Summary: Send flink-shaded issues and pull request notifications
to iss...@flink.apache.org
Key: FLINK-17513
URL: https://issues.apache.org/jira/browse/FLINK-17513
tillrohrmann opened a new pull request #334:
URL: https://github.com/apache/flink-web/pull/334
According to
https://cwiki.apache.org/confluence/display/INFRA/.asf.yaml+features+for+git+repositories,
the `.asf.yaml` file needs to part of the master branch. If this turns out to
be wrong,
Till Rohrmann created FLINK-17512:
-
Summary: Send flink-web issues and pull request notifications to
iss...@flink.apache.org
Key: FLINK-17512
URL: https://issues.apache.org/jira/browse/FLINK-17512
Till,
Thank you for your answers.
Best regards,
Roc
| |
Roc Marshal
|
|
邮箱：flin...@126.com
|
签名由 网易邮箱大师 定制
On 05/05/2020 14:25, Till Rohrmann wrote:
Hi Roc,
afaik it can take a bit of time until the status of the PR is updated in
accordance with the AZP results.
As of a couple of days
Robert Metzger created FLINK-17511:
--
Summary: "RocksDB Memory Management end-to-end test" fails with
"Current block cache usage 202123272 larger than expected memory limit
2"
Key: FLINK-17511
URL:
Hi Roc,
afaik it can take a bit of time until the status of the PR is updated in
accordance with the AZP results.
As of a couple of days ago, we no longer use Travis for running CI. That's
why you don't see it anymore.
Cheers,
Till
On Tue, May 5, 2020 at 1:59 AM Roc Marshal wrote:
> Hi,all.
Thanks for all the feedback. I will open the PRs now which change the
notification settings of the above-mentioned repositories.
Cheers,
Till
On Tue, May 5, 2020 at 6:26 AM Hequn Cheng wrote:
> +1, thanks a lot for driving this.
>
> Best, Hequn
>
> On Tue, May 5, 2020 at 11:56 AM Dian Fu
carp84 commented on a change in pull request #330:
URL: https://github.com/apache/flink-web/pull/330#discussion_r419883635
##
File path: _config.yml
##
@@ -192,6 +192,10 @@ component_releases:
release_archive:
flink:
+ -
+version_short: "1.10"
Review
Robert Metzger created FLINK-17510:
--
Summary: StreamingKafkaITCase. testKafka timeouts on downloading
Kafka
Key: FLINK-17510
URL: https://issues.apache.org/jira/browse/FLINK-17510
Project: Flink
77 matches
Mail list logo
