:00 UTC if we have received
sufficient votes.
[1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=148643521
[2]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-118-Improve-Flink-s-ID-system-td39321.html
Best,
Yangze Guo
Hi Aljoscha,
Thanks for your advice. +1 to align the config pattern.
I also agree that we need to move the long discussion to the [DISCUSS]
thread. Sorry if it bothers you.
Best,
Yangze Guo
On Thu, Apr 16, 2020 at 7:52 AM Becket Qin wrote:
>
> I agree with Aljoscha. It is important t
Thanks for the feedback, @ZhuZhu and @Till
Thanks for the deeper analysis of the size of TDD, @ZhuZhu.
If there is no further concern in the next 24 hours, I'll start voting
for this FLIP.
Best,
Yangze Guo
On Wed, Apr 15, 2020 at 4:56 PM Till Rohrmann wrote:
>
> This is good news
a difference for user, I'm also +1 for not
using bounded wildcard type there.
Best,
Yangze Guo
On Wed, Apr 15, 2020 at 4:23 PM Till Rohrmann wrote:
>
> I think Set
> getExternalResourceInfos(String resourceName, Class
> externalResourceType) is not less flexible than the other API s
> One minor note: I think the value of the returned map does not need to use a
> bounded wildcard type because for the user it won't make a difference.
Since the Driver now use a bounded wildcard type, it seems we could
not hold the return value(Set) with
Set. Am I right?
Best,
Yang
@Till
If we add "Class externalResourceType" param, what if there are
multiple subtypes in the ExternalResourceInfos set of one external
resource? It seems user has to set the T to ExternalResourceInfo and
the mechanism is useless at this case.
Best,
Yangze Guo
On Wed, Apr 15, 2020
oaded dynamically in runtime, if there is a
type mismatch, the job would fail in runtime instead of in compile
time, no matter the type extraction is done by Operator or Flink core.
This interface would not gain benefits for type safety.
Best,
Yangze Guo
On Wed, Apr 15, 2020 at 1:38 AM Till
tID and IntermediateResultPartitionID. If you have
further concerns or think we should make further investigation. Please
let me know.
Best,
Yangze Guo
On Mon, Apr 13, 2020 at 1:36 PM Yangze Guo wrote:
>
> Hi everyone,
> After an offline discussion with ZhuZhu, I have some comments on this
>
"Starting scheduling" to the last task
change state to running.
Best,
Yangze Guo
On Fri, Apr 10, 2020 at 12:53 PM Yangze Guo wrote:
>
> Hi there,
>
> Sorry for the belated reply. I just make a preliminary investigation
> of the infect of refactoring IntermediateRe
Hi there,
I've updated the FLIP accordingly. Please take a look. If you have any
further concerns please let me know.
Best,
Yangze Guo
On Fri, Apr 10, 2020 at 6:40 PM Yangze Guo wrote:
>
> Thanks for the feedback, Xintong.
>
> - Should we have a factory interface for `ExternalRe
their own `ExternalResourceInfo` implementation and how it
is used by the operator user codes.
Sounds good.
Best,
Yangze Guo
On Fri, Apr 10, 2020 at 6:04 PM Xintong Song wrote:
>
> Sorry to pull this back. I have some concerns about the recent updated
> interface details.
>
> - Should we
+1 (non-binding)
Thanks for driving this, Andrey.
Best,
Yangze Guo
On Thu, Apr 9, 2020 at 11:33 PM Ismaël Mejía wrote:
>
> +1 (non-binding)
> Great work Andrey, pretty excited about this happening!
>
>
> On Wed, Apr 8, 2020 at 4:20 AM Canbin Zheng wrote:
> >
> &
only one
ExecutionAttemptID per TDD.
After that preliminary investigation, I tend to not refactor
ExecutionAttemptID and IntermediateResultPartitionID at the moment or
treat it as future work.
WDYT? @ZhuZhu @Till
Best,
Yangze Guo
On Wed, Apr 1, 2020 at 11:53 AM Zhu Zhu wrote:
>
> >&
Edit: RuntimeContext interface
From: Map>
getExternalResourceInfo(ResourceSpec resourceSpec);
To: Map> getExternalResourceInfo();
Best,
Yangze Guo
On Wed, Apr 8, 2020 at 11:36 AM Yangze Guo wrote:
>
> Hi, there
>
> I have updated the FLIP, mainly target to make it more de
Yangze Guo created FLINK-17044:
--
Summary: FLIP-108: Add GPU support in Flink
Key: FLINK-17044
URL: https://issues.apache.org/jira/browse/FLINK-17044
Project: Flink
Issue Type: New Feature
fo` interface.
- Treat adding external resource info to RestAPI/WebUI as a future work.
If you have any new concerns after that change, please mentioned here.
Sorry for disturbing you.
Best,
Yangze Guo
On Wed, Apr 8, 2020 at 9:55 AM Yang Wang wrote:
>
> Thanks Yangze for the efforts to s
Congratulations Seth!
Best,
Yangze Guo
On Tue, Apr 7, 2020 at 4:07 PM Jiayi Liao wrote:
>
> >
> > Congratulations Seth :)
> >
> >
+1 (non-binding)
Best,
Yangze Guo
On Fri, Apr 3, 2020 at 2:11 PM Xintong Song wrote:
>
> +1 (non-binding)
>
> Thank you~
>
> Xintong Song
>
>
>
> On Fri, Apr 3, 2020 at 1:18 PM Zhijiang
> wrote:
>
> &g
Congrats to all of you!
Best,
Yangze Guo
On Wed, Apr 1, 2020 at 5:28 PM Tzu-Li (Gordon) Tai wrote:
>
> Konstantin, Dawid, and Zhijiang, thanks a lot for your continuous support
> in the community :)
> And congratulations! This is well deserved.
>
> Cheers,
> Gordon
>
&g
.
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-108%3A+Add+GPU+support+in+Flink
[2]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-108-Add-GPU-support-in-Flink-td38286.html
Best,
Yangze Guo
Thank you all for your participation! I'll start voting for this FLIP.
Best,
Yangze Guo
On Wed, Apr 1, 2020 at 4:55 PM Stephan Ewen wrote:
>
> Sounds good!
>
> On Tue, Mar 31, 2020 at 4:32 AM Yangze Guo wrote:
>
> > Hi everyone,
> > I've updated the FLIP
plementation phase.
Best,
Yangze Guo
On Tue, Mar 31, 2020 at 4:55 PM Zhu Zhu wrote:
>
> Thanks for proposing this improvement Yangze. Big +1 for the overall
> proposal. It can help a lot in troubleshooting.
>
> Here are a few questions for it:
> 1. Shall we make JobVertexID a compo
there is no collision for
different TM.
Best,
Yangze Guo
On Tue, Mar 31, 2020 at 12:25 AM Steven Wu wrote:
>
> +1 on allowing user defined resourceId for taskmanager
>
> On Sun, Mar 29, 2020 at 7:24 PM Yang Wang wrote:
>
> > Hi Konstantin,
> >
> > I think it is
Yangze Guo created FLINK-16874:
--
Summary: Respect the dynamic options when calculating memory
options in taskmanager.sh
Key: FLINK-16874
URL: https://issues.apache.org/jira/browse/FLINK-16874
Project
Hi everyone,
I've updated the FLIP accordingly. The key change is replacing two
resource allocation interfaces to config options.
If there are no further comments, I would like to start a voting
thread by tomorrow.
Best,
Yangze Guo
On Mon, Mar 30, 2020 at 9:15 PM Till Rohrmann wrote
themselves.
WDYT?
Best,
Yangze Guo
On Mon, Mar 30, 2020 at 5:44 PM Xintong Song wrote:
>
> I also agree that the pluggable ExternalResourceDriver should be loaded by
> the cluster class loader. Despite the plugin might be implemented by users,
> external resources (as part of task execut
e the same as the
external-resource.{resourceName}.amount.
So, I think it makes sense to replace these two interfaces with two
configs, i.e. external-resource.{resourceName}.yarn/kubernetes.key. We
may lose some extensibility, but AFAIK it could work with common
external resources like GPU, FPGA. WDYT?
Best,
Hi, Zhu Zhu,
Thanks for the explanation and information. I also agree that it out
of the scope of this FLIP and glad to see that we are moving forward
to a more extensible scheduler!
Best,
Yangze Guo
On Mon, Mar 30, 2020 at 1:31 AM Zhu Zhu wrote:
>
> Thanks for the comments!
>
>
the upstream and downstream
regions at the same time if we have enough resources. It can shorten
the running time of large job. We should not break the protocol of
blocking edge. But if it is possible to change the data exchange mode
of two regions dynamically?
Best,
Yangze Guo
On Fri, Mar 27, 2020 at 1:15
Thanks for driving this discussion, Zhu Zhu & Gary.
I found that the image link in this FLIP is not working well. When I
open that link, Google doc told me that I have no access privilege.
Could you take a look at that issue?
Best,
Yangze Guo
On Fri, Mar 27, 2020 at 1:38 AM Gary Yao w
-party supported resources for Yarn/Kubernetes. It
could also free us from the potential dependency issue as well.
Best,
Yangze Guo
On Fri, Mar 27, 2020 at 10:42 AM Xintong Song wrote:
>
> Thanks for updating the FLIP, Yangze.
>
> I agree with Till that we probably want to separate
find more details in the FLIP wiki document [1]. Looking forward to
your feedbacks.
[1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=148643521
Best,
Yangze Guo
at [1].
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-108%3A+Add+GPU+support+in+Flink
Best,
Yangze Guo
On Wed, Mar 25, 2020 at 7:32 PM Stephan Ewen wrote:
>
> This sounds good to go ahead from my side.
>
> I like the approach that Becket suggested - in that case the core
&
I second Thomas that we can support both Java 8 and 11.
Best,
Yangze Guo
On Wed, Mar 18, 2020 at 12:12 PM Thomas Weise wrote:
>
> -->
>
> On Mon, Mar 16, 2020 at 1:58 AM Andrey Zagrebin wrote:
>>
>> Thanks for the further feedback Thomas and Yangze.
>>
>
Yangze Guo created FLINK-16605:
--
Summary: Add max limitation to the total number of slots
Key: FLINK-16605
URL: https://issues.apache.org/jira/browse/FLINK-16605
Project: Flink
Issue Type
the GPU
info instead of the GPU Manager. AFAIK, it's the only place we could
pass GPU info to the RichFunction/UserDefinedFunction.
Best,
Yangze Guo
On Sat, Mar 14, 2020 at 4:06 AM Isaac Godfried wrote:
>
>
>
>
>
> On Fri, 13 Mar 2020 15:58:20 + se...@apache.org wrote -
ors to directly
access GPUManager, it should get what they want from Context. We could
then decouple the interface/implementation of GPUManager and Public
API.
Best,
Yangze Guo
On Fri, Mar 13, 2020 at 7:26 PM Stephan Ewen wrote:
>
> It sounds fine to initially start with GPU spec
Would you mind to share more information about why the task executor
is killed? If it is killed by Yarn, you might get such info in Yarn
NM/RM logs.
Best,
Yangze Guo
Best,
Yangze Guo
On Fri, Mar 13, 2020 at 12:31 PM DONG, Weike wrote:
>
> Hi,
>
> Recently I have encountered a stra
Yangze Guo created FLINK-16566:
--
Summary: Change the log level of the launching command and dynamic
properties from DEBUG to INFO in Mesos integration
Key: FLINK-16566
URL: https://issues.apache.org/jira/browse
Thanks for driving this release, Yu!
+1 for starting the 1.10.1 release cycle.
Best,
Yangze Guo
On Wed, Mar 11, 2020 at 1:42 PM Xintong Song wrote:
>
> Yu,
> Thanks for the explanation.
> I've no concerns. I was just trying to get some inputs for prioritizing
> tasks on my si
much extra
effort.
Regarding the custom configuration, the mechanism that Thomas mentioned LGTM.
[1]
https://github.com/apache/flink-docker/blob/master/Dockerfile-debian.template
Best,
Yangze Guo
On Wed, Mar 11, 2020 at 5:52 AM Thomas Weise wrote:
>
> Thanks for working on improv
start_jobmaster"/"start_session_jobmanager". Am I
understanding this correctly?
Best,
Yangze Guo
Best,
Yangze Guo
On Wed, Mar 4, 2020 at 5:34 PM Andrey Zagrebin wrote:
>
> Hi All,
>
> If you have ever touched the docker topic in Flink, you
> probably noticed that we
Yangze Guo created FLINK-16416:
--
Summary: Shutdown the task manager gracefully in standalone mode
Key: FLINK-16416
URL: https://issues.apache.org/jira/browse/FLINK-16416
Project: Flink
Issue
unt/discovery-script)
to make it more extensible. I think the "resource" is a proper level
to contain all the configs of extended resources.
Best,
Yangze Guo
On Wed, Mar 4, 2020 at 10:48 AM Xingbo Huang wrote:
>
> Thanks a lot for the FLIP, Yangze.
>
> There is no doubt that GP
apache.org/confluence/display/FLINK/FLIP-108%3A+Add+GPU+support+in+Flink
Best,
Yangze Guo
Yangze Guo created FLINK-16297:
--
Summary: Remove the redundant intent and blank line in highlight
code blocks
Key: FLINK-16297
URL: https://issues.apache.org/jira/browse/FLINK-16297
Project: Flink
Yangze Guo created FLINK-16237:
--
Summary: Wordcount on Docker test (custom fs plugin) fails.
Key: FLINK-16237
URL: https://issues.apache.org/jira/browse/FLINK-16237
Project: Flink
Issue Type
to follow it.
Best,
Yangze Guo
On Fri, Feb 21, 2020 at 2:39 PM Yang Wang wrote:
>
> I second xintong's suggestion. When i open a PR, i also check the item list
> in the template. It help to
> know whether i should test the PR in a real cluster(Yarn/K8s/Mesos). Or i
> should
+1 (non-binding)
It will make debugging more convenient and hence improve usability.
Best,
Yangze Guo
On Fri, Feb 21, 2020 at 2:50 PM Yang Wang wrote:
>
> Hi Jark,
>
> The GC log is not enabled by default. If the users want, he/she should
> configure it by the followin
Thanks, Gary & Yu. Congrats to everyone involved!
Best,
Yangze Guo
On Thu, Feb 13, 2020 at 9:23 AM Jingsong Li wrote:
>
> Congratulations! Great work.
>
> Best,
> Jingsong Lee
>
> On Wed, Feb 12, 2020 at 11:05 PM Leonard Xu wrote:
>>
>> Great news！
>>
+1 (non-binding)
- Build from source
- Run mesos e2e tests(including unmerged heap state backend and rocks
state backend case)
Best,
Yangze Guo
On Tue, Feb 11, 2020 at 10:08 AM Yu Li wrote:
>
> Thanks for the reminder Patrick! According to the release process [1] we
> wil
Yangze Guo created FLINK-15870:
--
Summary: Wait the job's terminal state through REST interface
Key: FLINK-15870
URL: https://issues.apache.org/jira/browse/FLINK-15870
Project: Flink
Issue Type
Congratulations!
Best,
Yangze Guo
On Thu, Jan 23, 2020 at 4:59 PM Stephan Ewen wrote:
>
> Hi all!
>
> We are announcing that Yu Li has joined the rank of Flink committers.
>
> Yu joined already in late December, but the announcement got lost because
> of the Christmas and
Yangze Guo created FLINK-15679:
--
Summary: Improve Flink's ID system
Key: FLINK-15679
URL: https://issues.apache.org/jira/browse/FLINK-15679
Project: Flink
Issue Type: Improvement
Yangze Guo created FLINK-15611:
--
Summary: KafkaITCase.testOneToOneSources fails on Travis
Key: FLINK-15611
URL: https://issues.apache.org/jira/browse/FLINK-15611
Project: Flink
Issue Type: Bug
Thanks for driving this, Xiaoling!
+1 for supporting SQL client gateway.
Best,
Yangze Guo
On Thu, Jan 2, 2020 at 9:58 AM 贺小令 wrote:
>
> Hey everyone,
> FLIP-24
> <https://cwiki.apache.org/confluence/display/FLINK/FLIP-24+-+SQL+Client>
> proposes the whole conception an
Yangze Guo created FLINK-15442:
--
Summary: Harden the Avro Confluent Schema Registry nightly
end-to-end test
Key: FLINK-15442
URL: https://issues.apache.org/jira/browse/FLINK-15442
Project: Flink
Yangze Guo created FLINK-15417:
--
Summary: Remove the docker volume or mount when starting Mesos e2e
cluster
Key: FLINK-15417
URL: https://issues.apache.org/jira/browse/FLINK-15417
Project: Flink
Yangze Guo created FLINK-15365:
--
Summary: Introduce streaming task using rocksDB backend e2e tests
for Mesos
Key: FLINK-15365
URL: https://issues.apache.org/jira/browse/FLINK-15365
Project: Flink
Yangze Guo created FLINK-15364:
--
Summary: Introduce streaming task using heap backend e2e tests for
Mesos
Key: FLINK-15364
URL: https://issues.apache.org/jira/browse/FLINK-15364
Project: Flink
Yangze Guo created FLINK-15324:
--
Summary: Make MesosResourceManager inherit from
ActiveResourceManager
Key: FLINK-15324
URL: https://issues.apache.org/jira/browse/FLINK-15324
Project: Flink
Yangze Guo created FLINK-15304:
--
Summary: Remove unexpected Hadoop dependency from Flink's Mesos
integration
Key: FLINK-15304
URL: https://issues.apache.org/jira/browse/FLINK-15304
Project: Flink
Congrats, ZhuZhu!
Bowen Li 于 2019年12月14日周六 上午5:37写道：
> Congrats!
>
> On Fri, Dec 13, 2019 at 10:42 AM Xuefu Z wrote:
>
> > Congratulations, Zhu Zhu!
> >
> > On Fri, Dec 13, 2019 at 10:37 AM Peter Huang >
> > wrote:
> >
> > > Congratulations!:)
> > >
> > > On Fri, Dec 13, 2019 at 9:45 AM Piotr
Yangze Guo created FLINK-15241:
--
Summary: Revert the unexpected change for the configuration of
Mesos CPU cores
Key: FLINK-15241
URL: https://issues.apache.org/jira/browse/FLINK-15241
Project: Flink
Yangze Guo created FLINK-15214:
--
Summary: Adding multiple submission e2e test for Flink's Mesos
integration
Key: FLINK-15214
URL: https://issues.apache.org/jira/browse/FLINK-15214
Project: Flink
,
Yangze Guo
On Wed, Dec 11, 2019 at 6:14 PM Gary Yao wrote:
>
> Thanks for driving this effort. Also +1 from my side. I have left a few
> questions below.
>
> > - Wordcount end-to-end test. For verifying the basic process of Mesos
> > deployment.
>
> Would thi
Yangze Guo created FLINK-15196:
--
Summary: The mesos.resourcemanager.tasks.cpus configuration does
not work as expectation
Key: FLINK-15196
URL: https://issues.apache.org/jira/browse/FLINK-15196
Project
you. ;)
Best,
Yangze Guo
[1]https://github.com/KarmaGYZ/flink/commit/0406d942446a1b17f81d93235b21a829bf88ccf0
[2]https://travis-ci.org/KarmaGYZ/flink/jobs/623207957
Best,
Yangze Guo
On Mon, Dec 9, 2019 at 2:39 PM Yang Wang wrote:
>
> Thanks Yangze for starting this discussion.
>
> J
Yangze Guo created FLINK-15135:
--
Summary: Adding e2e tests for Flink's Mesos integration
Key: FLINK-15135
URL: https://issues.apache.org/jira/browse/FLINK-15135
Project: Flink
Issue Type: Test
coverage will also be appreciated.
[1]https://hub.docker.com/layers/karmagyz/mesos-flink/latest/images/sha256-4e1caefea107818aa11374d6ac8a6e889922c81806f5cd791ead141f18ec7e64
Best,
Yangze Guo
On Sat, Dec 7, 2019 at 3:17 AM Piyush Narang wrote:
>
> +1 from our end as well. At Criteo, we are r
://issues.apache.org/jira/browse/FLINK-11307
[3]https://hub.docker.com/repository/docker/karmagyz/mesos-flink
[4]https://issues.apache.org/jira/browse/FLINK-14074
[5]https://www.oracle.com/technetwork/java/java-se-support-roadmap.html
Best,
Yangze Guo
Yangze Guo created FLINK-14951:
--
Summary: State TTL backend end-to-end test fail when taskManager
has multiple slot
Key: FLINK-14951
URL: https://issues.apache.org/jira/browse/FLINK-14951
Project: Flink
Thanks for driving this discussion, Dian!
+1 for this proposal. It will help to reduce container failure due to
the memory overuse.
Some comments left in the design doc.
Best,
Yangze Guo
On Mon, Nov 18, 2019 at 4:06 PM Xintong Song wrote:
>
> Sorry for the late reply.
>
> +1 for
Congratulations!
Best,
Yangze Guo
On Thu, Sep 12, 2019 at 9:35 AM Rong Rong wrote:
>
> Congratulations Zili!
>
> --
> Rong
>
> On Wed, Sep 11, 2019 at 6:26 PM Hequn Cheng wrote:
>
> > Congratulations!
> >
> > Best, Hequn
> >
&g
C at the same time,
we could always make the best decision.
[1] http://www.or.deis.unibo.it/kp/Chapter8.pdf
[2] https://www.cs.cmu.edu/~xia/resources/Documents/grandl_sigcomm14.pdf
Best,
Yangze Guo
On Thu, Aug 15, 2019 at 10:40 PM Xintong Song wrote:
>
> Hi everyone,
>
> We would like
Yangze Guo created FLINK-11172:
--
Summary: Remove the max retention time in StreamQueryConfig
Key: FLINK-11172
URL: https://issues.apache.org/jira/browse/FLINK-11172
Project: Flink
Issue Type
Yangze Guo created FLINK-11142:
--
Summary: Undefined behavior in the conversion from
DataStream/DataSet to Table
Key: FLINK-11142
URL: https://issues.apache.org/jira/browse/FLINK-11142
Project: Flink
Yangze Guo created FLINK-11040:
--
Summary: Incorrect generic type of DataStream in broadcast_state.md
Key: FLINK-11040
URL: https://issues.apache.org/jira/browse/FLINK-11040
Project: Flink
Issue
Yangze Guo created FLINK-11029:
--
Summary: Incorrect parameter in Working with state doc
Key: FLINK-11029
URL: https://issues.apache.org/jira/browse/FLINK-11029
Project: Flink
Issue Type: Bug
Yangze Guo created FLINK-11003:
--
Summary: Document of Java Lambda Expressions has a mistake
Key: FLINK-11003
URL: https://issues.apache.org/jira/browse/FLINK-11003
Project: Flink
Issue Type
301 - 380 of 380 matches
Mail list logo
