t; expand if needed down the line (as opposed to starting with a longer
> duration and then running into problems).
>
> Cheers,
>
> Ufuk
>
> > On 11. Jun 2024, at 15:44, Alexander Fedulov <
> alexander.fedu...@gmail.com> wrote:
> >
> > Hi Matthias,
> &g
gt; > Best,
> >
> > Xintong
> >
> >
> >
> > On Fri, May 24, 2024 at 9:35 PM David Radley
> > wrote:
> >
> > > Hi Martjin and Alex,
> > > I agree with your summaries, it will be interesting to see what
> requests
> > >
.
> >
> > If there is a maintainer willing to merge backported features to v1, as
> it
> > is important to some part of the community, this should be allowed, as
> > different parts of the community have different priorities and timelines,
> > Kind regards, David.
> &
icy to users on
> website / documentation (because FLIP is developer-facing) before / upon
> releasing 1.20.
>
> Other than that, the FLIP LGTM.
>
> Best,
>
> Xintong
>
>
>
> On Tue, May 21, 2024 at 5:21 PM Alexander Fedulov <
> alexander.fedu...@gmail.com> wrote:
h Flink's deprecation strategy. I
> > > > expect that the majority of users will have an easy migration path
> > > > from a Flink 1.x to a Flink 2.0, if you're currently not using a
> > > > deprecated API and are a Java user.
> > > >
> > > > Allowing
Alexander Fedulov created FLINK-35052:
-
Summary: Webhook validator should reject unsupported Flink versions
Key: FLINK-35052
URL: https://issues.apache.org/jira/browse/FLINK-35052
Project: Flink
Hi Max,
+1
- Verified SHA checksums
- Verified GPG signatures
- Verified that the source distributions do not contain binaries
- Verified built-in tests (mvn clean verify)
- Verified build with Java 11 (mvn clean install -DskipTests -T 1C)
- Verified that Helm and operator files contain Apache
the
collaboration.
Flink 2.0 aims to remove the SourceFunction API, which the current Pub/Sub
connector
relies on. It would be great if your colleagues could assist with this
effort [3].
Best,
Alexander Fedulov
[1] https://github.com/apache/flink-connector-gcp-pubsub
[2] https://issues.apache.org/jira/browse
Hi Mason,
the adjustments of not requiring the operator ID make sense to me since
this is the more prevalent expected usage pattern. I guess one small
clarification that might be needed is the mention of the return data type.
I assume since there are potentially multiple coordinators that can
Hi everyone,
pretty much every connector utilizes checks from the
org.apache.flink.util.Preconditions class, which is currently marked
as @Internal. This causes CONNECTOR_CLASSES_ONLY_DEPEND_ON_PUBLIC_API
architecture tests to fail and results in the violation exceptions being
filled with the
Alexander Fedulov created FLINK-34117:
-
Summary: CompactCoordinator for table file sink loses data upon
job termination
Key: FLINK-34117
URL: https://issues.apache.org/jira/browse/FLINK-34117
gt;>>
> >>>> On Wed, Jan 3, 2024 at 2:31 AM David Radley
> >>>> wrote:
> >>>>
> >>>>> Sorry for my typo.
> >>>>>
> >>>>> Many congratulations Alex!
> >>>>>
> >>>>&
Alexander Fedulov created FLINK-33789:
-
Summary: Expose restart time as metric
Key: FLINK-33789
URL: https://issues.apache.org/jira/browse/FLINK-33789
Project: Flink
Issue Type: New
m Di., 25. Juli 2023 um 07:07 Uhr schrieb Xintong Song <
> > > > > > > tonysong...@gmail.com>:
> > > > > > >
> > > > > > > > Hi Alex,
> > > > > > > >
> > > > > > > > Providing a longer supporting period f
k if we go
> > with your suggestion to use "proper time" rather than release cycles to
> > define the length of a support period (which sounds reasonable). My
> concern
> > was that we get into a situation where we need to support four versions
> of
> > Flink.
> &
Thanks for driving this Mathhias! +1 for joining the INFRA trial.
> Apache Infra did some experimenting on self-hosted runners in
collaboration
> with Apache Airflow (see ashb/runner with releases/pr-security-options
branch)
> where they only allow certain groups of users (e.g. committers) to
Alexander Fedulov created FLINK-33525:
-
Summary: Migrate LoadSimulationPipeline in Flink K8S Operator to
the new Source API
Key: FLINK-33525
URL: https://issues.apache.org/jira/browse/FLINK-33525
with this
change?
Best,
Alexander Fedulov
On Mon, 30 Oct 2023 at 18:24, Matthias Pohl
wrote:
> Thanks for your proposal, Zhanghao Chen. I think it adds more transparency
> to the configuration documentation.
>
> +1 from my side on the proposal
>
> On Wed, Oct 11, 2023 at 2:0
sources. You produce the
results as they are but utilize allowedLateness to patch the aggregates if
needed (no keyed watermarking is required).
So, is it correct to say that keyed watermarking is applicable only in
scenario 2)?
Best,
Alexander Fedulov
On Sat, 28 Oct 2023 at 14:33, Tawfek Yasser T
in the overall
system.
Do I get it correctly that the keyed watermarking only targets scenarios of
calculating keyed windows (which are also keyed by the same producer ids)?
Best,
Alexander Fedulov
On Fri, 27 Oct 2023 at 19:07, Tawfek Yasser Tawfek
wrote:
> Dear Apache Flink Development Team,
&g
Great work, thanks everyone!
Best,
Alexander
On Thu, 26 Oct 2023 at 21:15, Martijn Visser
wrote:
> Thank you all who have contributed!
>
> Op do 26 okt 2023 om 18:41 schreef Feng Jin
>
> > Thanks for the great work! Congratulations
> >
> >
> > Best,
> > Feng Jin
> >
> > On Fri, Oct 27, 2023
+1
I agree that the topic is distinct enough to justify a dedicated channel
and this could lead to more active participation from people who work on it.
Best,
Alexander
On Wed, 25 Oct 2023 at 20:03, Robin Moffatt wrote:
> Hi,
>
> I'd like to propose adding a PyFlink channel to the Apache Flink
+1
Best,
Alexander Fedulov
On Thu, 26 Oct 2023 at 13:39, Jing Ge wrote:
> Hi Ryan,
>
> +1
>
> Thanks for driving it. I have left one comment.
>
> Best regards,
> Jing
>
>
> On Wed, Oct 25, 2023 at 10:05 PM David Radley
> wrote:
>
> > Looks good
github.com/apache/flink/blob/9b63099964b36ad9d78649bb6f5b39473e0031bd/azure-pipelines.yml#L39
Best,
Alexander Fedulov
On Mon, 23 Oct 2023 at 14:44, Jing Ge wrote:
> Hi David,
>
> Please check [1] in the section Verify Java and Maven Version. Thanks!
>
> Best regards,
/flink/pull/12268/files#diff-39f0aea40d2dd3f026544bb4c2502b2e9eab4c825df5f2b68c6d4ca8c39d7b5e
[3] https://issues.apache.org/jira/browse/FLINK-5
Best,
Alexander Fedulov
Alexander Fedulov created FLINK-5:
-
Summary: Remove unused e2e tests
Key: FLINK-5
URL: https://issues.apache.org/jira/browse/FLINK-5
Project: Flink
Issue Type: Improvement
Alexander Fedulov created FLINK-33326:
-
Summary: Remove usage of FromElementsFunction
Key: FLINK-33326
URL: https://issues.apache.org/jira/browse/FLINK-33326
Project: Flink
Issue Type
+1 (non-binding)
Thanks for explicitly addressing my concerns from the previous attempt of
integrating the async-profiler ( FLIP-213 [1] ).
Best,
Alexander Fedulov
[1] https://lists.apache.org/thread/b5dpk4g6xgx0ysgnjphlnsvxftl17lqj
On Tue, 17 Oct 2023 at 12:57, Jing Ge wrote:
> +1(bind
Alexander Fedulov created FLINK-33286:
-
Summary: DataGeneratorSource should support automatic return type
detection
Key: FLINK-33286
URL: https://issues.apache.org/jira/browse/FLINK-33286
Project
Alexander Fedulov created FLINK-33199:
-
Summary: ArchitectureTests should test for canonical class names
instead of Class objects
Key: FLINK-33199
URL: https://issues.apache.org/jira/browse/FLINK-33199
Alexander Fedulov created FLINK-32904:
-
Summary: Support cron expressions for periodic snapshots triggering
Key: FLINK-32904
URL: https://issues.apache.org/jira/browse/FLINK-32904
Project: Flink
Congrats!
Best,
Alex
On Fri, 4 Aug 2023 at 11:09, Dan Zou wrote:
> Congrats, Matthias!
>
> Best,
> Dan Zou
>
>
>
>
>
> > 2023年8月4日 13:12，Samrat Deb 写道：
> >
> > Congrats, Matthias!
>
>
Alexander Fedulov created FLINK-32719:
-
Summary: Block upgrades during checkpoints when LATEST_STATE
recovery is configured
Key: FLINK-32719
URL: https://issues.apache.org/jira/browse/FLINK-32719
Alexander Fedulov created FLINK-32713:
-
Summary: Cascade deprecation to non-private methods that reference
SourceFunction
Key: FLINK-32713
URL: https://issues.apache.org/jira/browse/FLINK-32713
Alexander Fedulov created FLINK-32696:
-
Summary: Promote Kinesis connector support to PublicEvolving
Key: FLINK-32696
URL: https://issues.apache.org/jira/browse/FLINK-32696
Project: Flink
Hi,
I split the blockers [1] from the nice-to-haves [2] and added some missing
items.
>From [1], the one about support for the ExternallyInducedSource [3] is
debatable -
AFAIK, it is only used by Pravega, which is not an officially-supported
connector.
This can, arguably, be something we could
Alexander Fedulov created FLINK-32695:
-
Summary: Migrate SourceFunction in Tests to Source API
Key: FLINK-32695
URL: https://issues.apache.org/jira/browse/FLINK-32695
Project: Flink
Alexander Fedulov created FLINK-32694:
-
Summary: Cascade deprecation to classes that implement
ParallelSourceFunction
Key: FLINK-32694
URL: https://issues.apache.org/jira/browse/FLINK-32694
Alexander Fedulov created FLINK-32693:
-
Summary: Cascade deprecation to classes that directly implement
SourceFunction
Key: FLINK-32693
URL: https://issues.apache.org/jira/browse/FLINK-32693
Alexander Fedulov created FLINK-32692:
-
Summary: [umbrella] Nice-to-haves for SourceFunction API removal
Key: FLINK-32692
URL: https://issues.apache.org/jira/browse/FLINK-32692
Project: Flink
+1 (non-binding), assuming SourceFunction gets added back to the
doc as a "nice-to-have". I am glad we've reached a consensus here.
Extra thanks to Leonard for coordinating this discussion in particular.
Best,
Alex
On Wed, 26 Jul 2023 at 15:43, Jing Ge wrote:
> +1 (non-binding), glad to see we
ut what LTS means here.
> > > > > > >
> > > > > > >- IIUC, that means for the last 1.x minor release, we will
> > keep
> > > > > > >providing 1.x.y / 1.x.z bugfix release. This is a stronger
> > > support
> >
Alexander Fedulov created FLINK-32673:
-
Summary: Migrage Google PubSub connector to V2
Key: FLINK-32673
URL: https://issues.apache.org/jira/browse/FLINK-32673
Project: Flink
Issue Type
Alexander Fedulov created FLINK-32672:
-
Summary: Migrate RabbitMQ connector to Source V2 API
Key: FLINK-32672
URL: https://issues.apache.org/jira/browse/FLINK-32672
Project: Flink
Issue
Alexander Fedulov created FLINK-32670:
-
Summary: Annotate interfaces that inherit from SourceFunction as
deprecated
Key: FLINK-32670
URL: https://issues.apache.org/jira/browse/FLINK-32670
Hello everyone,
Recently, there were a lot of discussions about the deprecation of various
APIs for the upcoming 2.0 release. It appears there are two main motivations
with opposing directions, causing these discussions to remain unsettled. On
one hand, there's a desire to finally trim a wide
> How about this, we continue with the vote as is, and keep the discussion
on
the SourceFunction in Jira or a separate thread.
Sure, but I just want to mention two important things here before we switch
over to [1]:
>Given that eliminating the removal of SourceFunction was proposed 10 days
-
@Leonard
I see your concerns regarding the complexity of migration, but we still
have one year to address them.
@Xintong
I believe it makes sense to keep it in the list and mark it as a stretch
goal if you have concerns
with the "must have" label.
Best,
Alexander
On Thu, 20 Jul 2023 at 11:25,
Jing Ge wrote:
>
> > Hi Alex,
> >
> >
> > > > 3. remove SinkFunction.
> > > Which steps do you imply for the 1.18 release and for the 2.0 release?
> > >
> >
> > for 2.0 release. 1.18 will be released soon.
> >
> >
rs.
> >>>
> >>> I am ok with both of them and personally prefer option 1.
> >>>
> >>> Best regards,
> >>> Jing
> >>>
> >>>
> >>> On Fri, Jun 30, 2023 at 3:41 AM Xintong Song
> >>> wrote:
> >>&
rce source =
DataGeneratorSource.fromCollection(env, data);
I would appreciate hearing your thoughts and suggestions on this matter.
[1] https://github.com/apache/flink/pull/20049
[2] https://github.com/apache/flink/pull/22850
Best,
Alex
On Wed, 21 Jun 2023 at 19:27, Alexander Fedulov
wrote:
> I'd like to reviv
this is the case,
> we probably should not deprecate the API until these issues are resolved.
> Do you think it is feasible to resolve them by the feature freeze date of
> 1.18?
>
> Best,
>
> Xintong
>
>
>
> On Thu, Jun 29, 2023 at 8:02 PM Alexander Fedulov <
> alex
ch means without this
> API some of functions cannot be supported, then how could it be deprecated?
> How would we expect users to migrate away from it?
>
>
> @Jing,
>
> Sounds like it's impractical to deprecate SinkFunction in 1.18. Any
> expectation / plan on when / how
Hi Xintong,
Thanks for bringing up this topic. I can provide some details regarding
the SourceFunction deprecation efforts. Marking SourceFunction as
deprecated was not possible until now since we have stringent compiler
checks in flink-examples against using any deprecated APIs. We actually
Hi Xintong,
By compatibility discussion do you mean the "[DISCUSS] FLIP-321: Introduce
an API deprecation process" thread [1]?
I am also curious to know if the rationale behind this new API has been
previously discussed on the mailing list. Do we have a list of shortcomings
in the current
this work thread related
to StreamExecutionEnvironment#fromCollection() methods.
The discussion seem to have stalled:
https://github.com/apache/flink/pull/21028
Thanks,
Alex
On 2022/06/15 19:30:31 Alexander Fedulov wrote:
> Thank you all for your valuable input and participation in the discuss
Alexander Fedulov created FLINK-32373:
-
Summary: Support passing headers with SQL Client gateway requests
Key: FLINK-32373
URL: https://issues.apache.org/jira/browse/FLINK-32373
Project: Flink
cookies) to be passed along with each RestClient
request.
Any objections or alternative suggestions?
Best,
Alex
On Mon, 8 May 2023 at 20:14, Alexander Fedulov
wrote:
> Hi Thomas,
>
> Thanks for the feedback. I created two separate tickets to track the
> related work:
> https://is
Do you have a JIRA for this work?
>
> Thanks,
> Thomas
>
>
> On Wed, May 3, 2023 at 11:46 AM Alexander Fedulov <
> alexander.fedu...@gmail.com> wrote:
>
> > CC'ing some people who worked on the original implementation - curious to
> > hear your thoughts.
&g
Alexander Fedulov created FLINK-32035:
-
Summary: SQL Client should support HTTPS with built-in JDK
certificates
Key: FLINK-32035
URL: https://issues.apache.org/jira/browse/FLINK-32035
Project
Alexander Fedulov created FLINK-32030:
-
Summary: SQL Client gateway mode should accept URLs
Key: FLINK-32030
URL: https://issues.apache.org/jira/browse/FLINK-32030
Project: Flink
Issue
CC'ing some people who worked on the original implementation - curious to
hear your thoughts.
Alex
On Fri, 28 Apr 2023 at 14:41, Alexander Fedulov
wrote:
> I would like to discuss the current implementation of the SQL Gateway
> support in SQL Cli Client and how it can be improved.
I would like to discuss the current implementation of the SQL Gateway
support in SQL Cli Client and how it can be improved.
1) *hosname:port/v1 vs
https://hostname:port/flink-clusters/session-cluster-1/v1 *
Currently, the *--endpoint* parameter needs to be specified in the
*InetSocketAddress*
+1 for the proposal,
Best,
Alex
On Wed, 26 Apr 2023 at 15:50, Chesnay Schepler wrote:
> * adds a note to not include "import " in the regex" *
>
> On 26/04/2023 11:22, Maximilian Michels wrote:
> > If we ban Mockito imports, I can still write tests using the full
> > qualifiers, right?
> >
> >
Alexander Fedulov created FLINK-31871:
-
Summary: Interpret Flink MemoryUnits according to the actual user
input
Key: FLINK-31871
URL: https://issues.apache.org/jira/browse/FLINK-31871
Project
Great to see this, congratulations!
Best,
Alex
On Mon, 27 Mar 2023 at 11:24, Yu Li wrote:
> Dear Flinkers,
>
>
>
> As you may have noticed, we are pleased to announce that Flink Table Store
> has joined the Apache Incubator as a separate project called Apache
> Paimon(incubating) [1] [2]
Alexander Fedulov created FLINK-29890:
-
Summary: UDFs classloading from JARs in 1.16 is broken
Key: FLINK-29890
URL: https://issues.apache.org/jira/browse/FLINK-29890
Project: Flink
Alexander Fedulov created FLINK-29727:
-
Summary: Fall back to flink-conf.yaml if no
JOB_MANAGER_RPC_ADDRESS is specified
Key: FLINK-29727
URL: https://issues.apache.org/jira/browse/FLINK-29727
Hi Etienne,
thanks for your contribution. In light of the current efforts to
externalize connectors, do you think we could maybe combine the new
implementation with moving it into an external repository instead of
merging into Flink main?
Best,
Alexander Fedulov
On Fri, Oct 14, 2022 at 4:18 PM
+1
On Wed, Oct 19, 2022 at 12:56 PM Jing Ge wrote:
> +1
>
> On Wed, Oct 19, 2022 at 10:31 AM David Anderson
> wrote:
>
> > +1
> >
> >
> >
> > On Mon, Oct 17, 2022 at 3:39 PM Martijn Visser >
> > wrote:
> >
> > > Hi everyone,
> > >
> > > I'm hereby opening a vote for FLIP-265 Deprecate and
Alexander Fedulov created FLINK-29476:
-
Summary: Kinesis Connector retry mechanism not applied to
EOFException
Key: FLINK-29476
URL: https://issues.apache.org/jira/browse/FLINK-29476
Project
Alexander Fedulov created FLINK-29364:
-
Summary: Root cause of Exceptions thrown in the SourceReader
start() method gets "swallowed".
Key: FLINK-29364
URL: https://issues.apache.org/jira/browse/F
Congrats, Martijn!
On Mon, Sep 12, 2022 at 10:06 AM Jing Ge wrote:
> Congrats!
>
> On Mon, Sep 12, 2022 at 9:38 AM Daisy Tsang wrote:
>
> > Congrats!
> >
> > On Mon, Sep 12, 2022 at 9:32 AM Martijn Visser >
> > wrote:
> >
> > > Thank you all :)
> > >
> > > Op zo 11 sep. 2022 om 13:58 schreef
+1 (non-binding)
On Wed, Sep 7, 2022 at 9:28 PM Thomas Weise wrote:
> +1
>
>
> On Wed, Sep 7, 2022 at 4:48 AM Danny Cranmer
> wrote:
>
> > +1
> >
> > On Wed, 7 Sept 2022, 07:32 Zhu Zhu, wrote:
> >
> > > +1
> > >
> > > Thanks,
> > > Zhu
> > >
> > > Jingsong Li 于2022年9月6日周二 19:49写道：
> > > >
>
to everyone for participating in the discussions [2] and the voting
[3].
[1] https://cwiki.apache.org/confluence/x/9Av1D
[2] https://lists.apache.org/thread/7gjxto1rmkpff4kl54j8nlg5db2rqhkt
[3] https://lists.apache.org/thread/t7td1lvyy1znlj4294snm88o2jdmbhbn
Best,
Alexander Fedulov
universal
interface
- The sourceRatePerSecond parameter type was changed from long to double to
allow generating less than one event per second
Best,
Alexander Fedulov
On Mon, Jul 18, 2022 at 5:23 PM Alexander Fedulov
wrote:
> Hi all,
>
> I updated the FLIP [1] to make it more e
+ weekend), unless there is
an objection or not enough votes.
[1] https://lists.apache.org/thread/7gjxto1rmkpff4kl54j8nlg5db2rqhkt
[2] https://cwiki.apache.org/confluence/x/9Av1D
[3] https://github.com/apache/flink/pull/20049#issuecomment-1170948767
Best,
Alexander Fedulov
+1
Looking forward to using the API to simplify tests setups.
Best,
Alexander Fedulov
On Tue, Jul 19, 2022 at 2:31 PM Martijn Visser
wrote:
> Thanks for creating the FLIP and opening the vote Chesnay.
>
> +1 (binding)
>
> Op di 19 jul. 2022 om 10:26 schreef Chesnay Schepler :
-streaming/src/main/java/org/apache/flink/streaming/examples/wordcount/GeneratorSourcePOC.java#L92
Best,
Alexander Fedulov
On Thu, Jul 7, 2022 at 12:08 AM Alexander Fedulov
wrote:
> Hi Becket,
>
> interesting points about the discrepancies in the *RuntimeContext*
> "wra
es.
>
> What do you think? Is it necessary to raise a FLIP separately? If
> necessary, you can also write the first version of the proposal for
> source rate-limiting, and then I will add some of my ideas :)
>
> Thanks,
> Steve
>
> Alexander Fedulov 于2022年7月14日周四 00:47写道：
&g
>
Did you plan to go further than this?
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-238%3A+Introduce+FLIP-27-based+Data+Generator+Source
Best,
Alexander Fedulov
On Wed, Jul 13, 2022 at 6:38 PM Steve Yurong Su wrote:
> Hi Jark,
>
> Thanks a lot :)
>
> S
+1. Thanks, Anton.
Best,
Alexander Fedulov
On Mon, Jul 11, 2022 at 3:17 PM Márton Balassi
wrote:
> +1 (binding). Thanks!
>
> I can help you with the Slack admin steps if needed.
>
> On Mon, Jul 11, 2022 at 10:55 AM godfrey he wrote:
>
> > +1, Thanks for dr
Hi Becket,
interesting points about the discrepancies in the *RuntimeContext*
"wrapping" throughout the framework, but I agree - this is something that
needs to be tackled separately.
For now, I adjusted the FLIP and the PoC implementation to only expose the
parallelism.
Best,
Alexand
I decided that the classes listed above are generic enough to be placed
into *flink-test-utils*.
Here is the PR for the discussed changes that needs a review:
https://github.com/apache/flink/pull/20188
Best,
Alex
On Wed, Jul 6, 2022 at 1:35 PM Alexander Fedulov
wrote:
> Hi Ches
ed to e2e
> tests, ITCases are more lightweight and only focus on some specific part of
> the e2e pipeline. E2e tests cover the whole pipeline and could be
> considered as part of the acceptance test.
>
> Best regards,
> Jing
>
> On Mon, May 30, 2022 at 10:46 AM Alexander Fe
Alexander Fedulov created FLINK-28410:
-
Summary: Add Elasticsearch E2E test cases to the external
repository
Key: FLINK-28410
URL: https://issues.apache.org/jira/browse/FLINK-28410
Project: Flink
Alexander Fedulov created FLINK-28409:
-
Summary: Move FlinkContainerTestEnvironment and its dependencied
into flink-connector-test-utils
Key: FLINK-28409
URL: https://issues.apache.org/jira/browse/FLINK-28409
and
see if anything else might actually be needed later on. What do you think?
Best,
Alexander Fedulov
On Tue, Jul 5, 2022 at 2:30 AM Becket Qin wrote:
> Hi Alex,
>
> While it is true that the RuntimeContext gives access to all the stuff the
> framework can provide, it seems a little
,
Alexander Fedulov
On Mon, Jul 4, 2022 at 12:08 PM Alexander Fedulov
wrote:
> Hi Becket,
>
> Exposing the RuntimeContext is potentially even more useful.
> Do you think it is worth having both currentParallelism() and
> getRuntimeContext() methods?
> O
Hi Becket,
Exposing the RuntimeContext is potentially even more useful.
Do you think it is worth having both currentParallelism() and
getRuntimeContext() methods?
One can always call getNumberOfParallelSubtasks() on the RuntimeContext
directly if we expose it.
Best,
Alexander Fedulov
On Mon
it should be as
simple as adding the following to the anonymous SourceReaderContext
implementation
in SourceOperator#initReader():
public int currentParallelism() {
return getRuntimeContext().getNumberOfParallelSubtasks();
}
Is that what you had in mind?
Best,
Alexander Fedulov
On Fri, Jul 1,
his.
Best,
Alexander Fedulov
On Mon, Jun 20, 2022 at 4:31 PM David Anderson wrote:
> I'm very happy with this. +1
>
> A lot of SourceFunction implementations used in demos/POC implementations
> include a call to sleep(), so adding rate limiting is a good idea, in my
> opinion.
>
>
Alexander Fedulov created FLINK-28229:
-
Summary: Introduce Source API alternatives for
StreamExecutionEnvironment#fromCollection() methods
Key: FLINK-28229
URL: https://issues.apache.org/jira/browse/FLINK
Alexander Fedulov created FLINK-28227:
-
Summary: Add implementations for classes in
o.a.f.streaming.examples based on the new new Source API
Key: FLINK-28227
URL: https://issues.apache.org/jira/browse/FLINK
for participating in the discussion and voting.
[1] https://lists.apache.org/thread/kv9rj3w2rmkb8jtss5bqffhw57or7v8v
Best,
Alexander Fedulov
think?
Best,
Alexander Fedulov
On Tue, Jun 14, 2022 at 7:17 PM Jing Ge wrote:
> Hi,
>
> After reading all discussions posted in this thread and the source code of
> DataGeneratorSource which unfortunately used "Source" instead of
> "SourceFunction" i
Thank you all for your valuable input and participation in the discussion
The vote is open now [1]
[1] https://lists.apache.org/thread/kv9rj3w2rmkb8jtss5bqffhw57or7v8v
Best,
Alexander Fedulov
On Tue, Jun 14, 2022 at 10:21 PM Jing Ge wrote:
> Hi Martijn,
>
> Yes, that is exact
the SourceFunction interface
itself as @Deprecated + redirecting to the FLIP-27 Source API
right away, without waiting for all the subtasks to be completed.
[1] https://lists.apache.org/thread/d6cwqw9b3105wcpdkwq7rr4s7x4ywqr9
[2] https://issues.apache.org/jira/browse/FLINK-28045
Best,
Alexander
Hi Steven,
FYI, I've added your requirement to the list of subtasks for
deprecating the SourceFunction API [1] [2].
[1] https://issues.apache.org/jira/browse/FLINK-28045
[2] https://issues.apache.org/jira/browse/FLINK-28054
Best,
Alexander Fedulov
On Tue, Jun 7, 2022 at 6:03 PM Steven Wu
to do a formal vote for
this change or should we simply kick it off with the first deprecations
based on the discussion above?
Best,
Alexander Fedulov
On Tue, Jun 14, 2022 at 4:26 PM Jing Ge wrote:
> Hi Alex,
>
> I guess you are meaning to start a new voting thread following the FLIP
>
1 - 100 of 163 matches
Mail list logo
