Chesnay Schepler created FLINK-22216:
Summary: Log start of RM on info, instead of DeclarativeSlotManager
Key: FLINK-22216
URL: https://issues.apache.org/jira/browse/FLINK-22216
Project: Flink
Chesnay Schepler created FLINK-22214:
Summary: Add quotes around checkpoint storage types
Key: FLINK-22214
URL: https://issues.apache.org/jira/browse/FLINK-22214
Project: Flink
Issue
Chesnay Schepler created FLINK-22213:
Summary: Do not log hashcode of filesystem factory
Key: FLINK-22213
URL: https://issues.apache.org/jira/browse/FLINK-22213
Project: Flink
Issue Type
Chesnay Schepler created FLINK-22212:
Summary: Clean up RM resource requirement logging
Key: FLINK-22212
URL: https://issues.apache.org/jira/browse/FLINK-22212
Project: Flink
Issue Type
Chesnay Schepler created FLINK-22211:
Summary: DataStream.collect() logs warnings if job is not
initialized yet
Key: FLINK-22211
URL: https://issues.apache.org/jira/browse/FLINK-22211
Project
Chesnay Schepler created FLINK-22210:
Summary: Log conversion of input channels on debug
Key: FLINK-22210
URL: https://issues.apache.org/jira/browse/FLINK-22210
Project: Flink
Issue Type
Chesnay Schepler created FLINK-22208:
Summary: Bump snappy-java to 1.1.5+
Key: FLINK-22208
URL: https://issues.apache.org/jira/browse/FLINK-22208
Project: Flink
Issue Type: Improvement
Chesnay Schepler created FLINK-22184:
Summary: Rest client shutdown on failure runs in netty thread
Key: FLINK-22184
URL: https://issues.apache.org/jira/browse/FLINK-22184
Project: Flink
Chesnay Schepler created FLINK-22183:
Summary: Update Website copyright footer
Key: FLINK-22183
URL: https://issues.apache.org/jira/browse/FLINK-22183
Project: Flink
Issue Type: Task
The Apache Flink community is very happy to announce the release of
Apache Flink-shaded 13.0.
The flink-shaded project contains a number of shaded dependencies for
Apache Flink.
Apache Flink® is an open-source stream processing framework for
distributed, high-performing, always-available, an
Chesnay Schepler created FLINK-22116:
Summary: Setup .asf.yaml in flink-web
Key: FLINK-22116
URL: https://issues.apache.org/jira/browse/FLINK-22116
Project: Flink
Issue Type: Task
The vote has passed with 3 binding votes.
Votes:
Dawid (+1)
Robert (+1)
Gordon (+1)
On 3/31/2021 2:07 PM, Chesnay Schepler wrote:
Hi everyone,
Please review and vote on the release candidate #1 for the version
13.0, as follows:
[ ] +1, Approve the release
[ ] -1, Do not approve the release
Chesnay Schepler created FLINK-22072:
Summary: Rethink UnfulfillableSlotRequestException class hierarchy
Key: FLINK-22072
URL: https://issues.apache.org/jira/browse/FLINK-22072
Project: Flink
Hi everyone,
Please review and vote on the release candidate #1 for the version 13.0,
as follows:
[ ] +1, Approve the release
[ ] -1, Do not approve the release (please provide specific comments)
The complete staging area is available for your review, which includes:
* JIRA release notes [1],
It may cause certain metric backends to reject metrics due to names
being too long.
IIRC we have seen this with graphite in particular.
In some cases removing this truncation can also impact the transfer of
metrics due to size limitations.
Overall, I would advise you to not remove this trunca
It just initializes the field to ensure it is set when it is
deserialized server-side.
There is neither a guarantee nor requirement that the APIs must set the
ExecutionConfig at least once, so this ensures that on the server-side
the execution config is never null.
On 3/26/2021 11:18 AM, Zhang
". If "fixVersion" would mean "there is a concrete plan to
have this in the release", it might be less of a problem.
On Fri, Mar 26, 2021 at 11:03 AM Chesnay Schepler <mailto:ches...@apache.org>> wrote:
That's a fair point, but then that raises t
thing. In the proposal I shared a blocker is therefore defined as
"infrastructure
failures, bugs that block a release". With this definition FLINK-21152
would not be blocker, or would it? Cheers, Konstantin
On Fri, Mar 26, 2021 at 8:55 AM Chesnay Schepler wrote:
FLINK-21152 is an example
FLINK-21152 is an example of a blocker issue that can remain stale for
months.
On 3/26/2021 8:46 AM, Konstantin Knauf wrote:
Hi Arvid,
I agree that this should never happen for blockers. My thinking was that if
an unassigned blocker is deprioritized after 1 day it also forces us to
find someon
When/how are labels removed?
On 3/24/2021 10:06 AM, Matthias Pohl wrote:
Thanks Konstantin for working on this. The ideas we collected in [1] sound
good. I'm looking forward to trying it out.
+1 from my side.
Best,
Matthias
[1]
https://lists.apache.org/thread.html/re7affbb1357ce4986a7770b0052c
Chesnay Schepler created FLINK-21874:
Summary: Check for out-dated slot allocation confirmations is
insufficient
Key: FLINK-21874
URL: https://issues.apache.org/jira/browse/FLINK-21874
Project
being installed? (e.g., in setup.py)
On 3/16/2021 1:23 PM, Dian Fu wrote:
Yes, the size of .whl file in PyFlink will also be about 3MB if we split the
package. Currently the package is big because we bundled the jar files in it.
2021年3月16日 下午8:13，Chesnay Schepler 写道：
key difference being tha
PM Xintong Song wrote:
Actually, I think it's 9 packages, not 7.
Check here for the 1.12.2 packages.
https://pypi.org/project/apache-flink/#files
Thank you~
Xintong Song
On Tue, Mar 16, 2021 at 7:08 PM Chesnay Schepler
wrote:
Am I reading this correctly that we publish 7 differen
Am I reading this correctly that we publish 7 different artifacts just
for python?
What does the release matrix look like?
On 3/16/2021 3:45 AM, Dian Fu wrote:
Hi Xingbo,
Thanks a lot for bringing up this discussion. Actually the size limit already
becomes an issue during releasing 1.11.3 an
Chesnay Schepler created FLINK-21776:
Summary: Migrate all JobManagerJobMG instantiations to factory
method
Key: FLINK-21776
URL: https://issues.apache.org/jira/browse/FLINK-21776
Project: Flink
Chesnay Schepler created FLINK-21775:
Summary: Migrate all JobManagerMG instantiations to factory method
Key: FLINK-21775
URL: https://issues.apache.org/jira/browse/FLINK-21775
Project: Flink
Chesnay Schepler created FLINK-21773:
Summary: Remove dependency from flink-metrics-statsd
Key: FLINK-21773
URL: https://issues.apache.org/jira/browse/FLINK-21773
Project: Flink
Issue
Chesnay Schepler created FLINK-21772:
Summary: Remove dependency from flink-metrics-slf4j
Key: FLINK-21772
URL: https://issues.apache.org/jira/browse/FLINK-21772
Project: Flink
Issue
Chesnay Schepler created FLINK-21771:
Summary: Replace StreamTaskTestHarness#TestTaskMetricGroup
Key: FLINK-21771
URL: https://issues.apache.org/jira/browse/FLINK-21771
Project: Flink
Chesnay Schepler created FLINK-21770:
Summary: JobManagerMG should not accept JobGraph
Key: FLINK-21770
URL: https://issues.apache.org/jira/browse/FLINK-21770
Project: Flink
Issue Type
Chesnay Schepler created FLINK-21769:
Summary: Encapsulate component meta data
Key: FLINK-21769
URL: https://issues.apache.org/jira/browse/FLINK-21769
Project: Flink
Issue Type: Sub-task
Chesnay Schepler created FLINK-21767:
Summary: ComponentMetricGroups should return plain QueryScopeInfos
Key: FLINK-21767
URL: https://issues.apache.org/jira/browse/FLINK-21767
Project: Flink
Chesnay Schepler created FLINK-21766:
Summary: Remove OperatorMetricGroup#parent
Key: FLINK-21766
URL: https://issues.apache.org/jira/browse/FLINK-21766
Project: Flink
Issue Type: Sub
Chesnay Schepler created FLINK-21765:
Summary: Remove implementation-specific MetricGroup parents
Key: FLINK-21765
URL: https://issues.apache.org/jira/browse/FLINK-21765
Project: Flink
Chesnay Schepler created FLINK-21761:
Summary: Remove dependency from flink-metrics-influxdb
Key: FLINK-21761
URL: https://issues.apache.org/jira/browse/FLINK-21761
Project: Flink
Issue
Chesnay Schepler created FLINK-21762:
Summary: Remove dependency from flink-metrics-prometheus
Key: FLINK-21762
URL: https://issues.apache.org/jira/browse/FLINK-21762
Project: Flink
Chesnay Schepler created FLINK-21760:
Summary: Remove dependency from flink-metrics-jmx
Key: FLINK-21760
URL: https://issues.apache.org/jira/browse/FLINK-21760
Project: Flink
Issue Type
Chesnay Schepler created FLINK-21759:
Summary: Add TestMetricGroup
Key: FLINK-21759
URL: https://issues.apache.org/jira/browse/FLINK-21759
Project: Flink
Issue Type: Improvement
Chesnay Schepler created FLINK-21758:
Summary: Add default implementations for all MetricGroup methods
accepting ints
Key: FLINK-21758
URL: https://issues.apache.org/jira/browse/FLINK-21758
Chesnay Schepler created FLINK-21757:
Summary: Extract LogicalScopeProvider interface from
FrontMetricGroup
Key: FLINK-21757
URL: https://issues.apache.org/jira/browse/FLINK-21757
Project: Flink
Chesnay Schepler created FLINK-21756:
Summary: Move JMXServer to flink-core
Key: FLINK-21756
URL: https://issues.apache.org/jira/browse/FLINK-21756
Project: Flink
Issue Type: Sub-task
Chesnay Schepler created FLINK-21755:
Summary: Remove flink-runtime dependency from metric reporters
Key: FLINK-21755
URL: https://issues.apache.org/jira/browse/FLINK-21755
Project: Flink
Chesnay Schepler created FLINK-21751:
Summary: Improve handling of freed slots if final requirement
message is in flight
Key: FLINK-21751
URL: https://issues.apache.org/jira/browse/FLINK-21751
Chesnay Schepler created FLINK-21689:
Summary: UnalignedCheckpointITCase does not terminate
Key: FLINK-21689
URL: https://issues.apache.org/jira/browse/FLINK-21689
Project: Flink
Issue
Chesnay Schepler created FLINK-21636:
Summary: Setup a global timeout for all tests
Key: FLINK-21636
URL: https://issues.apache.org/jira/browse/FLINK-21636
Project: Flink
Issue Type
Chesnay Schepler created FLINK-21589:
Summary: Document Table/SQL API limitations regarding upgrades
with savepoints
Key: FLINK-21589
URL: https://issues.apache.org/jira/browse/FLINK-21589
Chesnay Schepler created FLINK-21571:
Summary: Japicmp reference version does not exist
Key: FLINK-21571
URL: https://issues.apache.org/jira/browse/FLINK-21571
Project: Flink
Issue Type
Chesnay Schepler created FLINK-21513:
Summary: Rethink up-/down-/restartingTime metrics
Key: FLINK-21513
URL: https://issues.apache.org/jira/browse/FLINK-21513
Project: Flink
Issue Type
Chesnay Schepler created FLINK-21510:
Summary: ExecutionGraph metrics collide on restart
Key: FLINK-21510
URL: https://issues.apache.org/jira/browse/FLINK-21510
Project: Flink
Issue Type
Chesnay Schepler created FLINK-21481:
Summary: Move git-commit-id-plugin execution to flink-runtime
Key: FLINK-21481
URL: https://issues.apache.org/jira/browse/FLINK-21481
Project: Flink
Chesnay Schepler created FLINK-21458:
Summary: Add numRestarts metric
Key: FLINK-21458
URL: https://issues.apache.org/jira/browse/FLINK-21458
Project: Flink
Issue Type: Sub-task
Chesnay Schepler created FLINK-21451:
Summary: Remove TaskExecutionState#jobID
Key: FLINK-21451
URL: https://issues.apache.org/jira/browse/FLINK-21451
Project: Flink
Issue Type
Chesnay Schepler created FLINK-21410:
Summary: Document checkpoint interval trade-offs
Key: FLINK-21410
URL: https://issues.apache.org/jira/browse/FLINK-21410
Project: Flink
Issue Type
This is the right place to ask such questions; in fact I'd suggest to
just open a JIRA ticket.
On 2/18/2021 2:50 PM, Miguel Araújo wrote:
Apologies if this would be a better fit for the user mailing list, but I
was unsure where to ask questions on (yet) unreleased functionality.
I was really h
Chesnay Schepler created FLINK-21409:
Summary: Add Avro to DataTypes & Serialization docs
Key: FLINK-21409
URL: https://issues.apache.org/jira/browse/FLINK-21409
Project: Flink
I
Chesnay Schepler created FLINK-21408:
Summary: Clarify which DataStream sources support Batch execution
Key: FLINK-21408
URL: https://issues.apache.org/jira/browse/FLINK-21408
Project: Flink
Chesnay Schepler created FLINK-21407:
Summary: Clarify which sources and APIs support which formats
Key: FLINK-21407
URL: https://issues.apache.org/jira/browse/FLINK-21407
Project: Flink
Chesnay Schepler created FLINK-21406:
Summary: Add AvroParquetFileRecordFormat
Key: FLINK-21406
URL: https://issues.apache.org/jira/browse/FLINK-21406
Project: Flink
Issue Type: New
Chesnay Schepler created FLINK-21405:
Summary: SchedulerNGFactoryFactoryTest fails if
DeclarativeScheduler is enabled via property
Key: FLINK-21405
URL: https://issues.apache.org/jira/browse/FLINK-21405
Chesnay Schepler created FLINK-21404:
Summary: YARNITCase runs indefinitely
Key: FLINK-21404
URL: https://issues.apache.org/jira/browse/FLINK-21404
Project: Flink
Issue Type: Sub-task
Chesnay Schepler created FLINK-21403:
Summary: Some tests expect to fail if parallelism cannot be met
Key: FLINK-21403
URL: https://issues.apache.org/jira/browse/FLINK-21403
Project: Flink
Chesnay Schepler created FLINK-21402:
Summary: Consolidate Scheduler/SlotPool factories
Key: FLINK-21402
URL: https://issues.apache.org/jira/browse/FLINK-21402
Project: Flink
Issue Type
Chesnay Schepler created FLINK-21401:
Summary: Tests that manually build a JobGraph cannot use
DeclarativeScheduler
Key: FLINK-21401
URL: https://issues.apache.org/jira/browse/FLINK-21401
Project
Chesnay Schepler created FLINK-21400:
Summary: Attempt numbers are not maintained across restarts
Key: FLINK-21400
URL: https://issues.apache.org/jira/browse/FLINK-21400
Project: Flink
Chesnay Schepler created FLINK-21399:
Summary: Adjust
JobMasterTest#testRequestNextInputSplitWith*Failover
Key: FLINK-21399
URL: https://issues.apache.org/jira/browse/FLINK-21399
Project: Flink
Chesnay Schepler created FLINK-21398:
Summary: Adjsut JobMasterTest#testRestoring[...]FromSavepoint
Key: FLINK-21398
URL: https://issues.apache.org/jira/browse/FLINK-21398
Project: Flink
Chesnay Schepler created FLINK-21386:
Summary: FromElements ignores returns()
Key: FLINK-21386
URL: https://issues.apache.org/jira/browse/FLINK-21386
Project: Flink
Issue Type: Bug
Chesnay Schepler created FLINK-21380:
Summary: Restarting/Canceling/Failing expose globally-terminal EG
Key: FLINK-21380
URL: https://issues.apache.org/jira/browse/FLINK-21380
Project: Flink
Chesnay Schepler created FLINK-21377:
Summary: Refactor some queryable-state JobMaster tests to work
against schedulers
Key: FLINK-21377
URL: https://issues.apache.org/jira/browse/FLINK-21377
Chesnay Schepler created FLINK-21368:
Summary: Consider removing RpcService#getExecutor
Key: FLINK-21368
URL: https://issues.apache.org/jira/browse/FLINK-21368
Project: Flink
Issue Type
Chesnay Schepler created FLINK-21362:
Summary: Remove State#onEnter
Key: FLINK-21362
URL: https://issues.apache.org/jira/browse/FLINK-21362
Project: Flink
Issue Type: Sub-task
Sure, but for WSL in particular we'd ideally we have way to detect that
we're even running within it. I'm not sure whether there is a sane
solution for that that works across various distros.
On 2/11/2021 1:14 AM, bytesandwich wrote:
Hi Chesnay and 郁蓝
Thank you for your help. I think Chesnay'
I can't tell you where it comes from, just that the Flink project had
nothing to do with it.
FYI; Hadoop 3 has been supported by Flink since 1.11 . We do no longer
publish shaded-hadoop jars though because it is a maintenance nightmare.
On 2/10/2021 6:54 PM, Adam Roberts wrote:
Hey everyone,
-1.12 branches we
will
need to remember to remove docs/content?
Best,
Piotrek
śr., 10 lut 2021 o 16:08 Seth Wiesman napisał(a):
One thing at a time :)
I'm creating tickets now for the ones on the PR but please create
others
as
they come up.
On Wed, Feb 10, 2021 at 9:02 AM Chesnay Sch
Thank you Seth for the work you put in. This is a really nice improvement.
(When do we migrate the Flink website? :P )
Regarding the follow-ups raised in the PR, will you go over them and
create tickets, or...?
On 2/10/2021 3:40 PM, Seth Wiesman wrote:
Hi Everyone,
I'm happy to say the migra
Chesnay Schepler created FLINK-21342:
Summary: Various classes extending TestBases cannot be instantiated
Key: FLINK-21342
URL: https://issues.apache.org/jira/browse/FLINK-21342
Project: Flink
Chesnay Schepler created FLINK-21340:
Summary: CheckForbiddenMethodsUsage is not run and fails
Key: FLINK-21340
URL: https://issues.apache.org/jira/browse/FLINK-21340
Project: Flink
Chesnay Schepler created FLINK-21339:
Summary: ExceptionUtilsITCases is not run and fails
Key: FLINK-21339
URL: https://issues.apache.org/jira/browse/FLINK-21339
Project: Flink
Issue
Chesnay Schepler created FLINK-21338:
Summary: Relax test naming constraints
Key: FLINK-21338
URL: https://issues.apache.org/jira/browse/FLINK-21338
Project: Flink
Issue Type
Chesnay Schepler created FLINK-21337:
Summary: ComparableInputTypeStrategyTests is not running
Key: FLINK-21337
URL: https://issues.apache.org/jira/browse/FLINK-21337
Project: Flink
Chesnay Schepler created FLINK-21322:
Summary: Add ExecutionGraphHandler
Key: FLINK-21322
URL: https://issues.apache.org/jira/browse/FLINK-21322
Project: Flink
Issue Type: Improvement
The 1.13 feature freeze is scheduled for the end of march, and the
release can be expected to happen between 2-4 weeks after that.
On 2/8/2021 11:21 AM, Adam Roberts wrote:
Hey Till, all - thanks for the information, very useful to know.
So the JIRAs in particular are for upgrading the version
When running the tests in WSL you will run into 2 issues:
a) building the WebUI can be unbearably so such that it pretty much
never finishes; you may want to activate the skip-webui-build profile
b) certain tests check how port conflicts are being handled, but WSL has
broken behavior in that reg
Chesnay Schepler created FLINK-21303:
Summary: Maybe remove LogicalSlot#getPhysicalSlotNumber
Key: FLINK-21303
URL: https://issues.apache.org/jira/browse/FLINK-21303
Project: Flink
Issue
Chesnay Schepler created FLINK-21252:
Summary: Scala quickstarts should specify -target jvm version
Key: FLINK-21252
URL: https://issues.apache.org/jira/browse/FLINK-21252
Project: Flink
+1
On 2/2/2021 10:11 AM, Till Rohrmann wrote:
+1 (binding)
Cheers,
Till
On Mon, Feb 1, 2021 at 5:38 AM Xintong Song wrote:
+1 (binding)
Thank you~
Xintong Song
On Mon, Feb 1, 2021 at 11:56 AM Yangze Guo wrote:
Hi everyone,
I'd like to start the vote of FLIP-156 [1]. This FLIP is di
Chesnay Schepler created FLINK-21210:
Summary: ApplicationClusterEntryPoints should explicitly close
PackagedProgram
Key: FLINK-21210
URL: https://issues.apache.org/jira/browse/FLINK-21210
Chesnay Schepler created FLINK-21209:
Summary: Update stackbrew maintainer field
Key: FLINK-21209
URL: https://issues.apache.org/jira/browse/FLINK-21209
Project: Flink
Issue Type
Chesnay Schepler created FLINK-21205:
Summary: Maybe remove Locality enum
Key: FLINK-21205
URL: https://issues.apache.org/jira/browse/FLINK-21205
Project: Flink
Issue Type: Improvement
Chesnay Schepler created FLINK-21204:
Summary: Remove LogicalSlot#getSlotSharingGroupId
Key: FLINK-21204
URL: https://issues.apache.org/jira/browse/FLINK-21204
Project: Flink
Issue Type
Yes, since we're only operating within the scheduler, which exists
separately for each job, we don't have to worry about collisions with
other jobs.
On 1/27/2021 11:08 AM, Yangze Guo wrote:
Thanks for preparing the FLIP and driving the discussion, Till. All of
my questions have already been an
Chesnay Schepler created FLINK-21164:
Summary: Jar handlers don't cleanup temporarily extracted jars
Key: FLINK-21164
URL: https://issues.apache.org/jira/browse/FLINK-21164
Project:
+1
While I don't think the filesystem is really useless, in it's current
state it is not maintainable, and so far no one rose up to remedy this.
On 1/27/2021 10:57 AM, Aljoscha Krettek wrote:
+1
I'm almost always in favour of removing old code instead of continuing
to let it rot.
Best,
Al
Chesnay Schepler created FLINK-21161:
Summary: Investigate Datadog OOM on timeout
Key: FLINK-21161
URL: https://issues.apache.org/jira/browse/FLINK-21161
Project: Flink
Issue Type
and requires no change, so I'm actually just leaning
towards that. However, the Kubernetes context is, I guess, not the only
one
to consider.
Best regards
Ingo
On Tue, Jan 26, 2021 at 3:48 PM Chesnay Schepler
wrote:
Mind you that we could of course solve these character issues by first
n
Chesnay Schepler created FLINK-21152:
Summary: Bump flink-shaded to 13.0
Key: FLINK-21152
URL: https://issues.apache.org/jira/browse/FLINK-21152
Project: Flink
Issue Type: Improvement
MetricReporter(Factory) API, migrating away from
java.util.Properties to Configuration
c) exclude reporters from this feature, which would be quite unfortunate.
On 1/26/2021 3:48 PM, Chesnay Schepler wrote:
Mind you that we could of course solve these character issues by first
nailing down whic
Mind you that we could of course solve these character issues by first
nailing down which characters we allow in keys (presumably: [a-z0-9-.]).
On 1/26/2021 3:45 PM, Chesnay Schepler wrote:
Here's an example: My option key is custom.my_backend_option. With the
current design, the correspo
in the discussion) Maybe we can put an intermediate
summary of pros and cons of different approaches into the FLIP?
And for completeness, we could combine DYNAMIC_VARIABLES approach with
passing individual variables.
Regards,
Roman
On Tue, Jan 26, 2021 at 12:54 PM Chesnay Schepler
wrote:
I think we have
I think we have to assume that some user has a custom config option that
uses underscores.
That said, we can probably assume that no one uses other special
characters like question marks and such, which are indeed allowed by the
YAML spec.
These kind of questions are precisely why I prefer t
1101 - 1200 of 3251 matches
Mail list logo
