Dawid Wysakowicz created FLINK-21148:
Summary: YARNSessionFIFOSecuredITCase cannot connect to BlobServer
Key: FLINK-21148
URL: https://issues.apache.org/jira/browse/FLINK-21148
Project: Flink
Dawid Wysakowicz created FLINK-21147:
Summary: Resuming Savepoint (file, async, no parallelism change)
fails with UnknownHostException
Key: FLINK-21147
URL: https://issues.apache.org/jira/browse/FLINK-21147
zhisheng created FLINK-21146:
Summary: 【SQL】Flink SQL Client not support specify the queue to
submit the job
Key: FLINK-21146
URL: https://issues.apache.org/jira/browse/FLINK-21146
Project: Flink
HideOnBush created FLINK-21145:
--
Summary: Flink Temporal Join Hive optimization
Key: FLINK-21145
URL: https://issues.apache.org/jira/browse/FLINK-21145
Project: Flink
Issue Type: Wish
Yang Wang created FLINK-21144:
-
Summary:
KubernetesResourceManagerDriver#tryResetPodCreationCoolDown causes fatal error
Key: FLINK-21144
URL: https://issues.apache.org/jira/browse/FLINK-21144
Project:
zhisheng created FLINK-21143:
Summary: 【runtime】flink job use the lib jars instead of the
`yarn.provided.lib.dirs` config jars
Key: FLINK-21143
URL: https://issues.apache.org/jira/browse/FLINK-21143
YUJIANBO created FLINK-21142:
Summary: Flink guava Dependence problem
Key: FLINK-21142
URL: https://issues.apache.org/jira/browse/FLINK-21142
Project: Flink
Issue Type: Bug
Components:
It appears that the discussion in FLIP-161 is primarily focussed on setting
individual configuration entries?
On the other hand, $FLINK_PROPERTIES (and envsubst) were introduced to set
a fragment or the complete flink-conf.yaml. It's used by at least 2 of the
Flink k8s operators.
In these cases
Hi Mats and Jakob,
+1 to what Till said about non-deterministic behavior. Also I suggest you
look at only Pinot's offline segment creation from Flink.
Pinot provides an inbuilt lambda architecture and has the real-time and
offline segments per table (architecture diagram
Thanks for the summary, Yangze.
The changes and follow-up issues LGTM. Let's wait for responses from the
others before starting a vote.
Thank you~
Xintong Song
On Tue, Jan 26, 2021 at 11:08 AM Yangze Guo wrote:
> Thanks everyone for the lively discussion. I'd like to try to
> summarize the
HUANG Hong created FLINK-21141:
--
Summary: Timeout bug in data stream connect operation
Key: FLINK-21141
URL: https://issues.apache.org/jira/browse/FLINK-21141
Project: Flink
Issue Type: Bug
Dian Fu created FLINK-21140:
---
Summary: Extract zip file dependencies before adding to PYTHONPATH
Key: FLINK-21140
URL: https://issues.apache.org/jira/browse/FLINK-21140
Project: Flink
Issue Type:
Thanks everyone for the lively discussion. I'd like to try to
summarize the current convergence in the discussion. Please let me
know if I got things wrong or missed something crucial here.
Change of this FLIP:
- Treat the SSG resource requirements as a hint instead of a
restriction for the
## configuration option
I see your point that autoscaling mode might be more suitable for session
clusters. It doesn't change that `execution-mode` could be a job-level
configuration. But I'm good with keeping it cluster-level and marking it
experimental at the moment, so we can change it later
Ivan Serdyuk created FLINK-21139:
Summary: java.lang.AssertionError: Expected: a numeric value
within <1.0E-6> of <40.0> but: <0.0> differed by <39.99>
Key: FLINK-21139
URL:
Maciej Prochniak created FLINK-21138:
Summary: KvStateServerHandler is not invoked with user code
classloader
Key: FLINK-21138
URL: https://issues.apache.org/jira/browse/FLINK-21138
Project:
I agree with Till about $FLINK_PROPERTIES being only supported by a Flink
buildfile.
Besides that,
1. having different ways of configuring different applications doesn't seem
convenient to me. For example, Kafka and ZK configured via usual properties
and Flink via concatenated one.
2. It could
Linyu Yao created FLINK-21137:
-
Summary: Maven plugin surefire failed due to test failure
Key: FLINK-21137
URL: https://issues.apache.org/jira/browse/FLINK-21137
Project: Flink
Issue Type: New
The problem I see with $FLINK_PROPERTIES is that this is only supported by
Flink's Docker entrypoint.sh. In fact this variable was introduced as a
temporary bridge to allow Docker users to change Flink's configuration
dynamically. If we had had a proper way of configuring Flink processes via
env
Hi Mats and Jakob,
In the general case, I don't think that elements from upstream Flink tasks
always arrive at the same subtask of the sink. One problem is that user
computations can be non-deterministic. Moreover, a rebalance operation can
distribute the events of a task A among several
I've always been using the most recent IntelliJ plugin version and it's
fine for all of my code so far and it was never a problem when I worked
on the initial reformatting. For the rare case where more recent
versions of the plugin would produce formatting that is incompatible
with 1.7.5 our
Hi Chesnay,
thanks for your input! After some thought I think your proposal makes a lot
of sense, i.e. if we have one single $FLINK_DYNAMIC_PROPERTIES environment
variable, in a Kubernetes environment we could do something like
```
env:
- name: S3_KEY
valueFrom: # get from secret
- name:
Robert Metzger created FLINK-21136:
--
Summary: Reactive Mode: Adjust timeout behavior in declarative
scheduler
Key: FLINK-21136
URL: https://issues.apache.org/jira/browse/FLINK-21136
Project: Flink
Robert Metzger created FLINK-21135:
--
Summary: Reactive Mode: Change Declarative Scheduler to set
infinite parallelism in JobGraph
Key: FLINK-21135
URL: https://issues.apache.org/jira/browse/FLINK-21135
Hi all,
We want to give you a short update on the Pinot Sink since we started
implementing a PoC.
As described earlier, we aim to use batch-uploading of segments to Pinot in
combination with caching elements in the Flink sink.
Our current implementation works like this:
Besides the pinot
Robert Metzger created FLINK-21134:
--
Summary: Introduce execution mode configuration key and check for
supported ClusterEntrypoint type
Key: FLINK-21134
URL: https://issues.apache.org/jira/browse/FLINK-21134
Kezhu Wang created FLINK-21133:
--
Summary: FLIP-27 Source does not work with synchronous savepoint
Key: FLINK-21133
URL: https://issues.apache.org/jira/browse/FLINK-21133
Project: Flink
Issue
Kezhu Wang created FLINK-21132:
--
Summary: BoundedOneInput.endInput is called when taking
synchronous savepoint
Key: FLINK-21132
URL: https://issues.apache.org/jira/browse/FLINK-21132
Project: Flink
+1 (binding)
- checked the diff between 1.10.2 and 1.10.3:
https://github.com/apache/flink/compare/release-1.10.2...release-1.10.3-rc1
- I didn't spot any dependency changes
- the ci builds for the 1.10 branch seem to be pretty stable:
https://travis-ci.com/github/apache/flink/builds
- the jars
Thanks Leonard for the detailed response and also the bad case about option
1, these all
make sense to me.
Also nice catch about conversion support of LocalZonedTimestampType, I
think it actually
makes sense to support java.sql.Timestamp as well as
java.time.LocalDateTime. It also has
a slight
Roman Khachatryan created FLINK-21131:
-
Summary: Show alignment timeout in checkpoint configuration (web
UI)
Key: FLINK-21131
URL: https://issues.apache.org/jira/browse/FLINK-21131
Project: Flink
Hi, All
Thanks for your comments. I think all of the thread have agreed that:
(1) The return values of CURRENT_TIME/CURRENT_TIMESTAMP/NOW()/PROCTIME() are
wrong.
(2) The LOCALTIME/LOCALTIMESTAMP and CURRENT_TIME/CURRENT_TIMESTAMP should be
different whether from SQL standard’s perspective or
Chesnay Schepler created FLINK-21130:
Summary: Add bin/ directory to PATH in docker image
Key: FLINK-21130
URL: https://issues.apache.org/jira/browse/FLINK-21130
Project: Flink
Issue
Till Rohrmann created FLINK-21129:
-
Summary: Long metric names cause Graphite to not store them
Key: FLINK-21129
URL: https://issues.apache.org/jira/browse/FLINK-21129
Project: Flink
Issue
Chesnay Schepler created FLINK-21128:
Summary: Rethink how Kubernetes interfaces with our docker image
Key: FLINK-21128
URL: https://issues.apache.org/jira/browse/FLINK-21128
Project: Flink
Yun Gao created FLINK-21127:
---
Summary: Stores finished status for fully finished operators
Key: FLINK-21127
URL: https://issues.apache.org/jira/browse/FLINK-21127
Project: Flink
Issue Type:
Chesnay Schepler created FLINK-21126:
Summary: Reconsider FLINK_PROPERTIES
Key: FLINK-21126
URL: https://issues.apache.org/jira/browse/FLINK-21126
Project: Flink
Issue Type: Improvement
Sebastian Liu created FLINK-21125:
-
Summary: Sum or Sum0 overflow quietly
Key: FLINK-21125
URL: https://issues.apache.org/jira/browse/FLINK-21125
Project: Flink
Issue Type: Bug
+1 (non-binding)
- checked/verified signatures and checksums
- build Flink from the attached source code
- started a Yarn per-job/session cluster
- check webUI is normal and no suspicious logs and exceptions
Best,
Yang
Leonard Xu 于2021年1月25日周一 上午10:31写道:
> +1 (non-binding)
>
> -
Flink will convert all projections and filters to calc before converting to
logical nodes.
You can check out FlinkStreamRuleSets.LOGICAL_RULES
Best,
Kurt
On Mon, Jan 25, 2021 at 11:03 AM laughing.sh...@qq.com <
laughing.sh...@qq.com> wrote:
>
> In flink table planner module, I can not find the
Thanks for looking into this problem Matthias. The patched version also
works for me. +1 for what Jark proposed.
Cheers,
Till
On Sun, Jan 24, 2021 at 3:50 PM Matthias Pohl
wrote:
> Maybe, it's worth a try: I created issue #560 [1] for this. Let's see what
> happens.
>
> [1]
Roman Khachatryan created FLINK-21124:
-
Summary: Checkpoint abort RPC can be ignored in some cases
Key: FLINK-21124
URL: https://issues.apache.org/jira/browse/FLINK-21124
Project: Flink
Chesnay Schepler created FLINK-21123:
Summary: Upgrade Beanutils 1.9.x to 1.9.4
Key: FLINK-21123
URL: https://issues.apache.org/jira/browse/FLINK-21123
Project: Flink
Issue Type:
Roman Khachatryan created FLINK-21122:
-
Summary: Update docs/ops/monitoring/checkpoint_monitoring.zh.md
Key: FLINK-21122
URL: https://issues.apache.org/jira/browse/FLINK-21122
Project: Flink
binguo created FLINK-21121:
--
Summary: TaggedOperatorSubtaskState is missing when creating a new
savepoint using state processor api
Key: FLINK-21121
URL: https://issues.apache.org/jira/browse/FLINK-21121
zlzhang0122 created FLINK-21120:
---
Summary: Add support for ignore abnormal watermark
Key: FLINK-21120
URL: https://issues.apache.org/jira/browse/FLINK-21120
Project: Flink
Issue Type:
Yun Tang created FLINK-21119:
Summary: Building Flink Azure FS Hadoop hangs during python CI
Key: FLINK-21119
URL: https://issues.apache.org/jira/browse/FLINK-21119
Project: Flink
Issue Type:
Thank you very much for the comments so far.
@Steven:
No fixed parallelism for any of the operators
>
> Regarding this limitation, can the scheduler only adjust the default
> parallelism? if some operators set parallelism explicitly (like always 1),
> just leave them unchanged.
We will respect
Dawid Wysakowicz created FLINK-21118:
Summary: TPC-DS end-to-end test (Blink planner) fails with "no
more allocated slots"
Key: FLINK-21118
URL: https://issues.apache.org/jira/browse/FLINK-21118
49 matches
Mail list logo