退订
Hi, Shubham
Which Flink version are you using?
AFAIK, the JobManager will recover the job from the HA store first, and it
won't submit the same job (identify be jobID) again if it has already been
recovered.
Best,
Weihua
On Tue, May 2, 2023 at 8:02 PM Shubham Bansal wrote:
> Hello everyone,
如题，想知道这个分类的标准是啥呢？
Hi, 在 initializeState 里初始化 State 是 OK 的，但是尽量不要在 initializeState 和
snapshotState 里访问 KeyedState，最好是在实际的 Function 比如这里的 FlatMap 里；
原因是 KeyedState 的访问是和 Current Key 绑定的，实际的 Function 在 Process 之前会隐式的 set
Current key ，因此是会保证每次 KeyedState 的操作是对确定的 KV 进行的；
而 initializeState 和 snapshotState 里是没有框架隐性 set
Hi DEROCCO,
I think you can check the startup command of the job on k8s to see if the
jar file is in the classpath.
If your job is DataStream, you need to add hadoop azure dependency in your
project, and if it is an SQL job, you need to include this jar file in your
Flink release package. Or you
Hi chris,
I think there is no existing method that allows you to customize placing
the operator on the specified node.
By the way, I think "predicting the optimal parallelism" of flink jobs is
interesting. Currently flink supports autoscaling mechanism, you can find
detailed information in this
Sorry for the mix-up. I read your message wrong. Please ignore my last
reply.
On Fri, May 5, 2023 at 11:42 AM John Gerassimou
wrote:
> Hi Chris,
>
> You should be able to do this using nodeSelector, or taints and
> tolerations.
>
>
>
Hi Chris,
You should be able to do this using nodeSelector, or taints and tolerations.
https://github.com/apache/flink-kubernetes-operator/blob/main/helm/flink-kubernetes-operator/templates/flink-operator.yaml#L55:L61
Thanks
John
On Fri, May 5, 2023 at 8:38 AM wrote:
> Hi,
>
> is there a way
CheckpointedFunction 接口的 initializeState 方法提供了访问 FunctionInitializationContext
的能力，而 FunctionInitializationContext 不仅提供了访问 OperatorStateStore 的能力，也提供了
KeyedStateStore 的能力。一般常见的是通过 CheckpointedFunction 来实现操作
OperatorState，但是也可以通过如下代码来获取 KeyedState：
```java
How can I add the package to the flink job or check if it is there?
From: Shammon FY
Sent: Thursday, May 4, 2023 9:59 PM
To: DEROCCO, CHRISTOPHER
Cc: user@flink.apache.org
Subject: Re: MSI Auth to Azure Storage Account with Flink Apache Operator not
working
Hi DEROCCO,
I think you need to
Thanks Hang and Gyula for the quick response! That makes sense, I can
resolve manually for now.
On Thu, May 4, 2023 at 8:37 PM Hang Ruan wrote:
> Hi, Nathan,
>
> I think the previous discussion[1] is helpful for you.
>
> Best,
> Hang
>
> [1]
Hi,
is there a way to manually define which node an operator should be placed in, using Kubernetes?
To give a bit more context, for my master's thesis, I'm looking into predicting the optimal parallelism degree for a node. To do so, we use a Zero Shot Model, which predicts the latency and
退订
刘晶 John Liu DBA
藤蔓技术部 Tenvine Technical Department
深圳市南山区高新科技园科技中三路科兴科学园B4-712 邮编 518052
Mobile: 18820970747
>
> flink issue可以登录
这个是jira账号吗？
flink中文邮箱账号密码
什么是flink中文邮箱账号 ?有无登陆页面链接
On Wed, Apr 19, 2023 at 11:36 AM kcz <573693...@qq.com.invalid> wrote:
> 请帮忙看看是我哪里出问题了嘛？我的账号是kcz。我想咨询大佬flink avro的问题
>
>
>
>
> kcz
> 573693...@qq.com
>
>
>
>
Please send email to user-zh-unsubscr...@flink.apache.org
if you want to unsubscribe the mail from
user-zh-unsubscr...@flink.apache.org , and you can
refer[1][2] for more details.
请发送任意内容的邮件到 user-zh-unsubscr...@flink.apache.org
地址来取消订阅来自 user-zh@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理邮件订阅。
Please send email to user-zh-unsubscr...@flink.apache.org
if you want to unsubscribe the mail from
user-zh-unsubscr...@flink.apache.org , and you can
refer[1][2] for more details.
请发送任意内容的邮件到 user-zh-unsubscr...@flink.apache.org
地址来取消订阅来自 user-zh@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理邮件订阅。
Please send email to user-zh-unsubscr...@flink.apache.org
if you want to unsubscribe the mail from
user-zh-unsubscr...@flink.apache.org , and you can
refer[1][2] for more details.
请发送任意内容的邮件到 user-zh-unsubscr...@flink.apache.org
地址来取消订阅来自 user-zh@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理邮件订阅。
On
如果需要取消订阅 u...@flink.apache.org 和 d...@flink.apache.org 邮件组，请发送任意内容的邮件到
user-unsubscr...@flink.apache.org 和 dev-unsubscr...@flink.apache.org ,参考[1]
[1] https://flink.apache.org/zh/community/
On Fri, May 5, 2023 at 3:24 PM wuzhongxiu wrote:
> 退订
>
>
>
> | |
> go574...@163.com
> |
> |
>
The Apache Flink community is very happy to announce the release of Apache
flink-connector-jdbc 3.1.0. This connector supports Flink 1.16 and 1.17.
Apache Flink® is an open-source stream processing framework for
distributed, high-performing, always-available, and accurate data streaming
退订
| |
go574...@163.com
|
|
邮箱：go574...@163.com
|
回复的原邮件
| 发件人 | willluzheng |
| 日期 | 2023年05月05日 15:22 |
| 收件人 | user-zh@flink.apache.org |
| 抄送至 | |
| 主题 | 退订 |
退订
退订
Hi Neha,
For the jobs you care about, you can attach additional labels using
`scope-variables-additional` [1]. The example located in the same page
showcases how you can configure KV pairs in its map configuration. Be sure
to replace the reporter name with the name of your prometheus reporter!
Hello,
I have a question about the Prometheus metrics. I am able to fetch the
metrics from the following expression.
sum(flink_jobmanager_job_numRestarts{job_name="$job_name"}) by (job_name)
Now I am interested in only a few jobs and I want to give them a label. How
to achieve this? How to give an
26 matches
Mail list logo
