有两个参数指定Python解释器：
1）-pyexec，指定的是作业执行过程中，用来运行Python UDF的Python解释器路径
2）-pyclientexec，指定客户端编译作业的时候，用到的Python解释器路径，具体信息可以看一下：
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/python/dependency_management/#python-interpreter-of-client
可以把这个参数-pyclientexec 也加上试试。
On Tue, Jun 7, 2022
Hi, Martijn. I have asked the scala community, i will reply to you if there
is any respond. however, i think you can vote or discuss with 2.12.15.
The 2.12.16 just backport some functionalies from higher scala version,
such as jvm11, jvm-17 target, the flink may need it.
But as Chesnay says, we
Hi, Martijn. I have asked the scala community, i will reply to you if there
is any respond. however, i think you can vote or discuss with 2.12.15.
The 2.12.16 just backport some functionalies from higher scala version,
such as jvm11, jvm-17 target, the flink may need it.
But as Chesnay says, we
Hi.
I am not sure whether Flink SQL satisfies your requirement or not. You can
just write the SQL in the file and use the SQL Client to submit it to your
cluster. We have a quick start in the Flink CDC and you can make a try[1].
Best,
Shengkai
[1]
Hi.
之前就已经开了一个 issue 关于 Optional 文档，你可以直接认领这个 issue[1]。另外，如果是 Flink
文档的错误，可以参考下这个PR，对应着修改[2]。
Best,
Shengkai
[1] https://issues.apache.org/jira/browse/FLINK-20760
[2] https://github.com/apache/flink/pull/19498
Xuyang 于2022年6月7日周二 23:46写道：
> Hi, 非常欢迎你一起参与社区的建设中来。
>
> 社区有一套完整的贡献流程，大体可以参照文档[1]。
On Tue, Jun 07, 2022 at 03:26:43PM +0800, czc...@gmail.com wrote:
> On Mon, Jun 06, 2022 at 10:42:08AM +0800, Shengkai Fang wrote:
> > Hi. In my experience, the step to debug classloading problems are as
> > follows:
>
> Thanks for the help. We get the following log when using
> `-verbose:class`:
Hi M,
We had a similar requirement – we were able to solve for this by:
1. Supply the operators we’re interested in acquiring metrics for through
the various name() methods
2. Use the jobid API [1] and find the operator we’ve named in the
“vertices” array
[1]
Hi Folks:
I am trying to find if I can get the number of records for an operator using
flinks REST API. I've checked the docs at
https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/ops/rest_api/.
I did see some apis that use vertexid, but could not find how to that info
without
Thanks, I'll check it out.
On Tue, Jun 7, 2022, 1:31 PM Austin Cawley-Edwards
wrote:
> They support Flink as well. Looks like they even support the new Flink k8s
> operator.[1]
>
> Austin
>
> [1]:
> https://seatunnel.apache.org/docs/2.1.1/start/kubernetes#deploying-the-operator
>
> On Tue, Jun
They support Flink as well. Looks like they even support the new Flink k8s
operator.[1]
Austin
[1]:
https://seatunnel.apache.org/docs/2.1.1/start/kubernetes#deploying-the-operator
On Tue, Jun 7, 2022 at 3:11 PM sri hari kali charan Tummala <
kali.tumm...@gmail.com> wrote:
> thanks but looks
thanks but looks like a spark tool is there something similar in flink?
Thanks
Sri
On Tue, Jun 7, 2022 at 12:07 PM Austin Cawley-Edwards <
austin.caw...@gmail.com> wrote:
> Hey there,
>
> No idea if it's any good, but just saw Apache SeaTunnel[1] today which
> seems to fit your requirements.
>
Hey there,
No idea if it's any good, but just saw Apache SeaTunnel[1] today which
seems to fit your requirements.
Best,
Austin
[1]: https://seatunnel.apache.org/
On Tue, Jun 7, 2022 at 2:19 PM sri hari kali charan Tummala <
kali.tumm...@gmail.com> wrote:
> Hi Flink Community,
>
> can someone
Hi Flink Community,
can someone point me to a good config-driven flink data movement tool
Github repos? Imagine I build my ETL dag connecting source -->
transformations --> target just using a config file.
below are a few spark examples:-
https://github.com/mvrpl/big-shipper
Hi, 非常欢迎你一起参与社区的建设中来。
社区有一套完整的贡献流程，大体可以参照文档[1]。
总的来说可以细分为：
1、发现问题，并在jira[2]中提出一个issue
2、提一个pr并在pr中写明相关的issue号码+模块名+简单描述，具体可以参考下其他的pr来写
3、热心的同学会帮你review的，你也可以在你新建的issue下面ping我下（xuyang）
[1] https://flink.apache.org/contributing/how-to-contribute.html
[2]
You are on the right path with using the --allowNonRestoredState flag;
we'll just have to find the right place to put it w.r.t. your setup.
Which docker images are you using (flink/statefun/something custom), and
how do you submit the job?
On 03/06/2022 01:17, Bhavani Balasubramanyam wrote:
我使用的版本是：
flink：1.13.2
flink cdc: flink-connector-jdbc_2.11-1.13.2.jar
flink-sql-connector-mysql-cdc-2.2.0.jar
flink-sql-connector-postgres-cdc-2.2.0.jar
任务比较简单，就是从mysql、pg同步数据到pg，mysql，使用的是sql接口，请问大伙儿有碰到过这个问题吗？
2022-06-07 18:13:59,393 ERROR
Hi
很抱歉这么晚回复
1. Hi
Xuyang老师，确实如你所说，调用applyFilters方法之后，又调用了copy方法生成了新的JdbcDynamicTableSource对象，在新的JdbcDynamicTableSource对象中再次调用了getScanRuntimeProvider方法。现在已经成功实现了谓词下推，十分感谢
2. Hi Shengkai老师，我十分愿意贡献到社区，不过我之前从未参与过GitHub开源项目，这对我既是机会又是挑战，我愿意挑战下自己。
Hi,
The documentation links are working as expected.
Best regards,
Martijn
Op ma 6 jun. 2022 om 04:32 schreef sri hari kali charan Tummala <
kali.tumm...@gmail.com>:
> I am getting a connection timed out error in firefox and google chrome can
> you double-check whether the weblink is working
Hi everyone,
The link at https://flink.apache.org/community.html#slack is usually your
best way to get in; it's updated whenever the 100 sign-up limit has been
reached.
Best regards,
Martijn
Op ma 6 jun. 2022 om 07:39 schreef Chengxuan Wang :
> Hi Jing,
> Could you also send the invite to me?
Hi all,
@Ran When I created this discussion thread, the latest available version of
Scala 2.12 was 2.12.15. I don't see 2.12.16 being released yet, only
discussed. I did read that they were planning it in the last couple of
weeks but haven't seen any progress since. Do you know more about the
Hi all,
@Ran When I created this discussion thread, the latest available version of
Scala 2.12 was 2.12.15. I don't see 2.12.16 being released yet, only
discussed. I did read that they were planning it in the last couple of
weeks but haven't seen any progress since. Do you know more about the
I think your analysis is correct; I'll file a ticket.
On 03/06/2022 15:28, Nick Birnberg wrote:
Hello everyone!
Our current setup has us running Flink on Kubernetes in HA mode
(Zookeeper) with multiple JobManagers. This appears to be a regression
from 1.14.
We can use the flink CLI to
Seems you have been added or found the link since then. :-)
https://flink.apache.org/community.html#slack
On Tue, Jun 7, 2022 at 12:28 AM Sahil Aulakh
wrote:
> Hi
>
> Please add me to the slack group.
>
> Thanks
> Sahil Aulakh
>
Can you give us a more complete stacktrace so we can see what call in
Flink is waiting for something?
Does this happen to all of your tests?
Can you provide us with an example that we can try ourselves? If not,
can you describe the test structure (e.g., is it using a
MiniClusterResource).
On Mon, Jun 06, 2022 at 10:42:08AM +0800, Shengkai Fang wrote:
> Hi. In my experience, the step to debug classloading problems are as
> follows:
Thanks for the help. We get the following log when using
`-verbose:class`:
[2.074s][info][class,load] org.apache.hadoop.fs.FileSystem source:
25 matches
Mail list logo
