Hi Yuval,
I'm also wondering why do you have such a big metadata file.
Probably, you could reduce it by decreasing
"state.backend.fs.memory-threshold" (if you didn't do so already) [1].
[1]
https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/checkpointing.html#state-backend-fs
Hey Austin,
I think you are right. The problematic row contains an odd number of
delimiters in which case skipFields will return -1, which in turn leads to
an exception.
I opened a bug ticket https://issues.apache.org/jira/browse/FLINK-19711 to
fix it.
Regards,
Roman
On Fri, Oct 16, 2020 at 8:
Hey,
I'm trying to build Flink and failing. I'm running Ubuntu 20.04.1 in
a virtual machine on Windows 10. I'm using OpenJDK 11.0.8. I'm on the
master branch, commit 9eae578ae592254d54bc51c679644e8e84c65152.
The command I'm using:
apache-maven-3.2.5/bin/mvn clean verify
The output:
[INFO] Flin
Hey,
One reason could be that a resource-intensive test was killed by oom
killer. You can inspect /var/log/kern.log for the related messages in your
VM.
Regards,
Roman
On Mon, Oct 19, 2020 at 5:57 PM Juha Mynttinen
wrote:
>
> Hey,
>
> I'm trying to build Flink and failing. I'm running Ubuntu
Hi,
AFAIK, the features discussed in the threads you mentioned are not yet
implemented. So there is no way to avoid Job restarts in case of ZK rolling
restarts.
I'm pulling in Till as he might know better.
Regards,
Roman
On Fri, Oct 16, 2020 at 7:45 PM Kenzyme wrote:
> Hi,
>
> Related to
> ht
Hi Alex,
This message isn't actually a problem - netty can't find the native
transports and falls back to nio-based one.
Does increasing taskmanager.numberOfTaskSlots in flink-conf.yaml help?
Can you share the full logs in DEBUG mode?
Regards,
Roman
On Mon, Oct 19, 2020 at 6:14 PM Alexander Sem
Hi,
Can you explain what "EMR cluster crashed" means in the 2nd scenario?
Can you also share:
- yarn.application-attempts in Flink
- yarn.resourcemanager.am.max-attempts in Yarn
- number of EMR master nodes (1 or 3)
- EMR version?
Regards,
Roman
On Mon, Oct 19, 2020 at 8:22 AM Averell wrote:
Hello Roman,
Thanks for your time.
I'm using EMR 5.30.1 (Flink 1.10.0) with 1 master node.
/yarn.application-attempts/ is not set (does that means unlimited?), while
/yarn.resourcemanager.am.max-attempts/ is 4.
In saying "EMR cluster crashed) I meant the cluster is lost. Some scenarios
which cou
To print the result you can create a POJO class matching your projected
fields and use it on line 38 instead of String.class.
For example:
Table result1 = tableA.select("content, content.hashCode() as h1,
hashCode(content) as h2");
tableEnv.toDataSet(result1, HashCodeSelect.class).print();
public
Hello,
Does Flink-SQL support fetching Mysql meta information automaticly in the
latest version, ? If not, could the you adding this feature ?
Thank you.
Best, Roc.
Hi Roman,
Thank you for your reply.
I'm not 100% sure if those features discussed in the threads will fix the
issue, but they seemed related in some way.
Basically, the expected behaviour I had for Flink was similar to how Kafka
works i.e. Kafka services continues w/o disruption whenever ZK qu
Hi, Jingsong Lee
Thanks for taking the time to respond to the email, I will try following
your suggestion.
Best,
Yang
在 2020年10月19日 11:56，Jingsong Li 写道：
Hi, Yang,
"SUCCESSFUL_JOB_OUTPUT_DIR_MARKER" does not work in StreamingFileSink.
You can take a look to partition commit fea
Hey,
Good hint that /var/log/kern.log. This time I can see this:
Oct 20 09:44:48 ubuntu kernel: [ 1925.651551]
oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/user.slice/user-1000.slice/user@1000.service
,task=java,pid=270024,uid=1000
Oct 20 09:4
13 matches
Mail list logo
