[ https://issues.apache.org/jira/browse/BEAM-1640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950102#comment-15950102 ]
Xu Mingmin commented on BEAM-1640: ---------------------------------- Figure out that it's an issue of System.properties conflict, in Flink 1.2.0 a new properties {{java.security.auth.login.config}} is added when running with {{./flink-1.2.0/bin/flink run}}. Will close this task > data file missing when submit a job on Flink > -------------------------------------------- > > Key: BEAM-1640 > URL: https://issues.apache.org/jira/browse/BEAM-1640 > Project: Beam > Issue Type: Bug > Components: runner-flink > Affects Versions: 0.6.0 > Reporter: Xu Mingmin > Assignee: Aljoscha Krettek > > I've one file with path 'META-INF/jaas/kafka_jaas.conf' in my jar package. it > works with Beam 0.5.0, when I re-package it with 0.6.0-SNAPSHOT, it fails to > submit with bin/flink command. --Both run on YARN. > The error is show as below, I guess this file maybe lost in Flink-Runner. > {code} > Caused by: org.apache.kafka.common.KafkaException: Failed to construct kafka > consumer > at > org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:702) > at > org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:557) > at > org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:540) > at org.apache.beam.sdk.io.kafka.KafkaIO$Read$2.apply(KafkaIO.java:503) > at org.apache.beam.sdk.io.kafka.KafkaIO$Read$2.apply(KafkaIO.java:501) > at > org.apache.beam.sdk.io.kafka.KafkaIO$UnboundedKafkaSource.generateInitialSplits(KafkaIO.java:620) > at > org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper.<init>(UnboundedSourceWrapper.java:159) > at > org.apache.beam.runners.flink.FlinkStreamingTransformTranslators$UnboundedReadSourceTranslator.translateNode(FlinkStreamingTransformTranslators.java:267) > ... 33 more > Caused by: org.apache.kafka.common.KafkaException: > java.lang.IllegalArgumentException: Could not find a 'KafkaClient' entry in > jaas config. > at > org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:86) > at > org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:70) > at > org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:83) > at > org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:623) > ... 40 more > Caused by: java.lang.IllegalArgumentException: Could not find a 'KafkaClient' > entry in jaas config. > at io.ebay.rheos.kafka.security.iaf.IAFLogin.login(IAFLogin.java:54) > at > org.apache.kafka.common.security.authenticator.LoginManager.<init>(LoginManager.java:53) > at > org.apache.kafka.common.security.authenticator.LoginManager.acquireLoginManager(LoginManager.java:75) > at > org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:78) > ... 43 more > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)