Great to hear that you fixed the problem! Cheers, Till
On Mon, Aug 24, 2020 at 2:53 AM Vijayendra Yadav <contact....@gmail.com> wrote: > Thank You Till. I had an old hadoop version dependency in one of the > dependent jars causing conflict. > > On Fri, Aug 21, 2020 at 12:24 AM Till Rohrmann <trohrm...@apache.org> > wrote: > >> Hi Vijay, >> >> could you move the s3 filesystem >> dependency lib/flink-s3-fs-hadoop-1.10.0.jar into the plugin directory? See >> this link [1] for more information. Since Flink 1.10 we have removed the >> relocation of filesystem dependencies because the recommended way to load >> them is via Flink's plugin mechanism. I suspect that this dependency is >> causing the conflicts. >> >> [1] >> https://ci.apache.org/projects/flink/flink-docs-stable/ops/plugins.html >> >> Cheers, >> Till >> >> On Thu, Aug 20, 2020 at 7:06 PM Vijayendra Yadav <contact....@gmail.com> >> wrote: >> >>> Hi Till/ Piotr, >>> >>> *My process was working with : FsStateBackend but when I switched >>> to RocksDBStateBackend I faced this problem. My class path is below. * >>> >>> *Related jar in classpath: * >>> /usr/lib/hadoop-yarn/hadoop-yarn-api-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-api.jar: >>> >>> >>> *Classpath:* >>> :conf:flink-kafka-to-s3-lib-2.18.0-SNAPSHOT.jar:lib:lib/flink-s3-fs-hadoop-1.10.0.jar:lib/flink-table-blink_2.11-1.10.0.jar:lib/flink-table_2.11-1.10.0.jar:lib/log4j-1.2.17.jar:lib/slf4j-log4j12-1.7.15.jar:flink-dist_2.11-1.10.0.jar:flink-conf.yaml:job.graph::/etc/hadoop/conf:/usr/lib/hadoop/hadoop-annotations-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-annotations.jar:/usr/lib/hadoop/hadoop-ant-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-ant.jar:/usr/lib/hadoop/hadoop-archive-logs-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-archive-logs.jar:/usr/lib/hadoop/hadoop-archives-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-archives.jar:/usr/lib/hadoop/hadoop-auth-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-auth.jar:/usr/lib/hadoop/hadoop-aws-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-aws.jar:/usr/lib/hadoop/hadoop-azure-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-azure-datalake-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-azure-datalake.jar:/usr/lib/hadoop/hadoop-azure.jar:/usr/lib/hadoop/hadoop-common-2.8.5-amzn-6-tests.jar:/usr/lib/hadoop/hadoop-common-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-common.jar:/usr/lib/hadoop/hadoop-datajoin-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-datajoin.jar:/usr/lib/hadoop/hadoop-distcp-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-distcp.jar:/usr/lib/hadoop/hadoop-extras-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-extras.jar:/usr/lib/hadoop/hadoop-gridmix-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-gridmix.jar:/usr/lib/hadoop/hadoop-nfs-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-nfs.jar:/usr/lib/hadoop/hadoop-openstack-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-openstack.jar:/usr/lib/hadoop/hadoop-rumen-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-rumen.jar:/usr/lib/hadoop/hadoop-sls-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-sls.jar:/usr/lib/hadoop/hadoop-streaming-2.8.5-amzn-6.jar:/usr/lib/hadoop/hadoop-streaming.jar:/usr/lib/hadoop/lib/activation-1.1.jar:/usr/lib/hadoop/lib/jsp-api-2.1.jar:/usr/lib/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/lib/hadoop/lib/jetty-6.1.26-emr.jar:/usr/lib/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/lib/hadoop/lib/jsr305-3.0.0.jar:/usr/lib/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/lib/hadoop/lib/junit-4.11.jar:/usr/lib/hadoop/lib/api-util-1.0.0-M20.jar:/usr/lib/hadoop/lib/asm-3.2.jar:/usr/lib/hadoop/lib/avro-1.7.7.jar:/usr/lib/hadoop/lib/log4j-1.2.17.jar:/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/lib/hadoop/lib/jetty-sslengine-6.1.26-emr.jar:/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/mockito-all-1.8.5.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26-emr.jar:/usr/lib/hadoop/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.10.jar:/usr/lib/hadoop/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop/lib/commons-configuration-1.6.jar:/usr/lib/hadoop/lib/slf4j-api-1.7.10.jar:/usr/lib/hadoop/lib/commons-digester-1.8.jar:/usr/lib/hadoop/lib/commons-io-2.4.jar:/usr/lib/hadoop/lib/snappy-java-1.1.7.3.jar:/usr/lib/hadoop/lib/commons-lang-2.6.jar:/usr/lib/hadoop/lib/stax-api-1.0-2.jar:/usr/lib/hadoop/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/commons-math3-3.1.1.jar:/usr/lib/hadoop/lib/commons-net-3.1.jar:/usr/lib/hadoop/lib/xz-1.0.jar:/usr/lib/hadoop/lib/curator-client-2.7.1.jar:/usr/lib/hadoop/lib/zookeeper-3.4.14.jar:/usr/lib/hadoop/lib/curator-framework-2.7.1.jar:/usr/lib/hadoop/lib/curator-recipes-2.7.1.jar:/usr/lib/hadoop/lib/gson-2.2.4.jar:/usr/lib/hadoop/lib/guava-11.0.2.jar:/usr/lib/hadoop/lib/hamcrest-core-1.3.jar:/usr/lib/hadoop/lib/jsch-0.1.54.jar:/usr/lib/hadoop/lib/htrace-core4-4.0.1-incubating.jar:/usr/lib/hadoop/lib/httpclient-4.5.9.jar:/usr/lib/hadoop/lib/httpcore-4.4.11.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/lib/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/lib/hadoop/lib/json-smart-1.3.1.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/lib/hadoop/lib/jackson-xc-1.9.13.jar:/usr/lib/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/lib/hadoop/lib/jersey-core-1.9.jar:/usr/lib/hadoop/lib/jersey-json-1.9.jar:/usr/lib/hadoop/lib/jersey-server-1.9.jar:/usr/lib/hadoop/lib/jets3t-0.9.0.jar:/usr/lib/hadoop/lib/jettison-1.1.jar:/usr/lib/hadoop/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/lib/hadoop/lib/paranamer-2.3.jar:/usr/lib/hadoop/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop/lib/servlet-api-2.5.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-2.8.5-amzn-6-tests.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-2.8.5-amzn-6.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-client-2.8.5-amzn-6-tests.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-client-2.8.5-amzn-6.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-client.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-native-client-2.8.5-amzn-6-tests.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-native-client-2.8.5-amzn-6.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-native-client.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-nfs-2.8.5-amzn-6.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-nfs.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs.jar:/usr/lib/hadoop-hdfs/lib/asm-3.2.jar:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/lib/hadoop-hdfs/lib/commons-io-2.4.jar:/usr/lib/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/lib/hadoop-hdfs/lib/htrace-core4-4.0.1-incubating.jar:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/lib/hadoop-hdfs/lib/jersey-core-1.9.jar:/usr/lib/hadoop-hdfs/lib/jersey-server-1.9.jar:/usr/lib/hadoop-hdfs/lib/jetty-6.1.26-emr.jar:/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26-emr.jar:/usr/lib/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/lib/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/lib/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-all-4.0.23.Final.jar:/usr/lib/hadoop-hdfs/lib/okhttp-2.4.0.jar:/usr/lib/hadoop-hdfs/lib/okio-1.4.0.jar:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/lib/hadoop-hdfs/lib/xercesImpl-2.9.1.jar:/usr/lib/hadoop-hdfs/lib/xml-apis-1.3.04.jar:/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/lib/hadoop-mapreduce/jackson-core-asl-1.9.13.jar:/usr/lib/hadoop-mapreduce/activation-1.1.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-core.jar:/usr/lib/hadoop-mapreduce/apacheds-i18n-2.0.0-M15.jar:/usr/lib/hadoop-mapreduce/hadoop-distcp-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs.jar:/usr/lib/hadoop-mapreduce/api-asn1-api-1.0.0-M20.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle.jar:/usr/lib/hadoop-mapreduce/api-util-1.0.0-M20.jar:/usr/lib/hadoop-mapreduce/joda-time-2.9.4.jar:/usr/lib/hadoop-mapreduce/asm-3.2.jar:/usr/lib/hadoop-mapreduce/jackson-jaxrs-1.9.13.jar:/usr/lib/hadoop-mapreduce/avro-1.7.7.jar:/usr/lib/hadoop-mapreduce/hadoop-azure-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/aws-java-sdk-core-1.11.759.jar:/usr/lib/hadoop-mapreduce/hadoop-azure-datalake-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/aws-java-sdk-kms-1.11.759.jar:/usr/lib/hadoop-mapreduce/hadoop-extras.jar:/usr/lib/hadoop-mapreduce/aws-java-sdk-s3-1.11.759.jar:/usr/lib/hadoop-mapreduce/hadoop-extras-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/azure-data-lake-store-sdk-2.2.3.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar:/usr/lib/hadoop-mapreduce/azure-storage-2.2.0.jar:/usr/lib/hadoop-mapreduce/hadoop-openstack-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/commons-beanutils-1.7.0.jar:/usr/lib/hadoop-mapreduce/hadoop-gridmix-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop-mapreduce/jackson-xc-1.9.13.jar:/usr/lib/hadoop-mapreduce/commons-cli-1.2.jar:/usr/lib/hadoop-mapreduce/hadoop-sls-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/commons-codec-1.4.jar:/usr/lib/hadoop-mapreduce/hadoop-gridmix.jar:/usr/lib/hadoop-mapreduce/commons-collections-3.2.2.jar:/usr/lib/hadoop-mapreduce/hadoop-openstack.jar:/usr/lib/hadoop-mapreduce/commons-compress-1.4.1.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-common.jar:/usr/lib/hadoop-mapreduce/commons-configuration-1.6.jar:/usr/lib/hadoop-mapreduce/hadoop-rumen-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/commons-digester-1.8.jar:/usr/lib/hadoop-mapreduce/hadoop-rumen.jar:/usr/lib/hadoop-mapreduce/commons-httpclient-3.1.jar:/usr/lib/hadoop-mapreduce/java-xmlbuilder-0.4.jar:/usr/lib/hadoop-mapreduce/commons-io-2.4.jar:/usr/lib/hadoop-mapreduce/hadoop-sls.jar:/usr/lib/hadoop-mapreduce/commons-lang-2.6.jar:/usr/lib/hadoop-mapreduce/httpcore-4.4.11.jar:/usr/lib/hadoop-mapreduce/commons-lang3-3.3.2.jar:/usr/lib/hadoop-mapreduce/hadoop-streaming-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/commons-logging-1.1.3.jar:/usr/lib/hadoop-mapreduce/hadoop-streaming.jar:/usr/lib/hadoop-mapreduce/commons-math3-3.1.1.jar:/usr/lib/hadoop-mapreduce/jcip-annotations-1.0-1.jar:/usr/lib/hadoop-mapreduce/commons-net-3.1.jar:/usr/lib/hadoop-mapreduce/htrace-core4-4.0.1-incubating.jar:/usr/lib/hadoop-mapreduce/curator-client-2.7.1.jar:/usr/lib/hadoop-mapreduce/httpclient-4.5.9.jar:/usr/lib/hadoop-mapreduce/curator-framework-2.7.1.jar:/usr/lib/hadoop-mapreduce/ion-java-1.0.2.jar:/usr/lib/hadoop-mapreduce/curator-recipes-2.7.1.jar:/usr/lib/hadoop-mapreduce/jaxb-api-2.2.2.jar:/usr/lib/hadoop-mapreduce/gson-2.2.4.jar:/usr/lib/hadoop-mapreduce/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-mapreduce/guava-11.0.2.jar:/usr/lib/hadoop-mapreduce/jackson-annotations-2.6.7.jar:/usr/lib/hadoop-mapreduce/hadoop-ant-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/jersey-json-1.9.jar:/usr/lib/hadoop-mapreduce/hadoop-ant.jar:/usr/lib/hadoop-mapreduce/hadoop-aws.jar:/usr/lib/hadoop-mapreduce/jsch-0.1.54.jar:/usr/lib/hadoop-mapreduce/hadoop-archive-logs-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/jackson-databind-2.6.7.3.jar:/usr/lib/hadoop-mapreduce/hadoop-archive-logs.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-app-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/hadoop-archives-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/jersey-core-1.9.jar:/usr/lib/hadoop-mapreduce/hadoop-archives.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-app.jar:/usr/lib/hadoop-mapreduce/hadoop-auth-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/jettison-1.1.jar:/usr/lib/hadoop-mapreduce/hadoop-auth.jar:/usr/lib/hadoop-mapreduce/jackson-core-2.6.7.jar:/usr/lib/hadoop-mapreduce/hadoop-aws-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/hadoop-azure-datalake.jar:/usr/lib/hadoop-mapreduce/jersey-server-1.9.jar:/usr/lib/hadoop-mapreduce/hadoop-azure.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/hadoop-datajoin-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/jets3t-0.9.0.jar:/usr/lib/hadoop-mapreduce/hadoop-datajoin.jar:/usr/lib/hadoop-mapreduce/jetty-6.1.26-emr.jar:/usr/lib/hadoop-mapreduce/hadoop-distcp.jar:/usr/lib/hadoop-mapreduce/json-smart-1.3.1.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-common-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-core-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.8.5-amzn-6-tests.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.8.5-amzn-6.jar:/usr/lib/hadoop-mapreduce/jackson-dataformat-cbor-2.6.7.jar:/usr/lib/hadoop-mapreduce/jackson-mapper-asl-1.9.13.jar:/usr/lib/hadoop-mapreduce/jetty-sslengine-6.1.26-emr.jar:/usr/lib/hadoop-mapreduce/jetty-util-6.1.26-emr.jar:/usr/lib/hadoop-mapreduce/jmespath-java-1.11.759.jar:/usr/lib/hadoop-mapreduce/jsp-api-2.1.jar:/usr/lib/hadoop-mapreduce/jsr305-3.0.0.jar:/usr/lib/hadoop-mapreduce/log4j-1.2.17.jar:/usr/lib/hadoop-mapreduce/metrics-core-3.0.1.jar:/usr/lib/hadoop-mapreduce/nimbus-jose-jwt-4.41.1.jar:/usr/lib/hadoop-mapreduce/okhttp-2.4.0.jar:/usr/lib/hadoop-mapreduce/okio-1.4.0.jar:/usr/lib/hadoop-mapreduce/paranamer-2.3.jar:/usr/lib/hadoop-mapreduce/protobuf-java-2.5.0.jar:/usr/lib/hadoop-mapreduce/servlet-api-2.5.jar:/usr/lib/hadoop-mapreduce/snappy-java-1.1.7.3.jar:/usr/lib/hadoop-mapreduce/stax-api-1.0-2.jar:/usr/lib/hadoop-mapreduce/xmlenc-0.52.jar:/usr/lib/hadoop-mapreduce/xz-1.0.jar:/usr/lib/hadoop-mapreduce/zookeeper-3.4.14.jar:/usr/lib/hadoop-mapreduce/lib/aopalliance-1.0.jar:/usr/lib/hadoop-mapreduce/lib/asm-3.2.jar:/usr/lib/hadoop-mapreduce/lib/avro-1.7.7.jar:/usr/lib/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-mapreduce/lib/commons-io-2.4.jar:/usr/lib/hadoop-mapreduce/lib/guice-3.0.jar:/usr/lib/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/usr/lib/hadoop-mapreduce/lib/hamcrest-core-1.3.jar:/usr/lib/hadoop-mapreduce/lib/jackson-core-asl-1.9.13.jar:/usr/lib/hadoop-mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/usr/lib/hadoop-mapreduce/lib/javax.inject-1.jar:/usr/lib/hadoop-mapreduce/lib/jersey-core-1.9.jar:/usr/lib/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/usr/lib/hadoop-mapreduce/lib/jersey-server-1.9.jar:/usr/lib/hadoop-mapreduce/lib/junit-4.11.jar:/usr/lib/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-mapreduce/lib/log4j-1.2.17.jar:/usr/lib/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop-mapreduce/lib/paranamer-2.3.jar:/usr/lib/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-mapreduce/lib/snappy-java-1.1.7.3.jar:/usr/lib/hadoop-mapreduce/lib/xz-1.0.jar:/usr/lib/hadoop-yarn/hadoop-yarn-api-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-api.jar:/usr/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell.jar:/usr/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/lib/hadoop-yarn/hadoop-yarn-client-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-client.jar:/usr/lib/hadoop-yarn/hadoop-yarn-common-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-common.jar:/usr/lib/hadoop-yarn/hadoop-yarn-registry-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-registry.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-common-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-common.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-nodemanager-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-nodemanager.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-sharedcachemanager-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-sharedcachemanager.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-tests-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-tests.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-timeline-pluginstorage-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-timeline-pluginstorage.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-web-proxy-2.8.5-amzn-6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-web-proxy.jar:/usr/lib/hadoop-yarn/lib/activation-1.1.jar:/usr/lib/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/lib/hadoop-yarn/lib/asm-3.2.jar:/usr/lib/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/lib/hadoop-yarn/lib/commons-codec-1.4.jar:/usr/lib/hadoop-yarn/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-yarn/lib/commons-io-2.4.jar:/usr/lib/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/lib/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop-yarn/lib/commons-math-2.2.jar:/usr/lib/hadoop-yarn/lib/curator-client-2.7.1.jar:/usr/lib/hadoop-yarn/lib/curator-test-2.7.1.jar:/usr/lib/hadoop-yarn/lib/guava-11.0.2.jar:/usr/lib/hadoop-yarn/lib/guice-3.0.jar:/usr/lib/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/lib/hadoop-yarn/lib/jackson-core-asl-1.9.13.jar:/usr/lib/hadoop-yarn/lib/jackson-jaxrs-1.9.13.jar:/usr/lib/hadoop-yarn/lib/jackson-mapper-asl-1.9.13.jar:/usr/lib/hadoop-yarn/lib/jackson-xc-1.9.13.jar:/usr/lib/hadoop-yarn/lib/javassist-3.18.1-GA.jar:/usr/lib/hadoop-yarn/lib/javax.inject-1.jar:/usr/lib/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/lib/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/lib/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/lib/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/lib/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/lib/hadoop-yarn/lib/jettison-1.1.jar:/usr/lib/hadoop-yarn/lib/jetty-6.1.26-emr.jar:/usr/lib/hadoop-yarn/lib/jetty-util-6.1.26-emr.jar:/usr/lib/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/lib/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/lib/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/lib/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/lib/hadoop-yarn/lib/xz-1.0.jar:/usr/lib/hadoop-yarn/lib/zookeeper-3.4.14-tests.jar:/usr/lib/hadoop-yarn/lib/zookeeper-3.4.14.jar:/usr/lib/hadoop-lzo/lib/hadoop-lzo-0.4.19.jar:/usr/lib/hadoop-lzo/lib/hadoop-lzo.jar:/usr/share/aws/emr/emrfs/conf:/usr/share/aws/emr/emrfs/lib/aopalliance-1.0.jar:/usr/share/aws/emr/emrfs/lib/bcpkix-jdk15on-1.51.jar:/usr/share/aws/emr/emrfs/lib/bcprov-jdk15on-1.51.jar:/usr/share/aws/emr/emrfs/lib/emrfs-hadoop-assembly-2.40.0.jar:/usr/share/aws/emr/emrfs/lib/ion-java-1.0.2.jar:/usr/share/aws/emr/emrfs/lib/javax.inject-1.jar:/usr/share/aws/emr/emrfs/lib/jcl-over-slf4j-1.7.21.jar:/usr/share/aws/emr/emrfs/lib/jmespath-java-1.11.711.jar:/usr/share/aws/emr/emrfs/lib/slf4j-api-1.7.21.jar:/usr/share/aws/emr/emrfs/auxlib/*:/usr/share/aws/emr/lib/*:/usr/share/aws/emr/ddb/lib/emr-ddb-hadoop.jar:/usr/share/aws/emr/goodies/lib/emr-hadoop-goodies.jar:/usr/share/aws/emr/kinesis/lib/emr-kinesis-hadoop.jar:/usr/lib/spark/yarn/lib/datanucleus-api-jdo.jar:/usr/lib/spark/yarn/lib/datanucleus-core.jar:/usr/lib/spark/yarn/lib/datanucleus-rdbms.jar:/usr/share/aws/emr/cloudwatch-sink/lib/cloudwatch-sink-1.2.0.jar:/usr/share/aws/emr/cloudwatch-sink/lib/cloudwatch-sink.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-dlm-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-codebuild-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-accessanalyzer-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-connect-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-acm-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-connectparticipant-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-acmpca-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-codegurureviewer-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-alexaforbusiness-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-core-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-amplify-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-codepipeline-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-api-gateway-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-kinesisvideosignalingchannels-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-apigatewaymanagementapi-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-codestar-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-apigatewayv2-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-costandusagereport-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-appconfig-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-cloudwatch-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-applicationautoscaling-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-cloudwatchmetrics-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-applicationinsights-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-costexplorer-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-appmesh-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-dataexchange-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-appstream-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-datapipeline-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-appsync-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-datasync-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-athena-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-code-generator-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-augmentedairuntime-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-codestarconnections-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-autoscaling-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-codestarnotifications-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-autoscalingplans-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-dax-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-backup-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-detective-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-batch-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-devicefarm-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-budgets-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-directconnect-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-chime-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-directory-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-cloud9-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-cognitoidentity-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-clouddirectory-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-cognitoidp-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-cloudformation-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-cognitosync-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-cloudfront-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-discovery-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-cloudhsm-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-comprehend-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-cloudhsmv2-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-comprehendmedical-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-cloudsearch-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-computeoptimizer-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-cloudtrail-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-codecommit-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-config-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-codedeploy-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-codeguruprofiler-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-codegen-maven-plugin-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-mq-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-dms-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-docdb-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-dynamodb-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-ebs-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-ec2-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-ec2instanceconnect-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-ecr-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-ecs-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-efs-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-eks-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-elasticache-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-elasticbeanstalk-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-elasticinference-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-elasticloadbalancing-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-elasticloadbalancingv2-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-elasticsearch-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-elastictranscoder-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-emr-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-eventbridge-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-events-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-fms-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-forecast-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-forecastquery-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-frauddetector-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-fsx-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-gamelift-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-glacier-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-globalaccelerator-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-glue-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-greengrass-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-groundstation-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-guardduty-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-health-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-iam-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-imagebuilder-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-importexport-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-inspector-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-iot-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-iot1clickdevices-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-iot1clickprojects-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-iotanalytics-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-iotevents-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-ioteventsdata-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-iotjobsdataplane-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-iotsecuretunneling-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-iotthingsgraph-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-kafka-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-kendra-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-kinesis-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-kinesisanalyticsv2-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-kinesisvideo-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-mediaconvert-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-kms-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-marketplaceentitlement-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-lakeformation-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-medialive-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-lambda-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-mediapackage-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-lex-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-marketplacemeteringservice-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-lexmodelbuilding-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-mechanicalturkrequester-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-licensemanager-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-mediapackagevod-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-lightsail-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-mediastore-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-logs-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-migrationhubconfig-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-machinelearning-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-mediastoredata-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-macie-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-mediaconnect-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-managedblockchain-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-marketplacecommerceanalytics-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-marketplacecatalog-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-mediatailor-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-migrationhub-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-simpleworkflow-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-mobile-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-snowball-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-models-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-sns-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-neptune-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-schemas-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-networkmanager-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-sqs-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-opensdk-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-ssm-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-opsworks-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-secretsmanager-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-opsworkscm-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-securityhub-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-organizations-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-sso-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-outposts-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-servicecatalog-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-personalize-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-servermigration-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-personalizeevents-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-serverlessapplicationrepository-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-personalizeruntime-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-ssooidc-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-pi-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-stepfunctions-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-pinpoint-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-servicediscovery-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-pinpointemail-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-servicequotas-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-pinpointsmsvoice-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-storagegateway-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-polly-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-sts-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-pricing-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-support-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-qldb-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-ses-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-qldbsession-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-sesv2-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-quicksight-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-test-utils-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-ram-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-textract-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-rds-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-transcribe-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-rdsdata-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-transfer-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-redshift-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-shield-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-rekognition-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-workmailmessageflow-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-resourcegroups-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-savingsplans-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-resourcegroupstaggingapi-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-translate-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-robomaker-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-waf-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-route53-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-signer-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-route53resolver-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-wafv2-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-s3-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-workdocs-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-s3control-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-worklink-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-sagemaker-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-simpledb-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-sagemakerruntime-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-workmail-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-workspaces-1.11.759.jar:/usr/share/aws/aws-java-sdk/aws-java-sdk-xray-1.11.759.jar:/usr/share/aws/aws-java-sdk/jmespath-java-1.11.759.jar >>> >>> >>> Regards, >>> Vijay >>> >>> On Thu, Aug 20, 2020 at 8:52 AM Till Rohrmann <trohrm...@apache.org> >>> wrote: >>> >>>> Here is a link to information on how to integrate Flink with Hadoop >>>> [1]. In the latest version you only need to point Flink to the Hadoop >>>> libraries via setting the HADOOP_CLASSPATH environment variable. >>>> >>>> [1] >>>> https://ci.apache.org/projects/flink/flink-docs-release-1.11/ops/deployment/hadoop.html >>>> >>>> Cheers, >>>> Till >>>> >>>> On Thu, Aug 20, 2020 at 5:50 PM Till Rohrmann <trohrm...@apache.org> >>>> wrote: >>>> >>>>> I agree with Piotr's analysis. It should not matter whether you are >>>>> using RocksDBStateBackend or not. It seems as if you have a Hadoop >>>>> dependency clash. Could you check which dependencies are on the class >>>>> path? >>>>> >>>>> Cheers, >>>>> Till >>>>> >>>>> On Thu, Aug 20, 2020 at 3:52 PM Piotr Nowojski < >>>>> piotr.nowoj...@gmail.com> wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> It looks more like a dependency convergence issue - you have two >>>>>> conflicting versions of >>>>>> `org.apache.hadoop.yarn.api.protocolrecords.AllocateRequest` >>>>>> on the class path. Or you built your jar with one version and trying to >>>>>> execute it with a different one. >>>>>> >>>>>> Till is it some kind of a known issue? >>>>>> >>>>>> Piotrek >>>>>> >>>>>> >>>>>> czw., 20 sie 2020 o 06:48 Vijayendra Yadav <contact....@gmail.com> >>>>>> napisał(a): >>>>>> >>>>>>> Hi Team, >>>>>>> >>>>>>> Getting the following error when using RocksDBStateBackend on >>>>>>> yarn/EMR. Am I missing any dependencies? >>>>>>> >>>>>>> >>>>>>> 2020-08-20 04:37:00,713 ERROR >>>>>>> org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl - >>>>>>> Exception on heartbeat >>>>>>> java.lang.NoSuchMethodError: >>>>>>> org.apache.hadoop.yarn.api.protocolrecords.AllocateRequest.newInstance(IFLjava/util/List;Ljava/util/List;Ljava/util/List;Lorg/apache/hadoop/yarn/api/records/ResourceBlacklistRequest;)Lorg/apache/hadoop/yarn/api/protocolrecords/AllocateRequest; >>>>>>> at >>>>>>> org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.allocate(AMRMClientImpl.java:280) >>>>>>> at >>>>>>> org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl$HeartbeatThread.run(AMRMClientAsyncImpl.java:273) >>>>>>> 2020-08-20 04:37:00,714 INFO >>>>>>> org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl - >>>>>>> Interrupted while waiting for queue >>>>>>> java.lang.InterruptedException >>>>>>> at >>>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) >>>>>>> at >>>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048) >>>>>>> at >>>>>>> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) >>>>>>> at >>>>>>> org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl$CallbackHandlerThread.run(AMRMClientAsyncImpl.java:323) >>>>>>> 2020-08-20 04:37:00,714 ERROR >>>>>>> org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl - >>>>>>> Stopping callback due to: >>>>>>> java.lang.NoSuchMethodError: >>>>>>> org.apache.hadoop.yarn.api.protocolrecords.AllocateRequest.newInstance(IFLjava/util/List;Ljava/util/List;Ljava/util/List;Lorg/apache/hadoop/yarn/api/records/ResourceBlacklistRequest;)Lorg/apache/hadoop/yarn/api/protocolrecords/AllocateRequest; >>>>>>> at >>>>>>> org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.allocate(AMRMClientImpl.java:280) >>>>>>> at >>>>>>> org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl$HeartbeatThread.run(AMRMClientAsyncImpl.java:273) >>>>>>> 2020-08-20 04:37:00,714 ERROR org.apache.flink.yarn.YarnResourceManager >>>>>>> - Fatal error occurred in ResourceManager. >>>>>>> java.lang.NoSuchMethodError: >>>>>>> org.apache.hadoop.yarn.api.protocolrecords.AllocateRequest.newInstance(IFLjava/util/List;Ljava/util/List;Ljava/util/List;Lorg/apache/hadoop/yarn/api/records/ResourceBlacklistRequest;)Lorg/apache/hadoop/yarn/api/protocolrecords/AllocateRequest; >>>>>>> at >>>>>>> org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.allocate(AMRMClientImpl.java:280) >>>>>>> at >>>>>>> org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl$HeartbeatThread.run(AMRMClientAsyncImpl.java:273) >>>>>>> 2020-08-20 04:37:00,714 ERROR >>>>>>> org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Fatal >>>>>>> error occurred in the cluster entrypoint. >>>>>>> java.lang.NoSuchMethodError: >>>>>>> org.apache.hadoop.yarn.api.protocolrecords.AllocateRequest.newInstance(IFLjava/util/List;Ljava/util/List;Ljava/util/List;Lorg/apache/hadoop/yarn/api/records/ResourceBlacklistRequest;)Lorg/apache/hadoop/yarn/api/protocolrecords/AllocateRequest; >>>>>>> at >>>>>>> org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.allocate(AMRMClientImpl.java:280) >>>>>>> at >>>>>>> org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl$HeartbeatThread.run(AMRMClientAsyncImpl.java:273) >>>>>>> 2020-08-20 04:37:00,718 INFO org.apache.flink.runtime.blob.BlobServer >>>>>>> >>>>>>> - Stopped BLOB server at 0.0.0.0:45627 >>>>>>> >>>>>>> >>>>>>> Regards, >>>>>>> >>>>>>> Vijay >>>>>>> >>>>>>>
