[
https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15656576#comment-15656576
]
ASF GitHub Bot commented on FLINK-5013:
---------------------------------------
GitHub user tzulitai opened a pull request:
https://github.com/apache/flink/pull/2787
[FLINK-5013] [kinesis] Shade AWS dependencies to work with older EMR
versions
This PR adds shading to fix the reported dependency issues on older EMR
versions.
Randomly tested for 4.x EMR on versions 4.3.0, 4.4.0, 4.7.2, and 4.8.0, as
well as 5.0.3. Works without issues.
However, for the native Flink support in EMR 5.1.0, the `NoSuchMethodError`
for `HttpConnectionParams.setSoKeepalive` still remains, even with the shading.
I'm suspecting that its a different problem.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tzulitai/flink FLINK-5013
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/2787.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2787
----
commit 1c56bda9690eb145006b19ba6b4f7649704f7fd4
Author: Tzu-Li (Gordon) Tai <tzuli...@apache.org>
Date: 2016-11-11T09:01:11Z
[FLINK-5013] [kinesis] Shade AWS dependencies to work with older EMR
versions
----
> Flink Kinesis connector doesn't work on old EMR versions
> --------------------------------------------------------
>
> Key: FLINK-5013
> URL: https://issues.apache.org/jira/browse/FLINK-5013
> Project: Flink
> Issue Type: Bug
> Components: Kinesis Connector
> Reporter: Robert Metzger
> Assignee: Tzu-Li (Gordon) Tai
> Priority: Critical
>
> A user reported on the mailing list that our Kinesis connector doesn't work
> with EMR 4.4.0:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Kinesis-Connector-Dependency-Problems-td9790.html
> The problem seems to be that Flink is loading older libraries from the "YARN
> container classpath", which on EMR contains the default Amazon libraries.
> We should try to shade kinesis and its amazon dependencies into a different
> namespace.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
