[ https://issues.apache.org/jira/browse/SPARK-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096825#comment-15096825 ]
Maciej BryĆski commented on SPARK-12269: ---------------------------------------- OK. We'll see. Thanks for the answer. > Update aws-java-sdk version > --------------------------- > > Key: SPARK-12269 > URL: https://issues.apache.org/jira/browse/SPARK-12269 > Project: Spark > Issue Type: Improvement > Components: Streaming > Reporter: Brian London > Assignee: Brian London > Priority: Minor > Fix For: 2.0.0 > > > The current Spark Streaming kinesis connector references a quite old version > 1.9.40 of the AWS Java SDK (1.10.40 is current). Numerous AWS features > including Kinesis Firehose are unavailable in 1.9. Those two versions of > the AWS SDK in turn require conflicting versions of Jackson (2.4.4 and 2.5.3 > respectively) such that one cannot include the current AWS SDK in a project > that also uses the Spark Streaming Kinesis ASL. > Bumping the version of Jackson and the AWS library solves this problem and > will allow Firehose integrations. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org