[GitHub] nifi issue #2582: NIFI-4923 Updated nifi-hadoop-libraries-nar, nifi-hdfs-pro...
Github user bbende commented on the issue: https://github.com/apache/nifi/pull/2582 @jtstorck I tested this against a 2.6 Hadoop with Kerberos and also a 3.0.0 and it appears to work against both so I'm planning to merge this. I do think we should make it as easy as possible for users to get the older NARs if for some reason they really do need to use the 2.x Hadoop client. The easiest way to do this would be to just grab from Nexus and drop them into the lib directory: http://central.maven.org/maven2/org/apache/nifi/nifi-hadoop-libraries-nar/1.6.0/nifi-hadoop-libraries-nar-1.6.0.nar http://central.maven.org/maven2/org/apache/nifi/nifi-hadoop-nar/1.6.0/nifi-hadoop-nar-1.6.0.nar I'm thinking we can either put links to these on our main Downloads page, or we can link to them in the Migration Guidance Wiki page. ---
[GitHub] nifi issue #2582: NIFI-4923 Updated nifi-hadoop-libraries-nar, nifi-hdfs-pro...
Github user tasanuma commented on the issue: https://github.com/apache/nifi/pull/2582 Thanks for working on this task. Basically, Wire Protocols between Hadoop clients and servers can be broken if they aren't within a major version. I think we should carefully proceed. FYI: http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-common/Compatibility.html#Wire_Protocols https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+Release ---
[GitHub] nifi issue #2582: NIFI-4923 Updated nifi-hadoop-libraries-nar, nifi-hdfs-pro...
Github user jtstorck commented on the issue: https://github.com/apache/nifi/pull/2582 @MikeThomsen I did run against HDP 2.6. Using client configs downloaded from a secure HDP 2.6 cluster, I was able to test Put/List/Fetch/DeleteHDFS, including TDE directories. ---
[GitHub] nifi issue #2582: NIFI-4923 Updated nifi-hadoop-libraries-nar, nifi-hdfs-pro...
Github user bbende commented on the issue: https://github.com/apache/nifi/pull/2582 Will review this soon... @MikeThomsen I think the intent here is to move master to use Hadoop 3.0.0 dependencies (3.1.0 is even out now)... If anyone needs to continue using the Hadoop 2.x dependencies then they can take the NARs from the previous release and add them in. For example, if 1.7.0 moves to 3.0.0, someone can take the nifi-hadoop-nar and nifi-hadoop-libraries-nar from 1.6.0 and drop them into 1.7.0. ---
[GitHub] nifi issue #2582: NIFI-4923 Updated nifi-hadoop-libraries-nar, nifi-hdfs-pro...
Github user MikeThomsen commented on the issue: https://github.com/apache/nifi/pull/2582 @jtstorck have you tried these changes against a Hadoop 2.X cluster? ---
