Hi Jose, Sorry, my previous response may have been misleading.
I have confirmed here that Flink 1.15 only supports Hadoop 2.8.5 and above, so you should use a Hadoop version of 2.8.5 or higher. https://nightlies.apache.org/flink/flink-docs-release-1.15/release-notes/flink-1.15/#upgrade-the-minimal-supported-hadoop-version-to-285 Starting from Flink 1.11, Flink no longer provides shaded-Hadoop and recommends configuring HADOOP_CLASSPATH instead. https://nightlies.apache.org/flink/flink-docs-release-1.11/release-notes/flink-1.11.html#support-for-hadoop-300-and-higher-flink-11086 Best, Feng On Thu, Oct 12, 2023 at 4:26 AM Jose Henrry Matituy Manchabajoy < henrrymati...@gmail.com> wrote: > Thanks for the above reply. > > To the repesct, I comment the following: in tests performed with > flink-shaded-hadoop-2-uber-2.8.3-10.0.jar, Hadoop 2.8.3 and Flink 1.10.0 > everything goes fine. But, when I upgrade Flink to 1.15.0. I encounter > errors. According to the documentation, Flink 1.15.0 only works with Hadoop > versions higher than 2.8.5. Apparently, flink-shaded-hadoop-2-uber-2.8.3, > only works with hadoop 2.8.3. Due to the above, I cannot connect Flink with > HDFS. Could you please clarify this aspect for me? > > Thank you very much. > > El lun, 9 oct 2023 a las 8:10, Jose Henrry Matituy Manchabajoy (< > henrrymati...@gmail.com>) escribió: > >> Cordial greetings >> >> In tests performed with flink-shaded-hadoop-2-uber-2.8.3-10.0.jar, Hadoop >> 2.8.3 and Flink 1.10.0 everything is fine. However when I upgrade Flink to >> 1.15.0. I encounter errors. According to the documentation, Flink 1.15.0 >> only works with Hadoop versions higher than 2.8.5. Apparently, >> flink-shaded-hadoop-2-uber-2.8.3, only works with hadoop 2.8.3. Because of >> the above, I am unable to connect Flink with HDFS. >> >> I appreciate your valuable collaboration. >> >> Yours sincerely, >> >> >> Jose Henrry Matituy >> >> El mié, 27 sept 2023 a las 20:34, Feng Jin (<jinfeng1...@gmail.com>) >> escribió: >> >>> Hi Jose >>> >>> This component is compatible with the latest version of Flink (1.17.1). >>> The package in question is merely a shaded dependency for Hadoop and is not >>> dependent on the version of Flink. >>> >>> Best, >>> Feng >>> >>> On Thu, Sep 28, 2023 at 4:03 AM Jose Henrry Matituy Manchabajoy < >>> henrrymati...@gmail.com> wrote: >>> >>>> Cordial greetings >>>> >>>> >>>> >>>> I am working on an application where I need to use Flik with HDFS. I >>>> understand that to make the connection I need to use the >>>> flink-shaded-hadoop-2-uber-2.8.3-10.0.jar extension. My question is. What >>>> is the most up to date version of Flink that works with this extension or >>>> is there another way to use a more up to date version of Flink with HDFS? >>>> >>>> >>>> >>>> Thank you very much for your attention. >>>> >>>> >>>> >>>> Yours sincerely, >>>> >>>> >>>> Jose Henrry Matituy >>>> >>>
