Ryan Skraba created FLINK-35175:
-----------------------------------
Summary: HadoopDataInputStream can't compile with Hadoop 3.2.3
Key: FLINK-35175
URL: https://issues.apache.org/jira/browse/FLINK-35175
Project: Flink
Issue Type: Bug
Affects Versions: 1.20.0
Reporter: Ryan Skraba
Unfortunately, introduced in FLINK-35045:
[PREADWRITEBUFFER|https://github.com/apache/flink/commit/a312a3bdd258e0ff7d6f94e979b32e2bc762b82f#diff-3ed57be01895ba0f792110e40f4283427c55528f11a5105b4bf34ebd4e6fef0dR182]
was added in Hadoop releases
[3.3.0|https://github.com/apache/hadoop/blob/rel/release-3.3.0/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StreamCapabilities.java#L72]
and
[2.10.0|https://github.com/apache/hadoop/blob/rel/release-2.10.0/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StreamCapabilities.java#L72].
It doesn't exist in flink.hadoop.version
[3.2.3|https://github.com/apache/hadoop/blob/rel/release-3.2.3/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StreamCapabilities.java],
which we are using in end-to-end tests.
{code:java}
00:23:55.093 [ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile (default-compile)
on project flink-hadoop-fs: Compilation failure: Compilation failure:
00:23:55.093 [ERROR]
/home/vsts/work/1/s/flink-filesystems/flink-hadoop-fs/src/main/java/org/apache/flink/runtime/fs/hdfs/HadoopDataInputStream.java:[151,63]
cannot find symbol
00:23:55.094 [ERROR] symbol: variable READBYTEBUFFER
00:23:55.094 [ERROR] location: interface
org.apache.hadoop.fs.StreamCapabilities
00:23:55.094 [ERROR]
/home/vsts/work/1/s/flink-filesystems/flink-hadoop-fs/src/main/java/org/apache/flink/runtime/fs/hdfs/HadoopDataInputStream.java:[182,63]
cannot find symbol
00:23:55.094 [ERROR] symbol: variable PREADBYTEBUFFER
00:23:55.094 [ERROR] location: interface
org.apache.hadoop.fs.StreamCapabilities
00:23:55.094 [ERROR]
/home/vsts/work/1/s/flink-filesystems/flink-hadoop-fs/src/main/java/org/apache/flink/runtime/fs/hdfs/HadoopDataInputStream.java:[183,43]
incompatible types: long cannot be converted to
org.apache.hadoop.io.ByteBufferPool
00:23:55.094 [ERROR] -> [Help 1] {code}
* 1.20 compile_cron_hadoop313
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=59012&view=logs&j=87489130-75dc-54e4-1f45-80c30aa367a3&t=73da6d75-f30d-5d5a-acbe-487a9dcff678&l=3630
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
