Sivaprasanna Sethuraman created FLINK-18013:
-----------------------------------------------

             Summary: Refactor Hadoop Utility classes/functions into a common 
Maven module
                 Key: FLINK-18013
                 URL: https://issues.apache.org/jira/browse/FLINK-18013
             Project: Flink
          Issue Type: Improvement
            Reporter: Sivaprasanna Sethuraman


We have multiple modules which use Hadoop in one way another. This has caused a 
significant redundancy in utility classes and functions related to Hadoop. One 
such example which is also the motivation behind this Jira is the functionality 
to (de)serializing Hadoop Configuration. This functionality has multiple 
implementations across multiple modules (flink-hadoop-fs, flink-orc, 
flink-sequence-file, etc) with more or less the same code.

The aim of this Jira is to introduce a new module, say flink-hadoop-utils, that 
only contains the Hadoop related utility classes & functions with proper test 
cases in a single shareable module and get rid of the redundancy by adding this 
module as the dependency.

Relevant [DISCUSS] thread can be found at 
[https://lists.apache.org/thread.html/rf885987160bede5911a7f61923307a6d5ae07f850da0a90555728e5f%40%3Cdev.flink.apache.org%3E]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to