1. Parquet works with hadoop 1 and 2, we work around the Hadoop incompatibilities. See: https://github.com/apache/incubator-parquet-mr/blob/master/parquet-hadoop/src/main/java/parquet/hadoop/util/ContextUtil.java Both profiles are run in travis-ci: https://github.com/apache/incubator-parquet-mr/blob/master/.travis.yml#L26
2. You do not need to recompile parquet to the version of hadoop you use. For the same reason described above. On Sun, Mar 29, 2015 at 4:46 AM, Cheng Lian <[email protected]> wrote: > Hi developers, > > I have two questions about the Hadoop version Parquet uses. In the Maven > POM of > Parquet, the default Hadoop version is 1.1.0, while with `hadoop-2` profile > enabled, the version is 2.3.0. So my questions are: > > 1. What's the Hadoop version the official parquet-hadoop Maven artifact > (take > 1.6.0rc7 as an example) depends on? > > Namely, when compiled and published to Maven repo, is `hadoop-2` profile > enabled? (I must confess that I'm not quite familiar with Maven release > management process, apologize in advance if this is a dumb question.) > > 2. When building an application which depends on a specific Hadoop > version, do I > have to compile my own `parquet-hadoop` library if the Hadoop version is > inconsistent with the `parquet-hadoop` Maven artifact? > > Thanks! > Cheng >
