YarnConfiguration is @Evolving :)
Moving discussion to dev@apex.
Thank you,
Vlad
//
On 3/23/17 08:43, Pramod Immaneni wrote:
So much for semantic versioning..
On Thu, Mar 23, 2017 at 7:15 AM, Munagala Ramanath
<r...@datatorrent.com <mailto:r...@datatorrent.com>> wrote:
Looks like this was a breaking change introduced in Hadoop 2.7.0:
In
https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html
<https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html>
we have:
static longDELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
static StringDELEGATION_TOKEN_MAX_LIFETIME_KEY
But in
https://hadoop.apache.org/docs/r2.7.0/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html
<https://hadoop.apache.org/docs/r2.7.0/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html>
we have:
static longRM_DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
static StringRM_DELEGATION_TOKEN_MAX_LIFETIME_KEY
Ram
On Wed, Mar 22, 2017 at 11:59 PM, Chinmay Kolhatkar
<chin...@apache.org <mailto:chin...@apache.org>> wrote:
Hi All,
I want to clarify whether my understanding is correct here.
1. I downloaded apache-apex-core-3.5.0-source-release.tar.gz
2. Extracted the tar
3. Ran following command to build apex core:
mvn clean package -DskipTests -Dhadoop.version=2.7.3
(NOTE: I have overridden hadoop version to 2.7.3)
I get following compilation error:
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.3:compile
(default-compile) on project apex-engine: Compilation failure:
Compilation failure:
[ERROR]
/home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/plan/logical/LogicalPlan.java:[159,87]
cannot find symbol
[ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
[ERROR] location: class
org.apache.hadoop.yarn.conf.YarnConfiguration
[ERROR]
/home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,120]
cannot find symbol
[ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_KEY
[ERROR] location: class
org.apache.hadoop.yarn.conf.YarnConfiguration
[ERROR]
/home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,173]
cannot find symbol
[ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
[ERROR] location: class
org.apache.hadoop.yarn.conf.YarnConfiguration
[ERROR] -> [Help 1]
What should be the expected result while building apex-core
when building with different version of hadoop?
Is this error expected OR something wrong in my environment?
Thanks,
Chinmay.
--
_______________________________________________________
Munagala V. Ramanath
Software Engineer
E: r...@datatorrent.com <mailto:r...@datatorrent.com> | M: (408)
331-5034 <tel:%28408%29%20331-5034> | Twitter: @UnknownRam
www.datatorrent.com <http://www.datatorrent.com> |
apex.apache.org <http://apex.apache.org>
