[
https://issues.apache.org/jira/browse/FLINK-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15431703#comment-15431703
]
ASF GitHub Bot commented on FLINK-3929:
---------------------------------------
Github user vijikarthi commented on the issue:
https://github.com/apache/flink/pull/2275
> YARNSessionFIFOSecuredITCase gives me the following:
17:49:58,097 INFO SecurityLogger.org.apache.hadoop.ipc.Server - Auth
successful for appattempt_1471880990715_0001_000001 (auth:SIMPLE)
It is not using Kerberos it seems. We should check that security is really
enabled and fail the test if not.
How did you run the Yarn IT test? I am seeing some compile issues when I
try to run the below command?
```
> mvn verify -pl flink-yarn-tests -Pinclude-yarn-tests
[INFO] Scanning for projects...
[INFO]
[INFO]
------------------------------------------------------------------------
[INFO] Building flink-yarn-tests 1.2-SNAPSHOT
[INFO]
------------------------------------------------------------------------
[INFO]
[INFO] --- maven-checkstyle-plugin:2.16:check (validate) @
flink-yarn-tests_2.10 ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @
flink-yarn-tests_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.7:add-source (add-source) @
flink-yarn-tests_2.10 ---
[INFO] Source directory:
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @
flink-yarn-tests_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
flink-yarn-tests_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.1.4:compile (scala-compile-first) @
flink-yarn-tests_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @
flink-yarn-tests_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- build-helper-maven-plugin:1.7:add-test-source (add-test-source)
@ flink-yarn-tests_2.10 ---
[INFO] Test Source directory:
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources)
@ flink-yarn-tests_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.1.4:testCompile (scala-test-compile) @
flink-yarn-tests_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @
flink-yarn-tests_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 12 source files to
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/target/test-classes
[INFO] -------------------------------------------------------------
[WARNING] COMPILATION WARNING :
[INFO] -------------------------------------------------------------
[WARNING]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/UtilsTest.java:[81,47]
YARN_HEAP_CUTOFF_RATIO in org.apache.flink.configuration.ConfigConstants has
been deprecated
[WARNING]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/UtilsTest.java:[82,48]
YARN_HEAP_CUTOFF_MIN in org.apache.flink.configuration.ConfigConstants has
been deprecated
[INFO] 2 warnings
[INFO] -------------------------------------------------------------
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[21,41]
cannot find symbol
symbol: class SecurityContext
location: package org.apache.flink.runtime.security
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[22,34]
cannot find symbol
symbol: class SecureTestEnvironment
location: package org.apache.flink.test.util
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[23,34]
cannot find symbol
symbol: class TestingSecurityContext
location: package org.apache.flink.test.util
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java:[408,68]
cannot find symbol
symbol: variable SECURITY_KEYTAB_KEY
location: class org.apache.flink.configuration.ConfigConstants
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java:[409,68]
cannot find symbol
symbol: variable SECURITY_PRINCIPAL_KEY
location: class org.apache.flink.configuration.ConfigConstants
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[46,17]
cannot find symbol
symbol: variable SecureTestEnvironment
location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[48,68]
cannot find symbol
symbol: variable SecureTestEnvironment
location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[49,33]
cannot find symbol
symbol: variable SecureTestEnvironment
location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[51,32]
package SecurityContext does not exist
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[51,80]
package SecurityContext does not exist
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[52,36]
cannot find symbol
symbol: variable SecureTestEnvironment
location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[52,75]
cannot find symbol
symbol: variable SecureTestEnvironment
location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[55,61]
cannot find symbol
symbol: variable SecureTestEnvironment
location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[55,25]
cannot find symbol
symbol: variable TestingSecurityContext
location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[60,56]
cannot find symbol
symbol: variable SecureTestEnvironment
location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[61,33]
cannot find symbol
symbol: variable SecureTestEnvironment
location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[67,17]
cannot find symbol
symbol: variable SecureTestEnvironment
location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[INFO] 17 errors
[INFO] -------------------------------------------------------------
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 4.428 s
[INFO] Finished at: 2016-08-22T14:36:41-07:00
[INFO] Final Memory: 86M/1735M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile
(default-testCompile) on project flink-yarn-tests_2.10: Compilation failure:
Compilation failure:
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[21,41]
cannot find symbol
[ERROR] symbol: class SecurityContext
[ERROR] location: package org.apache.flink.runtime.security
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[22,34]
cannot find symbol
[ERROR] symbol: class SecureTestEnvironment
[ERROR] location: package org.apache.flink.test.util
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[23,34]
cannot find symbol
[ERROR] symbol: class TestingSecurityContext
[ERROR] location: package org.apache.flink.test.util
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java:[408,68]
cannot find symbol
[ERROR] symbol: variable SECURITY_KEYTAB_KEY
[ERROR] location: class org.apache.flink.configuration.ConfigConstants
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java:[409,68]
cannot find symbol
[ERROR] symbol: variable SECURITY_PRINCIPAL_KEY
[ERROR] location: class org.apache.flink.configuration.ConfigConstants
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[46,17]
cannot find symbol
[ERROR] symbol: variable SecureTestEnvironment
[ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[48,68]
cannot find symbol
[ERROR] symbol: variable SecureTestEnvironment
[ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[49,33]
cannot find symbol
[ERROR] symbol: variable SecureTestEnvironment
[ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[51,32]
package SecurityContext does not exist
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[51,80]
package SecurityContext does not exist
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[52,36]
cannot find symbol
[ERROR] symbol: variable SecureTestEnvironment
[ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[52,75]
cannot find symbol
[ERROR] symbol: variable SecureTestEnvironment
[ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[55,61]
cannot find symbol
[ERROR] symbol: variable SecureTestEnvironment
[ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[55,25]
cannot find symbol
[ERROR] symbol: variable TestingSecurityContext
[ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[60,56]
cannot find symbol
[ERROR] symbol: variable SecureTestEnvironment
[ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[61,33]
cannot find symbol
[ERROR] symbol: variable SecureTestEnvironment
[ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR]
/workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[67,17]
cannot find symbol
[ERROR] symbol: variable SecureTestEnvironment
[ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> Support for Kerberos Authentication with Keytab Credential
> ----------------------------------------------------------
>
> Key: FLINK-3929
> URL: https://issues.apache.org/jira/browse/FLINK-3929
> Project: Flink
> Issue Type: New Feature
> Reporter: Eron Wright
> Assignee: Vijay Srinivasaraghavan
> Labels: kerberos, security
> Original Estimate: 672h
> Remaining Estimate: 672h
>
> _This issue is part of a series of improvements detailed in the [Secure Data
> Access|https://docs.google.com/document/d/1-GQB6uVOyoaXGwtqwqLV8BHDxWiMO2WnVzBoJ8oPaAs/edit?usp=sharing]
> design doc._
> Add support for a keytab credential to be associated with the Flink cluster,
> to facilitate:
> - Kerberos-authenticated data access for connectors
> - Kerberos-authenticated ZooKeeper access
> Support both the standalone and YARN deployment modes.
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
