[jira] [Created] (YARN-10310) YARN Service - User is able to launch a service with same name

[Bilwa S T (Jira)]

Bilwa S T created YARN-10310:


 Summary: YARN Service - User is able to launch a service with same 
name
 Key: YARN-10310
 URL: https://issues.apache.org/jira/browse/YARN-10310
 Project: Hadoop YARN
  Issue Type: Bug
Reporter: Bilwa S T
Assignee: Bilwa S T


As ServiceClient uses UserGroupInformation.getCurrentUser().getUserName() to 
get user whereas ClientRMService#submitApplication uses 
UserGroupInformation.getCurrentUser().getShortUserName() to set application 
username.
In case of user with name hdfs/had...@hadoop.com. below condition fails
ClientRMService#getApplications()

{code:java}
if (users != null && !users.isEmpty() &&
  !users.contains(application.getUser())) {
continue;
 }

{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-10309) Dump scheduler and queue state information into CapacityScheduler statedump

[Prabhu Joseph (Jira)]

Prabhu Joseph created YARN-10309:


 Summary: Dump scheduler and queue state information into 
CapacityScheduler statedump 
 Key: YARN-10309
 URL: https://issues.apache.org/jira/browse/YARN-10309
 Project: Hadoop YARN
  Issue Type: Improvement
  Components: capacityscheduler
Reporter: Prabhu Joseph
Assignee: Prabhu Joseph


CapacityScheduler dump with Scheduler, FiCaSchedulerNode, FiCaSchedulerApp, 
ParentQueue, LeafQueue, app and queue level ordering, multi node lookup 
ordering details will make it ease to debug scheduler related issues instead of 
correlating Debug Logs with CapacityScheduler code to get values for the above.

This is similar to FairScheduler statedump YARN-6042.







--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: branch2.10+JDK7 on Linux/x86

[Apache Jenkins Server]

For more details, see 
https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/710/

No changes




-1 overall


The following subsystems voted -1:
asflicense findbugs hadolint pathlen unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

XML :

   Parsing Error(s): 
   
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/empty-configuration.xml
 
   hadoop-tools/hadoop-azure/src/config/checkstyle-suppressions.xml 
   hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/public/crossdomain.xml 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/src/main/webapp/public/crossdomain.xml
 

FindBugs :

   module:hadoop-common-project/hadoop-minikdc 
   Possible null pointer dereference in 
org.apache.hadoop.minikdc.MiniKdc.delete(File) due to return value of called 
method Dereferenced at 
MiniKdc.java:org.apache.hadoop.minikdc.MiniKdc.delete(File) due to return value 
of called method Dereferenced at MiniKdc.java:[line 515] 

FindBugs :

   module:hadoop-common-project/hadoop-auth 
   
org.apache.hadoop.security.authentication.server.MultiSchemeAuthenticationHandler.authenticate(HttpServletRequest,
 HttpServletResponse) makes inefficient use of keySet iterator instead of 
entrySet iterator At MultiSchemeAuthenticationHandler.java:of keySet iterator 
instead of entrySet iterator At MultiSchemeAuthenticationHandler.java:[line 
192] 

FindBugs :

   module:hadoop-common-project/hadoop-common 
   org.apache.hadoop.crypto.CipherSuite.setUnknownValue(int) 
unconditionally sets the field unknownValue At CipherSuite.java:unknownValue At 
CipherSuite.java:[line 44] 
   org.apache.hadoop.crypto.CryptoProtocolVersion.setUnknownValue(int) 
unconditionally sets the field unknownValue At 
CryptoProtocolVersion.java:unknownValue At CryptoProtocolVersion.java:[line 67] 
   Possible null pointer dereference in 
org.apache.hadoop.fs.FileUtil.fullyDeleteOnExit(File) due to return value of 
called method Dereferenced at 
FileUtil.java:org.apache.hadoop.fs.FileUtil.fullyDeleteOnExit(File) due to 
return value of called method Dereferenced at FileUtil.java:[line 118] 
   Possible null pointer dereference in 
org.apache.hadoop.fs.RawLocalFileSystem.handleEmptyDstDirectoryOnWindows(Path, 
File, Path, File) due to return value of called method Dereferenced at 
RawLocalFileSystem.java:org.apache.hadoop.fs.RawLocalFileSystem.handleEmptyDstDirectoryOnWindows(Path,
 File, Path, File) due to return value of called method Dereferenced at 
RawLocalFileSystem.java:[line 383] 
   Useless condition:lazyPersist == true at this point At 
CommandWithDestination.java:[line 502] 
   org.apache.hadoop.io.DoubleWritable.compareTo(DoubleWritable) 
incorrectly handles double value At DoubleWritable.java: At 
DoubleWritable.java:[line 78] 
   org.apache.hadoop.io.DoubleWritable$Comparator.compare(byte[], int, int, 
byte[], int, int) incorrectly handles double value At DoubleWritable.java:int) 
incorrectly handles double value At DoubleWritable.java:[line 97] 
   org.apache.hadoop.io.FloatWritable.compareTo(FloatWritable) incorrectly 
handles float value At FloatWritable.java: At FloatWritable.java:[line 71] 
   org.apache.hadoop.io.FloatWritable$Comparator.compare(byte[], int, int, 
byte[], int, int) incorrectly handles float value At FloatWritable.java:int) 
incorrectly handles float value At FloatWritable.java:[line 89] 
   Possible null pointer dereference in 
org.apache.hadoop.io.IOUtils.listDirectory(File, FilenameFilter) due to return 
value of called method Dereferenced at 
IOUtils.java:org.apache.hadoop.io.IOUtils.listDirectory(File, FilenameFilter) 
due to return value of called method Dereferenced at IOUtils.java:[line 389] 
   Possible bad parsing of shift operation in 
org.apache.hadoop.io.file.tfile.Utils$Version.hashCode() At 
Utils.java:operation in 
org.apache.hadoop.io.file.tfile.Utils$Version.hashCode() At Utils.java:[line 
398] 
   
org.apache.hadoop.metrics2.lib.DefaultMetricsFactory.setInstance(MutableMetricsFactory)
 unconditionally sets the field mmfImpl At DefaultMetricsFactory.java:mmfImpl 
At DefaultMetricsFactory.java:[line 49] 
   
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.setMiniClusterMode(boolean) 
unconditionally sets the field miniClusterMode At 
DefaultMetricsSystem.java:miniClusterMode At DefaultMetricsSystem.java:[line 
92] 
   Useless object stored in variable seqOs of method 
org.apache.hadoop.security.token.delegation.ZKDelegationTokenSecretManager.addOrUpdateToken(AbstractDelegationTokenIdentifier,
 AbstractDelegationTokenSecretManager$DelegationTokenInformation, boolean) At 
ZKDelegationTokenSecretManager.java:seqOs of method 

[jira] [Created] (YARN-10308) Update javadoc and variable names for keytab in yarn services as it supports schemes other than hdfs and local file system

[Bilwa S T (Jira)]

Bilwa S T created YARN-10308:


 Summary: Update javadoc and variable names for keytab in yarn 
services as it supports schemes other than hdfs and local file system
 Key: YARN-10308
 URL: https://issues.apache.org/jira/browse/YARN-10308
 Project: Hadoop YARN
  Issue Type: Bug
Reporter: Bilwa S T
Assignee: Bilwa S T


1.  Below description should be updated

{code:java}
@ApiModelProperty(value = "The URI of the kerberos keytab. It supports two " +
  "schemes \"hdfs\" and \"file\". If the URI starts with \"hdfs://\" " +
  "scheme, it indicates the path on hdfs where the keytab is stored. The " +
  "keytab will be localized by YARN and made available to AM in its local" +
  " directory. If the URI starts with \"file://\" scheme, it indicates a " +
  "path on the local host where the keytab is presumbaly installed by " +
  "admins upfront. ")
  public String getKeytab() {
return keytab;
  }
{code}

2. Variables below are still named on hdfs which is confusing
{code:java}
if ("file".equals(keytabURI.getScheme())) {
  LOG.info("Using a keytab from localhost: " + keytabURI);
} else {
  Path keytabOnhdfs = new Path(keytabURI);
  if (!fileSystem.getFileSystem().exists(keytabOnhdfs)) {
LOG.warn(service.getName() + "'s keytab (principalName = "
+ principalName + ") doesn't exist at: " + keytabOnhdfs);
return;
  }
  LocalResource keytabRes = fileSystem.createAmResource(keytabOnhdfs,
  LocalResourceType.FILE);
  localResource.put(String.format(YarnServiceConstants.KEYTAB_LOCATION,
  service.getName()), keytabRes);
  LOG.info("Adding " + service.getName() + "'s keytab for "
  + "localization, uri = " + keytabOnhdfs);
}
{code}





--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org