CVE-2018-11766: Apache Hadoop privilege escalation vulnerability

2018-11-26 Thread Akira Ajisaka
CVE-2018-11766: Apache Hadoop privilege escalation vulnerability

Severity: Critical

Vendor: The Apache Software Foundation

Versions Affected:
Apache Hadoop versions from 2.7.4 to 2.7.6

Description:
In Apache Hadoop 2.7.4 to 2.7.6, the security fix for CVE-2016-6811 is
incomplete.
A user who can escalate to yarn user can possibly run arbitrary
commands as root user.

Mitigation:
Users should upgrade to 2.7.7 or upper.
If you are using the affected version of Apache Hadoop and there are
any users who can escalate to yarn user and cannot escalate to root user,
remove the permission to escalate to yarn user from them.

Credit:
This issue was discovered by Wilfred Spiegelenburg.

-
To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org
For additional commands, e-mail: user-h...@hadoop.apache.org



get a spark job full log via yarn api (instead of yarn cli)

2018-11-26 Thread Lian Jiang
On HDP3, I cannot get the full log of a failing spark job by using yarn api:

curl -k -u guest:"" -X GET https://
myhost.com/gateway/ui/resourcemanager/v1/cluster/apps/

{applicationId}

This means the job owner has to ssh to the cluster to run "yarn logs"
command to get the full log. Is this expected? How can I get the full spark
log without sshing to the cluster? Appreciate your help.