[ https://issues.apache.org/jira/browse/SPARK-21521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099111#comment-16099111 ]
Adrian Bridgett commented on SPARK-21521: ----------------------------------------- Thanks Marcelo - good idea regarding the setgid bit - that's definitely cleaner than my current workaround :) (3775 for setgid rather than 4775 I think though - 2 for the setgid, 1 for the sticky bit) And thanks for such a speedy response! > History service requires user is in any group > --------------------------------------------- > > Key: SPARK-21521 > URL: https://issues.apache.org/jira/browse/SPARK-21521 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 2.2.0 > Reporter: Adrian Bridgett > > (Regression cf. 2.0.2) > We run spark as several users, these write to the history location where the > files are saved as those users with permissions of 770 (this is hardcoded in > EventLoggingListener.scala). > The history service runs as root so that it has permissions on these files > (see https://spark.apache.org/docs/latest/security.html). > This worked fine in v2.0.2, however in v2.2.0 the events are being skipped > unless I add the root user into each users group at which point they are seen. > We currently have all acls configuration unset. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org