[jira] [Updated] (SPARK-29804) Spark-shell is failing on YARN mode

2019-11-11 Thread Hyukjin Kwon (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-29804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hyukjin Kwon updated SPARK-29804:
-
Target Version/s:   (was: 2.4.4)

> Spark-shell is failing on YARN mode
> ---
>
> Key: SPARK-29804
> URL: https://issues.apache.org/jira/browse/SPARK-29804
> Project: Spark
>  Issue Type: Question
>  Components: YARN
>Affects Versions: 2.4.4
> Environment: Spark2.4.4, Apache Hadoop 3.1.2
>Reporter: Srujan A
>Priority: Blocker
> Fix For: 2.4.4
>
>
> I am trying to run the spark-shell on YARN mode from containers and it's 
> failing on below reason. Please help me out.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-29804) Spark-shell is failing on YARN mode

2019-11-11 Thread Hyukjin Kwon (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-29804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hyukjin Kwon updated SPARK-29804:
-
Priority: Major  (was: Blocker)

> Spark-shell is failing on YARN mode
> ---
>
> Key: SPARK-29804
> URL: https://issues.apache.org/jira/browse/SPARK-29804
> Project: Spark
>  Issue Type: Question
>  Components: YARN
>Affects Versions: 2.4.4
> Environment: Spark2.4.4, Apache Hadoop 3.1.2
>Reporter: Srujan A
>Priority: Major
> Fix For: 2.4.4
>
>
> I am trying to run the spark-shell on YARN mode from containers and it's 
> failing on below reason. Please help me out.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-29804) Spark-shell is failing on YARN mode

2019-11-08 Thread Srujan A (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-29804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Srujan A updated SPARK-29804:
-
Issue Type: Question  (was: Bug)

> Spark-shell is failing on YARN mode
> ---
>
> Key: SPARK-29804
> URL: https://issues.apache.org/jira/browse/SPARK-29804
> Project: Spark
>  Issue Type: Question
>  Components: YARN
>Affects Versions: 2.4.4
> Environment: Spark2.4.4, Apache Hadoop 3.1.2
>Reporter: Srujan A
>Priority: Blocker
> Fix For: 2.4.4
>
>
> I am trying to run the spark-shell on YARN mode from containers and it's 
> failing on below reason. Please help me out.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-29804) Spark-shell is failing on YARN mode

2019-11-08 Thread Srujan A (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-29804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Srujan A updated SPARK-29804:
-
Docs Text: 
[root@hadoop]# /usr/lib/spark/spark-2.4.4/bin/spark-shell
[main] INFO org.apache.spark.SecurityManager - Changing view acls to: root
[main] INFO org.apache.spark.SecurityManager - Changing modify acls to: root
[main] INFO org.apache.spark.SecurityManager - Changing view acls groups to:
[main] INFO org.apache.spark.SecurityManager - Changing modify acls groups to:
[main] INFO org.apache.spark.SecurityManager - SecurityManager: authentication 
disabled; ui acls disabled; users  with view permissions: Set(root); groups 
with view permissions: Set(); users  with modify permissions: Set(root); groups 
with modify permissions: Set()
[main] INFO org.apache.spark.util.SignalUtils - Registered signal handler for 
INT
[main] INFO org.apache.spark.SparkContext - Running Spark version 2.4.4
[main] INFO org.apache.spark.SparkContext - Submitted application: Spark shell
[main] INFO org.apache.spark.SecurityManager - Changing view acls to: root
[main] INFO org.apache.spark.SecurityManager - Changing modify acls to: root
[main] INFO org.apache.spark.SecurityManager - Changing view acls groups to:
[main] INFO org.apache.spark.SecurityManager - Changing modify acls groups to:
[main] INFO org.apache.spark.SecurityManager - SecurityManager: authentication 
disabled; ui acls disabled; users  with view permissions: Set(root); groups 
with view permissions: Set(); users  with modify permissions: Set(root); groups 
with modify permissions: Set()
[main] INFO org.apache.spark.util.Utils - Successfully started service 
'sparkDriver' on port 44125.
[main] INFO org.apache.spark.SparkEnv - Registering MapOutputTracker
[main] INFO org.apache.spark.SparkEnv - Registering BlockManagerMaster
[main] INFO org.apache.spark.storage.BlockManagerMasterEndpoint - Using 
org.apache.spark.storage.DefaultTopologyMapper for getting topology information
[main] INFO org.apache.spark.storage.BlockManagerMasterEndpoint - 
BlockManagerMasterEndpoint up
[main] INFO org.apache.spark.storage.DiskBlockManager - Created local directory 
at /tmp/blockmgr-ac4d034f-50a3-494b-818a-54f98b1c6e16
[main] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore started 
with capacity 93.3 MB
[main] INFO org.apache.spark.SparkEnv - Registering OutputCommitCoordinator
[main] INFO org.spark_project.jetty.util.log - Logging initialized @7542ms
[main] INFO org.spark_project.jetty.server.Server - jetty-9.3.z-SNAPSHOT, build 
timestamp: 2018-06-05T10:11:56-07:00, git hash: 
84205aa28f11a4f31f2a3b86d1bba2cc8ab69827
[main] INFO org.spark_project.jetty.server.Server - Started @7628ms
[main] INFO org.spark_project.jetty.server.AbstractConnector - Started 
ServerConnector@6f740044{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
[main] INFO org.apache.spark.util.Utils - Successfully started service 
'SparkUI' on port 4040.
[main] INFO org.spark_project.jetty.server.handler.ContextHandler - Started 
o.s.j.s.ServletContextHandler@72e1e587{/jobs,null,AVAILABLE,@Spark}
[main] INFO org.spark_project.jetty.server.handler.ContextHandler - Started 
o.s.j.s.ServletContextHandler@f833223{/jobs/json,null,AVAILABLE,@Spark}
[main] INFO org.spark_project.jetty.server.handler.ContextHandler - Started 
o.s.j.s.ServletContextHandler@5186b78a{/jobs/job,null,AVAILABLE,@Spark}
[main] INFO org.spark_project.jetty.server.handler.ContextHandler - Started 
o.s.j.s.ServletContextHandler@1e749235{/jobs/job/json,null,AVAILABLE,@Spark}
[main] INFO org.spark_project.jetty.server.handler.ContextHandler - Started 
o.s.j.s.ServletContextHandler@870a9f2{/stages,null,AVAILABLE,@Spark}
[main] INFO org.spark_project.jetty.server.handler.ContextHandler - Started 
o.s.j.s.ServletContextHandler@6c2e7591{/stages/json,null,AVAILABLE,@Spark}
[main] INFO org.spark_project.jetty.server.handler.ContextHandler - Started 
o.s.j.s.ServletContextHandler@7f2542f{/stages/stage,null,AVAILABLE,@Spark}
[main] INFO org.spark_project.jetty.server.handler.ContextHandler - Started 
o.s.j.s.ServletContextHandler@2f82e3cf{/stages/stage/json,null,AVAILABLE,@Spark}
[main] INFO org.spark_project.jetty.server.handler.ContextHandler - Started 
o.s.j.s.ServletContextHandler@3a44993c{/stages/pool,null,AVAILABLE,@Spark}
[main] INFO org.spark_project.jetty.server.handler.ContextHandler - Started 
o.s.j.s.ServletContextHandler@6b6606d1{/stages/pool/json,null,AVAILABLE,@Spark}
[main] INFO org.spark_project.jetty.server.handler.ContextHandler - Started 
o.s.j.s.ServletContextHandler@27605b87{/storage,null,AVAILABLE,@Spark}
[main] INFO org.spark_project.jetty.server.handler.ContextHandler - Started 
o.s.j.s.ServletContextHandler@1fc4483f{/storage/json,null,AVAILABLE,@Spark}
[main] INFO org.spark_project.jetty.server.handler.ContextHandler - Started 
o.s.j.s.ServletContextHandler@1d7af82{/storage/rdd,null,AVAILABLE,@Spark}
[main] INFO