[ https://issues.apache.org/jira/browse/SPARK-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533755#comment-14533755 ]
gu-chi commented on SPARK-7110: ------------------------------- As I analyzed the exception stack trace again, I found the exception was thown at NewHadoopRDD.getPartitions, when invoke inputFormat.getSplits, so I add the similar modification as SPARK-1203 there, as running for so long time, never occur again. > when use saveAsNewAPIHadoopFile, sometimes it throws "Delegation Token can be > issued only with kerberos or web authentication" > ------------------------------------------------------------------------------------------------------------------------------ > > Key: SPARK-7110 > URL: https://issues.apache.org/jira/browse/SPARK-7110 > Project: Spark > Issue Type: Bug > Components: YARN > Affects Versions: 1.1.0 > Reporter: gu-chi > > Under yarn-client mode, this issue random occurs. Authentication method is > set to kerberos, and use "saveAsNewAPIHadoopFile" in PairRDDFunctions to save > data to HDFS, then exception comes as: > org.apache.hadoop.ipc.RemoteException(java.io.IOException): Delegation Token > can be issued only with kerberos or web authentication -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org