to stage failure:
java.lang.StringIndexOutOfBoundsException: String index out of range: 18
Ricky,
You may need to use map instead of flatMap in your case
val
rowRDD=sc.textFile(/user/spark/short_model).map(_.split(\\tfile:///\\t)).map(p
= Row(...))
Thanks!
-Terry
On Fri, Aug 28, 2015 at 5:08
)
at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
From: Terry Hole
Date: 2015-08-28 17:22
To: our...@cnsuning.com
CC: user; hao.cheng; Huang, Jie
Subject: Re: Job aborted due to stage failure:
java.lang.StringIndexOutOfBoundsException: String index out of range: 18
Ricky,
You may need
Ricky,
You may need to use map instead of flatMap in your case
*val rowRDD=sc.textFile(/user/spark/short_model).map(_.split(\\t)).map(p
= Row(...))*
Thanks!
-Terry
On Fri, Aug 28, 2015 at 5:08 PM, our...@cnsuning.com our...@cnsuning.com
wrote:
hi all,
when using spark sql ,A problem
)
at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
*From:* Terry Hole hujie.ea...@gmail.com
*Date:* 2015-08-28 17:22
*To:* our...@cnsuning.com
*CC:* user user@spark.apache.org; hao.cheng hao.ch...@intel.com; Huang,
Jie jie.hu...@intel.com
*Subject:* Re: Job aborted due to stage failure
