thank you Suzen, i've had a try to generate 1 billion records within 1.5min. It
is fast.And I will go on to try some other cases.
ThanksBest regards!
San.Luo
- 原始邮件 -
发件人："Suzen, Mehmet" <su...@acm.org>
收件人：luohui20...@sina.com
抄送人：user <user@spark.apache.org>
主题：Re: A tool to generate simulation data
日期：2017年07月28日 01点18分
I suggest RandomRDDs API. It provides nice tools. If you write
wrappers around that might be good.
https://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.mllib.random.RandomRDDs$
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
