Re: the dependence length of RDD, can its size be greater than 1 pleaae?

2017-06-15 Thread ??????????
--- From: "Sean Owen"<so...@cloudera.com> Date: 2017/6/15 16:13:11 To: "user"<user@spark.apache.org>;"dev"<d...@spark.apache.org>;"??????"<1427357...@qq.com>; Subject: Re: the dependence length of RDD, can its size be greater

Re: the dependence length of RDD, can its size be greater than 1 pleaae?

2017-06-15 Thread Sean Owen
Yes. Imagine an RDD that results from a union of other RDDs. On Thu, Jun 15, 2017, 09:11 萝卜丝炒饭 <1427357...@qq.com> wrote: > Hi all, > > The RDD code keeps a member as below: > dependencies_ : seq[Dependency[_]] > > It is a seq, that means it can keep more than one dependency. > > I have an issue

Re: the dependence length of RDD, can its size be greater than 1 pleaae?

2017-06-15 Thread Reynold Xin
A join? On Thu, Jun 15, 2017 at 1:11 AM 萝卜丝炒饭 <1427357...@qq.com> wrote: > Hi all, > > The RDD code keeps a member as below: > dependencies_ : seq[Dependency[_]] > > It is a seq, that means it can keep more than one dependency. > > I have an issue about this. > Is it possible that its size is

the dependence length of RDD, can its size be greater than 1 pleaae?

2017-06-15 Thread ??????????
Hi all, The RDD code keeps a member as below: dependencies_ : seq[Dependency[_]] It is a seq, that means it can keep more than one dependency. I have an issue about this. Is it possible that its size is greater than one please? If yes, how to produce it please? Would you like show me some