Re: reduceByKey as Action or Transformation

2016-04-25 Thread Weiping Qu
monstrates what you observed ? Thansk On Mon, Apr 25, 2016 at 8:38 AM, Weiping Qu <q...@informatik.uni-kl.de <mailto:q...@informatik.uni-kl.de>> wrote: Thanks. I read that from the specification. I thought the way people distinguish actions and transformations depe

Re: reduceByKey as Action or Transformation

2016-04-25 Thread Weiping Qu
_ Pooja Chadha Senior Architect THE BOSTON CONSULTING GROUP Mobile +1 617 794 3862 _ -Original Message- From: Weiping Qu [mailto:q...@informatik.uni-kl.de] Sent: Monday, April 25, 2016 11:05 AM

reduceByKey as Action or Transformation

2016-04-25 Thread Weiping Qu
Hi, I'd like just to verify that whether reduceByKey is transformation or actions. As written in RDD papers, spark flow will not be triggered only if actions are reached. I tried and saw that the my flow will be executed once there is a reduceByKey while it is categorized into transformations