ow-to-work-with-a-joined-rdd-in-pyspark-tp25510p25519.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-ma
is needed to understand what's going on.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-work-with-a-joined-rdd-in-pyspark-tp25510p25511.html
Sent from the Apache Spark User List mailing list archive at
', 100)), (u'PostModern_Cooking',
(u'DEF', 597))]
I would like to sum views per show for channel = "ABC"
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-work-with-a-joined-rdd-in-pyspark-tp25510p25512.html
Sent from the Apache Spark User Li
t;ABC" ).map( (_._1,
_._2._2)
.reduceByKey( (a,b) => a + b )
This should give you an RDD of one record per show and the summed view count
but only for shows on ABC right?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-work-with-a-joined-r
to do the same :(
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-work-with-a-joined-rdd-in-pyspark-tp25510p25516.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
Can't you just access it by element, like with [0] and [1] ?
http://www.tutorialspoint.com/python/python_tuples.htm
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-work-with-a-joined-rdd-in-pyspark-tp25510p25517.html
Sent from the Apache Spark
.n3.nabble.com/Joined-RDD-tp18820p18829.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h
action on C (let say collect), action is served
without
reading any data from the disk.
Since no data is cached in spark how is action on C is served without
reading data from disk.
Thanks
--Ajay
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Joined
this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Joined-RDD-tp18820p18829.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr
.
Since no data is cached in spark how is action on C is served without
reading data from disk.
Thanks
--Ajay
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Joined-RDD-tp18820.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
(let say collect), action is served without
reading any data from the disk.
Since no data is cached in spark how is action on C is served without
reading data from disk.
Thanks
--Ajay
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Joined-RDD-tp18820.html
11 matches
Mail list logo