Josh Wills created CRUNCH-379:
---------------------------------
Summary: Unions of PTable and PCollection<Pair> fail in
crunch-spark
Key: CRUNCH-379
URL: https://issues.apache.org/jira/browse/CRUNCH-379
Project: Crunch
Issue Type: Bug
Affects Versions: 0.8.2, 0.9.0
Reporter: Josh Wills
Fix For: 0.10.0, 0.8.3
Right now, unioning a PTable<K, V> and a PCollection<Pair<K, V>> in
crunch-spark will fail due to a ClassCastException-- one parent PCollection
will return a JavaRDD, while the other will return a JavaPairRDD, and we'll
only be expecting one type to be returned. This unioning works correctly in the
MR impl, so we should add a fix for it to work correctly in crunch-spark as
well.
--
This message was sent by Atlassian JIRA
(v6.2#6252)