Josh Wills created CRUNCH-379:
---------------------------------

             Summary: Unions of PTable and PCollection<Pair> fail in 
crunch-spark
                 Key: CRUNCH-379
                 URL: https://issues.apache.org/jira/browse/CRUNCH-379
             Project: Crunch
          Issue Type: Bug
    Affects Versions: 0.8.2, 0.9.0
            Reporter: Josh Wills
             Fix For: 0.10.0, 0.8.3


Right now, unioning a PTable<K, V> and a PCollection<Pair<K, V>> in 
crunch-spark will fail due to a ClassCastException-- one parent PCollection 
will return a JavaRDD, while the other will return a JavaPairRDD, and we'll 
only be expecting one type to be returned. This unioning works correctly in the 
MR impl, so we should add a fix for it to work correctly in crunch-spark as 
well.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to