Is this the sort of problem spark can accommodate?
I need to compare 10,000 matrices with each other (10^10 comparison). The
matrices are 100x10 (10^7 int values).
I have 10 machines with 2 to 8 cores (8-32 "processors").
All machines have to
- contribute to matrices generation (a simulati
String query = "select s.name, count(s.name) as tally from sample s group by
s.name order by tally";
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/group-by-order-by-fails-tp21815p21854.html
Sent from the Apache Spark User List mailing list archive at Nabb