Is this the sort of problem spark can accommodate?
I need to compare 10,000 matrices with each other (10^10 comparison). The
matrices are 100x10 (10^7 int values).
I have 10 machines with 2 to 8 cores (8-32 processors).
All machines have to
- contribute to matrices generation (a
String query = select s.name, count(s.name) as tally from sample s group by
s.name order by tally;
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/group-by-order-by-fails-tp21815p21854.html
Sent from the Apache Spark User List mailing list archive at