RE: Spark Sql behaves strangely with tables with a lot of partitions

2015-08-24 Thread Sereday, Scott
Can you please remove me from this distribution list? (Filling up my inbox too fast) From: Michael Armbrust [mailto:mich...@databricks.com] Sent: Monday, August 24, 2015 2:13 PM To: Philip Weaver philip.wea...@gmail.com Cc: Jerrick Hoang jerrickho...@gmail.com; Raghavendra Pandey

New Spark User - GBM iterations and Spark benchmarks

2015-08-13 Thread Sereday, Scott
I am exploring utilizing Spark as my dataset is becoming more and more difficult to manage and analyze. I'd appreciate if anyone could provide feedback on the following questions for me: * I am especially interested in training large datasets using machine learning algorithms. o