RE: PowerIterationClustering Benchmark

2016-12-18 Thread Mostafa Alaa Mohamed
Hi All, I have the same issue with one compressed file .tgz around 3 GB. I increase the nodes without any affect to the performance. Best Regards, Mostafa Alaa Mohamed, Technical Expert Big Data, M: +971506450787 Email: mohamedamost...@etisalat.ae<mailto:mohamedamost...@etisalat.ae>

Unsubscribe

2016-12-14 Thread Mostafa Alaa Mohamed
Unsubscribe Best Regards, Mostafa Alaa Mohamed, Technical Expert Big Data, M: +971506450787 Email: mohamedamost...@etisalat.ae -Original Message- From: balaji9058 [mailto:kssb...@gmail.com] Sent: Wednesday, December 14, 2016 08:32 AM To: user@spark.apache.org Subject: Re: Graphx triplet

Spark Hive Rejection

2016-09-29 Thread Mostafa Alaa Mohamed
we specify the rejection directory? If not avaiable do you recommend to open Jira issue? Best Regards, Mostafa Alaa Mohamed, Technical Expert Big Data, M: +971506450787 Email: mohamedamost...@etisalat.ae<mailto:mohamedamost...@etisalat.ae> The c

DataFrame Rejection Directory

2016-09-27 Thread Mostafa Alaa Mohamed
Hi All, I have dataframe contains some data and I need to insert it into hive table. My questions 1- Where will spark save the rejected rows from the insertion statements? 2- Can spark failed if some rows rejected? 3- How can I specify the rejection directory? Regards,