Hi, San

You need to provide more information to diagnose this problem, like :

1. What kind of SQL did you execute?
2. If there are some |group| operation in this SQL, could you do some
   statistic about how many unique group keys in this case?

On 1/26/15 17:01, luohui20...@sina.com wrote:

Hi there,

When running a sql query, i found abnormal time cost of tasks like the attached pic. it runs fast in the first few tasks, but extremely slow in later tasks, which speed 100X more time than early ones.However,they are dealing with same size data at 128mb....

       standalone & pseudo distributed cluster
       executor memory:40g

       driver momory:5g

Any advices will be appreciated.

--------------------------------

Thanks&Best regards!
罗辉 San.Luo


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Reply via email to