the sql logic in the program is very much complex , so do not describe the detailed codes here .
On Monday, July 18, 2016 6:04 PM, Zhiliang Zhu <zchl.j...@yahoo.com.INVALID> wrote: Hi All, Here we have one application, it needs to extract different columns from 6 hive tables, and then does some easy calculation, there is around 100,000 number of rows in each table,finally need to output another table or file (with format of consistent columns) . However, after lots of days trying, the spark hive job is unthinkably slow - sometimes almost frozen. There is 5 nodes for spark cluster. Could anyone offer some help, some idea or clue is also good. Thanks in advance~ Zhiliang