org.apache.tez.dag.api.SessionNotRunning

2016-04-09 Thread Khaja Hussain
Hi Guys - I am getting this error messages "java.lang.RuntimeException: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. No cluster diagnostics found" for some of the jobs I am running. The cluster are heavily loaded. I am suspecting this to be some kind of time-out issue

Re: ORC file sort order ..

2016-04-09 Thread Mich Talebzadeh
Have you tried bucketing by the column plus setting orce,create.index and orc.bloom.filter.columns CREATE TABLE dummy ( ID INT , CLUSTERED INT , SCATTERED INT , RANDOMISED INT , RANDOM_STRING VARCHAR(50) , SMALL_VC VARCHAR(10) , PADDING VARCHAR(10) ) *CLUSTERED BY (ID) INT