Hi Guys -
I am getting this error messages "java.lang.RuntimeException:
org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown.
No cluster diagnostics found" for some of the jobs I am running. The
cluster are heavily loaded. I am suspecting this to be some kind of
time-out issue
Have you tried bucketing by the column plus setting orce,create.index and
orc.bloom.filter.columns
CREATE TABLE dummy (
ID INT
, CLUSTERED INT
, SCATTERED INT
, RANDOMISED INT
, RANDOM_STRING VARCHAR(50)
, SMALL_VC VARCHAR(10)
, PADDING VARCHAR(10)
)
*CLUSTERED BY (ID) INT