Why my Spark job is slow and it throws OOM which leads YARN killing executors?

private HiveContext hiveContext; public DataWorker(HiveContext hiveContext,String entity,int date) { this.hiveContext = hiveContext; this.entity = entity; this.date = date; } @Override public Vo

Re: Why my Spark job is slow and it throws OOM which leads YARN killing executors?

ivate int date; private HiveContext hiveContext; public DataWorker(HiveContext hiveContext,String entity,int date) { this.hiveContext = hiveContext; this.entity = entity; this.date = date; }

Re: Why my Spark job is slow and it throws OOM which leads YARN killing executors?

gt; if (dMap.containsKey(key)) { > request = request.replaceAll(key, > dMap.get(key)); > } > } else if (request.contains("ABC IJK")) { > if (dMap.containsKe