RE: Operator ID Overlap

2016-03-09 Thread Ganelin, Ilya
I just realized on second glance that I do have a naming conflict! Thanks! Sent with Good (www.good.com) From: Tushar Gosavi Sent: Thursday, March 10, 2016 12:07:33 AM To: dev@apex.incubator.apache.org Subject: Re: Operator ID Overlap Hi, >From the st

Re: Operator ID Overlap

2016-03-09 Thread Tushar Gosavi
Hi, >From the stack trace it seems that you are adding two or more operator in the DAG using same name (Records_HDHT). Adding multiple operators to logical DAG using same name is not allowed. Can you check if this is the case, else there might be the problem in the platform. - Tushar. On Thu, M

Re: Operator ID Overlap

2016-03-09 Thread Ganelin, Ilya
Additional note: I am extracting operatorId from the context in setup: @Override public void setup(Context.OperatorContext context) { super.setup(context); operatorId = context.getId(); operatorUniquePath = new Path(getOutputFileName() + idDelim + operatorId + ".txt").toSt

Operator ID Overlap

2016-03-09 Thread Ganelin, Ilya
Hi all – I’ve created some helper functions to efficiently create HDFS Output operators (which require common configurations). However, I run into a duplicate operator ID error when attempting to run this, error and code are below: Why would the DAG be assigning a duplicate operator ID? For the