Re: Could not estimate number of reducers

2014-03-25 Thread Vincent Barat
BytesPerReducer=10 maxReducers=999 totalInputFileSize=-1 Could not estimate number of reducers and no requested or default parallelism set. Defaulting to 1 reducer. Setting Parallelism to 1 I tried to debug; in the source code below, the PlanHelper.getPhysicalOperators always return an empty

Could not estimate number of reducers

2014-03-24 Thread Vincent Barat
Setting up single store job Reduce phase detected, estimating # of required reducers. Using reducer estimator: org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator BytesPerReducer=10 maxReducers=999 totalInputFileSize=-1 Could not estimate number of reducers