Thank you for the quick reply! This works fine.

Kostas


On Wed, Aug 27, 2014 at 7:34 PM, Siddharth Seth <[email protected]> wrote:

> Kostas,
> What's happening in this case is that the fetcher ends up trying to use
> the HttpFetch (since optimize local fetch is not enabled on the edge).
> There's several options to fix this.
> 1) Use setFromConfiguration(tezConf) when creating the edge
> 2)
> Use 
> .setAdditionalConfiguration(TezRuntimeConfiguration.TEZ_RUNTIME_OPTIMIZE_LOCAL_FETCH,
> "true") when creating the edge
> 3) Setup a tez-site.xml in your classpath, which has the required set of
> properties configured (local fetch, fs.defaultFS) etc.
>
> The third option may be the one which can be used to fix TEZ-1348.
>
>
> On Wed, Aug 27, 2014 at 6:58 AM, Kostas Tzoumas <[email protected]>
> wrote:
>
>> Hi folks,
>>
>> I am new to Tez. I am trying to execute a simple application using "local
>> mode". I wrote a simple job with two vertices and one output. Stage1Vertex
>> generates one k-v pair and sends it to Stage2Vertex, which prints it to a
>> file.
>>
>> Currently, the job blocks at ShuffleManager.getNextInput(). I have
>> verified that a file is written out by Stage1Vertex in the Tez staging
>> directory with the correct value.
>>
>> Code is here:
>> https://github.com/ktzoumas/tez/blob/simple_tez_app/tez-simple-app/src/main/java/org/apache/tez/simpleapp/SimpleLocalJob.java
>>
>> Any ideas on what I am doing wrong?
>>
>> Kostas
>>
>
>

Reply via email to