Hi Tim,

The property 'oozie.action.max.output.data' cannot be overridden by user.
So you are hitting this issue while running your python script? Most
probably this is due to a long file path that you are passing. You can
store such file paths in a variable and then pass to your script/pig job
(if applicable)

--
Mona Chitnis




On 7/6/12 6:15 PM, "Tim Chan" <[email protected]> wrote:

>I'm trying to pass some output from one action to another using
>capture-output.
>
>I'm getting this error:
>
>Failing Oozie Launcher, Output data size [50,999] exceeds maximum [2,048]
>
>I believe setting CONF_OOZIE_ACTION_MAX_OUTPUT_DATA to a larger value
>will solve this. How do I set this?
>
>I've tried:
>
><action name="my-shell-action">
>        <shell xmlns="uri:oozie:shell-action:0.1">
>            <job-tracker>${jobTracker}</job-tracker>
>            <name-node>${nameNode}</name-node>
>            <job-xml>job.xml</job-xml>
>            <configuration>
>                <property>
>                    <name>mapred.job.queue.name</name>
>                    <value>${queueName}</value>
>                </property>
>                <property>
>                    <name>oozie.action.max.output.data</name>
>                    <value>100000</value>
>                </property>
>            </configuration>
>
>            <exec>python</exec>
>             ...
>
>
>            <capture-output/>
>        </shell>
>
>        <ok to="process-cross-ref-tsv-and-hdfs-put"/>
>        <error to="fail"/>
>    </action>
>
>I've tried setting it in the job.xml.
>I've tried setting in the coordinator.xml.
>I've also tried setting it in the coordinator.properties.
>
>How do I set a new value for this?

Reply via email to