Hey Hussain, I note that you're directly editing your workflow XML app file rather than relying on a job.properties for a dynamic change for each run. After changing the mapper # value, did you also ensure to update the HDFS copy of your file, so that Oozie picks up the changes when it launches it? Oozie reads WFs from HDFS, not local file system, being the reason why I ask this.
On Tue, Jul 17, 2012 at 9:10 PM, hussain k <[email protected]> wrote: > Hello, > > I am trying to run Sqoop import job from Oozie and I find some > strange behavior while trying to have more than 1 mapper run Sqoop job. > As long as i use -m 1 in the sqoop import command it works but when i > specify -m 100 or some other number it just still run 1 mapper only. > > Is there some additional parameter which i need to specify for running > multiple mapper for Sqoop import job from Oozie? > Here is my workflow.xml file below > > <workflow-app xmlns="uri:oozie:workflow:0.2" name="sqoop-wf"> > <start to="sqoop-node-1"/> > > <action name="sqoop-node-1"> > <sqoop xmlns="uri:oozie:sqoop-action:0.2"> > <job-tracker>${jobTracker}</job-tracker> > <name-node>${nameNode}</name-node> > <configuration> > <property> > <name>mapred.job.queue.name</name> > <value>${queueName}</value> > </property> > </configuration> > <command>import -D > sqoop.teradata.import.use.temporary.table=false --driver > com.teradata.jdbc.TeraDriver --connect jdbc:teradata:// > company.com/DATABASE=xyz --username abc --password xyz --table TT > -target-dir /data/tables/TT/ --verbose --fields-terminated-by \t --split-by > 'Loyalty_Member_Id' --num-mappers 365</command> > </sqoop> > <ok to="end"/> > <error to="fail"/> > </action> > </action> > <kill name="fail"> > <message>Sqoop failed, error > message[${wf:errorMessage(wf:lastErrorNode())}]</message> > </kill> > <end name="end"/> > </workflow-app> > > Note: When i try to run the same command from the command line instead of > running it from Oozie it kicks of proper number of mappers. > > Any help would be appreciated. > > > Thanks > Hussain K > -- Harsh J
