Crunch Gurus,
I’m trying to read an Orc file and get the following error when the directory
containing the file is not present in HDFS.
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.JavaMain],
main() threw exception, java.lang.IllegalStateException: Input source
Orc(hdfs://dir/path/) does not exist!
So I added a try catch for this specific exception,
public class Foo extends Configured implements Tool {
public static void main(String[] args) throws Exception {
ToolRunner.run(new Configuration(), new Foo(), args);
}
@Override
public int run(String[] args) throws Exception {
Configuration crunchConf = getConf();
Pipeline pipeline = new MRPipeline(Foo.class, crunchConf);
PCollection<myRecord> myRecordPCollection =
pipeline.emptyPCollection(Orcs.reflects(myRecord.class));
try{
myRecordPCollection = pipeline.read(myRecordOrcFileSource);
}catch(IllegalStateException e) {
e.printStackTrace();
}
PCollection<myNextRecord> myNextRecordPCollection =
pipeline.read(myNextRecordOrcFileSource);
PipelineResult result = pipeline.done();
System.out.println("--> Pipeline ending.");
return result.succeeded() ? 0 : 1;
}
}
But I’m unable to catch the exception within the run() and continue with the
remaining code. How could I handle this scenario? Any help is appreciated.
Thanks,
Siva
________________________________
***** Please note: The Sender of this email is either a Contractor or Vendor of
Lowe's Companies, Inc. and is not an employee or agent of Lowe's Companies Inc.
*****
NOTICE: All information in and attached to the e-mails below may be
proprietary, confidential, privileged and otherwise protected from improper or
erroneous disclosure. If you are not the sender's intended recipient, you are
not authorized to intercept, read, print, retain, copy, forward, or disseminate
this message. If you have erroneously received this communication, please
notify the sender immediately by phone (704-758-1000) or by e-mail and destroy
all copies of this message electronic, paper, or otherwise.
By transmitting documents via this email: Users, Customers, Suppliers and
Vendors collectively acknowledge and agree the transmittal of information via
email is voluntary, is offered as a convenience, and is not a secured method of
communication; Not to transmit any payment information E.G. credit card, debit
card, checking account, wire transfer information, passwords, or sensitive and
personal information E.G. Driver's license, DOB, social security, or any other
information the user wishes to remain confidential; To transmit only
non-confidential information such as plans, pictures and drawings and to assume
all risk and liability for and indemnify Lowe's from any claims, losses or
damages that may arise from the transmittal of documents or including
non-confidential information in the body of an email transmittal. Thank you.
