Hi All,

I am trying to get Spark Action to work in oozie.  I am currently using CDH
5.7.2 and Hue 3.9 that is bundled with the CDH version to create a test
workflow.  I create a spark jar that had all it's needed dependencies
compiled in the jar.  All this jar does is read a parquet file from hdfs
and write back to a different directory in hdfs.  When running this
workflow I am getting a 101 error:

>>> Invoking Spark class now >>>


Intercepting System.exit(101)


<<< Invocation of Main class completed <<<


Failing Oozie Launcher, Main class
[org.apache.oozie.action.hadoop.SparkMain], exit code [101]


Oozie Launcher failed, finishing Hadoop job gracefully


Oozie Launcher, uploading action data to HDFS sequence file:
hdfs://nameservice1/user/kpeng/oozie-oozi/0002825-160817212356434-oozie-oozi-W/spark-b023--spark/action-data.seq


Oozie Launcher ends


Any help would be appreciated.


Thanks,


KP

Reply via email to