[
https://issues.apache.org/jira/browse/FALCON-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sowmya Ramesh updated FALCON-1420:
----------------------------------
Description:
FALCON-1091 changed value of property
WorkflowExecutionArgs.OUTPUT_FEED_NAMES.getName() "NONE" to "IGNORE" in
ProcessExecutionCoordinatorBuilder.initializeOutputPaths which has introduced
the bug. For a process if there are no output feed MetadataMappingService
should not go ahead to add output feed instance.
Message:
2015-08-28 23:43:48,798 INFO - [ActiveMQ Session Task:] ~ Adding lineage for
context
WorkflowExecutionContext{{brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory,
operation=GENERATE, contextType=POST_PROCESSING,
logDir=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00//,
falconInputFeeds=NONE, cluster=primaryCluster, brokerTTL=4320,
entityType=PROCESS,
workflowEngineUrl=http://sandbox.hortonworks.com:11000/oozie/,
brokerUrl=tcp://sandbox.hortonworks.com:61616, entityName=replication-monthly,
userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory,
subflowId=0000033-150727232450793-oozie-oozi-W@user-action,
falconInPaths=IGNORE, userJMSNotificationEnabled=true,
timeStamp=2015-08-28-23-39, feedInstancePaths=IGNORE, userWorkflowVersion=1.0,
workflowUser=ambari-qa, workflowId=0000033-150727232450793-oozie-oozi-W,
userBrokerUrl=tcp://sandbox.hortonworks.com:61616?daemon=true,
status=SUCCEEDED,
contextFile=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00/replication-monthly-wf-post-exec-context.json,
userWorkflowName=hdfs-dr-workflow, nominalTime=2015-08-28-23-00,
feedNames=IGNORE, runId=0, userWorkflowEngine=oozie}}
(MetadataMappingService:261)
Exception:
{noformat}
2015-08-28 23:43:49,607 ERROR - [ActiveMQ Session Task:] ~ Error in listener
org.apache.falcon.metadata.MetadataMappingService
(WorkflowJobEndNotificationService:104)
org.apache.falcon.FalconException: java.lang.RuntimeException:
java.lang.NullPointerException
at
org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:274)
at
org.apache.falcon.workflow.WorkflowJobEndNotificationService.notifySuccess(WorkflowJobEndNotificationService.java:101)
at
org.apache.falcon.messaging.JMSMessageConsumer.onSuccess(JMSMessageConsumer.java:138)
at
org.apache.falcon.messaging.JMSMessageConsumer.onMessage(JMSMessageConsumer.java:110)
at
org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1229)
at
org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:134)
at
org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:205)
at
org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
at
org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
at
com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
at
com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
at
com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
at
org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:263)
... 11 more
Caused by: java.lang.NullPointerException
at org.apache.falcon.entity.FeedHelper.getCluster(FeedHelper.java:80)
at
org.apache.falcon.entity.FeedHelper.getStorageType(FeedHelper.java:235)
at
org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:280)
at
org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addFeedInstance(InstanceRelationshipGraphBuilder.java:245)
at
org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addOutputFeedInstances(InstanceRelationshipGraphBuilder.java:151)
at
org.apache.falcon.metadata.MetadataMappingService.onProcessInstanceExecuted(MetadataMappingService.java:304)
at
org.apache.falcon.metadata.MetadataMappingService.onSuccessfulExecution(MetadataMappingService.java:282)
at
org.apache.falcon.metadata.MetadataMappingService.access$100(MetadataMappingService.java:53)
at
org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:267)
at
org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:264)
at
com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
... 14 more
{noformat}
was:
FALCON-1091 changed value of property
WorkflowExecutionArgs.OUTPUT_FEED_NAMES.getName() "NONE" to "IGNORE" in
ProcessExecutionCoordinatorBuilder.initializeOutputPaths which has introduced
the bug. For a process if there are no output feed MetadataMappingService
should not go ahead to add output feed instance.
{noformat}
2015-08-28 23:43:48,798 INFO - [ActiveMQ Session Task:] ~ Adding lineage for
context
WorkflowExecutionContext{{brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory,
operation=GENERATE, contextType=POST_PROCESSING,
logDir=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00//,
falconInputFeeds=NONE, cluster=primaryCluster, brokerTTL=4320,
entityType=PROCESS,
workflowEngineUrl=http://sandbox.hortonworks.com:11000/oozie/,
brokerUrl=tcp://sandbox.hortonworks.com:61616, entityName=replication-monthly,
userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory,
subflowId=0000033-150727232450793-oozie-oozi-W@user-action,
falconInPaths=IGNORE, userJMSNotificationEnabled=true,
timeStamp=2015-08-28-23-39, feedInstancePaths=IGNORE, userWorkflowVersion=1.0,
workflowUser=ambari-qa, workflowId=0000033-150727232450793-oozie-oozi-W,
userBrokerUrl=tcp://sandbox.hortonworks.com:61616?daemon=true,
status=SUCCEEDED,
contextFile=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00/replication-monthly-wf-post-exec-context.json,
userWorkflowName=hdfs-dr-workflow, nominalTime=2015-08-28-23-00,
feedNames=IGNORE, runId=0, userWorkflowEngine=oozie}}
(MetadataMappingService:261)
{noformat}
Exception:
{noformat}
2015-08-28 23:43:49,607 ERROR - [ActiveMQ Session Task:] ~ Error in listener
org.apache.falcon.metadata.MetadataMappingService
(WorkflowJobEndNotificationService:104)
org.apache.falcon.FalconException: java.lang.RuntimeException:
java.lang.NullPointerException
at
org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:274)
at
org.apache.falcon.workflow.WorkflowJobEndNotificationService.notifySuccess(WorkflowJobEndNotificationService.java:101)
at
org.apache.falcon.messaging.JMSMessageConsumer.onSuccess(JMSMessageConsumer.java:138)
at
org.apache.falcon.messaging.JMSMessageConsumer.onMessage(JMSMessageConsumer.java:110)
at
org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1229)
at
org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:134)
at
org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:205)
at
org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
at
org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
at
com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
at
com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
at
com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
at
org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:263)
... 11 more
Caused by: java.lang.NullPointerException
at org.apache.falcon.entity.FeedHelper.getCluster(FeedHelper.java:80)
at
org.apache.falcon.entity.FeedHelper.getStorageType(FeedHelper.java:235)
at
org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:280)
at
org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addFeedInstance(InstanceRelationshipGraphBuilder.java:245)
at
org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addOutputFeedInstances(InstanceRelationshipGraphBuilder.java:151)
at
org.apache.falcon.metadata.MetadataMappingService.onProcessInstanceExecuted(MetadataMappingService.java:304)
at
org.apache.falcon.metadata.MetadataMappingService.onSuccessfulExecution(MetadataMappingService.java:282)
at
org.apache.falcon.metadata.MetadataMappingService.access$100(MetadataMappingService.java:53)
at
org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:267)
at
org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:264)
at
com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
... 14 more
{noformat}
> NPE in MetadataMappingService when adding process instance executed
> -------------------------------------------------------------------
>
> Key: FALCON-1420
> URL: https://issues.apache.org/jira/browse/FALCON-1420
> Project: Falcon
> Issue Type: Bug
> Affects Versions: 0.7
> Reporter: Sowmya Ramesh
>
> FALCON-1091 changed value of property
> WorkflowExecutionArgs.OUTPUT_FEED_NAMES.getName() "NONE" to "IGNORE" in
> ProcessExecutionCoordinatorBuilder.initializeOutputPaths which has introduced
> the bug. For a process if there are no output feed MetadataMappingService
> should not go ahead to add output feed instance.
> Message:
> 2015-08-28 23:43:48,798 INFO - [ActiveMQ Session Task:] ~ Adding lineage for
> context
> WorkflowExecutionContext{{brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory,
> operation=GENERATE, contextType=POST_PROCESSING,
> logDir=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00//,
> falconInputFeeds=NONE, cluster=primaryCluster, brokerTTL=4320,
> entityType=PROCESS,
> workflowEngineUrl=http://sandbox.hortonworks.com:11000/oozie/,
> brokerUrl=tcp://sandbox.hortonworks.com:61616,
> entityName=replication-monthly,
> userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory,
> subflowId=0000033-150727232450793-oozie-oozi-W@user-action,
> falconInPaths=IGNORE, userJMSNotificationEnabled=true,
> timeStamp=2015-08-28-23-39, feedInstancePaths=IGNORE,
> userWorkflowVersion=1.0, workflowUser=ambari-qa,
> workflowId=0000033-150727232450793-oozie-oozi-W,
> userBrokerUrl=tcp://sandbox.hortonworks.com:61616?daemon=true,
> status=SUCCEEDED,
> contextFile=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00/replication-monthly-wf-post-exec-context.json,
> userWorkflowName=hdfs-dr-workflow, nominalTime=2015-08-28-23-00,
> feedNames=IGNORE, runId=0, userWorkflowEngine=oozie}}
> (MetadataMappingService:261)
> Exception:
> {noformat}
> 2015-08-28 23:43:49,607 ERROR - [ActiveMQ Session Task:] ~ Error in listener
> org.apache.falcon.metadata.MetadataMappingService
> (WorkflowJobEndNotificationService:104)
> org.apache.falcon.FalconException: java.lang.RuntimeException:
> java.lang.NullPointerException
> at
> org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:274)
> at
> org.apache.falcon.workflow.WorkflowJobEndNotificationService.notifySuccess(WorkflowJobEndNotificationService.java:101)
> at
> org.apache.falcon.messaging.JMSMessageConsumer.onSuccess(JMSMessageConsumer.java:138)
> at
> org.apache.falcon.messaging.JMSMessageConsumer.onMessage(JMSMessageConsumer.java:110)
> at
> org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1229)
> at
> org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:134)
> at
> org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:205)
> at
> org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
> at
> org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.RuntimeException: java.lang.NullPointerException
> at
> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
> at
> com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
> at
> com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
> at
> org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:263)
> ... 11 more
> Caused by: java.lang.NullPointerException
> at org.apache.falcon.entity.FeedHelper.getCluster(FeedHelper.java:80)
> at
> org.apache.falcon.entity.FeedHelper.getStorageType(FeedHelper.java:235)
> at
> org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:280)
> at
> org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addFeedInstance(InstanceRelationshipGraphBuilder.java:245)
> at
> org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addOutputFeedInstances(InstanceRelationshipGraphBuilder.java:151)
> at
> org.apache.falcon.metadata.MetadataMappingService.onProcessInstanceExecuted(MetadataMappingService.java:304)
> at
> org.apache.falcon.metadata.MetadataMappingService.onSuccessfulExecution(MetadataMappingService.java:282)
> at
> org.apache.falcon.metadata.MetadataMappingService.access$100(MetadataMappingService.java:53)
> at
> org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:267)
> at
> org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:264)
> at
> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
> ... 14 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
