Re: Cluster entity vertex must exist

Wed, 27 Jul 2016 01:47:16 -0700 

Great! It helped!

That is the impact I hoped from userlist :)

Margus (margusja) Roo
http://margus.roo.ee
skype: margusja
+372 51 48 780

On 27/07/16 11:27, Pallavi Rao wrote:

Margus,
Looks like the problem you are facing is similar to what is reported in FALCON-1955 <https://issues.apache.org/jira/browse/FALCON-1955>. And, the workaround is similar too. The problem goes away on restart, but, comes back later. Guess, will need to dig deeper for a fix.
If you are NOT using any of the metadata APIs of Falcon (/falcon metadata/ commands of the CLI), you can disable the service in startup.properties temporarily till we have a fix for FALCON-1955 <https://issues.apache.org/jira/browse/FALCON-1955>, so that your entity submission is not blocked on this.
On Wed, Jul 27, 2016 at 1:35 PM, Margus Roo <[email protected] <mailto:[email protected]>> wrote: 

    As I understand thous lines will define db in startup.properties file

    *.falcon.graph.storage.backend=berkeleyje
    *.falcon.graph.storage.directory=/tmp/hadoop/falcon/data/lineage/graphdb

    in directory /tmp/hadoop/falcon/data/lineage/graphdb I have files

    -rw-r--r-- 1 falcon hadoop 65K Jul 27 11:01 00000000.jdb
    -rw-r--r-- 1 falcon hadoop   0 Jul 26 14:25 je.info.0
    -rw-r--r-- 1 falcon hadoop   0 Jul 26 14:25 je.info.0.lck
    -rw-r--r-- 1 falcon hadoop   0 Jul 26 14:25 je.lck

    Is it possible to connect using some utilit and check what is
    wrong inside? I can delete /tmp/hadoop/falcon/data/lineage/graphdb
    and restart falcon but after some time the problem is back.

    I can create a new Cluster in example Cluster3 and it works
    without problems. But I have loads of feeds and processes are
    working with Cluster2 (the problematic).

    Is there any workaround to fix Cluster2 ?


    Margus (margusja) Roo
    http://margus.roo.ee
    skype: margusja
    +372 51 48 780

    On 26/07/16 16:34, Ajay Yadav wrote:

    Is it possible for you to try the latest stable release 0.9?

    Around 0.6/0.6.1 graph db (used by Apache Falcon to store
    instances) of Apache Falcon had several issues so I will strongly
    recommend upgrading.



    On Tue, 26 Jul 2016 at 19:00 Margus Roo <[email protected]
    <mailto:[email protected]>> wrote:

        Hi

        I am using falcon 0.6.1

        When I am trying to submit process or feed I am getting error:

        Cluster entity vertex must exist

        In case I just restarted falcon server then I can submit
        process or feed:

        [margusja@hadoopnn2 ~]$ falcon entity -submit -type process
        -file web3.xml
        falcon/default/Submit successful (process) sign--web3

        But after I deleted process:

        [margusja@hadoopnn2 ~]$ falcon entity -delete -type process
        -name sign--web3
        falcon/default/sign--web3(process) removed successfully
        (KILLED in ENGINE)

        And I try to submit again then I am getting:

        [margusja@hadoopnn2 ~]$ falcon entity -submit -type process
        -file web3.xml
        ERROR: Bad
        
Request;default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
        java.lang.RuntimeException: java.lang.IllegalStateException:
        Cluster entity vertex must exist: Cluster2

        and in log:

        2016-07-26 16:28:26,873 INFO  - [63390@qtp-1536471117-0 -
        aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest
        RemoteUser is null (Servlets:47)
        2016-07-26 16:28:26,873 INFO  - [63390@qtp-1536471117-0 -
        aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest
        user.name <http://user.name> param value is margusja
        (Servlets:53)
        2016-07-26 16:28:27,010 INFO  - [2138332724@qtp-1536471117-3
        - b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest
        RemoteUser is null (Servlets:47)
        2016-07-26 16:28:27,011 INFO  - [2138332724@qtp-1536471117-3
        - b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest
        user.name <http://user.name> param value is margusja
        (Servlets:53)
        2016-07-26 16:28:27,358 INFO  - [2138332724@qtp-1536471117-3
        - 1e1fa678-4426-4398-b942-348c5742cc68:] ~ HttpServletRequest
        RemoteUser is falcon (Servlets:47)
        2016-07-26 16:28:27,359 INFO  - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Logging in falcon (CurrentUser:65)
        2016-07-26 16:28:27,359 INFO  - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Request from authenticated user: falcon,
        URL=/api/entities/submit/process, doAs user: null
        (FalconAuthenticationFilter:185)
        2016-07-26 16:28:27,362 INFO  - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Parsed Entity: sign--web3 (EntityParser:95)
        2016-07-26 16:28:27,364 INFO  - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Parsed Entity: sign--web3 (EntityParser:95)
        2016-07-26 16:28:27,381 INFO  - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Creating FS for the login user falcon, impersonation not
        required (HadoopClientFactory:191)
        2016-07-26 16:28:27,406 INFO  - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Persisted configuration PROCESS/sign--web3
        (ConfigurationStore:371)
        2016-07-26 16:28:27,407 INFO  - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Adding lineage for entity: sign--web3, type: PROCESS
        (MetadataMappingService:209)
        2016-07-26 16:28:27,409 INFO  - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Adding process entity: sign--web3
        (EntityRelationshipGraphBuilder:131)
        2016-07-26 16:28:27,465 ERROR - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Illegal State: Cluster entity vertex must exist for
        Cluster2 (EntityRelationshipGraphBuilder:173)
        2016-07-26 16:28:27,476 INFO  - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Adding process entity: sign--web3
        (EntityRelationshipGraphBuilder:131)
        2016-07-26 16:28:27,497 ERROR - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Illegal State: Cluster entity vertex must exist for
        Cluster2 (EntityRelationshipGraphBuilder:173)
        2016-07-26 16:28:27,518 INFO  - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Adding process entity: sign--web3
        (EntityRelationshipGraphBuilder:131)
        2016-07-26 16:28:27,536 ERROR - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Illegal State: Cluster entity vertex must exist for
        Cluster2 (EntityRelationshipGraphBuilder:173)
        2016-07-26 16:28:27,537 ERROR - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Unable to persist entity object (AbstractEntityManager:198)
        org.apache.falcon.FalconException:
        java.lang.RuntimeException: java.lang.IllegalStateException:
        Cluster entity vertex must exist: Cluster2
                at
        
org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:223)
                at
        
org.apache.falcon.entity.store.ConfigurationStore.onAdd(ConfigurationStore.java:259)
                at
        
org.apache.falcon.entity.store.ConfigurationStore.publish(ConfigurationStore.java:219)
                at
        
org.apache.falcon.resource.AbstractEntityManager.submitInternal(AbstractEntityManager.java:414)
                at
        
org.apache.falcon.resource.AbstractEntityManager.submit(AbstractEntityManager.java:195)
                at
        
org.apache.falcon.resource.ConfigSyncService.submit(ConfigSyncService.java:50)
                at
        sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
                at
        
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
                at
        
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
                at java.lang.reflect.Method.invoke(Method.java:497)
                at
        org.apache.falcon.resource.channel.IPCChannel.invoke(IPCChannel.java:49)
                at
        
org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$1.doExecute(SchedulableEntityManagerProxy.java:139)
                at
        
org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:577)
                at
        
org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit_aroundBody0(SchedulableEntityManagerProxy.java:141)
                at
        
org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure1.run(SchedulableEntityManagerProxy.java:1)
                at
        
org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
                at
        
org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
                at
        
org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(SchedulableEntityManagerProxy.java:119)
                at
        sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
                at
        
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
                at
        
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
                at java.lang.reflect.Method.invoke(Method.java:497)
                at
        
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
                at
        
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
                at
        
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
                at
        
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
                at
        
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)

        ...

        Caused by: java.lang.RuntimeException:
        java.lang.IllegalStateException: Cluster entity vertex must
        exist: Cluster2
                at
        
com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
                at
        
com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
                at
        
com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
                at
        
org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:211)
                ... 64 more
        Caused by: java.lang.IllegalStateException: Cluster entity
        vertex must exist: Cluster2
                at
        
org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addRelationToCluster(EntityRelationshipGraphBuilder.java:174)
                at
        
org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addProcessEntity(EntityRelationshipGraphBuilder.java:140)
                at
        
org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addEntity(EntityRelationshipGraphBuilder.java:62)
                at
        
org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:215)
                at
        
org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:212)
                at
        
com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
                ... 67 more
        2016-07-26 16:28:27,541 ERROR - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Action failed: Bad Request
        Error: java.lang.RuntimeException:
        java.lang.IllegalStateException: Cluster entity vertex must
        exist: Cluster2 (FalconWebException:83)
        2016-07-26 16:28:27,542 ERROR - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ Action failed: Bad Request
        Error:
        
default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
        java.lang.RuntimeException: java.lang.IllegalStateException:
        Cluster entity vertex must exist: Cluster2
         (FalconWebException:83)
        2016-07-26 16:28:27,542 INFO  - [2138332724@qtp-1536471117-3
        -
        
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
        ~ {Action:submit, Dimensions:{colo=NULL, entityType=process},
        Status: FAILED, Time-taken:182944401 ns} (METRIC:38)
        ~


        Any hints?
-- Margus (margusja) Roo 
        http://margus.roo.ee
        skype: margusja
        +372 51 48 780





_____________________________________________________________
The information contained in this communication is intended solely for the use of the individual or entity to whom it is addressed and others authorized to receive it. It may contain confidential or legally privileged information. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by responding to this email and then delete it from your system. The firm is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt.

Reply via email to