[ https://issues.apache.org/jira/browse/NIFI-2415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Haimo Liu updated NIFI-2415: ---------------------------- Description: running NIFI in a clustered mode, 7/27 build Both GenerateTableFetch and QueryDatabaseTable cannot store state in a clustered mode (checked ListFile, can store state successfully) see attached screenshot, trace below: 2016-07-27 23:25:00,014 INFO [ProcessThread(sid:1 cport:-1):] o.a.z.server.PrepRequestProcessor Got user-level KeeperException when processing sessionid:0x2562f7875130009 type:create cxid:0xe4d zxid:0x700003733 txntype:-1 reqpath:n/a Error Path:/nifi/components/2f810bb3-0156-1000-0000-000016128f8b Error:KeeperErrorCode = InvalidACL for /nifi/components/2f810bb3-0156-1000-0000-000016128f8b 2016-07-27 23:25:00,017 WARN [Framework Task Thread Thread-1] o.a.n.c.s.m.StandardStateManagerProvider Component with ID {} was removed from NiFi instance but failed to clear clustered state for the component java.io.IOException: Failed to set cluster-wide state in ZooKeeper for component with ID 2f810bb3-0156-1000-0000-000016128f8b at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:343) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:283) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:228) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.clear(ZooKeeperStateProvider.java:453) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] at org.apache.nifi.controller.state.StandardStateManager.clear(StandardStateManager.java:85) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] at org.apache.nifi.controller.state.manager.StandardStateManagerProvider.onComponentRemoved(StandardStateManagerProvider.java:276) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] at org.apache.nifi.groups.StandardProcessGroup$1.run(StandardProcessGroup.java:730) [nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_77] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_77] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_77] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.8.0_77] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_77] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_77] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_77] Caused by: org.apache.zookeeper.KeeperException$InvalidACLException: KeeperErrorCode = InvalidACL for /nifi/components/2f810bb3-0156-1000-0000-000016128f8b at org.apache.zookeeper.KeeperException.create(KeeperException.java:121) ~[zookeeper-3.4.6.jar:3.4.6-1569965] at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.6.jar:3.4.6-1569965] at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) ~[zookeeper-3.4.6.jar:3.4.6-1569965] at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.createNode(ZooKeeperStateProvider.java:360) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:321) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] ... 13 common frames omitted was: running NIFI in a clustered mode, 7/27 build Both GenerateTableFetch and QueryDatabaseTable cannot store state in a clustered mode (checked ListFile, can store state successfully) see attached screenshot > GenerateTableFetch/QueryDatabaseTable cannot store state > -------------------------------------------------------- > > Key: NIFI-2415 > URL: https://issues.apache.org/jira/browse/NIFI-2415 > Project: Apache NiFi > Issue Type: Bug > Components: Extensions > Affects Versions: 1.0.0 > Reporter: Haimo Liu > Assignee: Matt Burgess > Priority: Critical > Fix For: 1.0.0 > > Attachments: Screen Shot 2016-07-27 at 11.10.45 PM.png > > > running NIFI in a clustered mode, 7/27 build > Both GenerateTableFetch and QueryDatabaseTable cannot store state in a > clustered mode (checked ListFile, can store state successfully) > see attached screenshot, trace below: > 2016-07-27 23:25:00,014 INFO [ProcessThread(sid:1 cport:-1):] > o.a.z.server.PrepRequestProcessor Got user-level KeeperException when > processing sessionid:0x2562f7875130009 type:create cxid:0xe4d > zxid:0x700003733 txntype:-1 reqpath:n/a Error > Path:/nifi/components/2f810bb3-0156-1000-0000-000016128f8b > Error:KeeperErrorCode = InvalidACL for > /nifi/components/2f810bb3-0156-1000-0000-000016128f8b > 2016-07-27 23:25:00,017 WARN [Framework Task Thread Thread-1] > o.a.n.c.s.m.StandardStateManagerProvider Component with ID {} was removed > from NiFi instance but failed to clear clustered state for the component > java.io.IOException: Failed to set cluster-wide state in ZooKeeper for > component with ID 2f810bb3-0156-1000-0000-000016128f8b > at > org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:343) > ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] > at > org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:283) > ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] > at > org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:228) > ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] > at > org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.clear(ZooKeeperStateProvider.java:453) > ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] > at > org.apache.nifi.controller.state.StandardStateManager.clear(StandardStateManager.java:85) > ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] > at > org.apache.nifi.controller.state.manager.StandardStateManagerProvider.onComponentRemoved(StandardStateManagerProvider.java:276) > ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] > at > org.apache.nifi.groups.StandardProcessGroup$1.run(StandardProcessGroup.java:730) > [nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > [na:1.8.0_77] > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > [na:1.8.0_77] > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) > [na:1.8.0_77] > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > [na:1.8.0_77] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > [na:1.8.0_77] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > [na:1.8.0_77] > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_77] > Caused by: org.apache.zookeeper.KeeperException$InvalidACLException: > KeeperErrorCode = InvalidACL for > /nifi/components/2f810bb3-0156-1000-0000-000016128f8b > at > org.apache.zookeeper.KeeperException.create(KeeperException.java:121) > ~[zookeeper-3.4.6.jar:3.4.6-1569965] > at > org.apache.zookeeper.KeeperException.create(KeeperException.java:51) > ~[zookeeper-3.4.6.jar:3.4.6-1569965] > at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) > ~[zookeeper-3.4.6.jar:3.4.6-1569965] > at > org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.createNode(ZooKeeperStateProvider.java:360) > ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] > at > org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:321) > ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT] > ... 13 common frames omitted -- This message was sent by Atlassian JIRA (v6.3.4#6332)