Hello Anil, Hmm... so the ZK will have the info. Agreed. But what about the statement where it says that any new storage plugin added/updated will be broadcast to all the nodes running drillbit service. I took that statement to mean - the config file will be synchronized across all the nodes running the drillbit service. Did I get it wrong?
--- Mufeed Usman My LinkedIn <http://www.linkedin.com/pub/mufeed-usman/28/254/400> | My Social Cause <http://www.vision2016.org.in/> | My Blogs : LiveJournal <http://mufeed.livejournal.com> On Fri, Jun 27, 2014 at 11:57 AM, AnilKumar B <akumarb2...@gmail.com> wrote: > Hi Murfy, > > Based on my understanding, registered storage plugin info will be stored on > ZK. As below. > > [zk: localhost:2181(CONNECTED) 10] ls /drill/sys.storage_plugins > [hive, cp, dfs, hbase] > [zk: localhost:2181(CONNECTED) 11] get /drill/sys.storage_plugins/hbase > { > "type" : "hbase", > "config" : { > "hbase.zookeeper.quorum" : "localhost", > "hbase.zookeeper.property.clientPort" : "2181" > }, > "enabled" : true > } > cZxid = 0x428 > ctime = Tue Jun 24 13:30:18 IST 2014 > mZxid = 0x450 > mtime = Tue Jun 24 13:31:41 IST 2014 > pZxid = 0x428 > cversion = 0 > dataVersion = 1 > aclVersion = 0 > ephemeralOwner = 0x0 > dataLength = 157 > numChildren = 0 > [zk: localhost:2181(CONNECTED) 12] get /drill/sys.storage_plugins/cp > { > "type" : "file", > "enabled" : true, > "connection" : "classpath:///", > "workspaces" : null, > "formats" : null > } > cZxid = 0x426 > ctime = Tue Jun 24 13:30:18 IST 2014 > mZxid = 0x426 > mtime = Tue Jun 24 13:30:18 IST 2014 > pZxid = 0x426 > cversion = 0 > dataVersion = 0 > aclVersion = 0 > ephemeralOwner = 0x0 > dataLength = 118 > numChildren = 0 > [zk: localhost:2181(CONNECTED) 13] > > Thanks, > B Anil Kumar. > > Thanks & Regards, > B Anil Kumar. > > > On Fri, Jun 27, 2014 at 11:12 AM, mufy <mufeed.us...@gmail.com> wrote: > > > Stated here > > > > > https://cwiki.apache.org/confluence/display/DRILL/Connecting+Apache+Drill+to+Data+Sources > > that, > > > > "When you add or update storage plugin instances on one node, Drill > > broadcasts the information to all of the other Drill nodes so they have > > identical storage plugin instances registered. You do not need to restart > > any of the Drillbits when you add or update a storage plugin instance." > > > > Does that mean if I were to have the following on one node: > > [root@mufeed-drill1 ~]# cat > > > > > /opt/mapr/drill/drill-1.0.0/apache-drill-1.0.0-m2-incubating-SNAPSHOT/conf/storage-plugins.json > > { > > "storage": { > > > > dfs: { > > type: "file", > > connection: "maprfs:///" > > }, > > > > cp: { > > type: "file", > > connection: "classpath:///" > > }, > > > > cp1: { > > type: "file", > > connection: "classpath:///" > > }, > > } > > } > > > > The same content would get replicated to other nodes, on a file content > > level? If yes, I do not see that happening. If not, please clarify. > > > > --- > > Mufeed Usman > > My LinkedIn <http://www.linkedin.com/pub/mufeed-usman/28/254/400> | My > > Social Cause <http://www.vision2016.org.in/> | My Blogs : LiveJournal > > <http://mufeed.livejournal.com> > > >
