[jira] Commented: (ZOOKEEPER-744) Add monitoring four-letter word

2010-05-25 Thread Travis Crawford (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871479#action_12871479
 ] 

Travis Crawford commented on ZOOKEEPER-744:
---

Looks awesome! One nit -- many monitoring systems do not interpret strings so 
it may be appropriate to export everything as numbers. For example, consider a 
script that loops through these values poking them into Ganglia (or other 
timeseries database). The script would need special-cased to handle "leader". 
Later, as more values are added the import script would need updated with the 
new strings. Doing everything as numbers ensures new values would "just work" 
without updating other systems.

With that in mind, perhaps:

zk_server_state 1 (instead of: leader)
zk_build_timestamp unix_timestamp (instead of build string)

> Add monitoring four-letter word
> ---
>
> Key: ZOOKEEPER-744
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-744
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: server
>Reporter: Travis Crawford
> Attachments: zk-ganglia.png, ZOOKEEPER-744.patch
>
>
> Filing a feature request based on a zookeeper-user discussion.
> Zookeeper should have a new four-letter word that returns key-value pairs 
> appropriate for importing to a monitoring system (such as Ganglia which has a 
> large installed base)
> This command should initially export the following:
> (a) Count of instances in the ensemble.
> (b) Count of up-to-date instances in the ensemble.
> But be designed such that in the future additional data can be added. For 
> example, the output could define the statistic in a comment, then print a key 
> "space character" value line:
> """
> # Total number of instances in the ensemble
> zk_ensemble_instances_total 5
> # Number of instances currently participating in the quorum.
> zk_ensemble_instances_active 4
> """
> From the mailing list:
> """
> Date: Mon, 19 Apr 2010 12:10:44 -0700
> From: Patrick Hunt 
> To: zookeeper-u...@hadoop.apache.org
> Subject: Re: Recovery issue - how to debug?
> On 04/19/2010 11:55 AM, Travis Crawford wrote:
> > It would be a lot easier from the operations perspective if the leader
> > explicitly published some health stats:
> >
> > (a) Count of instances in the ensemble.
> > (b) Count of up-to-date instances in the ensemble.
> >
> > This would greatly simplify monitoring&  alerting - when an instance
> > falls behind one could configure their monitoring system to let
> > someone know and take a look at the logs.
> That's a great idea. Please enter a JIRA for this - a new 4 letter word 
> and JMX support. It would also be a great starter project for someone 
> interested in becoming more familiar with the server code.
> Patrick
> """

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (ZOOKEEPER-779) C Client should check the connectivity to the hosts in zookeeper_init

2010-05-25 Thread Qian Ye (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871474#action_12871474
 ] 

Qian Ye commented on ZOOKEEPER-779:
---

OK Patrick, however I'm really busy these days, it may take a week or two 
before I can make it done.

> C Client should check the connectivity to the hosts in zookeeper_init
> -
>
> Key: ZOOKEEPER-779
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-779
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: c client
>Affects Versions: 3.3.1
>Reporter: Qian Ye
> Attachments: ZOOKEEPER-779.patch, ZOOKEEPER-779.patch
>
>
> In some scenario, whether the client can connect to zookeeper servers is used 
> as a logic condition. If the client cannot connect to the servers, the 
> program should turn to another fork. However, current zookeeper_init could 
> not tell whether the client can connect to one server or not. It could make 
> some users feel confused. I think we should check the connectivity to the 
> host in zookeeper_init, so we can tell whether the hosts are avaiable at that 
> time or not.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (ZOOKEEPER-775) A large scale pub/sub system

2010-05-25 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871274#action_12871274
 ] 

Hadoop QA commented on ZOOKEEPER-775:
-

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12445481/libs.zip
  against trunk revision 947063.

+1 @author.  The patch does not contain any @author tags.

-1 tests included.  The patch doesn't appear to include any new or modified 
tests.
Please justify why no tests are needed for this patch.

-1 patch.  The patch command could not apply the patch.

Console output: 
http://hudson.zones.apache.org/hudson/job/Zookeeper-Patch-h1.grid.sp2.yahoo.net/106/console

This message is automatically generated.

> A large scale pub/sub system
> 
>
> Key: ZOOKEEPER-775
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-775
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>Reporter: Benjamin Reed
> Fix For: 3.4.0
>
> Attachments: libs.zip, ZOOKEEPER-775.patch, ZOOKEEPER-775_2.patch
>
>
> we have developed a large scale pub/sub system based on ZooKeeper and 
> BookKeeper.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (ZOOKEEPER-775) A large scale pub/sub system

2010-05-25 Thread Benjamin Reed (JIRA)

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benjamin Reed updated ZOOKEEPER-775:


Status: Patch Available  (was: Open)

> A large scale pub/sub system
> 
>
> Key: ZOOKEEPER-775
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-775
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>Reporter: Benjamin Reed
> Fix For: 3.4.0
>
> Attachments: libs.zip, ZOOKEEPER-775.patch, ZOOKEEPER-775_2.patch
>
>
> we have developed a large scale pub/sub system based on ZooKeeper and 
> BookKeeper.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (ZOOKEEPER-775) A large scale pub/sub system

2010-05-25 Thread Benjamin Reed (JIRA)

 [ 
https://issues.apache.org/jira/browse/ZOOKEEPER-775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benjamin Reed updated ZOOKEEPER-775:


Attachment: ZOOKEEPER-775_2.patch
libs.zip

this should build now. i've attached a libs.zip that contains bookkeeper and 
zookeeper libraries. i suggest that we commit this ASAP and then do the work to 
fix the build once the code is in subversion.

> A large scale pub/sub system
> 
>
> Key: ZOOKEEPER-775
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-775
> Project: Zookeeper
>  Issue Type: New Feature
>  Components: contrib
>Reporter: Benjamin Reed
> Fix For: 3.4.0
>
> Attachments: libs.zip, ZOOKEEPER-775.patch, ZOOKEEPER-775_2.patch
>
>
> we have developed a large scale pub/sub system based on ZooKeeper and 
> BookKeeper.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (ZOOKEEPER-779) C Client should check the connectivity to the hosts in zookeeper_init

2010-05-25 Thread Patrick Hunt (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871232#action_12871232
 ] 

Patrick Hunt commented on ZOOKEEPER-779:


I took a look at the patch, I don't see a big problem with this but I'm a 
little concerned about changing the semantics of zookeeper_init. Really I'd 
like to see us move to the strategy pattern directly rather than take a smaller 
step that ppl come to rely on and then we end up having to support (or break) 
going fwd. Qian I'm assuming this is working ok for you, but would you be 
interested in fleshing out the design of the strategy pattern and putting 
together a patch for that?

> C Client should check the connectivity to the hosts in zookeeper_init
> -
>
> Key: ZOOKEEPER-779
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-779
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: c client
>Affects Versions: 3.3.1
>Reporter: Qian Ye
> Attachments: ZOOKEEPER-779.patch, ZOOKEEPER-779.patch
>
>
> In some scenario, whether the client can connect to zookeeper servers is used 
> as a logic condition. If the client cannot connect to the servers, the 
> program should turn to another fork. However, current zookeeper_init could 
> not tell whether the client can connect to one server or not. It could make 
> some users feel confused. I think we should check the connectivity to the 
> host in zookeeper_init, so we can tell whether the hosts are avaiable at that 
> time or not.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (ZOOKEEPER-779) C Client should check the connectivity to the hosts in zookeeper_init

2010-05-25 Thread Patrick Hunt (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871222#action_12871222
 ] 

Patrick Hunt commented on ZOOKEEPER-779:


Qian, hudson has been having problems for the last week or two - I think this 
is a false positive failure. I've contacted Apache to look into what's wrong on 
the hudson machines but so far we've not heard back.

> C Client should check the connectivity to the hosts in zookeeper_init
> -
>
> Key: ZOOKEEPER-779
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-779
> Project: Zookeeper
>  Issue Type: Improvement
>  Components: c client
>Affects Versions: 3.3.1
>Reporter: Qian Ye
> Attachments: ZOOKEEPER-779.patch, ZOOKEEPER-779.patch
>
>
> In some scenario, whether the client can connect to zookeeper servers is used 
> as a logic condition. If the client cannot connect to the servers, the 
> program should turn to another fork. However, current zookeeper_init could 
> not tell whether the client can connect to one server or not. It could make 
> some users feel confused. I think we should check the connectivity to the 
> host in zookeeper_init, so we can tell whether the hosts are avaiable at that 
> time or not.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (ZOOKEEPER-780) zkCli.sh generates a ArrayIndexOutOfBoundsException

2010-05-25 Thread Miguel Correia (JIRA)

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871086#action_12871086
 ] 

Miguel Correia commented on ZOOKEEPER-780:
--

I've just picked a similar one so I guess the problem is more generic and has 
to do with the way zkCli.sh handles exceptions (i.e., misses handling some of 
them). This time I misspelled the parameter of the connect command (I forgot 
the ":"):

Output:

connect localhost2181
2010-05-25 11:28:25,241 - INFO  [main:zookee...@538] - Session: 
0x128cec5e35f0014 closed
2010-05-25 11:28:25,242 - INFO  [main:zookee...@373] - Initiating client 
connection, connectString=localhost2181 sessionTimeout=3 
watcher=org.apache.zookeeper.zookeepermain$mywatc...@1bac748
Exception in thread "main" java.net.UnknownHostException: localhost2181
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:849)
at java.net.InetAddress.getAddressFromNameService(InetAddress.java:1200)
at java.net.InetAddress.getAllByName0(InetAddress.java:1153)
at java.net.InetAddress.getAllByName(InetAddress.java:1083)
at java.net.InetAddress.getAllByName(InetAddress.java:1019)
at org.apache.zookeeper.ClientCnxn.(ClientCnxn.java:383)
at org.apache.zookeeper.ClientCnxn.(ClientCnxn.java:328)
at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:377)
at 
org.apache.zookeeper.ZooKeeperMain.connectToZK(ZooKeeperMain.java:261)
at 
org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:648)
at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:581)
at 
org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:353)
at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:311)
at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:270)


> zkCli.sh  generates a ArrayIndexOutOfBoundsException 
> -
>
> Key: ZOOKEEPER-780
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-780
> Project: Zookeeper
>  Issue Type: Bug
>  Components: scripts
>Affects Versions: 3.3.1
> Environment: Linux Ubuntu running in VMPlayer on top of Windows XP
>Reporter: Miguel Correia
>Priority: Minor
>
> I'm starting to play with Zookeeper so I'm still running it in standalone 
> mode. This is not a big issue, but here it goes for the records. 
> I've run zkCli.sh to run some commands in the server. I created a znode 
> /groups. When I tried to create a znode client_1 inside /groups, I forgot to 
> include the data: an exception was generated and zkCli-sh crashed, instead of 
> just showing an error. I tried a few variations and it seems like the problem 
> is not including the data.
> A copy of the screen:
> [zk: localhost:2181(CONNECTED) 3] create /groups firstgroup
> Created /groups
> [zk: localhost:2181(CONNECTED) 4] create -e /groups/client_1
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 3
>   at 
> org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:678)
>   at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:581)
>   at 
> org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:353)
>   at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:311)
>   at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:270)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Created: (ZOOKEEPER-780) zkCli.sh generates a ArrayIndexOutOfBoundsException

2010-05-25 Thread Miguel Correia (JIRA)
zkCli.sh  generates a ArrayIndexOutOfBoundsException 
-

 Key: ZOOKEEPER-780
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-780
 Project: Zookeeper
  Issue Type: Bug
  Components: scripts
Affects Versions: 3.3.1
 Environment: Linux Ubuntu running in VMPlayer on top of Windows XP
Reporter: Miguel Correia
Priority: Minor


I'm starting to play with Zookeeper so I'm still running it in standalone mode. 
This is not a big issue, but here it goes for the records. 

I've run zkCli.sh to run some commands in the server. I created a znode 
/groups. When I tried to create a znode client_1 inside /groups, I forgot to 
include the data: an exception was generated and zkCli-sh crashed, instead of 
just showing an error. I tried a few variations and it seems like the problem 
is not including the data.

A copy of the screen:

[zk: localhost:2181(CONNECTED) 3] create /groups firstgroup
Created /groups
[zk: localhost:2181(CONNECTED) 4] create -e /groups/client_1
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 3
at 
org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:678)
at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:581)
at 
org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:353)
at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:311)
at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:270)


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.