Monitoring move progress

2011-12-21 Thread Ethan Rowe
I've got some nodes in a moving state in a cluster (the nodes to which they stream shouldn't overlap), and I'm finding it difficult to determine if they're actually doing anything related to the move at this point, or if they're stuck in the state and not actually doing anything. In each case, I

New node unable to stream (0.8.5)

2011-09-15 Thread Ethan Rowe
Hi. We've been running a 7-node cluster with RF 3, QUORUM reads/writes in our production environment for a few months. It's been consistently stable during this period, particularly once we got out maintenance strategy fully worked out (per node, one repair a week, one major compaction a week,

Re: New node unable to stream (0.8.5)

2011-09-15 Thread Ethan Rowe
to. On Thu, Sep 15, 2011 at 7:41 AM, Sylvain Lebresne sylv...@datastax.comwrote: On Thu, Sep 15, 2011 at 1:16 PM, Ethan Rowe et...@the-rowes.com wrote: Hi. We've been running a 7-node cluster with RF 3, QUORUM reads/writes in our production environment for a few months. It's been

Re: New node unable to stream (0.8.5)

2011-09-15 Thread Ethan Rowe
of the set of failing streams. On Thu, Sep 15, 2011 at 8:13 AM, Ethan Rowe et...@the-rowes.com wrote: Here's a typical log slice (not terribly informative, I fear): INFO [AntiEntropyStage:2] 2011-09-15 05:41:36,106 AntiEntropyService.java (l ine 884) Performing streaming repair of 1003 ranges

Re: New node unable to stream (0.8.5)

2011-09-15 Thread Ethan Rowe
they aren't replication neighbors? On Thu, Sep 15, 2011 at 8:18 AM, Ethan Rowe et...@the-rowes.com wrote: I just noticed the following from one of Jonathan Ellis' messages yesterday: Added to NEWS: - After upgrading, run nodetool scrub against each node before running repair, moving

Re: New node unable to stream (0.8.5)

2011-09-15 Thread Ethan Rowe
AM, Ethan Rowe et...@the-rowes.com wrote: Here's a typical log slice (not terribly informative, I fear): INFO [AntiEntropyStage:2] 2011-09-15 05:41:36,106 AntiEntropyService.java (l ine 884) Performing streaming repair of 1003 ranges with /10.34.90.8for (299

Re: New node unable to stream (0.8.5)

2011-09-15 Thread Ethan Rowe
, Sep 15, 2011 at 8:08 AM, Ethan Rowe et...@the-rowes.com wrote: After further review, I'm definitely going to scrub all the original nodes in the cluster. We've lost some data as a result of this situation. It can be restored, but the question is what to do with the problematic new node

Re: New node unable to stream (0.8.5)

2011-09-15 Thread Ethan Rowe
that gets us. Thanks for the assistance. - Ethan On Thu, Sep 15, 2011 at 8:40 AM, Ethan Rowe et...@the-rowes.com wrote: On Thu, Sep 15, 2011 at 9:21 AM, Jonathan Ellis jbel...@gmail.com wrote: Where did the data loss come in? The outcome of the analytical jobs run overnight while some

Re: New node unable to stream (0.8.5)

2011-09-15 Thread Ethan Rowe
that the cluster will be in a healthy state soon, so we can reimport as necessary and we'll be out of the woods. Now that I've said all that, something will inevitably go wrong, but until that happens, thanks again for the feedback. - Ethan On Thu, Sep 15, 2011 at 8:40 AM, Ethan Rowe et

Truncate introspection

2011-06-27 Thread Ethan Rowe
Is there any straightforward means of seeing what's going on after issuing a truncate (on 0.7.5)? I'm not seeing evidence that anything actually happened. I've disabled read repair on the column family in question and don't have anything actively reading/writing at present, apart from my one-off

Re: Truncate introspection

2011-06-27 Thread Ethan Rowe
I got from the docs but it wasn't totally clear to me. On Mon, Jun 27, 2011 at 3:33 PM, Jonathan Ellis jbel...@gmail.com wrote: There's a JMX method to get the number of sstables in a CF, is that what you're looking for? On Mon, Jun 27, 2011 at 1:04 PM, Ethan Rowe et...@the-rowes.com wrote

Re: What's the best modeling approach for ordering events by date?

2011-04-15 Thread Ethan Rowe
something? Thanks for your answer, Guille On Thu, Apr 14, 2011 at 4:49 PM, Ethan Rowe et...@the-rowes.com wrote: How do you plan to read the data? Entire histories, or in relatively confined slices of time? Do the events have any attributes by which you might segregate them, apart from

Re: What's the best modeling approach for ordering events by date?

2011-04-14 Thread Ethan Rowe
How do you plan to read the data? Entire histories, or in relatively confined slices of time? Do the events have any attributes by which you might segregate them, apart from time? If you can divide time into a fixed series of intervals, you can insert members of a given interval as columns (or

hadoop streaming input

2011-03-17 Thread Ethan Rowe
Hello. What's the current thinking on input support for Hadoop streaming? It seems like the relevant Jira issue has been quiet for some time: https://issues.apache.org/jira/browse/CASSANDRA-1497 Thanks. - Ethan

Re: hadoop streaming input

2011-03-17 Thread Ethan Rowe
jobs since then and I just haven't had time with the things I've been doing here. If you'd like to take a stab at it, you're welcome to rebase and get it finished. On Mar 17, 2011, at 12:57 PM, Ethan Rowe wrote: Hello. What's the current thinking on input support for Hadoop streaming

Re: ORM in Cassandra?

2010-04-26 Thread Ethan Rowe
. Thanks. - Ethan -- Ethan Rowe End Point Corporation et...@endpoint.com

Re: ORM in Cassandra?

2010-04-26 Thread Ethan Rowe
services would benefit from such tools. -- Ethan Rowe End Point Corporation et...@endpoint.com

Re: Separate disks with cloud deployment

2010-03-25 Thread Ethan Rowe
. I'll defer to the Rackspace folks regarding Rackspace Cloud; it has been I/O on average since you're dealing with a real, local disk. But I don't know about getting a second disk in that environment, though. -- Ethan Rowe End Point Corporation et...@endpoint.com

Re: Separate disks with cloud deployment

2010-03-25 Thread Ethan Rowe
On 03/25/2010 11:18 AM, Ethan Rowe wrote: [snip] I'll defer to the Rackspace folks regarding Rackspace Cloud; it has been I/O on average since you're dealing with a real, local disk. But I don't know about getting a second disk in that environment, though. That should have said better I/O