[jira] [Commented] (CASSANDRA-2921) Split BufferedRandomAccessFile (BRAF) into Input and Output classes

2011-07-22 Thread Pavel Yaskevich (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13069457#comment-13069457
 ] 

Pavel Yaskevich commented on CASSANDRA-2921:


bq. I don't understand. Your second patch changes Writer to a Stream which is 
the right direction to take this IMO. If we're going to stick with Writer and 
Reader both exposing the same RAF interface I don't think there's much point in 
splitting them up.

Second patch used to have random I/O writer but my point is - if we want to 
support BRAF lets do both Reader and Writer and do SequentialWriter in the 
separate file. But if you really think we should remove write functionality 
from BRAF, I'm okay with that, will attach v4 patch with some minor changes to 
your v3 soon.

 Split BufferedRandomAccessFile (BRAF) into Input and Output classes 
 

 Key: CASSANDRA-2921
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2921
 Project: Cassandra
  Issue Type: Improvement
  Components: Core
Reporter: Pavel Yaskevich
Assignee: Pavel Yaskevich
 Fix For: 1.0

 Attachments: 2921-v3.txt, CASSANDRA-2921-make-Writer-a-stream.patch, 
 CASSANDRA-2921-v2.patch, CASSANDRA-2921.patch


 Split BRAF into Input and Output classes to void complexity related to random 
 I/O in write mode that we don't need any more, see CASSANDRA-2879. And make 
 implementation more clean and reusable.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (CASSANDRA-2921) Split BufferedRandomAccessFile (BRAF) into Input and Output classes

2011-07-22 Thread Pavel Yaskevich (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Yaskevich updated CASSANDRA-2921:
---

Attachment: CASSANDRA-2921-v4.patch

Renamed static writer/reader methods to open. Changed cache skipping so it 
works correctly for sequential I/O.

 Split BufferedRandomAccessFile (BRAF) into Input and Output classes 
 

 Key: CASSANDRA-2921
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2921
 Project: Cassandra
  Issue Type: Improvement
  Components: Core
Reporter: Pavel Yaskevich
Assignee: Pavel Yaskevich
 Fix For: 1.0

 Attachments: 2921-v3.txt, CASSANDRA-2921-make-Writer-a-stream.patch, 
 CASSANDRA-2921-v2.patch, CASSANDRA-2921-v4.patch, CASSANDRA-2921.patch


 Split BRAF into Input and Output classes to void complexity related to random 
 I/O in write mode that we don't need any more, see CASSANDRA-2879. And make 
 implementation more clean and reusable.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (CASSANDRA-2126) RMI call times out on large repair jobs

2011-07-22 Thread David Allsopp (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13069514#comment-13069514
 ] 

David Allsopp commented on CASSANDRA-2126:
--

I've just had exactly the same exception for a nodetool loadbalance operation 
(on v0.7.6)

 RMI call times out on large repair jobs
 ---

 Key: CASSANDRA-2126
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2126
 Project: Cassandra
  Issue Type: Bug
  Components: Tools
Reporter: Matthew F. Dennis
Priority: Minor

 It looks like when a repair is started via nodetool and the repair takes a 
 long time the blocking RMI call can timeout before the repair finishes.  The 
 repair will continue to run and correctly complete, but the caller receives a 
 stack trace similar to:
 {noformat}
 Exception in thread main java.rmi.UnmarshalException: Error unmarshaling 
 return header; nested exception is:
 java.io.EOFException
 at 
 sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:209)
 at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:142)
 at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source)
 at javax.management.remote.rmi.RMIConnectionImpl_Stub.invoke(Unknown 
 Source)
 at 
 javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:993)
 at 
 javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:288)
 at $Proxy0.forceTableRepair(Unknown Source)
 at 
 org.apache.cassandra.tools.NodeProbe.forceTableRepair(NodeProbe.java:155)
 at 
 org.apache.cassandra.tools.NodeCmd.optionalKSandCFs(NodeCmd.java:635)
 at org.apache.cassandra.tools.NodeCmd.main(NodeCmd.java:546)
 Caused by: java.io.EOFException
 at java.io.DataInputStream.readByte(DataInputStream.java:250)
 at 
 sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:195)
 ... 9 more
 {noformat}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Issue Comment Edited] (CASSANDRA-2126) RMI call times out on large repair jobs

2011-07-22 Thread David Allsopp (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13069514#comment-13069514
 ] 

David Allsopp edited comment on CASSANDRA-2126 at 7/22/11 11:50 AM:


I've just had almost the same exception for a nodetool loadbalance operation 
(on v0.7.6):

{noformat}
$ nodetool -h dev2 -p8080 loadbalance
Exception in thread main java.rmi.UnmarshalException: Error unmarshaling 
return header; nested exception is: 
java.io.EOFException
at 
sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:227)
at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:160)
at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source)
at javax.management.remote.rmi.RMIConnectionImpl_Stub.invoke(Unknown 
Source)
at 
javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:1001)
at 
javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:305)
at $Proxy0.loadBalance(Unknown Source)
at org.apache.cassandra.tools.NodeProbe.loadBalance(NodeProbe.java:352)
at org.apache.cassandra.tools.NodeCmd.main(NodeCmd.java:541)
Caused by: java.io.EOFException
at java.io.DataInputStream.readByte(DataInputStream.java:267)
at 
sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:213)
... 8 more
{noformat}

  was (Author: dallsopp):
I've just had exactly the same exception for a nodetool loadbalance 
operation (on v0.7.6)
  
 RMI call times out on large repair jobs
 ---

 Key: CASSANDRA-2126
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2126
 Project: Cassandra
  Issue Type: Bug
  Components: Tools
Reporter: Matthew F. Dennis
Priority: Minor

 It looks like when a repair is started via nodetool and the repair takes a 
 long time the blocking RMI call can timeout before the repair finishes.  The 
 repair will continue to run and correctly complete, but the caller receives a 
 stack trace similar to:
 {noformat}
 Exception in thread main java.rmi.UnmarshalException: Error unmarshaling 
 return header; nested exception is:
 java.io.EOFException
 at 
 sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:209)
 at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:142)
 at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source)
 at javax.management.remote.rmi.RMIConnectionImpl_Stub.invoke(Unknown 
 Source)
 at 
 javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:993)
 at 
 javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:288)
 at $Proxy0.forceTableRepair(Unknown Source)
 at 
 org.apache.cassandra.tools.NodeProbe.forceTableRepair(NodeProbe.java:155)
 at 
 org.apache.cassandra.tools.NodeCmd.optionalKSandCFs(NodeCmd.java:635)
 at org.apache.cassandra.tools.NodeCmd.main(NodeCmd.java:546)
 Caused by: java.io.EOFException
 at java.io.DataInputStream.readByte(DataInputStream.java:250)
 at 
 sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:195)
 ... 9 more
 {noformat}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[Cassandra Wiki] Update of NodeTool by DavidAllsopp

2011-07-22 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on Cassandra Wiki for 
change notification.

The NodeTool page has been changed by DavidAllsopp:
http://wiki.apache.org/cassandra/NodeTool?action=diffrev1=18rev2=19

Comment:
added info on Join command

  
  The largest token is repeated at the top of the list to indicate that we have 
a ring. i.e, the first and last printed token are the same, suggesting some 
kind of continuity
  
+ == Join ==
+ 
+ Triggers the specified node to join the ring. This assumes that the node was 
started with `-Dcassandra.join_ring=false` so that it did not join the ring 
upon startup.
+ 
  == Info ==
  Outputs node information including the token, load info (on disk storage), 
generation number (times started), uptime in seconds, and heap memory usage.
  


[jira] [Commented] (CASSANDRA-2920) Remove SSTableWriter.Builder

2011-07-22 Thread Yuki Morishita (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13069540#comment-13069540
 ] 

Yuki Morishita commented on CASSANDRA-2920:
---

OK, then +1.

 Remove SSTableWriter.Builder
 

 Key: CASSANDRA-2920
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2920
 Project: Cassandra
  Issue Type: Task
  Components: Core
Affects Versions: 1.0
Reporter: Jonathan Ellis
Assignee: Stu Hood
Priority: Minor
 Fix For: 1.0

 Attachments: 2920-v2.txt, 2920.txt


 CASSANDRA-2677 left Builder-oriented streaming in for backwards 
 compatibility, but since we're going to change the sstable format for 1.0, 
 and Builder doesn't work across format changes, there's no point in leaving 
 Builder around.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




svn commit: r1149623 - /cassandra/trunk/test/unit/org/apache/cassandra/utils/BytesReadTrackerTest.java

2011-07-22 Thread jbellis
Author: jbellis
Date: Fri Jul 22 14:41:23 2011
New Revision: 1149623

URL: http://svn.apache.org/viewvc?rev=1149623view=rev
Log:
belatedly add BRTT

Added:

cassandra/trunk/test/unit/org/apache/cassandra/utils/BytesReadTrackerTest.java

Added: 
cassandra/trunk/test/unit/org/apache/cassandra/utils/BytesReadTrackerTest.java
URL: 
http://svn.apache.org/viewvc/cassandra/trunk/test/unit/org/apache/cassandra/utils/BytesReadTrackerTest.java?rev=1149623view=auto
==
--- 
cassandra/trunk/test/unit/org/apache/cassandra/utils/BytesReadTrackerTest.java 
(added)
+++ 
cassandra/trunk/test/unit/org/apache/cassandra/utils/BytesReadTrackerTest.java 
Fri Jul 22 14:41:23 2011
@@ -0,0 +1,209 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * License); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * AS IS BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+package org.apache.cassandra.utils;
+
+import static org.junit.Assert.assertEquals;
+import static org.junit.Assert.assertTrue;
+
+import java.io.ByteArrayInputStream;
+import java.io.ByteArrayOutputStream;
+import java.io.DataInputStream;
+import java.io.DataOutputStream;
+
+import org.junit.Test;
+
+public class BytesReadTrackerTest
+{
+
+@Test
+public void testBytesRead() throws Exception
+{
+byte[] testData;
+
+ByteArrayOutputStream baos = new ByteArrayOutputStream();
+DataOutputStream dos = new DataOutputStream(baos);
+try
+{
+// boolean
+dos.writeBoolean(true);
+// byte
+dos.writeByte(0x1);
+// char
+dos.writeChar('a');
+// short
+dos.writeShort(1);
+// int
+dos.writeInt(1);
+// long
+dos.writeLong(1L);
+// float
+dos.writeFloat(1.0f);
+// double
+dos.writeDouble(1.0d);
+
+// String
+dos.writeUTF(abc);
+testData = baos.toByteArray();
+}
+finally
+{
+dos.close();
+}
+
+DataInputStream dis = new DataInputStream(new 
ByteArrayInputStream(testData));
+BytesReadTracker tracker = new BytesReadTracker(dis);
+
+try
+{
+// boolean = 1byte
+boolean bool = tracker.readBoolean();
+assertTrue(bool);
+assertEquals(1, tracker.getBytesRead());
+// byte = 1byte
+byte b = tracker.readByte();
+assertEquals(b, 0x1);
+assertEquals(2, tracker.getBytesRead());
+// char = 1byte
+char c = tracker.readChar();
+assertEquals('a', c);
+assertEquals(3, tracker.getBytesRead());
+// short = 2bytes
+short s = tracker.readShort();
+assertEquals(1, s);
+assertEquals((short) 5, tracker.getBytesRead());
+// int = 4bytes
+int i = tracker.readInt();
+assertEquals(1, i);
+assertEquals(9, tracker.getBytesRead());
+// long = 8bytes
+long l = tracker.readLong();
+assertEquals(1L, l);
+assertEquals(17, tracker.getBytesRead());
+// float = 4bytes
+float f = tracker.readFloat();
+assertEquals(1.0f, f, 0);
+assertEquals(21, tracker.getBytesRead());
+// double = 8bytes
+double d = tracker.readDouble();
+assertEquals(1.0d, d, 0);
+assertEquals(29, tracker.getBytesRead());
+// String(abc) = 2(string size) + 3 = 5 bytes
+String str = tracker.readUTF();
+assertEquals(abc, str);
+assertEquals(34, tracker.getBytesRead());
+}
+finally
+{
+dis.close();
+}
+
+tracker.reset();
+assertEquals(0, tracker.getBytesRead());
+}
+
+@Test
+public void testUnsignedRead() throws Exception
+{
+byte[] testData;
+
+ByteArrayOutputStream baos = new ByteArrayOutputStream();
+DataOutputStream dos = new DataOutputStream(baos);
+try
+{
+// byte
+dos.writeByte(0x1);
+// short
+

svn commit: r1149628 [2/2] - in /cassandra/trunk: src/java/org/apache/cassandra/cache/ src/java/org/apache/cassandra/db/commitlog/ src/java/org/apache/cassandra/db/compaction/ src/java/org/apache/cass

2011-07-22 Thread jbellis
Modified: 
cassandra/trunk/test/unit/org/apache/cassandra/io/util/BufferedRandomAccessFileTest.java
URL: 
http://svn.apache.org/viewvc/cassandra/trunk/test/unit/org/apache/cassandra/io/util/BufferedRandomAccessFileTest.java?rev=1149628r1=1149627r2=1149628view=diff
==
--- 
cassandra/trunk/test/unit/org/apache/cassandra/io/util/BufferedRandomAccessFileTest.java
 (original)
+++ 
cassandra/trunk/test/unit/org/apache/cassandra/io/util/BufferedRandomAccessFileTest.java
 Fri Jul 22 14:56:25 2011
@@ -40,145 +40,141 @@ public class BufferedRandomAccessFileTes
 @Test
 public void testReadAndWrite() throws Exception
 {
-BufferedRandomAccessFile file = createTempFile(braf);
+SequentialWriter w = createTempFile(braf);
 
 // writting string of data to the file
 byte[] data = Hello.getBytes();
-file.write(data);
-assertEquals(file.length(), data.length);
-assertEquals(file.getFilePointer(), data.length);
+w.write(data);
+assertEquals(data.length, w.length());
+assertEquals(data.length, w.getFilePointer());
+
+w.sync();
 
 // reading small amount of data from file, this is handled by initial 
buffer
-file.seek(0);
+RandomAccessReader r = RandomAccessReader.open(w);
+
 byte[] buffer = new byte[data.length];
-assertEquals(file.read(buffer), data.length);
+assertEquals(data.length, r.read(buffer));
 assertTrue(Arrays.equals(buffer, data)); // we read exactly what we 
wrote
-assertEquals(file.read(), -1); // nothing more to read EOF
-assert file.bytesRemaining() == 0  file.isEOF();
+assertEquals(r.read(), -1); // nothing more to read EOF
+assert r.bytesRemaining() == 0  r.isEOF();
+
+r.close();
 
 // writing buffer bigger than page size, which will trigger reBuffer()
-byte[] bigData = new byte[BufferedRandomAccessFile.DEFAULT_BUFFER_SIZE 
+ 10];
+byte[] bigData = new byte[RandomAccessReader.DEFAULT_BUFFER_SIZE + 10];
 
 for (int i = 0; i  bigData.length; i++)
 bigData[i] = 'd';
 
-long initialPosition = file.getFilePointer();
-file.write(bigData); // writing data
-assertEquals(file.getFilePointer(), initialPosition + bigData.length);
-assertEquals(file.length(), initialPosition + bigData.length); // file 
size should equals to last position
+long initialPosition = w.getFilePointer();
+w.write(bigData); // writing data
+assertEquals(w.getFilePointer(), initialPosition + bigData.length);
+assertEquals(w.length(), initialPosition + bigData.length); // file 
size should equals to last position
+
+w.sync();
+
+r = RandomAccessReader.open(w); // re-opening file in read-only mode
 
 // reading written buffer
-file.seek(initialPosition); // back to initial (before write) position
+r.seek(initialPosition); // back to initial (before write) position
 data = new byte[bigData.length];
 long sizeRead = 0;
 for (int i = 0; i  data.length; i++)
 {
-data[i] = (byte) file.read(); // this will trigger reBuffer()
+data[i] = (byte) r.read();
 sizeRead++;
 }
 
 assertEquals(sizeRead, data.length); // read exactly data.length bytes
-assertEquals(file.getFilePointer(), initialPosition + data.length);
-assertEquals(file.length(), initialPosition + bigData.length);
+assertEquals(r.getFilePointer(), initialPosition + data.length);
+assertEquals(r.length(), initialPosition + bigData.length);
 assertTrue(Arrays.equals(bigData, data));
-assert file.bytesRemaining() == 0  file.isEOF(); // we are at the of 
the file
+assertTrue(r.bytesRemaining() == 0  r.isEOF()); // we are at the of 
the file
 
 // test readBytes(int) method
-file.seek(0);
-ByteBuffer fileContent = file.readBytes((int) file.length());
-assertEquals(fileContent.limit(), file.length());
+r.seek(0);
+ByteBuffer fileContent = r.readBytes((int) w.length());
+assertEquals(fileContent.limit(), w.length());
 assert ByteBufferUtil.string(fileContent).equals(Hello + new 
String(bigData));
 
 // read the same buffer but using readFully(int)
 data = new byte[bigData.length];
-file.seek(initialPosition);
-file.readFully(data);
-assert file.bytesRemaining() == 0  file.isEOF(); // we should be at 
EOF
+r.seek(initialPosition);
+r.readFully(data);
+assert r.bytesRemaining() == 0  r.isEOF(); // we should be at EOF
 assertTrue(Arrays.equals(bigData, data));
 
 // try to read past mark (all methods should return -1)
 data = new byte[10];
-assertEquals(file.read(), -1);
-

[jira] [Assigned] (CASSANDRA-2935) CLI ignores quoted default_validation_class in create column family command

2011-07-22 Thread Jonathan Ellis (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jonathan Ellis reassigned CASSANDRA-2935:
-

Assignee: Pavel Yaskevich

 CLI ignores quoted default_validation_class in create column family command
 -

 Key: CASSANDRA-2935
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2935
 Project: Cassandra
  Issue Type: Bug
  Components: Tools
Affects Versions: 0.8.1
 Environment: Ubuntu 10.10
Reporter: Andy Bauch
Assignee: Pavel Yaskevich
Priority: Trivial

 The default_validation_class parameter of CREATE COLUMN FAMILY is ignored 
 when quotes.  The key_validation_class and comparator parameters do not 
 exhibit this behavior.  
 Sample output:
 [default@vp2] create column family UserPlaybackHistory with 
 comparator='AsciiType' and key_validation_class='AsciiType' and 
 default_validation_class='AsciiType';  
 18a9f020-b3ce-11e0--9904252df9ff
 Waiting for schema agreement...
 ... schemas agree across the cluster
 [default@vp2] describe keyspace;
 Keyspace: vp2:
   Replication Strategy: org.apache.cassandra.locator.SimpleStrategy
   Durable Writes: true
 Options: [replication_factor:2]
   Column Families:
 ColumnFamily: UserPlaybackHistory
   Key Validation Class: org.apache.cassandra.db.marshal.AsciiType
   Default column value validator: 
 org.apache.cassandra.db.marshal.BytesType
   Columns sorted by: org.apache.cassandra.db.marshal.AsciiType
   Row cache size / save period in seconds: 0.0/0
   Key cache size / save period in seconds: 20.0/14400
   Memtable thresholds: 1.0875/232/1440 (millions of ops/MB/minutes)
   GC grace seconds: 864000
   Compaction min/max thresholds: 4/32
   Read repair chance: 1.0
   Replicate on write: false
   Built indexes: []
 [default@vp2] drop column family UserPlaybackHistory;
 2513e2d0-b3ce-11e0--9904252df9ff
 Waiting for schema agreement...
 ... schemas agree across the cluster
 [default@vp2] create column family UserPlaybackHistory with 
 comparator=AsciiType and key_validation_class=AsciiType and 
 default_validation_class=AsciiType;  
 5d1b4ce0-b3ce-11e0--9904252df9ff
 Waiting for schema agreement...
 ... schemas agree across the cluster
 [default@vp2] describe keyspace;  
   
  
 Keyspace: vp2:
   Replication Strategy: org.apache.cassandra.locator.SimpleStrategy
   Durable Writes: true
 Options: [replication_factor:2]
   Column Families:
 ColumnFamily: UserPlaybackHistory
   Key Validation Class: org.apache.cassandra.db.marshal.AsciiType
   Default column value validator: 
 org.apache.cassandra.db.marshal.AsciiType
   Columns sorted by: org.apache.cassandra.db.marshal.AsciiType
   Row cache size / save period in seconds: 0.0/0
   Key cache size / save period in seconds: 20.0/14400
   Memtable thresholds: 1.0875/232/1440 (millions of ops/MB/minutes)
   GC grace seconds: 864000
   Compaction min/max thresholds: 4/32
   Read repair chance: 1.0
   Replicate on write: false
   Built indexes: []

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (CASSANDRA-2935) CLI ignores quoted default_validation_class in create column family command

2011-07-22 Thread Jonathan Ellis (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jonathan Ellis updated CASSANDRA-2935:
--

Assignee: (was: Pavel Yaskevich)

 CLI ignores quoted default_validation_class in create column family command
 -

 Key: CASSANDRA-2935
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2935
 Project: Cassandra
  Issue Type: Bug
  Components: Tools
Affects Versions: 0.8.1
 Environment: Ubuntu 10.10
Reporter: Andy Bauch
Priority: Trivial

 The default_validation_class parameter of CREATE COLUMN FAMILY is ignored 
 when quotes.  The key_validation_class and comparator parameters do not 
 exhibit this behavior.  
 Sample output:
 [default@vp2] create column family UserPlaybackHistory with 
 comparator='AsciiType' and key_validation_class='AsciiType' and 
 default_validation_class='AsciiType';  
 18a9f020-b3ce-11e0--9904252df9ff
 Waiting for schema agreement...
 ... schemas agree across the cluster
 [default@vp2] describe keyspace;
 Keyspace: vp2:
   Replication Strategy: org.apache.cassandra.locator.SimpleStrategy
   Durable Writes: true
 Options: [replication_factor:2]
   Column Families:
 ColumnFamily: UserPlaybackHistory
   Key Validation Class: org.apache.cassandra.db.marshal.AsciiType
   Default column value validator: 
 org.apache.cassandra.db.marshal.BytesType
   Columns sorted by: org.apache.cassandra.db.marshal.AsciiType
   Row cache size / save period in seconds: 0.0/0
   Key cache size / save period in seconds: 20.0/14400
   Memtable thresholds: 1.0875/232/1440 (millions of ops/MB/minutes)
   GC grace seconds: 864000
   Compaction min/max thresholds: 4/32
   Read repair chance: 1.0
   Replicate on write: false
   Built indexes: []
 [default@vp2] drop column family UserPlaybackHistory;
 2513e2d0-b3ce-11e0--9904252df9ff
 Waiting for schema agreement...
 ... schemas agree across the cluster
 [default@vp2] create column family UserPlaybackHistory with 
 comparator=AsciiType and key_validation_class=AsciiType and 
 default_validation_class=AsciiType;  
 5d1b4ce0-b3ce-11e0--9904252df9ff
 Waiting for schema agreement...
 ... schemas agree across the cluster
 [default@vp2] describe keyspace;  
   
  
 Keyspace: vp2:
   Replication Strategy: org.apache.cassandra.locator.SimpleStrategy
   Durable Writes: true
 Options: [replication_factor:2]
   Column Families:
 ColumnFamily: UserPlaybackHistory
   Key Validation Class: org.apache.cassandra.db.marshal.AsciiType
   Default column value validator: 
 org.apache.cassandra.db.marshal.AsciiType
   Columns sorted by: org.apache.cassandra.db.marshal.AsciiType
   Row cache size / save period in seconds: 0.0/0
   Key cache size / save period in seconds: 20.0/14400
   Memtable thresholds: 1.0875/232/1440 (millions of ops/MB/minutes)
   GC grace seconds: 864000
   Compaction min/max thresholds: 4/32
   Read repair chance: 1.0
   Replicate on write: false
   Built indexes: []

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (CASSANDRA-2854) Java Build Path is broken in Eclipse after running generate-eclipse-files Ant target

2011-07-22 Thread Patricio Echague (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13069613#comment-13069613
 ] 

Patricio Echague commented on CASSANDRA-2854:
-

In my Case, Mac OS X 10.6.8 and Eclipse Helios 3.6.2

Even though the source folder is src/java I get this error (around 9 thousand 
of these)

{code}
The declared package org.apache.cassandra.utils.obs does not match the 
expected package java.org.apache.cassandra.utils.obs BitUtil.java
/cassandra-trunk/src/java/org/apache/cassandra/utils/obsline 18 Java 
Problem
{code}


 Java Build Path is broken in Eclipse after running generate-eclipse-files Ant 
 target
 

 Key: CASSANDRA-2854
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2854
 Project: Cassandra
  Issue Type: Bug
  Components: Packaging
Affects Versions: 0.8.1
 Environment: Windows 7 64-bit, Eclipse Helios SR1, Subclipse
Reporter: David Allsopp
Priority: Minor

 Following the instructions in 
 http://wiki.apache.org/cassandra/RunningCassandraInEclipse, but checking out 
 v0.8.1:
 After running the 'generate-eclipse-files' Ant target, the build path is set 
 up to include all the libraries in build/lib/jars, but each library has ;C 
 (semicolon, letter C) appended to it, so Eclipse can't find the libraries - 
 there are about 55 errors like:
 Project 'cassandra-0.8.1' is missing required library: 
 '\Users\David\eclipse_workspace\cassandra-0.8.1\build\lib\jars\commons-cli-1.2.jar;C'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




svn commit: r1149663 - in /cassandra/site: publish/download/index.html src/settings.py

2011-07-22 Thread slebresne
Author: slebresne
Date: Fri Jul 22 17:24:52 2011
New Revision: 1149663

URL: http://svn.apache.org/viewvc?rev=1149663view=rev
Log:
Update web site for 0.7.8

Modified:
cassandra/site/publish/download/index.html
cassandra/site/src/settings.py

Modified: cassandra/site/publish/download/index.html
URL: 
http://svn.apache.org/viewvc/cassandra/site/publish/download/index.html?rev=1149663r1=1149662r2=1149663view=diff
==
--- cassandra/site/publish/download/index.html (original)
+++ cassandra/site/publish/download/index.html Fri Jul 22 17:24:52 2011
@@ -52,22 +52,22 @@
   p
   The previous stable branch of Cassandra continues to see periodic maintenance
   for some time after a new release is made. The lastest oldstable release is
-  0.7.7 (released on 
-  2011-06-16).
+  0.7.8 (released on 
+  2011-07-22).
   /p
 
   ul
 li
-a class=filename 
href=http://www.apache.org/dyn/closer.cgi?path=/cassandra/0.7.7/apache-cassandra-0.7.7-bin.tar.gz;apache-cassandra-0.7.7-bin.tar.gz/a
-[a 
href=http://www.apache.org/dist/cassandra/0.7.7/apache-cassandra-0.7.7-bin.tar.gz.asc;PGP/a]
-[a 
href=http://www.apache.org/dist/cassandra/0.7.7/apache-cassandra-0.7.7-bin.tar.gz.md5;MD5/a]
-[a 
href=http://www.apache.org/dist/cassandra/0.7.7/apache-cassandra-0.7.7-bin.tar.gz.sha;SHA1/a]
+a class=filename 
href=http://www.apache.org/dyn/closer.cgi?path=/cassandra/0.7.8/apache-cassandra-0.7.8-bin.tar.gz;apache-cassandra-0.7.8-bin.tar.gz/a
+[a 
href=http://www.apache.org/dist/cassandra/0.7.8/apache-cassandra-0.7.8-bin.tar.gz.asc;PGP/a]
+[a 
href=http://www.apache.org/dist/cassandra/0.7.8/apache-cassandra-0.7.8-bin.tar.gz.md5;MD5/a]
+[a 
href=http://www.apache.org/dist/cassandra/0.7.8/apache-cassandra-0.7.8-bin.tar.gz.sha;SHA1/a]
 /li
 li
-a class=filename 
href=http://www.apache.org/dyn/closer.cgi?path=/cassandra/0.7.7/apache-cassandra-0.7.7-src.tar.gz;apache-cassandra-0.7.7-src.tar.gz/a
-[a 
href=http://www.apache.org/dist/cassandra/0.7.7/apache-cassandra-0.7.7-src.tar.gz.asc;PGP/a]
-[a 
href=http://www.apache.org/dist/cassandra/0.7.7/apache-cassandra-0.7.7-src.tar.gz.md5;MD5/a]
-[a 
href=http://www.apache.org/dist/cassandra/0.7.7/apache-cassandra-0.7.7-src.tar.gz.sha;SHA1/a]
+a class=filename 
href=http://www.apache.org/dyn/closer.cgi?path=/cassandra/0.7.8/apache-cassandra-0.7.8-src.tar.gz;apache-cassandra-0.7.8-src.tar.gz/a
+[a 
href=http://www.apache.org/dist/cassandra/0.7.8/apache-cassandra-0.7.8-src.tar.gz.asc;PGP/a]
+[a 
href=http://www.apache.org/dist/cassandra/0.7.8/apache-cassandra-0.7.8-src.tar.gz.md5;MD5/a]
+[a 
href=http://www.apache.org/dist/cassandra/0.7.8/apache-cassandra-0.7.8-src.tar.gz.sha;SHA1/a]
 /li
   /ul
   

Modified: cassandra/site/src/settings.py
URL: 
http://svn.apache.org/viewvc/cassandra/site/src/settings.py?rev=1149663r1=1149662r2=1149663view=diff
==
--- cassandra/site/src/settings.py (original)
+++ cassandra/site/src/settings.py Fri Jul 22 17:24:52 2011
@@ -92,8 +92,8 @@ SITE_POST_PROCESSORS = {
 }
 
 class CassandraDef(object):
-oldstable_version = '0.7.7'
-oldstable_release_date = '2011-06-16'
+oldstable_version = '0.7.8'
+oldstable_release_date = '2011-07-22'
 oldstable_exists = True
 stable_version = '0.8.1'
 stable_release_date = '2011-06-28'




svn commit: r1149664 - /cassandra/tags/cassandra-0.7.8/

2011-07-22 Thread slebresne
Author: slebresne
Date: Fri Jul 22 17:26:34 2011
New Revision: 1149664

URL: http://svn.apache.org/viewvc?rev=1149664view=rev
Log:
Create 0.7.8 branch

Added:
cassandra/tags/cassandra-0.7.8/   (props changed)
  - copied from r1149176, cassandra/branches/cassandra-0.7/

Propchange: cassandra/tags/cassandra-0.7.8/
--
--- svn:ignore (added)
+++ svn:ignore Fri Jul 22 17:26:34 2011
@@ -0,0 +1,8 @@
+.classpath
+.project
+.settings
+temp-testng-customsuite.xml
+build
+build.properties
+.idea
+out

Propchange: cassandra/tags/cassandra-0.7.8/
--
--- svn:mergeinfo (added)
+++ svn:mergeinfo Fri Jul 22 17:26:34 2011
@@ -0,0 +1,10 @@
+/cassandra/branches/cassandra-0.6:922689-1131291
+/cassandra/branches/cassandra-0.7:1026516,1035666,1050269
+/cassandra/branches/cassandra-0.7.0:1053690-1055654
+/cassandra/branches/cassandra-0.8:1133389-1133390
+/cassandra/tags/cassandra-0.7.0-rc3:1051699-1053689
+/cassandra/trunk:1026516-1026734,1028929
+/incubator/cassandra/branches/cassandra-0.3:774578-796573
+/incubator/cassandra/branches/cassandra-0.4:810145-834239,834349-834350
+/incubator/cassandra/branches/cassandra-0.5:72-915439
+/incubator/cassandra/branches/cassandra-0.6:911237-922688




[Cassandra Wiki] Update of FAQ by JoaquinCasares

2011-07-22 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on Cassandra Wiki for 
change notification.

The FAQ page has been changed by JoaquinCasares:
http://wiki.apache.org/cassandra/FAQ?action=diffrev1=125rev2=126

   * [[#jconsole_array_arg|Why can't I call jmx method X on jconsole? (ex. 
getNaturalEndpoints)]]
   * [[#max_key_size|What's the maximum key size permitted?]]
   * [[#ubuntu_hangs|I'm using Ubuntu with JNA, and holy crap weird things keep 
hanging and stalling and printing scary tracebacks in dmesg!]]
+  * [[#schema_disagreement|How do I fix schema disagreement errors?]]
  
  Anchor(cant_listen_on_ip_any)
  
@@ -498, +499 @@

  
  If you have more information on the problem and better ways to avoid it, 
please do update this space.
  
+ Anchor(schema_disagreement)
+ == How do I fix schema disagreement errors? ==
+ 
+ This is no longer a problem in Cassandra 0.8, but is still seen in 0.7. 
+ 
+ First, you should open the cassandra-cli and run:
+ connect localhost/9160;
+ describe cluster;
+ 
+ Note which schemas are in the minority and mark down those IPs. Then login to 
each of those machines and stop the Cassandra service/process by running 'sudo 
service cassandra stop' or 'kill pid'. Then, remove the schema* and 
migration* sstables inside of your /var/lib/cassandra/data/system folder (based 
on default settings).
+ 
+ After starting up Cassandra again, your node will notice the missing 
information and pull in the correct data from the cluster.
+ 
+ To confirm everything is on the same schema, use the cassandra-cli to confirm 
'describe cluster;' only returns one schema version.
+ 


[Cassandra Wiki] Trivial Update of FAQ by JoaquinCasares

2011-07-22 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on Cassandra Wiki for 
change notification.

The FAQ page has been changed by JoaquinCasares:
http://wiki.apache.org/cassandra/FAQ?action=diffrev1=126rev2=127

  
  This is no longer a problem in Cassandra 0.8, but is still seen in 0.7. 
  
+ Open the cassandra-cli and run: 'connect localhost/9160;', then 'describe 
cluster;'.
- First, you should open the cassandra-cli and run:
- connect localhost/9160;
- describe cluster;
  
- Note which schemas are in the minority and mark down those IPs. Then login to 
each of those machines and stop the Cassandra service/process by running 'sudo 
service cassandra stop' or 'kill pid'. Then, remove the schema* and 
migration* sstables inside of your /var/lib/cassandra/data/system folder (based 
on default settings).
+ Note which schemas are in the minority and mark down those IPs. Login to each 
of those machines and stop the Cassandra service/process by running 'sudo 
service cassandra stop' or 'kill pid'. Remove the schema* and migration* 
sstables inside of your /var/lib/cassandra/data/system folder (based on default 
settings).
  
- After starting up Cassandra again, your node will notice the missing 
information and pull in the correct data from the cluster.
+ After starting Cassandra again, your node will notice the missing information 
and pull in the correct data from the cluster.
  
  To confirm everything is on the same schema, use the cassandra-cli to confirm 
'describe cluster;' only returns one schema version.
  


[jira] [Assigned] (CASSANDRA-2082) Saved row cache continues to be read past max cache size

2011-07-22 Thread Chris Burroughs (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chris Burroughs reassigned CASSANDRA-2082:
--

Assignee: Chris Burroughs

 Saved row cache continues to be read past max cache size
 

 Key: CASSANDRA-2082
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2082
 Project: Cassandra
  Issue Type: Bug
  Components: Core
Affects Versions: 0.6.11
Reporter: Chris Burroughs
Assignee: Chris Burroughs
Priority: Minor

 Scenario:
  - Node has a saved row cache of size n
  - node OOMs
  - Make row cache size = .5n to prevent OOM while we debug, restart node.
  - n items are still read from the row cache, making startup take twice as 
 long as needed.
 (This is intended as a straightforward bug, not as a hackish CASSANDRA-1966.)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (CASSANDRA-2854) Java Build Path is broken in Eclipse after running generate-eclipse-files Ant target

2011-07-22 Thread Patricio Echague (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13069649#comment-13069649
 ] 

Patricio Echague commented on CASSANDRA-2854:
-

I had this problem with Eclipse 3.6.2 always. Eclipse 3.7 works just fine.

 Java Build Path is broken in Eclipse after running generate-eclipse-files Ant 
 target
 

 Key: CASSANDRA-2854
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2854
 Project: Cassandra
  Issue Type: Bug
  Components: Packaging
Affects Versions: 0.8.1
 Environment: Windows 7 64-bit, Eclipse Helios SR1, Subclipse
Reporter: David Allsopp
Priority: Minor

 Following the instructions in 
 http://wiki.apache.org/cassandra/RunningCassandraInEclipse, but checking out 
 v0.8.1:
 After running the 'generate-eclipse-files' Ant target, the build path is set 
 up to include all the libraries in build/lib/jars, but each library has ;C 
 (semicolon, letter C) appended to it, so Eclipse can't find the libraries - 
 there are about 55 errors like:
 Project 'cassandra-0.8.1' is missing required library: 
 '\Users\David\eclipse_workspace\cassandra-0.8.1\build\lib\jars\commons-cli-1.2.jar;C'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (CASSANDRA-2895) add java classpath to cassandra startup logging

2011-07-22 Thread Jackson Chung (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13069676#comment-13069676
 ] 

Jackson Chung commented on CASSANDRA-2895:
--

sure. First off, I will start by saying it is absolutely possible to still 
obtain the classpath from other techniques, such as jconsole, jinfo, ps, 
/proc/pid/cmdline, etc. All these are doable providing using it properly. 
Some common typical challenges on these other techniques: PATH is difference 
for the user who starts cassandra vs user who ssh into the machine and check, 
resulting in cannot attach the jvm due to jvm mismatched. Cannot attach 
remotely due to permission. ps result truncated. /proc/pidcmdline result is 
ugly (no separator).

We need to know the classpath info to identify which jars contains the classes. 
Granted knowing just the classpath is not enough as one would still need to 
verify that actual path/jar exists (and with proper permission). Down the road 
when hotfixes accumulated (and for the sake of arguments in a scenario where 
the hotfix only contains fixed classes, but not the whole build), we would need 
to identify if a hotfix (jar) is properly set in the classpath to validate the 
java process is running with the hotfix.

a real (small) example: 
 INFO [main] 2011-07-22 11:34:10,113 CLibrary.java (line 61) JNA not found. 
Native methods will be disabled.

well from a end-user perspective, not found where? Of course a 
java-experienced user would most likely intuitively think of class path. But 
for others it may not be obvious. Further support analysts will need to do 
his/her own analysis to determine if the jna.jar is on the classpath and in the 
said-location. (ie jna.jar is in /path/to/ but classpath said 
/path/to/others/). This could be further challenged if it needs to be done 
remotely or the analyst has no direct access to the machine. 

Hence the classpath info is one of the more important info for someone who 
understand not just Cassandra, but java in general of what it is doing.

As to oppose using DEBUG: currently the logging does not have a header sets. 
Ie the log is logged once and wouldn't appear again. Logging at DEBUG for some 
that only logged once at startup means one would have to restart the jvm to see 
the log. That seems overkill for just simply get a log. One may as well 
learn/try to use jinfo/jconsole/ps/cmdline to get that info. 

I agree we wouldn't want every bit of details (that say available via jinfo) to 
be logged, that would noise the log quite a bit. On the other hand, the 
classpath itselfs provides a quick and strong validation to properly identify 
any misconfiguration on classpath settings. 

 add java classpath to cassandra startup logging
 ---

 Key: CASSANDRA-2895
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2895
 Project: Cassandra
  Issue Type: Improvement
Reporter: Jackson Chung
Priority: Minor
 Attachments: 2895.diff


 this is helpful to determine/verify if the Cassandra is started with the 
 expected classpath
 it's a simple 1-liner addon that are useful... will submit a patch later.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (CASSANDRA-2082) Saved row cache continues to be read past max cache size

2011-07-22 Thread Chris Burroughs (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chris Burroughs updated CASSANDRA-2082:
---

Attachment: 0002-v1-unit-test-for-CASSANDRA-2082.patch
0001-v1-Only-load-up-to-capacity-items-into-the-cache.patch

Note that the second patch applies on top of CASSANDRA-1966.

 Saved row cache continues to be read past max cache size
 

 Key: CASSANDRA-2082
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2082
 Project: Cassandra
  Issue Type: Bug
  Components: Core
Affects Versions: 0.6.11
Reporter: Chris Burroughs
Assignee: Chris Burroughs
Priority: Minor
 Attachments: 
 0001-v1-Only-load-up-to-capacity-items-into-the-cache.patch, 
 0002-v1-unit-test-for-CASSANDRA-2082.patch


 Scenario:
  - Node has a saved row cache of size n
  - node OOMs
  - Make row cache size = .5n to prevent OOM while we debug, restart node.
  - n items are still read from the row cache, making startup take twice as 
 long as needed.
 (This is intended as a straightforward bug, not as a hackish CASSANDRA-1966.)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (CASSANDRA-2938) NotFoundException doing a quick succession of insert/get's on the same CF or rowkey

2011-07-22 Thread Cathy Daw (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Cathy Daw updated CASSANDRA-2938:
-

Attachment: t910.py

 NotFoundException doing a quick succession of insert/get's on the same CF or 
 rowkey
 ---

 Key: CASSANDRA-2938
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2938
 Project: Cassandra
  Issue Type: Bug
Affects Versions: 0.8.0
Reporter: Cathy Daw
Priority: Minor
 Attachments: t910.py


 *Issue*
 * A customer complained about pycassa.cassandra.c08.ttypes.NotFoundException: 
 NotFoundException()
 * This issue is related to a quick succession of insert/get's.  See: 
 [http://support.datastax.com/tickets/910]
 * Customer's AWS instance on EBS:  1 row with 10K columns, with sleep code:  
 fails 1/10 inserts
 * Rackspace:
 ** We could not reproduce this with the sleep code left in.  This was tested 
 with the SimpleStrategy and NetworkTopologyStrategy.
 ** 1 row with 10K columns, without sleep code:  fails 1/500 inserts
 ** 10K row with 1 column, without sleep code:  Script passes 2 in 5 attempts. 
  When it fails, it is at about the 4000-5000th insert.
 *Stack*
 {code}
 Traceback (most recent call last):
   File t910.py, line 56, in module
 test()
   File t910.py, line 43, in test
 db.get('testraw', columns=[key, ]) 
   File 
 /usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/columnfamily.py,
  line 391, in get
 read_consistency_level or self.read_consistency_level)
   File 
 /usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/pool.py,
  line 380, in new_f
 result = getattr(super(ConnectionWrapper, self), f.__name__)(*args, 
 **kwargs)
   File 
 /usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/cassandra/c08/Cassandra.py,
  line 422, in get
 return self.recv_get()
   File 
 /usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/cassandra/c08/Cassandra.py,
  line 449, in recv_get
 raise result.nfe
 pycassa.cassandra.c08.ttypes.NotFoundException: NotFoundException()
 {code}
 *Script - also attached*
 {code}
 #!/usr/bin/python
 import time
 import pycassa
 from pycassa import system_manager
 from pycassa.system_manager import *
 def test():
 m = pycassa.system_manager.SystemManager('cathy1:9160')
 pool = pycassa.pool.ConnectionPool('testraw',
 server_list=['cathy1:9160', ], timeout=5, pool_size=16,
 max_overflow=0, prefill=False, pool_timeout=30, max_retries=8)
 kspaces = m.list_keyspaces()
 if not 'testraw' in kspaces:
 m.create_keyspace('testraw', 3)
 cfs = m.get_keyspace_column_families('testraw')
 if 'testraw' not in cfs:
 m.create_column_family('testraw', 'testraw',
 comparator_type=system_manager.BYTES_TYPE,
 default_validation_class=system_manager.BYTES_TYPE,
 row_cache_size=1024 * 1024, key_cache_size=0)
 db = pycassa.ColumnFamily(pool, 'testraw',
 read_consistency_level=pycassa.ConsistencyLevel.QUORUM,
 write_consistency_level=pycassa.ConsistencyLevel.QUORUM)
 try:
 for i in range(1):
 print 'Inserting %d' % i
 # The following code generates 1 row with 10K columns
 key = str(i)
 db.insert('testraw', {key: ''})
 db.get('testraw', columns=[key, ])
 # The following code generates 10K rows with 1 columns
 #key = 'key' + str(i) 
 #db.insert(key, {str(i) : ''}) 
 #db.get(key, columns=[str(i), ]) 
 # time.sleep(.1) 
 finally:
 print 'Done'
 m.drop_keyspace('testraw')
 if __name__ == '__main__':
 test()
 {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (CASSANDRA-2938) NotFoundException doing a quick succession of insert/get's on the same CF or rowkey

2011-07-22 Thread Cathy Daw (JIRA)
NotFoundException doing a quick succession of insert/get's on the same CF or 
rowkey
---

 Key: CASSANDRA-2938
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2938
 Project: Cassandra
  Issue Type: Bug
Affects Versions: 0.8.0
Reporter: Cathy Daw
Priority: Minor
 Attachments: t910.py

*Issue*
* A customer complained about pycassa.cassandra.c08.ttypes.NotFoundException: 
NotFoundException()
* This issue is related to a quick succession of insert/get's.  See: 
[http://support.datastax.com/tickets/910]
* Customer's AWS instance on EBS:  1 row with 10K columns, with sleep code:  
fails 1/10 inserts

* Rackspace:
** We could not reproduce this with the sleep code left in.  This was tested 
with the SimpleStrategy and NetworkTopologyStrategy.
** 1 row with 10K columns, without sleep code:  fails 1/500 inserts
** 10K row with 1 column, without sleep code:  Script passes 2 in 5 attempts.  
When it fails, it is at about the 4000-5000th insert.


*Stack*
{code}
Traceback (most recent call last):
  File t910.py, line 56, in module
test()
  File t910.py, line 43, in test
db.get('testraw', columns=[key, ]) 
  File 
/usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/columnfamily.py,
 line 391, in get
read_consistency_level or self.read_consistency_level)
  File 
/usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/pool.py,
 line 380, in new_f
result = getattr(super(ConnectionWrapper, self), f.__name__)(*args, 
**kwargs)
  File 
/usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/cassandra/c08/Cassandra.py,
 line 422, in get
return self.recv_get()
  File 
/usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/cassandra/c08/Cassandra.py,
 line 449, in recv_get
raise result.nfe
pycassa.cassandra.c08.ttypes.NotFoundException: NotFoundException()
{code}

*Script - also attached*
{code}
#!/usr/bin/python

import time
import pycassa
from pycassa import system_manager
from pycassa.system_manager import *

def test():
m = pycassa.system_manager.SystemManager('cathy1:9160')

pool = pycassa.pool.ConnectionPool('testraw',
server_list=['cathy1:9160', ], timeout=5, pool_size=16,
max_overflow=0, prefill=False, pool_timeout=30, max_retries=8)

kspaces = m.list_keyspaces()

if not 'testraw' in kspaces:
m.create_keyspace('testraw', 3)

cfs = m.get_keyspace_column_families('testraw')

if 'testraw' not in cfs:
m.create_column_family('testraw', 'testraw',

comparator_type=system_manager.BYTES_TYPE,
default_validation_class=system_manager.BYTES_TYPE,
row_cache_size=1024 * 1024, key_cache_size=0)

db = pycassa.ColumnFamily(pool, 'testraw',
read_consistency_level=pycassa.ConsistencyLevel.QUORUM,
write_consistency_level=pycassa.ConsistencyLevel.QUORUM)

try:
for i in range(1):
print 'Inserting %d' % i

# The following code generates 1 row with 10K columns
key = str(i)
db.insert('testraw', {key: ''})
db.get('testraw', columns=[key, ])

# The following code generates 10K rows with 1 columns
#key = 'key' + str(i) 
#db.insert(key, {str(i) : ''}) 
#db.get(key, columns=[str(i), ]) 

# time.sleep(.1) 
finally:
print 'Done'
m.drop_keyspace('testraw')

if __name__ == '__main__':
test()
{code}



--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (CASSANDRA-2938) NotFoundException doing a quick succession of insert/get's on the same CF or rowkey

2011-07-22 Thread Cathy Daw (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Cathy Daw updated CASSANDRA-2938:
-

Description: 
*Issue*
* A customer complained about pycassa.cassandra.c08.ttypes.NotFoundException: 
NotFoundException()
* This issue is related to a quick succession of insert/get's.  See: 
[http://support.datastax.com/tickets/910]
* Customer's AWS instance on EBS:  1 row with 10K columns, with sleep code:  
fails 1/10 inserts

* 3-node test cluster on Rackspace.  
** We could not reproduce this with the sleep code left in.  This was tested 
with the SimpleStrategy and NetworkTopologyStrategy.
** 1 row with 10K columns, without sleep code:  fails 1/500 inserts
** 10K row with 1 column, without sleep code:  Script passes 2 in 5 attempts.  
When it fails, it is at about the 4000-5000th insert.


*Stack*
{code}
Traceback (most recent call last):
  File t910.py, line 56, in module
test()
  File t910.py, line 43, in test
db.get('testraw', columns=[key, ]) 
  File 
/usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/columnfamily.py,
 line 391, in get
read_consistency_level or self.read_consistency_level)
  File 
/usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/pool.py,
 line 380, in new_f
result = getattr(super(ConnectionWrapper, self), f.__name__)(*args, 
**kwargs)
  File 
/usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/cassandra/c08/Cassandra.py,
 line 422, in get
return self.recv_get()
  File 
/usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/cassandra/c08/Cassandra.py,
 line 449, in recv_get
raise result.nfe
pycassa.cassandra.c08.ttypes.NotFoundException: NotFoundException()
{code}

*Script - also attached*
{code}
#!/usr/bin/python

import time
import pycassa
from pycassa import system_manager
from pycassa.system_manager import *

def test():
m = pycassa.system_manager.SystemManager('cathy1:9160')

pool = pycassa.pool.ConnectionPool('testraw',
server_list=['cathy1:9160', ], timeout=5, pool_size=16,
max_overflow=0, prefill=False, pool_timeout=30, max_retries=8)

kspaces = m.list_keyspaces()

if not 'testraw' in kspaces:
m.create_keyspace('testraw', 3)

cfs = m.get_keyspace_column_families('testraw')

if 'testraw' not in cfs:
m.create_column_family('testraw', 'testraw',

comparator_type=system_manager.BYTES_TYPE,
default_validation_class=system_manager.BYTES_TYPE,
row_cache_size=1024 * 1024, key_cache_size=0)

db = pycassa.ColumnFamily(pool, 'testraw',
read_consistency_level=pycassa.ConsistencyLevel.QUORUM,
write_consistency_level=pycassa.ConsistencyLevel.QUORUM)

try:
for i in range(1):
print 'Inserting %d' % i

# The following code generates 1 row with 10K columns
key = str(i)
db.insert('testraw', {key: ''})
db.get('testraw', columns=[key, ])

# The following code generates 10K rows with 1 columns
#key = 'key' + str(i) 
#db.insert(key, {str(i) : ''}) 
#db.get(key, columns=[str(i), ]) 

# time.sleep(.1) 
finally:
print 'Done'
m.drop_keyspace('testraw')

if __name__ == '__main__':
test()
{code}



  was:
*Issue*
* A customer complained about pycassa.cassandra.c08.ttypes.NotFoundException: 
NotFoundException()
* This issue is related to a quick succession of insert/get's.  See: 
[http://support.datastax.com/tickets/910]
* Customer's AWS instance on EBS:  1 row with 10K columns, with sleep code:  
fails 1/10 inserts

* Rackspace:
** We could not reproduce this with the sleep code left in.  This was tested 
with the SimpleStrategy and NetworkTopologyStrategy.
** 1 row with 10K columns, without sleep code:  fails 1/500 inserts
** 10K row with 1 column, without sleep code:  Script passes 2 in 5 attempts.  
When it fails, it is at about the 4000-5000th insert.


*Stack*
{code}
Traceback (most recent call last):
  File t910.py, line 56, in module
test()
  File t910.py, line 43, in test
db.get('testraw', columns=[key, ]) 
  File 
/usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/columnfamily.py,
 line 391, in get
read_consistency_level or self.read_consistency_level)
  File 
/usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/pool.py,
 line 380, in new_f
result = getattr(super(ConnectionWrapper, self), f.__name__)(*args, 
**kwargs)
  File 
/usr/local/lib/python2.6/dist-packages/pycassa-1.1.0-py2.6.egg/pycassa/cassandra/c08/Cassandra.py,
 line 422, in get
 

[Cassandra Wiki] Update of FAQ by BrandonWilliams

2011-07-22 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on Cassandra Wiki for 
change notification.

The FAQ page has been changed by BrandonWilliams:
http://wiki.apache.org/cassandra/FAQ?action=diffrev1=127rev2=128

  Anchor(schema_disagreement)
  == How do I fix schema disagreement errors? ==
  
- This is no longer a problem in Cassandra 0.8, but is still seen in 0.7. 
- 
  Open the cassandra-cli and run: 'connect localhost/9160;', then 'describe 
cluster;'.
  
  Note which schemas are in the minority and mark down those IPs. Login to each 
of those machines and stop the Cassandra service/process by running 'sudo 
service cassandra stop' or 'kill pid'. Remove the schema* and migration* 
sstables inside of your /var/lib/cassandra/data/system folder (based on default 
settings).


[jira] [Created] (CASSANDRA-2939) CQL regex to match column family in query

2011-07-22 Thread Blake Visin (JIRA)
CQL regex to match column family in query
-

 Key: CASSANDRA-2939
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2939
 Project: Cassandra
  Issue Type: Bug
  Components: Drivers
 Environment: Python CQL
Reporter: Blake Visin


In the file cursor.py 
(https://svn.apache.org/repos/asf/cassandra/drivers/py/cql/cursor.py)

Line 37: _cfamily_re = re.compile(\s*SELECT\s+.+\s+FROM\s+[\']?(\w+), re.I | 
re.M)

The Regex will improperly match anything after the word  'from' even if it is 
in the WHERE clause

I believe the fix is:

_cfamily_re = re.compile(\s*SELECT\s+.+?\s+FROM\s+[\']?(\w+), re.I | re.M)

Added the ? so the regex is not so greedy

use this query to reproduce the results:

SELECT key FROM column_family WHERE key = 'break from chores'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (CASSANDRA-2939) CQL regex to match column family in query

2011-07-22 Thread Blake Visin (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13069692#comment-13069692
 ] 

Blake Visin commented on CASSANDRA-2939:


How do I do code blocks?  The regex's don't show up correctly in the 
description and the syntax is underlining it.

 CQL regex to match column family in query
 -

 Key: CASSANDRA-2939
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2939
 Project: Cassandra
  Issue Type: Bug
  Components: Drivers
 Environment: Python CQL
Reporter: Blake Visin
  Labels: CQL, python

 In the file cursor.py 
 (https://svn.apache.org/repos/asf/cassandra/drivers/py/cql/cursor.py)
 Line 37: _cfamily_re = re.compile(\s*SELECT\s+.+\s+FROM\s+[\']?(\w+), re.I 
 | re.M)
 The Regex will improperly match anything after the word  'from' even if it is 
 in the WHERE clause
 I believe the fix is:
 _cfamily_re = re.compile(\s*SELECT\s+.+?\s+FROM\s+[\']?(\w+), re.I | re.M)
 Added the ? so the regex is not so greedy
 use this query to reproduce the results:
 SELECT key FROM column_family WHERE key = 'break from chores'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (CASSANDRA-2939) CQL regex to match column family in query

2011-07-22 Thread Blake Visin (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Blake Visin updated CASSANDRA-2939:
---

Comment: was deleted

(was: How do I do code blocks?  The regex's don't show up correctly in the 
description and the syntax is underlining it.)

 CQL regex to match column family in query
 -

 Key: CASSANDRA-2939
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2939
 Project: Cassandra
  Issue Type: Bug
  Components: Drivers
 Environment: Python CQL
Reporter: Blake Visin
  Labels: CQL, python

 In the file cursor.py 
 (https://svn.apache.org/repos/asf/cassandra/drivers/py/cql/cursor.py)
 {code}Line 37: _cfamily_re = re.compile(\s*SELECT\s+.+\s+FROM\s+[\']?(\w+), 
 re.I | re.M){code}
 The Regex will improperly match anything after the word  'from' even if it is 
 in the WHERE clause
 I believe the fix is:
 {code}_cfamily_re = re.compile(\s*SELECT\s+.+?\s+FROM\s+[\']?(\w+), re.I | 
 re.M){code}
 Added the ? so the regex is not so greedy
 use this query to reproduce the results:
 SELECT key FROM column_family WHERE key = 'break from chores'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (CASSANDRA-2939) CQL regex to match column family in query

2011-07-22 Thread Blake Visin (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Blake Visin updated CASSANDRA-2939:
---

Description: 
In the file cursor.py 
(https://svn.apache.org/repos/asf/cassandra/drivers/py/cql/cursor.py)

{code}Line 37: _cfamily_re = re.compile(\s*SELECT\s+.+\s+FROM\s+[\']?(\w+), 
re.I | re.M){code}

The Regex will improperly match anything after the word  'from' even if it is 
in the WHERE clause

I believe the fix is:

{code}_cfamily_re = re.compile(\s*SELECT\s+.+?\s+FROM\s+[\']?(\w+), re.I | 
re.M){code}

Added the ? so the regex is not so greedy

use this query to reproduce the results:

SELECT key FROM column_family WHERE key = 'break from chores'

  was:
In the file cursor.py 
(https://svn.apache.org/repos/asf/cassandra/drivers/py/cql/cursor.py)

Line 37: _cfamily_re = re.compile(\s*SELECT\s+.+\s+FROM\s+[\']?(\w+), re.I | 
re.M)

The Regex will improperly match anything after the word  'from' even if it is 
in the WHERE clause

I believe the fix is:

_cfamily_re = re.compile(\s*SELECT\s+.+?\s+FROM\s+[\']?(\w+), re.I | re.M)

Added the ? so the regex is not so greedy

use this query to reproduce the results:

SELECT key FROM column_family WHERE key = 'break from chores'


 CQL regex to match column family in query
 -

 Key: CASSANDRA-2939
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2939
 Project: Cassandra
  Issue Type: Bug
  Components: Drivers
 Environment: Python CQL
Reporter: Blake Visin
  Labels: CQL, python

 In the file cursor.py 
 (https://svn.apache.org/repos/asf/cassandra/drivers/py/cql/cursor.py)
 {code}Line 37: _cfamily_re = re.compile(\s*SELECT\s+.+\s+FROM\s+[\']?(\w+), 
 re.I | re.M){code}
 The Regex will improperly match anything after the word  'from' even if it is 
 in the WHERE clause
 I believe the fix is:
 {code}_cfamily_re = re.compile(\s*SELECT\s+.+?\s+FROM\s+[\']?(\w+), re.I | 
 re.M){code}
 Added the ? so the regex is not so greedy
 use this query to reproduce the results:
 SELECT key FROM column_family WHERE key = 'break from chores'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Assigned] (CASSANDRA-2939) CQL regex to match column family in query

2011-07-22 Thread Jonathan Ellis (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jonathan Ellis reassigned CASSANDRA-2939:
-

Assignee: Tyler Hobbs

 CQL regex to match column family in query
 -

 Key: CASSANDRA-2939
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2939
 Project: Cassandra
  Issue Type: Bug
  Components: Drivers
 Environment: Python CQL
Reporter: Blake Visin
Assignee: Tyler Hobbs
  Labels: CQL, python

 In the file cursor.py 
 (https://svn.apache.org/repos/asf/cassandra/drivers/py/cql/cursor.py)
 {code}Line 37: _cfamily_re = re.compile(\s*SELECT\s+.+\s+FROM\s+[\']?(\w+), 
 re.I | re.M){code}
 The Regex will improperly match anything after the word  'from' even if it is 
 in the WHERE clause
 I believe the fix is:
 {code}_cfamily_re = re.compile(\s*SELECT\s+.+?\s+FROM\s+[\']?(\w+), re.I | 
 re.M){code}
 Added the ? so the regex is not so greedy
 use this query to reproduce the results:
 SELECT key FROM column_family WHERE key = 'break from chores'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




svn commit: r1149712 - /cassandra/trunk/src/java/org/apache/cassandra/io/util/MemoryInputStream.java

2011-07-22 Thread jbellis
Author: jbellis
Date: Fri Jul 22 20:01:43 2011
New Revision: 1149712

URL: http://svn.apache.org/viewvc?rev=1149712view=rev
Log:
r/m unnecessary implements from MIS

Modified:
cassandra/trunk/src/java/org/apache/cassandra/io/util/MemoryInputStream.java

Modified: 
cassandra/trunk/src/java/org/apache/cassandra/io/util/MemoryInputStream.java
URL: 
http://svn.apache.org/viewvc/cassandra/trunk/src/java/org/apache/cassandra/io/util/MemoryInputStream.java?rev=1149712r1=1149711r2=1149712view=diff
==
--- 
cassandra/trunk/src/java/org/apache/cassandra/io/util/MemoryInputStream.java 
(original)
+++ 
cassandra/trunk/src/java/org/apache/cassandra/io/util/MemoryInputStream.java 
Fri Jul 22 20:01:43 2011
@@ -21,14 +21,12 @@ package org.apache.cassandra.io.util;
  */
 
 
-import java.io.Closeable;
-import java.io.DataInput;
 import java.io.IOException;
 
 import org.apache.cassandra.cache.FreeableMemory;
 
 
-public class MemoryInputStream extends AbstractDataInput implements DataInput, 
Closeable
+public class MemoryInputStream extends AbstractDataInput
 {
 private final FreeableMemory mem;
 private int position = 0;




svn commit: r1149716 - in /cassandra/branches/cassandra-0.7: CHANGES.txt src/java/org/apache/cassandra/db/ColumnFamilyStore.java src/java/org/apache/cassandra/io/sstable/SSTable.java

2011-07-22 Thread slebresne
Author: slebresne
Date: Fri Jul 22 20:10:50 2011
New Revision: 1149716

URL: http://svn.apache.org/viewvc?rev=1149716view=rev
Log:
Don't include tmp file as sstable when creating cfs
patch by slebresne; reviewed by jbellis for CASSANDRA-2929

Modified:
cassandra/branches/cassandra-0.7/CHANGES.txt

cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/db/ColumnFamilyStore.java

cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/io/sstable/SSTable.java

Modified: cassandra/branches/cassandra-0.7/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-0.7/CHANGES.txt?rev=1149716r1=1149715r2=1149716view=diff
==
--- cassandra/branches/cassandra-0.7/CHANGES.txt (original)
+++ cassandra/branches/cassandra-0.7/CHANGES.txt Fri Jul 22 20:10:50 2011
@@ -1,3 +1,7 @@
+0.7.9
+  * don't include tmp files as sstable when create cfs (CASSANDRA-2929)
+
+
 0.7.8
  * fix possibility of spurious UnavailableException for LOCAL_QUORUM
reads with dynamic snitch + read repair disabled (CASSANDRA-2870)

Modified: 
cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/db/ColumnFamilyStore.java
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/db/ColumnFamilyStore.java?rev=1149716r1=1149715r2=1149716view=diff
==
--- 
cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/db/ColumnFamilyStore.java
 (original)
+++ 
cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/db/ColumnFamilyStore.java
 Fri Jul 22 20:10:50 2011
@@ -225,7 +225,7 @@ public class ColumnFamilyStore implement
 ssTables = new SSTableTracker(table.name, columnFamilyName);
 SetDecoratedKey savedKeys = 
readSavedCache(DatabaseDescriptor.getSerializedKeyCachePath(table.name, 
columnFamilyName));
 ListSSTableReader sstables = new ArrayListSSTableReader();
-for (Map.EntryDescriptor,SetComponent sstableFiles : 
files(table.name, columnFamilyName, false).entrySet())
+for (Map.EntryDescriptor,SetComponent sstableFiles : 
files(table.name, columnFamilyName, false, false).entrySet())
 {
 SSTableReader sstable;
 try
@@ -499,7 +499,7 @@ public class ColumnFamilyStore implement
  */
 public static void scrubDataDirectories(String table, String columnFamily)
 {
-for (Map.EntryDescriptor,SetComponent sstableFiles : files(table, 
columnFamily, true).entrySet())
+for (Map.EntryDescriptor,SetComponent sstableFiles : files(table, 
columnFamily, true, true).entrySet())
 {
 Descriptor desc = sstableFiles.getKey();
 SetComponent components = sstableFiles.getValue();
@@ -628,7 +628,7 @@ public class ColumnFamilyStore implement
 /**
  * Collects a map of sstable components.
  */
-private static MapDescriptor,SetComponent files(String keyspace, final 
String columnFamily, final boolean includeCompacted)
+private static MapDescriptor,SetComponent files(String keyspace, final 
String columnFamily, final boolean includeCompacted, final boolean 
includeTemporary)
 {
 final MapDescriptor,SetComponent sstables = new 
HashMapDescriptor,SetComponent();
 for (String directory : 
DatabaseDescriptor.getAllDataFileLocationsForTable(keyspace))
@@ -637,7 +637,8 @@ public class ColumnFamilyStore implement
 {
 if (component != null  
component.left.cfname.equals(columnFamily))
 {
-if (includeCompacted || !new 
File(component.left.filenameFor(Component.COMPACTED_MARKER)).exists())
+if ((includeCompacted || !new 
File(component.left.filenameFor(Component.COMPACTED_MARKER)).exists())
+  (includeTemporary || !component.left.temporary))
 {
 SetComponent components = 
sstables.get(component.left);
 if (components == null)

Modified: 
cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/io/sstable/SSTable.java
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/io/sstable/SSTable.java?rev=1149716r1=1149715r2=1149716view=diff
==
--- 
cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/io/sstable/SSTable.java
 (original)
+++ 
cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/io/sstable/SSTable.java
 Fri Jul 22 20:10:50 2011
@@ -230,7 +230,7 @@ public abstract class SSTable
 FileUtils.skipBytesFully(ifile, 8);
 keys++;
 }
-assert keys  0  ifile.getFilePointer()  0  ifile.length()  0;
+assert keys  0  ifile.getFilePointer()  0  ifile.length()  0 : 
Unexpected empty index file:  + ifile;
 long 

svn commit: r1149725 - in /cassandra/branches/cassandra-0.8: ./ contrib/ interface/thrift/gen-java/org/apache/cassandra/thrift/ src/java/org/apache/cassandra/db/ src/java/org/apache/cassandra/io/sstab

2011-07-22 Thread slebresne
Author: slebresne
Date: Fri Jul 22 20:22:01 2011
New Revision: 1149725

URL: http://svn.apache.org/viewvc?rev=1149725view=rev
Log:
merge from 0.7

Modified:
cassandra/branches/cassandra-0.8/   (props changed)
cassandra/branches/cassandra-0.8/contrib/   (props changed)

cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java
   (props changed)

cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java
   (props changed)

cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/InvalidRequestException.java
   (props changed)

cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/NotFoundException.java
   (props changed)

cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/SuperColumn.java
   (props changed)

cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/db/ColumnFamilyStore.java

cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/io/sstable/SSTable.java

Propchange: cassandra/branches/cassandra-0.8/
--
--- svn:mergeinfo (original)
+++ svn:mergeinfo Fri Jul 22 20:22:01 2011
@@ -1,5 +1,5 @@
 
/cassandra/branches/cassandra-0.6:922689-1052356,1052358-1053452,1053454,1053456-1131291
-/cassandra/branches/cassandra-0.7:1026516-1149015
+/cassandra/branches/cassandra-0.7:1026516-1149015,1149716
 /cassandra/branches/cassandra-0.7.0:1053690-1055654
 /cassandra/branches/cassandra-0.8:1090934-1125013,1125041
 /cassandra/branches/cassandra-0.8.0:1125021-1130369

Propchange: cassandra/branches/cassandra-0.8/contrib/
--
--- svn:mergeinfo (original)
+++ svn:mergeinfo Fri Jul 22 20:22:01 2011
@@ -1,5 +1,5 @@
 
/cassandra/branches/cassandra-0.6/contrib:922689-1052356,1052358-1053452,1053454,1053456-1068009
-/cassandra/branches/cassandra-0.7/contrib:1026516-1149015
+/cassandra/branches/cassandra-0.7/contrib:1026516-1149015,1149716
 /cassandra/branches/cassandra-0.7.0/contrib:1053690-1055654
 /cassandra/branches/cassandra-0.8/contrib:1090934-1125013,1125041
 /cassandra/branches/cassandra-0.8.0/contrib:1125021-1130369

Propchange: 
cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java
--
--- svn:mergeinfo (original)
+++ svn:mergeinfo Fri Jul 22 20:22:01 2011
@@ -1,5 +1,5 @@
 
/cassandra/branches/cassandra-0.6/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:922689-1052356,1052358-1053452,1053454,1053456-1131291
-/cassandra/branches/cassandra-0.7/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:1026516-1149015
+/cassandra/branches/cassandra-0.7/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:1026516-1149015,1149716
 
/cassandra/branches/cassandra-0.7.0/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:1053690-1055654
 
/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:1090934-1125013,1125041
 
/cassandra/branches/cassandra-0.8.0/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:1125021-1130369

Propchange: 
cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java
--
--- svn:mergeinfo (original)
+++ svn:mergeinfo Fri Jul 22 20:22:01 2011
@@ -1,5 +1,5 @@
 
/cassandra/branches/cassandra-0.6/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java:922689-1052356,1052358-1053452,1053454,1053456-1131291
-/cassandra/branches/cassandra-0.7/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java:1026516-1149015
+/cassandra/branches/cassandra-0.7/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java:1026516-1149015,1149716
 
/cassandra/branches/cassandra-0.7.0/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java:1053690-1055654
 
/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java:1090934-1125013,1125041
 
/cassandra/branches/cassandra-0.8.0/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java:1125021-1130369

Propchange: 
cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/InvalidRequestException.java
--
--- svn:mergeinfo (original)
+++ svn:mergeinfo Fri Jul 22 20:22:01 2011
@@ -1,5 +1,5 @@
 
/cassandra/branches/cassandra-0.6/interface/thrift/gen-java/org/apache/cassandra/thrift/InvalidRequestException.java:922689-1052356,1052358-1053452,1053454,1053456-1131291

svn commit: r1149726 - in /cassandra/trunk: ./ contrib/ interface/thrift/gen-java/org/apache/cassandra/thrift/ src/java/org/apache/cassandra/db/ src/java/org/apache/cassandra/io/sstable/

2011-07-22 Thread slebresne
Author: slebresne
Date: Fri Jul 22 20:26:15 2011
New Revision: 1149726

URL: http://svn.apache.org/viewvc?rev=1149726view=rev
Log:
merge from 0.8

Modified:
cassandra/trunk/   (props changed)
cassandra/trunk/contrib/   (props changed)

cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java
   (props changed)

cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java
   (props changed)

cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/InvalidRequestException.java
   (props changed)

cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/NotFoundException.java
   (props changed)

cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/SuperColumn.java
   (props changed)
cassandra/trunk/src/java/org/apache/cassandra/db/ColumnFamilyStore.java
cassandra/trunk/src/java/org/apache/cassandra/io/sstable/SSTable.java

Propchange: cassandra/trunk/
--
--- svn:mergeinfo (original)
+++ svn:mergeinfo Fri Jul 22 20:26:15 2011
@@ -1,7 +1,7 @@
 
/cassandra/branches/cassandra-0.6:922689-1052356,1052358-1053452,1053454,1053456-1131291
-/cassandra/branches/cassandra-0.7:1026516-1149015
+/cassandra/branches/cassandra-0.7:1026516-1149015,1149716
 /cassandra/branches/cassandra-0.7.0:1053690-1055654
-/cassandra/branches/cassandra-0.8:1090934-1125013,1125019-1149016
+/cassandra/branches/cassandra-0.8:1090934-1125013,1125019-1149016,1149725
 /cassandra/branches/cassandra-0.8.0:1125021-1130369
 /cassandra/branches/cassandra-0.8.1:1101014-1125018
 /cassandra/tags/cassandra-0.7.0-rc3:1051699-1053689

Propchange: cassandra/trunk/contrib/
--
--- svn:mergeinfo (original)
+++ svn:mergeinfo Fri Jul 22 20:26:15 2011
@@ -1,7 +1,7 @@
 
/cassandra/branches/cassandra-0.6/contrib:922689-1052356,1052358-1053452,1053454,1053456-1068009
-/cassandra/branches/cassandra-0.7/contrib:1026516-1149015
+/cassandra/branches/cassandra-0.7/contrib:1026516-1149015,1149716
 /cassandra/branches/cassandra-0.7.0/contrib:1053690-1055654
-/cassandra/branches/cassandra-0.8/contrib:1090934-1125013,1125019-1149016
+/cassandra/branches/cassandra-0.8/contrib:1090934-1125013,1125019-1149016,1149725
 /cassandra/branches/cassandra-0.8.0/contrib:1125021-1130369
 /cassandra/branches/cassandra-0.8.1/contrib:1101014-1125018
 /cassandra/tags/cassandra-0.7.0-rc3/contrib:1051699-1053689

Propchange: 
cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java
--
--- svn:mergeinfo (original)
+++ svn:mergeinfo Fri Jul 22 20:26:15 2011
@@ -1,7 +1,7 @@
 
/cassandra/branches/cassandra-0.6/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:922689-1052356,1052358-1053452,1053454,1053456-1131291
-/cassandra/branches/cassandra-0.7/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:1026516-1149015
+/cassandra/branches/cassandra-0.7/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:1026516-1149015,1149716
 
/cassandra/branches/cassandra-0.7.0/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:1053690-1055654
-/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:1090934-1125013,1125019-1149016
+/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:1090934-1125013,1125019-1149016,1149725
 
/cassandra/branches/cassandra-0.8.0/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:1125021-1130369
 
/cassandra/branches/cassandra-0.8.1/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:1101014-1125018
 
/cassandra/tags/cassandra-0.7.0-rc3/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java:1051699-1053689

Propchange: 
cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java
--
--- svn:mergeinfo (original)
+++ svn:mergeinfo Fri Jul 22 20:26:15 2011
@@ -1,7 +1,7 @@
 
/cassandra/branches/cassandra-0.6/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java:922689-1052356,1052358-1053452,1053454,1053456-1131291
-/cassandra/branches/cassandra-0.7/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java:1026516-1149015
+/cassandra/branches/cassandra-0.7/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java:1026516-1149015,1149716
 
/cassandra/branches/cassandra-0.7.0/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java:1053690-1055654
-/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java:1090934-1125013,1125019-1149016

[jira] [Commented] (CASSANDRA-2921) Split BufferedRandomAccessFile (BRAF) into Input and Output classes

2011-07-22 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13069733#comment-13069733
 ] 

Hudson commented on CASSANDRA-2921:
---

Integrated in Cassandra #970 (See 
[https://builds.apache.org/job/Cassandra/970/])
split BRAF into RandomAccessReader and SequentialWriter
patch by pyaskevich and jbellis for CASSANDRA-2921

jbellis : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1149628
Files : 
* /cassandra/trunk/src/java/org/apache/cassandra/io/sstable/SSTable.java
* /cassandra/trunk/src/java/org/apache/cassandra/io/sstable/KeyIterator.java
* /cassandra/trunk/src/java/org/apache/cassandra/io/sstable/SSTableScanner.java
* /cassandra/trunk/test/unit/org/apache/cassandra/db/TableTest.java
* 
/cassandra/trunk/src/java/org/apache/cassandra/db/commitlog/CommitLogSegment.java
* /cassandra/trunk/test/long/org/apache/cassandra/db/LongTableTest.java
* /cassandra/trunk/src/java/org/apache/cassandra/db/commitlog/CommitLog.java
* 
/cassandra/trunk/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
* /cassandra/trunk/src/java/org/apache/cassandra/io/sstable/SSTableWriter.java
* /cassandra/trunk/src/java/org/apache/cassandra/tools/SSTableExport.java
* /cassandra/trunk/src/java/org/apache/cassandra/utils/CLibrary.java
* /cassandra/trunk/src/java/org/apache/cassandra/io/util/SequentialWriter.java
* /cassandra/trunk/src/java/org/apache/cassandra/cache/AutoSavingCache.java
* 
/cassandra/trunk/src/java/org/apache/cassandra/io/util/BufferedSegmentedFile.java
* 
/cassandra/trunk/src/java/org/apache/cassandra/io/util/MmappedSegmentedFile.java
* 
/cassandra/trunk/src/java/org/apache/cassandra/io/sstable/SSTableIdentityIterator.java
* /cassandra/trunk/src/java/org/apache/cassandra/io/util/RandomAccessReader.java
* 
/cassandra/trunk/test/unit/org/apache/cassandra/io/sstable/SSTableWriterCommutativeTest.java
* 
/cassandra/trunk/test/unit/org/apache/cassandra/io/util/BufferedRandomAccessFileTest.java
* /cassandra/trunk/test/unit/org/apache/cassandra/io/sstable/SSTableTest.java
* /cassandra/trunk/src/java/org/apache/cassandra/io/sstable/SSTableReader.java
* 
/cassandra/trunk/src/java/org/apache/cassandra/io/util/BufferedRandomAccessFile.java


 Split BufferedRandomAccessFile (BRAF) into Input and Output classes 
 

 Key: CASSANDRA-2921
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2921
 Project: Cassandra
  Issue Type: Improvement
  Components: Core
Reporter: Pavel Yaskevich
Assignee: Pavel Yaskevich
 Fix For: 1.0

 Attachments: 2921-v3.txt, CASSANDRA-2921-make-Writer-a-stream.patch, 
 CASSANDRA-2921-v2.patch, CASSANDRA-2921-v4.patch, CASSANDRA-2921.patch


 Split BRAF into Input and Output classes to void complexity related to random 
 I/O in write mode that we don't need any more, see CASSANDRA-2879. And make 
 implementation more clean and reusable.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (CASSANDRA-2929) Don't include tmp files as sstable when create column families

2011-07-22 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13069793#comment-13069793
 ] 

Hudson commented on CASSANDRA-2929:
---

Integrated in Cassandra-0.7 #535 (See 
[https://builds.apache.org/job/Cassandra-0.7/535/])
Don't include tmp file as sstable when creating cfs
patch by slebresne; reviewed by jbellis for CASSANDRA-2929

slebresne : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1149716
Files : 
* /cassandra/branches/cassandra-0.7/CHANGES.txt
* 
/cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/db/ColumnFamilyStore.java
* 
/cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/io/sstable/SSTable.java


 Don't include tmp files as sstable when create column families
 --

 Key: CASSANDRA-2929
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2929
 Project: Cassandra
  Issue Type: Bug
  Components: Core
Affects Versions: 0.7.0
Reporter: Sylvain Lebresne
Assignee: Sylvain Lebresne
Priority: Trivial
 Fix For: 0.7.9

 Attachments: 
 0001-Don-t-include-tmp-files-as-sstables-when-creating-CF.patch


 When we open a column family and populate the SSTableReader, we happen to 
 include -tmp files. This has no change to actually happen in a real life 
 situation, but that is what was triggering a race in the unit tests 
 triggering spurious assertion failure in estimateRowsFromIndex.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (CASSANDRA-2895) add java classpath to cassandra startup logging

2011-07-22 Thread Rick Shaw (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13069802#comment-13069802
 ] 

Rick Shaw commented on CASSANDRA-2895:
--

This will only be logged once at startup. Why not just put:


{{echo CLASSPATH  =  $CLASSPATH}}


after the definition of {{CLASSPATH}} in the {{cassandra.in.sh}} file in the 
{{/bin}} directory? 

 add java classpath to cassandra startup logging
 ---

 Key: CASSANDRA-2895
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2895
 Project: Cassandra
  Issue Type: Improvement
Reporter: Jackson Chung
Priority: Minor
 Attachments: 2895.diff


 this is helpful to determine/verify if the Cassandra is started with the 
 expected classpath
 it's a simple 1-liner addon that are useful... will submit a patch later.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (CASSANDRA-2940) Make rpc_timeout_in_ms into a jmx mbean property

2011-07-22 Thread Jeremy Hanna (JIRA)
Make rpc_timeout_in_ms into a jmx mbean property


 Key: CASSANDRA-2940
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2940
 Project: Cassandra
  Issue Type: Improvement
Reporter: Jeremy Hanna


When using the hadoop integration especially, experimenting with 
rpc_timeout_in_ms is a pain if you have to restart every server in the cluster 
for it to take effect.  This would be an improvement to make it into a jmx 
mbean property to set it at runtime.  The yaml file could be updated separately 
so it would be persistent still.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (CASSANDRA-2940) Make rpc_timeout_in_ms into a jmx mbean property

2011-07-22 Thread Jeremy Hanna (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jeremy Hanna updated CASSANDRA-2940:


Labels: lhf  (was: )

 Make rpc_timeout_in_ms into a jmx mbean property
 

 Key: CASSANDRA-2940
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2940
 Project: Cassandra
  Issue Type: Improvement
Reporter: Jeremy Hanna
  Labels: lhf

 When using the hadoop integration especially, experimenting with 
 rpc_timeout_in_ms is a pain if you have to restart every server in the 
 cluster for it to take effect.  This would be an improvement to make it into 
 a jmx mbean property to set it at runtime.  The yaml file could be updated 
 separately so it would be persistent still.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




svn commit: r1149759 - /cassandra/branches/cassandra-0.8/doc/cql/CQL.textile

2011-07-22 Thread eevans
Author: eevans
Date: Fri Jul 22 23:23:12 2011
New Revision: 1149759

URL: http://svn.apache.org/viewvc?rev=1149759view=rev
Log:
bump CQL version

Patch by eevans for CASSANDRA-1709

Modified:
cassandra/branches/cassandra-0.8/doc/cql/CQL.textile

Modified: cassandra/branches/cassandra-0.8/doc/cql/CQL.textile
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-0.8/doc/cql/CQL.textile?rev=1149759r1=1149758r2=1149759view=diff
==
--- cassandra/branches/cassandra-0.8/doc/cql/CQL.textile (original)
+++ cassandra/branches/cassandra-0.8/doc/cql/CQL.textile Fri Jul 22 23:23:12 
2011
@@ -1,4 +1,4 @@
-h1. Cassandra Query Language (CQL) v1.0.0
+h1. Cassandra Query Language (CQL) v1.1.0
 
 h2. Table of Contents
 
@@ -364,5 +364,8 @@ Versioning of the CQL language adheres t
 h1. Changes
 
 pre. 
+Sat, 01 Jun 2011 15:58:00 -0600 - Pavel Yaskevich
+ * Updated to support ALTER (CASSANDRA-1709)
+
 Tue, 22 Mar 2011 18:10:28 -0700 - Eric Evans eev...@rackspace.com
  * Initial version, 1.0.0




[jira] [Updated] (CASSANDRA-2496) Gossip should handle 'dead' states

2011-07-22 Thread Brandon Williams (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Brandon Williams updated CASSANDRA-2496:


Attachment: 0008-only-handleStateRemoving-if-the-node-is-a-member.patch
0007-Always-update-epstate-timestamps-when-the-node-is-al.patch

0007 handles problems when a node has been down longer than aVeryLongTime, and 
ensures that we advertise the new token states long enough.

0008 makes sure that SS only get involved with removal if the token is a member.

 Gossip should handle 'dead' states
 --

 Key: CASSANDRA-2496
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2496
 Project: Cassandra
  Issue Type: Bug
  Components: Core
Reporter: Brandon Williams
Assignee: Brandon Williams
 Attachments: 0001-Rework-token-removal-process.txt, 
 0002-add-2115-back.txt, 0003-update-gossip-related-comments.patch.txt, 
 0004-do-REMOVING_TOKEN-REMOVED_TOKEN.patch.txt, 
 0005-drain-self-if-removetoken-d-elsewhere.patch.txt, 
 0006-acknowledge-unexpected-repl-fins.patch.txt, 
 0007-Always-update-epstate-timestamps-when-the-node-is-al.patch, 
 0008-only-handleStateRemoving-if-the-node-is-a-member.patch


 For background, see CASSANDRA-2371

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (CASSANDRA-2941) Expose number of rpc timeouts for individual hosts metric via jmx

2011-07-22 Thread Melvin Wang (JIRA)
Expose number of rpc timeouts for individual hosts metric via jmx 
--

 Key: CASSANDRA-2941
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2941
 Project: Cassandra
  Issue Type: Improvement
Reporter: Melvin Wang
Assignee: Melvin Wang
Priority: Minor


We have a total number timeouts for each node. It's better for monitoring to 
break down this total number into number of timeouts per host that this node 
tried to connect to.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (CASSANDRA-2941) Expose number of rpc timeouts for individual hosts metric via jmx

2011-07-22 Thread Melvin Wang (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Melvin Wang updated CASSANDRA-2941:
---

Attachment: twttr-cassandra-0.8-counts-resync-timeouts-metric.diff

expose the number of timeouts per host.
expose the delta of this metric.


 Expose number of rpc timeouts for individual hosts metric via jmx 
 --

 Key: CASSANDRA-2941
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2941
 Project: Cassandra
  Issue Type: Improvement
Reporter: Melvin Wang
Assignee: Melvin Wang
Priority: Minor
 Attachments: twttr-cassandra-0.8-counts-resync-timeouts-metric.diff


 We have a total number timeouts for each node. It's better for monitoring to 
 break down this total number into number of timeouts per host that this node 
 tried to connect to.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (CASSANDRA-2942) If you drop a CF when one node is down the files are orphaned on the downed node

2011-07-22 Thread Cathy Daw (JIRA)
If you drop a CF when one node is down the files are orphaned on the downed node


 Key: CASSANDRA-2942
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2942
 Project: Cassandra
  Issue Type: Bug
Reporter: Cathy Daw
Priority: Minor



* Bring up 3 node cluster
* From node1: Run Stress Tool
{code} stress --num-keys=10 --columns=10 --consistency-level=ALL 
--average-size-values --replication-factor=3 --nodes=node1,node2 {code}
* Shutdown node3
* From node1: drop the Standard1 CF in Keyspace1
* Shutdown node2 and node3
* Bring up node1 and node2. Check that the Standard1 files are gone.
{code}
ls -al /var/lib/cassandra/data/Keyspace1/
{code}
* Bring up node3. The log file shows the drop column family occurs
{code}
 INFO 00:51:25,742 Applying migration 9a76f880-b4c5-11e0--8901a7c5c9ce Drop 
column family: Keyspace1.Standard1
{code}
* Restart node3 to clear out dropped tables from the filesystem
{code}
root@cathy3:~/cass-0.8/bin# ls -al /var/lib/cassandra/data/Keyspace1/
total 36
drwxr-xr-x 3 root root 4096 Jul 23 00:51 .
drwxr-xr-x 6 root root 4096 Jul 23 00:48 ..
-rw-r--r-- 1 root root0 Jul 23 00:51 Standard1-g-1-Compacted
-rw-r--r-- 2 root root 5770 Jul 23 00:51 Standard1-g-1-Data.db
-rw-r--r-- 2 root root   32 Jul 23 00:51 Standard1-g-1-Filter.db
-rw-r--r-- 2 root root  120 Jul 23 00:51 Standard1-g-1-Index.db
-rw-r--r-- 2 root root 4276 Jul 23 00:51 Standard1-g-1-Statistics.db
drwxr-xr-x 3 root root 4096 Jul 23 00:51 snapshots
{code}
*Bug:  The files for Standard1 are orphaned on node3*



--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (CASSANDRA-1709) CQL keyspace and column family management

2011-07-22 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13069876#comment-13069876
 ] 

Hudson commented on CASSANDRA-1709:
---

Integrated in Cassandra-0.8 #236 (See 
[https://builds.apache.org/job/Cassandra-0.8/236/])
bump CQL version

Patch by eevans for CASSANDRA-1709

eevans : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1149759
Files : 
* /cassandra/branches/cassandra-0.8/doc/cql/CQL.textile


 CQL keyspace and column family management
 -

 Key: CASSANDRA-1709
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1709
 Project: Cassandra
  Issue Type: Sub-task
  Components: API
Affects Versions: 0.8 beta 1
Reporter: Eric Evans
Assignee: Pavel Yaskevich
Priority: Minor
  Labels: cql
 Fix For: 0.8.1

 Attachments: CASSANDRA-1709-alter-table-statement-v2.patch, 
 CASSANDRA-1709-alter-table-statement.patch, 
 v1-0001-CASSANDRA-1709-CQL-DROP-implementations.txt, 
 v1-0002-system-tests-for-CQL-DROPs.txt, v1-0003-updated-doco-for-CQL-DROPs.txt

   Original Estimate: 0h
  Remaining Estimate: 0h

 CQL specification and implementation for schema management.
 This corresponds to the following RPC methods:
 * system_add_column_family()
 * system_add_keyspace()
 * system_drop_keyspace()
 * system_update_keyspace()
 * system_update_columnfamily()
 *Update: 2011-04-11*
 All that remains for the Cassandra 1.0 timeline is {{ALTER}} (scroll down for 
 the agreed upon specification).  {{CREATE}} and {{DROP}} are complete.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Assigned] (CASSANDRA-2942) If you drop a CF when one node is down the files are orphaned on the downed node

2011-07-22 Thread Jonathan Ellis (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jonathan Ellis reassigned CASSANDRA-2942:
-

Assignee: Sylvain Lebresne

You should be able to reproduce this even on a single node -- just drop a CF, 
then restart.  It only cleans out marked-for-delete files from known CFs.

May be fixed by CASSANDRA-2521.  Otherwise we can add go ahead and clear out 
marked-for-delete files, even if they don't belong to an active CF logic.

 If you drop a CF when one node is down the files are orphaned on the downed 
 node
 

 Key: CASSANDRA-2942
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2942
 Project: Cassandra
  Issue Type: Bug
Reporter: Cathy Daw
Assignee: Sylvain Lebresne
Priority: Minor

 * Bring up 3 node cluster
 * From node1: Run Stress Tool
 {code} stress --num-keys=10 --columns=10 --consistency-level=ALL 
 --average-size-values --replication-factor=3 --nodes=node1,node2 {code}
 * Shutdown node3
 * From node1: drop the Standard1 CF in Keyspace1
 * Shutdown node2 and node3
 * Bring up node1 and node2. Check that the Standard1 files are gone.
 {code}
 ls -al /var/lib/cassandra/data/Keyspace1/
 {code}
 * Bring up node3. The log file shows the drop column family occurs
 {code}
  INFO 00:51:25,742 Applying migration 9a76f880-b4c5-11e0--8901a7c5c9ce 
 Drop column family: Keyspace1.Standard1
 {code}
 * Restart node3 to clear out dropped tables from the filesystem
 {code}
 root@cathy3:~/cass-0.8/bin# ls -al /var/lib/cassandra/data/Keyspace1/
 total 36
 drwxr-xr-x 3 root root 4096 Jul 23 00:51 .
 drwxr-xr-x 6 root root 4096 Jul 23 00:48 ..
 -rw-r--r-- 1 root root0 Jul 23 00:51 Standard1-g-1-Compacted
 -rw-r--r-- 2 root root 5770 Jul 23 00:51 Standard1-g-1-Data.db
 -rw-r--r-- 2 root root   32 Jul 23 00:51 Standard1-g-1-Filter.db
 -rw-r--r-- 2 root root  120 Jul 23 00:51 Standard1-g-1-Index.db
 -rw-r--r-- 2 root root 4276 Jul 23 00:51 Standard1-g-1-Statistics.db
 drwxr-xr-x 3 root root 4096 Jul 23 00:51 snapshots
 {code}
 *Bug:  The files for Standard1 are orphaned on node3*

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (CASSANDRA-2943) add ability to drop local tasks that will timeout anyway

2011-07-22 Thread Jonathan Ellis (JIRA)
add ability to drop local tasks that will timeout anyway


 Key: CASSANDRA-2943
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2943
 Project: Cassandra
  Issue Type: Improvement
Affects Versions: 0.6.4
Reporter: Jonathan Ellis
Assignee: Jonathan Ellis
Priority: Minor
 Fix For: 0.8.2


back in CASSANDRA-685 we added the ability to drop messages that we know are 
going to timeout, as a protection when Cassandra is overloaded.  But this logic 
is in MessageDeliveryTask, so when we skip MessagingService as an optimization 
for local delivery, we also skip the timeout check.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (CASSANDRA-2943) add ability to drop local tasks that will timeout anyway

2011-07-22 Thread Jonathan Ellis (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jonathan Ellis updated CASSANDRA-2943:
--

Attachment: 2943.txt

Adds DroppableRunnable class.

 add ability to drop local tasks that will timeout anyway
 

 Key: CASSANDRA-2943
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2943
 Project: Cassandra
  Issue Type: Improvement
Affects Versions: 0.6.4
Reporter: Jonathan Ellis
Assignee: Jonathan Ellis
Priority: Minor
 Fix For: 0.8.2

 Attachments: 2943.txt


 back in CASSANDRA-685 we added the ability to drop messages that we know are 
 going to timeout, as a protection when Cassandra is overloaded.  But this 
 logic is in MessageDeliveryTask, so when we skip MessagingService as an 
 optimization for local delivery, we also skip the timeout check.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira