[Cassandra Wiki] Update of "NodeProbe" by JoaquinCasares

2011-03-06 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Cassandra Wiki" for 
change notification.

The "NodeProbe" page has been changed by JoaquinCasares.
The comment on this change is: Added a comment about the deletion of compacted 
tables requiring the jvm's GC..
http://wiki.apache.org/cassandra/NodeProbe?action=diff&rev1=11&rev2=12

--

  bin/nodetool -host 10.176.0.146 cleanup
  }}}
  == Compact ==
- Initiates an immediate table compaction.
+ Initiates an immediate table compaction. 
+ 
+ Note: the compacted tables will not immediately be cleared from the hard disk 
and will remain on the system until the JVM performs a GC. For more 
information, read about 
[[http://wiki.apache.org/cassandra/MemtableSSTable|MemtableSSTables]].
  
  {{{
  bin/nodetool -host 10.176.0.146 compact


[jira] Commented: (CASSANDRA-2277) parameter substitution for Java CQL driver

2011-03-06 Thread Vivek Mishra (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13003274#comment-13003274
 ] 

Vivek Mishra commented on CASSANDRA-2277:
-

Can we link it with Cassandra-2124?

> parameter substitution for Java CQL driver
> --
>
> Key: CASSANDRA-2277
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2277
> Project: Cassandra
>  Issue Type: Sub-task
>  Components: API
>Reporter: Eric Evans
>  Labels: cql
> Fix For: 0.8
>
>
> The Java driver should support parameter substitution such that given a query 
> string and a sequence of arguments, question marks ('?') in the query string 
> will be substituted with the arguments.
> {code:style=Java}
> conn.execute("SELECT ?,? FROM Standard1 WHERE KEY = ?", 10, 20, "foo")
> {code} 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] Commented: (CASSANDRA-2277) parameter substitution for Java CQL driver

2011-03-06 Thread Vivek Mishra (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13003273#comment-13003273
 ] 

Vivek Mishra commented on CASSANDRA-2277:
-

Eric,
I can take up this one. Possible to assign to me?

Vivek

> parameter substitution for Java CQL driver
> --
>
> Key: CASSANDRA-2277
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2277
> Project: Cassandra
>  Issue Type: Sub-task
>  Components: API
>Reporter: Eric Evans
>  Labels: cql
> Fix For: 0.8
>
>
> The Java driver should support parameter substitution such that given a query 
> string and a sequence of arguments, question marks ('?') in the query string 
> will be substituted with the arguments.
> {code:style=Java}
> conn.execute("SELECT ?,? FROM Standard1 WHERE KEY = ?", 10, 20, "foo")
> {code} 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] Commented: (CASSANDRA-2088) Temp files for failed compactions/streaming not cleaned up

2011-03-06 Thread Aaron Morton (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13003264#comment-13003264
 ] 

Aaron Morton commented on CASSANDRA-2088:
-

I'm keen to try this ticket (to learn more about compaction and repair) if it's 
not already been worked on. Also if it's ok for me to take a couple of days 
while I dig into this.

For compaction I'm looking in
- CompactionManager.doCompaction where it creates a new SSTableWriter via 
cfs.createCompactionWriter() 
- CompactionManager.doCleanupCompaction() also uses an SSTableWriter

Are the sorts of failures we're considering for compaction ones that come from 
the CompactionIterator or SSTableScanner ?

For repair I'm looking in:
- IncomingStreamReader appears to clean up the temporary pending file in some 
error situations. Do we have any more info on the sorts of failures here? e.g. 
If there is an IOException sending the re-stream message, or a non checked 
exception it will fail to cleaup the file. 
- I'm looking into what happens in StreamInSession.finished() closeIfFinished()
- Are we considering failures during the streaming or when processing the data 
after the stream has finished?

Any guidance welcome. 

> Temp files for failed compactions/streaming not cleaned up
> --
>
> Key: CASSANDRA-2088
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2088
> Project: Cassandra
>  Issue Type: Bug
>  Components: Core
>Reporter: Stu Hood
> Fix For: 0.7.4
>
>
> From separate reports, compaction and repair are currently missing 
> opportunities to clean up tmp files after failures.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[Cassandra Wiki] Update of "API" by TylerHobbs

2011-03-06 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Cassandra Wiki" for 
change notification.

The "API" page has been changed by TylerHobbs.
The comment on this change is: Remove duplicate (and incorrect) 
describe_keyspaces() entry.
http://wiki.apache.org/cassandra/API?action=diff&rev1=20&rev2=21

--

  
  Remove data from the row specified by `key` at the granularity specified by 
`column_path`, and the given `timestamp`.  Note that all the values in 
`column_path` besides `column_path.column_family` are truly optional: you can 
remove the entire row by just specifying the !ColumnFamily, or you can remove a 
!SuperColumn or a single Column by specifying those levels too. Note that the 
`timestamp` is needed, so that if the commands are replayed in a different 
order on different nodes, the same result is produced.
  
+ === truncate ===
- === describe_keyspaces ===
-  . `set describe_keyspaces()`
  
- Gets a list of all the keyspaces configured for the cluster.
+  . `truncate(string column_family)`
+ 
+ Removes all the rows from the given column family.
  
  === describe_cluster_name ===
   . `string describe_cluster_name()`
  
  Gets the name of the cluster.
  
+ === describe_keyspace ===
+ 
+  . `KsDef describe_keyspace(string keyspace)`
+ 
+ Gets information about the specified keyspace.
+ 
+ === describe_keyspaces ===
+ 
+  . `list describe_keyspaces()`
+ 
+ Gets a list of all the keyspaces configured for the cluster. (Equivalent to 
calling describe_keyspace(k) for k in keyspaces.)
+ 
  === describe_partitioner ===
   . `string describe_partitioner()`
  
@@ -302, +315 @@

  
  Gets the Thrift API version.
  
- === describe_keyspace ===
- 
-  . `KsDef describe_keyspace(string keyspace)`
- 
- Gets information about the specified keyspace.
- 
- === describe_keyspaces ===
- 
-  . `list describe_keyspaces()`
- 
- Gets a list of all the keyspaces configured for the cluster. (Equivalent to 
calling describe_keyspace(k) for k in keyspaces.)
- 
- === truncate ===
- 
-  . `truncate(string column_family)`
- 
- Removes all the rows from the given column family.
- 
  === system_add_column_family ===
  
   . `string system_add_column_family(CFDef cf_def)`


[Cassandra Wiki] Update of "API" by TylerHobbs

2011-03-06 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Cassandra Wiki" for 
change notification.

The "API" page has been changed by TylerHobbs.
The comment on this change is: Added describe_snitch().
http://wiki.apache.org/cassandra/API?action=diff&rev1=19&rev2=20

--

  
  Gets the name of the cluster.
  
+ === describe_partitioner ===
+  . `string describe_partitioner()`
+ 
+ Gets the name of the partitioner for the cluster.
+ 
+ === describe_ring ===
+  . `list describe_ring(keyspace)`
+ 
+ Gets the token ring; a map of ranges to host addresses. Represented as a set 
of `TokenRange` instead of a map from range to list of endpoints, because you 
can't use Thrift structs as map keys: 
https://issues.apache.org/jira/browse/THRIFT-162 for the same reason, we can't 
return a set here, even though order is neither important nor predictable.
+ 
+ === describe_snitch ===
+  . `string describe_snitch()`
+ 
+ Gets the name of the snitch used for the cluster.
+ 
  === describe_version ===
   . `string describe_version()`
  
  Gets the Thrift API version.
  
- === describe_ring ===
-  . `list describe_ring(keyspace)`
- 
- Gets the token ring; a map of ranges to host addresses. Represented as a set 
of `TokenRange` instead of a map from range to list of endpoints, because you 
can't use Thrift structs as map keys: 
https://issues.apache.org/jira/browse/THRIFT-162 for the same reason, we can't 
return a set here, even though order is neither important nor predictable.
- 
- === describe_partitioner ===
-  . `string describe_partitioner()`
- 
- Gets the name of the partitioner for the cluster.
- 
  === describe_keyspace ===
  
   . `KsDef describe_keyspace(string keyspace)`


[Cassandra Wiki] Update of "API" by TylerHobbs

2011-03-06 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Cassandra Wiki" for 
change notification.

The "API" page has been changed by TylerHobbs.
The comment on this change is: Added describe_partitioner().
http://wiki.apache.org/cassandra/API?action=diff&rev1=18&rev2=19

--

  
  Gets the token ring; a map of ranges to host addresses. Represented as a set 
of `TokenRange` instead of a map from range to list of endpoints, because you 
can't use Thrift structs as map keys: 
https://issues.apache.org/jira/browse/THRIFT-162 for the same reason, we can't 
return a set here, even though order is neither important nor predictable.
  
+ === describe_partitioner ===
+  . `string describe_partitioner()`
+ 
+ Gets the name of the partitioner for the cluster.
+ 
  === describe_keyspace ===
  
   . `KsDef describe_keyspace(string keyspace)`


[jira] Updated: (CASSANDRA-2008) CLI help incorrect in places

2011-03-06 Thread Aaron Morton (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aaron Morton updated CASSANDRA-2008:


Attachment: 2008-2.patch

Second patch includes all the stuff from first patch and adds CounterColumnType 
to the help.

Against the 0.8 trunk

> CLI help incorrect in places
> 
>
> Key: CASSANDRA-2008
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2008
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.8
>Reporter: Aaron Morton
>Assignee: Aaron Morton
>Priority: Trivial
> Fix For: 0.8
>
> Attachments: 2007.txt, 2008-2.patch
>
>
> Found some errors in the CLI help, such as these for create column family.
> - memtable_operations: Flush memtables after this many operations
> - memtable_throughput: ... or after this many bytes have been written
> - memtable_flush_after: ... or after this many seconds
> Should be millions of ops, MB's written and minutes not seconds.  Have 
> confirmed thats how the values are used. Will check all the help. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] Updated: (CASSANDRA-2007) Move demo Keyspace1 definition from casandra.yaml to an input file for cassandra-cli

2011-03-06 Thread Aaron Morton (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aaron Morton updated CASSANDRA-2007:


Affects Version/s: (was: 0.7.0)
   0.8
Fix Version/s: (was: 0.7.4)
   0.8

> Move demo Keyspace1 definition from casandra.yaml to an input file for 
> cassandra-cli
> 
>
> Key: CASSANDRA-2007
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2007
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.8
>Reporter: Aaron Morton
>Assignee: Aaron Morton
>Priority: Trivial
> Fix For: 0.8
>
> Attachments: 2007-1.patch, 2007-2.patch
>
>
> Th suggested way to make schema changes is through cassandra-cli but we do 
> not have an example of how to do it. Additionally, to get the demo keyspace 
> created users have to use a different process. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] Updated: (CASSANDRA-2007) Move demo Keyspace1 definition from casandra.yaml to an input file for cassandra-cli

2011-03-06 Thread Aaron Morton (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aaron Morton updated CASSANDRA-2007:


Attachment: 2007-2.patch

2007-2.patch is a rebased version against the trunk @ 8fa4253. 

The schema includes the counter examples. All help has been removed from the 
example schema as help has been added to the cli in CASSANDRA-2008. There are 
also changes to handle keyspaces: not been present in the yaml when 
loadSchemaFromYaml is called. 

The patch is intended for v0.8 as it is not a bug fix. Let me know if we would 
also like it against 0.7. 

> Move demo Keyspace1 definition from casandra.yaml to an input file for 
> cassandra-cli
> 
>
> Key: CASSANDRA-2007
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2007
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.8
>Reporter: Aaron Morton
>Assignee: Aaron Morton
>Priority: Trivial
> Fix For: 0.8
>
> Attachments: 2007-1.patch, 2007-2.patch
>
>
> Th suggested way to make schema changes is through cassandra-cli but we do 
> not have an example of how to do it. Additionally, to get the demo keyspace 
> created users have to use a different process. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] Issue Comment Edited: (CASSANDRA-1472) Add bitmap secondary indexes

2011-03-06 Thread Stu Hood (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13003216#comment-13003216
 ] 

Stu Hood edited comment on CASSANDRA-1472 at 3/6/11 10:18 PM:
--

tjake: Yea: opening a separate ticket to discuss a generic file format makes 
sense.

I had a realization about this implementation of secondary indexes: I was 
originally thinking we'd be able to push all boolean queries down to the 
indexes on a per-sstable basis, but this is unfortunately not the case. We will 
not be able to push 'AND' on separate indexes down to the sstables themselves: 
we'd need to join the index from all sstables, since a row might contain one 
clause in one sstable, and another clause in another sstable. EDIT: This is 
roughly equivalent to what we'd need to do with a KEYS index (seek-wise), 
meaning that the advantage is mostly in space utilization and lack of locks.

  was (Author: stuhood):
tjake: Yea: opening a separate ticket to discuss a generic file format 
makes sense.

I had a realization about this implementation of secondary indexes: I was 
originally thinking we'd be able to push all boolean queries down to the 
indexes on a per-sstable basis, but this is unfortunately not the case. We will 
not be able to push 'AND' on separate indexes down to the sstables themselves: 
we'd need to join the index from all sstables, since a row might contain one 
clause in one sstable, and another clause in another sstable.
  
> Add bitmap secondary indexes
> 
>
> Key: CASSANDRA-1472
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1472
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Core
>Reporter: Stu Hood
>Assignee: Stu Hood
> Fix For: 0.7.4
>
> Attachments: 0.7-1472-v5.tgz, 0.7-1472-v6.tgz, 
> 0001-CASSANDRA-1472-rebased-to-0.7-branch.txt, 
> 0019-Rename-bugfixes-and-fileclose.txt, 1472-v3.tgz, 1472-v4.tgz, 
> 1472-v5.tgz, anatomy.png, v4-bench-c32.txt
>
>
> Bitmap indexes are a very efficient structure for dealing with immutable 
> data. We can take advantage of the fact that SSTables are immutable by 
> attaching them directly to SSTables as a new component (supported by 
> CASSANDRA-1471).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] Commented: (CASSANDRA-1472) Add bitmap secondary indexes

2011-03-06 Thread Stu Hood (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13003216#comment-13003216
 ] 

Stu Hood commented on CASSANDRA-1472:
-

tjake: Yea: opening a separate ticket to discuss a generic file format makes 
sense.

I had a realization about this implementation of secondary indexes: I was 
originally thinking we'd be able to push all boolean queries down to the 
indexes on a per-sstable basis, but this is unfortunately not the case. We will 
not be able to push 'AND' on separate indexes down to the sstables themselves: 
we'd need to join the index from all sstables, since a row might contain one 
clause in one sstable, and another clause in another sstable.

> Add bitmap secondary indexes
> 
>
> Key: CASSANDRA-1472
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1472
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Core
>Reporter: Stu Hood
>Assignee: Stu Hood
> Fix For: 0.7.4
>
> Attachments: 0.7-1472-v5.tgz, 0.7-1472-v6.tgz, 
> 0001-CASSANDRA-1472-rebased-to-0.7-branch.txt, 
> 0019-Rename-bugfixes-and-fileclose.txt, 1472-v3.tgz, 1472-v4.tgz, 
> 1472-v5.tgz, anatomy.png, v4-bench-c32.txt
>
>
> Bitmap indexes are a very efficient structure for dealing with immutable 
> data. We can take advantage of the fact that SSTables are immutable by 
> attaching them directly to SSTables as a new component (supported by 
> CASSANDRA-1471).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] Created: (CASSANDRA-2278) CLI list fails when keys are not of the assumed type

2011-03-06 Thread Yaniv Kunda (JIRA)
CLI list  fails when keys are not of the assumed type
-

 Key: CASSANDRA-2278
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2278
 Project: Cassandra
  Issue Type: Bug
  Components: Tools
Affects Versions: 0.7.3
Reporter: Yaniv Kunda
Priority: Minor


If a keyspace contains non-utf8 keys (for example, {{LongType}} keys), the 
"{{list ;}}" command can fail converting a key for display, only outputting 
the message "{{Input length = 1}}" and stopping the listing of the rest of the 
keys.
This message seems to be an example of the standard exception message of 
{{java.nio.charset.MalformedInputException}}.
Similar messages will probably appear when utf8 keys are assumed to be long, 
etc.

Workaround: use "{{assume  keys as ;}}" - but this will work only of 
all displayed keys conform to the assumption type.

Suggested fix: If key cannot be converted to the assumption type, instead of
{{RowKey: }}
display
{{RowKey bytes:  (cannot convert key to )}}

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira