RE: Is the updating compaction strategy from 'sized tiered' to 'leveled' automatic or need to be done manually? [heur]

Enough to write 1 column and run nodetool flush. From: Viktor Jevdokimov [mailto:viktor.jevdoki...@adform.com] Sent: Tuesday, May 6, 2014 12:00 PM To: user@cassandra.apache.org Subject: RE: Is the updating compaction strategy from 'sized tiered' to 'leveled' automatic or need

RE: Is the updating compaction strategy from 'sized tiered' to 'leveled' automatic or need to be done manually? [heur]

Subject: Re: Is the updating compaction strategy from 'sized tiered' to 'leveled' automatic or need to be done manually? [heur] What you mean 'you need write to this CF'? I've changed the schema by using CQL3 'alter table' statments. On M

RE: Is the updating compaction strategy from 'sized tiered' to 'leveled' automatic or need to be done manually?

To trigger LCS you need to write to this CF and wait when new sstable flushes. I can’t find any other way to start LCS. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370

RE: Exporting column family data to csv

http://mail-archives.apache.org/mod_mbox/cassandra-user/201309.mbox/%3C9AF3ADEDDFED4DDEA840B8F5C6286BBA@vig.local%3E http://stackoverflow.com/questions/18872422/rpc-timeout-error-while-exporting-data-from-cql Google for more. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email

RE: Upserting the same values multiple times

elete columns. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-03163 Vilnius, Lithuania Follow us on Twitter: @adforminsider<http

RE: Cassandra mad GC

Forgot to ask, what do you want to achieve by changing default GC settings? -Original Message- From: Viktor Jevdokimov [mailto:viktor.jevdoki...@adform.com] Sent: Wednesday, January 15, 2014 10:18 AM To: user@cassandra.apache.org Subject: RE: Cassandra mad GC Simply don't use G1 G

RE: Cassandra mad GC

Simply don't use G1 GC, it will not be better on Cassandra than CMS, it could be worse. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-03163 Vilnius, Lithuania Disclaimer

RE: Sorting keys for batch reads to minimize seeks

latency? On 18/10/13 08:31, Viktor Jevdokimov wrote: > The only thing you may win - avoid unnecessary network hops if: > - request sorted keys (by token) from appropriate replica with > ConsistencyLevel.ONE and "dynamic_snitch: false". > - nodes has the same load > -

RE: Sorting keys for batch reads to minimize seeks

> - as nodes are added or removed from the cluster Just be aware, get token ranges from Cassandra. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-03163 Vilnius, Lithuania

RE: Sorting keys for batch reads to minimize seeks

o you want to achieve? Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-03163 Vilnius, Lithuania Disclaimer: The information contained in this message and attachments is inten

RE: Problems in the cassandra bulk loader

Cassandra does not expect more rows with the same key in sstable. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-03163 Vilnius, Lithuania Follow

RE: Problems in the cassandra bulk loader

hich is for C* development, not usage/your code development around Cassandra. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-03163 Vilnius, Lithuania Disclaimer: The information cont

RE: Error during startup - java.lang.OutOfMemoryError: unable to create new native thread

For start: - check (cassandra-env.sh) -Xss size, you may need to increase it for your JVM; - check (cassandra-env.sh) -Xms and -Xmx size, you may need to increase it for your data load/bloom filter/index sizes. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer [Adform News] <h

RE: What is the effect of reducing the thrift message sizes on GC

ve to be copied from young to old space. So reads and compactions will not promote objects to old space (short living objects) and you can see that increased reads and compactions during the same write load will increase GC frequency but decrease GC pause time. Best regards / Pagarbiai V

RE: consistency level for "create keyspace"?

the map is 1. */ map> describe_schema_versions() throws (1: InvalidRequestException ire), Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithua

RE: (unofficial) Community Poll for Production Operators : Repair

oo much significant impact on performance of the cluster without real value. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaimer: The

RE: Cassandra Experts

Consulting company is a body shop that looking for a job candidates for their clients, shortly - recruiters, so not interested in support or learning, just selling bodies with some brains. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com

RE: compaction throughput rate not even close to 16MB

. supercolumns with one column (columns from model 1 merged to one blob value) We found that model 2 compaction performs 4 times faster. The same for regular column families. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212

RE: 'sstableloader' is not recognized as an internal or external command,

t file for sstableloader using other bat files for example. I don't know if sstableloader will support Windows directory structure. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063,

RE: Reduce Cassandra GC

4GB RAM and use 2GB heap without any GC issue with amount of data from 0 to 16GB compressed on each node. Memtable space sized to 100MB, New Heap 400MB. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com>

RE: Reduce Cassandra GC

For a >40GB of data 1GB of heap is too low. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Follow us o

RE: Does Memtable resides in Heap?

Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaimer: The information contained in this message and attachments is intended solely for the attention and use of the named

RE: sstableloader throughput

that the 1.1 sstable loader works much better then the 1.0 version. The changes were not easy to backport to the 1.0.X branch so it did not happen. It is likely that 1.2 is even better :) On Wed, Apr 10, 2013 at 10:38 AM, Viktor Jevdokimov wrote: Rsync is not for our case. Is sstableloader for

RE: sstableloader throughput

not fixed in the 1.0.x series. On Wednesday, April 10, 2013, Viktor Jevdokimov wrote: > Found https://issues.apache.org/jira/browse/CASSANDRA-3668 > > Weird. > > > > Hi, > > > > We're using Casandra 1.0.12 sstableloader to import data from dedicated > mach

RE: sstableloader throughput

Found https://issues.apache.org/jira/browse/CASSANDRA-3668 Weird. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lit

sstableloader throughput

n with 50MB/s import should take less than a minute. Why sstableloader throughput is so low/slow? Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasins

RE: cannot start Cassandra on Windows7

You NEED to edit cassandra.yaml and log4j-server.properties paths before starting on Windows. There're a LOT of things to learn for starters. Google for Cassandra on Windows. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370

RE: Using Cassandra for read operations

a stress tool only gives out average read latency. Is there a way > to figure out max read-latency for a bunch of read operations? > > > > * How big a row cache can one have? Given that cassandra provides off- > heap row caching, in a machine >32 gb RAM, would it be wi

RE: Testing compaction strategies on a single production server?

Just turn off dynamic snitch on survey node and make read requests from it directly with CL.ONE, watch histograms, compare. Regarding switching compaction strategy there're a lot of info already. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adfor

RE: Why do Datastax docs recommend Java 6?

I would prefer Oracle to own an Azul's Zing JVM over any other (GC) to provide it for free for anyone :) Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J

RE: data not shown up after some time

Are you sure your app is setting TTL correctly? TTL is in seconds. For 90 days it have to be 90*24*60*60=7776000. What If you set by accident 777600 (10 times less) - that will be 9 days, almost what you see. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki

RE: JMX CF Beans

/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Follow us on Twitter: @adforminsider<http://twitter.com/#!/adforminsider> Take

RE: High Read and write through put

For such a generic question without technical details of requirements, the answer - use defaults. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinsk

RE: Concurrent write performance

Do you experience any performance problems? This will be the last thing to look at. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT

RE: LCS not removing rows with all TTL expired columns

. I have not tested 1.2 LCS behavior, we're still on 1.0.x Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania F

RE: Partition maintenance

No way to read the taped data with TTL later - will disappear from tapes :) Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 V

RE: cassandra vs couchbase benchmark

results may significantly vary. Just need to know what and how to optimize for Cassandra to get best results. Couchbase is not for our use case because of its data model (requires reads for updates/inserts), so we can't compare it to Cassandra. Best regards / Pagarbiai Viktor Jevd

RE: Cassandra nodes failing with OOM

We've seen OOM in a situation, when OS was not properly prepared in production. http://www.datastax.com/docs/1.1/install/recommended_settings Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone:

RE: Super columns and arrays

struct SuperColumn { 1: required binary name, 2: required list columns, } Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaimer: The

RE: what is more important (RAM vs Cores)

, conclude last. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaimer: The information contained in this message and attachments is intended solely for th

RE: unbalanced ring

To run, or not to run? All this depends on use case. There're no problems running major compactions (we do it nightly) in one case, there could be problems in another. Just need to understand, how everything works. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer

RE: Persistent connection among nodes to communicate and redirect request

StorageProxy), which forward request (if needed) >to other endpoints via MessagingService >(org.apache.cassandra.net.MessagingService), which uses storage_port from >yaml, not a thrift port (rpc_port in yaml). What else could be wrong? Wiki or >source code? Best regards / Paga

RE: Persistent connection among nodes to communicate and redirect request

9160 is a client port. Nodes are using messaging service on storage_port (7000) for intra-node communication. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius

RE: High commit size

difference is to run C* on Linux instead of Windows. Migration was pretty easy. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lit

RE: High commit size

Do not use mmap/auto on Windows, standard access mode only. In cassandra.yaml: disk_access_mode: standard Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jas

RE: Read latency skyrockets after 95-98th percentile

What is a data load? Does it fits in RAM? I bet it's due to GC. Since this is a 1 node only, dynamic snitch is out of scope. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 306

RE: how to disable compression ?

>From cassandra-cli help: To disable compression just set compression_options to null like this compression_options = null so [default@XXXKeyspace] update column family YYY with compression_options = null; Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevd

RE: how to disable compression ?

Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Follow us on Twitter: @adforminsider<http://twitter.com/#!/adforminsider> What is Adform

RE: Tools for analize cassandra gc.log

f achievement. Tuning GC is a last resort to gain something. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaimer: The information contained in this mes

RE: upgrade issue

Replace tabs with spaces in Cassandra.yaml Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Follow us on T

RE: cassandra 1.0.x and java 1.7

Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaimer: The information contained in this message and attachments is intended solely for the attention and use of the named

RE: portability between enterprise and community version

Clients are clients, servers are servers. Why do you need mixed environment Cassandra cluster? Isn't enough mixed clients? Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063,

RE: portability between enterprise and community version

I remember that join and decommission didn’t worked since using streaming. All problems was due to paths differences between Windows and Linux styles. So how do you move keyspaces? Using streaming (join/decommission), or manually? Best regards / Pagarbiai Viktor Jevdokimov Senior Developer

RE: portability between enterprise and community version

as by anyone else. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Follow us on Twitter: @adforminsider<http

RE: portability between enterprise and community version

Do not mix Linux and Windows nodes. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Follow us on T

RE: nodetool repair -pr enough in this scenario?

ized more than once (max = RF times). Multiple DC with 100% data range in each DC scenario: the same, only RF = sum of RF from all DC's. Is that correct? Finally - is this process for SSTables only, excluding memtables and hints? Best regards / Pagarbiai Viktor Jevdokimov Senior Develo

RE: nodetool repair -pr enough in this scenario?

onize A-B range one with other. For other ranges you need to run on other nodes. Without -PR running on any node will repair all ranges, A-B, B-C, C-A. A node you run a repair without -PR is just a repair coordinator, so no difference, which one will be next time. Best regards / Pagarbiai V

RE: repair

progress or other control in between, your choice. Use repair with care, do not let your cluster go down. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261

FYI: Java 7u4 on Linux requires higher stack size

ate to Java 7u4. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Follow us on Twitter: @adforminsider<http://twit

RE: Replication factor

points for a key by calculating a token, so we always hit a replica. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithu

RE: Replication factor

Depends on use case. For ours we have another experience and statistics, when turning dynamic snitch off makes overall latency and spikes much, much lower. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.

RE: Replication factor

> When RF == number of nodes, and you read at CL ONE you will always be reading > locally. "always be reading locally" - only if Dynamic Snitch is "off". With dynamic snitch "on" request may be redirected to other node, which may introduce latency spikes.

RE: Safely Disabling Compaction

. nodetool setcompactionthreshold 0 0 To restore, set your normal values. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lit

RE: cassandra read latency help

total of 40KB data from a data set of 180GB uncompressed under 30ms is not an easy task. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT

RE: Exception when truncate

Truncate flushes all memtables to free up commit logs, and that on all nodes. So this takes time. Discussed on this list not so long ago. Watch for: https://issues.apache.org/jira/browse/CASSANDRA-3651 https://issues.apache.org/jira/browse/CASSANDRA-4006 Best regards / Pagarbiai Viktor

RE: cassandra read latency help

or use SSD; - If you do regular updates to key, do not use row cache, otherwise you may try. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaime

RE: get dinamicsnith info from php

ing a node with lower latencies. If you'd like Cassandra to avoid forwarding requests to appropriate node, but making a direct request to a node where data is, you need smarter client, capable to select node by key and other things to do to achieve this. Best regards / Pagarbiai Vi

RE: get dinamicsnith info from php

gards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Follow us on Twitter: @adforminsider<http://twitter.com/#!/adforminsider> What

RE: counter CF and TTL

There's no TTL on counter columns and no ready-to-use solution I know about. https://issues.apache.org/jira/browse/CASSANDRA-2774 Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 21

RE: how to upgrade my cassadra from SizeTieredCompaction to LeveledCompactiom

>> There is 2T data on each server. Can someone give me some advice? > do not do it Best advice! Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius,

RE: zabbix templates

gc.cms[*],java -jar /etc/zabbix/cmdline-jmxclient-0.10.3.jar - 127.0.0.1:7199 java.lang:type=GarbageCollector,name=ConcurrentMarkSweep LastGcInfo 2>&1 | awk '/$1/ {print $$2;}' UserParameter=cassandra.db.DynamicSnitchScores[*],java -jar /etc/zabbix/cmdline-jmxclient-0.10.3.jar - 127.0.0.1:7199 org.a

RE: size tiered compaction - improvement

Our use case requires Column TTL, not CF TTL, because it is variable, not constant. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaimer: The

RE: tombstones problem with 1.0.8

Upon read from S1 & S6 rows are merged, T3 timestamp wins. T1 will be deleted upon S1 compaction with S6 or manual cleanup. We're running major compactions nightly, a lot of inserts per day with TTL, some with deletes from app - no problems with tombstones. Best regards/ Pagarbia

RE: tombstones problem with 1.0.8

ins row with column T3 delete row T4 flush memtable, sstable 2 contains empty row tombstone T5 delete row (present in memtable) T6 row tombstone for T3 expected to be expired T7 compaction, sstable 3 row tombstone appears because of T5 Best regards/ Pagarbiai Viktor Jevdokimov Senior Deve

RE: tombstones problem with 1.0.8

ion for a row/column that is already deleted (can't be returned by get)? Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063. Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania [Adf

RE: tombstones problem with 1.0.8

atest timestamp of the column/row, including other sstables and memtable. You need to review your application logic. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063. Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vi

RE: tombstones problem with 1.0.8

Just tested 1.0.8 before upgrading from 1.0.7: tombstones created by TTL or by delete operation are perfectly deleted after either compaction or cleanup. Have no idea about any other settings than gc_grace_seconds, check you schema from cassandra-cli. Best regards/ Pagarbiai Viktor

RE: exception when attempting to truncate a table

sable snapshots). All this takes time for a truncate. But you can check with a short scan a few moments later after failed truncate that the data is actually truncated. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063

Re: how to increase compaction rate?

After loosing one node we had to repair, CFs was on leveled compaction. For one CF each node had about 7GB of data. Running a repair without primary range switch ended up some nodes exhausted to about 60-100GB of 5MB sstables for that CF (a lot of files). After switching back from leveled to tiered

Re: Truncate flushes memtables for all CFs causing timeouts

/apache/cassandra/db/ColumnFamilyStore.java#L1681 > > AFAIK truncate is not considered a regular operation. (All nodes must be > online for example) > > Cheers > > > - > Aaron Morton > Freelance Developer > @aaronmorton > http://www.the

Truncate flushes memtables for all CFs causing timeouts

Hello, Truncate uses RPC timeout, which is in my case set to 10 seconds (I want even less) and it's not enough. I've seen in sources TODO for this case. What I found is that truncate starting flush for all memtables for all CFs, not only for a CF to be truncated. When there're a lot of CFs to be

Re: Cassandra cache patterns with thiny and wide rows

Depends on how large is a data set, specifically hot data, comparing to available RAM, what is a heavy read load, and what are the latency requirements. 2012/3/6 Maciej Miklas > I've asked this question already on stackoverflow but without answer - I > wll try again: > > > My use case expects h

Re: Huge amount of empty files in data directory.

After running Cassandra for 2 years in production on Windows servers, starting from 0.7 beta2 up to 1.0.7 we have moved to Linux and forgot all the hell we had on Windows. Having JNA, off-heap row cache and normally working MMAP on Linux you're getting a lot better performance and stability compari

Re: how stable is 1.0 these days?

1.0.7 is very stable, weeks in high-load production environment without any exception, 1.0.8 should be even more stable, check changes.txt for what was fixed. 2012/3/2 Marcus Eriksson > beware of https://issues.apache.org/jira/browse/CASSANDRA-3820 though if > you have many keys per node > > ot

RE: Internal error processing batch_mutate java.util.ConcurrentModificationException

Yes, the exception is for CounterColumn on Standard column family. Created https://issues.apache.org/jira/browse/CASSANDRA-3870 Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063. Fax: +370 5 261 0453 J. Jasinskio

Internal error processing batch_mutate java.util.ConcurrentModificationException

java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063. Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius

RE: Consurrent compactors

actors > 1 setting just not working. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063. Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania [Adform news]<http://www.adform.com/>

Consurrent compactors

e finished. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063. Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania [Adform news]<http://www.adform.com/> [Visit us!] Follow: [twitter]<

RE: SQL DB Integration

uld do your research for Cassandra on specific questions, not global. First, define storage requirements from application/functionality perspective, then look for a solution. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 F

Re: How to control location of data?

The idea behind client that controls location of a data is performance, to avoid unnecessary network round-trips between nodes and unnecessary caching of backup ranges. All of this mostly is true for reads at CL.ONE and RF>1. How it works (in our case): Our client uses describe_ring that returns

Leveled compaction strategy and expiring columns

Hi, We're trying to understand how leveled compaction works. The documentation written is about new/updated columns only. What about expiring columns and TTL? When higher level sstables will be compacted and expired columns removed? Best regards/ Pagarbiai Viktor Jevdokimov S

RE: [RELEASE] Apache Cassandra 1.0.6 released

Created https://issues.apache.org/jira/browse/CASSANDRA-3642 -Original Message- From: Viktor Jevdokimov [mailto:viktor.jevdoki...@adform.com] Sent: Thursday, December 15, 2011 18:26 To: user@cassandra.apache.org Subject: RE: [RELEASE] Apache Cassandra 1.0.6 released Cassandra 1.0.6

RE: [RELEASE] Apache Cassandra 1.0.6 released

more Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaimer: The information contained in this message and attachments is intended solely for the

RE: cassandra most stable version ?

0.8.7 Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063. Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania [Adform news]<http://www.adform.com/> [Visit us!] Follow: [twitter

RE: NetworkTopologyStrategy bug?

Sorry, the bug was in our snitch. We're using getHostName() instead of getCanonicalHostName() to determine DC & Rack and since for local it returns alias, instead of reverse DNS, DC & Rack numbers are not as expected. Best regards/ Pagarbiai Viktor Jevdokimov Senior Devel

NetworkTopologyStrategy bug?

ery READ request to any node will be forwarded to other node. That what we have right now with 0.8.6 and up to 1.0.5 as with 3 nodes in 1 DC, as with 8x2 nodes. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063. Fax:

RE: Can't run cleanup

Nodetool repair also don't start on all nodes, log is reporting: INFO 15:57:51,070 Starting repair command #2, repairing 0 ranges. INFO 15:57:51,070 Repair command #2 completed successfully Regular read repairs are working as reads and writes. Best regards/ Pagarbiai Viktor Jevdo

Can't run cleanup

de for more than 12 hours. Nodetool's info/ring/tpstats/netstats for all nodes looks fine. Restart don't help. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063. Fax: +370 5 261 0453 J. Jasinskio 16C

RE: Cassandra 1.x and proper JNA setup

Up, also interested in answers to questions below. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaimer: The information contained in this message

RE: [RELEASE] Apache Cassandra 1.0 released

Congrats!!! Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaimer: The information contained in this message and attachments is intended solely for

  1   2   >