Re: cold vs hot data

2018-09-20 Thread Jens Rantil
will be archived and may > be scanned by us and/or by external service providers to detect and prevent > threats to our systems, investigate illegal or inappropriate behavior, > and/or eliminate unsolicited promotional e-mails (“spam”). If you have any > concerns about this process, plea

Re: Current active queries and status/type

2018-03-06 Thread Jens Rantil
, D. Salvatore wrote: >> >>> Hello! >>> There is any way to know how many queries a node is currently serving >>> through JMX(or other tools)? And the state of the request so, for example, >>> if the request is waiting for data from another node? >&g

Re: One time major deletion/purge vs periodic deletion

2018-03-06 Thread Jens Rantil
job weekly??) > > > > Some estimates on the number of deletes performed would be…upto 80-90K > rows purged in 3 months vs 10K deletes every week ?? > > > > Thanks, > > Charu > > > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: Multiple nodes decommission

2017-04-16 Thread Jens Rantil
acob Shadix : > > Are you using vnodes? I typically do one-by-one as the decommission will > create additional load/network activity streaming data to the other nodes > as the token ranges are reassigned. > > -- Jacob Shadix > > On Sat, Apr 8, 2017 at 10:55 AM, Vlad wrote: &

`nodetool verify` outcome check

2017-01-03 Thread Jens Rantil
Hi, We've had a discussion internally to start to run `nodetool verify` periodically to test for bitrot. Does anyone know how I could check if the verification failed or succeeded from, say, a script? Is there an error exit code or some output I could grep for? Thanks, Jens -- Jens R

Re: Backup restore with a different name

2016-11-02 Thread Jens Rantil
g the (corrupt) current state in the live cluster". Cheers, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.com/#!/tink.se> Linkedin <http://www.linkedin.com/company/2735919?trk=vsrp

Re: Backup restore with a different name

2016-11-02 Thread Jens Rantil
re is an option: https://github.com/anubhavkale/CassandraTools/ > tree/master/BackupRestore > > > > > > *From:* Jens Rantil [mailto:jens.ran...@tink.se] > *Sent:* Wednesday, November 2, 2016 2:21 PM > *To:* Cassandra Group > *Subject:* Backup restore with a different name &g

Backup restore with a different name

2016-11-02 Thread Jens Rantil
loper to looks at the old copy? Cheers, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.com/#!/tink.se> Linkedin <http://www.linkedin.com/company/2735919?trk=vsrp_companies_res_photo&tr

Re: Cassandra Poor Read Performance Response Time

2016-11-02 Thread Jens Rantil
mprove noticeably. I have attached a trace of > one query i ran which took around 3 seconds which i would expect to take > well below a second. I have also included the cassandra.yaml file and jvm > options file. We do intend to change the storage to local storage and &

Re: Does anyone store larger values in Cassandra E.g. 500 KB?

2016-10-24 Thread Jens Rantil
Software Engineer | Instaclustr >>> >>> >>> >>> >>> This email has been sent on behalf of Instaclustr Pty Ltd (Australia) >>> and Instaclustr Inc (USA). >>> >>> This email and any attachments may contain confidential and

Re: understanding partitions and # of nodes

2016-09-22 Thread Jens Rantil
guess it helps because when you add more nodes to > your cluster, the data can be redistributed since you have more nodes. > > What else are things to consider? > > Thanks. > -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web:

Re: Nodetool repair

2016-09-20 Thread Jens Rantil
number of clustering keys per partition key could have an impact. Might be worth investigating. Cheers, Jens -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: Nodetool repair

2016-09-19 Thread Jens Rantil
believe repair > performs following operations - > > 1) Major compaction > 2) Exchange of merkle trees with neighbouring nodes. > > Is there any other operation performed during manual repair? What if I > kill the process in the middle? > > Thanks. > Lokesh > -- Jens R

Re: How Fast Does Information Spread With Gossip?

2016-09-16 Thread Jens Rantil
rmation about the liveness of a > node spreads. For example, in an n-node cluster the median amount of time > it takes for all nodes to learn that a node went down is f(n) seconds. Is a > minute a reasonable upper bound for most clusters? Too high, too low? > > > Thanks, >

Re: Maximum number of columns in a table

2016-09-16 Thread Jens Rantil
ap column" >>>>>>>> >>>>>>>> --> how do you manage the different types then ? Because maps in >>>>>>>> Cassandra are strongly typed >>>>>>>> >>>>>>>> Unless you set the type of map

Re: Is to ok restart DECOMMISION

2016-09-16 Thread Jens Rantil
ommission and restarting decommission will > > cause any issues to cluster? > > > > Using c*-2.0.17 , 2 Data centers, each DC with 3 groups each , each group > > with 3 nodes with RF-3 > > > > -- > > Thanks...! > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: [ANNOUNCEMENT] Website update

2016-09-12 Thread Jens Rantil
Good job guys. >> >> -- >> Ashish Disawal >> >> On Mon, Sep 12, 2016 at 3:00 AM, Jens Rantil wrote: >> >>> Nice! The website also feels snappier! >>> >>> >>> On Friday, July 29, 2016, Sylvain Lebresne wrote: >>>

Re: Cassandra and Kubernetes and scaling

2016-09-12 Thread Jens Rantil
Jens On Monday, September 12, 2016, David Aronchick wrote: > Please let me know if I can help at all! > > On Sun, Sep 11, 2016 at 2:55 PM, Jens Rantil > wrote: > >> Hi Aiman, >> >> I noticed you never got any reply. This might be of interest: >> http://bl

Re: Cassandra and Kubernetes and scaling

2016-09-11 Thread Jens Rantil
> > > > 3. Scaling up and increasing the RF of a particular keyspace, would > there be a clean way to do this with the kubernetes tooling? > > > > In the end I'm wondering how much of the Kubernetes + Cassandra involves > nodetool, and how much is just a

Re: Schema Disagreement vs Nodetool resetlocalschema

2016-09-11 Thread Jens Rantil
ion. How safe is this method? Do we need to disable > thrift/gossip protocol before performing this function, and enable them > back after resync completes? > > > > Thanks in advance! > > > > Sincerely, > > > > Michael Fong > -- Jens Rantil

Re: [ANNOUNCEMENT] Website update

2016-09-11 Thread Jens Rantil
ore than welcome. > > Best, > On behalf of the Apache Cassandra developers. > -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.com/#!/tink.se> Linkedin <http://www.linkedin.com

Re: Bootstrapping multiple cassandra nodes simultaneously in existing dc

2016-09-11 Thread Jens Rantil
Sun, Sep 11, 2016, 17:10 Jens Rantil > wrote: > >> Hi Bhuvan, >> >> I have done such expansion multiple times and can really recommend >> bootstrapping a new DC and pointing your clients to it. The process is so >> much faster and the documentation you r

Re: large number of pending compactions, sstables steadily increasing

2016-09-11 Thread Jens Rantil
>>> > >>> Space used (live): 301894591442 > >>> > >>> Space used (total): 301894591442 > >>> > >>> > >>> > >>> Problematic node > >>> > >>> Keyspace: mykeyspace > &g

Re: Bootstrapping multiple cassandra nodes simultaneously in existing dc

2016-09-11 Thread Jens Rantil
ml> > and > bootstrap multiple nodes simultaneously by keeping auto_bootstrap false in > cassandra.yaml and rebuilding nodes simultaneously in the new dc? > > > Thanks & Regards, > Bhuvan > -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +4

Re: Isolation in case of Single Partition Writes and Batching with LWT

2016-09-11 Thread Jens Rantil
istency in this case (When LWT is being used in > batches). > > 3. Is it possible to use multiple LWT in a single Batch? In general how > does LWT performs with Batch and is Paxos acted on before batch execution? > > Can someone help us with this? > > Thanks & Regards,

Re: Finding records that exist on Cassandra but not externally

2016-09-08 Thread Jens Rantil
and for > any data refresh only a very small fraction (<.1%) will actually need > deleting. 99% of the time I'll just be overwriting existing keys. > > I'd be grateful if anyone could shed some advice on the best solution here > or whether there's some better way I hav

Re: Finding records that exist on Cassandra but not externally

2016-09-07 Thread Jens Rantil
y small fraction (<.1%) will actually need > deleting. 99% of the time I'll just be overwriting existing keys. > > I'd be grateful if anyone could shed some advice on the best solution here > or whether there's some better way I haven't thought of. > > Thanks, > > Chris > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: Ring connection timeouts with 2.2.6

2016-06-30 Thread Jens Rantil
etwork appears to be fine between nodes, with iperf tests showing >> that we have a lot of headroom. >> >> Any thoughts on what to look for? Can we increase thread count/pool sizes >> for the messaging service? >> >> Thanks, >> >> Mike >> >> -- >> >> Mike Heffner >> Librato, Inc. >> >> > > > -- > > Mike Heffner > Librato, Inc. > > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: some questions

2016-06-30 Thread Jens Rantil
but this cql can’t execute. have some advise??? > > update table_name set field=my_function(field) where … > > > tnk u so much > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: Multi DC setup question

2016-06-29 Thread Jens Rantil
enters the primary DC else the application URL be directed to > another DC. > > > > What is the best option to achieve this?? > > > > Thanks, > > Charu > > > > > > > > > > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: Motivation for a DHT ring

2016-06-29 Thread Jens Rantil
jean paul : > >> Hi all, >> >> Please, What is the motivation for choosing a DHT ring in cassandra? Why >> not use a normal parallel or distributed file system that supports >> replication? >> >> Thank you so much for clarification. >> >> Kind

Re: tuning repairs and compaction options

2016-05-06 Thread Jens Rantil
ir behaviour? Which > settings should I look at if I want CPU to stay below 50% for instance. My > worry is always to impact the read/write performance during times when we > do anti-entropy repairs. > > Cheers, > Reik > -- Jens Rantil Backend Developer @ Tink Tink AB, Walling

Re: Alternative approach to setting up new DC

2016-04-25 Thread Jens Rantil
he data into the new DC and susbsequently alter the >> keyspace to replicate from the older DC. >> >> Cheers >> Jan >> >> >> >> On Thu, 4/21/16, Jens Rantil wrote: >> >> Subject: Re: Alternat

Re: When are hints written?

2016-04-25 Thread Jens Rantil
r haul in the way hints have been implemented. >> >> Recommend reading up this blog article: >> >> http://www.datastax.com/dev/blog/whats-coming-to-cassandra-in-3-0-improved-hint-storage-and-delivery >> >> hope this helps >> Jan/ >> >> >>

Re: Combining two clusters/keyspaces into single cluster

2016-04-25 Thread Jens Rantil
assandra/2.1/cassandra/operations/ops_add_dc_to_cluster_t.html > > Is that the appropriate guide for this and I'm just over thinking it? Or > is there something else I should be looking at? > > Also, this is DSC C* 2.1.13. > > TIA! > > -AA > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: Unable to reliably count keys on a thrift CF

2016-04-25 Thread Jens Rantil
T token(key), key FROM tbl WHERE > token(key) >= #{token} LIMIT 1") > end > last_token = token > end > > puts keys.keys.count > > What am I missing? > > Thanks! > > Carlos Alonso | Software Engineer | @calonso <https://twitter.com/calonso> > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: Alternative approach to setting up new DC

2016-04-21 Thread Jens Rantil
gc_grace_seconds after when the backup is taken. As of me, I managed to a get a more stable VPN setup and did not have to go down this path. Cheers, Jens On Mon, Apr 18, 2016 at 10:15 AM Jens Rantil wrote: > Hi, > > I am provisioning a new datacenter for an existing cluster. A rather sh

Re: When are hints written?

2016-04-21 Thread Jens Rantil
itten? > > Regarding your other post: Yes, 3.0.3 is pretty new. But we are new to > this cassandra game, and our schema-fu is not strong enough for us to > create a schema without using materialized views :) > > > ons. 20. apr. 2016 kl. 17.09 skrev Jens Rantil : > >>

Re: When are hints written?

2016-04-20 Thread Jens Rantil
ow which knobs to turn to accomplish this? or if it is even > possible :) > > We are running cassandra 3.0.3, with 8Gb heap and a replication factor of > 3. > > Thank you in advance! > > Yours sincerely, > Bo Madsen > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: When are hints written?

2016-04-20 Thread Jens Rantil
cluster to wait for the write to be > persisted on the relevant nodes before returning an ok to the client. But I > don't know which knobs to turn to accomplish this? or if it is even > possible :) > > We are running cassandra 3.0.3, with 8Gb heap and a replication factor of > 3. >

Alternative approach to setting up new DC

2016-04-18 Thread Jens Rantil
onds after operation 3) above, use sstableloader to stream my backup to the new nodes. 5. For safety precaution, do a full repair. Could you see any issues with doing this? Cheers, Jens -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matte

Re: Consistent reads and first write wins

2015-07-08 Thread Jens Rantil
reads, then will both clients see the value 'bar' for > prop1? Are there situations in which clients might see different values? > > > -- > > - John > -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tin

Hanging pending compactions

2015-07-08 Thread Jens Rantil
y for me to extract debugging information to file a bug report before restarting the nodes? Cheers, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.com/#!/tink.se> Linkedin <http://www.linked

RE: nodetool repair

2015-06-19 Thread Jens Rantil
Hi, For the record I've succesfully used https://github.com/BrianGallew/cassandra_range_repair to make smooth repairing. Could maybe also be of interest don't know... Cheers, Jens – Skickat från Mailbox On Fri, Jun 19, 2015 at 8:36 PM, null wrote: > It seems to me that running repa

Re: Question regarding concurrent bootstrapping

2015-06-14 Thread Jens Rantil
Fri, Jun 12, 2015 at 5:21 AM, Jens Rantil wrote: >> Let's say I have an existing cluster and do the following: >> >>1. I start a new joining node (A). It enters state "Up/Joining". >>Streaming automatically start to this node. >>2. I wait tw

Re: Question about "nodetool status ..." output

2015-06-12 Thread Jens Rantil
n | Twitter: cjrolo | Linkedin: *linkedin.com/in/carlosjuzarterolo > <http://linkedin.com/in/carlosjuzarterolo>* > Mobile: +31 6 159 61 814 | Tel: +1 613 565 8696 x1649 > www.pythian.com > > On Fri, Jun 12, 2015 at 11:58 AM, Jens Rantil wrote: > >> Hi, >> >> I have o

Question regarding concurrent bootstrapping

2015-06-12 Thread Jens Rantil
what it is responsible of? This is of importance for planning when one it expanding a cluster to multiple smaller nodes. Thanks, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.com/#!/tink.se> Li

Question about "nodetool status ..." output

2015-06-12 Thread Jens Rantil
was a mistake) and then X.X.X.51. I haven't executed `nodetool cleanup` on any nodes yet. For the curious, the full ring can be found here: https://gist.github.com/JensRantil/57ee515e647e2f154779 Cheers, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708

Re: Hbase vs Cassandra

2015-06-08 Thread Jens Rantil
; doesn't rollback?. Yes. /Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.com/#!/tink.se> Linkedin <http://www.linkedin.com/company/2735919?trk=vsrp_companies_res_photo&t

Re: Hbase vs Cassandra

2015-06-08 Thread Jens Rantil
t Cassandra has, is easy in HBase, but making it as > consistent as the rest of HBase is hard) > > Thanks > Ajay > > >> >> On May 29, 2015, at 12:09 PM, Ajay wrote: >> >> Hi, >> >> I need some info on Hbase vs Cassandra as a data store (in general plus

Re: Newly added node getting more data than expected

2015-06-07 Thread Jens Rantil
he GossipingPropertyFileSnitch > decides where to put secondary/tertiary replicas (ie. always "next physical > node" in ring)? Do I need to execute `nodetool cleanup` also on newly > commissioned nodes? > > Thanks, > Jens > > -- > Jens Rantil > Backend engineer &

Newly added node getting more data than expected

2015-06-07 Thread Jens Rantil
Could anyone explain to me my new node is receiving more data than expected? Does this have to do with the way the GossipingPropertyFileSnitch decides where to put secondary/tertiary replicas (ie. always "next physical node" in ring)? Do I need to execute `nodetool cleanup` also on newl

Re: Decommission datacenter - repair?

2015-06-07 Thread Jens Rantil
Ah, that explains things. Thanks! On Fri, Jun 5, 2015 at 10:59 PM, Robert Coli wrote: > On Fri, Jun 5, 2015 at 5:15 AM, Jens Rantil wrote: > >> Datastax's documentation on "Decommissioning a data center >> <http://docs.datastax.com/en/cas

Re: Decommission datacenter - repair?

2015-06-05 Thread Jens Rantil
On Fri, Jun 5, 2015 at 5:45 PM, Jens Rantil wrote: > >> Hi, >> >> I asked this on IRC earlier today, but didn't get any response; >> >> Datastax's documentation on "Decommissioning a data center >> <http://docs.datastax.com/en/cassandra/2.0/cas

Decommission datacenter - repair?

2015-06-05 Thread Jens Rantil
ommission each node. Isn't decommissioning going to hand over all data anyway? Then why is the repair necessary? Cheers, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.com/#!/tink.se> Linkedin <

Re: Concurrent schema creation/change strategy

2015-05-26 Thread Jens Rantil
the clients can be allowed to work (i.e. move schema > creation out of the clients)? > > > > > Thanks > /Magnus > > -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.com

Re: Performance penalty of multiple UPDATEs of non-pk columns

2015-05-21 Thread Jens Rantil
t; SELECT f3 FROM t1 WHERE f1=k2 AND f2=k2; > > It looks like all the previous values are preserved until compaction, but > does executing the SELECT reads all the values (O(n), n - number of > updates) or only the current one (O(1)) ? > > > How the situation looks for Cou

Re: Hive support on Cassandra

2015-05-07 Thread Jens Rantil
I found couple of open source efforts but nothing is available currently. > > Thanks > Ajay > -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.com/#!/tink.se> Linkedin <http://

Re: Query returning tombstones

2015-05-02 Thread Jens Rantil
> > Maybe someone can point me to an existing jira-ticket, but I also > appreciate any other feedback :-) > > regards, > Christian > > -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.f

Re: Creating 'Put' requests

2015-04-24 Thread Jens Rantil
inoise','Bye Bye >> > Blackbird','Joséphine Baker');"); >> > >> > >> > >> > But for more complicated code this will quickly become unmanageable, >> > and doesn’t lend itself well to dynamically creating row data base

Re: When to use STCS/DTCS/LCS

2015-04-09 Thread Jens Rantil
cement thats enough.Please guide me. Thanks > in advance. > > Thanks and Regards, > Divya > >> >>> -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.com/#!/tin

Re: Help understanding aftermath of death by GC

2015-03-31 Thread Jens Rantil
the thread which is taking all the memory. I've seen this happen multiple times. If this happened to you, a critical Cassandra thread could have died and brought the whole Cassandra DB with itself. Just an idea - cheers, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.

Re: Really high read latency

2015-03-23 Thread Jens Rantil
mean bytes: 986530969 > Average live cells per slice (last five minutes): > 501.66101694915255 > Maximum live cells per slice (last five minutes): 502.0 > Average tombstones per slice (last five minutes): 0.0 > Maximum tombstones per slice (last five mi

Re: Store data with cassandra

2015-03-20 Thread Jens Rantil
Jean, I'm not sure you will receive any reply unless you ask specific questions about those links. Cheers, Jens – Skickat från Mailbox On Fri, Mar 20, 2015 at 5:08 PM, Sibbald, Charles wrote: > Sounds like this is a job for jackrabbit ? > http://jackrabbit.apache.org > From: Ali Akhtar mai

Re: Timeout error in fetching million rows as results using clustering keys

2015-03-18 Thread Jens Rantil
Hi, Try setting fetchsize before querying. Assuming you don't set it too high, and you don't have too many tombstones, that should do it. Cheers, Jens – Skickat från Mailbox On Wed, Mar 18, 2015 at 2:58 AM, Mehak Mehta wrote: > Hi, > I have requirement to fetch million row as result of my

Re: Input/Output Error

2015-03-04 Thread Jens Rantil
Hi, Check your Cassandra and kernel (if on Linux) log files for errors. Cheers, Jens – Skickat från Mailbox On Wed, Mar 4, 2015 at 2:18 AM, 曹志富 wrote: > Some times My C* 2.1.3 cluster compaction or streaming occur this error ,do > this because of disk or filesystem problem?? > Thanks All. >

Re: Inconsistent count(*) and distinct results from Cassandra

2015-03-04 Thread Jens Rantil
Frens, What consistency are you querying with? Could be you are simply receiving result from different nodes each time. Jens – Skickat från Mailbox On Wed, Mar 4, 2015 at 7:08 PM, Mikhail Strebkov wrote: > We have observed the same issue in our production Cassandra cluster (5 nodes > in o

Re: best practices for time-series data with massive amounts of records

2015-03-03 Thread Jens Rantil
the second table schema described > above, but switch to an order-preserving hashing function, and then > manually hash the "id" field. This is essentially what we would do in > HBase. > Like you might already know, this order preserving hashing is _not_ considered best prac

Re: using or in select query in cassandra

2015-03-02 Thread Jens Rantil
ta so i need to add OR clause in my > WHERE clause. > ex: select * from table where id =123 OR name ='abc' > so in above i want that i get data if my id is 123 or my name is abc . > > is there any possibility in cassandra to achieve this . > > -- Jens Rantil Backend en

Re: How to extract all the user id from a single table in Cassandra?

2015-03-02 Thread Jens Rantil
(); >> >> String user_id = r.getString("user_id"); >> userList.add(user_id); >> } >> } catch (Exception e) { >> System.out.println("error= " + e); >&g

Re: how many rows can one partion key hold?

2015-02-27 Thread Jens Rantil
ze(the number of > rows)? > When one partition's data is extreme large, the write/read will slow? > Can anyone show me some exist usecases. > thanks! > > > > > > -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web:

Re: How to speed up SELECT * query in Cassandra

2015-02-13 Thread Jens Rantil
very poor >> datawarehouse ot long term time series store) and then use services to >> process queries that merge data from hadoop and cassandra. >> >> Also, spark on hdfs gives more flexibility in terms of large datasets >> and performance. The very nature

Re: Added new nodes to cluster but no streams

2015-02-13 Thread Jens Rantil
if you are in a version without the fix for CASSANDRA-2434, in theory > adding multiple nodes "at once" might contribute to their bootstraps > hanging. > > Stop cassandra on the joining nodes, wipe/move aside their data > directories, and try again one at a time. > &g

Re: How to speed up SELECT * query in Cassandra

2015-02-11 Thread Jens Rantil
On Wed, Feb 11, 2015 at 11:40 AM, Marcelo Valle (BLOOMBERG/ LONDON) < mvallemil...@bloomberg.net> wrote: > If you use Cassandra enterprise, you can use hive, AFAIK. Even better, you can use Spark/Shark with DSE. Cheers, Jens -- Jens Rantil Backend engineer Tink AB Email:

Re: how to batch the select query to reduce network communication

2015-02-06 Thread Jens Rantil
* from t where a = 1 and b = 2 limit 10; >> select * from t where a = 1 and b = 3 limit 10; >> >> how can i batch this, and only execute once to get the result >> > > > -- > > > > -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Pho

Re: Writing the same column frequently - anti pattern?

2015-02-06 Thread Jens Rantil
. So I assume for > that particular case no tombstone is set but the column is replaced in > memory and then the 'newest' version is flushed to disk. > > Is this assumption correct? Or Is writing the same column an an > anti-pattern? > > I am thankful for any input. >

RE: Retrieving all row keys of a CF

2015-01-29 Thread Jens Rantil
I had the same issue and overcame it by querying for primary keys over all subset s of the token range/ring. ——— Jens Rantil Backend Engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter On Thu, Jan 29, 2015 at 10:32 PM, Ravi Agrawal

Re: Controlling the MAX SIZE of sstables after compaction

2015-01-26 Thread Jens Rantil
se hector to this? I have no personal experience with Hector, but I suppose so. Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter On Mon, Jan 26, 2015 at 9:57 AM, Parth Setya wrote:

Re: Controlling the MAX SIZE of sstables after compaction

2015-01-26 Thread Jens Rantil
which could be pretty messy. Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter On Mon, Jan 26, 2015 at 7:40 AM, Parth Setya wrote: > Hi > *Setup* > *3 Node Cluster* > Api- &

Re: How to know disk utilization by each row on a node

2015-01-20 Thread Jens Rantil
Hi, Datastax comes with sstablekeys that does that. You could also use sstable2json script to find keys. Cheers, Jens On Tue, Jan 20, 2015 at 2:53 PM, Edson Marquezani Filho wrote: > Hello, everybody. > Does anyone know a way to list, for an arbitrary column family, all > the rows owned (incl

Re: keyspace not exists?

2015-01-16 Thread Jens Rantil
Hi Jason, Have you checked the Cassandra log? Cheers, Jens On Fri, Jan 16, 2015 at 10:59 AM, Jason Wee wrote: > $ cqlsh 192.168.0.2 9042 > Connected to just4fun at 192.168.0.2:9042. > [cqlsh 5.0.1 | Cassandra 2.1.1 | CQL spec 3.2.0 | Native protocol v3] > Use HELP for help. > cqlsh> DESCRIBE K

Script to count tombstones by partition key

2015-01-14 Thread Jens Rantil
interested. Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter

TombstoneOverwhelmingException for few tombstones

2015-01-07 Thread Jens Rantil
ar tombstone_failure_threshold: 10 Can anyone explain why Cassandra is overwhelmed when I’m nowhere near the hard limit? Thanks, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter

Re: Implications of ramping up max_hint_window_in_ms

2015-01-05 Thread Jens Rantil
Thanks for input, Rob. Just making sure, is "older version" the same as "less than version 2"? On Mon, Jan 5, 2015 at 8:13 PM, Robert Coli wrote: > On Mon, Jan 5, 2015 at 2:52 AM, Jens Rantil wrote: >> Since repair is a slow and daunting process*

Implications of ramping up max_hint_window_in_ms

2015-01-05 Thread Jens Rantil
? * I know incremental repair is coming up, but I don’t consider it stable enough. Thanks, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter

Re: is primary key( foo, bar) the same as primary key ( foo ) with a ‘set' of bars?

2015-01-01 Thread Jens Rantil
...they have a somewhat different conflict/repair resolutions, too. On Thu, Jan 1, 2015 at 8:06 PM, DuyHai Doan wrote: > Storage-engine wise, they are almost equivalent, thought there are some > minor differences: > 1) with Set structure, you cannot store more that 64kb worth of data > 2) collec

Re: How many tombstones for deleted CQL row?

2014-12-26 Thread Jens Rantil
gt; create a "row tomstone" and not one tombstone per column, fortunately > On Fri, Dec 26, 2014 at 10:50 AM, Jens Rantil wrote: >> Hi, >> >> I am considering tuning the tombstone warn/error threshold. >> >> Just making sure; If I INSERT one (CQL) row

How many tombstones for deleted CQL row?

2014-12-26 Thread Jens Rantil
Hi, I am considering tuning the tombstone warn/error threshold. Just making sure; If I INSERT one (CQL) row populating all six columns and then DELETE the inserted row, will Cassandra write 1 "range tombstone" or seven tombstones (one per columns plus "row marker")? Thanks, Jens

Re: Sqoop Free Form Import Query Breaks off

2014-12-25 Thread Jens Rantil
Hi, Does this have anything to do with Cassandra? Also, please try to avoid cross posting; It makes it hard for - future readers to read the full thread. - anyone to follow the full thread. - anyone to respond. I assume there are few who are enrolled to both mailing lists at the same time. Than

Re: Understanding tombstone WARN log output

2014-12-19 Thread Jens Rantil
Hi again, A follow-up question (to my yet unanswered question): How come the first localDeletion is Integer.MAX_VALUE above? Should it be? Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin

Re: Multi DC informations (sync)

2014-12-19 Thread Jens Rantil
the status of that. 2 - `nodetool status` is your friend. It will tell you whether the cluster considers other nodes reachable or not. Run it on a node in the datacenter that you’d like to test connectivity from. Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran

Re: Replacing nodes disks

2014-12-18 Thread Jens Rantil
tes for strong consistency. > What do you say? > > Another question is (and I know it depends on many factors but I'd like to > hear an experienced estimation): How much time would take to rebuild a 250G > data node? > > Thanks in advance, > Or. > > -- > O

Understanding tombstone WARN log output

2014-12-18 Thread Jens Rantil
=1418720184675000, localDeletion=1418720184] ... in system.log. My primary key is ((userid uuid), id uuid). Is it possible for me to see from this output which partition key and/or ranges that has all of these tombstones? Thanks, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone

Query strategy with respect to tombstones

2014-12-17 Thread Jens Rantil
alternatives here?  In the best of worlds, the fetchSize property would also honour the number of tombstones, but I don’t think that would be possible, right? Thanks, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin

Re: 100% CPU utilization, ParNew and never completing compactions

2014-12-16 Thread Jens Rantil
Maybe checking which thread(s) would hint what's going on? (see http://www.boxjar.com/using-top-and-jstack-to-find-the-java-thread-that-is-hogging-the-cpu/). On Wed, Dec 17, 2014 at 1:51 AM, Arne Claassen wrote: > Cassandra 2.0.10 and Datastax Java Driver 2.1.1 > On Dec 16, 2014, at 4:48 PM, Ry

Re: Understanding what is key and partition key

2014-12-16 Thread Jens Rantil
For the first row, the key is: (2014, N, 1, සියළුම, යුද්ධ) and the value-part is (664). Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter On Tue, Dec 16, 2014 at 2:25 PM, Chamila

Re: Hinted handoff not working

2014-12-14 Thread Jens Rantil
Hi Robert , Maybe you need to flush your memtables to actually see the disk usage increase? This applies to both hosts. Cheers, Jens On Sun, Dec 14, 2014 at 3:52 PM, Robert Wille wrote: > I have a cluster with RF=3. If I shut down one node, add a bunch of data to > the cluster, I don’t see a

`nodetool cfhistogram` utility script

2014-12-12 Thread Jens Rantil
improvements would obviously be to not hardcode `us:` and support the other histograms. Also, this logic should maybe even be moved into the   `nodetool cfhistogram` since these are fairly common metrics for latency. Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone

Re: batch_size_warn_threshold_in_kb

2014-12-11 Thread Jens Rantil
Maybe slightly off-topic, but what is a mutation? Is it equivalent to a CQL row? Or maybe a column in a row? Does include tombstones within the selected range? Thanks, Jens On Thu, Dec 11, 2014 at 9:56 PM, Ryan Svihla wrote: > Nothing magic, just put in there based on experience. You can find

Re: Best practice for emulating a Cassandra timeout during unit tests?

2014-12-10 Thread Jens Rantil
Hi, I don’t know if this is “best practice”, but you could do this using mocking if nothing else. Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter On Tue, Dec 9, 2014 at 8:42 PM, Clint

  1   2   >