Re: cold vs hot data

2018-09-20 Thread Jens Rantil
be archived and may > be scanned by us and/or by external service providers to detect and prevent > threats to our systems, investigate illegal or inappropriate behavior, > and/or eliminate unsolicited promotional e-mails (“spam”). If you have any > concerns about this process, please co

Re: Current active queries and status/type

2018-03-06 Thread Jens Rantil
quest) >> >> >> On 1 March 2018 at 15:50, D. Salvatore <dd.salvat...@gmail.com> wrote: >> >>> Hello! >>> There is any way to know how many queries a node is currently serving >>> through JMX(or other tools)? And the state of the request so, fo

Re: One time major deletion/purge vs periodic deletion

2018-03-06 Thread Jens Rantil
frequently > (run the job weekly??) > > > > Some estimates on the number of deletes performed would be…upto 80-90K > rows purged in 3 months vs 10K deletes every week ?? > > > > Thanks, > > Charu > > > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan

Re: Multiple nodes decommission

2017-04-16 Thread Jens Rantil
> > On Sat, Apr 8, 2017 at 10:55 AM, Vlad <qa23d-...@yahoo.com> wrote: > > Hi, > > how multiple nodes should be decommissioned by "nodetool decommission"- > one by one or in parallel ? > > Thanks. > > > > > > -- Jens Ra

`nodetool verify` outcome check

2017-01-03 Thread Jens Rantil
Hi, We've had a discussion internally to start to run `nodetool verify` periodically to test for bitrot. Does anyone know how I could check if the verification failed or succeeded from, say, a script? Is there an error exit code or some output I could grep for? Thanks, Jens -- Jens Rantil

Re: Backup restore with a different name

2016-11-02 Thread Jens Rantil
for reference while keeping the (corrupt) current state in the live cluster". Cheers, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.com/#!/tink.se> Linkedin <http://ww

Re: Backup restore with a different name

2016-11-02 Thread Jens Rantil
supported. > > > > Here is an option: https://github.com/anubhavkale/CassandraTools/ > tree/master/BackupRestore > > > > > > *From:* Jens Rantil [mailto:jens.ran...@tink.se] > *Sent:* Wednesday, November 2, 2016 2:21 PM > *To:* Cassandra Group <use

Backup restore with a different name

2016-11-02 Thread Jens Rantil
ooks at the old copy? Cheers, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.com/#!/tink.se> Linkedin <http://www.linkedin.com/company/2735919?trk=vsrp_companies_res_photo=VSRPsear

Re: Cassandra Poor Read Performance Response Time

2016-11-02 Thread Jens Rantil
options file. We do intend to change the storage to local storage and > expect this will have a significant impact but i was wondering if there's > anything else which could be changed which will also have a significant > impact on read performance? > > Thanks > Ian > > --

Re: Does anyone store larger values in Cassandra E.g. 500 KB?

2016-10-24 Thread Jens Rantil
or Software Engineer | Instaclustr >>> >>> >>> >>> >>> This email has been sent on behalf of Instaclustr Pty Ltd (Australia) >>> and Instaclustr Inc (USA). >>> >>> This email and any attachments may contain confidential and leg

Re: understanding partitions and # of nodes

2016-09-22 Thread Jens Rantil
100 partitions I guess it helps because when you add more nodes to > your cluster, the data can be redistributed since you have more nodes. > > What else are things to consider? > > Thanks. > -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 8

Re: Nodetool repair

2016-09-20 Thread Jens Rantil
've also heard that the number of clustering keys per partition key could have an impact. Might be worth investigating. Cheers, Jens -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: Nodetool repair

2016-09-19 Thread Jens Rantil
eve repair > performs following operations - > > 1) Major compaction > 2) Exchange of merkle trees with neighbouring nodes. > > Is there any other operation performed during manual repair? What if I > kill the process in the middle? > > Thanks. > Lokesh > -- Jens Rantil

Re: How Fast Does Information Spread With Gossip?

2016-09-16 Thread Jens Rantil
arly interested in how fast information about the liveness of a > node spreads. For example, in an n-node cluster the median amount of time > it takes for all nodes to learn that a node went down is f(n) seconds. Is a > minute a reasonable upper bound for most clusters? Too high, too low? > &g

Re: Maximum number of columns in a table

2016-09-16 Thread Jens Rantil
manage the different types then ? Because maps in >>>>>>>> Cassandra are strongly typed >>>>>>>> >>>>>>>> Unless you set the type of map value to blob, in this case you >>>>>>>> might as well store all the objec

Re: Is to ok restart DECOMMISION

2016-09-16 Thread Jens Rantil
; > Does killing node/stopping decommission and restarting decommission will > > cause any issues to cluster? > > > > Using c*-2.0.17 , 2 Data centers, each DC with 3 groups each , each group > > with 3 nodes with RF-3 > > > > -- > > Thanks...! > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: [ANNOUNCEMENT] Website update

2016-09-12 Thread Jens Rantil
bsite looks great. >> Good job guys. >> >> -- >> Ashish Disawal >> >> On Mon, Sep 12, 2016 at 3:00 AM, Jens Rantil <jens.ran...@tink.se> wrote: >> >>> Nice! The website also feels snappier! >>> >>> >>> On

Re: Cassandra and Kubernetes and scaling

2016-09-12 Thread Jens Rantil
2016, David Aronchick <aronch...@gmail.com> wrote: > Please let me know if I can help at all! > > On Sun, Sep 11, 2016 at 2:55 PM, Jens Rantil <jens.ran...@tink.se > <javascript:_e(%7B%7D,'cvml','jens.ran...@tink.se');>> wrote: > >> Hi Aiman, >> >&g

Re: Cassandra and Kubernetes and scaling

2016-09-11 Thread Jens Rantil
t terminated, leaving you with potential missing replicas > > > > 3. Scaling up and increasing the RF of a particular keyspace, would > there be a clean way to do this with the kubernetes tooling? > > > > In the end I'm wondering how much of the Kubernetes + Cassandra invo

Re: Schema Disagreement vs Nodetool resetlocalschema

2016-09-11 Thread Jens Rantil
localschema to force the > schema synchronization. How safe is this method? Do we need to disable > thrift/gossip protocol before performing this function, and enable them > back after resync completes? > > > > Thanks in advance! > > > > Sincerely, > > > > Michael Fong

Re: [ANNOUNCEMENT] Website update

2016-09-11 Thread Jens Rantil
; contribution) > is more than welcome. > > Best, > On behalf of the Apache Cassandra developers. > -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.com/#!/tink.se> Li

Re: Bootstrapping multiple cassandra nodes simultaneously in existing dc

2016-09-11 Thread Jens Rantil
Sun, Sep 11, 2016, 17:10 Jens Rantil <jens.ran...@tink.se > <javascript:_e(%7B%7D,'cvml','jens.ran...@tink.se');>> wrote: > >> Hi Bhuvan, >> >> I have done such expansion multiple times and can really recommend >> bootstrapping a new DC and p

Re: large number of pending compactions, sstables steadily increasing

2016-09-11 Thread Jens Rantil
0, 0] > >>> > >>> Space used (live): 301894591442 > >>> > >>> Space used (total): 301894591442 > >>> > >>> > >>> > >>> Problematic node > >>> > >>> Ke

Re: Bootstrapping multiple cassandra nodes simultaneously in existing dc

2016-09-11 Thread Jens Rantil
AddDCToCluster.html> > and > bootstrap multiple nodes simultaneously by keeping auto_bootstrap false in > cassandra.yaml and rebuilding nodes simultaneously in the new dc? > > > Thanks & Regards, > Bhuvan > -- Jens Rantil Backend engineer Tink AB Email: jens.ra

Re: Isolation in case of Single Partition Writes and Batching with LWT

2016-09-11 Thread Jens Rantil
ould > there a chance of inconsistency in this case (When LWT is being used in > batches). > > 3. Is it possible to use multiple LWT in a single Batch? In general how > does LWT performs with Batch and is Paxos acted on before batch execution? > > Can someone help us with thi

Re: Finding records that exist on Cassandra but not externally

2016-09-08 Thread Jens Rantil
for > any data refresh only a very small fraction (<.1%) will actually need > deleting. 99% of the time I'll just be overwriting existing keys. > > I'd be grateful if anyone could shed some advice on the best solution here > or whether there's some better way I haven't thought of.

Re: Finding records that exist on Cassandra but not externally

2016-09-07 Thread Jens Rantil
fraction (<.1%) will actually need > deleting. 99% of the time I'll just be overwriting existing keys. > > I'd be grateful if anyone could shed some advice on the best solution here > or whether there's some better way I haven't thought of. > > Thanks, > > Chris > --

Re: Ring connection timeouts with 2.2.6

2016-06-30 Thread Jens Rantil
e drift. >> >> The network appears to be fine between nodes, with iperf tests showing >> that we have a lot of headroom. >> >> Any thoughts on what to look for? Can we increase thread count/pool sizes >> for the messaging service? >> >> Thanks, &g

Re: some questions

2016-06-30 Thread Jens Rantil
I want use UDF in update, but this cql can’t execute. have some advise??? > > update table_name set field=my_function(field) where … > > > tnk u so much > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: Multi DC setup question

2016-06-30 Thread Jens Rantil
> application enters the primary DC else the application URL be directed to > another DC. > > > > What is the best option to achieve this?? > > > > Thanks, > > Charu > > > > > > > > > > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: Motivation for a DHT ring

2016-06-30 Thread Jens Rantil
; >> Thank you so much for clarification. >> >> Kind regards. >> > > -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matters you can reach me at +46-708-84 18 32.

Re: tuning repairs and compaction options

2016-05-06 Thread Jens Rantil
options to have a more gentle repair behaviour? Which > settings should I look at if I want CPU to stay below 50% for instance. My > worry is always to impact the read/write performance during times when we > do anti-entropy repairs. > > Cheers, > Reik > -- Jens Rantil Backend D

Re: Alternative approach to setting up new DC

2016-04-21 Thread Jens Rantil
gc_grace_seconds after when the backup is taken. As of me, I managed to a get a more stable VPN setup and did not have to go down this path. Cheers, Jens On Mon, Apr 18, 2016 at 10:15 AM Jens Rantil <jens.ran...@tink.se> wrote: > Hi, > > I am provisioning a new datacenter for an e

Re: When are hints written?

2016-04-21 Thread Jens Rantil
when hints are written? > > Regarding your other post: Yes, 3.0.3 is pretty new. But we are new to > this cassandra game, and our schema-fu is not strong enough for us to > create a schema without using materialized views :) > > > ons. 20. apr. 2016 kl. 17.09 skrev J

Re: When are hints written?

2016-04-20 Thread Jens Rantil
ld like for the cluster to wait for the write to be > persisted on the relevant nodes before returning an ok to the client. But I > don't know which knobs to turn to accomplish this? or if it is even > possible :) > > We are running cassandra 3.0.3, with 8Gb heap and a replication factor of > 3

Alternative approach to setting up new DC

2016-04-18 Thread Jens Rantil
onds after operation 3) above, use sstableloader to stream my backup to the new nodes. 5. For safety precaution, do a full repair. Could you see any issues with doing this? Cheers, Jens -- Jens Rantil Backend Developer @ Tink Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden For urgent matte

Hanging pending compactions

2015-07-08 Thread Jens Rantil
for me to extract debugging information to file a bug report before restarting the nodes? Cheers, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https://www.facebook.com/#!/tink.se Linkedin http://www.linkedin.com/company

Re: Consistent reads and first write wins

2015-07-08 Thread Jens Rantil
might see different values? -- - John -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https://www.facebook.com/#!/tink.se Linkedin http://www.linkedin.com/company/2735919?trk=vsrp_companies_res_phototrkInfo=VSRPsearchId

RE: nodetool repair

2015-06-19 Thread Jens Rantil
Hi, For the record I've succesfully used https://github.com/BrianGallew/cassandra_range_repair to make smooth repairing. Could maybe also be of interest don't know... Cheers, Jens – Skickat från Mailbox On Fri, Jun 19, 2015 at 8:36 PM, null sean_r_dur...@homedepot.com wrote: It

Re: Question regarding concurrent bootstrapping

2015-06-14 Thread Jens Rantil
: On Fri, Jun 12, 2015 at 5:21 AM, Jens Rantil jens.ran...@tink.se wrote: Let's say I have an existing cluster and do the following: 1. I start a new joining node (A). It enters state Up/Joining. Streaming automatically start to this node. 2. I wait two minutes (best practise

Question about nodetool status ... output

2015-06-12 Thread Jens Rantil
was a mistake) and then X.X.X.51. I haven't executed `nodetool cleanup` on any nodes yet. For the curious, the full ring can be found here: https://gist.github.com/JensRantil/57ee515e647e2f154779 Cheers, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18

Question regarding concurrent bootstrapping

2015-06-12 Thread Jens Rantil
of? This is of importance for planning when one it expanding a cluster to multiple smaller nodes. Thanks, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https://www.facebook.com/#!/tink.se Linkedin http://www.linkedin.com

Re: Question about nodetool status ... output

2015-06-12 Thread Jens Rantil
/in/carlosjuzarterolo http://linkedin.com/in/carlosjuzarterolo* Mobile: +31 6 159 61 814 | Tel: +1 613 565 8696 x1649 www.pythian.com On Fri, Jun 12, 2015 at 11:58 AM, Jens Rantil jens.ran...@tink.se wrote: Hi, I have one node in my 5-node cluster that effectively owns 100% and it looks like my cluster

Re: Hbase vs Cassandra

2015-06-08 Thread Jens Rantil
specific to time series data). The comparison in the following helps: 1: features 2: deployment and monitoring 3: performance 4: anything else Thanks Ajay -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https

Re: Hbase vs Cassandra

2015-06-08 Thread Jens Rantil
rollback?. Yes. /Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https://www.facebook.com/#!/tink.se Linkedin http://www.linkedin.com/company/2735919?trk=vsrp_companies_res_phototrkInfo=VSRPsearchId%3A1057023381369207406670

Re: Decommission datacenter - repair?

2015-06-07 Thread Jens Rantil
Ah, that explains things. Thanks! On Fri, Jun 5, 2015 at 10:59 PM, Robert Coli rc...@eventbrite.com wrote: On Fri, Jun 5, 2015 at 5:15 AM, Jens Rantil jens.ran...@tink.se wrote: Datastax's documentation on Decommissioning a data center http://docs.datastax.com/en/cassandra/2.0/cassandra

Re: Newly added node getting more data than expected

2015-06-07 Thread Jens Rantil
Hi again, I should also point out that `nodetool ring ...` only has one entry for X.X.X.4 and that that token range is equally large as the other token ranges for the virtual nodes. Let me know if you need any more information from me. Cheers, Jens On Sun, Jun 7, 2015 at 11:19 PM, Jens Rantil

Newly added node getting more data than expected

2015-06-07 Thread Jens Rantil
is receiving more data than expected? Does this have to do with the way the GossipingPropertyFileSnitch decides where to put secondary/tertiary replicas (ie. always next physical node in ring)? Do I need to execute `nodetool cleanup` also on newly commissioned nodes? Thanks, Jens -- Jens Rantil

Decommission datacenter - repair?

2015-06-05 Thread Jens Rantil
decommissioning going to hand over all data anyway? Then why is the repair necessary? Cheers, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https://www.facebook.com/#!/tink.se Linkedin http://www.linkedin.com/company/2735919?trk

Re: Decommission datacenter - repair?

2015-06-05 Thread Jens Rantil
at 5:45 PM, Jens Rantil jens.ran...@tink.se wrote: Hi, I asked this on IRC earlier today, but didn't get any response; Datastax's documentation on Decommissioning a data center http://docs.datastax.com/en/cassandra/2.0/cassandra/operations/ops_decomission_dc_t.html tells me to run a full

Re: Concurrent schema creation/change strategy

2015-05-26 Thread Jens Rantil
coming back to determine if a conflict happened, 3) if conflict, move on to next table? Or is it just better to add a separate step to create the schema at some point in time before the clients can be allowed to work (i.e. move schema creation out of the clients)? Thanks /Magnus -- Jens

Re: Performance penalty of multiple UPDATEs of non-pk columns

2015-05-21 Thread Jens Rantil
, but does executing the SELECT reads all the values (O(n), n - number of updates) or only the current one (O(1)) ? How the situation looks for Counter types? -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https

Re: Hive support on Cassandra

2015-05-07 Thread Jens Rantil
? I found couple of open source efforts but nothing is available currently. Thanks Ajay -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https://www.facebook.com/#!/tink.se Linkedin http://www.linkedin.com/company/2735919

Re: Query returning tombstones

2015-05-02 Thread Jens Rantil
point me to an existing jira-ticket, but I also appreciate any other feedback :-) regards, Christian -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https://www.facebook.com/#!/tink.se Linkedin http://www.linkedin.com

Re: When to use STCS/DTCS/LCS

2015-04-09 Thread Jens Rantil
thats enough.Please guide me. Thanks in advance. Thanks and Regards, Divya -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https://www.facebook.com/#!/tink.se Linkedin http://www.linkedin.com/company/2735919?trk

Re: Help understanding aftermath of death by GC

2015-03-31 Thread Jens Rantil
- not necessarily in the thread which is taking all the memory. I've seen this happen multiple times. If this happened to you, a critical Cassandra thread could have died and brought the whole Cassandra DB with itself. Just an idea - cheers, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran

Re: Really high read latency

2015-03-23 Thread Jens Rantil
fundamentally broken about my data model? Thanks! -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https://www.facebook.com/#!/tink.se Linkedin http://www.linkedin.com/company/2735919?trk=vsrp_companies_res_phototrkInfo

Re: Store data with cassandra

2015-03-20 Thread Jens Rantil
Jean, I'm not sure you will receive any reply unless you ask specific questions about those links. Cheers, Jens – Skickat från Mailbox On Fri, Mar 20, 2015 at 5:08 PM, Sibbald, Charles charles.sibb...@bskyb.com wrote: Sounds like this is a job for jackrabbit ?

Re: Timeout error in fetching million rows as results using clustering keys

2015-03-18 Thread Jens Rantil
Hi, Try setting fetchsize before querying. Assuming you don't set it too high, and you don't have too many tombstones, that should do it. Cheers, Jens – Skickat från Mailbox On Wed, Mar 18, 2015 at 2:58 AM, Mehak Mehta meme...@cs.stonybrook.edu wrote: Hi, I have requirement to fetch

Re: Inconsistent count(*) and distinct results from Cassandra

2015-03-04 Thread Jens Rantil
Frens, What consistency are you querying with? Could be you are simply receiving result from different nodes each time. Jens – Skickat från Mailbox On Wed, Mar 4, 2015 at 7:08 PM, Mikhail Strebkov streb...@gmail.com wrote: We have observed the same issue in our production Cassandra

Re: Input/Output Error

2015-03-04 Thread Jens Rantil
Hi, Check your Cassandra and kernel (if on Linux) log files for errors. Cheers, Jens – Skickat från Mailbox On Wed, Mar 4, 2015 at 2:18 AM, 曹志富 cao.zh...@gmail.com wrote: Some times My C* 2.1.3 cluster compaction or streaming occur this error ,do this because of disk or filesystem

Re: best practices for time-series data with massive amounts of records

2015-03-03 Thread Jens Rantil
above, but switch to an order-preserving hashing function, and then manually hash the id field. This is essentially what we would do in HBase. Like you might already know, this order preserving hashing is _not_ considered best practise in the Cassandra world. Cheers, Jens -- Jens Rantil

Re: using or in select query in cassandra

2015-03-02 Thread Jens Rantil
in my WHERE clause. ex: select * from table where id =123 OR name ='abc' so in above i want that i get data if my id is 123 or my name is abc . is there any possibility in cassandra to achieve this . -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32

Re: How to extract all the user id from a single table in Cassandra?

2015-03-02 Thread Jens Rantil
) { System.out.println(error= + e); } return userList; } } Adding java-driver group and Cassandra group as well to see whether there is any better way to execute this? -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web

Re: how many rows can one partion key hold?

2015-02-27 Thread Jens Rantil
)? When one partition's data is extreme large, the write/read will slow? Can anyone show me some exist usecases. thanks! -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https://www.facebook.com/#!/tink.se Linkedin

Re: Added new nodes to cluster but no streams

2015-02-13 Thread Jens Rantil
multiple nodes at once might contribute to their bootstraps hanging. Stop cassandra on the joining nodes, wipe/move aside their data directories, and try again one at a time. =Rob -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se

Re: How to speed up SELECT * query in Cassandra

2015-02-13 Thread Jens Rantil
859 6129 Skype colin.p.clark On Feb 11, 2015, at 4:49 AM, Jens Rantil jens.ran...@tink.se wrote: On Wed, Feb 11, 2015 at 11:40 AM, Marcelo Valle (BLOOMBERG/ LONDON) mvallemil...@bloomberg.net wrote: If you use Cassandra enterprise, you can use hive, AFAIK. Even better, you can use

Re: How to speed up SELECT * query in Cassandra

2015-02-11 Thread Jens Rantil
On Wed, Feb 11, 2015 at 11:40 AM, Marcelo Valle (BLOOMBERG/ LONDON) mvallemil...@bloomberg.net wrote: If you use Cassandra enterprise, you can use hive, AFAIK. Even better, you can use Spark/Shark with DSE. Cheers, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se

Re: Writing the same column frequently - anti pattern?

2015-02-06 Thread Jens Rantil
assume for that particular case no tombstone is set but the column is replaced in memory and then the 'newest' version is flushed to disk. Is this assumption correct? Or Is writing the same column an an anti-pattern? I am thankful for any input. Regards Andi -- Jens Rantil Backend

Re: how to batch the select query to reduce network communication

2015-02-06 Thread Jens Rantil
execute once to get the result -- -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https://www.facebook.com/#!/tink.se Linkedin http://www.linkedin.com/company/2735919?trk=vsrp_companies_res_phototrkInfo=VSRPsearchId

Re: Controlling the MAX SIZE of sstables after compaction

2015-01-26 Thread Jens Rantil
to this? I have no personal experience with Hector, but I suppose so. Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter On Mon, Jan 26, 2015 at 9:57 AM, Parth Setya setya.pa...@gmail.com wrote

Re: Controlling the MAX SIZE of sstables after compaction

2015-01-26 Thread Jens Rantil
which could be pretty messy. Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter On Mon, Jan 26, 2015 at 7:40 AM, Parth Setya setya.pa...@gmail.com wrote: Hi *Setup* *3 Node Cluster* Api

Re: How to know disk utilization by each row on a node

2015-01-20 Thread Jens Rantil
Hi, Datastax comes with sstablekeys that does that. You could also use sstable2json script to find keys. Cheers, Jens On Tue, Jan 20, 2015 at 2:53 PM, Edson Marquezani Filho edsonmarquez...@gmail.com wrote: Hello, everybody. Does anyone know a way to list, for an arbitrary column family,

Re: keyspace not exists?

2015-01-16 Thread Jens Rantil
Hi Jason, Have you checked the Cassandra log? Cheers, Jens On Fri, Jan 16, 2015 at 10:59 AM, Jason Wee peich...@gmail.com wrote: $ cqlsh 192.168.0.2 9042 Connected to just4fun at 192.168.0.2:9042. [cqlsh 5.0.1 | Cassandra 2.1.1 | CQL spec 3.2.0 | Native protocol v3] Use HELP for help.

Script to count tombstones by partition key

2015-01-14 Thread Jens Rantil
is interested. Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter

TombstoneOverwhelmingException for few tombstones

2015-01-07 Thread Jens Rantil
explain why Cassandra is overwhelmed when I’m nowhere near the hard limit? Thanks, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter

Re: Implications of ramping up max_hint_window_in_ms

2015-01-05 Thread Jens Rantil
Thanks for input, Rob. Just making sure, is older version the same as less than version 2? On Mon, Jan 5, 2015 at 8:13 PM, Robert Coli rc...@eventbrite.com wrote: On Mon, Jan 5, 2015 at 2:52 AM, Jens Rantil jens.ran...@tink.se wrote: Since repair is a slow and daunting process*, I am

Implications of ramping up max_hint_window_in_ms

2015-01-05 Thread Jens Rantil
of? * I know incremental repair is coming up, but I don’t consider it stable enough. Thanks, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter

Re: is primary key( foo, bar) the same as primary key ( foo ) with a ‘set' of bars?

2015-01-01 Thread Jens Rantil
...they have a somewhat different conflict/repair resolutions, too. On Thu, Jan 1, 2015 at 8:06 PM, DuyHai Doan doanduy...@gmail.com wrote: Storage-engine wise, they are almost equivalent, thought there are some minor differences: 1) with Set structure, you cannot store more that 64kb worth

How many tombstones for deleted CQL row?

2014-12-26 Thread Jens Rantil
Hi, I am considering tuning the tombstone warn/error threshold. Just making sure; If I INSERT one (CQL) row populating all six columns and then DELETE the inserted row, will Cassandra write 1 range tombstone or seven tombstones (one per columns plus row marker)? Thanks, Jens

Re: How many tombstones for deleted CQL row?

2014-12-26 Thread Jens Rantil
a row tomstone and not one tombstone per column, fortunately On Fri, Dec 26, 2014 at 10:50 AM, Jens Rantil jens.ran...@tink.se wrote: Hi, I am considering tuning the tombstone warn/error threshold. Just making sure; If I INSERT one (CQL) row populating all six columns and then DELETE

Re: Sqoop Free Form Import Query Breaks off

2014-12-25 Thread Jens Rantil
Hi, Does this have anything to do with Cassandra? Also, please try to avoid cross posting; It makes it hard for - future readers to read the full thread. - anyone to follow the full thread. - anyone to respond. I assume there are few who are enrolled to both mailing lists at the same time.

Re: Multi DC informations (sync)

2014-12-19 Thread Jens Rantil
the status of that. 2 - `nodetool status` is your friend. It will tell you whether the cluster considers other nodes reachable or not. Run it on a node in the datacenter that you’d like to test connectivity from. Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran

Re: Understanding tombstone WARN log output

2014-12-19 Thread Jens Rantil
Hi again, A follow-up question (to my yet unanswered question): How come the first localDeletion is Integer.MAX_VALUE above? Should it be? Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin

Understanding tombstone WARN log output

2014-12-18 Thread Jens Rantil
=1418720184675000, localDeletion=1418720184] ... in system.log. My primary key is ((userid uuid), id uuid). Is it possible for me to see from this output which partition key and/or ranges that has all of these tombstones? Thanks, Jens -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone

Re: Replacing nodes disks

2014-12-18 Thread Jens Rantil
it depends on many factors but I'd like to hear an experienced estimation): How much time would take to rebuild a 250G data node? Thanks in advance, Or. -- Or Sher -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https

Query strategy with respect to tombstones

2014-12-17 Thread Jens Rantil
alternatives here?  In the best of worlds, the fetchSize property would also honour the number of tombstones, but I don’t think that would be possible, right? Thanks, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin

Re: Understanding what is key and partition key

2014-12-16 Thread Jens Rantil
For the first row, the key is: (2014, N, 1, සියළුම, යුද්ධ) and the value-part is (664). Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter On Tue, Dec 16, 2014 at 2:25 PM, Chamila

Re: 100% CPU utilization, ParNew and never completing compactions

2014-12-16 Thread Jens Rantil
Maybe checking which thread(s) would hint what's going on? (see http://www.boxjar.com/using-top-and-jstack-to-find-the-java-thread-that-is-hogging-the-cpu/). On Wed, Dec 17, 2014 at 1:51 AM, Arne Claassen a...@emotient.com wrote: Cassandra 2.0.10 and Datastax Java Driver 2.1.1 On Dec 16,

Re: Hinted handoff not working

2014-12-14 Thread Jens Rantil
Hi Robert , Maybe you need to flush your memtables to actually see the disk usage increase? This applies to both hosts. Cheers, Jens On Sun, Dec 14, 2014 at 3:52 PM, Robert Wille rwi...@fold3.com wrote: I have a cluster with RF=3. If I shut down one node, add a bunch of data to the

`nodetool cfhistogram` utility script

2014-12-12 Thread Jens Rantil
improvements would obviously be to not hardcode `us:` and support the other histograms. Also, this logic should maybe even be moved into the   `nodetool cfhistogram` since these are fairly common metrics for latency. Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone

Re: batch_size_warn_threshold_in_kb

2014-12-11 Thread Jens Rantil
Maybe slightly off-topic, but what is a mutation? Is it equivalent to a CQL row? Or maybe a column in a row? Does include tombstones within the selected range? Thanks, Jens On Thu, Dec 11, 2014 at 9:56 PM, Ryan Svihla rsvi...@datastax.com wrote: Nothing magic, just put in there based on

Re: Best practice for emulating a Cassandra timeout during unit tests?

2014-12-10 Thread Jens Rantil
Hi, I don’t know if this is “best practice”, but you could do this using mocking if nothing else. Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter On Tue, Dec 9, 2014 at 8:42 PM, Clint

Re: Cassandra backup via snapshots in production

2014-12-01 Thread Jens Rantil
environments. - Because it did, AFAIK, not support (asymmetric) encryption before uploading. -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook https://www.facebook.com/#!/tink.se Linkedin http://www.linkedin.com/company/2735919

Re: Cassandra add a node and remove a node

2014-11-30 Thread Jens Rantil
the old node. See [1]. [1] http://www.datastax.com/documentation/cassandra/2.0/cassandra/operations/ops_replace_live_node.html Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter On Mon

Re: Cassandra backup via snapshots in production

2014-11-27 Thread Jens Rantil
. Make sure to pipe the output to a file or the `syslog` utility.  * It does not do continuous/point-in-time backup. That said, it does its job for us for now. Feel free to propose improvements! Cheers, Jens ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46

Re: Cassandra backup via snapshots in production

2014-11-25 Thread Jens Rantil
Truncate does trigger snapshot creation though Doesn’t it? With “auto_snapshot: true” it should. ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter On Tue, Nov 25, 2014 at 9:21 AM, DuyHai Doan doanduy

Cassandra schema migrator

2014-11-25 Thread Jens Rantil
and system.schema_columns, but as always reusing a proven tool would be preferable. So far I only know of Spring Data Cassandra that handles creating tables and adding columns. However, it does not handle table properties in any way. Thanks, Jens ——— Jens Rantil Backend engineer Tink AB Email

Re: Problem with performance, memory consumption, and RLIMIT_MEMLOCK

2014-11-22 Thread Jens Rantil
Hi Dmitri, I have not used the CPP driver, but maybe you have forgotten set the equivalent of the Iava driver's fetchsize to something sensible? Just an idea, Jens — Sent from Mailbox On Sun, Nov 16, 2014 at 6:09 PM, Dmitri Dmitrienko ddmit...@gmail.com wrote: Hi, I have a very

Re: Cassandra backup via snapshots in production

2014-11-21 Thread Jens Rantil
and for each sstable; encrypts, uploads to S3 and deletes the snapshotted sstable. It took me an hour to write and roll out to all our nodes. The whole process is currently logged, but eventually I will also send an e-mail if backup fails. ——— Jens Rantil Backend engineer Tink AB Email: jens.ran

  1   2   >