Issue with pagination using paging state

2023-09-08 Thread Ritesh Kumar
Hello Team,I am trying to achieve pagination in Cassandra using paging state mechanism.I am trying to paginate through records with LIMIT set to 250 and fetch size set to 50. I get the paging state for the next set of 50 records up until the 250 records are retrieved but how can I paginate further

Re: Application level pagination in Cassandra

2020-07-30 Thread Erick Ramirez
I don't have experience with ScalarDB so I don't have an answer for you. I have to admit I've been here for a bit and ScalarDB doesn't really come up in discussion. So if you don't get a response, I would recommend you post your question in the ScalarDB community as well. Cheers! >

Application level pagination in Cassandra

2020-07-30 Thread Manu Chadha
Hi This question is part-Cassandra and part ScalarDB. I am using ScalarDB which provide ACID support on top of `Cassandra`. The library seem to be working well! Unfortunately, ScalarDB doesn't support pagination though so I have to implement it in the application. Consider this scenar

what happened to a pagination if some data are inserted before it get resumed ?

2019-10-31 Thread jagernicolas
ask to get the second page, some data were added to what was my first page, some to the second etc. what will I see when I resume the pagination ? will I get the results as if nothing was added to the database, or am I going to see on my second page some results that was pushed out of the first

Re: Cassandra Driver Pagination

2018-04-25 Thread Andy Tolbert
Hi Ahmed, It does not, it only reads enough rows to satisfy the clients request. Although, that may be a bit of an oversimplification as it has to scan through sstable files, read indices, pass over tombstones and so on, but it will stop reading new rows once it has read the number of rows the dri

Re: Cassandra Driver Pagination

2018-04-25 Thread Ahmed Eljami
Hi Andy, Thanks. When the driver requests X rows, C* will load the whole partition (All rows) before reply to driver ? Thanls. 2018-04-24 18:11 GMT+02:00 Andy Tolbert : > Hi Ahmed, > > The java driver docs do a good job explaining how the driver uses paging, > including providing a sequence di

Re: Cassandra Driver Pagination

2018-04-24 Thread Andy Tolbert
Hi Ahmed, The java driver docs do a good job explaining how the driver uses paging, including providing a sequence diagram that describes the flow of the process: https://docs.datastax.com/en/developer/java-driver/3.5/manual/paging/ The driver requests X rows (5000 by default, controlled via Quer

Cassandra Driver Pagination

2018-04-24 Thread Ahmed Eljami
Hello, Can someone explain me how paging is implemented ? according to the doc of datastax, the goal being to avoid loading much results in memory. Does it mean that the whole partition is not upload to heap memory? ​C* version: 2.1 Java Driver version: 3.0 ​Best regards​

Re: Migrating a Limit/Offset Pagination and Sorting to Cassandra

2017-10-07 Thread Daniel Hölbling-Inzko
I now finished a implementation where I just save the pagination state to a separate table and retrieve it to get to the next page. So far it seems to work pretty well. But I have to do more thorough testing. Greetings. On Wed 4. Oct 2017 at 19:42, Jon Haddad wrote: > Seems pre

Re: Migrating a Limit/Offset Pagination and Sorting to Cassandra

2017-10-04 Thread Jon Haddad
Seems pretty overengineered, imo, given you can just save the pagination state as Andy Tolbert pointed out. > On Oct 4, 2017, at 8:38 AM, Daniel Hölbling-Inzko > wrote: > > Thanks for pointing me to Elassandra. > Have you had any experience running this in production at sca

Re: Migrating a Limit/Offset Pagination and Sorting to Cassandra

2017-10-04 Thread Greg Saylor
clustering keys for each table to get your "pages". >>>> >>>> Also I'm assuming there's a lot of data per partition if in-mem sorting >>>> isn't an option, if this is true you will want to be wary of creating >>>> large pa

Re: Migrating a Limit/Offset Pagination and Sorting to Cassandra

2017-10-04 Thread Daniel Hölbling-Inzko
Hölbling-Inzko < >> daniel.hoelbling-in...@bitmovin.com> wrote: >> >>> Hi, >>> I am currently working on migrating a service that so far was MySQL >>> based to Cassandra. >>> Everything seems to work fine so far, but a few things in the old >

Re: Migrating a Limit/Offset Pagination and Sorting to Cassandra

2017-10-04 Thread Andy Tolbert
s and reading them all at once. Although this depends on your data >> model and compaction strategy choices. >> >> On 3 October 2017 at 08:36, Daniel Hölbling-Inzko < >> daniel.hoelbling-in...@bitmovin.com> wrote: >> >>> Hi, >>> I am currently wo

Re: Migrating a Limit/Offset Pagination and Sorting to Cassandra

2017-10-03 Thread Greg Saylor
g-Inzko > <mailto:daniel.hoelbling-in...@bitmovin.com>> wrote: > Hi, > I am currently working on migrating a service that so far was MySQL based to > Cassandra. > Everything seems to work fine so far, but a few things in the old services > API Spec is posing some inter

Re: Migrating a Limit/Offset Pagination and Sorting to Cassandra

2017-10-03 Thread Daniel Hölbling-Inzko
< > daniel.hoelbling-in...@bitmovin.com> wrote: > >> Hi, >> I am currently working on migrating a service that so far was MySQL based >> to Cassandra. >> Everything seems to work fine so far, but a few things in the old >> services API Spec is posing some i

Re: Migrating a Limit/Offset Pagination and Sorting to Cassandra

2017-10-03 Thread kurt greaves
ote: > Hi, > I am currently working on migrating a service that so far was MySQL based > to Cassandra. > Everything seems to work fine so far, but a few things in the old services > API Spec is posing some interesting data modeling challenges: > > The old service was doin

Migrating a Limit/Offset Pagination and Sorting to Cassandra

2017-10-03 Thread Daniel Hölbling-Inzko
Hi, I am currently working on migrating a service that so far was MySQL based to Cassandra. Everything seems to work fine so far, but a few things in the old services API Spec is posing some interesting data modeling challenges: The old service was doing Limit/Offset pagination which is obviously

Re: Pagination

2017-06-21 Thread Vladimir Yudovin
Hi, can this https://docs.datastax.com/en/developer/java-driver/2.1/manual/paging/ help you? Best regards, Vladimir Yudovin, Winguzone - Cloud Cassandra Hosting On Wed, 21 Jun 2017 02:44:17 -0400 web master wrote I am migrating from MySql to Cas

Pagination

2017-06-20 Thread web master
I am migrating from MySql to Cassandra , In mysql I use OFFSET and LIMIT to paginate , the problem is that we have Android client that request next page and POST to server OFFSET and LIMIT so I don't know how can I migrate to Cassandra and keep backward compatibility Is there any technique for the

Pagination and timeouts

2017-03-27 Thread Tom van den Berge
I have a table with some 1M rows, and I would like to get the partition key of each row. Using the java driver (2.1.9), I'm executing the query select distinct key from table; The result set is paginated automatically. My C* cluster has two datacenters, and when I run this query using consistency

Re: Sorting & pagination in apache cassandra 2.1

2016-01-15 Thread Carlos Alonso
Hi Anuja. Yeah, that's what he means. Before Cassandra 3.0 the modelling advice is to have one table per query. This may sound weird from a relational perspective, but the truth is that writes in Cassandra are very cheap, and its better to write multiple times and have quick and easy reads than wr

Re: Sorting & pagination in apache cassandra 2.1

2016-01-14 Thread anuja jain
@Jonathan what do you mean by "you'll need to maintain your own materialized view tables"? does it mean we have to create new table for each query? On Wed, Jan 13, 2016 at 7:40 PM, Narendra Sharma wrote: > In the example you gave the primary key user _ name is the row key. Since > the default pa

Re: Sorting & pagination in apache cassandra 2.1

2016-01-13 Thread Narendra Sharma
In the example you gave the primary key user _ name is the row key. Since the default partition is random you are getting rows in random order. Since each row no clustering column there is no further grouping of data. Or in simple terms each row has one record and is being returned ordered by colu

Re: Sorting & pagination in apache cassandra 2.1

2016-01-12 Thread Jonathan Haddad
The clustering keys determine the sorting of rows within a partition. The partitions within a file are sorted by their token (usually computed by applying the murmur 3 hash to the partition key). If you are using a version of Cassandra < 3.0, you'll need to maintain your own materialized view tab

Re: Sorting & pagination in apache cassandra 2.1

2016-01-12 Thread anuja jain
I understand the meaning of SSTable but whats the reason behind sorting the table on the basis of int columns first.. Is there any data type preference in cassandra? Also What is the alternative to creating materialised views if my cassandra version is prior to 3.0 (specifically 2.1) and which is a

Re: Sorting & pagination in apache cassandra 2.1

2016-01-12 Thread Robert Coli
On Mon, Jan 11, 2016 at 11:30 PM, anuja jain wrote: > 1 more question, what does it mean by "cassandra inherently sorts data"? > SSTable = Sorted Strings Table. It doesn't contain "Strings" anymore, really, but that's a hint.. :) =Rob

Re: Sorting & pagination in apache cassandra 2.1

2016-01-12 Thread Carlos Alonso
Hi Anuja. Cassandra saves records on disk sorted by the clustering column. In this case you haven't selected any but it looks like is picking birth_year as the clustering column. I don't know which is the clustering column selection algorithm though (maybe alphabetically by name?). Regards Carlo

Re: Sorting & pagination in apache cassandra 2.1

2016-01-11 Thread anuja jain
1 more question, what does it mean by "cassandra inherently sorts data"? For eg: I have a table with schema CREATE TABLE users ( ... user_name varchar PRIMARY KEY, ... password varchar, ... gender varchar, ... session_token varchar,

Re: Sorting & pagination in apache cassandra 2.1

2016-01-11 Thread anuja jain
What is the alternative if my cassandra version is prior to 3.0 (specifically) 2.1) and which is already in production.? Also as per the docs given at https://docs.datastax.com/en/datastax_enterprise/4.6/datastax_enterprise/srch/srchCapazty.html what does it mean by we need to do capacity planni

Re: Sorting & pagination in apache cassandra 2.1

2016-01-07 Thread Tyler Hobbs
On Thu, Jan 7, 2016 at 6:45 AM, anuja jain wrote: > My question is, what is the alternative if we need to order by col3 or > col4 in my above example without including col2 in order by clause. > The server-side alternative is to create a second table (or a materialized view, if you're using 3.0+

Sorting & pagination in apache cassandra 2.1

2016-01-07 Thread anuja jain
HI All, If suppose I have a cassandra table with structure CREATE TABLE test.t1 ( col1 text, col2 text, col3 text, col4 text, PRIMARY KEY (col1, col2, col3, col4) ) WITH CLUSTERING ORDER BY (col2 ASC, col3 ASC, col4 ASC); and it has following data col1 | col2 | col3 | col4 -

Re: Automatic pagination does not get all results

2015-10-23 Thread Sid Tantia
t; Reply-To: "user@cassandra.apache.org" > Date: Thursday, October 22, 2015 at 5:49 PM > To: user > Subject: Automatic pagination does not get all results > > Hello, > > Has anyone had a problem with automatic pagination returning different > results everytime (th

Re: Automatic pagination does not get all results

2015-10-22 Thread Jeff Jirsa
? What CL did you use to write the data? What CL did you use to read the data? Have you run repair since writing the data? From: Sid Tantia Reply-To: "user@cassandra.apache.org" Date: Thursday, October 22, 2015 at 5:49 PM To: user Subject: Automatic pagination does not get all resu

Automatic pagination does not get all results

2015-10-22 Thread Sid Tantia
Hello, Has anyone had a problem with automatic pagination returning different results everytime (this is for a table with ~180,000 rows)? I'm going through each page and inserting the results into an array and each time I go through all the pages, the resultant array has a different size.

Re: Pagination support on Java Driver Query API

2015-02-13 Thread Ajay
app settings so you can see my actual name, sorry. > > On Feb 12, 2015, at 8:55 AM, DataStax > wrote: > > Hello, > > As was mentioned earlier, the Java driver doesn’t actually perform > pagination. > > Instead, it uses cassandra native protocol to set page size o

Re: Pagination support on Java Driver Query API

2015-02-12 Thread Bulat Shakirzyanov
Fixed my Mail.app settings so you can see my actual name, sorry. > On Feb 12, 2015, at 8:55 AM, DataStax wrote: > > Hello, > > As was mentioned earlier, the Java driver doesn’t actually perform pagination. > > Instead, it uses cassandra native protocol to set page size

Re: Pagination support on Java Driver Query API

2015-02-12 Thread DataStax
Hello, As was mentioned earlier, the Java driver doesn’t actually perform pagination. Instead, it uses cassandra native protocol to set page size of the result set. (https://github.com/apache/cassandra/blob/trunk/doc/native_protocol_v2.spec#L699-L730 <https://github.com/apache/cassandra/b

Re: Pagination support on Java Driver Query API

2015-02-12 Thread Eric Stevens
re used to sort the data with in a partition( multi level sorting and > henceforth the restrictions on the ORDER BY clause) which I think can > change likely down the lane in Cassandra 3.x or 4.x in an different way for > some better storage or retrieval. > > Thats said I am hesitant to

Re: Pagination support on Java Driver Query API

2015-02-12 Thread Eric Stevens
l > done. Generally speaking you know you're done when your first clustering > key is the only non-equality operator in the statement, and you got no rows > back. > > > > > > > On Wed, Feb 11, 2015 at 10:55 AM, Ajay wrote: > >> Basically I am trying different q

Re: Pagination support on Java Driver Query API

2015-02-12 Thread Ondřej Nešpor
rally speaking you know you're done when your first > clustering key is the only non-equality operator in the statement, and > you got no rows back. > > > > > > > On Wed, Feb 11, 2015 at 10:55 AM, Ajay <mailto:ajay.ga...@gmail.com>> wrote: > > Basicall

Re: Pagination support on Java Driver Query API

2015-02-12 Thread Ajay
nt to implement this client side logic for pagination for a) 2+ queries might need more than one query to Cassandra. b) tied up implementation to Cassandra internal storage details which can change(though not often). c) in our case, we are building REST Apis which will be deployed Tomcat clusters. Hence wha

Re: Pagination support on Java Driver Query API

2015-02-12 Thread Eric Stevens
roach. > > One such query is like > > Select * from mycf where condition on partition key order by ck1 asc, ck2 > desc where ck1 and ck2 are clustering keys in that order. > > Here how do we achieve pagination support? > > Thanks > Ajay > On Feb 11, 2015 11:16 PM, &qu

Re: Pagination support on Java Driver Query API

2015-02-11 Thread Ajay
Basically I am trying different queries with your approach. One such query is like Select * from mycf where condition on partition key order by ck1 asc, ck2 desc where ck1 and ck2 are clustering keys in that order. Here how do we achieve pagination support? Thanks Ajay On Feb 11, 2015 11:16 PM

Re: Pagination support on Java Driver Query API

2015-02-11 Thread Ajay
ion for all preceding clustering key columns. With this I cannot get the pagination correct. Thanks Ajay > I can't believe that everyone read & process all rows at once (without pagination). Probably not too many people try to read all rows in a table as a single rolling operation

Re: Pagination support on Java Driver Query API

2015-02-11 Thread Eric Stevens
> I can't believe that everyone read & process all rows at once (without pagination). Probably not too many people try to read all rows in a table as a single rolling operation with a standard client driver. But those who do would use token() to keep track of where they are and be ab

Re: Pagination support on Java Driver Query API

2015-02-10 Thread Ajay
Thanks Alex. But is there any workaround possible?. I can't believe that everyone read & process all rows at once (without pagination). Thanks Ajay On Feb 10, 2015 11:46 PM, "Alex Popescu" wrote: > > On Tue, Feb 10, 2015 at 4:59 AM, Ajay wrote: > >>

Re: Pagination support on Java Driver Query API

2015-02-10 Thread Alex Popescu
On Tue, Feb 10, 2015 at 4:59 AM, Ajay wrote: > 1) Java driver implicitly support Pagination in the ResultSet (using > Iterator) which can be controlled through FetchSize. But it is limited in a > way that we cannot skip or go previous. The FetchState is not exposed. Cassandra doesn&

Pagination support on Java Driver Query API

2015-02-10 Thread Ajay
Hi, I am working on exposing the Cassandra Query APIs(Java Driver) as REST APIs for our internal project. To support Pagination, I looked at the Cassandra documentation, Source code and other forums. What I mean by pagination support is like below: 1) Client fires query to REST server 2) Server

Re: Internal pagination in secondary index queries

2014-12-31 Thread Sam Klock
Thanks. I've opened the following issue to track this: https://issues.apache.org/jira/browse/CASSANDRA-8550 SK On 2014-12-30 11:26, Tyler Hobbs wrote: > > On Mon, Dec 29, 2014 at 5:20 PM, Sam Klock > wrote: > > > Our investigation led us to logic in Cassandra u

Re: Internal pagination in secondary index queries

2014-12-30 Thread Tyler Hobbs
On Mon, Dec 29, 2014 at 5:20 PM, Sam Klock wrote: > > > Our investigation led us to logic in Cassandra used to paginate scans > of rows in indexes on composites. The issue seems to be the short > algorithm Cassandra uses to select the size of the pages for the scan, > partially given on the follo

Re: Internal pagination in secondary index queries

2014-12-29 Thread Jonathan Haddad
Secondary indexes are there for convenience, not performance. If you're looking for something performant, you'll need to maintain your own indexes. On Mon Dec 29 2014 at 3:22:58 PM Sam Klock wrote: > Hi folks, > > Perhaps this is a question better addressed to the Cassandra developers > direct

Internal pagination in secondary index queries

2014-12-29 Thread Sam Klock
Hi folks, Perhaps this is a question better addressed to the Cassandra developers directly, but I thought I'd ask it here first. We've recently been benchmarking certain uses of secondary indexes in Cassandra 2.1.x, and we've noticed that when the number of items in an index reaches beyond so

Re: Cassandra (2.0.4) pagination and total records?

2014-03-18 Thread DuyHai Doan
With Cassandra 2.0.x and Java driver 2.0.0 you can set the fetch size on the query and then use Resulset.iterator(). It will iterate over your data set by loading batches of size = fetch size Le 18 mars 2014 01:39, "Philip G" a écrit : > Thanks for the links. > > As I'm messing around with CQL, I

Re: Cassandra (2.0.4) pagination and total records?

2014-03-17 Thread Philip G
Thanks for the links. As I'm messing around with CQL, I'm realizing Cassandra isn't going to do what I need. Quite simply, here's a basic layout of my table: myTable ( visit_dt timestamp, cid ascii, company text, // ... other stuff primary key (visit_dt, cid) ); index on (company) My quer

Re: Cassandra (2.0.4) pagination and total records?

2014-03-17 Thread Tupshin Harper
Read the automatic paging portion of this post : http://www.datastax.com/dev/blog/client-side-improvements-in-cassandra-2-0 On Mar 17, 2014 8:09 PM, "Philip G" wrote: > On Mon, Mar 17, 2014 at 4:54 PM, Robert Coli wrote: > >> The form of your question suggests you are Doing It Wrong, FWIW. >> >

Re: Cassandra (2.0.4) pagination and total records?

2014-03-17 Thread Iain Finlayson
Hi Philip, Read this blog post http://www.wentnet.com/blog/?p=24 It talks about COUNT but might give some answers to your first question. On Monday, March 17, 2014, Philip G wrote: > On Mon, Mar 17, 2014 at 4:54 PM, Robert Coli > > > wrote: > >> The form of your question suggests you are Do

Re: Cassandra (2.0.4) pagination and total records?

2014-03-17 Thread Philip G
On Mon, Mar 17, 2014 at 4:54 PM, Robert Coli wrote: > The form of your question suggests you are Doing It Wrong, FWIW. > Okay, let me ask different question: how do you go about data browsing in a CQL3 table? Especially in situations were a single query could return a couple thousand records, a

Re: Cassandra (2.0.4) pagination and total records?

2014-03-17 Thread Robert Coli
On Mon, Mar 17, 2014 at 4:27 PM, Philip G wrote: > Is there a way to get "total number of records" when working with limit > and internal pagination? Every example I found online was purely about > using LIMIT and sort_col > token(sort_col). Nothing about getting the to

Cassandra (2.0.4) pagination and total records?

2014-03-17 Thread Philip G
Is there a way to get "total number of records" when working with limit and internal pagination? Every example I found online was purely about using LIMIT and sort_col > token(sort_col). Nothing about getting the total matching records. (PS: if there's a better group to ask CQL

Re: Astyanax - multiple key search with pagination

2013-12-30 Thread Aaron Morton
gt; I’m using Astyanax and trying to do search for multiple keys with pagination. > I tried “.getKeySlice” with a list a of primary keys, but it doesn’t allow > pagination. Does anyone know how to tackle this issue with Astyanax? > > Parag

Re: Cassandra pytho pagination

2013-12-23 Thread Aaron Morton
> Is there something wrong with it? Here 1234555665_53323232 and > 2344555665_53323232 are super columns. Also, If I have to represent this data > with new composite comparator, How will I accomplish that? > > Composite types via pycassa http://pycassa.github.io/pycassa/assorted/composite_typ

Re: Cassandra pytho pagination

2013-12-23 Thread Aaron Morton
> > Cheers > > - > Aaron Morton > New Zealand > @aaronmorton > > Co-Founder & Principal Consultant > Apache Cassandra Consulting > http://www.thelastpickle.com > > On 13/12/2013, at 4:56 am, Kumar Ranjan wrote: > >> Hey

Astyanax - multiple key search with pagination

2013-12-20 Thread Parag Patel
Hi, I'm using Astyanax and trying to do search for multiple keys with pagination. I tried ".getKeySlice" with a list a of primary keys, but it doesn't allow pagination. Does anyone know how to tackle this issue with Astyanax? Parag

Re: Cassandra pytho pagination

2013-12-19 Thread Kumar Ranjan
Rob - I got a question following your advice. This is how, I define my column family validators = { 'approved':'UTF8Type', 'tid': 'UTF8Type', 'iid': 'UTF8Type', 'score': 'IntegerType', 'likes': 'Intege

Re: Cassandra pytho pagination

2013-12-18 Thread Robert Coli
On Wed, Dec 18, 2013 at 1:28 PM, Kumar Ranjan wrote: > Second approach ( I used in production ): > - fetch all super columns for a row key > Stock response mentioning that super columns are anti-advised for use, especially in brand new code. =Rob

Re: Cassandra pytho pagination

2013-12-18 Thread Kumar Ranjan
> On 13/12/2013, at 4:56 am, Kumar Ranjan wrote: > > Hey Folks, > > I need some ideas about support implementing of pagination on the browser, > from the backend. So python code (backend) gets request from frontend with > page=1,2,3,4 and so on and count_per_page=50. > >

Re: Cassandra pytho pagination

2013-12-17 Thread Aaron Morton
> Hey Folks, > > I need some ideas about support implementing of pagination on the browser, > from the backend. So python code (backend) gets request from frontend with > page=1,2,3,4 and so on and count_per_page=50. > > I am trying to use xget with column_count and buff

Cassandra pytho pagination

2013-12-12 Thread Kumar Ranjan
Hey Folks, I need some ideas about support implementing of pagination on the browser, from the backend. So python code (backend) gets request from frontend with page=1,2,3,4 and so on and count_per_page=50. I am trying to use xget with column_count and buffer_size parameters. Can someone explain

Re: pagination in cql3

2013-05-24 Thread Sylvain Lebresne
The short answer is yes, you can rely on the ordering of keys being consistent. They will always be returned in partitioner order. This is pretty much implied by the existence of the token() function so it's not going to change (if only because changing it would break people). -- Sylvain On Fri,

pagination in cql3

2013-05-24 Thread Ondřej Černoš
Hi all, I need to support a legacy API where page offset and limit are on the input of the API call (it used to be mapped directly to offset and limit MySQL select options). The data are pretty small (like really small, some hundreds of thousands narrow rows maximum - I use Cassandra for its multi

Re: Pagination over row Keys in Cassandra using Kundera/CQL queries

2013-01-14 Thread aaron morton
-- > Aaron Morton > Freelance Cassandra Developer > New Zealand > > @aaronmorton > http://www.thelastpickle.com > > On 10/01/2013, at 11:55 AM, Snehal Nagmote wrote: > >> Hello All, >> >> I am using Kundera 2.0.7 and Cassandra 1.0.8. I need

Re: Pagination over row Keys in Cassandra using Kundera/CQL queries

2013-01-10 Thread Snehal Nagmote
> > Hello All, > > I am using Kundera 2.0.7 and Cassandra 1.0.8. I need to implement > batching/ pagination over row keys. > > for instance, Scan columnfamily , get 100 records in batch everytime , > till all keys are exhausted. > > I am using random partitioner for keyspac

Re: Pagination over row Keys in Cassandra using Kundera/CQL queries

2013-01-09 Thread aaron morton
All, > > I am using Kundera 2.0.7 and Cassandra 1.0.8. I need to implement batching/ > pagination over row keys. > > for instance, Scan columnfamily , get 100 records in batch everytime , till > all keys are exhausted. > > I am using random partitioner for keyspace. I ex

Pagination over row Keys in Cassandra using Kundera/CQL queries

2013-01-09 Thread Snehal Nagmote
Hello All, I am using Kundera 2.0.7 and Cassandra 1.0.8. I need to implement batching/ pagination over row keys. for instance, Scan columnfamily , get 100 records in batch everytime , till all keys are exhausted. I am using random partitioner for keyspace. I explored limit option in cql and

RE: Pagination

2012-11-27 Thread Sam Hodgson
causing problems. Cheers Sam Date: Tue, 27 Nov 2012 13:01:48 -0700 Subject: Re: Pagination From: de...@fyrie.net To: user@cassandra.apache.org Do you really require page numbers? I usually find them annoying while paging through a forum, especially if it is quite active. Threads from the bottom of

Re: Pagination

2012-11-27 Thread Derek Williams
, and the next page being the next N results after the last updated time of the last thread on the page. It is also much easier to model with Cassandra. On Tue, Nov 27, 2012 at 12:19 PM, Sam Hodgson wrote: > Hi All, > > Wondering if anyone has any good solutions to pagination? In p

Re: Offset in slicequeries for pagination

2012-06-11 Thread Rajat Mathur
Hi Cyril, This may help. http://architecturalatrocities.com/post/13918146722/implementing-column-pagination-in-cassandra On Tue, Jun 12, 2012 at 3:18 AM, Cyril Auburtin wrote: > If my columns are ("k1:k2" => data1), ("k11:k32" => data211), ("k10:k211"

Re: Offset in slicequeries for pagination

2012-06-11 Thread Cyril Auburtin
If my columns are ("k1:k2" => data1), ("k11:k32" => data211), ("k10:k211" => data91) U mean transforming to ("1:k1:k2" => data1), ("2:k11:k32" => data211) but I need the previous columns names to slice query on them 2012/6/11 R. Verlangen > I solved this with creating a manual index with as co

Re: Offset in slicequeries for pagination

2012-06-11 Thread R. Verlangen
I solved this with creating a manual index with as column keys integers and column values the uuid's of the results. Then run a slicequery to determine the batch to fetch. 2012/6/11 Cyril Auburtin > using 10 results maximum per page, > > to go directly to 14th page, there is no offset=141 possi

Re: Maintain sort order on updatable property and pagination

2012-04-29 Thread aaron morton
nge the value. Note that it has to do the same thing you do: read and delete the old value. > Also for pagination, we have to set range for columnNames. If we know the > last page's last columnName we can get the next page. What if we want to go > from page 2 to page 6, this seems

Maintain sort order on updatable property and pagination

2012-04-26 Thread Rajat Mathur
this in real time. Also for pagination, we have to set range for columnNames. If we know the last page's last columnName we can get the next page. What if we want to go from page 2 to page 6, this seems impossible as of now. Any suggestion? Thank you. **

RE: Previous Page Pagination?

2011-10-29 Thread Alex Major
Hey, You can switch the reversed flag on (or off) and use the first key returned as the start key for the previous page. Alex -- From: Sam Hodgson Sent: 29/10/2011 16:15 To: user@cassandra.apache.org Subject: Previous Page Pagination? Hi, Is there a good method to

Previous Page Pagination?

2011-10-29 Thread Sam Hodgson
Hi, Is there a good method to use for pagination in Cassandra? I can create a next page link by pulling an extra column when getting however previous page is proving tricky. Im using integer timestamps as column keys so would really need a way to pull out the 10 preceeding columns as well as

RE: How do you implement pagination?

2010-12-10 Thread Dan Hendry
ave reached the end of all records. This may or may not be acceptable for your application. Dan From: joshua.j...@gmail.com [mailto:joshua.j...@gmail.com] On Behalf Of Joshua Partogi Sent: December-10-10 21:05 To: user@cassandra.apache.org Subject: Re: How do you implement pagination

Re: How do you implement pagination?

2010-12-10 Thread Joshua Partogi
i, Dec 10, 2010 at 7:01 PM, Joshua Partogi wrote: > >> Hi all, >> >> I am interested to see people's way to do record pagination with cassandra >> because I can not find anything like MySQL LIMIT in cassandra. >> >> From what I understand you need to tell ca

Re: How do you implement pagination?

2010-12-10 Thread Tyler Hobbs
Yes, what you described is the correct way to do it. Your next slice will start with that 11th column. - Tyler On Fri, Dec 10, 2010 at 7:01 PM, Joshua Partogi wrote: > Hi all, > > I am interested to see people's way to do record pagination with cassandra > because I can not f

How do you implement pagination?

2010-12-10 Thread Joshua Partogi
Hi all, I am interested to see people's way to do record pagination with cassandra because I can not find anything like MySQL LIMIT in cassandra. >From what I understand you need to tell cassandra the Record ID for the beginning of the slice and the number of record you want to get af

Re: Pagination

2010-12-06 Thread Jonathan Ellis
o it with a SQL db either. On Mon, Dec 6, 2010 at 3:35 PM, Mark wrote: > How is pagination accomplished when you dont know a start key? For example, > how can I "jump" to page 10? > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, the source for professional Cassandra support http://riptano.com

Pagination

2010-12-06 Thread Mark
How is pagination accomplished when you dont know a start key? For example, how can I "jump" to page 10?

Re: SEO friendly pagination

2010-08-25 Thread Ryan King
On Wed, Aug 25, 2010 at 11:20 AM, Petr Odut wrote: > Hi, > I've read about pagination in cassandra. My current implementation is > get_range_slices with startKey = lastKey + 1, but I need to get the > specified page directly. Is it any chance to do this? > > If you look at

SEO friendly pagination

2010-08-25 Thread Petr Odut
Hi, I've read about pagination in cassandra. My current implementation is get_range_slices with startKey = lastKey + 1, but I need to get the specified page directly. Is it any chance to do this? If you look at twitter, it has direct pagination too: http://twitter.com/PetrOdut?page=1

Re: pagination through slices with deleted keys

2010-05-07 Thread Mike Malone
On Fri, May 7, 2010 at 5:29 AM, Joost Ouwerkerk wrote: > +1. There is some disagreement on whether or not the API should > return empty columns or skip rows when no data is found. In all of > our use cases, we would prefer skipped rows. And based on how > frequently new cassandra users appear t

Re: pagination through slices with deleted keys

2010-05-07 Thread Mark Greene
I like your idea about specifying it at the SP level. On Fri, May 7, 2010 at 8:29 AM, Joost Ouwerkerk wrote: > +1. There is some disagreement on whether or not the API should > return empty columns or skip rows when no data is found. In all of > our use cases, we would prefer skipped rows. And

Re: pagination through slices with deleted keys

2010-05-07 Thread Joost Ouwerkerk
+1. There is some disagreement on whether or not the API should return empty columns or skip rows when no data is found. In all of our use cases, we would prefer skipped rows. And based on how frequently new cassandra users appear to be confused about the current behaviour, this might be a more

Re: pagination through slices with deleted keys

2010-05-06 Thread Mike Malone
On Thu, May 6, 2010 at 3:27 PM, Ian Kallen wrote: > Cool, is this a patch you've applied on the server side? Are you running > 0.6.x? I'm wondering if this kind of thing can make it into future versions > of Cassandra. > Yea, server side. It's basically doing the same thing clients typically wan

Re: pagination through slices with deleted keys

2010-05-06 Thread Ian Kallen
he range_ghosts FAQ entry on the wiki >> which do a good job describing how difficult deletion is in an eventually >> consistent system. But practical application strategies for dealing with it >> aren't there (that I saw). I'm wondering how folks implement pagination in &g

Re: pagination through slices with deleted keys

2010-05-06 Thread Mike Malone
ange_ghosts FAQ entry on the wiki > which do a good job describing how difficult deletion is in an eventually > consistent system. But practical application strategies for dealing with it > aren't there (that I saw). I'm wondering how folks implement pagination in > th

Re: pagination through slices with deleted keys

2010-05-06 Thread Ian Kallen
letes and the range_ghosts FAQ entry on the wiki >> which do a good job describing how difficult deletion is in an eventually >> consistent system. But practical application strategies for dealing with it >> aren't there (that I saw). I'm wondering how folks implement pagination

Re: pagination through slices with deleted keys

2010-05-06 Thread Mark Greene
the DistributedDeletes and the range_ghosts FAQ entry on the wiki > which do a good job describing how difficult deletion is in an eventually > consistent system. But practical application strategies for dealing with it > aren't there (that I saw). I'm wondering how folks implement pagination in &g

pagination through slices with deleted keys

2010-05-06 Thread Ian Kallen
I read the DistributedDeletes and the range_ghosts FAQ entry on the wiki which do a good job describing how difficult deletion is in an eventually consistent system. But practical application strategies for dealing with it aren't there (that I saw). I'm wondering how folks implement pag

  1   2   >