John,
copy is not recommended for than 2 millions rows, so copy is ruled out in your
case for those 30 tables you mentioned.
Sincerely,
Aakash Pandhi
On Wednesday, February 19, 2020, 02:26:15 PM CST, Amanda Moran
<amanda.kay.mo...@gmail.com> wrote:
HI there-
DataStax recently released their bulkloader into the OSS community.
I would take a look and at least try it out:
https://docs.datastax.com/en/dsbulk/doc/dsbulk/dsbulkAbout.html
Good luck!
Amanda
On Wed, Feb 19, 2020 at 12:10 PM JOHN, BIBIN <bj9...@att.com> wrote:
Thanks for the response. We need to export into a flat file and send to another
analytical application. There are 137 tables and 30 of them are have 300M+
records. So “COPY TO” taking lot of time.
Thank you
Bibin John
From: Aakash Pandhi <pandhiaak...@yahoo.com.INVALID>
Sent: Wednesday, February 19, 2020 12:51 PM
To: user@cassandra.apache.org
Subject: Re: Mechanism to Bulk Export from Cassandra on daily Basis
John,
Greetings,
Requirement is to just export data from table and stage it somewhere? OR export
it and load them in another cluster/table?
sstableloader is a utility which can help you as it is designed for bulk
loading.
Sincerely,
Aakash Pandhi
On Wednesday, February 19, 2020, 10:13:32 AM PST, JOHN, BIBIN <bj9...@att.com>
wrote:
Team,
We have a requirement to bulk export data from Cassandra on daily basis? Table
contain close to 600M records and cluster is having 12 nodes. What is the best
approach to do this?
Thanks
Bibin John
