Re: [orientdb] Re: I'm wondering if OrientDB can handle my database

Sorry for the typo. Should be 204 TB On Friday, 11 September 2015 14:03:18 UTC+1, James Wang wrote: > > actually, i missed - it is 200 billion records, so > > 200 * 255 * 4 ~= 204000 billion bytes, i.e. 204 PB > > if there is no compression :D > > On Friday, 11 September 2015 12:56:13 UTC+1, Mi

Re: [orientdb] Re: I'm wondering if OrientDB can handle my database

That is a fair sized MySQL database. And sorry to get off topic, but, you must have a pretty big server for it to work well, or the requests made to it aren't all too extensive or intensive. Scott -- --- You received this message because you are subscribed to the Google Groups "OrientDB" g

Re: [orientdb] Re: I'm wondering if OrientDB can handle my database

Good to know. My real scenery: 1 billion records Percona InnoDB table file size (ibd file): 300 GB table fields: about 16 (mixed string and integer et al) index: about 10 fields Hope this would give you an idea about MySQL On Friday, 11 September 2015 16:53:01 UTC+1, scott molinari

Re: [orientdb] Re: I'm wondering if OrientDB can handle my database

MongoDB definitely has compression (now) and I think OrientDB has compression too. In the 2.0 release announcement it says the binary protocol compresses the data, but then it says the snappy compression is turned off by default. So, not sure what all that means. Scott -- --- You received t

Re: [orientdb] Re: I'm wondering if OrientDB can handle my database

actually, i missed - it is 200 billion records, so 200 * 255 * 4 ~= 204000 billion bytes, i.e. 204 PB if there is no compression :D On Friday, 11 September 2015 12:56:13 UTC+1, Milen Dyankov wrote: > > rofl > > you wish it was that simple, don't you ;) > > On Fri, Sep 11, 2015 at 1:53 PM, James

Re: [orientdb] Re: I'm wondering if OrientDB can handle my database

rofl you wish it was that simple, don't you ;) On Fri, Sep 11, 2015 at 1:53 PM, James Wang wrote: > about: > 2 * 255 * 4 ~= 2040 Billion Bytes > > :D > > On Friday, 11 September 2015 12:30:17 UTC+1, Milen Dyankov wrote: >> >> well yea ;) what I meant was for the example given in the original >>

Re: [orientdb] Re: I'm wondering if OrientDB can handle my database

about: 2 * 255 * 4 ~= 2040 Billion Bytes :D On Friday, 11 September 2015 12:30:17 UTC+1, Milen Dyankov wrote: > > well yea ;) what I meant was for the example given in the original request: > > ... records, each having 2 fields: A, and B, both strings of no more than >> 255 characters ... > > >

Re: [orientdb] Re: I'm wondering if OrientDB can handle my database

well yea ;) what I meant was for the example given in the original request: ... records, each having 2 fields: A, and B, both strings of no more than > 255 characters ... On Fri, Sep 11, 2015 at 1:23 PM, James Wang wrote: > That would depend on your db/table structures, I think > > On Friday,

Re: [orientdb] Re: I'm wondering if OrientDB can handle my database

That would depend on your db/table structures, I think On Friday, 11 September 2015 12:18:25 UTC+1, Milen Dyankov wrote: > > Just out of curiosity, can someone estimate how much of disk space would > be needed to store this amount of data in MongoDB vs OrientDB? > > > On Fri, Sep 11, 2015 at 1:09

Re: [orientdb] Re: I'm wondering if OrientDB can handle my database

Just out of curiosity, can someone estimate how much of disk space would be needed to store this amount of data in MongoDB vs OrientDB? On Fri, Sep 11, 2015 at 1:09 PM, scott molinari < scottamolin...@googlemail.com> wrote: > If you are only storing documents and don't really need the graph > fu

[orientdb] Re: I'm wondering if OrientDB can handle my database

If you are only storing documents and don't really need the graph functionality OrientDB offers (and what makes it so special), then you might want to go with MongoDB. Scott -- --- You received this message because you are subscribed to the Google Groups "OrientDB" group. To unsubscribe fro

Re: [orientdb] Re: I'm wondering if OrientDB can handle my database

Sir, It was more than 3 months ago. I vaguely remember that I did the testing in remote mode (so I can do select queries at the same time - not sure if I could do importing data and select at the same time in plocal mode). And the ETL run on the same machine as the server. My table structur

Re: [orientdb] Re: I'm wondering if OrientDB can handle my database

Hi James, With such numbers, does the ETL connect in remote or does it use the "plocal" embedded connection? Best Regards, Luca Garulli Founder & CEO OrientDB On 10 September 2015 at 11:51, James Wang wrote: > I managed to import 25000 records per second using a stand a

[orientdb] Re: I'm wondering if OrientDB can handle my database

I managed to import 25000 records per second using a stand alone OrientDB server and OrientDB ETL. My total records were 20m - far far less than your 200 billions Not sure if any database can achieve that speed - may be able on a RAM disk (but a RAM disk can not hold that much data though). On