yura last wrote:
> I expect that the amount of concurrent customers will be low.
> Today I have 1 machine so I don't have the capacity for all
> the data.
You aim for 90 billion documents in the first go and want to prepare for 10
times that. Your current test setup is 60M documents, which means
I expect that the amount of concurrent customers will be low.Today I have 1
machine so I don't have the capacity for all the data. Because of that I am
thinking on a new "cluster" solution.Today is 1 billion each day for 90 days =
90 billion (around 45TB data).
I should prefer a lot of machines
yura last wrote:
> I have one machine (6 cores, 148 GB RAM, 2.5 TB HDD) and I index
> around 60 million documents for a day - the index size is around 26GB.
So 1 billion documents would be approximately 500GB.
...and 10 billion/day in 90 days would be 450TB.
> I do have customer-ID today and I
Thanks for your answersCurrently I have one machine (6 cores, 148 GB RAM, 2.5
TB HDD) and I index around 60 million documents for a day - the index size is
around 26GB.I do have customer-ID today and I use it for the queries. I don't
split the customers but I get bad performance.
If I will make
yura last wrote:
> Hi All, I am testing a SolrCloud with many collections. The version is 5.2.1
> and I installed 3 machines – each one with 4 cores and 8 GB Ram.Then I
> created collections with 3 shards and replication factor of 2. It gives me 2
> cores per collection on each machine.I reached a
1. Keep the number of collections down to the low hundreds max. Preferably
no more than a few dozen or a hundred.
2. 8GB is too small to be useful. 16 GB min.
3. If you need large numbers of machines, organize them as separate
clusters.
4. Figure 100 to 200 million documents on a Solr server. E.g.,
Hi All, I am testing a SolrCloud with many collections. The version is 5.2.1
and I installed 3 machines – each one with 4 cores and 8 GB Ram.Then I created
collections with 3 shards and replication factor of 2. It gives me 2 cores per
collection on each machine.I reached almost 900 collections a
