Thanks for your response. I have already gone through those documents before. My point was that if I am using Solr Cloud the only way to distribute my indexes is by adding shards? and I don't have to do anything manually (because all the distributed search is handled by Solr Cloud).
What is the Xms and Xmx you are allocating to Solr and how much max is used by your solr? Xms and Xmx are both 4G. My current JVM-Memory consumption is 1.58 GB How many segments are there in the index? The more the segment the slower is the search. How do I check how many segments are there in the index? Is this after you moved to solrcloud? I have been using SolrCloud from the beginning. Regards, Salman On Thu, Nov 5, 2015 at 1:21 PM, Modassar Ather <modather1...@gmail.com> wrote: > SolrCloud makes the distributed search easier. You can find details about > it under following link. > https://cwiki.apache.org/confluence/display/solr/How+SolrCloud+Works > > You can also refer to following link: > > https://cwiki.apache.org/confluence/display/solr/Shards+and+Indexing+Data+in+SolrCloud > > From size of your index I meant index size and not the total document > alone. > How many segments are there in the index? The more the segment the slower > is the search. > What is the Xms and Xmx you are allocating to Solr and how much max is used > by your solr? > > I doubt this as the slowness was happening for a long period of time. > I mentioned this point as I have seen gc pauses of 30 seconds and more in > some complex queries. > > I am facing delay of 2-3 seconds but previously I > had delays of around 28 seconds. > Is this after you moved to solrcloud? > > Regards, > Modassar > > > On Thu, Nov 5, 2015 at 3:09 PM, Salman Ansari <salman.rah...@gmail.com> > wrote: > > > Here is the current info > > > > How much memory is used? > > Physical memory consumption: 5.48 GB out of 14 GB. > > Swap space consumption: 5.83 GB out of 15.94 GB. > > JVM-Memory consumption: 1.58 GB out of 3.83 GB. > > > > What is your index size? > > I have around 70M documents distributed on 2 shards (so each shard has > 35M > > document) > > > > What type of queries are slow? > > I am running normal queries (queries on a field) no faceting or > highlights > > are requested. Currently, I am facing delay of 2-3 seconds but > previously I > > had delays of around 28 seconds. > > > > Are there GC pauses as they can be a cause of slowness? > > I doubt this as the slowness was happening for a long period of time. > > > > Are document updates/additions happening in parallel? > > No, I have stopped adding/updating documents and doing queries only. > > > > This is what you are already doing. Did you mean that you want to add > more > > shards? > > No, what I meant is that I read that previously there was a way to chunk > a > > large index into multiple and then do distributed search on that as in > this > > article https://wiki.apache.org/solr/DistributedSearch. What I was > looking > > for how this is handled in Solr Cloud? > > > > > > Regards, > > Salman > > > > > > > > > > > > On Thu, Nov 5, 2015 at 12:06 PM, Modassar Ather <modather1...@gmail.com> > > wrote: > > > > > What is your index size? How much memory is used? What type of queries > > are > > > slow? > > > Are there GC pauses as they can be a cause of slowness? > > > Are document updates/additions happening in parallel? > > > > > > The queries are very slow to run so I was thinking to distribute > > > the indexes into multiple indexes and consequently distributed search. > > Can > > > anyone guide me to some sources (articles) that discuss this in Solr > > Cloud? > > > > > > This is what you are already doing. Did you mean that you want to add > > more > > > shards? > > > > > > Regards, > > > Modassar > > > > > > On Thu, Nov 5, 2015 at 1:51 PM, Salman Ansari <salman.rah...@gmail.com > > > > > wrote: > > > > > > > Hi, > > > > > > > > I am using Solr cloud and I have created a single index that host > > around > > > > 70M documents distributed into 2 shards (each having 35M documents) > > and 2 > > > > replicas. The queries are very slow to run so I was thinking to > > > distribute > > > > the indexes into multiple indexes and consequently distributed > search. > > > Can > > > > anyone guide me to some sources (articles) that discuss this in Solr > > > Cloud? > > > > > > > > Appreciate your feedback regarding this. > > > > > > > > Regards, > > > > Salman > > > > > > > > > >
