Re: SOLR indexing takes longer time

2020-08-17 Thread Abhijit Pawar
... On Mon, Aug 17, 2020 at 1:32 PM Divye Handa wrote: > Can you share the dih configuration you are using for same? > > On Mon, 17 Aug, 2020, 23:52 Abhijit Pawar, wrote: > > > Hello, > > > > We are indexing some 200K plus documents in SOLR 5.4.1 with no shards / >

SOLR indexing takes longer time

2020-08-17 Thread Abhijit Pawar
Hello, We are indexing some 200K plus documents in SOLR 5.4.1 with no shards / replicas and just single core. It takes almost 3.5 hours to index that data. I am using a data import handler to import data from the mongo database. Is there something we can do to reduce the time taken to index?

Re: Slow query response from SOLR 5.4.1

2020-08-17 Thread Abhijit Pawar
ding > _some_ of these things or other related details might help you get the > answer you're looking for. > > Alternately, if you've figured out the issue already post the answer > on this thread - help anyone with a similar issue in the future. > Jason > > On Tue, Aug

Slow query response from SOLR 5.4.1

2020-08-04 Thread Abhijit Pawar
Hello, I am seeing a performance issue in querying in one of the SOLR servers - instance version 5.4.1. Total number of documents indexed are 20K plus. Data returned for this particular query is just as less as 22 documents however it takes almost 2 minutes to get the results back. Is there a

Apache Struts recon attempt from UNKNOWN IP Attack

2019-12-23 Thread Abhijit Pawar
Hello All, Recently we started seeing this email on one of our SOLR server: *Apache Struts recon attempt from UNKNOWN IP Attack* In detail it explains as below: "This attack is possible due to a vulnerability in Struts 2 caused by improper sanitization during OGNL expression evaluation. It is

Re: ParseException : Unable to index date in ISODate("2019-03-12T21:53:16.841Z") format in SOLR 5.4.1

2019-05-11 Thread Abhijit Pawar
ow to get it to > spit out the date in the correct format, but that’s where you need to look. > > > > Best, > > Erick > > > >> On May 10, 2019, at 2:13 PM, Abhijit Pawar > wrote: > >> > >> Hello, > >> > >> I am trying to index date in

ParseException : Unable to index date in ISODate("2019-03-12T21:53:16.841Z") format in SOLR 5.4.1

2019-05-10 Thread Abhijit Pawar
Hello, I am trying to index date in ISODate format like this saved in mongoDB collection using DataImortHandler in SOLR 5.4.1: { . . "endDate" : ISODate("2019-03-12T21:53:16.841Z") } It throws below error: *java.text.ParseException: Unparseable date: "Tue Mar 12 21:53:16 UTC 2019"* Below is

Re: Which fieldType to use for JSON Array in Solr 6.5.0?

2019-04-09 Thread Abhijit Pawar
"Apple", "city": "Cupertino", "zip": 95014} ]}' On Tue, Apr 9, 2019 at 3:28 PM Shawn Heisey wrote: > On 4/9/2019 2:04 PM, Abhijit Pawar wrote: > > Hello Guys, > > > > I am trying to index a JSON array in one of my collectio

Which fieldType to use for JSON Array in Solr 6.5.0?

2019-04-09 Thread Abhijit Pawar
Hello Guys, I am trying to index a JSON array in one of my collections in mongoDB in Solr 6.5.0 however it is not getting indexed. I am using a DataImportHandler for this. *Here's how the data looks in mongoDB:* { "idStr" : "5ca38e407b154dac08913a96", "sampleAttr" : "sampleAttrVal", *

Re: Still not seeing Solr listening on 8983 after 30 seconds!

2018-08-23 Thread Abhijit Pawar
:25857 Heap Memory Usage: -1 Deleted Docs:20 Version:42497 Segment Count:8 solr-config.xml: ${solr.ulog.dir:} ${solr.ulog.numVersionBuckets:65536} Thanks! Regards, Abhijit On Thu, Aug 23, 2018 at 3:30 PM Shawn Heisey wrote: > On 8/23/2018 2:02 PM, Abhijit Pawar wr

Still not seeing Solr listening on 8983 after 30 seconds!

2018-08-23 Thread Abhijit Pawar
Hello All, Recently with no change in the configuration or code we are facing a slowdown of approx 3 minutes while restarting the SOLR instance.Earlier it used to come up in few seconds however now it takes so long. *Error Message Displayed:* Waiting up to 30 seconds to see Solr running on port

Re: How to merge child documents using DataImportHandler

2018-05-27 Thread Abhijit Pawar
, Abhijit. > Have you tried to drop some of child=true? They usually cause slicing to > separate documents, rather than default "merge to root" mode. > > On Sun, May 27, 2018 at 9:48 PM, Abhijit Pawar <abhijit.ibizs...@gmail.com > > > wrote: > > > ​​ > >

How to merge child documents using DataImportHandler

2018-05-27 Thread Abhijit Pawar
​​ Hello, I am using DataImportHandler to index data from mongoDB. Here's how my data-source-config file looks like: entityA(Root Entity) - *products* entityB (child=true,pk=unique field) - *skus* entityC - *attributevalues* entityD - *attributenames*

TemplateTransformer is not working for few new fields

2017-11-28 Thread Abhijit Pawar
Hello All, I have added two new fields to a entity in data-source-config.xml file. On running full-import it gets indexed fine and I can see the values for those two fields just like other fields. However on adding a nested entity under that entity and using a TemplateTransformer on nested

Re: How to boost entire json document on top of results

2017-08-11 Thread Abhijit Pawar
with a value of > 10, then this is just a simple sort > > sort=boost desc,score desc > > If you want to do something fancier, see Function Queries in the ref > guide. Or use edismax query parsing and add a boost query > > Best, > Erick > > > > On Fri, Aug 11, 20

How to boost entire json document on top of results

2017-08-11 Thread Abhijit Pawar
Hi, I am working on a scenario trying to boost certain documents while indexing over other documents. I am using a DataImportHandler to import JSON documents from a MongoDB datasource. Here's my data-source-config file :

Re: SynonymFilterFactory needs bounce for every change

2017-08-08 Thread Abhijit Pawar
cuments indexed > > Not that I know of > > Best, > Erick > > On Mon, Aug 7, 2017 at 3:57 PM, Abhijit Pawar > <abhijit.ibizs...@gmail.com> wrote: > > Hi, > > > > I am using SynonymFilterFactory in my custom fieldType and I observed > SOLR >

SynonymFilterFactory needs bounce for every change

2017-08-07 Thread Abhijit Pawar
Hi, I am using SynonymFilterFactory in my custom fieldType and I observed SOLR picks up new synonyms from the synonyms.txt file only when I bounce the server. Is there something we can do to get the synonyms picked up without bouncing server? Also can we have synonyms defined for certain

Re: Fieldtype json supported in SOLR 5.4.0 or 5.4.1

2017-04-02 Thread Abhijit Pawar
​ : However it just shows and empty array when data is indexed.Any idea how to define field of type JSON ?​ ​ Best Regards, <http://www.ibizsoftinc.com/> <http://www.ibizsoftinc.com/> Abhijit Pawar Office : +1 (469) 287 2005 x 110 Follow us on: On Sat, Apr 1, 2017 at 10:1

Re: Fieldtype json supported in SOLR 5.4.0 or 5.4.1

2017-03-31 Thread Abhijit Pawar
ds based on what it receives. Otherwise you > will need to carefully design a schema.xml. > Cheers -- Rick > > On March 28, 2017 6:08:40 PM EDT, Abhijit Pawar < > abhijit.ibizs...@gmail.com> wrote: > >Hello All, > > > >I am working on a requirement to index

Re: Fieldtype json supported in SOLR 5.4.0 or 5.4.1

2017-03-29 Thread Abhijit Pawar
? Best Regards, <http://www.ibizsoftinc.com/> <http://www.ibizsoftinc.com/> Abhijit Pawar Office : +1 (469) 287 2005 x 110 Follow us on: On Tue, Mar 28, 2017 at 6:20 PM, Rick Leir <rl...@leirtech.com> wrote: > Abhijit > In Mongo you probably have one JSON record pe

Fieldtype json supported in SOLR 5.4.0 or 5.4.1

2017-03-28 Thread Abhijit Pawar
Hello All, I am working on a requirement to index field of type JSON (in mongoDB collection) in SOLR 5.4.0. I am using mongo-jdbc-dih which I found on GitHub : https://github.com/hrishik/solr-mongodb-dih However I could not find a fieldtype on Apache SOLR wiki page which would support JSON

ObjectId datatype handling in SOLR 5.4.0

2017-03-21 Thread Abhijit Pawar
Hello, I am trying to index fields with ObjectId datatype from my mongoDB into SOLR 5.4.0 using DIH(DataImportHandler) however it does not allow me to index it. I have to change it to string in my mongodb and then index it. Is there a way to index ObjectId datatype fields in SOLR schema ? Best

How to resolve exception - Unable to create HttpClient instance

2017-01-31 Thread Abhijit Pawar
Hello, I am working SOLR 5.4.1 which is installed on LINUX OS. I have indexed the XML data and now using SOLRJ API to get it in my Java class and displaying it in JSP page. When I run the code it throws this exception : Exception : Unable to create HttpClient instance. Any idea how to resolve

Re: HELP!!- Error on authentication for mongodb in data-source-config.xml

2017-01-18 Thread Abhijit Pawar
t Regards, <http://www.ibizsoftinc.com/> <http://www.ibizsoftinc.com/> Abhijit Pawar Office : +1 (469) 287 2005 x 110 Follow us on: On Wed, Jan 18, 2017 at 9:33 AM, Abhijit Pawar <apa...@ibizsoftinc.com> wrote: > Thanks Shawn. > As you rightly mentioned I will check with some who is

Re: HELP!!- Error on authentication for mongodb in data-source-config.xml

2017-01-18 Thread Abhijit Pawar
Thanks Shawn. As you rightly mentioned I will check with some who is familiar with JDBC for mongDB. Thank you and take care. Best Regards, <http://www.ibizsoftinc.com/> <http://www.ibizsoftinc.com/> Abhijit Pawar Office : +1 (469) 287 2005 x 110 Follow us on: On Wed, Jan 18,

HELP!!- Error on authentication for mongodb in data-source-config.xml

2017-01-16 Thread Abhijit Pawar
Hello, Need your help on one small problem I am facing in SOLR. I have added authentication for our mongodb database in data-source-config file in SOLR. This is the configuration I have done : >*.*<>*] ​Any idea what could be the issue.​?Appreciate you help!!! ​Thank You!​ Best