Re: Best strategy for logging & security

2015-06-02 Thread Vishal Swaroop
me > with each query log. > > Security: > suggest you to go through this wiki > https://wiki.apache.org/solr/SolrSecurity > > *Thanks,* > *Rajesh,* > *(mobile) : 8328789519.* > > On Mon, Jun 1, 2015 at 11:20 AM, Vishal Swaroop > wrote: > > > It

Re: Best strategy for logging & security

2015-06-01 Thread Vishal Swaroop
suggest you to go through this wiki > https://wiki.apache.org/solr/SolrSecurity > > *Thanks,* > *Rajesh,* > *(mobile) : 8328789519.* > > On Mon, Jun 1, 2015 at 11:20 AM, Vishal Swaroop > wrote: > > > It will be great if you can provide your valuable inputs on strat

Best strategy for logging & security

2015-06-01 Thread Vishal Swaroop
It will be great if you can provide your valuable inputs on strategy for logging & security... Thanks a lot in advance... Logging : - Is there a way to implement logging for each cores separately. - What will be the best strategy to log every query details (like source IP, search query, etc.

Re: distributed search limitations via SolrCloud

2015-05-27 Thread Vishal Swaroop
5.x Solr world deprecates using a war > file. It's still actually produced, but Solr is moving towards start > scripts instead. This is something new to get used to. See: > https://wiki.apache.org/solr/WhyNoWar > > Best, > Erick > > On Wed, May 27, 2015 at 12:51 PM,

Re: distributed search limitations via SolrCloud

2015-05-27 Thread Vishal Swaroop
#x27;d explore is whether you can denormlized your way > out of the need to join. Or whether you can use block joins instead. > > Best, > Erick > > On Wed, May 27, 2015 at 11:15 AM, Vishal Swaroop > wrote: > > Currently, we have SOLR configured on single linux server (24

distributed search limitations via SolrCloud

2015-05-27 Thread Vishal Swaroop
Currently, we have SOLR configured on single linux server (24 GB physical memory) with multiple cores. We are using SOLR joins (https://wiki.apache.org/solr/Join) across cores on this single server. But, as data will grow to ~2 billion we need to assess whether we’ll need to run SolrCloud as "In a

Re: Suggestion on field type

2015-05-20 Thread Vishal Swaroop
esult > > enough to matter which is application-specific. > > > > Best, > > Erick > > > > On Tue, May 19, 2015 at 12:05 PM, Vishal Swaroop > wrote: > >> Also 10481.5711458735456*79* indexes to 10481.571145873546 using double > >> >

Re: Suggestion on field type

2015-05-19 Thread Vishal Swaroop
Also 10481.5711458735456*79* indexes to 10481.571145873546 using double On Tue, May 19, 2015 at 2:57 PM, Vishal Swaroop wrote: > Thanks Erick... I can ignore the trailing zeros > > I am indexing data from Vertica database... Though *double *is very close > but it SOLR indexes 14

Re: Suggestion on field type

2015-05-19 Thread Vishal Swaroop
ed" portion and will be returned if you specify > the field in your "fl" list. I'm assuming here that you're looking at > the actual indexed terms, and don't really understand why the trailing > zeros are important > > Do not use strings. > > Bes

Re: Suggestion on field type

2015-05-19 Thread Vishal Swaroop
indexes to 277.67783 On Tue, May 19, 2015 at 11:56 AM, Jack Krupansky wrote: > "double" (solr.TrieDoubleField) gives more precision > > See: > > https://lucene.apache.org/solr/5_1_0/solr-core/org/apache/solr/schema/TrieDoubleField.html > > -- Jack Krupansky >

Suggestion on field type

2015-05-19 Thread Vishal Swaroop
Please suggest which numeric field type to use so that I can get complete value. e.g value in database is : 194.846189733028000 If I index it as float SOLR indexes it as 194.84619 where as I need complete value i.e 194.846189733028000 I will also be doing range query on this field. Regards

Help to index nested document

2015-05-11 Thread Vishal Swaroop
Need your valuable inputs... I am indexing data from database (one table) which is in this example format : id name value 1 Joe 102724904 2 Joe 100996643 - id is primary/ unique key - there can be same "name" but different "value" - If I try "name" as unique key then SOLR removes duplicate and in

How to get exact match along with text edge_ngram

2015-05-04 Thread Vishal Swaroop
We have item_name indexed as text edge_ngram which returns like results... Please suggest what will be the best approach (like "string" index (in addition to "...edge_ngram"... or using copyField...) to search ALSO for exact matches? e.g. url should return item_name as "abc" entries only... I tri

Re: generate uuid/ id for table which do not have any primary key

2015-04-20 Thread Vishal Swaroop
Thanks... Yes that is option we will go forward with. On Apr 20, 2015 10:52 AM, "Kaushik" wrote: > Have you tried select as id, name, age ? > > On Thu, Apr 16, 2015 at 3:34 PM, Vishal Swaroop > wrote: > > > Just wondering if there is a way to generate uuid/ id i

Re: generate uuid/ id for table which do not have any primary key

2015-04-16 Thread Vishal Swaroop
Just wondering if there is a way to generate uuid/ id in data-config without using combination of fields in query... data-config.xml On Thu, Apr 16, 2015 at 3:18 PM, Vishal Swaroop wrote: > Thanks Kaushik & Erick.. > > Though I can populate uuid by using combination of fi

Re: generate uuid/ id for table which do not have any primary key

2015-04-16 Thread Vishal Swaroop
wrote: > > You seem to have defined the field, but not populating it in the query. > Use > > a combination of fields to come up with a unique id that can be assigned > to > > uuid. Does that make sense? > > > > Kaushik > > > > On Thu, Apr 16, 2015

generate uuid/ id for table which do not have any primary key

2015-04-16 Thread Vishal Swaroop
How to generate uuid/ id (maybe in data-config.xml...) for table which do not have any primary key. Scenario : Using DIH I need to import data from database but table does not have any primary key I do have uuid defined in schema.xml and is uuid data-config.xml Error : Document is missi

Re: SOLR 5.0.0 and Tomcat version ?

2015-03-23 Thread Vishal Swaroop
suggest to use Solr as it is, because after few more release solr will > > not > > >> be able to run using application server. > > >> > > >> So its good to use it as it is (without application server) when you > are > > >> redesigning the stru

SOLR 5.0.0 and Tomcat version ?

2015-03-23 Thread Vishal Swaroop
Hi, We are planning to configure new linux server for latest SOLR release i.e. 5.0.0 Please suggest which Tomcat version will be best compatible with SOLR5... latest Tomcat release is 8.0 Thanks

Re: Suggestion on indexing complex xml

2015-03-02 Thread Vishal Swaroop
15 at 4:43 PM, Alexandre Rafalovitch wrote: > On 27 February 2015 at 16:11, Vishal Swaroop wrote: > > I am able to index XML with same "name" element but in different XPATH by > > using XPathEntityProcessor "forEach" (e.g. below) > > > > Just wonderi

Suggestion on indexing complex xml

2015-02-27 Thread Vishal Swaroop
Hi, I am able to index XML with same "name" element but in different XPATH by using XPathEntityProcessor "forEach" (e.g. below) Just wondering if there is better way to handle this xml format. a) Is there any better way to handle this scenario as xml file will have multiple sub-menu attributes (

Re: Add fields without manually editing Schema.xml.

2015-02-25 Thread Vishal Swaroop
s, Tokenizers, Filters, URPs and even a newsletter: > http://www.solr-start.com/ > > > On 25 February 2015 at 13:26, Vishal Swaroop wrote: > > Hi, > > > > Just wondering if there is a way to handle this use-case in SOLR without > > manually editing Schema.xml. >

Add fields without manually editing Schema.xml.

2015-02-25 Thread Vishal Swaroop
Hi, Just wondering if there is a way to handle this use-case in SOLR without manually editing Schema.xml. Scenario : We have xml data with some elements/ attributes which we plan to index. As we move forward there can be addition of xml elements. Is there a way to handle this with out manually a

Suggestion on distinct/ group by for a field ?

2015-02-23 Thread Vishal Swaroop
Please suggest on how to get the distinct count for a field (name). Summary : I have data indexed in the following format category name value Cat1 A 1 Cat1 A 2 Cat1 B 3 Cat1 B 4 I tried getting the distinct "name" count... but it returns 4 records instaed of 2 (i.e. A, B) http://localhost:8081/so

Re: If I change schema.xml then reIndex is neccessary in Solr or not?

2015-01-22 Thread Vishal Swaroop
We noticed that SOLR/ Tomcat also needs a restart... is it same for you also ? Regards On Thu, Jan 22, 2015 at 2:11 AM, Nitin Solanki wrote: > Ok. Thanx > > On Thu, Jan 22, 2015 at 11:38 AM, Gora Mohanty wrote: > > > On 22 January 2015 at 11:23, Nitin Solanki wrote: > > > I *indexed* *2GB* o

Re: Ignore whitesapce, underscore using KeywordTokenizer... EdgeNGramFilter

2015-01-21 Thread Vishal Swaroop
E_12" ** On Wed, Jan 21, 2015 at 3:31 PM, Alvaro Cabrerizo wrote: > Hi, > > Not sure, but I think that the PatternReplaceFilterFactory or > the PatternReplaceCharFilterFactory could help you deleting those > characters. > > Regards. &

Ignore whitesapce, underscore using KeywordTokenizer... EdgeNGramFilter

2015-01-21 Thread Vishal Swaroop
I am trying to implement type-ahead suggestion for single field which should ignore whitesapce, underscore or special characters in autosuggest. It works as suggested by Alex using KeywordTokenizerFactory but how to ignore whitesapce, underscore... Example itemName data can be : "ABC E12" : if us

Re: How to make edge_ngram work with number, underscores, dashes and space

2015-01-21 Thread Vishal Swaroop
have issues. > > Regards, >Alex. > > Sign up for my Solr resources newsletter at http://www.solr-start.com/ > > > On 20 January 2015 at 23:08, Vishal Swaroop wrote: > > Thanks for the response.. > > a) I am trying to make it non-case-sensitive... ite

Re: How to make edge_ngram work with number, underscores, dashes and space

2015-01-20 Thread Vishal Swaroop
ywordTokenizer and > LowerCaseFilter? > > Also, normally we do not use NGRam filter on both Index and Query. > That just makes things to match on common prefixes instead of matching > what you are searching for to a prefix of original word. > > Regards, > Alex. > ---

How to make edge_ngram work with number, underscores, dashes and space

2015-01-20 Thread Vishal Swaroop
Hi, May be this is basic but I am trying to understand which Tokenizer and Filter to use. I followed some examples as mentioned in solr wiki but type-ahead does not show expected suggestions. Example itemName data can be : - "ABC12DE" : It does not work as soon as I type 1.. i.e. ABC1 - "ABC_12DE

Is defining facet fields in solrconfig.xml mandatory ?

2015-01-07 Thread Vishal Swaroop
Hi, I am exploring faceting in SOLR in collection1 example Faceting fields are defined in solrconfig.xml under browse request handler which is used in in-built "VelocityResponseWriter" ... on cat I think it is not at all mandatory to define facet fields in solrconfig.xml, right ?

Re: SOLR - any open source framework

2015-01-06 Thread Vishal Swaroop
> but writing custom components was easier in other framworks (you need to > take this statement with grain of salt: it was specific to our situation), > but that was one year ago... > > On Tue, Jan 6, 2015 at 5:20 PM, Vishal Swaroop > wrote: > > > Thanks Roman... I wil

Re: SOLR - any open source framework

2015-01-06 Thread Vishal Swaroop
> > *) http://projectblacklight.org/ > > > > Regards, > > Alex. > > > > Sign up for my Solr resources newsletter at http://www.solr-start.com/ > > > > > > On 6 January 2015 at 16:35, Vishal Swaroop wrote: > > > I am new to SOLR and was

Re: SOLR - any open source framework

2015-01-06 Thread Vishal Swaroop
rces newsletter at http://www.solr-start.com/ > > > On 6 January 2015 at 16:35, Vishal Swaroop wrote: > > I am new to SOLR and was able to configure, run samples as well as able > to > > index data using DIH (from database). > > > > Just wondering if there are open source framework to query and > > display/visualize. > > > > Regards >

SOLR - any open source framework

2015-01-06 Thread Vishal Swaroop
I am new to SOLR and was able to configure, run samples as well as able to index data using DIH (from database). Just wondering if there are open source framework to query and display/visualize. Regards