Solr enabled kerberos and create collection failed

2019-10-21 Thread Lvyankui
SolrCloud mode, Solr and Zookeeper enabled kerberos, create collection failed with following command curl --negotiate -u : 'http:// noder27:8983/solr/admin/collections?action=CREATE&name=test01&numShards=1&replicationFactor=1&collection.configName=_default&wt=json' The error is: { "responseHead

Re: Importing a csv file encapsulated by " creates a large copyField field of all fields combined.

2019-10-21 Thread rhys J
Thank you, that worked perfectly. I can't believe I didn't notice the separator was a tab.

Re: Solr Paryload example

2019-10-21 Thread Erik Hatcher
Yes. The decoding of a payload based on its schema type is what the payload() function does. Your Payloader won't currently work well/legibly for fields encoded numerically: https://github.com/o19s/payload-component/blob/master/src/main/java/com/o19s/payloads/Payloader.java#L130

Re: Solr Paryload example

2019-10-21 Thread Eric Pugh
Have you checked out https://github.com/o19s/payload-component On Mon, Oct 21, 2019 at 2:47 PM Erik Hatcher wrote: > How about a single field, with terms like: > > store1_USD|125.0 store2_EUR|220.0 store3_GBP|225.0 > > Would that do the trick? > > And yeah, payload decoding is currently limi

Re: Solr Paryload example

2019-10-21 Thread Erik Hatcher
How about a single field, with terms like: store1_USD|125.0 store2_EUR|220.0 store3_GBP|225.0 Would that do the trick? And yeah, payload decoding is currently limited to float and int with the built-in payload() function. We'd need a new way to pull out textual/bytes payloads - like

Re: Importing a csv file encapsulated by " creates a large copyField field of all fields combined.

2019-10-21 Thread Shawn Heisey
On 10/21/2019 11:24 AM, rhys J wrote: I am using this command: curl ' http://localhost:8983/solr/users/update/csv?commit=true&separator=%09&encapsulator=%20&escape=\&stream.file=/tmp/users.csv ' The sequence %20 is a URL encoding of a space. If you intend the encapsulator character to be a do

Re: Japanese Query Unexpectedly Misses

2019-10-21 Thread Stephen Lewis Bianamara
Thank you Yasufumi! It looks like the userdict_ja.txt could be a good way for us to go. I wonder though if there is a more generic solution to this problem? E.g., has anyone done some research into a list of commonly desired decompoundings which the Kuormoji statistics miss? I tried searching onl

Re: Solr Paryload example

2019-10-21 Thread Erick Erickson
My tongue-in-cheek comment about how to tell veteran programmers from novices: Novice: “My code compiled fine, it should run perfectly” Veteran: “That can’t be right, my code appeared to succeed the first time I ran it.”... > On Oct 21, 2019, at 12:54 PM, Vincenzo D'Amore wrote: > > Hi all, >

Re: Importing a csv file encapsulated by " creates a large copyField field of all fields combined.

2019-10-21 Thread rhys J
I am using this command: curl ' http://localhost:8983/solr/users/update/csv?commit=true&separator=%09&encapsulator=%20&escape=\&stream.file=/tmp/users.csv ' On Mon, Oct 21, 2019 at 1:22 PM Alexandre Rafalovitch wrote: > What command do you use to get the file into Solr? My guess that you > are

Re: Importing a csv file encapsulated by " creates a large copyField field of all fields combined.

2019-10-21 Thread Alexandre Rafalovitch
What command do you use to get the file into Solr? My guess that you are somehow not hitting the correct handler. Perhaps you are sending it to extract handler (designed for PDF, MSWord, etc) rather than the correct CSV handler. Solr comes with the examples of how to index CSV command. See for exa

RE: Solr JVM Turning - 7.2.1 - with solrj updates

2019-10-21 Thread Sethuraman, Ganesh
Dear Solr Users, appreciate any insight on this performance issue below. -Original Message- From: Sethuraman, Ganesh Sent: Wednesday, October 16, 2019 9:25 PM To: solr-user@lucene.apache.org Subject: Solr JVM Turning - 7.2.1 CAUTION: This email originated from outside of D&B. Please

Importing a csv file encapsulated by " creates a large copyField field of all fields combined.

2019-10-21 Thread rhys J
I am trying to import a csv file to my solr core. It looks like this: "user_id","name","email","client","classification","default_client","disabled","dm_password","manager" "A2M","Art Morse","amo...@morsemoving.com","Morse Moving","Morse","","X","blue0show","" "ABW","Amy Wiedner","amy.wied...@pyr

Re: Solr Paryload example

2019-10-21 Thread Shawn Heisey
On 10/21/2019 7:59 AM, Vincenzo D'Amore wrote: But how many dynamic fields like this can I have? more than thousands? There are no actual limits on the number of fields, dynamic or not. You can have as many fields as you want per document, and as many fields as you want across the whole inde

Re: Solr Paryload example

2019-10-21 Thread Vincenzo D'Amore
Hi all, at last I've tried to write my own payload function, and it has worked (pretty well) immediately! Well, to be honest I'm a little puzzled, so I have applied immediately the first rule: always beware when your code works at first run. Now I'm testing it. On Mon, Oct 21, 2019 at 4:37 PM Er

Re: solr UI collection dropdown sorting order

2019-10-21 Thread Sotiris Fragkiskos
i had not idea this can be done, i'm not very web-savvy, just know some python.. On Mon, Oct 21, 2019 at 2:56 PM Erick Erickson wrote: > This is all web-kind of code, html/js/angular-or-whatever…. > > > On Oct 21, 2019, at 5:38 AM, Sotiris Fragkiskos > wrote: > > > > this is excellent!! THANKS!

Re: Solr Paryload example

2019-10-21 Thread Erick Erickson
Don’t go to thousands of fields, it’s usually a bad idea for that many fields. If all you’re doing is returning the data for display, have you considered indexing, perhaps in a separate field, a string token for each? Something like store1_USD_125.00 ? Then have the UI split that apart in a plea

Re: Solr Paryload example

2019-10-21 Thread Alexandre Rafalovitch
I remember several years ago a discussion/blog post about a similar problem. The author went through a lot of thinking and decided that the best way to deal with a similar problem was to have Solr documents represent different level of abstraction, more granular. IIRC, the equivalent for your exam

Re: Solr Paryload example

2019-10-21 Thread Vincenzo D'Amore
Hi Erick, thanks for getting back to me. We started to use payloads because we have the classical per-store pricing problem. Thousands of stores across and different prices. Then we found the payloads very useful started to use it for many reasons, like enabling/disabling the product for such stor

Re: solr UI collection dropdown sorting order

2019-10-21 Thread Erick Erickson
This is all web-kind of code, html/js/angular-or-whatever…. > On Oct 21, 2019, at 5:38 AM, Sotiris Fragkiskos wrote: > > this is excellent!! THANKS!! > > On Mon, Oct 21, 2019 at 10:29 AM Charlie Hull wrote: > >> I think we looked at this at our recent Hackday in DC - check out the >> firs

Re: Solr Paryload example

2019-10-21 Thread Erick Erickson
This is one of those situations where I know a client did it, but didn’t see the code myself. So I can’t help much. Perhaps a good question at this point, though, is “why do you want to add string payloads anyway”? This isn’t the client, but it might give you some pointers: https://github.co

Solr enabled kerberos and create collection failed

2019-10-21 Thread Lvyankui
SolrCloud mode, Solr and Zookeeper enabled kerberos, create collection failed with following command curl --negotiate -u : 'http:// noder27:8983/solr/admin/collections?action=CREATE&name=test01&numShards=1&replicationFactor=1&collection.configName=_default&wt=json' The error is: { "responseHea

Re: Solr Paryload example

2019-10-21 Thread Vincenzo D'Amore
Hi Erick, It seems I've reached a dead-point, or at least it seems looking at the code, it seems I can't easily add a custom decoder: Looking at PayloadUtils class there is getPayloadDecoder method invoked to return the PayloadDecoder : public static PayloadDecoder getPayloadDecoder(FieldType

Re: solr UI collection dropdown sorting order

2019-10-21 Thread Sotiris Fragkiskos
this is excellent!! THANKS!! On Mon, Oct 21, 2019 at 10:29 AM Charlie Hull wrote: > I think we looked at this at our recent Hackday in DC - check out the > first part of this blog: > > https://opensourceconnections.com/blog/2019/09/23/what-happens-at-a-lucene-solr-hackday/ > - hopefully a po

Re: solr UI collection dropdown sorting order

2019-10-21 Thread Charlie Hull
I think we looked at this at our recent Hackday in DC - check out the first part of this blog: https://opensourceconnections.com/blog/2019/09/23/what-happens-at-a-lucene-solr-hackday/ - hopefully a pointer towards getting this fixed. Best Charlie On 20/10/2019 09:06, Sotiris Fragkiskos wrote

Re: solr UI collection dropdown sorting order

2019-10-21 Thread Sotiris Fragkiskos
My java knowledge is very weak to say the least, so I can't help there unfortunately... Thanks for the reply, I have been meaning to ask for at least a year!! kind regards, Sotiri On Mon, Oct 21, 2019 at 1:54 AM Erick Erickson wrote: > Unfortunately not, although if you’d like to add that funct

Re: Solr Paryload example

2019-10-21 Thread Vincenzo D'Amore
Thanks Eric, please, do you have a clue or a suggestion to give me in order to write such function? Or should I write a payload decoder for the delimited_payloads_string. And again, if I have to write a decoder, would be easier if I found an example to start with. Best regards, Vincenzo On Mon,