Looking for some guide on how to do the index on a folder of data in Solr 7.2

2019-09-18 Thread Raymond Xie
r 7.2 anymore, it is just "post", not "post.jar" Can you tell me what is the right command to do the index on a folder? I am not able to find that information in the documentation. Thank you very much. On Tue, Sep 17, 2019 at 9:42 AM Raymond Xie wrote: > Thank you Paras for

Re: Why I receive permission denied when running as root

2019-09-17 Thread Raymond Xie
ene/solr/8.2.0/solr-8.2.0.zip>). > Yes, it does mean that the package is incomplete. > > On Tue, 17 Sep 2019 at 18:40, Raymond Xie wrote: > >> Thank you Paras: >> >> If I am already user of root, and still run sudo? no, it doesn't work: >> [root@pocnnr

Re: Why I receive permission denied when running as root

2019-09-17 Thread Raymond Xie
he file by: > > *chmod +x bin/solr* > > > Hope this helps. > > On Tue, 17 Sep 2019 at 18:03, Raymond Xie wrote: > >> Thank you. >> >> As I suspected, this is something else. It prompts me the same error here: >> [root@pocnnr1n1 solr]# bin/solr

Re: Why I receive permission denied when running as root

2019-09-17 Thread Raymond Xie
st you to go through *Service Installation Script *in Taking > Solr to Production > <https://lucene.apache.org/solr/guide/8_1/taking-solr-to-production.html> that > describes the ideal Solr setup. A must read! > > Hope I helped. > > > On Tue, 17 Sep 2019 at 08:37, Raymond Xie wrote: &

Why I receive permission denied when running as root

2019-09-16 Thread Raymond Xie
[root@pocnnr1n1 solr-8.2.0]# ll total 88 -rw-r--r-- 1 root root 4023 Jul 19 09:09 README.md -rw-r--r-- 1 root root 32153 Jul 19 09:09 build.xml -rw-r--r-- 1 root root 27717 Jul 19 09:09 NOTICE.txt -rw-r--r-- 1 root root 12646 Jul 19 09:09 LICENSE.txt drwxr-xr-x 10 root root 174 Sep 16 21:13

Re: How to do parallel indexing on files (not on HDFS)

2018-05-24 Thread Raymond Xie
may guide you best. > > > http://saumitra.me/blog/tweet-search-and-analysis-with-kafka-solr-cassandra/ > > I dont know where this guys code went.. but the content is there with code > samples. > > > > > -- > > On May 23, 2018, 8:37 PM -0500, Raymond Xie , wro

Re: How to do parallel indexing on files (not on HDFS)

2018-05-23 Thread Raymond Xie
abbit or > Kafka (Persist the map), have a bunch of threads , workers, containers, > whatever pop off the queue , process the item (reduce). > > > -- > Rahul Singh > rahul.si...@anant.us > > Anant Corporation > > On May 20, 2018, 7:24 AM -0400, Raymond Xie , wrote: >

Re: Index filename while indexing JSON file

2018-05-20 Thread Raymond Xie
would you consider to include the filename as another meta data fields for being indexed? I think your downstream python can do that easily. ** *Sincerely yours,* *Raymond* On Fri, May 18, 2018 at 3:47 PM, S.Ashwath wrote: > Hello, > > I have 2

How to do parallel indexing on files (not on HDFS)

2018-05-20 Thread Raymond Xie
I know how to do indexing on file system like single file or folder, but how do I do that in a parallel way? The data I need to index is of huge volume and can't be put on HDFS. Thank you ** *Sincerely yours,* *Raymond*

Multi threading indexing

2018-05-13 Thread Raymond Xie
Hello, I have a huge amount of data (TB level) to be indexed, I am wondering if anyone can share your idea/code to do the multithreading indexing? ** *Sincerely yours,* *Raymond*

How to do multi-threading indexing on huge volume of JSON files?

2018-05-08 Thread Raymond Xie
I have a huge amount of JSON files to be indexed in Solr, it costs me 22 minutes to index 300,000 JSON files which were generated from 1 single bz2 file, this is only 0.25% of the total amount of data from the same business flow, there are 100+ business flow to be index'ed. I absolutely need a goo

How to do indexing on remote location

2018-05-08 Thread Raymond Xie
Please take this as no joking! Any suggestion is welcome and appreciated. I have data on remote WORM drive on a cluster that include 3 hosts, each host contains same copy of data. I have Solr server on a different host and need to do the indexing on the WORM drive. It is said the indexing can on

Re: How to create a solr collection providing as much searching flexibility as possible?

2018-04-29 Thread Raymond Xie
Thank you Alessandro, It looks like my requirement is vague, but indeed I already indicated my data is in FIX format, which is a format, here is an example in the Wiki link in my original question: 8=FIX.4.2 | 9=178 | 35=8 | 49=PHLX | 56=PERS | 52=20071123-05:30:00.000 | 11=ATOMNOCCC9990900 | 20

How to create a solr collection providing as much searching flexibility as possible?

2018-04-27 Thread Raymond Xie
I have huge amount of data in FIX format ( https://en.wikipedia.org/wiki/Financial_Information_eXchange) I want to give the data users the most flexibility to do their search, usually like trading date range, order id or type, amount, Can anyone share any experience on that? Thanks. *--

adding document to collection failed in Solr cloud mode

2018-04-14 Thread Raymond Xie
Hello, I need to add all documents in a folder to collection and it failed: Here is my command: hostname: mysolr Solr Admin URL: http://mysolr.net:8983/solr/#/ Collection name: collection_indexer Collection url: http://mysolr.net:8983/solr/#/collection_indexer_shard1_replica1 data folder: /tmp/

Re: How to create my schema and add document, thank you

2018-04-06 Thread Raymond Xie
ically in the newer version of Solr out of the box. you > just need to edit it > 2. Have you reload your instance after you made the modification? > > On Thu, Apr 5, 2018 at 6:56 PM, Raymond Xie wrote: > > > I have the data ready for index now, it is a json file: > >

Urgent! How to retrieve the whole message in the Solr search result?

2018-04-06 Thread Raymond Xie
I am using Solr for the following search need: raw data: in FIX format, it's OK if you don't know what it is, treat it as csv with a special delimiter. parsed data: from raw data, all in the same format of a bunch of JSON format with all 100+ fields. Example: Raw data: delimiter is \u001: 8=FI

How to create my schema and add document, thank you

2018-04-05 Thread Raymond Xie
I have the data ready for index now, it is a json file: {"122": "20180320-08:08:35.038", "49": "VIPER", "382": "0", "151": "1.0", "9": "653", "10071": "20180320-08:08:35.088", "15": "JPY", "56": "XSVC", "54": "1", "10202": "APMKTMAKING", "10537": "XOSE", "10217": "Y", "48": "179492540", "201": "1

Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance

2018-04-04 Thread Raymond Xie
, "10039": "viperooe", "39": "A", "10438": "RIO.4.5", "38": "1", "37": "3379122", "372": "D", "660": "102", "44": "2.0", "1

Re: How do I create a schema file for FIX data in Solr

2018-04-03 Thread Raymond Xie
he error message. Note though, this is > no longer related to Solr issue. > > On Tue, 3 Apr 2018, 23:00 Raymond Xie, wrote: > > > Hi Rick, > > > > Following your suggestion I found > https://github.com/SunGard-Labs/fix2json > > which seems to be a fit; >

Re: How do I create a schema file for FIX data in Solr

2018-04-03 Thread Raymond Xie
yours,* *Raymond* On Mon, Apr 2, 2018 at 9:30 AM, Raymond Xie wrote: > Thank you Rick for the enlightening. > > I will get the FIX message parsed first and come back here later. > > > ** > *Sincerely yours,* > > > *Ra

Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance

2018-04-02 Thread Raymond Xie
> > Copyfield to copy all searchable fields into the default field. > > Cheers -- Rick > > > > On April 1, 2018 11:34:07 PM EDT, Raymond Xie > > wrote: > > >Hi Rick, > > > > > >I sorted it out half: > > > > > >I should have speci

Re: How do I create a schema file for FIX data in Solr

2018-04-02 Thread Raymond Xie
teresting leads. > > On April 2, 2018 12:34:44 AM EDT, Raymond Xie > wrote: > >Thank you, Shawn, Rick and other readers, > > > >To Shawn: > > > >For *8=FIX.4.4 9=653 35=RIO* as an example, in the FIX standard: 8 > >means BeginString, in this example, its

Re: How do I create a schema file for FIX data in Solr

2018-04-01 Thread Raymond Xie
awn Heisey wrote: > On 4/1/2018 10:12 AM, Raymond Xie wrote: > >> FIX is a format standard of financial data. It contains lots of tags in >> number with value for the tag, like 8=asdf, where 8 is the tag and asdf is >> the tag's value. Each tag has its definition. >&g

Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance

2018-04-01 Thread Raymond Xie
ut is not visible to me because the mailing list strips images. > Please try a different way to show the output. > Cheers -- Rick > > On March 29, 2018 10:17:13 PM EDT, Raymond Xie > wrote: > > I am new to Solr, following Steve Rowe's example on > >https://github.c

Re: How do I create a schema file for FIX data in Solr

2018-04-01 Thread Raymond Xie
Don't know why the mail list took away the highlighted color on the tags, anyway, I have explained the data structure so hopefully you get the idea. Thanks. ~~~sent from my cell phone, sorry if there is any typo Raymond Xie 于 2018年4月1日周日 下午12:24写道: > At the moment I have no plans t

Re: How do I create a schema file for FIX data in Solr

2018-04-01 Thread Raymond Xie
FIXdata nor Solr, any ideas are greatly appreciated. Thanks lots in advance. Again, if you want to see the data a sample is in the original question. ~~~sent from my cell phone, sorry if there is any typo Raymond Xie 于 2018年4月1日周日 下午12:12写道: > Thanks to all. > > FIX is a format st

Re: How do I create a schema file for FIX data in Solr

2018-04-01 Thread Raymond Xie
ng search problems so much easier. > > > >wunder > >Walter Underwood > >wun...@wunderwood.org > >http://observer.wunderwood.org/ (my blog) > > > >> On Mar 31, 2018, at 11:29 AM, Shawn Heisey > >wrote: > >> > >> On 3/31/2018 12:21 P

How do I create a schema file for FIX data in Solr

2018-03-31 Thread Raymond Xie
Hello, I just started using Solr to create a Searching function on our existing data. The existing data is in FIX format sample as below: 8=FIX.4.4 9=653 35=RIO 1=TEST 11=3379122 38=1 44=2.0 39=A 40=2 49=VIPER 50=JPNIK01 54=1 55=JNI253D8.OS 56=XSVC 59=0 75=20180350 100=XOSE 10039=viperoo

Need help to get started on Solr, searching get nothing. Thank you very much in advance

2018-03-29 Thread Raymond Xie
I am new to Solr, following Steve Rowe's example on https://github.com/apache/lucene-solr/tree/master/solr/example/films: It would be greatly appreciated if anyone can enlighten me where to start troubleshooting, thank you very much in advance. The steps I followed are: Here ya go << END_OF

New Subscribe

2018-03-27 Thread Raymond Xie
** *Sincerely yours,* *Raymond*