Re: How do I create a schema file for FIX data in Solr

I'm talking to the author to find out, thanks. ~~~sent from my cell phone, sorry if there is any typo Adhyan Arizki 于 2018年4月3日周二 下午1:38写道： > Raymond, > > Seems you are having issue with the node environment. Likely the path isn't > registered correctly judging from the

Re: How do I create a schema file for FIX data in Solr

Raymond, Seems you are having issue with the node environment. Likely the path isn't registered correctly judging from the error message. Note though, this is no longer related to Solr issue. On Tue, 3 Apr 2018, 23:00 Raymond Xie, wrote: > Hi Rick, > > Following your

Re: How do I create a schema file for FIX data in Solr

Hi Rick, Following your suggestion I found https://github.com/SunGard-Labs/fix2json which seems to be a fit; I followed the installation instruction and successfully installed the fix2json on my Ubuntu host. sudo npm install -g fix2json I ran the same command as indicated in the git: fix2json

Re: How do I create a schema file for FIX data in Solr

Thank you Rick for the enlightening. I will get the FIX message parsed first and come back here later. ** *Sincerely yours,* *Raymond* On Mon, Apr 2, 2018 at 9:15 AM, Rick Leir wrote: > Google >fix to json, > there are

Re: How do I create a schema file for FIX data in Solr

Google fix to json, there are a few interesting leads. On April 2, 2018 12:34:44 AM EDT, Raymond Xie wrote: >Thank you, Shawn, Rick and other readers, > >To Shawn: > >For *8=FIX.4.4 9=653 35=RIO* as an example, in the FIX standard: 8 >means BeginString, in this

Re: How do I create a schema file for FIX data in Solr

Ray Have you looked around for an existing FIX to Solr conduit? If FIX is a common standard then I would expect that someone has done some work on this and github'd it. Even just FIX to JSON. Cheers -- Rick On April 2, 2018 12:34:44 AM EDT, Raymond Xie wrote: >Thank you,

Re: How do I create a schema file for FIX data in Solr

Raymond, May i suggest you to take a look at the examples given in Solr package? Essentially you need to understand which field is to be searchable by the application and what not. These FIX data can be represented i JSON or XML. To parse and upload the data to Solr, you can use different

Re: How do I create a schema file for FIX data in Solr

Thank you, Shawn, Rick and other readers, To Shawn: For *8=FIX.4.4 9=653 35=RIO* as an example, in the FIX standard: 8 means BeginString, in this example, its value is FIX.4.4.9, and 9 means body length, it is 653 for this message, 35 is RIO, meaning the message type is RIO, 122 stands for

Re: How do I create a schema file for FIX data in Solr

On 4/1/2018 10:12 AM, Raymond Xie wrote: FIX is a format standard of financial data. It contains lots of tags in number with value for the tag, like 8=asdf, where 8 is the tag and asdf is the tag's value. Each tag has its definition. The sample msg in FIX format was in the original question.

Re: How do I create a schema file for FIX data in Solr

Raymond Folks are quiet, maybe because of Easter. Solr has a RESTful interface, and all the details are in the manual. Briefly, you need to create a JSON document containing all the fields in a FIX, then POST it to Solr. POST all your FIX's to Solr, perhaps in batches. Then search for a FIX

Re: How do I create a schema file for FIX data in Solr

Don't know why the mail list took away the highlighted color on the tags, anyway, I have explained the data structure so hopefully you get the idea. Thanks. ~~~sent from my cell phone, sorry if there is any typo Raymond Xie 于 2018年4月1日周日 下午12:24写道： > At the moment I have

Re: How do I create a schema file for FIX data in Solr

At the moment I have no plans to stream the data. Note the raw data is saved in a Linux host, I need to do index on those raw data and provide search capabilities on the data. The data is in FIX, I believe I would need to parse the data and create index on the parsed data, I have never worked on

Re: How do I create a schema file for FIX data in Solr

Thanks to all. FIX is a format standard of financial data. It contains lots of tags in number with value for the tag, like 8=asdf, where 8 is the tag and asdf is the tag's value. Each tag has its definition. The sample msg in FIX format was in the original question. All I need to do is to know

Re: How do I create a schema file for FIX data in Solr

Raymond Will you be streaming the FIX data, perhaps with aggregation? Just a thought, I have no experience with FIX. Streaming opens up lots of questions. Cheers -- Rick On March 31, 2018 2:33:25 PM EDT, Walter Underwood wrote: >Looks like Financial Information Exchange

Re: How do I create a schema file for FIX data in Solr

Looks like Financial Information Exchange data, but, as Shawn says, the real problem is what you want to do with it. * What fields will be searched? Those are indexed. * What fields will be returned in the result? Those are stored. * What is the data type for each field? I often store the data

Re: How do I create a schema file for FIX data in Solr

On 3/31/2018 12:21 PM, Raymond Xie wrote: I just started using Solr to create a Searching function on our existing data. The existing data is in FIX format sample as below: all the red tags (I didn't mark all of them) are fields with definition from FIX standard, I need to create index on

How do I create a schema file for FIX data in Solr

Hello, I just started using Solr to create a Searching function on our existing data. The existing data is in FIX format sample as below: 8=FIX.4.4 9=653 35=RIO 1=TEST 11=3379122 38=1 44=2.0 39=A 40=2 49=VIPER 50=JPNIK01 54=1 55=JNI253D8.OS 56=XSVC 59=0 75=20180350 100=XOSE