[solr build in eclipse for debuging] assertTrue error
Hi, I'm trying to debug, and I downloaded solr source and built it. everything is fine except one thing. all test code "assertTrue" got error. It looks like there is no static import for assertTrue. I think adding static import to all of testcase by myself is not good way I don't understand why this error happen. Thanks in advance. Regards, Hangu
[DIH] deltaQuery has no column to resolve to declared primary key pk='id'
Hi, I stuck in DIH... full import is fine. and delta import was also fine before I add deltaQuery and parentDeltaQuery in 'auth' entity. thank you for any help.. Regards, Hangu
Re: [newbie] Configuration for SolrCloud + DataImportHandler
Mikhail, I didn't understatnd that's what I need to do. thank you. but at the first moment, I am not doing well.. I am testing to change configuration in solrcloud, through this command ./zkcli.sh -zkhost localhost:9983 -cmd putfile /synonyms.txt /usr/local/solr-5.3.1-test/server/scripts/cloud-scripts/synonyms.txt and no error message was occured. and then I reloaded solr at localhost:8983 coreAdmin. then I checked synonyms.txt file at localhost:8983/solr/#/~cloud?view=tree but nothing happend. what's wrong? Regards, Hangu On Tue, Oct 20, 2015 at 9:18 PM, Mikhail Khludnev < mkhlud...@griddynamics.com> wrote: > did you try something like > $> zkcli.sh -zkhost localhost:2181 -cmd putfile /solr.xml /path/to/solr.xml > ? > > On Mon, Oct 19, 2015 at 11:15 PM, hangu choi <dev.ha...@gmail.com> wrote: > > > Hi, > > > > I am trying to start SolrCloud with embedded ZooKeeper. > > > > I know how to config solrconfig.xml and schema.xml, and other things for > > data import handler. > > but when I trying to config it with solrCloud, I don't know where to > start. > > > > I know there is no conf directory in SolrCloud because conf directory are > > stored in ZooKeeper. > > Then, how can I config that? I read this ( > > > > > https://cwiki.apache.org/confluence/display/solr/Using+ZooKeeper+to+Manage+Configuration+Files > > ) > > but I failed to understand. > > > > I need to config solrconfig.xml and schema.xml for my custom schema. > > > > > > Regards, > > Hangu > > > > > > -- > Sincerely yours > Mikhail Khludnev > Principal Engineer, > Grid Dynamics > > <http://www.griddynamics.com> > <mkhlud...@griddynamics.com> >
Re: [newbie] Configuration for SolrCloud + DataImportHandler
Mikhail, I solved the problem, I putfile to wrong path. /synonyms.txt should be /configs/gettingstarted/synonyms.txt . Regards, Hangu On Wed, Oct 21, 2015 at 4:17 PM, Hangu Choi <dev.ha...@gmail.com> wrote: > Mikhail, > > I didn't understatnd that's what I need to do. thank you. > > but at the first moment, I am not doing well.. > I am testing to change configuration in solrcloud, through this command > > ./zkcli.sh -zkhost localhost:9983 -cmd putfile /synonyms.txt > /usr/local/solr-5.3.1-test/server/scripts/cloud-scripts/synonyms.txt > and no error message was occured. > > and then I reloaded solr at localhost:8983 coreAdmin. > then I checked synonyms.txt file at localhost:8983/solr/#/~cloud?view=tree > but nothing happend. what's wrong? > > > > > Regards, > Hangu > > On Tue, Oct 20, 2015 at 9:18 PM, Mikhail Khludnev < > mkhlud...@griddynamics.com> wrote: > >> did you try something like >> $> zkcli.sh -zkhost localhost:2181 -cmd putfile /solr.xml >> /path/to/solr.xml >> ? >> >> On Mon, Oct 19, 2015 at 11:15 PM, hangu choi <dev.ha...@gmail.com> wrote: >> >> > Hi, >> > >> > I am trying to start SolrCloud with embedded ZooKeeper. >> > >> > I know how to config solrconfig.xml and schema.xml, and other things for >> > data import handler. >> > but when I trying to config it with solrCloud, I don't know where to >> start. >> > >> > I know there is no conf directory in SolrCloud because conf directory >> are >> > stored in ZooKeeper. >> > Then, how can I config that? I read this ( >> > >> > >> https://cwiki.apache.org/confluence/display/solr/Using+ZooKeeper+to+Manage+Configuration+Files >> > ) >> > but I failed to understand. >> > >> > I need to config solrconfig.xml and schema.xml for my custom schema. >> > >> > >> > Regards, >> > Hangu >> > >> >> >> >> -- >> Sincerely yours >> Mikhail Khludnev >> Principal Engineer, >> Grid Dynamics >> >> <http://www.griddynamics.com> >> <mkhlud...@griddynamics.com> >> > >
Validating idea of architecture for RDB / Import / Solr
Hi, I am newbie for solr and I hope to check my idea is good or terrible if someone can help. # background * I have mysql as my primary data storage. * I want to import data from mysql to solr (solrcloud). * I have domain logics to make solr document - (means I can't make solr document with plain sql query) # my idea * In mysql I make table for solr document, and insert/update whenever any changes made for solr document. * run data import handler (mostly delta query) from [solr document table] to solr with cron scheduler frequently with soft-commit. * hard-commit less frequently. Is it good or terrible idea? for any advice, I will be happy. Regards, Hangu
[newbie] Configuration for SolrCloud + DataImportHandler
Hi, I am trying to start SolrCloud with embedded ZooKeeper. I know how to config solrconfig.xml and schema.xml, and other things for data import handler. but when I trying to config it with solrCloud, I don't know where to start. I know there is no conf directory in SolrCloud because conf directory are stored in ZooKeeper. Then, how can I config that? I read this ( https://cwiki.apache.org/confluence/display/solr/Using+ZooKeeper+to+Manage+Configuration+Files ) but I failed to understand. I need to config solrconfig.xml and schema.xml for my custom schema. Regards, Hangu
Re: Validating idea of architecture for RDB / Import / Solr
Thank you Susheel, chandan. Susheel, In Option 1, I have to manage my domain logic two places, one for java, one for sql. and my domain logic is not stable and may change frequently.. I think changing complext sql query whenever my domain logic change will be painful... and yes, I've thought like option 2. still my importing java application has to change whenever domain logic change. but because it is java, I can consider import domain logic or can make domain layer as service, etc... chandan, Thank you for sharing your experience. Thank you all for your attention. It's helpful to me! :) Regards, Hangu On Wed, Oct 21, 2015 at 1:01 AM, chandan khatri <chandankhat...@gmail.com> wrote: > Hi Hongu, > > Scaling shouldn't be a problem if you follow the proposed approach but if > the updates are frequent then there can be issue with high latency. > > I am also following the same approach where the data is first > updated/written to Mysql and then in MongoDB. I believe using this we can > take advantage of both RDBMS and NoSQL. > > I am only using MongoDB for non transactional data but planning to use it > for transactional data e.g inventory. > > Thanks, > Chandan > > > > On Tue, Oct 20, 2015 at 6:22 PM, Susheel Kumar <susheel2...@gmail.com> > wrote: > > > Hello Hangu, > > > > > > OPTION1. you can write complex/nested join queries with DIH and have > > functions written in javascript for transformations in data-config if > that > > meets your domain requirement > > OPTION2. use Java program with SolrJ and read data using jdbc and apply > > domain specific rules, create solr document and then using SolrJ classes > > like (ClouldSolrClient...) write the documents to Solr. This can scale > and > > will have more flexibility as you go further. > > > > The current solution you are suggesting to go, can work depending on > how > > much data you are talking about / how many updates etc. but will have its > > own consequences like maintaining a separate state of data (if it is > large > > you are storing it twice etc...), may not scale etc. > > > > Thanks, > > Susheel > > > > > > > > On Tue, Oct 20, 2015 at 2:47 AM, hangu choi <dev.ha...@gmail.com> wrote: > > > > > Hi, > > > > > > I am newbie for solr and I hope to check my idea is good or terrible if > > > someone can help. > > > > > > # background > > > * I have mysql as my primary data storage. > > > * I want to import data from mysql to solr (solrcloud). > > > * I have domain logics to make solr document - (means I can't make > > solr > > > document with plain sql query) > > > > > > # my idea > > > * In mysql I make table for solr document, and insert/update > whenever > > > any changes made for solr document. > > > * run data import handler (mostly delta query) from [solr document > > > table] to solr with cron scheduler frequently with soft-commit. > > > * hard-commit less frequently. > > > > > > Is it good or terrible idea? > > > for any advice, I will be happy. > > > > > > > > > Regards, > > > Hangu > > > > > >
