Re: Integrating solr with Hadoop

2014-07-02 Thread gurunath
Thanks Eric, I will watch out for Map reduce option. It will be helpfull if I get any links to set up hadoop with solr. -- View this message in context: http://lucene.472066.n3.nabble.com/Integrating-solr-with-Hadoop-tp4144715p4145157.html Sent from the Solr - User mailing list archive at

Re: Integrating solr with Hadoop

2014-07-01 Thread Erick Erickson
ion mentioned below. > > 1. Solr 4.7 + Tomcat 7 + Apache zookeeper and Hadoop. > > Thanks > Guru Pai. > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Integrating-solr-with-Hadoop-tp4144715p4144916.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: Integrating solr with Hadoop

2014-06-30 Thread gurunath
zookeeper and Hadoop. Thanks Guru Pai. -- View this message in context: http://lucene.472066.n3.nabble.com/Integrating-solr-with-Hadoop-tp4144715p4144916.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Integrating solr with Hadoop

2014-06-30 Thread Jay Vyas
le, the size of data will grow gradually. I have heard about using >> "*Big Data Work for Hadoop and Solr*", Is this a better option for large >> data or better to go ahead with tomcat or jetty server with solr. >> >> Thanks >> >> >> >> >> -- >> View this message in context: >> http://lucene.472066.n3.nabble.com/Integrating-solr-with-Hadoop-tp4144715.html >> Sent from the Solr - User mailing list archive at Nabble.com.

Re: Integrating solr with Hadoop

2014-06-30 Thread Shawn Heisey
On 6/30/2014 3:19 AM, gurunath wrote: > I want to setup solr in production, Initially the data set i am using is of > small scale, the size of data will grow gradually. I have heard about using > "*Big Data Work for Hadoop and Solr*", Is this a better option for large > data or better to go ahead w

Re: Integrating solr with Hadoop

2014-06-30 Thread Erick Erickson
er to go ahead with tomcat or jetty server with solr. > > Thanks > > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Integrating-solr-with-Hadoop-tp4144715.html > Sent from the Solr - User mailing list archive at Nabble.com.

Integrating solr with Hadoop

2014-06-30 Thread gurunath
with solr. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Integrating-solr-with-Hadoop-tp4144715.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Solr with Hadoop

2013-07-18 Thread Saikat Kanjilal
ine if you have more questions. Regards > From: mlie...@impetus.com > To: solr-user@lucene.apache.org > Subject: Re: Solr with Hadoop > Date: Thu, 18 Jul 2013 15:41:36 + > > Rajesh, > > If you require to have an integration between Solr and Hadoop or NoSQL, I &g

Re: Solr with Hadoop

2013-07-18 Thread Matt Lieber
you query over the data ingested from Solr in Hive for example, which is pretty nice. Solr would not trigger Hadoop jobs, though. Cheers, Matt On 7/17/13 7:37 PM, "Rajesh Jain" wrote: >I > have a newbie question on integrating Solr with Hadoop. > >There are some vendors like

Solr with Hadoop

2013-07-17 Thread Rajesh Jain
I have a newbie question on integrating Solr with Hadoop. There are some vendors like Cloudera/MapR who have announced Solr Search for Hadoop. If I use the Apache distro, how can I use Solr Search on docs in HDFS/Hadoop Is there a tutorial on how to use it or getting started. I am using Flume

Re: solr with hadoop

2010-07-06 Thread Jason Rutherglen
uted indexing correctly, what about updating the documents > and what about replicating them correctly? > > Does this work? Or wasn't this an issue? > > Kind regards > - Mitch > -- > View this message in context: > http://lucene.472066.n3.nabble.com/solr-with-

Re: solr with hadoop

2010-07-05 Thread MitchK
/solr-with-hadoop-tp482688p944413.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: solr with hadoop

2010-06-23 Thread Otis Gospodnetic
al Message > From: Jon Baer > To: solr-user@lucene.apache.org > Sent: Tue, June 22, 2010 12:47:14 PM > Subject: Re: solr with hadoop > > I was playing around w/ Sqoop the other day, its a simple Cloudera tool for > imports (mysql -> hdfs) @ > href="http://www.clouder

Re: solr with hadoop

2010-06-22 Thread Jon Baer
ematext.com/ -- Lucene - Solr - Nutch >> >> - Original Message >> From: Stu Hood >> To: solr-user@lucene.apache.org >> Sent: Monday, January 7, 2008 7:14:20 PM >> Subject: Re: solr with hadoop >> >> As Mike suggested, we use Hadoop t

Re: solr with hadoop

2010-06-22 Thread MitchK
> Otis > -- > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > > - Original Message > From: Stu Hood > To: solr-user@lucene.apache.org > Sent: Monday, January 7, 2008 7:14:20 PM > Subject: Re: solr with hadoop > > As Mike suggested, we use Hadoop

Re: solr with hadoop

2010-06-22 Thread Marc Sturlese
I think a good solution could be to use hadoop with SOLR-1301 to build solr shards and then use solr distributed search against these shards (you will have to copy to local from HDFS to search against them) -- View this message in context: http://lucene.472066.n3.nabble.com/solr-with-hadoop

Re: solr with hadoop

2010-06-22 Thread Neeb
of mapreduce? Any directions and guidance over this setup would be highly appreciated. Thanks in advance, -Ali -- View this message in context: http://lucene.472066.n3.nabble.com/solr-with-hadoop-tp482688p914483.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Using Solr with Hadoop ....

2008-11-29 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Sat, Nov 29, 2008 at 7:26 PM, Jon Baer <[EMAIL PROTECTED]> wrote: > HadoopEntityProcessor for the DIH? Reading data from Hadoop with DIH could be really cool There are a few very useful ones which are required badly. Most useful one would be a TikaEntityProcessor. But I do not see it solving th

Re: Using Solr with Hadoop ....

2008-11-29 Thread Jon Baer
HadoopEntityProcessor for the DIH? Ive wondered about this as they make HadoopCluster LiveCDs and EC2 have images but best way to make use of them is always a challenge. - Jon On Nov 29, 2008, at 3:34 AM, Erik Hatcher wrote: On Nov 28, 2008, at 8:38 PM, Yonik Seeley wrote: Or, it would b

Re: Using Solr with Hadoop ....

2008-11-29 Thread Erik Hatcher
On Nov 28, 2008, at 8:38 PM, Yonik Seeley wrote: Or, it would be relatively trivial to write a Lucene program to merge the indexes. FYI, such a tool exists in Lucene's API already: Erik

RE: Using Solr with Hadoop ....

2008-11-28 Thread souravm
ay be worthwhile where I use Solr/Lucene's indexing power and Hadoop's parallel processing capability. Regards, Sourav -Original Message- From: Yonik Seeley [mailto:[EMAIL PROTECTED] Sent: Friday, November 28, 2008 7:08 PM To: solr-user@lucene.apache.org Subject: Re: Using S

Re: Using Solr with Hadoop ....

2008-11-28 Thread Yonik Seeley
Ah sorry, I had misread your original post. 3-6M docs per hour can be challenging. Using the CSV loader, I've indexed 4000 docs per second (14M per hour) on a 2.6GHz Athlon, but they were relatively simple and small docs. On Fri, Nov 28, 2008 at 9:54 PM, souravm <[EMAIL PROTECTED]> wrote: > There

RE: Using Solr with Hadoop ....

2008-11-28 Thread souravm
ginal Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Yonik Seeley Sent: Friday, November 28, 2008 5:38 PM To: solr-user@lucene.apache.org Subject: Re: Using Solr with Hadoop The indexing rate you need to achieve should be equal to the rate that new documents are produced

Re: Using Solr with Hadoop ....

2008-11-28 Thread Yonik Seeley
Original Message- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Yonik Seeley > Sent: Friday, November 28, 2008 1:58 PM > To: solr-user@lucene.apache.org > Subject: Re: Using Solr with Hadoop > > While future Solr-hadoop integration is a definite possibil

RE: Using Solr with Hadoop ....

2008-11-28 Thread souravm
he servers. Regards, Sourav -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Yonik Seeley Sent: Friday, November 28, 2008 1:58 PM To: solr-user@lucene.apache.org Subject: Re: Using Solr with Hadoop While future Solr-hadoop integration is a definite p

Re: Using Solr with Hadoop ....

2008-11-28 Thread Yonik Seeley
s not an option as my target doc size > per hr itself can be very huge (3-6M). So I am considering using HDFS and > MapReduce to do the indexing job within time. > > In that regard I have following queries regarding using Solr with Hadoop. > > 1. After creating the index using Had

Using Solr with Hadoop ....

2008-11-28 Thread souravm
using HDFS and MapReduce to do the indexing job within time. In that regard I have following queries regarding using Solr with Hadoop. 1. After creating the index using Hadoop whether storing them for query purpose again in HDFS would mean additional performance overhead (compared to storing

Re: solr with hadoop

2008-01-07 Thread Otis Gospodnetic
t;[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Sent: Monday, January 7, 2008 7:14:20 PM Subject: Re: solr with hadoop As Mike suggested, we use Hadoop to organize our data en route to Solr. Hadoop allows us to load balance the indexing stage, and then we use the raw Lucene IndexWrit

Re: solr with hadoop

2008-01-07 Thread Stu Hood
Klaas <[EMAIL PROTECTED]> Sent: Friday, January 4, 2008 3:04pm To: solr-user@lucene.apache.org Subject: Re: solr with hadoop On 4-Jan-08, at 11:37 AM, Evgeniy Strokin wrote: > I have huge index base (about 110 millions documents, 100 fields > each). But size of the index base is reas

Re: solr with hadoop

2008-01-05 Thread Otis Gospodnetic
sounds like 2) might be more suitable for you. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Evgeniy Strokin <[EMAIL PROTECTED]> To: Solr User Sent: Friday, January 4, 2008 2:37:41 PM Subject: solr with hadoop I have huge index base (abo

Re: solr with hadoop

2008-01-04 Thread Ryan McKinley
ments, are running slow. So I was thinking is any benefits to use hadoop for this? And if so, what direction should I go? Is anybody did something for integration Solr with Hadoop? Does it give any performance boost? Hadoop might be useful for organizing your data enroute to Solr, but I don'

Re: solr with hadoop

2008-01-04 Thread Mike Klaas
slow. So I was thinking is any benefits to use hadoop for this? And if so, what direction should I go? Is anybody did something for integration Solr with Hadoop? Does it give any performance boost? Hadoop might be useful for organizing your data enroute to Solr, but I don't see how i

solr with hadoop

2008-01-04 Thread Evgeniy Strokin
p for this? And if so, what direction should I go? Is anybody did something for integration Solr with Hadoop? Does it give any performance boost? Any information is helpful for me, Thanks, Eugene