Re: ant compile = not able to resolve dependencies

2015-01-10 Thread Anurag Sharma
Any directions to resolve it is also helpful.

On Sat, Jan 10, 2015 at 2:48 PM, Anurag Sharma  wrote:

> Hi,
>
> I am facing issue in resolving the dependency while doing 'ant compile' on
> trunk, seeing following error:
>
> [ivy:retrieve]  ::  UNRESOLVED DEPENDENCIES ::
> [ivy:retrieve]  ::
> [ivy:retrieve]  :: org.restlet.jee#org.restlet.ext.servlet;2.3.0:
> configuration not found in org.restlet.jee#org.restlet.ext.servlet;2.3.0:
> 'master'. It was required from org.apache.solr#core;working@pc compile
>
>
> Please suggest if anyone faced this issue.
>
> Thanks
> Anurag
>


ant compile = not able to resolve dependencies

2015-01-10 Thread Anurag Sharma
Hi,

I am facing issue in resolving the dependency while doing 'ant compile' on
trunk, seeing following error:

[ivy:retrieve]  ::  UNRESOLVED DEPENDENCIES ::
[ivy:retrieve]  ::
[ivy:retrieve]  :: org.restlet.jee#org.restlet.ext.servlet;2.3.0:
configuration not found in org.restlet.jee#org.restlet.ext.servlet;2.3.0:
'master'. It was required from org.apache.solr#core;working@pc compile


Please suggest if anyone faced this issue.

Thanks
Anurag


Re: Solr HTTP client authentication

2014-11-17 Thread Anurag Sharma
I think Solr encourage SSL than authentication

On Mon, Nov 17, 2014 at 6:08 PM, Bai Shen  wrote:

> I am using solrj to connect to my solr server.  However I need to
> authenticate against the server and can not find out how to do so using
> solrj.  Is this possible or do I need to drop solrj?  I can manually create
> an httpclient and set up authentication but then I can't use solrj.
>
> Thanks.
>


Re: solr IRC

2014-11-15 Thread Anurag Sharma
Thanks a lot Shawn for the detailed explanation. The wiki is also very
helpful. Any recommended client like pidgin, adium etc. especially for
windows.

On Sat, Nov 15, 2014 at 11:26 PM, Shawn Heisey  wrote:

> On 11/14/2014 10:32 PM, Anurag Sharma wrote:
> > Also like know, is this the only IRC or there are other's as well like
> solr
> > dev, lucene dev  etc
>
> The freenode channels #solr and #solr-dev exist specifically for Solr.
> End users should keep their questions in #solr, because #solr-dev is for
> discussions around development of Solr itself.
>
> As a specific example:  Initial discussion of a possible bug should
> begin in #solr.  If you want to be part of the conversation for FIXING
> that bug, then #solr-dev would be appropriate.
>
> For the wider lucene ecosystem, there are #lucene and #lucene-dev, but
> Solr questions should only be asked there as a last resort, because it's
> off-topic for those channels and many residents probably don't know
> anything about Solr.
>
> It can take quite a while for someone to notice your question after you
> have asked it.  The person that notices your question first may not know
> the answer, though.
>
> I've created a wiki page about the IRC channels, and I've pinged our
> admin UI expert about using that wiki page as the landing point for the
> "IRC Channel" link in the Solr admin UI.
>
> https://wiki.apache.org/solr/IRCChannels
>
> Thanks,
> Shawn
>
>


Eclipse junit run issue after run in Cloud mode

2014-11-15 Thread Anurag Sharma
Am facing issue in running junit after 'svn up', junit works well without
any issue with a fresh trunk checkout. Only difference between fresh and
updated is that the earlier was once launched solr in cloud mode. There is
no issue in running through "ant test  -Dtestcase".

Following are the log when running in the svn updated env. Does anyone
faced the same issue?

Eclipse console log:
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/C:/work/trunk/solr/core/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/C:/work/trunk/solr/solrj/test-lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No such property [conversionPattern] in
org.apache.solr.util.SolrLogLayout.
NOTE: test params are: codec=null, sim=null, locale=null, timezone=(null)
NOTE: Windows 8 6.2 amd64/Oracle Corporation 1.7.0_51
(64-bit)/cpus=4,threads=1,free=61030064,total=77594624
NOTE: All tests run in this JVM: [AtomicUpdatesTest]
NOTE: reproduce with: ant test  -Dtestcase=AtomicUpdatesTest
-Dtests.seed=7DDB6D72ED561A31 -Dtests.asserts=true
-Dtests.file.encoding=UTF-8

JUnit error in Eclipse
java.lang.VerifyError: class
org.apache.lucene.codecs.lucene40.Lucene40CompoundReader overrides final
method makeLock.(Ljava/lang/String;)Lorg/apache/lucene/store/Lock;
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(Unknown Source)
at java.security.SecureClassLoader.defineClass(Unknown Source)
at java.net.URLClassLoader.defineClass(Unknown Source)
at java.net.URLClassLoader.access$100(Unknown Source)
at java.net.URLClassLoader$1.run(Unknown Source)
at java.net.URLClassLoader$1.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at
org.apache.lucene.codecs.lucene40.Lucene40Codec.(Lucene40Codec.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
at java.lang.reflect.Constructor.newInstance(Unknown Source)
at java.lang.Class.newInstance(Unknown Source)
at org.apache.lucene.util.NamedSPILoader.reload(NamedSPILoader.java:67)
at org.apache.lucene.util.NamedSPILoader.(NamedSPILoader.java:47)
at org.apache.lucene.util.NamedSPILoader.(NamedSPILoader.java:37)
at org.apache.lucene.codecs.Codec.(Codec.java:42)
at
org.apache.lucene.util.TestRuleSetupAndRestoreClassEnv.before(TestRuleSetupAndRestoreClassEnv.java:152)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Unknown Source)

java.lang.NoClassDefFoundError: Could not initialize class
org.apache.lucene.codecs.Codec
at
org.apache.lucene.util.TestRuleSetupAndRestoreClassEnv.after(TestRuleSetupAndRestoreClassEnv.java:296)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:52)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrO

Re: solr IRC

2014-11-14 Thread Anurag Sharma
Also like know, is this the only IRC or there are other's as well like solr
dev, lucene dev  etc

On Sat, Nov 15, 2014 at 10:59 AM, Anurag Sharma  wrote:

> I tried couple of weeks earlier as well. As suggested, will try again
> after mid next week.
>
> On Sat, Nov 15, 2014 at 10:53 AM, Alexandre Rafalovitch <
> arafa...@gmail.com> wrote:
>
>> If you tried this week it is because everybody was at the conference. Try
>> again mid next week.
>>
>> Regards,
>>  Alex
>> On 14/11/2014 11:35 pm, "Anurag Sharma"  wrote:
>>
>> > Is this correct link to Solr IRC -
>> > http://webchat.freenode.net/?channels=#solr
>> > I tried couple of times using the IRC, the list of online users are
>> always
>> > good but never get any response on the query and also don't see any
>> > communication/discussion.
>> >
>>
>
>


Re: solr IRC

2014-11-14 Thread Anurag Sharma
I tried couple of weeks earlier as well. As suggested, will try again after
mid next week.

On Sat, Nov 15, 2014 at 10:53 AM, Alexandre Rafalovitch 
wrote:

> If you tried this week it is because everybody was at the conference. Try
> again mid next week.
>
> Regards,
>  Alex
> On 14/11/2014 11:35 pm, "Anurag Sharma"  wrote:
>
> > Is this correct link to Solr IRC -
> > http://webchat.freenode.net/?channels=#solr
> > I tried couple of times using the IRC, the list of online users are
> always
> > good but never get any response on the query and also don't see any
> > communication/discussion.
> >
>


solr IRC

2014-11-14 Thread Anurag Sharma
Is this correct link to Solr IRC -
http://webchat.freenode.net/?channels=#solr
I tried couple of times using the IRC, the list of online users are always
good but never get any response on the query and also don't see any
communication/discussion.


Re: DIH Blob data

2014-11-14 Thread Anurag Sharma
Thanks Michael & Eric for the succinct response.

On Sat, Nov 15, 2014 at 12:13 AM, Michael Sokolov <
msoko...@safaribooksonline.com> wrote:

> There is a binary type
>
> -Mike
>
> On 11/14/2014 12:21 PM, Anurag Sharma wrote:
>
>> bq: We routinely store images and pdfs in Solr. There *is* a benefit,
>> since
>> you don't need to manage another storage system, you don't have to worry
>> about Solr getting out of sync with the other system, you can use Solr
>> replication for all your assets, etc.
>>
>> Do the same holds good for large Blobs like image, audio, video as well?
>> Tika supports multiple file formats (http://tika.apache.org/1.5/
>> formats.html)
>> but not sure how good is the Solr/Tika combination. Storing pdf and other
>> docs could be useful in Solr, tika can extract metadata from the docs and
>> make them discoverable.
>>
>> Considering all the above cases there should also be a support for File
>> field type in Solr like other types Date, Float, Int, Long, String etc.
>> but
>> looks like there are only two file types (
>> http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/
>> core/src/java/org/apache/solr/schema/)
>> and both re external file storage.
>>
>> - ExternalFileField.java
>> <http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/
>> core/src/java/org/apache/solr/schema/ExternalFileField.java>
>> - ExternalFileFieldReloader.java
>> <http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/
>> core/src/java/org/apache/solr/schema/ExternalFileFieldReloader.java>
>>
>> What type can be used in schema when storing the files internally?
>>
>>
>> On Thu, Nov 13, 2014 at 3:48 AM, Jeon Woosung 
>> wrote:
>>
>>  How about this?
>>>
>>> First, define a field for filter query. It should be multivalued.
>>>
>>> Second, implements transformer to extract json dynamic fields, and put
>>> the
>>> dynamic fields into the solr field.
>>>
>>> For example,
>>>
>>> 
>>>
>>> Data : {a:1,b:2,c:3}
>>>
>>> You can split the data to "a:1", "b:2", "c:3", and put them into terms.
>>>
>>> And then you can use filter query like "fq=terms:a:1"
>>> 2014. 11. 13. 오전 3:59에 "Michael Sokolov" >>
>>>> 님이
>>>>
>>> 작성:
>>>
>>>  We routinely store images and pdfs in Solr. There *is* a benefit, since
>>>> you don't need to manage another storage system, you don't have to worry
>>>> about Solr getting out of sync with the other system, you can use Solr
>>>> replication for all your assets, etc.
>>>>
>>>> I don't use DIH, so personally I don't care whether it handles blobs,
>>>> but
>>>> it does seem like a natural extension for a system that indexes data
>>>> from
>>>> SQL in Solr.
>>>>
>>>> -Mike
>>>>
>>>>
>>>> On 11/12/2014 01:31 PM, Anurag Sharma wrote:
>>>>
>>>>  BLOB is non-searchable field so there is no benefit of storing it into
>>>>> Solr. Any external key-value store can be used to store the blob and
>>>>> reference of this blob can be stored as a string field in Solr.
>>>>>
>>>>> On Wed, Nov 12, 2014 at 5:56 PM, stockii 
>>>>> wrote:
>>>>>
>>>>>   I had a similar problem and didnt find any solution to use the fields
>>>>>
>>>> in
>>>
>>>> JSON
>>>>>> Blob for a filter ... Not with DIH.
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> View this message in context:
>>>>>>
>>>>>>  http://lucene.472066.n3.nabble.com/DIH-Blob-data-
>>> tp4168896p4168925.html
>>>
>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>>>
>>>>>>
>>>>>>
>


Re: Restrict search to subset (a list of aprrox 40,000 ids from an external service) of corpus

2014-11-14 Thread Anurag Sharma
Is it possible to add another integer dyanmicField to the selected doc ids?
If yes, further can add update incremental/same values to these docs now
search can be done to this subset using range/filter query.

On Fri, Nov 14, 2014 at 10:21 PM, henry cleland 
wrote:

> Hi guys,
> How do I search only a subset of my corpus based on a large list of non
> consecutive unique key ids (cannot do a range query).
> Is there a way around doing this  q=id:(id1 OR id2 OR id3 OR id4 ... OR
> id4 ) AND name:*
>
> Also what is the limit of "OR"s i can apply on the query if that is the
> only way out, i don't suppose it is infinity.
> Thanks
>


Re: DIH Blob data

2014-11-14 Thread Anurag Sharma
bq: We routinely store images and pdfs in Solr. There *is* a benefit, since
you don't need to manage another storage system, you don't have to worry
about Solr getting out of sync with the other system, you can use Solr
replication for all your assets, etc.

Do the same holds good for large Blobs like image, audio, video as well?
Tika supports multiple file formats (http://tika.apache.org/1.5/formats.html)
but not sure how good is the Solr/Tika combination. Storing pdf and other
docs could be useful in Solr, tika can extract metadata from the docs and
make them discoverable.

Considering all the above cases there should also be a support for File
field type in Solr like other types Date, Float, Int, Long, String etc. but
looks like there are only two file types (
http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/core/src/java/org/apache/solr/schema/)
and both re external file storage.

   - ExternalFileField.java
   
<http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/core/src/java/org/apache/solr/schema/ExternalFileField.java>
   - ExternalFileFieldReloader.java
   
<http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/core/src/java/org/apache/solr/schema/ExternalFileFieldReloader.java>

What type can be used in schema when storing the files internally?


On Thu, Nov 13, 2014 at 3:48 AM, Jeon Woosung  wrote:

> How about this?
>
> First, define a field for filter query. It should be multivalued.
>
> Second, implements transformer to extract json dynamic fields, and put the
> dynamic fields into the solr field.
>
> For example,
>
> 
>
> Data : {a:1,b:2,c:3}
>
> You can split the data to "a:1", "b:2", "c:3", and put them into terms.
>
> And then you can use filter query like "fq=terms:a:1"
> 2014. 11. 13. 오전 3:59에 "Michael Sokolov"  >님이
> 작성:
>
> > We routinely store images and pdfs in Solr. There *is* a benefit, since
> > you don't need to manage another storage system, you don't have to worry
> > about Solr getting out of sync with the other system, you can use Solr
> > replication for all your assets, etc.
> >
> > I don't use DIH, so personally I don't care whether it handles blobs, but
> > it does seem like a natural extension for a system that indexes data from
> > SQL in Solr.
> >
> > -Mike
> >
> >
> > On 11/12/2014 01:31 PM, Anurag Sharma wrote:
> >
> >> BLOB is non-searchable field so there is no benefit of storing it into
> >> Solr. Any external key-value store can be used to store the blob and
> >> reference of this blob can be stored as a string field in Solr.
> >>
> >> On Wed, Nov 12, 2014 at 5:56 PM, stockii 
> >> wrote:
> >>
> >>  I had a similar problem and didnt find any solution to use the fields
> in
> >>> JSON
> >>> Blob for a filter ... Not with DIH.
> >>>
> >>>
> >>>
> >>> --
> >>> View this message in context:
> >>>
> http://lucene.472066.n3.nabble.com/DIH-Blob-data-tp4168896p4168925.html
> >>> Sent from the Solr - User mailing list archive at Nabble.com.
> >>>
> >>>
> >
>


Re: DIH Blob data

2014-11-12 Thread Anurag Sharma
BLOB is non-searchable field so there is no benefit of storing it into
Solr. Any external key-value store can be used to store the blob and
reference of this blob can be stored as a string field in Solr.

On Wed, Nov 12, 2014 at 5:56 PM, stockii  wrote:

> I had a similar problem and didnt find any solution to use the fields in
> JSON
> Blob for a filter ... Not with DIH.
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/DIH-Blob-data-tp4168896p4168925.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>


Re: SOLRJ Atomic updates of String field

2014-11-12 Thread Anurag Sharma
I understood the query now.
Atomic Update and Optimistic Concurrency are independent in Solr version >
5.
Not sure about version 4.2, if they are combined in this version a
_version_ field is needed to pass in every update. The atomic/partial
update will succeed if version in the request and indexed doc matches
otherwise response will have HTTP error code 409.

You can try by passing the _version_ of indexed doc during update.

It's also good to add a unit test in Solr for partial update which
currently I see missing.

On Wed, Nov 12, 2014 at 1:00 PM, Ahmet Arslan 
wrote:

> Hi Bbarani,
>
> Partial update solrJ example can be found in :
> http://find.searchhub.org/document/5b1187abfcfad33f
>
> Ahmet
>
>
>
> On Tuesday, November 11, 2014 8:51 PM, bbarani  wrote:
> I am using the below code to do partial update (in SOLR 4.2)
>
> partialUpdate = new HashMap();
> partialUpdate.put("set",Object);
> doc.setField(description, partialUpdate);
> server.add(docs);
> server.commit();
>
> I am seeing the below description value with {set =...}, Any idea why this
> is getting added?
>
> 
> {set=The iPhone 6 Plus features a 5.5-inch retina HD display, the A8 chip
> for faster processing and longer battery life, the M8 motion coprocessor to
> track speed, distance and elevation, and with an 8MP iSight camera, you can
> record 1080p HD Video at 60 FPS!}
> 
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/SOLRJ-Atomic-updates-of-String-field-tp4168809.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>


Re: SOLRJ Atomic updates of String field

2014-11-11 Thread Anurag Sharma
Sorry didn't get what you are trying to achieve and the issue.

On Wed, Nov 12, 2014 at 12:20 AM, bbarani  wrote:

> I am using the below code to do partial update (in SOLR 4.2)
>
> partialUpdate = new HashMap();
> partialUpdate.put("set",Object);
> doc.setField(description, partialUpdate);
> server.add(docs);
> server.commit();
>
> I am seeing the below description value with {set =...}, Any idea why this
> is getting added?
>
> 
> {set=The iPhone 6 Plus features a 5.5-inch retina HD display, the A8 chip
> for faster processing and longer battery life, the M8 motion coprocessor to
> track speed, distance and elevation, and with an 8MP iSight camera, you can
> record 1080p HD Video at 60 FPS!}
> 
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/SOLRJ-Atomic-updates-of-String-field-tp4168809.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>


Re: Analytics result for each Result Group

2014-11-11 Thread Anurag Sharma
Probably sum and division can be applied to get the median.
If you are using ver above 5,
http://svn.apache.org/repos/asf/lucene/dev//trunk/solr/contrib/analytics/src/java/org/apache/solr/analytics/statistics/MedianStatsCollector.java
can be used directly

On Tue, Nov 11, 2014 at 5:49 PM, Talat Uyarer  wrote:

> Hi Anurag,
>
> How can I find median function ? I use a lot that.
>
> 2014-11-09 20:39 GMT+02:00 Anurag Sharma :
> > Can a function query(http://wiki.apache.org/solr/FunctionQuery) serves
> your
> > use case
> >
> > On Wed, Nov 5, 2014 at 3:36 PM, Talat Uyarer  wrote:
> >
> >> I searched wiki pages about that. I do not find any documentation. If
> >> you help me I will be glad.
> >>
> >> Thanks
> >>
> >> 2014-11-04 11:34 GMT+02:00 Talat Uyarer :
> >> > Hi folks,
> >> >
> >> > We use Analytics Component for median, max etc. I wonder if I use
> >> > "group.field" parameter with analytics component, How to calculate
> >> > analytics for each result group ?
> >> >
> >> > Thanks
> >> >
> >> > --
> >> > Talat UYARER
> >> > Websitesi: http://talat.uyarer.com
> >> > Twitter: http://twitter.com/talatuyarer
> >> > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> >>
> >>
> >>
> >> --
> >> Talat UYARER
> >> Websitesi: http://talat.uyarer.com
> >> Twitter: http://twitter.com/talatuyarer
> >> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> >>
>
>
>
> --
> Talat UYARER
> Websitesi: http://talat.uyarer.com
> Twitter: http://twitter.com/talatuyarer
> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>


Re: Analytics result for each Result Group

2014-11-09 Thread Anurag Sharma
Can a function query(http://wiki.apache.org/solr/FunctionQuery) serves your
use case

On Wed, Nov 5, 2014 at 3:36 PM, Talat Uyarer  wrote:

> I searched wiki pages about that. I do not find any documentation. If
> you help me I will be glad.
>
> Thanks
>
> 2014-11-04 11:34 GMT+02:00 Talat Uyarer :
> > Hi folks,
> >
> > We use Analytics Component for median, max etc. I wonder if I use
> > "group.field" parameter with analytics component, How to calculate
> > analytics for each result group ?
> >
> > Thanks
> >
> > --
> > Talat UYARER
> > Websitesi: http://talat.uyarer.com
> > Twitter: http://twitter.com/talatuyarer
> > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>
>
>
> --
> Talat UYARER
> Websitesi: http://talat.uyarer.com
> Twitter: http://twitter.com/talatuyarer
> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>


Re: indexing errors when storeOffsetsWithPositions="true" in solr 4.9.1

2014-11-09 Thread Anurag Sharma
Is it possible to share the sequence of steps with data causing this issue

On Wed, Nov 5, 2014 at 4:51 PM, Alan Woodward  wrote:

> Hi Min,
>
> Do you have the specific bit of text that caused this exception to be
> thrown?
>
> Alan Woodward
> www.flax.co.uk
>
>
> On 4 Nov 2014, at 23:15, Min L wrote:
>
> > Hi All:
> >
> > I am using solr 4.9.1. and trying to use PostingsSolrHighlighter. But I
> got
> > errors during indexing. I thought LUCENE-5111 has fixed issues with
> > WordDelimitedFilter. The error is as below:
> >
> > Caused by: java.lang.IllegalArgumentException: startOffset must be
> > non-negative, and endOffset must be >= startOffset, and offsets must
> > not go backwards startOffset=31,endOffset=44,lastStartOffset=37 for
> > field 'description_texts'
> >   at
> org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:630)
> >   at
> org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:342)
> >   at
> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:301)
> >   at
> org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:241)
> >   at
> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:451)
> >   at
> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1539)
> >   at
> org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:240)
> >   at
> org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:164)
> >
> >
> > My schema.xml looks like below:
> >
> >  > indexed="true" storeOffsetsWithPositions="true"/>
> >
> > 
> >
> >  
> >
> >
> >
> >
> >
> >
> >
> > > "stemdict_en.txt" />
> >
> > > "^(\p{Punct}*)(.*?)(\p{Punct}*)$" replacement="$2"/>
> >
> >
> >
> > words="stopwords_english.txt"
> > ignoreCase="true" enablePositionIncrements="true" />
> >
> > preserveOriginal="1"
> > splitOnNumerics="0" catenateWords="1" />
> >
> >  
> >
> >  
> >
> >
> >
> >
> >
> > words="stopwords_english.txt"
> > ignoreCase="true" enablePositionIncrements="true" />
> >
> > preserveOriginal="1"
> > splitOnNumerics="0" catenateWords="1" />
> >
> > > "stemdict_en.txt" />
> >
> >
> >
> >  
> >
> >
> >
> >
> > Any help is appreciated.
> >
> >
> > Thanks.
> >
> > Min
>
>


Re: Best way to map holidays to corresponding date

2014-11-09 Thread Anurag Sharma
Not sure this is the correct way but can we use synonyms here

On Wed, Nov 5, 2014 at 6:14 PM, Jack Krupansky 
wrote:

> Unfortunately, a date is a non-analyzed field, so you can't do something
> like a synonym.
>
> Further, Holidays are repeating - every year - and the dates can vary, so
> they won't match exactly.
>
> Use an update request processor to examine the date field at values index
> time and look up and store the holiday name in a text field so that you can
> do a query such as "holiday:easter". It could be a string field, but they
> case would have to match exactly You could code this in a JavaScript script
> that has the logic or hard dates for various holidays using the stateless
> script update processor.
>
> -- Jack Krupansky
>
> -Original Message- From: Patrick Kirsch
> Sent: Wednesday, November 5, 2014 6:12 AM
> To: solr-user@lucene.apache.org
> Subject: Best way to map holidays to corresponding date
>
>
> Hey,
> maybe someone already faced the situation and could give me a hint.
>
> Given one query includes "Easter" or "Sylvester" I search for the best
> place to translate the string to the corresponding date.
>
> Is there any solr.Mapping*Factory for that?
> Do I need to implement it in a custom Solr Query Parser etc.?
>
> Regards,
> Patrick
>


Re: Sort documents by first value in multivalued field

2014-11-08 Thread Anurag Sharma
What is 'first value' here, any example?

On Fri, Nov 7, 2014 at 5:04 PM, Nickolay41189  wrote:

> How can I sort documents by first value in multivalued field? (without
> adding
> copyField and without some changes in schema.xml)?
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Sort-documents-by-first-value-in-multivalued-field-tp4168140.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>


Re: Term count in multivalue fields

2014-11-08 Thread Anurag Sharma
Since 'omitTermFremFreqAndPositions' is enabled what does a function query
'totaltermfreq(field,term)' return?

Another way, not sure this is the correct approach, while indexing add a
field containing the number. Filter and sum(function query) on the field
while querying. Range query can also be done on this field.

On Fri, Nov 7, 2014 at 7:23 PM, Nickolay41189  wrote:

> Andrey, thank you for reply. Can you explain what do you mean "faceting
> query
> with prefix"? I'm newer in the wolrd of Solr, can you give me example of
> this query?
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Term-count-in-multivalue-fields-tp4168138p4168167.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>


Re: Minimum Term Matching in More Like This Queries

2014-11-08 Thread Anurag Sharma
There is no direct way of retrieving doc based on minimum term match in
Solr. mlm params 'mlt.mintf' and 'mlt.match.offset' can be explored if they
meets the criteria. Refer below links for more details:
http://wiki.apache.org/solr/MoreLikeThisHandler
https://wiki.apache.org/solr/MoreLikeThis

In case you are using lucene library directly,setPercentTermsToMatch()
function can be used from MoreLikeThisQuery class.
Refer code:
https://svn.apache.org/repos/asf/lucene/dev/trunk/lucene/queries/src/java/org/apache/lucene/queries/mlt/MoreLikeThisQuery.java

On Fri, Nov 7, 2014 at 9:45 PM, Tim Hearn  wrote:

> Hi!
>
> I'm fairly new to Solr.  Is there a feature which enforces minimum term
> matching for MLT Queries?  More precisely, that is, a document will match
> the MLT query if and only if at least x terms in the query are found in the
> document, with x defined by the user.  I could not find such a feature in
> the documentation, and switching to the edismax query parser and using the
> 'mm' parameter does not work for me.
>
> Thanks!
>


Re: Sort documents by exist(multivalued field)

2014-11-08 Thread Anurag Sharma
Is it possible to describe the exact use case here.

On Fri, Nov 7, 2014 at 10:26 PM, Alexandre Rafalovitch 
wrote:

> You encode that knowledge by using UpdateRequestProcessor. Clone the
> field, replace it with true, map it to boolean. That way, you will pay
> the price once per document indexed not (documentCount*) times per
> request.
>
> Regards,
>   Alex.
> Personal: http://www.outerthoughts.com/ and @arafalov
> Solr resources and newsletter: http://www.solr-start.com/ and @solrstart
> Solr popularizers community: https://www.linkedin.com/groups?gid=6713853
>
>
> On 7 November 2014 06:43, Nickolay41189  wrote:
> > I want to sort by multivalued field like boolean values.
> > Something like that:
> > *sort exist(multivalued field name) desc*
> >
> > Is it possible?
> >
> > P.S. I know that sorting doesn't work for multivalued fields, but it work
> > for single boolean field...
> >
> >
> >
> > --
> > View this message in context:
> http://lucene.472066.n3.nabble.com/Sort-documents-by-exist-multivalued-field-tp4168141.html
> > Sent from the Solr - User mailing list archive at Nabble.com.
>


Re: How to dynamically create Solr cores with schema

2014-11-08 Thread Anurag Sharma
For more advanced dynamic fields refer dynamicField elements convention
patterns for fields from the below schema.xml
http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/server/solr/configsets/basic_configs/conf/schema.xml

solr create core api can be referred to create a core dynamically. e.g.
curl "
http://localhost:8080/solr/admin/cores?action=CREATE&name=$name&instanceDir=/etc/solr/conf/$name
"


On Fri, Nov 7, 2014 at 10:29 PM, Alexandre Rafalovitch 
wrote:

> The usual solution to that is to have dynamic fields with suffixes
> indicating the types. So, your int fields are mapped to *_i, your date
> fields to *_d.
>
> Solr has schemaless support, but it is auto-detect for now. Creating
> fields of particular types via API I think is in JIRA on the trunk for
> 5.0.
>
> Regards,
>Alex.
> Personal: http://www.outerthoughts.com/ and @arafalov
> Solr resources and newsletter: http://www.solr-start.com/ and @solrstart
> Solr popularizers community: https://www.linkedin.com/groups?gid=6713853
>
>
> On 6 November 2014 10:04, Andreas Hubold 
> wrote:
> > Hi,
> >
> > I have a use-case where Java applications need to create Solr indexes
> > dynamically. Schema fields of these indexes differ and should be defined
> by
> > the Java application upon creation.
> >
> > So I'm trying to use the Core Admin API [1] to create new cores and the
> > Schema API [2] to define fields. When creating a core, I have to specify
> > solrconfig.xml (with enabled ManagedIndexSchemaFactory) and the schema to
> > start with. I thought it would be a good idea to use a named config sets
> [3]
> > for this purpose:
> >
> > curl
> > '
> http://localhost:8082/solr/admin/cores?action=CREATE&name=m1&instanceDir=cores/m1&configSet=myconfig&dataDir=data
> '
> >
> > But when I add a field to the core "m1", the field actually gets added to
> > the config set. Is this a bug of feature?
> >
> > curl http://localhost:8082/solr/m1/schema/fields -X POST -H
> > 'Content-type:application/json'
> >   --data-binary '[{
> > "name":"foo",
> > "type":"tdate",
> > "stored":true
> > }]'
> >
> > All cores created from the config set "myconfig" will get the new field
> > "foo" in their schema. So this obviously does not work to create cores
> with
> > different schema.
> >
> > I also tried to use the config/schema parameters of the CREATE core
> command
> > (instead of config sets) to specify some existing
> solrconfig.xml/schema.xml.
> > I tried relative paths here (e.g. some level upwards) but I could not
> get it
> > to work. The documentation [1] tells me that relative paths are allowed.
> > Should this work?
> >
> > Next thing that would come to my mind is to use dynamic fields instead
> of a
> > correct managed schema, but that does not sound as nice.
> > Or maybe I should implement a custom CoreAdminHandler which takes list of
> > field definitions, if that's possible somehow...?
> >
> > I don't know. What's your recommended approach?
> >
> > We're using Solr 4.10.1 non-SolrCloud. Would this be simpler or different
> > with SolrCloud?
> >
> > Thank you,
> > Andreas
> >
> > [1]
> >
> https://cwiki.apache.org/confluence/display/solr/CoreAdmin+API#CoreAdminAPI-CREATE
> > [2]
> >
> https://cwiki.apache.org/confluence/display/solr/Schema+API#SchemaAPI-Modifytheschema
> > [3] https://cwiki.apache.org/confluence/display/solr/Config+Sets
>


Re: Delete data from stored documents

2014-11-08 Thread Anurag Sharma
Since the data already existing and need is to remove unwanted fields using
a custom update processor looks less useful here. Erick's
recommendation on re-indexing
into a new collection if at all possible looks simple and safe.



On Sat, Nov 8, 2014 at 12:44 AM, Erick Erickson 
wrote:

> bq: My question is if I can delete the field definition from the
> schema.xml and do an optimize and the fields “magically” disappears
>
> no. schema.xml is really just about regularizing how Lucene indexes
> things. Lucene (where this would have to take place) doesn't have any
> understanding of schema.xml, so changing it then optimizing (and
> optimizing is also a Lucene function) won't have any effect.
>
> If you
> 1> change the schema
> and
> 2> update documents
> the data will be purged as background merges happen.
>
> But really, I'd recommend re-indexing into a new collection if at all
> possible.
>
>
> Best,
> Erick
>
> On Fri, Nov 7, 2014 at 4:26 AM, Yago Riveiro 
> wrote:
> > Jack,
> >
> >
> >
> >
> > I have some data indexed that I don’t need any more. My question is if I
> can delete the field definition from the schema.xml and do an optimize and
> the fields “magically” disappears (and free space from disk).
> >
> >
> >
> >
> > Re-index data to delete fields is to expensive in collections with
> hundreds of millions of documents.
> >
> >
> >
> >
> > Optimize operation seems to be a good place to shrink to documents ...
> >
> >
> >
> > —
> > /Yago Riveiro
> >
> > On Fri, Nov 7, 2014 at 12:19 PM, Jack Krupansky  >
> > wrote:
> >
> >> Could you clarify exactly what you are trying to do, like with an
> example? I
> >> mean, how exactly are you determining what fields are "unwanted"? Are
> you
> >> simply asking whether fields can be deleted from the index (and schema)?
> >> -- Jack Krupansky
> >> -Original Message-
> >> From: yriveiro
> >> Sent: Thursday, November 6, 2014 9:19 AM
> >> To: solr-user@lucene.apache.org
> >> Subject: Delete data from stored documents
> >> Hi,
> >> It's possible remove store data of an index deleting the unwanted fields
> >> from schema.xml and after do an optimize over the index?
> >> Thanks,
> >> /yago
> >> -
> >> Best regards
> >> --
> >> View this message in context:
> >>
> http://lucene.472066.n3.nabble.com/Delete-data-from-stored-documents-tp4167990.html
> >> Sent from the Solr - User mailing list archive at Nabble.com.
>


Re: Synonymn for Numbers

2014-11-08 Thread Anurag Sharma
If you are searching for single document can a real time get on doc id
mentioned below serve your use case?
http://localhost:8983/solr/get?id=mydoc

Real time get for multiple docs:
http://localhost:8983/solr/get?id=mydoc&id=mydoc

On Sat, Nov 8, 2014 at 12:52 AM, EXTERNAL Taminidi Ravi (ETI,
Automotive-Service-Solutions)  wrote:

> Hi Group,
>
> I am working on implementing synonym for number like
> 10,2010
> 14,2014
>
> 2 digit number to get documents with four digit, I added the above lines
> in synonym and everything works. But now I have to get for one direction,
>
> I tried 10=>2010 but it is still gets the record belongs to 10 , if I
> search 2010. I want to get only 2010 documents if I search 2010 not 10. I
> have expand=true in the synonym filter.
>
>  ignoreCase="true" expand="true"/>
>
>
> If any help really appreciated.
>
> Thanks
>
> Ravi
>


Re: Solr exceptions during batch indexing

2014-11-08 Thread Anurag Sharma
Just trying to understand what's the challenge in returning the bad doc
id(s)?
Solr already know which doc(s) failed on update and can return their id(s)
in response or callback. Can we have JIRA ticket on it if it doesn't exist?

This looks like a common use case and every solr consumer might be writing
their own versions to handle this issue.

On Sat, Nov 8, 2014 at 1:17 AM, Walter Underwood 
wrote:

> Right, that is why we batch.
>
> When a batch of 1000 fails, drop to a batch size of 1 and start the batch
> over. Then it can report the exact document with problems.
>
> If you want to continue, go back to the bigger batch size. I usually fail
> the whole batch on one error.
>
> wunder
> Walter Underwood
> wun...@wunderwood.org
> http://observer.wunderwood.org/
>
>
> On Nov 7, 2014, at 11:44 AM, Peter Keegan  wrote:
>
> > I'm seeing 9X throughput with 1000 docs/batch vs 1 doc/batch, with a
> single
> > thread, so it's certainly worth it.
> >
> > Thanks,
> > Peter
> >
> >
> > On Fri, Nov 7, 2014 at 2:18 PM, Erick Erickson 
> > wrote:
> >
> >> And Walter has also been around for a _long_ time ;)
> >>
> >> (sorry, couldn't resist)
> >>
> >> Erick
> >>
> >> On Fri, Nov 7, 2014 at 11:12 AM, Walter Underwood <
> wun...@wunderwood.org>
> >> wrote:
> >>> Yes, I implemented exactly that fallback for Solr 1.2 at Netflix.
> >>>
> >>> It isn’t to hard if the code is structured for it; retry with a batch
> >> size of 1.
> >>>
> >>> wunder
> >>>
> >>> On Nov 7, 2014, at 11:01 AM, Erick Erickson 
> >> wrote:
> >>>
>  Yeah, this has been an ongoing issue for a _long_ time. Basically,
>  you can't. So far, people have essentially written fallback logic to
>  index the docs of a failing packet one at a time and report it.
> 
>  I'd really like better reporting back, but we haven't gotten there
> yet.
> 
>  Best,
>  Erick
> 
>  On Fri, Nov 7, 2014 at 8:25 AM, Peter Keegan 
> >> wrote:
> > How are folks handling Solr exceptions that occur during batch
> >> indexing?
> > Solr stops parsing the docs stream when an error occurs (e.g. a doc
> >> with a
> > missing mandatory field), and stops indexing the batch. The bad
> >> document is
> > not identified, so it would be hard for the client to recover by
> >> skipping
> > over it.
> >
> > Peter
> >>>
> >>
>
>


Re: issue in launching SolrCloud windows/cygwin

2014-10-19 Thread Anurag Sharma
Hi Nazik,

Thanks for the response. The link mentioned by you is very useful.  I used
the windows cmd and started the cloud using solr.cmd script. The script is
very rich in taking multiple options.

Anurag

On Sun, Oct 19, 2014 at 5:01 PM, Nazik Huq  wrote:

> Run Solr straight from the Windows cmd if CygWin isn't a requirement. For
> example, running "java -jar start.jar" from the "example" directory will
> start single instance Solr.
>
> To run SolrCloud follow the instructions in "Simple Two-Shard Cluster on
> the Same Machine" from this link http://bit.ly/1rlmYvF .
>
> @nazik_huq
>
> On Sun, Oct 19, 2014 at 2:51 AM, Anurag Sharma  wrote:
>
> > Here is the issue am facing issue in using the 'solr' script on Windows
> > with cygwin terminal:
> >
> > $ bin/solr -e cloud
> > bin/solr: line 16: $'\r': command not found
> > bin/solr: line 17: $'\r': command not found
> > bin/solr: line 46: $'\r': command not found
> > which: no lsof in
> >
> >
> (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program
> > Files/TortoiseSVN/bin:/cygdrive/c/Program
> > Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program
> > Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files
> > (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts)
> > bin/solr: line 52: $'\r': command not found
> > bin/solr: line 87: syntax error near unexpected token `"$HOME/.
> solr.in.sh
> > "'
> > 'in/solr: line 87: `   "$HOME/.solr.in.sh" \
> >
> >
> > further
> > $ bin/solr start -cloud -d node1 -p 8983
> > bin/solr: line 16: $'\r': command not found
> > bin/solr: line 17: $'\r': command not found
> > bin/solr: line 46: $'\r': command not found
> > which: no lsof in
> >
> >
> (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program
> > Files/TortoiseSVN/bin:/cygdrive/c/Program
> > Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program
> > Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files
> > (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts)
> > bin/solr: line 52: $'\r': command not found
> > bin/solr: line 87: syntax error near unexpected token `"$HOME/.
> solr.in.sh
> > "'
> > 'in/solr: line 87: `   "$HOME/.solr.in.sh" \
> >
> > Is there any other way I can run the SolrCloud using "java -jar
> start.jar"
> > options?
> >
>


Re: issue in launching SolrCloud windows/cygwin

2014-10-19 Thread Anurag Sharma
Hello Jurgen,

Thanks a lot for yoru prompt response.

It solved the CRLF problem but the script is not supported on cygwin due to
severe limitations and lack of adherence to BASH standards, such as lack of
lsof, curl, and ps options.

I found there is a native solr.cmd script for windows which works without
any issue on windows shell. This solves the problem for now.

Regards,
Anurag



On Sun, Oct 19, 2014 at 12:39 PM, "Jürgen Wagner (DVT)" <
juergen.wag...@devoteam.com> wrote:

>  Hello Anurag,
>   the CRLF problem with Cygwin can be cured by running the scripts all
> through this filter:
>
> tr -d '\r' < $script > $script.new ; mv $script.new $script
>
> with $script holding the path of the script to be massaged.
>
> Generally, however, I would advise to use the standard scripts only for
> testing or demonstration purposes as you're very likely to have to change
> parameters or settings for your production environment, anyway. Using the
> latest Jetty is one such example.
>
> Best regards,
> --Jürgen
>
>
> On 19.10.2014 08:51, Anurag Sharma wrote:
>
> Here is the issue am facing issue in using the 'solr' script on Windows
> with cygwin terminal:
>
> $ bin/solr -e cloud
> bin/solr: line 16: $'\r': command not found
> bin/solr: line 17: $'\r': command not found
> bin/solr: line 46: $'\r': command not found
> which: no lsof in
> (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program
> Files/TortoiseSVN/bin:/cygdrive/c/Program
> Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program
> Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files
> (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts)
> bin/solr: line 52: $'\r': command not found
> bin/solr: line 87: syntax error near unexpected token `"$HOME/.solr.in.sh"'
> 'in/solr: line 87: `   "$HOME/.solr.in.sh" \
>
>
> further
> $ bin/solr start -cloud -d node1 -p 8983
> bin/solr: line 16: $'\r': command not found
> bin/solr: line 17: $'\r': command not found
> bin/solr: line 46: $'\r': command not found
> which: no lsof in
> (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program
> Files/TortoiseSVN/bin:/cygdrive/c/Program
> Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program
> Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files
> (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts)
> bin/solr: line 52: $'\r': command not found
> bin/solr: line 87: syntax error near unexpected token `"$HOME/.solr.in.sh"'
> 'in/solr: line 87: `   "$HOME/.solr.in.sh" \
>
> Is there any other way I can run the SolrCloud using "java -jar start.jar"
> options?
>
>
>
>
> --
>
> Mit freundlichen Grüßen/Kind regards/Cordialement vôtre/Atentamente/С
> уважением
> *i.A. Jürgen Wagner*
> Head of Competence Center "Intelligence"
> & Senior Cloud Consultant
>
> Devoteam GmbH, Industriestr. 3, 70565 Stuttgart, Germany
> Phone: +49 6151 868-8725, Fax: +49 711 13353-53, Mobile: +49 171 864 1543
> E-Mail: juergen.wag...@devoteam.com, URL: www.devoteam.de
> --
> Managing Board: Jürgen Hatzipantelis (CEO)
> Address of Record: 64331 Weiterstadt, Germany; Commercial Register:
> Amtsgericht Darmstadt HRB 6450; Tax Number: DE 172 993 071
>
>
>


issue in launching SolrCloud windows/cygwin

2014-10-18 Thread Anurag Sharma
Here is the issue am facing issue in using the 'solr' script on Windows
with cygwin terminal:

$ bin/solr -e cloud
bin/solr: line 16: $'\r': command not found
bin/solr: line 17: $'\r': command not found
bin/solr: line 46: $'\r': command not found
which: no lsof in
(/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program
Files/TortoiseSVN/bin:/cygdrive/c/Program
Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program
Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files
(x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts)
bin/solr: line 52: $'\r': command not found
bin/solr: line 87: syntax error near unexpected token `"$HOME/.solr.in.sh"'
'in/solr: line 87: `   "$HOME/.solr.in.sh" \


further
$ bin/solr start -cloud -d node1 -p 8983
bin/solr: line 16: $'\r': command not found
bin/solr: line 17: $'\r': command not found
bin/solr: line 46: $'\r': command not found
which: no lsof in
(/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program
Files/TortoiseSVN/bin:/cygdrive/c/Program
Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program
Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files
(x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts)
bin/solr: line 52: $'\r': command not found
bin/solr: line 87: syntax error near unexpected token `"$HOME/.solr.in.sh"'
'in/solr: line 87: `   "$HOME/.solr.in.sh" \

Is there any other way I can run the SolrCloud using "java -jar start.jar"
options?


Re: solr trunk update.. build issues

2014-10-14 Thread Anurag Sharma
I am able to launch solr example start.jar using: java –jar start.jar

The eclipse issue is also resolved now, looks like eclipse was taking time
to process all the files and was an intermittent issue. Now am able to run
the selected JUnits as well.

On Wed, Oct 15, 2014 at 1:06 AM, Anurag Sharma  wrote:

> Hi Shalin,
>
> Sorry about the typo, actually it's renaming the war file(
> \solr\dist\solr-6.0.0-SNAPSHOT.war) placed to
> \trunk\solr\example\webapps\solr.war as referred in last point of step7 in
> http://wiki.apache.org/solr/HowToCompileSolr
> I'll also refer and try
> https://cwiki.apache.org/confluence/display/solr/Running+Solr
>
> Regarding problem#2, on running "ant eclipse" at /trunk (top level
> directory for lucene & solr) and closing/opening the project removes all
> the problems in the project but eclipse is not able to show the modified
> file though it still exist. I need to explore more to find the root cause.
>
> Thanks for the quick response.
> Anurag
>
>
> On Wed, Oct 15, 2014 at 12:51 AM, Shalin Shekhar Mangar <
> shalinman...@gmail.com> wrote:
>
>> On Wed, Oct 15, 2014 at 12:38 AM, Anurag Sharma 
>> wrote:
>>
>> > Just wanted to check if anyone faced below issues and how they fixed:
>> >
>> > Solr launch issue
>> > ---
>> > From command line ant compile, ant dist gives BUILD SUCCESSFUL
>> > generating \solr\dist\solr-6.0.0-SNAPSHOT.war. After copying and
>> renaming
>> > the same file to example/start.jar on run shows below error
>> > $ java –jar start.jar
>> > Error: Could not find or load main class ▒jar
>> >
>> >
>> The start.jar contains the jetty bootstrap code. It is different from the
>> war file and you shouldn't rename it to start.jar. You can use "ant
>> example" from inside the solr directory to create a runnable example. You
>> can also run "ant example" followed by the using the bin scripts to start
>> Solr. See https://cwiki.apache.org/confluence/display/solr/Running+Solr
>>
>>
>> > Problems with eclipse project
>> > ---
>> > Also shows below problems in eclipse project:
>> > Description Resource Path Location Type
>> > Project 'trunk' is missing required library:
>> > 'solr/example/solr-webapp/webapp/WEB-INF/lib/protobuf-java-2.5.0.jar'
>> > trunk Build
>> > path Build Path Problem
>> > Project 'trunk' is missing required library:
>> >
>> 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-core-5.0.0-SNAPSHOT.jar'
>> > trunk Build path Build Path Problem
>> > Project 'trunk' is missing required library:
>> >
>> >
>> 'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet.ext.servlet-2.1.1.jar'
>> > trunk Build path Build Path Problem
>> > Project 'trunk' is missing required library:
>> > 'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet-2.1.1.jar'
>> trunk
>> > Build
>> > path Build Path Problem
>> > Project 'trunk' is missing required library:
>> > 'solr/example/solr-webapp/webapp/WEB-INF/lib/wstx-asl-3.2.7.jar' trunk
>> > Build
>> > path Build Path Problem
>> > Project 'trunk' is missing required library:
>> > 'solr/example/solr-webapp/webapp/WEB-INF/lib/zookeeper-3.4.6.jar' trunk
>> > Build
>> > path Build Path Problem
>> > Project 'trunk' is missing required library:
>> >
>> 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-solrj-5.0.0-SNAPSHOT.jar'
>> > trunk Build path Build Path Problem
>> > Project 'trunk' is missing required library:
>> > 'solr/example/solr-webapp/webapp/WEB-INF/lib/spatial4j-0.4.1.jar' trunk
>> > Build
>> > path Build Path Problem
>> > The project cannot be built until build path errors are resolved trunk
>> > Unknown Java Problem
>> > Project 'trunk' is missing required library:
>> >
>> >
>> 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-phonetic-5.0.0-SNAPSHOT.jar'
>> > trunk Build path Build Path Problem
>> > Project 'trunk' is missing required library:
>> >
>> >
>> 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-kuromoji-5.0.0-SNAPSHOT.jar'
>> > trunk Build path Build Path Problem
>> > Project 'trunk' is missing required libra

Re: solr trunk update.. build issues

2014-10-14 Thread Anurag Sharma
Hi Shalin,

Sorry about the typo, actually it's renaming the war file(
\solr\dist\solr-6.0.0-SNAPSHOT.war) placed to
\trunk\solr\example\webapps\solr.war as referred in last point of step7 in
http://wiki.apache.org/solr/HowToCompileSolr
I'll also refer and try
https://cwiki.apache.org/confluence/display/solr/Running+Solr

Regarding problem#2, on running "ant eclipse" at /trunk (top level
directory for lucene & solr) and closing/opening the project removes all
the problems in the project but eclipse is not able to show the modified
file though it still exist. I need to explore more to find the root cause.

Thanks for the quick response.
Anurag


On Wed, Oct 15, 2014 at 12:51 AM, Shalin Shekhar Mangar <
shalinman...@gmail.com> wrote:

> On Wed, Oct 15, 2014 at 12:38 AM, Anurag Sharma 
> wrote:
>
> > Just wanted to check if anyone faced below issues and how they fixed:
> >
> > Solr launch issue
> > ---
> > From command line ant compile, ant dist gives BUILD SUCCESSFUL
> > generating \solr\dist\solr-6.0.0-SNAPSHOT.war. After copying and renaming
> > the same file to example/start.jar on run shows below error
> > $ java –jar start.jar
> > Error: Could not find or load main class ▒jar
> >
> >
> The start.jar contains the jetty bootstrap code. It is different from the
> war file and you shouldn't rename it to start.jar. You can use "ant
> example" from inside the solr directory to create a runnable example. You
> can also run "ant example" followed by the using the bin scripts to start
> Solr. See https://cwiki.apache.org/confluence/display/solr/Running+Solr
>
>
> > Problems with eclipse project
> > ---
> > Also shows below problems in eclipse project:
> > Description Resource Path Location Type
> > Project 'trunk' is missing required library:
> > 'solr/example/solr-webapp/webapp/WEB-INF/lib/protobuf-java-2.5.0.jar'
> > trunk Build
> > path Build Path Problem
> > Project 'trunk' is missing required library:
> >
> 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-core-5.0.0-SNAPSHOT.jar'
> > trunk Build path Build Path Problem
> > Project 'trunk' is missing required library:
> >
> >
> 'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet.ext.servlet-2.1.1.jar'
> > trunk Build path Build Path Problem
> > Project 'trunk' is missing required library:
> > 'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet-2.1.1.jar' trunk
> > Build
> > path Build Path Problem
> > Project 'trunk' is missing required library:
> > 'solr/example/solr-webapp/webapp/WEB-INF/lib/wstx-asl-3.2.7.jar' trunk
> > Build
> > path Build Path Problem
> > Project 'trunk' is missing required library:
> > 'solr/example/solr-webapp/webapp/WEB-INF/lib/zookeeper-3.4.6.jar' trunk
> > Build
> > path Build Path Problem
> > Project 'trunk' is missing required library:
> >
> 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-solrj-5.0.0-SNAPSHOT.jar'
> > trunk Build path Build Path Problem
> > Project 'trunk' is missing required library:
> > 'solr/example/solr-webapp/webapp/WEB-INF/lib/spatial4j-0.4.1.jar' trunk
> > Build
> > path Build Path Problem
> > The project cannot be built until build path errors are resolved trunk
> > Unknown Java Problem
> > Project 'trunk' is missing required library:
> >
> >
> 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-phonetic-5.0.0-SNAPSHOT.jar'
> > trunk Build path Build Path Problem
> > Project 'trunk' is missing required library:
> >
> >
> 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-kuromoji-5.0.0-SNAPSHOT.jar'
> > trunk Build path Build Path Problem
> > Project 'trunk' is missing required library:
> >
> >
> 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-codecs-5.0.0-SNAPSHOT.jar'
> > trunk Build path Build Path Problem
> > Project 'trunk' is missing required library:
> >
> >
> 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-backward-codecs-5.0.0-SNAPSHOT.jar'
> > trunk Build path Build Path Problem
> > Project 'trunk' is missing required library:
> >
> >
> 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-expressions-5.0.0-SNAPSHOT.jar'
> > trunk Build path Build Path Problem
> > Project 'trunk' is missing required library:
> >
> 

solr trunk update.. build issues

2014-10-14 Thread Anurag Sharma
Just wanted to check if anyone faced below issues and how they fixed:

Solr launch issue
---
>From command line ant compile, ant dist gives BUILD SUCCESSFUL
generating \solr\dist\solr-6.0.0-SNAPSHOT.war. After copying and renaming
the same file to example/start.jar on run shows below error
$ java –jar start.jar
Error: Could not find or load main class ▒jar

Problems with eclipse project
---
Also shows below problems in eclipse project:
Description Resource Path Location Type
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/protobuf-java-2.5.0.jar'
trunk Build
path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-core-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet.ext.servlet-2.1.1.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet-2.1.1.jar' trunk Build
path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/wstx-asl-3.2.7.jar' trunk Build
path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/zookeeper-3.4.6.jar' trunk Build
path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-solrj-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/spatial4j-0.4.1.jar' trunk Build
path Build Path Problem
The project cannot be built until build path errors are resolved trunk
Unknown Java Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-phonetic-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-kuromoji-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-codecs-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-backward-codecs-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-expressions-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-core-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-highlighter-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-grouping-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-memory-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-join-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-queries-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-misc-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-spatial-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-queryparser-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/noggit-0.6.jar' trunk Build
path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-suggest-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/commons-fileupload-1.2.1.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/commons-io-2.3.jar' trunk Build
path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/commons-lang-2.6.jar' trunk Build
path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/concurrentlinkedhashmap-lru-

Re: import solr source to eclipse

2014-10-14 Thread Anurag Sharma
Another alternative is launch the jetty server from outside and attach it
remotely from eclipse.

java -Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=y,address=7666
-jar start.jar
The above command waits until the application attach succeed.


On Tue, Oct 14, 2014 at 12:56 PM, Rajani Maski 
wrote:

> Configure eclipse with Jetty plugin. Create a Solr folder under your
> Solr-Java-Project and Run the project [Run as] on Jetty Server.
>
> This blog[1] may help you to configure Solr within eclipse.
>
>
> [1]
> http://hokiesuns.blogspot.in/2010/01/setting-up-apache-solr-in-eclipse.html
>
> On Tue, Oct 14, 2014 at 12:06 PM, Ali Nazemian 
> wrote:
>
> > Thank you very much for your guides but how can I run solr server inside
> > eclipse?
> > Best regards.
> >
> > On Mon, Oct 13, 2014 at 8:02 PM, Rajani Maski 
> > wrote:
> >
> > > Hi,
> > >
> > > The best tutorial for setting up Solr[solr 4.7] in eclipse/intellij  is
> > > documented in Solr In Action book, Apendix A, *Working with the Solr
> > > codebase*
> > >
> > >
> > > On Mon, Oct 13, 2014 at 6:45 AM, Tomás Fernández Löbbe <
> > > tomasflo...@gmail.com> wrote:
> > >
> > > > The way I do this:
> > > > From a terminal:
> > > > svn checkout https://svn.apache.org/repos/asf/lucene/dev/trunk/
> > > > lucene-solr-trunk
> > > > cd lucene-solr-trunk
> > > > ant eclipse
> > > >
> > > > ... And then, from your Eclipse "import existing java project", and
> > > select
> > > > the directory where you placed lucene-solr-trunk
> > > >
> > > > On Sun, Oct 12, 2014 at 7:09 AM, Ali Nazemian  >
> > > > wrote:
> > > >
> > > > > Hi,
> > > > > I am going to import solr source code to eclipse for some
> development
> > > > > purpose. Unfortunately every tutorial that I found for this purpose
> > is
> > > > > outdated and did not work. So would you please give me some hint
> > about
> > > > how
> > > > > can I import solr source code to eclipse?
> > > > > Thank you very much.
> > > > >
> > > > > --
> > > > > A.Nazemian
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> > A.Nazemian
> >
>


Re: Using relative path for indexing in SOLR

2014-10-13 Thread Anurag Sharma
You can always give the relative path from your current working directory
like below:
~/solr/example/exampledocs$ java -jar post.jar ./../sourcepdf/*.pdf

This solves your issue?

On Mon, Oct 13, 2014 at 3:58 PM, bharath Raghavendran 
wrote:

> Hi ,
>
> I am currently using solr-4.9.0 to index my PDF's using the default
> post.jar , start.jar provided in the examples directory.
>
> However i would like to modify the indexed path from absolute location to
> relative path from the base folder.
>
> Example :
>
> Absolute Path : E:\myFolder\level1\level11\myfile.PDF
>
> Relative Path : level11/myfile.PDF
>
> Let me know if this is possible to implement.
>
> Thanks,
> Bharath
>


Re: import solr source to eclipse

2014-10-12 Thread Anurag Sharma
I recently tried to run eclipse in debug mode and followed
http://wiki.apache.org/solr/HowToConfigureEclipse. It worked for me.


On Sun, Oct 12, 2014 at 7:39 PM, Ali Nazemian  wrote:

> Hi,
> I am going to import solr source code to eclipse for some development
> purpose. Unfortunately every tutorial that I found for this purpose is
> outdated and did not work. So would you please give me some hint about how
> can I import solr source code to eclipse?
> Thank you very much.
>
> --
> A.Nazemian
>


Re: [ANN] Lucidworks Fusion 1.0.0

2014-10-06 Thread Anurag Sharma
Ok. Thanks for the clarification.

On Mon, Oct 6, 2014 at 12:54 AM, Garth Grimm <
garthgr...@averyranchconsulting.com> wrote:

> Well, the current release is only supported on Linux.  A Windows
> compatible release is planned for later this year.
>
> -Original Message-----
> From: Anurag Sharma [mailto:anura...@gmail.com]
> Sent: Sunday, October 05, 2014 12:23 PM
> To: solr-user@lucene.apache.org
> Subject: Re: [ANN] Lucidworks Fusion 1.0.0
>
> I downloaded fusion and tried to run it on windows 8 using cygwin. It's
> giving "Error: Unable to access jarfile
> /home/user1/fusion/jetty/home/start.jar". Also tried changing the
> permission of jar, .sh and all folder/subfolders in fusion to 777 but still
> getting the same error.
>
> Please share your experience if tried running fusion on windows 8 or
> facing the above issue on other port.
>
> Thanks
> Anurag
>
> On Mon, Sep 29, 2014 at 6:05 AM, Aman Tandon 
> wrote:
>
> > Hi,
> >
> > How we can see the demo for NLP?
> > On Sep 24, 2014 4:43 PM, "Grant Ingersoll"  wrote:
> >
> > > Hi Thomas,
> > >
> > > Thanks for the question, yes, I give a brief demo of it in action
> > > during my talk and we will have demos at our booth.  I will also
> > > give a demo during the Webinar, which will be recorded.  As others
> > > have said as well, you can simply download it and try yourself.
> > >
> > > Cheers,
> > > Grant
> > >
> > > On Sep 23, 2014, at 2:00 AM, Thomas Egense 
> > > wrote:
> > >
> > > > Hi Grant.
> > > > Will there be a Fusion demostration/presentation  at Lucene/Solr
> > > Revolution
> > > > DC? (Not listed in the program yet).
> > > >
> > > >
> > > > Thomas Egense
> > > >
> > > > On Mon, Sep 22, 2014 at 3:45 PM, Grant Ingersoll
> > > > 
> > > > wrote:
> > > >
> > > >> Hi All,
> > > >>
> > > >> We at Lucidworks are pleased to announce the release of
> > > >> Lucidworks
> > > Fusion
> > > >> 1.0.   Fusion is built to overlay on top of Solr (in fact, you can
> > > manage
> > > >> multiple Solr clusters -- think QA, staging and production -- all
> > > >> from
> > > our
> > > >> Admin).In other words, if you already have Solr, simply point
> > > Fusion at
> > > >> your instance and get all kinds of goodies like Banana (
> > > >> https://github.com/LucidWorks/Banana -- our port of Kibana to
> > > >> Solr +
> > a
> > > >> number of extensions that Kibana doesn't have), collaborative
> > filtering
> > > >> style recommendations (without the need for Hadoop or Mahout!), a
> > modern
> > > >> signal capture framework, analytics, NLP integration,
> > Boosting/Blocking
> > > and
> > > >> other relevance tools, flexible index and query time pipelines as
> > > >> well
> > > as a
> > > >> myriad of connectors ranging from Twitter to web crawling to
> > Sharepoint.
> > > >> The best part of all this?  It all leverages the infrastructure
> > > >> that
> > you
> > > >> know and love: Solr.  Want recommendations?  Deploy more Solr.
> > > >> Want
> > log
> > > >> analytics?  Deploy more Solr.  Want to track important system
> metrics?
> > > >> Deploy more Solr.
> > > >>
> > > >> Fusion represents our commitment as a company to continue to
> > contribute
> > > a
> > > >> large quantity of enhancements to the core of Solr while
> > > >> complementing
> > > and
> > > >> extending those capabilities with value adds that integrate a
> > > >> number
> > of
> > > 3rd
> > > >> party (e.g connectors) and home grown capabilities like an all
> > > >> new, responsive UI built in AngularJS.  Fusion is not a fork of
> > > >> Solr.  We
> > do
> > > not
> > > >> hide Solr in any way.  In fact, our goal is that your existing
> > > applications
> > > >> will work out of the box with Fusion, allowing you to take
> > > >> advantage
> > of
> > > new
> > > >> capabilities w/o overhauling your existing application.
> > > >>
> > > >> If you want to learn more, please feel free to join our technical
> > > webinar
> > > >> on October 2:
> > > http://lucidworks.com/blog/say-hello-to-lucidworks-fusion/.
> > > >> If you'd like to download: http://lucidworks.com/product/fusion/.
> > > >>
> > > >> Cheers,
> > > >> Grant Ingersoll
> > > >>
> > > >> 
> > > >> Grant Ingersoll | CTO
> > > >> gr...@lucidworks.com | @gsingers
> > > >> http://www.lucidworks.com
> > > >>
> > > >>
> > >
> > > 
> > > Grant Ingersoll | @gsingers
> > > http://www.lucidworks.com
> > >
> > >
> > >
> > >
> > >
> > >
> >
>


Re: [ANN] Lucidworks Fusion 1.0.0

2014-10-05 Thread Anurag Sharma
I downloaded fusion and tried to run it on windows 8 using cygwin. It's
giving "Error: Unable to access jarfile
/home/user1/fusion/jetty/home/start.jar". Also tried changing the
permission of jar, .sh and all folder/subfolders in fusion to 777 but still
getting the same error.

Please share your experience if tried running fusion on windows 8 or facing
the above issue on other port.

Thanks
Anurag

On Mon, Sep 29, 2014 at 6:05 AM, Aman Tandon 
wrote:

> Hi,
>
> How we can see the demo for NLP?
> On Sep 24, 2014 4:43 PM, "Grant Ingersoll"  wrote:
>
> > Hi Thomas,
> >
> > Thanks for the question, yes, I give a brief demo of it in action during
> > my talk and we will have demos at our booth.  I will also give a demo
> > during the Webinar, which will be recorded.  As others have said as well,
> > you can simply download it and try yourself.
> >
> > Cheers,
> > Grant
> >
> > On Sep 23, 2014, at 2:00 AM, Thomas Egense 
> > wrote:
> >
> > > Hi Grant.
> > > Will there be a Fusion demostration/presentation  at Lucene/Solr
> > Revolution
> > > DC? (Not listed in the program yet).
> > >
> > >
> > > Thomas Egense
> > >
> > > On Mon, Sep 22, 2014 at 3:45 PM, Grant Ingersoll 
> > > wrote:
> > >
> > >> Hi All,
> > >>
> > >> We at Lucidworks are pleased to announce the release of Lucidworks
> > Fusion
> > >> 1.0.   Fusion is built to overlay on top of Solr (in fact, you can
> > manage
> > >> multiple Solr clusters -- think QA, staging and production -- all from
> > our
> > >> Admin).In other words, if you already have Solr, simply point
> > Fusion at
> > >> your instance and get all kinds of goodies like Banana (
> > >> https://github.com/LucidWorks/Banana -- our port of Kibana to Solr +
> a
> > >> number of extensions that Kibana doesn't have), collaborative
> filtering
> > >> style recommendations (without the need for Hadoop or Mahout!), a
> modern
> > >> signal capture framework, analytics, NLP integration,
> Boosting/Blocking
> > and
> > >> other relevance tools, flexible index and query time pipelines as well
> > as a
> > >> myriad of connectors ranging from Twitter to web crawling to
> Sharepoint.
> > >> The best part of all this?  It all leverages the infrastructure that
> you
> > >> know and love: Solr.  Want recommendations?  Deploy more Solr.  Want
> log
> > >> analytics?  Deploy more Solr.  Want to track important system metrics?
> > >> Deploy more Solr.
> > >>
> > >> Fusion represents our commitment as a company to continue to
> contribute
> > a
> > >> large quantity of enhancements to the core of Solr while complementing
> > and
> > >> extending those capabilities with value adds that integrate a number
> of
> > 3rd
> > >> party (e.g connectors) and home grown capabilities like an all new,
> > >> responsive UI built in AngularJS.  Fusion is not a fork of Solr.  We
> do
> > not
> > >> hide Solr in any way.  In fact, our goal is that your existing
> > applications
> > >> will work out of the box with Fusion, allowing you to take advantage
> of
> > new
> > >> capabilities w/o overhauling your existing application.
> > >>
> > >> If you want to learn more, please feel free to join our technical
> > webinar
> > >> on October 2:
> > http://lucidworks.com/blog/say-hello-to-lucidworks-fusion/.
> > >> If you'd like to download: http://lucidworks.com/product/fusion/.
> > >>
> > >> Cheers,
> > >> Grant Ingersoll
> > >>
> > >> 
> > >> Grant Ingersoll | CTO
> > >> gr...@lucidworks.com | @gsingers
> > >> http://www.lucidworks.com
> > >>
> > >>
> >
> > 
> > Grant Ingersoll | @gsingers
> > http://www.lucidworks.com
> >
> >
> >
> >
> >
> >
>


demo app explaining solr features

2014-09-27 Thread Anurag Sharma
I am wondering if there is any demo app that can demonstrate all the
features/capabilities of solr. My intention is to understand, use and play
around all the features supported by solr.

Also looking to explore how solr fits with NLP (like open-nlp), different
datastores (like cassandra, mongodb, arangoDB, couchDB), ML engines(mahout,
prediction.io etc) and caching servers (redis, memcache).

Thanks
Anurag


applicability of schema on document

2014-09-27 Thread Anurag Sharma
I am trying to understand how the schema and it's field types gets applied
to a document. Is it based on a document Id e.g. how to specify solr to
store fields like age as integer, dateofbirth as date but not as a string
or vice versa. Also, is it possible to change the field type at runtime?

Direct update using below command adds the values even when the id doesn't
exist:
curl http://localhost:8983/solr/update\?commit\=true -H
'Content-type:application/json' -d '[{"dob": {"add":
["2014-02-12T12:00:00Z", "2014-07-16T12:00:00Z"]}, "id": }]'
My doubts in the above scenario are:

   - Is it taking some default types based on parsed values?
   - Is it also possible to store multiple types in a single field?
   - What are the rules for schema less doc

Above scenario is tried using solr.war in example/webapps Following are
multiple schema files in example directory
./example/example-DIH/solr/db/conf/schema.xml
./example/example-DIH/solr/mail/conf/schema.xml
./example/example-DIH/solr/rss/conf/schema.xml
./example/example-DIH/solr/solr/conf/schema.xml
./example/example-DIH/solr/tika/conf/schema.xml
./example/example-schemaless/solr/collection1/conf/schema.xml
./example/multicore/core0/conf/schema.xml
./example/multicore/core1/conf/schema.xml
./example/solr/collection1/conf/schema.xml


Any documentation or unit tests describing the flow, creating and using the
schema will be helpful.

Thanks
Anurag


Re: running solr in debug through eclipse

2014-09-21 Thread Anurag Sharma
Hey Eric,

It works like charm :).
Thanks a lot for pin pointing the issue. My bad I was using the suspend=y
option blindly.

Thanks again,
Anurag

On Sun, Sep 21, 2014 at 10:03 PM, Erick Erickson 
wrote:

> It's doing exactly what you tell it to:
>
> java -Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=y,address=7666
> -jar start.jar
>
> Specifically suspend=y' means it will sit there, very patiently, until
> you connect to it with a debugger and tell it to go. This is _very_
> useful to debug initialization errors, but can sometimes be a bit
> puzzling.
>
> I'd recommend you actually attach with the debugger (i.e. a "remote"
> session). In IntelliJ, (I'm sure there are analogous ways in Eclipse),
> you create, quite literally, a "remote session" that you give the URL
> of the server you started above and the port. You start your server as
> above and then start your remote session in your IDE and you'll be in
> the debugger, attached to the running Solr instance. You can set
> breakpoints or just hit the "go" button and the server should start
> up. My setup usually just has "localhost" and 7666 for the URL/port.
>
> You do not have to attach a debugger first, just specify 'suspend=n'
> instead. But starting with 'suspend=y' insures you have actually
> attached to the server and have all the parts in place.
>
> Best,
> Erick
>
> On Sun, Sep 21, 2014 at 3:51 AM, Anurag Sharma  wrote:
> > Hi All,
> >
> > Thanks a lot for your suggestions. Shalin, your direction quickly took me
> > to the issue, it was very insightful and helpful.
> > Finally am able to understand the issue I was working on and run
> particular
> > unit test class AtomicUpdatesTest around it.
> >
> > On running the Solr in debug mode, I am still not able to start solr in
> > debug mode using:
> > java -Xdebug
> -Xrunjdwp:transport=dt_socket,server=y,suspend=y,address=7666
> > -jar start.jar
> > (Ref: http://wiki.apache.org/solr/HowToConfigureEclipse)
> > The command wait for hours and the server never comes up on windows
> without
> > giving any error/info message.
> >
> > Please suggest if someone faced this issue. I tried restarting windows,
> > ensured no process running on 7666 port. In previous trials to start, I
> > used to get msg "Debugger failed to attach: handshake failed - received
> >>GET /solr/ HTT< - expect" but it stopped coming now.
> >
> > Thanks
> > Anurag
> >
> >
> >
> >
> > On Fri, Sep 19, 2014 at 8:21 PM, Erick Erickson  >
> > wrote:
> >
> >> Yeah, it's usually pretty daunting to know where to start, the
> >> codebase is kinda big. Even "start from junit test" is often daunting,
> >> there are a lot of them too.
> >>
> >> Others have given you good places to start, good luck!
> >>
> >> Erick
> >>
> >> On Fri, Sep 19, 2014 at 12:23 AM, Bernd Fehling
> >>  wrote:
> >> > Just start at the UpdateHandler and follow it down the line.
> >> >
> >> > I would start at org/apache/solr/update/UpdateHandler.java
> >> >
> >> > If you already know if it is add, delete or update then start with
> >> > AddUpdateCommand.java, DeleteUpdateCommand.java or UpdateCommand.java.
> >> >
> >> > Just follow the red line :-)
> >> >
> >> > Regards
> >> > Bernd
> >> >
> >> >
> >> > Am 19.09.2014 um 08:47 schrieb Anurag Sharma:
> >> >> Thanks Bernd for your insight.
> >> >> As of now, I am focussing to fix the issue in the updater but not
> able
> >> to
> >> >> localize which code to look in for it.
> >> >>
> >> >> Regards,
> >> >> Anurag
> >> >>
> >> >> On Fri, Sep 19, 2014 at 12:09 PM, Bernd Fehling <
> >> >> bernd.fehl...@uni-bielefeld.de> wrote:
> >> >>
> >> >>> It depends on what you are going to do.
> >> >>>
> >> >>> If you are adding/modifying code and Junit tests use Junit test
> cases.
> >> >>> If you are debugging runtime problems under load use remote
> debugging.
> >> >>> If you are going for in deep debugging (even into Jetty and Java)
> use
> >> >>> RunJettyRun for Eclipse.
> >> >>>
> >> >>> Regards
> >> >>> Bernd
> >> >>>
> >> >>>
> >> >>> Am 18.09.2014 um 20:50 schrieb Anurag Sharma:
> >> >>>> Dear Solr users,
> >> >>>>
> >> >>>> I am new to Solr dev community and trying to setup eclipse to
> debug a
> >> >>>> running solr server. Please suggest if anyone of you have tried
> doing
> >> the
> >> >>>> same.
> >> >>>>
> >> >>>> Once above is done. Also suggest the entry point in code where
> >> breakpoint
> >> >>>> can be placed.
> >> >>>>
> >> >>>> Thanks
> >> >>>> Anurag
> >> >>>>
> >> >>>
> >> >>>
> >> >>
> >>
>


Re: running solr in debug through eclipse

2014-09-21 Thread Anurag Sharma
Hi All,

Thanks a lot for your suggestions. Shalin, your direction quickly took me
to the issue, it was very insightful and helpful.
Finally am able to understand the issue I was working on and run particular
unit test class AtomicUpdatesTest around it.

On running the Solr in debug mode, I am still not able to start solr in
debug mode using:
java -Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=y,address=7666
-jar start.jar
(Ref: http://wiki.apache.org/solr/HowToConfigureEclipse)
The command wait for hours and the server never comes up on windows without
giving any error/info message.

Please suggest if someone faced this issue. I tried restarting windows,
ensured no process running on 7666 port. In previous trials to start, I
used to get msg "Debugger failed to attach: handshake failed - received
>GET /solr/ HTT< - expect" but it stopped coming now.

Thanks
Anurag




On Fri, Sep 19, 2014 at 8:21 PM, Erick Erickson 
wrote:

> Yeah, it's usually pretty daunting to know where to start, the
> codebase is kinda big. Even "start from junit test" is often daunting,
> there are a lot of them too.
>
> Others have given you good places to start, good luck!
>
> Erick
>
> On Fri, Sep 19, 2014 at 12:23 AM, Bernd Fehling
>  wrote:
> > Just start at the UpdateHandler and follow it down the line.
> >
> > I would start at org/apache/solr/update/UpdateHandler.java
> >
> > If you already know if it is add, delete or update then start with
> > AddUpdateCommand.java, DeleteUpdateCommand.java or UpdateCommand.java.
> >
> > Just follow the red line :-)
> >
> > Regards
> > Bernd
> >
> >
> > Am 19.09.2014 um 08:47 schrieb Anurag Sharma:
> >> Thanks Bernd for your insight.
> >> As of now, I am focussing to fix the issue in the updater but not able
> to
> >> localize which code to look in for it.
> >>
> >> Regards,
> >> Anurag
> >>
> >> On Fri, Sep 19, 2014 at 12:09 PM, Bernd Fehling <
> >> bernd.fehl...@uni-bielefeld.de> wrote:
> >>
> >>> It depends on what you are going to do.
> >>>
> >>> If you are adding/modifying code and Junit tests use Junit test cases.
> >>> If you are debugging runtime problems under load use remote debugging.
> >>> If you are going for in deep debugging (even into Jetty and Java) use
> >>> RunJettyRun for Eclipse.
> >>>
> >>> Regards
> >>> Bernd
> >>>
> >>>
> >>> Am 18.09.2014 um 20:50 schrieb Anurag Sharma:
> >>>> Dear Solr users,
> >>>>
> >>>> I am new to Solr dev community and trying to setup eclipse to debug a
> >>>> running solr server. Please suggest if anyone of you have tried doing
> the
> >>>> same.
> >>>>
> >>>> Once above is done. Also suggest the entry point in code where
> breakpoint
> >>>> can be placed.
> >>>>
> >>>> Thanks
> >>>> Anurag
> >>>>
> >>>
> >>>
> >>
>


Re: running solr in debug through eclipse

2014-09-18 Thread Anurag Sharma
Thanks Bernd for your insight.
As of now, I am focussing to fix the issue in the updater but not able to
localize which code to look in for it.

Regards,
Anurag

On Fri, Sep 19, 2014 at 12:09 PM, Bernd Fehling <
bernd.fehl...@uni-bielefeld.de> wrote:

> It depends on what you are going to do.
>
> If you are adding/modifying code and Junit tests use Junit test cases.
> If you are debugging runtime problems under load use remote debugging.
> If you are going for in deep debugging (even into Jetty and Java) use
> RunJettyRun for Eclipse.
>
> Regards
> Bernd
>
>
> Am 18.09.2014 um 20:50 schrieb Anurag Sharma:
> > Dear Solr users,
> >
> > I am new to Solr dev community and trying to setup eclipse to debug a
> > running solr server. Please suggest if anyone of you have tried doing the
> > same.
> >
> > Once above is done. Also suggest the entry point in code where breakpoint
> > can be placed.
> >
> > Thanks
> > Anurag
> >
>
>


Re: running solr in debug through eclipse

2014-09-18 Thread Anurag Sharma
Hi Erick,

Thanks a lot for your response.

I am trying to fix the issue:
https://issues.apache.org/jira/browse/SOLR-6307. I guess this require
change in the 'update' component. Am not able to locate the code for
'update' component nor the testcases.

To understand the code base I think I may need to go through both the #1 &
#2 approaches.

Regards,
Anurag


On Fri, Sep 19, 2014 at 8:38 AM, Erick Erickson 
wrote:

> There are two approaches that work:
> 1> (preferred IMO) is to debug through the Junit test cases. It's far
> easier than remote debugging usually, with quicker turnaround times.
>
> 2> Set up remote debugging, see:
> http://wiki.apache.org/solr/HowToConfigureEclipse which is linked from
> the "how to contribute" page here:
> http://wiki.apache.org/solr/HowToContribute#Eclipse
>
> As to where to set your first breakpoint, I have no clue. You haven't
> told us a thing about what you're trying to accomplish, so "somewhere
> in the code" is about the best I can say ;).
>
> Best
> Erick
>
> On Thu, Sep 18, 2014 at 11:50 AM, Anurag Sharma 
> wrote:
> > Dear Solr users,
> >
> > I am new to Solr dev community and trying to setup eclipse to debug a
> > running solr server. Please suggest if anyone of you have tried doing the
> > same.
> >
> > Once above is done. Also suggest the entry point in code where breakpoint
> > can be placed.
> >
> > Thanks
> > Anurag
>


running solr in debug through eclipse

2014-09-18 Thread Anurag Sharma
Dear Solr users,

I am new to Solr dev community and trying to setup eclipse to debug a
running solr server. Please suggest if anyone of you have tried doing the
same.

Once above is done. Also suggest the entry point in code where breakpoint
can be placed.

Thanks
Anurag