Re: ConcurrentUpdateSolrClient - notify on success/failure?

2019-01-01 Thread deniz
thanks a lot for the explanation :) - Zeki ama calismiyor... Calissa yapar... -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

ConcurrentUpdateSolrClient - notify on success/failure?

2018-12-27 Thread deniz
I am trying to figure out if i can log anything or fire some events for other listeners (like a jee event and so on) once ConcurrentUpdateSolrClient sends the updates to the Solr (i.e internal queue is emptied and the request is made with the all of the data to Solr itself) from java code... I am

Re: Trying to retrieve two values from two different collections by sql (V 7.2.1)

2018-10-16 Thread deniz
found out sth strange regarding this case. If i change one of the values into sth else, and the field names are not the same any more, then i can get the different values so the initial query was select *collection1.id* as collection1id, collection2.id as collection2id from collection1 join

Trying to retrieve two values from two different collections by sql (V 7.2.1)

2018-10-16 Thread deniz
I am trying to run a query like below to query against two different collections: select collection1.id as collection1id, collection2.id as collection2id from collection1 join collection2 on collection1.name = collection2.name where collection1.name = 'dummyname'; And as a result, I am only

Re: SQL Query with NOT (V 7.2.1)

2018-10-16 Thread deniz
okay, found a work around for string fields for NOT queries This query does not filters for NOT: curl --data-urlencode "stmt=select id, name from collection where NOT (name = 'defaultmail')" 'http://server:port/solr/collection/sql' but after adding sth trivial i.e id > 0 o the where clause as

Re: SQL Query with NOT (V 7.2.1)

2018-10-16 Thread deniz
using integers in where clause with NOT is the same, though for that one using <> as workaround does the job - Zeki ama calismiyor... Calissa yapar... -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: SQL Query with NOT (V 7.2.1)

2018-10-16 Thread deniz
with curl the result is the same: curl --data-urlencode "stmt=select id, name from collection where NOT (name = 'defaultmail')" 'http://server:port/solr/collection/sql' then the response is . . . { "id":113, "name":"defaultmail"} ,{ "id":109,

SQL Query with NOT (V 7.2.1)

2018-10-15 Thread deniz
I have been trying to get sql queries running, but having trouble while dealing with the NOT queries. Basically, the code looks like below SolrQuery sqlQuery = new SolrQuery(); sqlQuery.setRequestHandler("/sql"); sqlQuery.set("stmt","select collection1.id as collection_1_id, collection1.email

Re: Metrics API via Solrj

2018-10-03 Thread deniz
Thanks a lot Jason and Shawn, it is quite smooth although there is no built in stuff like collection or schema request objects for metrics :) - Zeki ama calismiyor... Calissa yapar... -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Metrics API via Solrj

2018-10-03 Thread deniz
Are there anyway to get the metrics via solrj ? all of the examples seem like using plain curl or http reqs with json response. I have found org.apache.solr.client.solrj.io.stream.metrics package, but couldnt figure out how to send the requests via solrj... could anyone help me to figure out how

Concurrent Update Client Stops on Exceptions Randomly v7.4

2018-09-06 Thread deniz
I am trying to write a wrapper for DIH, so i can leverage the field type guessing while importing the sql data. the query is supposed to retrieve 400K+ documents. in the test data in db, there are dirty date fields, which has data like '1966-00-00' or '1987-10-00' as well. I am running the

Re: Null Pointer Exception without details on Update in schemaless 7.4

2018-09-05 Thread deniz
server is also 7.4 and your assumption/check on null values on input doc seems legit... I have added some checks before pushing the doc to solr and replaced null values with some default values, and updates seem going through w/o problem... though having a little bit explanatory logs on server

Re: Null Pointer Exception without details on Update in schemaless 7.4

2018-09-05 Thread deniz
nope, the data i am pushing is stuff like string, int, etc etc i have have checked further and made bunch of trial and error, here are the things I was able to figure out: - If a date value from database is null, then it is breaking the update with "-00-00" is not a valid date string error.

Null Pointer Exception without details on Update in schemaless 7.4

2018-09-05 Thread deniz
I have set up a schemaless solr (cloud) and have been trying to test the updates. as DIH is not going through field guessing, I have wrote a small piece of code to query data from db and push the docs to solr... Once the client pushes the docs to solr, on server there are npe logs as below:

Re: Spatial Search based on the amount of docs, not the distance

2017-06-21 Thread deniz
it is for sure possible to use d value for limiting the distance, however, it might not be very efficient, as some of the coords may not have any docs around for a large value of d... so it is hard to determine a default value for d. though it sounds like havinga default d and gradual increments

Spatial Search based on the amount of docs, not the distance

2017-06-21 Thread deniz
I am trying to figure out if it is possible to have the spatial search limit itself based on the amount of docs rather than the distance... What I want is, sth like "closest XXX documents from point(x,y)" in dependent from "d" value in the query... would this need a custom plugin, or there are

Re: Interval Facets with JSON

2017-02-08 Thread deniz
Tom Evans-2 wrote > I don't think there is such a thing as an interval JSON facet. > Whereabouts in the documentation are you seeing an "interval" as JSON > facet type? > > > You want a range facet surely? > > One thing with range facets is that the gap is fixed size. You can > actually do your

Re: Interval Facets with JSON

2017-02-07 Thread deniz
I have taken a look at the class solr/core/src/test/org/apache/solr/search/facet/TestJsonFacets.java but it seems like there are no tests for interval facets on json... - Zeki ama calismiyor... Calissa yapar... -- View this message in context:

Interval Facets with JSON

2017-02-07 Thread deniz
Hello, I am trying to run JSON facets with on interval query as follows: "json.facet":{"height_facet":{"interval":{"field":"height","set":["[160,180]","[180,190]"]}}} And related field is But I keep seeing errors like: o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException:

Re: [Solr 5.1.0] - Ignoring Whitespaces as delimiters

2016-10-16 Thread deniz
thanks a lot... prepared one regex, which seems like doing what i am looking for :) - Zeki ama calismiyor... Calissa yapar... -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-5-1-0-Ignoring-Whitespaces-as-delimiters-tp4300939p4301344.html Sent from the Solr - User

[Solr 5.1.0] - Ignoring Whitespaces as delimiters

2016-10-12 Thread deniz
Hello, Are there any built-in tokenizers which will do sth like StandardTokenizer, but will not tokenize on whitespace? e.g field:abc cde-rfg will be tokenized as "abc cde" and "rfg", not "abc", "cde", "rfg" I have checked the existing tokenizers/analyzers and it seems like there is no other

Re: Solr 6 / Solrj RuntimeException: First tuple is not a metadata tuple

2016-05-09 Thread deniz
was able to get "gettingstarted" example running with sql, on my local only with a single zk... still not sure why the core/collection i have tried, didnt work till now... thanks a lot for pointing out for the version related issues, it made me change my focus from client to server side :)

Re: Solr 6 / Solrj RuntimeException: First tuple is not a metadata tuple

2016-05-08 Thread deniz
Joel Bernstein wrote > It appears that the /sql handler is not sending the metadata Tuple. > According to the log the parameter includeMetadata=true is being sent. > This > should trigger the sending of the metadata Tuple. > > Is it possible that you are using a pre 6.0 release version of Solr

Re: Solr 6 / Solrj RuntimeException: First tuple is not a metadata tuple

2016-05-06 Thread deniz
I went on digging and debug the code and here is what I got on the point it breaks: so basically the tuple doesnt have anything for "isMetadata" hence getting null on that point... is this a bug or there is missing configs on

Re: Solr 6 / Solrj RuntimeException: First tuple is not a metadata tuple

2016-05-05 Thread deniz
Joel Bernstein wrote >> Can you post your classpath? classpath as follows: solr-solrj-6.0.0 commons-io-2.4 httpclient-4.4.1 httpcore-4.4.1 httpmime-4.4.1 zookeeper-3.4.6 stax2-api-3.1.4 woodstox-core-asl-4.4.1 noggit-0.6 jcl-over-slf4j-1.7.7 slf4j-api-1.7.7 - Zeki ama calismiyor...

Re: Solr 6 / Solrj RuntimeException: First tuple is not a metadata tuple

2016-05-05 Thread deniz
Also found // JDBC requires metadata like field names from the SQLHandler. Force this property to be true. props.setProperty("includeMetadata", "true"); in org.apache.solr.client.solrj.io.sql.DriverImpl are there any other ways to get response on solrj without metaData to avoid the

Re: Solr 6 / Solrj RuntimeException: First tuple is not a metadata tuple

2016-05-05 Thread deniz
could it be something with includeMetaData=true param? I have tried to set it to false but then the logs look like: webapp=/solr path=/sql params={includeMetadata=true=false=1=json=2.2=select+id,+text+from+test+where+tits%3D1+limit+5=map_reduce} status=0 QTime=3 - Zeki ama calismiyor...

Re: Solr 6 / Solrj RuntimeException: First tuple is not a metadata tuple

2016-05-05 Thread deniz
> The logs you shared don't seem to be the full logs. There will be a > related > exception on the Solr server side. The exception on the Solr server side > will explain the cause of the problem. The logs are the full logs which I got on the console when I run the code, and there is no exception

Solr 6 / Solrj RuntimeException: First tuple is not a metadata tuple

2016-05-04 Thread deniz
QTime=1 The error is happening because of some missing handlers on errors on the code or because of some strict checks on IDE(Ideaj)? Anyone had similar issues while using sql with solrj? Thanks Deniz - Zeki ama calismiyor... Calissa yapar... -- View this message in context: http://luc

Export request handler via SolrJ

2016-02-01 Thread deniz
I have been trying to export the whole resultset via SolrJ but till now everything (Including the tricks here: http://stackoverflow.com/questions/33540577/how-can-use-the-export-request-handler-via-solrj) has failed... On curl, it is working totally fine to query with server:port/solr/core/export

Re: Core mismatch in org.apache.solr.update.StreamingSolrClients Errors for ConcurrentUpdateSolrClient

2015-08-11 Thread deniz
okay, to make everything clear, here are the steps: - Creating configs etc and then running: ./zkcli.sh -cmd upconfig -n CoreA -d /path/to/core/configs/CoreA/conf/ -z zk1:2181,zk2:2182,zk3:2183 - Then going to http://someserver:8983/solr/#/~cores - Clicking Add Core:

Re: Core mismatch in org.apache.solr.update.StreamingSolrClients Errors for ConcurrentUpdateSolrClient

2015-08-11 Thread deniz
thanks for the details Anshum :) I got one more question, could this kind of error logging might be also triggered by the amount of incoming requests? I can see these errors only on prod env, but testing env is totally fine, although the creation process is exactly the same - Zeki ama

Re: Core mismatch in org.apache.solr.update.StreamingSolrClients Errors for ConcurrentUpdateSolrClient

2015-08-11 Thread deniz
this is also normal? Anshum Gupta wrote Hi Deniz, Seems like the update that's being forwarded from a non-leader (original node that received the request) is failing. This could be due to multiple reasons, including issue with your schema vs document that you sent. To elaborate more

Re: Core mismatch in org.apache.solr.update.StreamingSolrClients Errors for ConcurrentUpdateSolrClient

2015-08-11 Thread deniz
I have created by simply creating configs and then using upconfig to upload to zookeeper, then adding it on admin interface of solr. I have only changed the ips of server and server1 and changed the core/collection names to CoreA and CoreB, in the logs CoreA and CoreB are different collections

Core mismatch in org.apache.solr.update.StreamingSolrClients Errors for ConcurrentUpdateSolrClient

2015-08-10 Thread deniz
I have a simple 2-node(5.1) cloud env with 6 different cores. One of the cores(CoreB) has some update issue which I am aware of, but the error logs on solr, I am seeing these below: ERROR - 2015-08-11 05:04:34.592; [*CoreA shard1 core_node2 CoreA*] org.apache.solr.update.StreamingSolrClients$1;

Re: stats component performance

2015-06-09 Thread deniz
would be really nice if there are any... i am also looking for some detailed explanation about the stats on solr, couldnt find anything yet though... - Zeki ama calismiyor... Calissa yapar... -- View this message in context:

Re: zk disconnects and failure to retry?

2015-01-22 Thread deniz
bumping an old entry... but are there any improvements on this issue? - Zeki ama calismiyor... Calissa yapar... -- View this message in context: http://lucene.472066.n3.nabble.com/zk-disconnects-and-failure-to-retry-tp4065877p4181370.html Sent from the Solr - User mailing list archive at

Using tmpfs for Solr index

2015-01-22 Thread deniz
Would it boost any performance in case the index has been switched from RAMDirectoryFactory to use tmpfs? Or it would simply do the same thing like MMap? And in case it would be better to use tmpfs rather than RAMDirectory or MMap, which directory factory would be the most feasible one for this

Re: Grouping based on multiple filters/criterias

2014-08-24 Thread deniz
umeshprasad wrote Solr does support date mathematics in filters / queries . So your timestamps intervals can be dynamic .. how would it be done for this case then? retrieving bunch of documents sorted by timestamp, then depending on some interval like 1 hour, those should be grouped all

Re: Grouping based on multiple filters/criterias

2014-08-21 Thread deniz
umeshprasad wrote Grouping supports group by queries. https://cwiki.apache.org/confluence/display/solr/Result+Grouping However you will need to form the group queries before hand. Thanks Regards Umesh Prasad Search Lead@ in.linkedin.com/pub/umesh-prasad/6/5bb/580/ have seen

Grouping based on multiple filters/criterias

2014-08-18 Thread deniz
appear different than other posts, as it would be a combined view of the posts... i.e deniz activity one activity two . activity eight /deniz other user 1 single activity /other user 1 another user 1 single

Retrieving and updating large set of documents on Solr 4.7.2

2014-08-17 Thread deniz
0 down vote favorite I am trying to implement an activity feed for a website, and planning to use Solr for this case. As it does not have any follower/following relation, Solr is fitting for the requirements. There is one point which makes me concerned about performance. So as user A,

Solr 4.7.2 Core Creation Issue on SC - ZK

2014-05-19 Thread deniz
Hello, I am using SC with version 4.7.2. There is already one collection/core running on the cloud, and I am trying to add a new core according to https://wiki.apache.org/solr/CoreAdmin#CREATE When I add the core, I can see that it is added to collections in Cloud/file menu, but the config part

Re: Searching with special chars

2014-03-03 Thread deniz
So as there was no quick work around to this issue, we simply change the http method from get to post, to avoid further problems which could be triggered by user input too. though this violates the restful standards... at least we have something running properly - Zeki ama calismiyor...

Searching with special chars

2014-02-26 Thread deniz
Hello, We are facing some kinda weird problem. So here is the scenario: We have a frontend and a middle-ware which is dealing with user input search queries before posting to Solr. So when a user enters city:Frankenthal_(Pfalz) and then searches, there is no result although there are fields on

Re: how to avoid recover? how to ensure a recover success?

2013-10-28 Thread deniz
I have had a similar problem before but the patch which was included with the version 4.1 fixed that... I couldnt reproduce the problem with the patch... anyone is able to reproduce this exception? - Zeki ama calismiyor... Calissa yapar... -- View this message in context:

Field with default value and stored=false, will be reset back to the default value in case of updating other fields

2013-10-09 Thread deniz
hi all, I have encountered some problems and post it on stackoverflow here: http://stackoverflow.com/questions/19285251/solr-field-with-default-value-resets-itself-if-it-is-stored-false as you can see from the response, does it make sense to open a bug ticket for this? because, although i can

Re: Field with default value and stored=false, will be reset back to the default value in case of updating other fields

2013-10-09 Thread deniz
Billnbell wrote You have to update the whole record including all fields... so what is the point of having atomic updates if i need to update everything? - Zeki ama calismiyor... Calissa yapar... -- View this message in context:

Full Import and Most up to date data

2013-08-01 Thread deniz
Hello, I have some questions about full importing. So lets say that i have some kinda large data to index and it takes around 2 hours to finish the full import. When I start full import at 1pm, what happens if some data in db is updated at 1:15 or 2pm while full import is still going on? will

Re: Unexpected character '' (code 60) expected '='

2013-08-01 Thread deniz
Vineet Mishra wrote I am using Solr 3.5 with the posting XML file size of just 1Mb. On Wed, Jul 31, 2013 at 8:19 PM, Shawn Heisey lt; solr@ gt; wrote: On 7/31/2013 7:16 AM, Vineet Mishra wrote: I checked the File. . .nothing is there. I mean the formatting is correct, its a valid

DIH and tinyint(1) Field

2013-07-22 Thread deniz
Hello, I have exactly the same problem as here http://lucene.472066.n3.nabble.com/how-to-avoid-DataImportHandler-from-interpreting-quot-tinyint-1-unsigned-quot-value-as-quot-Boolean--td4035241.html#a4036967 however for the solution there, it is ruining my date type fields... are there any

Re: DIH and tinyint(1) Field

2013-07-22 Thread deniz
Shalin Shekhar Mangar wrote Your database's JDBC driver is interpreting the tinyint(1) as a boolean. Solr 4.4 fixes the problem affected date fields with convertType=true. It should be released by the end of this week. On Mon, Jul 22, 2013 at 12:18 PM, deniz lt; denizdurmus87@ gt

Re: Field exist in schema.xml but returns

2013-04-09 Thread deniz
Raymond Wiker wrote You have misspelt the tag name in the field definition... you have fiald instead of field. thank you Raymond, it was really hard to find it out in a massive schema file - Zeki ama calismiyor... Calissa yapar... -- View this message in context:

Field exist in schema.xml but returns

2013-04-08 Thread deniz
hi all, I am using solrcloud and running some simple test queries... though i am getting a undefined field error for a field that I have in my schema.xml so the query is myField:* and response is: response lst name=responseHeader int name=status400/int int name=QTime3/int lst

Analysing Solr Log Files

2013-01-08 Thread deniz
Hi All, i want to analyze the solr log file... the thing i want to do is, putting all the queries coming to the server to a log file, on a daily or hourly basis, and then running a tool to make analysis like most used field or queries, the queries which have hits and so on... are there any tools

Re: Analysing Solr Log Files

2013-01-08 Thread deniz
thank you Otis I have used sematext's trial version but it requires sending log files to another url(correct me if i am wrong :) ), but i need something which could run on local, something would be triggrered by cronjob or something could be integrated(somehow) with the admin interface -

How does fq skip score value?

2012-12-09 Thread deniz
Hello, I would like to know fq parameters doesnt deal with scoring so on,,, I have been digging the code, to see where it separates and executes fq parameters but couldnt find yet... anyone knows how does fq work to skip score information? - Zeki ama calismiyor... Calissa yapar... --

Re: ids parameter decides the result set and order, no matter what kind of query you enter

2012-12-05 Thread deniz
replying my own question. ids is used in responsebuilders some internal mapping structure which is used for sorting and reordering document list before it is shown to the end user... simply it stores unique field values from documents which are to be shown to the user, and each mapping of these

Solr Query Parameter : ids - What is this used for?

2012-12-03 Thread deniz
Hello, as it is clear in the title too, i wanna know for what solr uses this parameter... i see it on a sharding env on cloud, so i guess it is related with cloud but still there is no explanation about it in any of wiki pages that i have checked... can someone explain the usage and aim of this

Re: Solr Query Parameter : ids - What is this used for?

2012-12-03 Thread deniz
Yonik Seeley-4 wrote It's an internal implementation detail of distributed search - the second phase selects specific ids on each shard via the ids parameter. -Yonik http://lucidworks.com so i suppose it us unique field? or it depends on which field we are using for querying on shards?

Re: SolrCloud(5x) - Errors while recovering

2012-12-02 Thread deniz
Mark Miller-3 wrote FYI, I've fixed this 5x issue a few days ago. - Mark Yep, after the patch, it is not occuring anymore, thank you - Zeki ama calismiyor... Calissa yapar... -- View this message in context:

Re: SolrCloud - Sorting Problem

2012-12-02 Thread deniz
Chris Hostetter-3 wrote w/o more information about how/where you add this information, it's going to be really hard to give you suggestions on how to fix your problem. The modifications I made is nearly the same with score field. Basically I have added a PositionAugmenter class, modified

Re: SolrCloud - Sorting Problem

2012-12-02 Thread deniz
deniz wrote after these, I guess i need to check how the request is distributed on cloud... any ideas where I should start checking? as for replying my own question (hopefully correct) I have started digging org.apache.solr.handler.component.SearchHandler.handleRequestBody which loops (i

Re: SolrCloud - Sorting Problem

2012-12-02 Thread deniz
I think I have figured out this... at least some kinda.. After putting logs here there in the code, especially in SolrCore, HttpShardHandler, SearchHandler classes, it seems like sorting is done after all of the shards finish responding and then before we see the results the result set is

Re: Solr - Jetty Form Too Large Exception

2012-11-29 Thread deniz
Marcin Rzewucki wrote I think you should change/set value for multipartUploadLimitInKB attribute of requestParsers in solrconfig.xml the value for multiPartUploadLimit is shown as 2048000 in the config and in the error logs i see 20, related with jetty... I have changed some part in the

SolrCloud - Sorting Problem

2012-11-29 Thread deniz
Hello, I am having a weird problem with solrcloud and sorting, I will open a bug ticket about this too, but wondering if anyone had similar problems like mine Background: Basically, I have added a new feature to Solr after I got the source code. Similar to the we get score in the resultset, I am

Re: SolrCloud - Sorting Problem

2012-11-29 Thread deniz
After playing with this more, i think I have some clue... on the standalone solr, when i give start 11 and rows 20, i can see documents with positions ranging from 12 to 31, which is correct... on the cloud, when i give the same parameters, again i get the same documents, but this time position

RE: SolrCloud(5x) - Errors while recovering

2012-11-27 Thread deniz
Markus Jelsma-2 wrote Seems you got this issue: https://issues.apache.org/jira/browse/SOLR-4032 thank you for the heads up and a surprising thing about my error.. when i use smaller size of documents, i do not get any errors at all... I dont know why but I have just tried to index only

RE: SolrCloud(5x) - Errors while recovering

2012-11-27 Thread deniz
another update having 300K docs causes the same error... I think there is something going on with the size of the index stored... after some point replication fails... any ideas how to bypass this? - Zeki ama calismiyor... Calissa yapar... -- View this message in context:

RE: SolrCloud(5x) - Errors while recovering

2012-11-27 Thread deniz
i have that issue with some larger size of indexes only... 12 - 14K docs are working totally okay even after a node dies and then starts again but if index is bigger, somehow i keep getting the lines above - Zeki ama calismiyor... Calissa yapar... -- View this message in context:

Re: SolrCloud - Fails to read db config file

2012-11-26 Thread deniz
Marcin Rzewucki wrote Hi, It seems like the file is missing from Zookeeper. Can you confirm ? Regards. nope, i can see my db-config file on the admin interface of solr as well as zk client on command line, i dont think it is missing from zookeeper - Zeki ama calismiyor... Calissa

Re: SolrCloud - Fails to read db config file

2012-11-26 Thread deniz
okay, after changing it to db-config from the full path above, i am able to see dataimport page, but still data import is failing... i see this in the logs SEVERE: Full Import failed:org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to PropertyWriter

Re: SolrCloud - Fails to read db config file

2012-11-26 Thread deniz
Mark Miller-3 wrote It looks like your original path had a double / in it that was causing problems. my original path in the config file doesnt have any double quotes, but when it is on solrcloud, it adds additional slash to the path... i am not an zookeeper expert or something but could it be

Re: SolrCloud - Fails to read db config file

2012-11-26 Thread deniz
Mark Miller-3 wrote It looks like your original path had a double / in it that was causing problems. my original path in the config file doesnt have any double quotes, but when it is on solrcloud, it adds additional slash to the path... i am not an zookeeper expert or something but could it be

Re: SolrCloud - Fails to read db config file

2012-11-26 Thread deniz
Mark Miller-3 wrote It looks like your original path had a double / in it that was causing problems. my original path in the config file doesnt have any double quotes, but when it is on solrcloud, it adds additional slash to the path... i am not an zookeeper expert or something but could it be

SolrCloud(5x) - Errors while recovering

2012-11-26 Thread deniz
Here is briefly what is happening: I have a simple SolrCloud environment for test purposes, running with a zookeeper ensemble, not the ones embedded in Solr. I have 3 instances in the cloud, all of them are using RAMDirectory (which is enabled by new Solr release to use with cloud) After

SolrCloud Performance - Indexing

2012-11-26 Thread deniz
As I am some kinda confused, I wanna check if anyone else has same confusions like mine about solrcloud.. I have set up an environment with 3 solr instances and 2 zookeepers, amd tried to index some documents from mysql db. the total amount the docs are around 3.5M. before indexing i was

Re: Weird Behaviour on Solr 5x (SolrCloud)

2012-11-21 Thread deniz
Mark Miller-3 wrote I'm not sure - I guess I'll have to look into it - could you file a JIRA issue with these details? sure... but before that could it be because of using RAM dir? because basically when you restart solr the ram is gone and it tries to checks the old folder that it had used...

Re: SolrCloud(5x) - Detects all of the Solr insrances on a machine

2012-11-21 Thread deniz
after putting the port information to solr.xml too, it seems properly... i dont know why this thing only happens on remote machines not on local, but could this be a minor bug related with solr? basically if we are giving the port information in the starting command, then we shouldnt be dealing

SolrCloud(5x) - Detects all of the Solr insrances on a machine

2012-11-20 Thread deniz
Hello, I am running a Solr instance (4.0), without invoking anything about zookeeper and solrcloud, as a standalone server on a machine. then for testing Solr 5x trunk, i have set 2 Solr (5x) instances, running with -DzkHost= someaddress:port and when i check zookeeper logs, i can see that the

Re: SolrCloud(5x) - Detects all of the Solr insrances on a machine

2012-11-20 Thread deniz
well here are more details about my starting commands This is the standalone SolrServer: (port 8983) java -server -XX:+UnlockExperimentalVMOptions -XX:+UseG1GC -XX:+UseCompressedStrings -Dcom.sun.management.jmxremote -d64 -Xmx4096m -Dcom.sun.management.jmxremote.port=

Re: SolrCloud(5x) - Detects all of the Solr insrances on a machine

2012-11-20 Thread deniz
so another test result: i have set up a similar environment on another virtual machine which is running on the same hard machine with my previous example... so basically my standalone solr is running on virtual1:8983 and i set up 3 solr instances which are on virtual2:8995,8996,8997... those

Re: SolrCloud(5x) - Detects all of the Solr insrances on a machine

2012-11-20 Thread deniz
Mark Miller-3 wrote How are you specifying the port? I don't see jetty.port in there. That is critical - it sets the hostPort in solr.xml. - Mark setting it with -Djetty.port=blabla or directly in etc/jetty.xml - Zeki ama calismiyor... Calissa yapar... -- View this message in context:

Re: SolrCloud(5x) - Detects all of the Solr insrances on a machine

2012-11-20 Thread deniz
Mark Miller-3 wrote It must be passes with -D as a system prop with the default setup. That feeds hostPort in solr.xml. If you use etc/jetty.xml, but sure to still pass it on the cmd line or also put the port in solr.xml for hostPort. - Mark basically I should add the port info to the

Re: Weird Behaviour on Solr 5x (SolrCloud)

2012-11-20 Thread deniz
is this because of zookeeper's load balancer or something like that? because the results are returning totally randomly... - Zeki ama calismiyor... Calissa yapar... -- View this message in context:

Re: Weird Behaviour on Solr 5x (SolrCloud)

2012-11-20 Thread deniz
well... i find a way to avoid this... i dont know if it is the correct way or i am simply bypassing the problem instead of fixing it.. when i delete the data/ folders contents before restarting, it can get the index information from cloud without any problem... so it is the way how solrcloud

Re: SolrCloud Error after leader restarts

2012-11-19 Thread deniz
i know facts about ramdirectory actually.. just running some perf tests on our dev env right now.. so in case i use ramdir with 5x cloud, it will still not do the recovery? i mean it will not get the data from the leader and fill its ramdir again? - Zeki ama calismiyor... Calissa yapar...

Re: SolrCloud Error after leader restarts

2012-11-19 Thread deniz
Mark Miller-3 wrote On Nov 19, 2012, at 9:11 PM, deniz lt; denizdurmus87@ gt; wrote: so in case i use ramdir with 5x cloud, it will still not do the recovery? i mean it will not get the data from the leader and fill its ramdir again? Yes, in 5x RAM directory should be able to recover

Weird Behaviour on Solr 5x (SolrCloud)

2012-11-19 Thread deniz
Hi all, after Mark Miller made it clear to me that 5x is supporting cloud with ramdir, I have started playing with it and it seemed working smoothly, except a weird behaviour.. here is the story of it: Basically, I have pulled the code and built solr 5x, and the replace the war file in webapps

SolrCloud - Zookeeper Questions

2012-11-18 Thread deniz
Hi All, I have been digging web for answers to some of my questions in my mind but till now I am still not clear on them.. first (and main)question is about zookeeper itself.. are there any tutorials in detail how we can use it with solr other than wikies? SolrCloud wiki page is useful for sure,

Re: SolrCloud - Zookeeper Questions

2012-11-18 Thread deniz
Mark Miller-3 wrote On Nov 18, 2012, at 10:02 PM, deniz lt; denizdurmus87@ gt; wrote: removing a shard/replica temporarily and then adding back again I'd unload them with http cmds (without using the options that delete things on disk) and then create them again when I wanted them

SolrCloud Error after leader restarts

2012-11-18 Thread deniz
Hello, for test purposes, I am running two zookeepers on ports 2181 and 2182. and i have two solr instances running on different machines... For the one which is running on my local and acts as leader: java -Dbootstrap_conf=true -DzkHost=localhost:2181 -jar start.jar and for the one which acts

Re: solr4.0 problem zkHost with multiple hosts throws out of range exception

2012-11-12 Thread deniz
so do we need to add one of the servers from the -DzkHost string to -DzkRun? should it look like -DzkRun=host1:port -DzkHost=host:port, host1:port, host2:port in the start up command? and will wiki page be updated? because the example there is still letting into the error that was

Jetty Error while testing Solr

2012-11-07 Thread deniz
HI all, I got a weird error while running tests on my solr... here is the log for that error: ERROR o.a.solr.servlet.SolrDispatchFilter - null:org.eclipse.jetty.io.EofException at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:154) at

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-06 Thread deniz
Erik Hatcher-4 wrote There's an open issue (with a patch!) that enables this, it seems: lt;https://issues.apache.org/jira/browse/SOLR-3911gt; Erik well patch seems not doing that... i have tried and still getting some error lines about the dir types - Zeki ama calismiyor...

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-05 Thread deniz
Erik Hatcher-4 wrote There's an open issue (with a patch!) that enables this, it seems: lt;https://issues.apache.org/jira/browse/SOLR-3911gt; i will check it for sure, thank you Erik :) Shawn Heisey-4 wrote ... transparently mapping the files on disk to a virtual memory space and using

MMapDirectory - Mapping Failed error

2012-11-04 Thread deniz
Hi All, I was testing my solr on MMapDirectory, and while indexing, I get this error lines in the log: 10:27:41.003 [commitScheduler-4-thread-1] ERROR org.apache.solr.update.CommitTracker - auto commit error...:org.apache.solr.common.SolrException: Error opening new searcher at

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-04 Thread deniz
Michael Della Bitta-2 wrote No, RAMDirectory doesn't work for replication. Use MMapDirectory... it ends up storing the index in RAM and more efficiently so, plus it's backed by disk. Just be sure to not set a big heap because MMapDirectory works outside of heap. for my tests, i dont think

Solr Replication is not Possible on RAMDirectory?

2012-11-02 Thread deniz
Hi all, I am trying to set up a master/slave system, by following this page : http://wiki.apache.org/solr/SolrReplication I was able to set up and did some experiments with that, but when i try to set the index for RAMDirectory, i got errors for indexing. While master and slave are both using a

Re: Http 500/503 Responses from Solr

2012-10-30 Thread deniz
well, as for details for the server, it is running on a server with 6 gigs of ram ( jvm heap max is 4 gb), using ram directory for the index. here is my config file (some values are changed as i have been testing): config luceneMatchVersionLUCENE_40/luceneMatchVersion lib dir=../../../dist/

  1   2   >