Curious observation on copying an index

2015-05-26 Thread Jack Park
Windoz 7: ES 1.3.2: added some 6 million documents distributed over two index instances. Decided to bookmark that collection by copying it to another directory in case something crashed going forward. Something crashed. Copied the clone back to the index directory. On booting and looking at it

Re: Evaluating Moving to Discourse - Feedback Wanted

2015-04-23 Thread Jack Park
I've long wondered how it is that the ElasticSearch tribe could not build something within its own community, a platform that uses ElasticSearch to provide the UX being discussed here (a term occasionally used for that is eat your own dog food). Just thinkin... On Thu, Apr 23, 2015 at 8:18 AM,

Re: 30 billion unique documents (and counting)

2015-04-22 Thread Jack Park
I would certainly like to see that book, or at least a draft of it ;-) On Wed, Apr 22, 2015 at 10:12 AM, Kimbro Staken ksta...@kstaken.com wrote: Hello Fred, I have clusters as large as 200billion documents/130TB. Sharing experiences on that would require a book, but a couple quick things

Re: 30 billion unique documents (and counting)

2015-04-22 Thread Jack Park
That starts to argue for lots of smaller servers maybe even with smaller SSD's. Say, a low power i3 with 16 or 23gb ram, and a 128gb SSD. Is that right? On Wed, Apr 22, 2015 at 2:56 PM, Mark Walkom markwal...@gmail.com wrote: If you are using time series data then you should be using time

Re: Evaluating Moving to Discourse - Feedback Wanted

2015-04-09 Thread Jack Park
+1 to Glen's reply. I would build on Glen's comment nobody is ever forever going to invest anything in improving the user interface with this question (to the entire group): What should a user interface for group collaboration be capable of facilitating? Cheers Jack On Thu, Apr 9, 2015 at 8:23

Re: Some interesting storage numbers for people interested.

2015-02-23 Thread Jack Park
What is lost (the tradeoff) when _source is disabled? What is lost when _all is disabled? This is interesting! Thanks Jack On Mon, Feb 23, 2015 at 12:10 PM, John Smith java.dev@gmail.com wrote: I don't run a blog but I thought I would share some results with the community. Using

Re: Some interesting storage numbers for people interested.

2015-02-23 Thread Jack Park
February 2015 at 07:27, Jack Park jackp...@topicquests.org wrote: What is lost (the tradeoff) when _source is disabled? What is lost when _all is disabled? This is interesting! Thanks Jack On Mon, Feb 23, 2015 at 12:10 PM, John Smith java.dev@gmail.com wrote: I don't run a blog but I

Re: Data Mining with ES

2015-02-05 Thread Jack Park
From my experience, data mining is an enormous field. I've found that it helps to select from a range of topics, such as text mining (machine reading), linked-open-data, or data mining in the sense of making sense of social networks, social behaviors, and so forth. Does that make sense in your

Re: [ANN] Elasticsearch RDF Jena Plugin

2014-12-28 Thread Jack Park
Great idea! Need a clarification. All of the java source files I opened say Apache license, but the readme says AGPL. Which license is it? On Sun, Dec 28, 2014 at 12:01 PM, joergpra...@gmail.com joergpra...@gmail.com wrote: Hi, do you want to turn your Elasticsearch into a SPARQL

Re: javascript es client - should es clients be pooled?

2014-12-26 Thread Jack Park
On my platform, there is one and only one es client, through which all requests go. It seems to work well, though well is defined as having just a few people using it at one time. We plan to start stress testing the system soon. Cheers Jack On Fri, Dec 26, 2014 at 9:55 AM, phil swenson

Re: To Raid or not to Raid

2014-12-12 Thread Jack Park
I cannot put my finger on it, but I think I recall that someone in this group once said that ES is IO intensive, that RAID would slow things down, arguing in favor of redundant servers over RAID. Does that still make sense? On Fri, Dec 12, 2014 at 8:00 AM, Mark Walkom markwal...@gmail.com wrote:

Yet another invalid internal transport message format error

2014-11-10 Thread Jack Park
The console trace snippet is below. The bug started for reasons I do not understand. Facts: There is an instance of ES on 9300 on another box. This instance was set to 9250 and was running fine until I attempted to start another localhost on this box at 9350 and noticed that they (9250 and 9350)

Write-Read question

2014-10-20 Thread Jack Park
I observe, and expect a slight delay between writing an object to ES and being able to fetch it back. In ordinary circumstances, this is not an issue. But, in the context of many agents processing information resources, creating indexes for them, but also needing to refer to those indexes right

Re: Write-Read question

2014-10-20 Thread Jack Park
and Search is near realtime. You can use the refresh flag while indexing to make sure search is also real time , but its expensive. Thanks Vineeth On Mon, Oct 20, 2014 at 8:59 PM, Jack Park jackp...@topicquests.org wrote: I observe, and expect a slight delay between writing an object

Re: Another odd ES freak out...

2014-10-04 Thread Jack Park
I saw a few of those which I ultimately attributed to a flaky network connection. That's not going to explain every such episode, but it did solve one of mine. On Thu, Oct 2, 2014 at 11:27 PM, Shobana Neelakantan s.shoban...@gmail.com wrote: We are seeing the same issue as well. Were you able

Re: [Version 1.3.2] Root type mapping not empty after parsing! Remaining fields:

2014-09-16 Thread Jack Park
A solution was found here http://stackoverflow.com/questions/22071198/adding-mapping-to-a-type-from-java-how-do-i-do-it On Mon, Sep 15, 2014 at 4:16 PM, Jack Park jackp...@topicquests.org wrote: I got this on 1.2.2 and found on the web that it was a bug. So, I upgraded to 1.3.2 and got

Re: Seeking opinions on cluster platforms

2014-09-15 Thread Jack Park
, though it might be a bit heavy. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 13 September 2014 03:16, Jack Park jackp...@topicquests.org wrote: Let me pose a question by suggesting two extremes for hardware

Naive question about multiple clients

2014-09-15 Thread Jack Park
A really simple question is this: can more than one client be talking to an ES cluster at the same time? I ask because I notice that there is a lock file in a shard directory. Thanks! -- You received this message because you are subscribed to the Google Groups elasticsearch group. To

Re: Naive question about multiple clients

2014-09-15 Thread Jack Park
* | *Elasticsearch.com* @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr Le 15 septembre 2014 à 15:58:29, Jack Park (jackp...@topicquests.org) a écrit: A really simple question is this: can more than one client be talking to an ES cluster

Re: Naive question about multiple clients

2014-09-15 Thread Jack Park
...@pilato.fr wrote: Why not using the JavaScript client? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 15 sept. 2014 à 16:39, Jack Park jackp...@topicquests.org a écrit : Thanks! I have the system running under nodejs, but want to start a java client against the same cluster

Revisiting query parse (no field after start_object) errors

2014-09-15 Thread Jack Park
This query: { from: 0, size: 30, query: { term: { sbOf: TypeType } } } is giving me fits. I recently migrated from 0.90 to 1.2.2 and went through this with my node.js client, got many ideas in this forum and solved the problem. The query above works

Re: Revisiting query parse (no field after start_object) errors

2014-09-15 Thread Jack Park
. No clue why, but it's bound to be something in my code... On Mon, Sep 15, 2014 at 8:45 AM, Jack Park jackp...@topicquests.org wrote: This query: { from: 0, size: 30, query: { term: { sbOf: TypeType } } } is giving me fits. I recently

[Version 1.3.2] Root type mapping not empty after parsing! Remaining fields:

2014-09-15 Thread Jack Park
I got this on 1.2.2 and found on the web that it was a bug. So, I upgraded to 1.3.2 and got the same bug. There was a note here that suggested adding mappings: to the top of the mappings doc. Didn't help on 1.2.2

A fresh variant of MapperParsingException

2014-08-12 Thread Jack Park
I created a gist for the mappings I am sending through node-es, with a returned error: MapperParsingException[Root type mapping not empty after parsing! The gist is at https://gist.github.com/KnowledgeGarden/b965b7e78f19f9be9025 Note, that if I remove the upper portion of the json: topics: {

About elasticsearch.org

2014-08-12 Thread Jack Park
Just curious: on all browsers here in silicon valley, I cannot raise any elasticsearch.org Is it just me (or comcast?) Other websites appear fine. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving

Re: About elasticsearch.org

2014-08-12 Thread Jack Park
). On Tuesday, August 12, 2014 1:57:48 PM UTC-3, Jack Park wrote: Just curious: on all browsers here in silicon valley, I cannot raise any elasticsearch.org Is it just me (or comcast?) Other websites appear fine. -- You received this message because you are subscribed to the Google Groups

Re: About elasticsearch.org

2014-08-12 Thread Jack Park
I just hear second hand that the outage is pretty large. On Tue, Aug 12, 2014 at 10:14 AM, Jack Park jackp...@topicquests.org wrote: It appears that liquidweb (their host) has some problems. I and a friend in Canada can open it on my cell phone, but nobody I know around here can raise

Re: A fresh variant of MapperParsingException

2014-08-12 Thread Jack Park
Thanks! The top level of my mappings.json is changed from the gist to look like this: { core: { properties: { lox: { And that appears to work. On Tue, Aug 12, 2014 at 8:43 AM, Jun Ohtani joht...@gmail.com wrote: hi, you should not remove core. please try to add that.

No parser for element [term]

2014-07-16 Thread Jack Park
This exact query is not found in the list, so here goes. Just upgraded to 1.2.2. The query documentation http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-term-query.html gives this example: { term : { user : kimchy } } So, my querydsl written for nodejs is

term query no hits was Re: No parser for element [term]

2014-07-16 Thread Jack Park
at 9:48 AM, David Pilato da...@pilato.fr wrote: You need to put it in a query. Have a look at http://www.elasticsearch.org/guide/en/elasticsearch/guide/current/search.html -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 16 juil. 2014 à 18:04, Jack Park jackp

Re: term query no hits was Re: No parser for element [term]

2014-07-16 Thread Jack Park
to be non analyzed. The choice depends on your other use cases (do you require partial matching?). Cheers, Ivan On Wed, Jul 16, 2014 at 10:21 AM, Jack Park jackp...@topicquests.org wrote: Thank you very much. I was in the process of drafting a message that I found that and made the query

Re: term query no hits was Re: No parser for element [term]

2014-07-16 Thread Jack Park
/indices-analyze.html A term query will do an exact match. If your field is in fact correct, post an example mapping and document. Cheers, Ivan On Wed, Jul 16, 2014 at 10:43 AM, Jack Park jackp...@topicquests.org wrote: Thanks Ivan. That term query on the label field was, in fact

Re: term query no hits was Re: No parser for element [term]

2014-07-16 Thread Jack Park
Here are the mappings I dumped by adding that function to my client: {topics:{mappings:{core:{properties:{crDt:{type:date,format:dat eOptionalTime},crtr:{type:string},details:{type:string},inOf:{ty pe:string},isPrv:{type:string},lEdDt:{type:date,format:dateOpt

Question about querying on a URL field

2014-07-11 Thread Jack Park
This query {\query\:{\field\:{\url\:\http://google.com/\} seems to fail. It represents a stringified JSON object without any processing on the simple url itself. A snippet of the giant error message is below. Thanks in advance for ideas. Jack DataProvider.getNodeByURL Error:

Re: Question about querying on a URL field

2014-07-11 Thread Jack Park
. On Fri, Jul 11, 2014 at 7:06 PM, Jack Park jackp...@topicquests.org wrote: This query {\query\:{\field\:{\url\:\http://google.com/\} seems to fail. It represents a stringified JSON object without any processing on the simple url itself. A snippet of the giant error message is below. Thanks

Re: Dealing with spam in this forum

2014-07-02 Thread Jack Park
The behavior in my gmail-operated spam filter has been to toss out lots of emails from this list as false positives. So, I keep sending them back to my in box; pretty soon, gmail asks me to forward the good ones to them to study, so I do. The result of that is that they catch NONE of those spams.

Simple question about a two-node cluster

2014-02-04 Thread Jack Park
I confess that, at least for me, documentation, including purchased books, remains a bit ambiguous, where the context is that of making my ES client talk to two different servers. In the end, I did nothing to the elasticsearch.yml files at each server; it simply was not clear what needed to be

Re: Simple question about a two-node cluster

2014-02-04 Thread Jack Park
Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 5 February 2014 12:09, Jack Park jackp...@topicquests.org wrote: Hi Tony, I did look at the logs. Also, I restarted everything and followed the instructions found at http://techhari.blogspot.com/2013/03

Re: Curious Query Question

2014-01-25 Thread Jack Park
} } }' clint On 25 January 2014 02:00, Jack Park jackp...@topicquests.org wrote: I have a nested structure, where I am capturing labels against their language, thus: label: { en: [ Ontology Inverse Functional Property Type ] }, My question: what does a query

Ubuntu, Unable to reach host

2013-12-21 Thread Jack Park
I just now installed the latest ES distro on an Ubuntu box with OpenJDK 6b27. It's failing to reach host -- that's an error that googles well, but with nothing that I've seen to help. The box is sitting at 10.1.10.179 and is pingable on its local network from a host windoz box (firewall off). It

Re: Ubuntu, Unable to reach host

2013-12-21 Thread Jack Park
. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 22 December 2013 08:09, Jack Park jackp...@topicquests.org wrote: I just now installed the latest ES distro on an Ubuntu box with OpenJDK 6b27. It's failing