be interesting if you can run the tests again with 1.x branch.
Note, also, please use default features in ES for now, no disable flushing
and such.
On Friday, June 13, 2014 7:57:23 AM UTC+2, Maco Ma wrote:
I try to measure the performance of ingesting the documents having lots
of fields
=field118_i:\[0%20TO%2029\]'
curl -s
'http://localhost:8983/solr/collection2/query?rows=0q=*fq=field91_dt:\[2012-1-06T01%3A15%3A51Z%20TO%20NOW\]'
curl -s
'http://localhost:8983/solr/collection2/query?rows=0q=*fq=field879_ss:f*'
Maco
On Wednesday, June 25, 2014 5:23:16 PM UTC+8, Maco Ma wrote:
I
concurrently. I think this is one point that Mike mentioned, right? Even
with Solr, you think we will hit some performance issue with large fields
when ingest and query runs concurrently.
Thanks!
Cindy
On Thursday, June 12, 2014 10:57:23 PM UTC-7, Maco Ma wrote:
I try to measure the performance
. There are
nice Solr/ES perl clients to push docs using bulk indexing.
Jörg
On Wednesday, June 18, 2014 4:50:13 AM UTC+2, Maco Ma wrote:
Hi Mike,
new_ES_config.sh(define the templates and disable the refresh/flush):
curl -XPOST localhost:9200/doc -d '{
mappings : {
type
I tried your script with setting iwc.setRAMBufferSizeMB(4)/ and 48G
heap size. The speed can be around 430 docs/sec before the first flush and
the final speed is 350 docs/sec. Not sure what configuration Solr uses and
its ingestion speed can be 800 docs/sec.
Maco
On Wednesday, June 18,
Hi Mike,
new_ES_config.sh(define the templates and disable the refresh/flush):
curl -XPOST localhost:9200/doc -d '{
mappings : {
type : {
_source : { enabled : false },
dynamic_templates : [
{t1:{
match :
email: ma...@campaignmonitor.com javascript:
web: www.campaignmonitor.com
On 13 June 2014 15:57, Maco Ma mayao...@gmail.com javascript: wrote:
I try to measure the performance of ingesting the documents having lots
of fields.
The latest elasticsearch 1.2.1:
Total docs count: 10k (a small
I try to measure the performance of ingesting the documents having lots of
fields.
The latest elasticsearch 1.2.1:
Total docs count: 10k (a small set definitely)
ES_HEAP_SIZE: 48G
settings:
