Re: Indexing slower on a better system

2017-02-13 Thread Zheng Lin Edwin Yeo
Ok no problem. So you were saying that in your case, your indexing speed is also faster at your MacBook Pro, as compared to your Amazon EC2 servers which has better specifications? Regards, Edwin On 14 February 2017 at 14:17, Walter Underwood wrote: > Sorry. Haven’t used Windows since seven y

Re: Indexing slower on a better system

2017-02-13 Thread Walter Underwood
Sorry. Haven’t used Windows since seven years ago and haven’t run Windows as a server for more than a decade. I would not recommend using Windows as your Solr OS. Windows is just not designed for that. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) >

Re: Indexing slower on a better system

2017-02-13 Thread Zheng Lin Edwin Yeo
Hi Walter, For your suggestion to try out the time gunzip < solr-6.4.1.tgz > /dev/null, does it works on Windows system? I tried on Windows, and it give me the error "The syntax of the command is incorrect". In my current setup, if running on one trip, I can index about 16000 lines in a CSV file

Re: Indexing slower on a better system

2017-02-13 Thread Zheng Lin Edwin Yeo
Thanks for the info. Yes, I'm running Solr 6.4.1 on both hosts. Regards, Edwin On 14 February 2017 at 13:21, Walter Underwood wrote: > It is worth doing a basic CPU speed test. Once you have enough RAM, > indexing is mostly CPU-bound. > > Try something like this. Run it once to get the tgz fi

Re: Indexing slower on a better system

2017-02-13 Thread Walter Underwood
It is worth doing a basic CPU speed test. Once you have enough RAM, indexing is mostly CPU-bound. Try something like this. Run it once to get the tgz file cached in OS file buffers, then once to time it. time gunzip < solr-6.4.1.tgz > /dev/null I get 1.3 seconds on an Amazon c4.8xlarge and 0.8

Re: Indexing slower on a better system

2017-02-13 Thread Zheng Lin Edwin Yeo
No, currently the server is slower, and my laptop is faster. But shouldn't the server be faster, since it has a much better specification, like more RAM, better processor and SSD drive. Regards, Edwin On 14 February 2017 at 12:26, Walter Underwood wrote: > Are you sure the server is faster? M

Re: Indexing slower on a better system

2017-02-13 Thread Walter Underwood
Are you sure the server is faster? My MacBook Pro is a lot faster than many of our Amazon EC2 servers. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Feb 13, 2017, at 8:12 PM, Zheng Lin Edwin Yeo wrote: > > Hi, > > I'm facing the issue of the in

Indexing slower on a better system

2017-02-13 Thread Zheng Lin Edwin Yeo
Hi, I'm facing the issue of the indexing speed is slower is slower on a server with a much better specification with Solr running on SSD, as compared to a laptop with a normal hard disk. Both the system has the exact same configurations. The configurations are first setup on the laptop, before be