Re: How to training and deploy on different machine?

2017-09-20 Thread Brian Chiu
Dear Pat, Thanks for the detailed guide. It is nice to know it is possible. But I am not sure if I understand it correctly, so could you please point out any misunderstanding in the following? (If there is any) Let's say I have 3 machines. There is a machine [EventServer and data store)

Re: Unable to connect to all storage backends successfully

2017-09-20 Thread Jim Miller
Hi Donald, I did not.  I will read the release notes and update accordingly. Thanks! Jim --  Jim Miller On September 20, 2017 at 1:01:53 PM, Donald Szeto (don...@apache.org) wrote: Hey Jim, Did you build PIO 0.12 with ES 1.4 support? ES 1.x is being deprecated in 0.12 so the default build

Re: Unable to connect to all storage backends successfully

2017-09-20 Thread Donald Szeto
Hey Jim, Did you build PIO 0.12 with ES 1.4 support? ES 1.x is being deprecated in 0.12 so the default build will use ES 5.x support. See the upcoming release notes: https://github.com/apache/incubator-predictionio/blob/release/0.12.0/RELEASE.md#behavior-changes Regards, Donald On Wed, Sep 20,

Re: How to training and deploy on different machine?

2017-09-20 Thread Pat Ferrel
Yes, this is the recommended config (Postgres is not, but later). Spark is only needed during training but the `pio train` process creates drives and executors in Spark. The driver will be the `pio train` machine so you must install pio on it. You should have 2 Spark machines at least because

Re: Unable to connect to all storage backends successfully

2017-09-20 Thread Jim Miller
Yes.  I’m following this tutorial but using 0.12.0 instead of 0.10.0: https://medium.freecodecamp.org/building-an-recommendation-engine-with-apache-prediction-io-ml-server-aed0319e0d8 --  Jim Miller On September 20, 2017 at 10:51:39 AM, Pat Ferrel (p...@occamsmachete.com) wrote: meaning is

Re: Unable to connect to all storage backends successfully

2017-09-20 Thread Pat Ferrel
meaning is “firstcluster” the cluster name in your Elasticsearch configuration? On Sep 19, 2017, at 8:54 PM, Vaghawan Ojha wrote: I think the problem is with Elasticsearch, are you sure the cluster exists in elasticsearch configuration? On Wed, Sep 20, 2017 at 8:17

How to training and deploy on different machine?

2017-09-20 Thread Brian Chiu
Hi, I would like to be able to train and run model on different machines. The reason is, on my dataset, training takes around 16GB of memory and deploying only needs 8GB. In order to save money, it would be better if only a 8GB memory machine is used in production, and only start a 16GB one