Re: Exception: Job aborted due to stage failure: Task 0 in stage 3.0 failed 1 times,

2017-07-08 Thread Kenneth Chan
Hi Sebastian, would you post the full stack trace? would you go to Spark master and look into more detailed Spark log of the failure? it may give more hint where in engine code trigger the null pointer exception You could also follow here to debug and see if the data is imported as expected, or

Re: Exception: Job aborted due to stage failure: Task 0 in stage 3.0 failed 1 times,

2017-07-08 Thread Vaghawan Ojha
Hi, As much as I can understand from the error message, the Null Exception happens when you have wrong data or no data at all. Please make sure everything is fine in your data. Sometimes, the event store can store the data you provide, but the template you might be using may need other kind of da

Re: Import Inital Data Model

2017-07-08 Thread Vaghawan Ojha
Hi Sebastian, Yes, you need to provide the whole transaction data, not the product and user as much as I know, but not sure if that it works too. Normally you post a transection data, and when you have to tell more about the user (like: the purchased address, device, category) or about the product

Exception: Job aborted due to stage failure: Task 0 in stage 3.0 failed 1 times,

2017-07-08 Thread Sebastian Fix
Hey Keneth Thank for the answer. I’managed to import the following data: After running „pio build“ i get the following error during the „pio train“ process: [ERROR] [Executor] Exception in task 0.0 in stage 3.0 (TID 9) [WARN] [TaskSetManager] Lost task 0.0 in stage 3.0 (TID 9, localhost): ja

Re: Getting the probability values in the random forest classification template of PredictionIO

2017-07-08 Thread Kenneth Chan
see here https://spark.apache.org/docs/latest/mllib-ensembles.html#prediction you can ask in Apache Spark's mailing list too. On Fri, Jun 30, 2017 at 4:09 AM, Pat Ferrel wrote: > You probably should ask on PredictionIO mailing list. > > Signup here: http://predictionio.incubator.apache.org/supp

Re: Kafka support as Event Store

2017-07-08 Thread Kenneth Chan
thomas, if you always your own data store backend for events or your application data, you don't have to use EventServer. Just implement a PIO engine which directly reads from your data source. On Thu, Jul 6, 2017 at 7:32 AM, Pat Ferrel wrote: > The EventStore is queryable in flexible ways and

Re: Import Inital Data Model

2017-07-08 Thread Kenneth Chan
re: " i’m always getting an exception with the initial load from User & Product" what's the error you got? On Fri, Jul 7, 2017 at 12:46 PM, Sebastian Fix wrote: > Hello together, > > I finally got the System running and would like to import some initial > data now. > > I’m using the E-Commerce-T

Re: Eventserver API in an Engine?

2017-07-08 Thread Kenneth Chan
re: "bundling event server as engine" depending on how we wanna separate the concern. the way i look at it is decouple 1, data collection service (PIO event server) and 2. modeling and prediction service (PIO engine) - that's the separation of concern. Ideally data is agnostic to engine, and sho

Re: Eventserver API in an Engine?

2017-07-08 Thread Kenneth Chan
# re: " I see it as objects you see it as data stores" not really. I see things based on what functionality and purpose it provides. like you mentioned - The way Elasticseach is used in UR is part of the model and where the algorithm write the computation result into and then used as serving. In a