Hi Mitch,
1. What do you mean "my own rating" here? You know the products. So what Amazon is going to provide by way of Kafka? The idea was to embed the functionality of a kafka producer within a rest service in order i can invoke this logic with my a rating. I did not create such functionality because i started to make another things, i get bored, basically. I created some unix commands with this code, using sbt-pack. 1. Assuming that you have created topic specifically for this purpose then that topic is streamed into Kafka, some algorithms is applied and results are saved in DB you got it! 1. You have some dashboard that will fetch data (via ???) from the DB and I guess Zeppelin can do it here? No, not any dashboard yet. Maybe it is not a good idea to connect mongodb with a dashboard through a web socket. It probably works, for a proof of concept, but, in a real project? i don't know yet... You can see what i did to push data within a kafka topic in this scala class <https://github.com/alonsoir/awesome-recommendation-engine/blob/master/src/main/scala/example/producer/AmazonProducerExample.scala>, you have to invoke pack within the scala shell to create this unix command. Regards! Alonso Alonso Isidoro Roman [image: https://]about.me/alonso.isidoro.roman <https://about.me/alonso.isidoro.roman?promo=email_sig&utm_source=email_sig&utm_medium=email_sig&utm_campaign=external_links> 2016-09-05 16:39 GMT+02:00 Mich Talebzadeh <mich.talebza...@gmail.com>: > Thank you Alonso, > > I looked at your project. Interesting > > As I see it this is what you are suggesting > > > 1. A kafka producer is going to ask periodically to Amazon in order to > know what products based on my own ratings and i am going to introduced > them into some kafka topic. > 2. A spark streaming process is going to read from that previous topic. > 3. Apply some machine learning algorithms (ALS, content based > filtering colaborative filtering) on those datasets readed by the spark > streaming process. > 4. Save results in a mongo or cassandra instance. > 5. Use play framework to create an websocket interface between the > mongo instance and the visual interface. > > > As I understand > > Point 1: A kafka producer is going to ask periodically to Amazon in order > to know what products based on my own ratings ..... > > > 1. What do you mean "my own rating" here? You know the products. So > what Amazon is going to provide by way of Kafka? > 2. Assuming that you have created topic specifically for this purpose > then that topic is streamed into Kafka, some algorithms is applied and > results are saved in DB > 3. You have some dashboard that will fetch data (via ???) from the DB > and I guess Zeppelin can do it here? > > > Do you Have a DFD diagram for your design in case. Something like below > (hope does not look pedantic, non intended). > > [image: Inline images 1] > > > > > > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > On 5 September 2016 at 15:08, Alonso Isidoro Roman <alons...@gmail.com> > wrote: > >> Hi Mitch, i wrote few months ago a tiny project with this issue in mind. >> The idea is to apply ALS algorithm in order to get some valid >> recommendations from another users. >> >> >> The url of the project >> <https://github.com/alonsoir/awesome-recommendation-engine> >> >> >> >> Alonso Isidoro Roman >> [image: https://]about.me/alonso.isidoro.roman >> >> <https://about.me/alonso.isidoro.roman?promo=email_sig&utm_source=email_sig&utm_medium=email_sig&utm_campaign=external_links> >> >> 2016-09-05 15:41 GMT+02:00 Mich Talebzadeh <mich.talebza...@gmail.com>: >> >>> Hi, >>> >>> Has anyone done any work on Real time recommendation engines with Spark >>> and Scala. >>> >>> I have seen few PPTs with Python but wanted to see if these have been >>> done with Scala. >>> >>> I trust this question makes sense. >>> >>> Thanks >>> >>> p.s. My prime interest would be in Financial markets. >>> >>> >>> Dr Mich Talebzadeh >>> >>> >>> >>> LinkedIn * >>> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* >>> >>> >>> >>> http://talebzadehmich.wordpress.com >>> >>> >>> *Disclaimer:* Use it at your own risk. Any and all responsibility for >>> any loss, damage or destruction of data or any other property which may >>> arise from relying on this email's technical content is explicitly >>> disclaimed. The author will in no case be liable for any monetary damages >>> arising from such loss, damage or destruction. >>> >>> >>> >> >> >
