Re: Future Mahout - Zeppelin work

2016-05-20 Thread Trevor Grant
Unfortunately Zeppelin dev has been so rapid, 0.6-SNAPSHOT as a version is uninformative to me. I'd say if possible, you're first troubleshooting measure would be to re clone or do a "git fetch upstream" to get up to the very latest Sorry for delayed reply Tg On May 20, 2016 5:36 PM, "Andrew Musse

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Andrew Musselman
Nope Created spark context.. Spark context is available as "val sc". Mahout distributed context is available as "implicit val sdc". 16/05/20 15:48:46 WARN ObjectStore: Version information not found in metastore. hive.metastore.schema.verification is not enabled so recording the schema version 0.13

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Suneel Marthi
R u seeing a similar thing in plain Mahout-Spark shell too ? On Fri, May 20, 2016 at 6:46 PM, Andrew Musselman < andrew.mussel...@gmail.com> wrote: > Now this, definitely would help to clarify the instructions; let me know if > I can help. > > import org.apache.mahout.math._ > import org.apache.m

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Andrew Musselman
Now this, definitely would help to clarify the instructions; let me know if I can help. import org.apache.mahout.math._ import org.apache.mahout.math.scalabindings._ import org.apache.mahout.math.drm._ import org.apache.mahout.math.scalabindings.RLikeOps._ import org.apache.mahout.math.drm.RLikeDr

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Andrew Musselman
Oh might have been a browser cache issue; even after a couple hard refresh methods using another browser has the import link. On Fri, May 20, 2016 at 3:36 PM, Andrew Musselman < andrew.mussel...@gmail.com> wrote: > Trevor, my zeppelin source is at this version: > > org.apache.zeppelin > zeppe

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Andrew Musselman
Trevor, my zeppelin source is at this version: org.apache.zeppelin zeppelin pom 0.6.0-incubating-SNAPSHOT Zeppelin Zeppelin project http://zeppelin.incubator.apache.org/ And yes you're right the artifacts weren't added to the dependencies; is that a feature in more modern zep? On F

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Dmitriy Lyubimov
no parenthesis. import o.a.m.sparkbindings._ myRdd = myDrm.rdd On Fri, May 20, 2016 at 2:57 PM, Suneel Marthi wrote: > On Fri, May 20, 2016 at 3:18 PM, Trevor Grant > wrote: > > > Hey Pat, > > > > If you spit out a TSV - you can import into pyspark / matplotlib from the > > resource pool

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Suneel Marthi
On Fri, May 20, 2016 at 3:18 PM, Trevor Grant wrote: > Hey Pat, > > If you spit out a TSV - you can import into pyspark / matplotlib from the > resource pool in essentially the same way and use that plotting library if > you prefer. In fact you could import the tsv into pandas and use all of > t

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Suneel Marthi
I concur. It seems to work for me the present Zeppelin snapshot version. On Fri, May 20, 2016 at 5:54 PM, Trevor Grant wrote: > If appears the jars aren't loading. > > Did you add those artifacts? > > If your version is the one cloned from tills that's fairly ancient. > > I need to update that p

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Trevor Grant
If appears the jars aren't loading. Did you add those artifacts? If your version is the one cloned from tills that's fairly ancient. I need to update that post badly. Do a fresh git clone from apache/incubator-zeppelin the point of my last post was to get flink 0.10 working w Zeppelin pre relea

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Andrew Musselman
In any case, still getting this error in the console when I run this block: "import org.apache.mahout.math._ import org.apache.mahout.math.scalabindings._ import org.apache.mahout.math.drm._ import org.apache.mahout.math.scalabindings.RLikeOps._ import org.apache.mahout.math.drm.RLikeDrmOps._ impo

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Andrew Musselman
Ah, well I cloned the Till branch per your Nov 3 article.. git clone https://github.com/tillrohrmann/incubator-zeppelin.git On Fri, May 20, 2016 at 2:28 PM, Trevor Grant wrote: > That's a "new" feature in the 0.6-snapshot... Say within the last month or > two, how long has it been since you did

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Trevor Grant
That's a "new" feature in the 0.6-snapshot... Say within the last month or two, how long has it been since you did a git pull? I'll update soon with a note on that. I can also create a gist with the code. On May 20, 2016 4:24 PM, "Andrew Musselman" wrote: > At this step of the tutorial I'm stuc

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Andrew Musselman
At this step of the tutorial I'm stuck because I don't have an "Import Note" link in my Zeppelin home: "I’m going to do you another favor. Go to the Zeppelin home page and click on ‘Import Note’. When given the option between URL and json, click on URL and enter the following link: https://raw.gi

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Trevor Grant
FYI: Looks like Flink shell is fixed :D https://github.com/apache/flink/pull/1913 (I tested, is working good). Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo http://trevorgrant.org *"Fortunate is he, who is able to know the cause

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Trevor Grant
Hey Pat, If you spit out a TSV - you can import into pyspark / matplotlib from the resource pool in essentially the same way and use that plotting library if you prefer. In fact you could import the tsv into pandas and use all of the pandas plotting as well (though I think it is for the most part

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Suneel Marthi
On Fri, May 20, 2016 at 12:54 PM, Trevor Grant wrote: > Dmitriy really nailed it on the head in his reply to the post which I'll > rebroadcast below. In essence the whole reason you are (theoretically) > using Mahout is the data is to big to fit in memory. If it's to big to fit > in memory, well

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Pat Ferrel
Agreed. BTW I don’t want to stall progress but being the most ignorant of plot libs, I’ll ask if we should consider python and matplotlib. In another project we use python because of the RDD support on Spark though the visualizations are extremely limited in our case. If we can pass an RDD to p

Re: [Hello] from NASa

2016-05-20 Thread Suneel Marthi
Welcome to the project Steven!! On Fri, May 20, 2016 at 10:07 AM, Steven NASa wrote: > Hi Folk & Masters, > > My name is *NASa*. I am now working for an e-commerce B2C company in China, > dealing with Transaction Process development in C++ & Java on Linux > environment. > > As you know, *Recomme

Re: [Hello] from NASa

2016-05-20 Thread Andrew Musselman
Steven, thanks for reaching out, and welcome to the project! If you want to discuss how to build a recommender system, the user list is probably more appropriate, and we all hang out there too. If you'd like to contribute to the project dev's the right list. Let us know if you have any trouble ge

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Trevor Grant
Dmitriy really nailed it on the head in his reply to the post which I'll rebroadcast below. In essence the whole reason you are (theoretically) using Mahout is the data is to big to fit in memory. If it's to big to fit in memory, well then its probably too big to plot each point (e.g. trillions of

Re: [Hello] from NASa

2016-05-20 Thread Khurrum Nasim
Sounds more like demand prediction to me. However your system should be able to interact with other non-C/C++ systems. There is something called Apache Thrift. Which brings me to the following - would it be a valuable feature to Mahout library to provide connectivity with other systems u

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Pat Ferrel
Great job Trevor, we’ll need this detail to smooth out the sharp edges and any guidance from you or the Zeppelin community will be a big help. On May 20, 2016, at 8:13 AM, Shannon Quinn wrote: Agreed, thoroughly enjoying the blog post. On 5/19/16 12:01 AM, Andrew Palumbo wrote: > Well done, T

Re: Future Mahout - Zeppelin work

2016-05-20 Thread Shannon Quinn
Agreed, thoroughly enjoying the blog post. On 5/19/16 12:01 AM, Andrew Palumbo wrote: Well done, Trevor! I've not yet had a chance to try this in zeppelin but I just read the blog which is great! Original message From: Trevor Grant Date: 05/18/2016 2:44 PM (GMT-05:00) To: d

[Hello] from NASa

2016-05-20 Thread Steven NASa
Hi Folk & Masters, My name is *NASa*. I am now working for an e-commerce B2C company in China, dealing with Transaction Process development in C++ & Java on Linux environment. As you know, *Recommender System* is quite valuable and important to an e-commerce online shopping website like Amazon. I