Hi, I am going to implement a sample java interpreter for zeppelin for demo purposes in my proposal. Since java-repl dependencies are not available as maven dependencies I had to add those jars manually to the project. But when I build the zeppelin project with the new changes I made, it refuses to be built saying that it cannot resolve those jars. Please let me know how to add those jars correctly.
Regards On Wed, Mar 16, 2016 at 8:01 AM, Alexander Bezzubov <b...@apache.org> wrote: > Hi Minudika, > > thank you for keeping list posted! > I will get back to you with the proposal comments later today directly > inside the document. > > -- > Alex > > > On Wed, Mar 16, 2016 at 6:27 AM, Minudika Malshan <minudika...@gmail.com> > wrote: > > > Hi, > > > > Could you please help me to improve the content of above proposal? > > > > Thanks > > > > On Sun, Mar 13, 2016 at 1:37 AM, Minudika Malshan <minudika...@gmail.com > > > > wrote: > > > > > Hi Alex, > > > > > > I prepared a draft version of my proposal which you can find here > > > < > > > https://docs.google.com/document/d/1KaBKxYbR08pgwv3UfPF-SMiRM2VJ7K4AQiLzzfUd138/edit?usp=sharing > > >. > > > Could you please have a look and give comments on how to improve it. > > > > > > Thanks and regards > > > > > > On Sat, Mar 12, 2016 at 8:10 AM, Alexander Bezzubov <b...@apache.org> > > > wrote: > > > > > >> Hi, > > >> > > >> great question - as cloud platform that you mention is not > open-source, > > it > > >> is not immediately expected to get it done as a part of GSoC. > > >> > > >> That being said, if that is something that you want to look into, or > > think > > >> that should be not very hard to implement, or think that would be of > the > > >> great benefit of users - it's totally up to you and you can make it > part > > >> of > > >> your project proposal scope, if you want to (i.e as extra bonus, at > the > > >> end, if time permits) > > >> > > >> -- > > >> Alex > > >> > > >> On Thu, Mar 10, 2016 at 6:39 PM, Minudika Malshan < > > minudika...@gmail.com> > > >> wrote: > > >> > > >> > Hi Alex, > > >> > > > >> > As we know the origin of Apache beam is the Google cloud platform. > It > > >> has > > >> > been developed mainly focusing on deploying pipelines in the cloud. > > >> > But AFAIK mostly zeppelin is used as a standalone system. > > >> > Is it expected to implement the cloud support for the interpreter > > under > > >> > this GSoC project? > > >> > > > >> > Best regards. > > >> > > > >> > Minudika Malshan > > >> > Undergraduate > > >> > Department of Computer Science and Engineering > > >> > University of Moratuwa > > >> > Sri Lanka. > > >> > > > >> > > > >> > > > >> > > > >> > On Thu, Mar 10, 2016 at 6:44 AM, Alexander Bezzubov <b...@apache.org > > > > >> > wrote: > > >> > > > >> > > Hi Minudika, > > >> > > > > >> > > you plan sounds awesome - please either keep this thread posted on > > the > > >> > > progress or even better, feel free to start a new one, with more > > >> > > descriptive subject, asking community for a feedback on your > > proposal. > > >> > > > > >> > > Google docs \w ability for people with the link to post comments > > there > > >> > is a > > >> > > great medium. As soon as you send one I'll be happy to add it to > > >> https:// > > >> > > > > >> > cwiki.apache.org/confluence/display/ZEPPELIN/Google+Summer+Of+Code+2016 > > >> > > > > >> > > -- > > >> > > Alex > > >> > > > > >> > > On Wed, Mar 9, 2016 at 9:21 PM, Minudika Malshan < > > >> minudika...@gmail.com> > > >> > > wrote: > > >> > > > > >> > > > Hi Alex, > > >> > > > > > >> > > > I think Java-repl can be used for the implementation. Currently > I > > am > > >> > > > working on a sample implementation and will share it in here > soon. > > >> > > > And will it be ok if I share my sample proposal as a google doc? > > >> > > > > > >> > > > Thanks for your help. > > >> > > > > > >> > > > Regards. > > >> > > > Minudika > > >> > > > > > >> > > > Minudika Malshan > > >> > > > Undergraduate > > >> > > > Department of Computer Science and Engineering > > >> > > > University of Moratuwa > > >> > > > Sri Lanka > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > On Mon, Mar 7, 2016 at 6:39 AM, Alexander Bezzubov < > > b...@apache.org> > > >> > > wrote: > > >> > > > > > >> > > > > Hi Minudika, > > >> > > > > > > >> > > > > if you are talking about Java REPL [1], this was just an > example > > >> of > > >> > the > > >> > > > > project we might want to use to archive the first step of our > > >> goal: > > >> > get > > >> > > > > Java code interpreted by Zeppelin. > > >> > > > > > > >> > > > > > Should we have to add JAVA-REPL source code as a module for > > the > > >> > beam > > >> > > > > > interpreter or can we get the necessary features of it as > > >> > > dependencies > > >> > > > to > > >> > > > > > our project? > > >> > > > > Well, it looks like this particular project is built with Ant > > and > > >> is > > >> > > not > > >> > > > > published on Maven [2]. So right now there is no easy way to > get > > >> it > > >> > as > > >> > > > > build-time dependency. > > >> > > > > > > >> > > > > What I would suggest here: > > >> > > > > - try finding any other other alternative java REPL > > >> implementations > > >> > > > > - if there are none, you could try hacking first PoC for > > >> Java\Beam > > >> > > > > interpreter together just using the code from this project, > > >> inside a > > >> > > new > > >> > > > > interpreter module directly (it is Apache 2.0 licensed) > > >> > > > > > > >> > > > > If it suits our needs and PoC works (it might not, looking > > though > > >> > open > > >> > > > > issues on Github), then at the end of the GSoC you could just > > >> > allocate > > >> > > > some > > >> > > > > time to contribute Maven publishing to that project (which > > should > > >> not > > >> > > > take > > >> > > > > long and can be done as a last step). > > >> > > > > > > >> > > > > Hope this helps and please let me know if you have further > > >> questions! > > >> > > > > > > >> > > > > 1. https://github.com/albertlatacz/java-repl/issues/79 > > >> > > > > 2. https://github.com/albertlatacz/java-repl > > >> > > > > > > >> > > > > On Sun, Mar 6, 2016 at 4:17 AM, Minudika Malshan < > > >> > > minudika...@gmail.com> > > >> > > > > wrote: > > >> > > > > > > >> > > > > > Hi, > > >> > > > > > > > >> > > > > > I have gained understanding about zeppelin and > functionalities > > >> of > > >> > > > > DataFlow > > >> > > > > > SDK. please help me to get familiar with JAVA-REPL. > > >> > > > > > It would be a great help if you can help me to understand > the > > >> flow > > >> > of > > >> > > > > > JAVA-REPL and the way to use it to interpret DataFlow SDK > > >> methods. > > >> > > > > > > > >> > > > > > Regards > > >> > > > > > Minudika > > >> > > > > > > > >> > > > > > Minudika Malshan > > >> > > > > > Undergraduate > > >> > > > > > Department of Computer Science and Engineering > > >> > > > > > University of Moratuwa. > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > On Sat, Mar 5, 2016 at 1:03 AM, Minudika Malshan < > > >> > > > minudika...@gmail.com> > > >> > > > > > wrote: > > >> > > > > > > > >> > > > > > > Hi, > > >> > > > > > > > > >> > > > > > > I was going through JAVA REPL implementation. > > >> > > > > > > I'm bit confused about the way it should be used to > > implement > > >> a > > >> > > java > > >> > > > > > > interpreter which supports Apache beam commands. > > >> > > > > > > Should we have to add JAVA-REPL source code as a module > for > > >> the > > >> > > beam > > >> > > > > > > interpreter or can we get the necessary features of it as > > >> > > > dependencies > > >> > > > > to > > >> > > > > > > our project? > > >> > > > > > > Could you please explain the procedure I should follow in > > >> order > > >> > to > > >> > > > > > achieve > > >> > > > > > > this task. > > >> > > > > > > > > >> > > > > > > Thanks and regards, > > >> > > > > > > Minudika > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > Minudika Malshan > > >> > > > > > > Undergraduate > > >> > > > > > > Department of Computer Science and Engineering > > >> > > > > > > University of Moratuwa. > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > On Thu, Mar 3, 2016 at 11:23 AM, Alexander Bezzubov < > > >> > > b...@apache.org> > > >> > > > > > > wrote: > > >> > > > > > > > > >> > > > > > >> Hi, > > >> > > > > > >> > > >> > > > > > >> I would suggest you to take some time and read through > the > > >> links > > >> > > > from > > >> > > > > > >> email > > >> > > > > > >> carefully and then post back here in this thread, in case > > you > > >> > > manage > > >> > > > > to > > >> > > > > > >> find the answer to your question. > > >> > > > > > >> > > >> > > > > > >> That might helpful to other students participating in > GSoC > > as > > >> > > well. > > >> > > > > > >> > > >> > > > > > >> Thanks! > > >> > > > > > >> > > >> > > > > > >> -- > > >> > > > > > >> Alex > > >> > > > > > >> > > >> > > > > > >> > > >> > > > > > >> On Thu, Mar 3, 2016 at 2:43 PM, Minudika Malshan < > > >> > > > > minudika...@gmail.com > > >> > > > > > > > > >> > > > > > >> wrote: > > >> > > > > > >> > > >> > > > > > >> > Hi Alex, > > >> > > > > > >> > > > >> > > > > > >> > Thanks a lot for your detailed guide through the > project. > > >> > > > > > >> > As you have mentioned, I'm going to create a draft > > >> proposal. > > >> > > > > > >> > Is there any specific template for the proposal? Or > will > > >> it be > > >> > > ok > > >> > > > to > > >> > > > > > >> create > > >> > > > > > >> > a proposal on my own including the facts and points > > you've > > >> > > > mentioned > > >> > > > > > in > > >> > > > > > >> > your reply? > > >> > > > > > >> > > > >> > > > > > >> > Thanks again and regards. > > >> > > > > > >> > Minudika > > >> > > > > > >> > > > >> > > > > > >> > Minudika Malshan > > >> > > > > > >> > Undergraduate > > >> > > > > > >> > Department of Computer Science and Engineering > > >> > > > > > >> > University of Moratuwa. > > >> > > > > > >> > > > >> > > > > > >> > > > >> > > > > > >> > > > >> > > > > > >> > > > >> > > > > > >> > On Thu, Mar 3, 2016 at 8:49 AM, Alexander Bezzubov < > > >> > > > > > >> abezzu...@nflabs.com> > > >> > > > > > >> > wrote: > > >> > > > > > >> > > > >> > > > > > >> > > Hi Minudika, > > >> > > > > > >> > > > > >> > > > > > >> > > > Currently I am writing an interpreter for SiddhiQL > > >> which > > >> > is > > >> > > a > > >> > > > > real > > >> > > > > > >> time > > >> > > > > > >> > > > complex event processing engine, as a part of > > research. > > >> > > > > > >> > > > If you are interested, you can find the code at > here. > > >> > (It's > > >> > > > too > > >> > > > > > >> messy > > >> > > > > > >> > > > though. Have a lot to clean up the in the code) > > >> > > > > > >> > > > https://github.com/minudika/incubator-zeppelin > > >> > > > > > >> > > > > >> > > > > > >> > > Thank you for sharing! That would be a huge plus for > > your > > >> > > > > proposal, > > >> > > > > > >> but > > >> > > > > > >> > > please remember that code quality would be an > important > > >> > factor > > >> > > > on > > >> > > > > > >> > > the proposal selection process, so please make sure > > that > > >> you > > >> > > > have > > >> > > > > > >> > finished > > >> > > > > > >> > > possible cleanups before attaching it to your > > >> application. > > >> > > > > > >> > > > > >> > > > > > >> > > On the side note - I can see your commits in master > > >> branch > > >> > of > > >> > > > your > > >> > > > > > >> fork, > > >> > > > > > >> > > why not to try the workflow Zeppelin uses > > >> > > > > > >> > > < > > >> > > > > > >> > > > > >> > > > > > >> > > > >> > > > > > >> > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > https://github.com/apache/incubator-zeppelin/blob/master/CONTRIBUTING.md#source-control-workflow > > >> > > > > > >> > > > > > >> > > > > > >> > > [0] > > >> > > > > > >> > > by tracking your work in different branches? From > there > > >> it > > >> > > will > > >> > > > be > > >> > > > > > >> easy > > >> > > > > > >> > to > > >> > > > > > >> > > submit a PR and ask other contributors for a code > > review, > > >> > > which > > >> > > > > > could > > >> > > > > > >> > > improve chances of getting high quality code at the > > end. > > >> > > > > > >> > > > > >> > > > > > >> > > > > >> > > > > > >> > > > I would like to know the exact purpose of this > > project > > >> and > > >> > > > > > expected > > >> > > > > > >> > > outcome > > >> > > > > > >> > > from the student. > > >> > > > > > >> > > > > >> > > > > > >> > > The purpose (the objective or the outcome or the > goal) > > of > > >> > this > > >> > > > > > >> project is > > >> > > > > > >> > > to have merged PR with a code + documentation + > example > > >> of > > >> > > usage > > >> > > > > > for a > > >> > > > > > >> > new > > >> > > > > > >> > > Interpreter in Zeppelin, that works with Apache Beam > > SKD > > >> by > > >> > > the > > >> > > > > end > > >> > > > > > of > > >> > > > > > >> > the > > >> > > > > > >> > > summer. > > >> > > > > > >> > > > > >> > > > > > >> > > It might be bold goal, so in order to be reachable > and > > >> get > > >> > > > > accepted > > >> > > > > > it > > >> > > > > > >> > > should be further divided on smaller goal aligned > with > > >> GSoC > > >> > > > > > timeline, > > >> > > > > > >> and > > >> > > > > > >> > > then even on a smaller "steps" on "how to get there". > > >> > > > > > >> > > The expectations are that you will do this work, as > > part > > >> of > > >> > > your > > >> > > > > > >> > > application proposal (with the help of potential > > >> mentors). > > >> > In > > >> > > > > prev. > > >> > > > > > >> email > > >> > > > > > >> > > in this thread I posted some ideas on how those > smaller > > >> > goals > > >> > > > can > > >> > > > > > look > > >> > > > > > >> > > like, but ultimately it's up to you to decide. > > >> > > > > > >> > > > > >> > > > > > >> > > > > >> > > > > > >> > > So I would suggest you start looking into creating a > > >> > proposal > > >> > > > > draft > > >> > > > > > as > > >> > > > > > >> > > early as possible. [5] Have some examples and docs > from > > >> ASF > > >> > on > > >> > > > the > > >> > > > > > >> > proposal > > >> > > > > > >> > > as well, so please make sure that you read it. Please > > >> also > > >> > > feel > > >> > > > > free > > >> > > > > > >> to > > >> > > > > > >> > > post it here to get the feedback from the community, > > and > > >> I > > >> > > will > > >> > > > be > > >> > > > > > >> happy > > >> > > > > > >> > to > > >> > > > > > >> > > further assist you with it. > > >> > > > > > >> > > > > >> > > > > > >> > > Good proposal consists of: > > >> > > > > > >> > > > > >> > > > > > >> > > - list of high-level, measurable "results", or steps > > to > > >> > > archive > > >> > > > > the > > >> > > > > > >> > final > > >> > > > > > >> > > objective\goal > > >> > > > > > >> > > - laid out over the timeline (so expectations for > > >> > > "milestones" > > >> > > > > like > > >> > > > > > >> > > mid-term are set) > > >> > > > > > >> > > - each "result" with the further scope breakdown to > a > > >> > smaller > > >> > > > > > action > > >> > > > > > >> > items > > >> > > > > > >> > > (ideally, each not longer than 1day) > > >> > > > > > >> > > - plus some background information, showing that you > > are > > >> > > > > qualified > > >> > > > > > >> to do > > >> > > > > > >> > > all that and put some thinking into details (links to > > >> your > > >> > > code > > >> > > > > here > > >> > > > > > >> will > > >> > > > > > >> > > help very much) > > >> > > > > > >> > > > > >> > > > > > >> > > > > >> > > > > > >> > > > I am getting familiar with Apache beam nowadays. > > Please > > >> > can > > >> > > > you > > >> > > > > > >> provide > > >> > > > > > >> > > me some useful resources for that. > > >> > > > > > >> > > > > >> > > > > > >> > > [1], [2], [3], [4] are some resource to learn about > > Beam > > >> > > before > > >> > > > it > > >> > > > > > has > > >> > > > > > >> > > finalized its move to Apache. > > >> > > > > > >> > > > > >> > > > > > >> > > Hope this helps! > > >> > > > > > >> > > > > >> > > > > > >> > > -- > > >> > > > > > >> > > Alex > > >> > > > > > >> > > > > >> > > > > > >> > > > > >> > > > > > >> > > 0. > > >> > > > > > >> > > > > >> > > > > > >> > > > > >> > > > > > >> > > > >> > > > > > >> > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > https://github.com/apache/incubator-zeppelin/blob/master/CONTRIBUTING.md#source-control-workflow > > >> > > > > > >> > > 1. https://cloud.google.com/dataflow/ > > >> > > > > > >> > > 2. > > >> > > > > > https://cloud.google.com/dataflow/what-is-google-cloud-dataflow > > >> > > > > > >> > > 3. > > >> > > > > > >> > > > > >> > > > > > >> > > > >> > > > > > >> > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > https://cloud.google.com/dataflow/blog/dataflow-beam-and-spark-comparison > > >> > > > > > >> > > 4. > > >> > > > > > https://github.com/GoogleCloudPlatform/DataflowJavaSDK-examples > > >> > > > > > >> > > 5. https://community.apache.org/gsoc.html > > >> > > > > > >> > > > > >> > > > > > >> > > On Wed, Mar 2, 2016 at 2:50 AM, Minudika Malshan < > > >> > > > > > >> minudika...@gmail.com> > > >> > > > > > >> > > wrote: > > >> > > > > > >> > > > > >> > > > > > >> > > > Hi, > > >> > > > > > >> > > > > > >> > > > > > >> > > > First of all, thanks Alex for your reply. > > >> > > > > > >> > > > Sorry for the delay. > > >> > > > > > >> > > > Some thing has gone wrong with my mail thread. I > just > > >> saw > > >> > > > Alex's > > >> > > > > > >> reply. > > >> > > > > > >> > > > > > >> > > > > > >> > > > I am getting familiar with Apache beam nowadays. > > Please > > >> > can > > >> > > > you > > >> > > > > > >> provide > > >> > > > > > >> > > me > > >> > > > > > >> > > > some useful resources for that. > > >> > > > > > >> > > > Beam developers said that it would take like a week > > to > > >> get > > >> > > the > > >> > > > > > >> official > > >> > > > > > >> > > > Apache documentation for beam done. > > >> > > > > > >> > > > > > >> > > > > > >> > > > Cheers, > > >> > > > > > >> > > > Minudika > > >> > > > > > >> > > > > > >> > > > > > >> > > > Minudika Malshan > > >> > > > > > >> > > > Undergraduate > > >> > > > > > >> > > > Department of Computer Science and Engineering > > >> > > > > > >> > > > University of Moratuwa. > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > On Sun, Feb 21, 2016 at 2:30 AM, Minudika Malshan < > > >> > > > > > >> > minudika...@gmail.com > > >> > > > > > >> > > > > > >> > > > > > >> > > > wrote: > > >> > > > > > >> > > > > > >> > > > > > >> > > > > Hi all, > > >> > > > > > >> > > > > > > >> > > > > > >> > > > > I am looking forward to contribute in this year > > GSOC. > > >> > > > > > >> > > > > I have a basic understand in writing interpreters > > for > > >> > > > zeppelin > > >> > > > > > and > > >> > > > > > >> > have > > >> > > > > > >> > > > > already implement an interpreter for WSO2 siddhi > > >> which > > >> > is > > >> > > a > > >> > > > > > >> complex > > >> > > > > > >> > > event > > >> > > > > > >> > > > > processing language. > > >> > > > > > >> > > > > Could you please give me more details about the > > >> > > requirement > > >> > > > > for > > >> > > > > > >> > > > > implementing a new interpreter for Apache beam? > > >> > > > > > >> > > > > It would be a great help for me to getting > familiar > > >> with > > >> > > > this > > >> > > > > > >> > > > > implementation. > > >> > > > > > >> > > > > > > >> > > > > > >> > > > > Thank you! > > >> > > > > > >> > > > > > > >> > > > > > >> > > > > Minudika Malshan > > >> > > > > > >> > > > > Undergraduate > > >> > > > > > >> > > > > Department of Computer Science and Engineering > > >> > > > > > >> > > > > University of Moratuwa. > > >> > > > > > >> > > > > > > >> > > > > > >> > > > > > > >> > > > > > >> > > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > >> > > > > > >> > > > > >> > > > > > >> > > > > >> > > > > > >> > > -- > > >> > > > > > >> > > -- > > >> > > > > > >> > > Kind regards, > > >> > > > > > >> > > Alexander. > > >> > > > > > >> > > > > >> > > > > > >> > > > >> > > > > > >> > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > > > > > > > > > > -- > > > *Minudika Malshan* > > > Undergraduate > > > Department of Computer Science and Engineering > > > University of Moratuwa > > > Sri Lanka. > > > <https://lk.linkedin.com/pub/minudika-malshan/100/656/a80> > > > > > > > > > > > > > > > -- > > *Minudika Malshan* > > Undergraduate > > Department of Computer Science and Engineering > > University of Moratuwa > > Sri Lanka. > > <https://lk.linkedin.com/pub/minudika-malshan/100/656/a80> > > > -- *Minudika Malshan* Undergraduate Department of Computer Science and Engineering University of Moratuwa Sri Lanka. <https://lk.linkedin.com/pub/minudika-malshan/100/656/a80>