Hi, Damien Thanks for sharing information. I will look in to 'Spring Cleaning PR' and start work in there.
On Thu, May 21, 2015 at 7:26 AM, Corneau Damien <cornead...@apache.org> wrote: > Hi madhuka, > > The Spring Cleaning PR will change the code base a lot, the way the code > work will be the same (for 80% of the case), so you can familiarize > yourself with it however keep in mind that the Spring Cleaning PR will > change: > * folder structure > * Separate some code into multiple files > * Refactor some code to be simpler/optimized > > The folder structure part is kinda set right now (just a few tiny changes > more), and we are working on making some refactoring ready as fast as > possible. > > I think that on Monday, you can get familiar with that PR new structure > and work from there, it should help you understand better all the part of > the zeppelin-web. > > > On Thu, May 21, 2015 at 1:46 AM, madhuka udantha <madhukaudan...@gmail.com > > wrote: > >> Hi All, >> >> >> I went through google charts / d3 (chart-options, chart-types, chart-data >> and chart-format) with angularJS. And I have written few blog >> articles regard to the topics[1,2]. >> To Familiarize myself with Zepplin I wrote angular controller and new tab >> for Zepplin-Web app. >> >> As 'spring cleaning of Zeppelin-web'[3] is in-progress, will this change >> existing code base? I'm currently working on zepplin web app. Will the >> change be significant? Shall I familiarize with the existing code base or >> the resulting one of the 'spring cleaning of Zeppelin-web' >> >> >> >> [1] http://madhukaudantha.blogspot.com/search/label/Google%20Chart >> [2] https://github.com/Madhuka/angularjs-tutorial >> [3] https://github.com/apache/incubator-zeppelin/pull/56 >> >> On Fri, May 1, 2015 at 9:40 AM, Alex B. <abezzu...@nflabs.com> wrote: >> >>> Congratulations, Madhuka! >>> >>> Glad that you can make it and thank you for your contributions. So we >>> will go on with the initial plan of making more visualizations for Zeppelin >>> then. >>> >>> Meanwhile it is community bonding period [1] I would suggest you go on >>> participating at the dev@ and user@ mailing lists, helping people, >>> sharing your experience with Zeppelin and meanwhile you can also try doing >>> a simple PoC as Ilya suggested, by picking two different libraries or >>> chart types (1 existing, 1 new) and writing an implementation of the >>> transformation function to fit them together. >>> >>> Please keep in touch and let us know who it goes every week or two in a >>> form of short email with your progress summary. We can also arrange >>> something like a regular call\IRC hours if you will. >>> >>> Thanks again, please feel free to reach out in case of any further >>> questions! >>> >>> [1] >>> http://googlesummerofcode.blogspot.kr/2007/04/so-what-is-this-community-bonding-all.html >>> >>> On Thu, Apr 30, 2015 at 12:57 PM, madhuka udantha < >>> madhukaudan...@gmail.com> wrote: >>> >>>> Hi, >>>> >>>> Thank you all for your participation in this thread and the support I >>>> got. My GSoC proposal for Zeppelin had been accepted. Hope you will >>>> continue to give the same support you have been giving me to see to the >>>> successful finishing of the project. >>>> >>>> Also Thanks to Corneau for spring cleaning zeppelin. I can too support >>>> this if needed. Please share any thread which will be discussing [1] so I >>>> can go through the code changes happening. >>>> >>>> Currently I'm using zeppelin/master on github. Is it alright? Do you >>>> have any ideas to what my first deliverable would need to contain? >>>> >>>> Thanks. >>>> >>>> [1] https://github.com/apache/incubator-zeppelin/pull/56 >>>> >>>> On Wed, Apr 29, 2015 at 2:41 PM, Corneau Damien <cornead...@apache.org> >>>> wrote: >>>> >>>>> Hi Madhuka and dev mailing list, >>>>> >>>>> Since the code became quite a mess (didn't supervised it enough I >>>>> guess :p >>>>> ), and GSOC 2015 will start soon, >>>>> I'm currently working on making things easier for people who would >>>>> like to >>>>> participate in the front-end of Zeppelin. >>>>> Work in Progress in that Pull Request : >>>>> https://github.com/apache/incubator-zeppelin/pull/56 >>>>> >>>>> It should be finished before the GSOC 2015 coding time start :) >>>>> >>>>> On Mon, Apr 27, 2015 at 2:00 PM, Ilya Malyanov <imalya...@gmail.com> >>>>> wrote: >>>>> >>>>> > Hi Madhuka, >>>>> > >>>>> > I’m not aware of any efforts in bridging different chart libraries. >>>>> But my >>>>> > guess is, we’ll have to do it ourselves. You can start by picking two >>>>> > different libraries or chart types and writing an implementation of >>>>> the >>>>> > transformation function. It might help you to assess the scope of >>>>> work. >>>>> > >>>>> > Regarding paragraph.js. >>>>> > I don’t think there is documentation for it. >>>>> > So the best way to understand the data flow it is to read the code. >>>>> > I know it’s not very helpful, but I don’t think anyone can help you >>>>> in >>>>> > this situation. >>>>> > >>>>> > Regards, >>>>> > Ilya >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > On Thu, Apr 23, 2015 at 10:43 PM, madhuka udantha < >>>>> > madhukaudan...@gmail.com> wrote: >>>>> > >>>>> >> Hi, >>>>> >> >>>>> >> In different charting libraries the data template take different >>>>> formats. >>>>> >> Therefore to convert between these formats we use a data >>>>> transformation >>>>> >> module. It converts the input data (JSON format) to different data >>>>> >> templates based on the chart library/ chart type selected. If chart >>>>> library >>>>> >> A and chart library B both use the same data template it will reuse >>>>> the >>>>> >> data transformation algorithm. >>>>> >> >>>>> >> Please share your valuable ideas on this matter. Has any >>>>> implementation >>>>> >> been done similar to this before? >>>>> >> >>>>> >> I also need to know the data flow within Paragraph.js. Please be >>>>> kind >>>>> >> enough to share the required resources. What is the logging >>>>> mechanism that >>>>> >> is being used in zeppelin? >>>>> >> >>>>> >> I have written few articles[1] on zeppelin >>>>> >> >>>>> >> [1] >>>>> http://madhukaudantha.blogspot.com/search/label/Apache%20Zeppelin >>>>> >> >>>>> >> On Mon, Apr 20, 2015 at 11:44 AM, madhuka udantha < >>>>> >> madhukaudan...@gmail.com> wrote: >>>>> >> >>>>> >>> Hi, >>>>> >>> >>>>> >>> Here are some blog posts[1] on AngularJS that I wrote last week and >>>>> >>> git-hub[2] repo on them >>>>> >>> >>>>> >>> [1] >>>>> >>> >>>>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=sidebar >>>>> >>> < >>>>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=classic >>>>> > >>>>> >>> [2] https://github.com/Madhuka/angularjs-tutorial >>>>> >>> >>>>> >>> >>>>> >>> On Wed, Apr 15, 2015 at 12:20 PM, madhuka udantha < >>>>> >>> madhukaudan...@gmail.com> wrote: >>>>> >>> >>>>> >>>> Hi Alex, >>>>> >>>> >>>>> >>>> I ran the tests and they were fine. Yes I'm familiar with the code >>>>> >>>> layout/architecture. Basically I'm looking at AngularJS and >>>>> Typescript. I >>>>> >>>> have played around with those two technologies and ran some >>>>> example code >>>>> >>>> which worked fine. I'm writing few blog posts on them as well. >>>>> >>>> >>>>> >>>> Currently I'm looking at zeppelin-web\app\scripts\controllers\ >>>>> and I'm >>>>> >>>> getting familiarized with the Zeppelin Code Base. Also I'm hoping >>>>> to write >>>>> >>>> some blog posts on it. >>>>> >>>> >>>>> >>>> I'm also following paragraph.js functions mainly the two >>>>> >>>> functions pivot() and pivotDataToD3ChartFormat() for constructing >>>>> d3 data. >>>>> >>>> >>>>> >>>> Further I'm finding what are the mainly used charting types by >>>>> Research >>>>> >>>> Teams of Universities all over the world. Also I'm researching on >>>>> the main >>>>> >>>> features that would be used in such graphs. >>>>> >>>> >>>>> >>>> Yes it will be great to have a call/meeting. This week or >>>>> following >>>>> >>>> will be fine for me. IRC meeting or google hangout will be fine. >>>>> >>>> >>>>> >>>> On Tue, Apr 14, 2015 at 12:33 PM, Alex B. <abezzu...@nflabs.com> >>>>> wrote: >>>>> >>>> >>>>> >>>>> Hi Madhuka, >>>>> >>>>> >>>>> >>>>> how Zeppelin code-base exploration it going for you? Do you have >>>>> any >>>>> >>>>> updates? >>>>> >>>>> I can see from >>>>> >>>>> >>>>> http://madhukaudantha.blogspot.kr/2015/03/building-apache-zeppelin.html >>>>> >>>>> that you were able to build it well. >>>>> >>>>> >>>>> >>>>> Were you able to run some tests? Are you familiar by now with >>>>> code >>>>> >>>>> layout\client-server architecture? >>>>> >>>>> >>>>> >>>>> Asking because it is time for us now to rate the GSoC proposals >>>>> that >>>>> >>>>> we'v >>>>> >>>>> got, so please let us know about the progress that you have made >>>>> so >>>>> >>>>> fas, so >>>>> >>>>> we can use it as foundation. >>>>> >>>>> >>>>> >>>>> Will you be interested in making a quick call this early\next >>>>> week and >>>>> >>>>> also >>>>> >>>>> talk about your GSoC proposal a bit? >>>>> >>>>> >>>>> >>>>> That would be awesome and could help us a lot! >>>>> >>>>> Thanks in advance. >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> On Wed, Apr 1, 2015 at 2:27 PM, madhuka udantha < >>>>> >>>>> madhukaudan...@gmail.com> >>>>> >>>>> wrote: >>>>> >>>>> >>>>> >>>>> > Hi Damien, >>>>> >>>>> > >>>>> >>>>> > Thanks for the quick and descriptive reply. I will go through >>>>> each >>>>> >>>>> of them >>>>> >>>>> > and update you on those and I will share my experiences in my >>>>> blog >>>>> >>>>> too. I >>>>> >>>>> > will go through the code-base with consideration for the above >>>>> files. >>>>> >>>>> > >>>>> >>>>> > Thanks >>>>> >>>>> > >>>>> >>>>> > On Wed, Apr 1, 2015 at 7:36 AM, Corneau Damien < >>>>> >>>>> cornead...@apache.org> >>>>> >>>>> > wrote: >>>>> >>>>> > >>>>> >>>>> > > Hi, >>>>> >>>>> > > >>>>> >>>>> > > First of all we use angularjs so you might want to >>>>> familiarize >>>>> >>>>> yourself >>>>> >>>>> > > with it. >>>>> >>>>> > > Currently the code is not well organized (big files), and not >>>>> >>>>> really >>>>> >>>>> > > angular friendly either, but we are working on fixing that. >>>>> >>>>> > > >>>>> >>>>> > > We also were preparing a switch to Typescript, so you might >>>>> want >>>>> >>>>> to read >>>>> >>>>> > > about it too. >>>>> >>>>> > > >>>>> >>>>> > > You will find most of the web logic inside of >>>>> >>>>> > > zeppelin-web/app/scripts/controllers/ >>>>> >>>>> > > >>>>> >>>>> > > Main controllers are: notebook.js and paragraph.js >>>>> >>>>> > > >>>>> >>>>> > > notebook.js take care of the full note, while paragraph.js >>>>> is for >>>>> >>>>> each >>>>> >>>>> > > paragraph of the notebook. >>>>> >>>>> > > >>>>> >>>>> > > In notebook.js will have functions that distributes actions >>>>> to all >>>>> >>>>> > > paragraphs, interpreter binding, note style etc... >>>>> >>>>> > > In paragraph.js you shall find everything about text-editor, >>>>> >>>>> running >>>>> >>>>> > > queries, pivot and visualization. >>>>> >>>>> > > >>>>> >>>>> > > Since the file is somewhere around 1600 lines in >>>>> paragraph.js, I >>>>> >>>>> can help >>>>> >>>>> > > you find what you want with more precise questions. >>>>> >>>>> > > >>>>> >>>>> > > Some functions you might be interested in: 'pivot = >>>>> function(' , ' >>>>> >>>>> > > pivotDataToD3ChartFormat = function(', 'setD3Chart = >>>>> function(', >>>>> >>>>> '$scope. >>>>> >>>>> > > loadTableData = function(' >>>>> >>>>> > > >>>>> >>>>> > > This Pull request (typescript) wasn't ported to the incubator >>>>> >>>>> repository >>>>> >>>>> > > yet, but there was some work on splitting the paragraph into >>>>> >>>>> smaller >>>>> >>>>> > parts. >>>>> >>>>> > > It might help you understand or find what you want. >>>>> >>>>> > > >>>>> >>>>> > > >>>>> >>>>> > > >>>>> >>>>> > > On Wed, Apr 1, 2015 at 2:23 AM, madhuka udantha < >>>>> >>>>> > madhukaudan...@gmail.com> >>>>> >>>>> > > wrote: >>>>> >>>>> > > >>>>> >>>>> > > > Hi All, >>>>> >>>>> > > > >>>>> >>>>> > > > Can you point out some resources / tutorials to >>>>> understand the >>>>> >>>>> code >>>>> >>>>> > > base >>>>> >>>>> > > > of zeppelin? >>>>> >>>>> > > > Since I am trying to familiarize myself with the zeppelin >>>>> code >>>>> >>>>> > structure >>>>> >>>>> > > > and architecture >>>>> >>>>> > > > >>>>> >>>>> > > > Thanks >>>>> >>>>> > > > >>>>> >>>>> > > > On Fri, Mar 20, 2015 at 10:57 AM, madhuka udantha < >>>>> >>>>> > > > madhukaudan...@gmail.com> wrote: >>>>> >>>>> > > > >>>>> >>>>> > > >> Hi All, >>>>> >>>>> > > >> >>>>> >>>>> > > >> I'm Udantha, MSc. Student at University of Moratuwa. This >>>>> GSoC >>>>> >>>>> 2015 >>>>> >>>>> > > >> project, 0COMDEV-1190 captures my interest. >>>>> >>>>> > > >> >>>>> >>>>> > > >> I have abundant experiences of visualization techniques >>>>> creating >>>>> >>>>> > > numerous >>>>> >>>>> > > >> dashboards[1,2] with javascript, html5, angularJS, d3 >>>>> charting >>>>> >>>>> etc. >>>>> >>>>> > > >> >>>>> >>>>> > > >> My current research area comprises of big data where I >>>>> have >>>>> >>>>> worked >>>>> >>>>> > with >>>>> >>>>> > > >> various types of data sets. Also I'm working with cluster >>>>> >>>>> > representation >>>>> >>>>> > > >> and classification techniques where visualization amounts >>>>> to a >>>>> >>>>> > > considerable >>>>> >>>>> > > >> part. I was following COMDEV-119 (jira) with Alexander >>>>> Bezzubov >>>>> >>>>> and >>>>> >>>>> > > CORNEAU >>>>> >>>>> > > >> Damien for more than week. >>>>> >>>>> > > >> >>>>> >>>>> > > >> Thanks >>>>> >>>>> > > >> >>>>> >>>>> > > >> [1] http://wso2.com/products/user-engagement-server/ >>>>> >>>>> > > >> [2] https://github.com/wso2/jaggery >>>>> >>>>> > > >> -- >>>>> >>>>> > > >> Cheers, >>>>> >>>>> > > >> Madhuka Udantha >>>>> >>>>> > > >> http://madhukaudantha.blogspot.com >>>>> >>>>> > > >> >>>>> >>>>> > > > >>>>> >>>>> > > > >>>>> >>>>> > > > >>>>> >>>>> > > > -- >>>>> >>>>> > > > Cheers, >>>>> >>>>> > > > Madhuka Udantha >>>>> >>>>> > > > http://madhukaudantha.blogspot.com >>>>> >>>>> > > > >>>>> >>>>> > > >>>>> >>>>> > >>>>> >>>>> > >>>>> >>>>> > >>>>> >>>>> > -- >>>>> >>>>> > Cheers, >>>>> >>>>> > Madhuka Udantha >>>>> >>>>> > http://madhukaudantha.blogspot.com >>>>> >>>>> > >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> >>>>> -- >>>>> >>>>> Kind regards, >>>>> >>>>> Alexander. >>>>> >>>>> >>>>> >>>> >>>>> >>>> >>>>> >>>> >>>>> >>>> -- >>>>> >>>> Cheers, >>>>> >>>> Madhuka Udantha >>>>> >>>> http://madhukaudantha.blogspot.com >>>>> >>>> >>>>> >>> >>>>> >>> >>>>> >>> >>>>> >>> -- >>>>> >>> Cheers, >>>>> >>> Madhuka Udantha >>>>> >>> http://madhukaudantha.blogspot.com >>>>> >>> >>>>> >> >>>>> >> >>>>> >> >>>>> >> -- >>>>> >> Cheers, >>>>> >> Madhuka Udantha >>>>> >> http://madhukaudantha.blogspot.com >>>>> >> >>>>> > >>>>> > >>>>> >>>> >>>> >>>> >>>> -- >>>> Cheers, >>>> Madhuka Udantha >>>> http://madhukaudantha.blogspot.com >>>> >>> >>> >>> >>> -- >>> -- >>> Kind regards, >>> Alexander. >>> >>> >> >> >> -- >> Cheers, >> Madhuka Udantha >> http://madhukaudantha.blogspot.com >> > > -- Cheers, Madhuka Udantha http://madhukaudantha.blogspot.com
