Re: How to contribute a spatial module to MADlib manipulating objects from PostGIS

[Kuien Liu]

Hi Greg,

Is the video replay available for guys outside Pivotal network to watch?
I made a call with Chenliang Wang in 7:15pm~8:13pm yesterday evening, he
explained his case in evaluating the property prices, he is thinking to
implement this function (GWR) inner databases. I explain the usage of
Madlib and how to enable PostGIS in GPDB. I think Gautum's presentation
on BayesianAnalysis is a good tutorial for him to kick-off his plan.

Cheers,
Kuien Liu

On Fri, Jan 15, 2016 at 10:53 AM, Greg Chase  wrote:

> We always share the presentation and post the video replay as well.
>
> You can also drink lots of coffee, and join us if you are crazy enough.
>
> We like crazy people.
>
> This email encrypted by tiny buttons & fat thumbs, beta voice recognition,
> and autocorrect on my iPhone.
>
> On Jan 14, 2016, at 6:35 PM, Kuien Liu  wrote:
>
> Yes, 2AM on Saturday... May you please share Gautam's representation video
> after the call?
>
> Cheers,
> Kuien Liu
>
> On Wed, Jan 13, 2016 at 6:36 PM, Greg Chase  wrote:
>
>> As I said, our next call is not China-friendly:
>> http://mail-archives.apache.org/mod_mbox/incubator-madlib-dev/201601.mbox/%3CCAMg1VtnKB-WoyVqCstfMNCcJVOn2HKQQ6wNfqdovhgnB7zd5cw%40mail.gmail.com%3E
>>
>> This is this Friday, 10AM Pacifc Standard Time which is 2AM Saturday
>> Beijing time.
>>
>> We will arrange a next call in a couple weeks at an Asia friendly time to
>> support contributors in Asia.
>>
>> However, if you make the next call, we will make time for you to talk :)
>>
>> Regards,
>>
>> -Greg
>>
>> On Wed, Jan 13, 2016 at 2:18 AM, Kuien Liu  wrote:
>>
>>> Great, I would like to join it, please send me an invitation if possible.
>>>
>>> Cheers,
>>> Kuien Liu
>>>
>>> On Wed, Jan 13, 2016 at 6:10 PM, Greg Chase  wrote:
>>>
 Perhaps ChenLiang would like to join a call with the MADlib community
 and discuss his contribution?

 We have a call this Friday 10AM PST which is not a friendly time for
 China, but we can schedule a next call at a friendlier time.

 This email encrypted by tiny buttons & fat thumbs, beta voice
 recognition, and autocorrect on my iPhone.

 > On Jan 13, 2016, at 1:53 AM, Ivan Novick  wrote:
 >
 > Cool!
 >
 >> On Wed, Jan 13, 2016 at 5:52 PM, Kuien Liu  wrote:
 >>
 >> Got it, I think I can have a (f2f) talk with Chenliang Wang, as he
 was
 >> graduated from an institute of CAS which is not far from our Beijing
 >> office, and I am familiar with his supervisor and lab director. So I
 think
 >> it is highly possible to find him directly in Beijing.
 >>
 >> Cheers,
 >> Kuien Liu
 >>
 >>> On Wed, Jan 13, 2016 at 3:05 PM, Ivan Novick 
 wrote:
 >>>
 >>> Hello ChenLiang,
 >>>
 >>> I have read your description of the interface and to my
 understanding
 >>> this is a supervised machine learning algorithm that supports
 geometry
 >>> data.  Am I correct?
 >>>
 >>> What could be a good industrial use case for this model for some
 >>> examples?  Could you train a system based on locations and weather
 to find
 >>> bad signals for cell phone?  Can you provide any real world example
 >>> scenario where this type of model will be useful for end users?
 >>>
 >>> Also I am adding CC to some of my colleagues at work.  Kuien, Max,
 >>> Yandong can you provide any feedback on this proposal from your
 Point of
 >>> View?
 >>>
 >>>
 >>>
 http://mail-archives.apache.org/mod_mbox/incubator-madlib-dev/201601.mbox/%3cblu175-w72199bca72716d8c1a99bf4...@phx.gbl%3E
 >>>
 >>> Cheers,
 >>> Ivan
 >>>
 >>>
 >>> On Wed, Jan 13, 2016 at 11:20 AM, WangChenLiang <
 hi181904...@msn.com>
 >>> wrote:
 >>>
  Sorry, the link of attachment (http://1drv.ms/1ZjAiCg) is lost in
 the
  previous letter.
 
 > From: hi181904...@msn.com
 > To: dev@madlib.incubator.apache.org
 > Subject: RE: How to contribute a spatial module to MADlib
 manipulating
  objects from PostGIS
 > Date: Wed, 13 Jan 2016 11:09:17 +0800
 >
 >
 >
 > Hi   ,Caleb and Ivan!
 >   Thanks for your attention and help. I reviewed the previous
 draft
  and find
 > something inappropriate. The archive containing the new draft and
  example code
 > is attached in the letter which would be more reasonable  than the
  earlier edition.
 > Please go over the manuscript and give suggestion again .
 > The following are my answers to Caleb's questions.
 > - Does this function require PostGIS to also be
 > installed? If yes, it would be better
 > if we disable the function if
 > PostGIS 

Re: How to contribute a spatial module to MADlib manipulating objects from PostGIS

[Kuien Liu]

Yes, 2AM on Saturday... May you please share Gautam's representation video
after the call?

Cheers,
Kuien Liu

On Wed, Jan 13, 2016 at 6:36 PM, Greg Chase  wrote:

> As I said, our next call is not China-friendly:
> http://mail-archives.apache.org/mod_mbox/incubator-madlib-dev/201601.mbox/%3CCAMg1VtnKB-WoyVqCstfMNCcJVOn2HKQQ6wNfqdovhgnB7zd5cw%40mail.gmail.com%3E
>
> This is this Friday, 10AM Pacifc Standard Time which is 2AM Saturday
> Beijing time.
>
> We will arrange a next call in a couple weeks at an Asia friendly time to
> support contributors in Asia.
>
> However, if you make the next call, we will make time for you to talk :)
>
> Regards,
>
> -Greg
>
> On Wed, Jan 13, 2016 at 2:18 AM, Kuien Liu  wrote:
>
>> Great, I would like to join it, please send me an invitation if possible.
>>
>> Cheers,
>> Kuien Liu
>>
>> On Wed, Jan 13, 2016 at 6:10 PM, Greg Chase  wrote:
>>
>>> Perhaps ChenLiang would like to join a call with the MADlib community
>>> and discuss his contribution?
>>>
>>> We have a call this Friday 10AM PST which is not a friendly time for
>>> China, but we can schedule a next call at a friendlier time.
>>>
>>> This email encrypted by tiny buttons & fat thumbs, beta voice
>>> recognition, and autocorrect on my iPhone.
>>>
>>> > On Jan 13, 2016, at 1:53 AM, Ivan Novick  wrote:
>>> >
>>> > Cool!
>>> >
>>> >> On Wed, Jan 13, 2016 at 5:52 PM, Kuien Liu  wrote:
>>> >>
>>> >> Got it, I think I can have a (f2f) talk with Chenliang Wang, as he was
>>> >> graduated from an institute of CAS which is not far from our Beijing
>>> >> office, and I am familiar with his supervisor and lab director. So I
>>> think
>>> >> it is highly possible to find him directly in Beijing.
>>> >>
>>> >> Cheers,
>>> >> Kuien Liu
>>> >>
>>> >>> On Wed, Jan 13, 2016 at 3:05 PM, Ivan Novick 
>>> wrote:
>>> >>>
>>> >>> Hello ChenLiang,
>>> >>>
>>> >>> I have read your description of the interface and to my understanding
>>> >>> this is a supervised machine learning algorithm that supports
>>> geometry
>>> >>> data.  Am I correct?
>>> >>>
>>> >>> What could be a good industrial use case for this model for some
>>> >>> examples?  Could you train a system based on locations and weather
>>> to find
>>> >>> bad signals for cell phone?  Can you provide any real world example
>>> >>> scenario where this type of model will be useful for end users?
>>> >>>
>>> >>> Also I am adding CC to some of my colleagues at work.  Kuien, Max,
>>> >>> Yandong can you provide any feedback on this proposal from your
>>> Point of
>>> >>> View?
>>> >>>
>>> >>>
>>> >>>
>>> http://mail-archives.apache.org/mod_mbox/incubator-madlib-dev/201601.mbox/%3cblu175-w72199bca72716d8c1a99bf4...@phx.gbl%3E
>>> >>>
>>> >>> Cheers,
>>> >>> Ivan
>>> >>>
>>> >>>
>>> >>> On Wed, Jan 13, 2016 at 11:20 AM, WangChenLiang >> >
>>> >>> wrote:
>>> >>>
>>>  Sorry, the link of attachment (http://1drv.ms/1ZjAiCg) is lost in
>>> the
>>>  previous letter.
>>> 
>>> > From: hi181904...@msn.com
>>> > To: dev@madlib.incubator.apache.org
>>> > Subject: RE: How to contribute a spatial module to MADlib
>>> manipulating
>>>  objects from PostGIS
>>> > Date: Wed, 13 Jan 2016 11:09:17 +0800
>>> >
>>> >
>>> >
>>> > Hi   ,Caleb and Ivan!
>>> >   Thanks for your attention and help. I reviewed the previous draft
>>>  and find
>>> > something inappropriate. The archive containing the new draft and
>>>  example code
>>> > is attached in the letter which would be more reasonable  than the
>>>  earlier edition.
>>> > Please go over the manuscript and give suggestion again .
>>> > The following are my answers to Caleb's questions.
>>> > - Does this function require PostGIS to also be
>>> > installed? If yes, it would be better
>>> > if we disable the function if
>>> > PostGIS is not present rather than introduce PostGIS
>>> > as a dependency. (Similar
>>> > to what we do with our requirement on the xml module with our PMML
>>>  export
>>> > functionality).
>>> >
>>> >
>>> >
>>> > A:Yes. I am trying to avoid
>>> > input any spatial datatypes in the interface of GWR.
>>> > But I have no
>>> > idea if it is necessary to provide simple alternative when PostGIS
>>> is
>>>  not
>>> > available.
>>> >
>>> >
>>> >
>>> > - What are the exact datatypes in the function
>>> > definition for regression_location
>>> > and prediction_location?
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > A:I changed the datatype
>>> > to TEXT as the name of POINT or MULTIPOLYGON
>>> > (centroid of
>>> > each polygon for estimation for GWR).
>>> >
>>> >
>>> >
>>> > - In the description it describes
>>> > regression_location as "The length of
>>> > regression_location must be equal 

Re: How to contribute a spatial module to MADlib manipulating objects from PostGIS

[Greg Chase]

We always share the presentation and post the video replay as well.

You can also drink lots of coffee, and join us if you are crazy enough.

We like crazy people.

This email encrypted by tiny buttons & fat thumbs, beta voice recognition, and 
autocorrect on my iPhone.

> On Jan 14, 2016, at 6:35 PM, Kuien Liu  wrote:
> 
> Yes, 2AM on Saturday... May you please share Gautam's representation video 
> after the call?
> 
> Cheers,
> Kuien Liu
> 
>> On Wed, Jan 13, 2016 at 6:36 PM, Greg Chase  wrote:
>> As I said, our next call is not China-friendly: 
>> http://mail-archives.apache.org/mod_mbox/incubator-madlib-dev/201601.mbox/%3CCAMg1VtnKB-WoyVqCstfMNCcJVOn2HKQQ6wNfqdovhgnB7zd5cw%40mail.gmail.com%3E
>> 
>> This is this Friday, 10AM Pacifc Standard Time which is 2AM Saturday Beijing 
>> time.
>> 
>> We will arrange a next call in a couple weeks at an Asia friendly time to 
>> support contributors in Asia.
>> 
>> However, if you make the next call, we will make time for you to talk :)
>> 
>> Regards,
>> 
>> -Greg
>> 
>>> On Wed, Jan 13, 2016 at 2:18 AM, Kuien Liu  wrote:
>>> Great, I would like to join it, please send me an invitation if possible.
>>> 
>>> Cheers,
>>> Kuien Liu
>>> 
 On Wed, Jan 13, 2016 at 6:10 PM, Greg Chase  wrote:
 Perhaps ChenLiang would like to join a call with the MADlib community and 
 discuss his contribution?
 
 We have a call this Friday 10AM PST which is not a friendly time for 
 China, but we can schedule a next call at a friendlier time.
 
 This email encrypted by tiny buttons & fat thumbs, beta voice recognition, 
 and autocorrect on my iPhone.
 
 > On Jan 13, 2016, at 1:53 AM, Ivan Novick  wrote:
 >
 > Cool!
 >
 >> On Wed, Jan 13, 2016 at 5:52 PM, Kuien Liu  wrote:
 >>
 >> Got it, I think I can have a (f2f) talk with Chenliang Wang, as he was
 >> graduated from an institute of CAS which is not far from our Beijing
 >> office, and I am familiar with his supervisor and lab director. So I 
 >> think
 >> it is highly possible to find him directly in Beijing.
 >>
 >> Cheers,
 >> Kuien Liu
 >>
 >>> On Wed, Jan 13, 2016 at 3:05 PM, Ivan Novick  
 >>> wrote:
 >>>
 >>> Hello ChenLiang,
 >>>
 >>> I have read your description of the interface and to my understanding
 >>> this is a supervised machine learning algorithm that supports geometry
 >>> data.  Am I correct?
 >>>
 >>> What could be a good industrial use case for this model for some
 >>> examples?  Could you train a system based on locations and weather to 
 >>> find
 >>> bad signals for cell phone?  Can you provide any real world example
 >>> scenario where this type of model will be useful for end users?
 >>>
 >>> Also I am adding CC to some of my colleagues at work.  Kuien, Max,
 >>> Yandong can you provide any feedback on this proposal from your Point 
 >>> of
 >>> View?
 >>>
 >>>
 >>> http://mail-archives.apache.org/mod_mbox/incubator-madlib-dev/201601.mbox/%3cblu175-w72199bca72716d8c1a99bf4...@phx.gbl%3E
 >>>
 >>> Cheers,
 >>> Ivan
 >>>
 >>>
 >>> On Wed, Jan 13, 2016 at 11:20 AM, WangChenLiang 
 >>> wrote:
 >>>
  Sorry, the link of attachment (http://1drv.ms/1ZjAiCg) is lost in the
  previous letter.
 
 > From: hi181904...@msn.com
 > To: dev@madlib.incubator.apache.org
 > Subject: RE: How to contribute a spatial module to MADlib 
 > manipulating
  objects from PostGIS
 > Date: Wed, 13 Jan 2016 11:09:17 +0800
 >
 >
 >
 > Hi   ,Caleb and Ivan!
 >   Thanks for your attention and help. I reviewed the previous draft
  and find
 > something inappropriate. The archive containing the new draft and
  example code
 > is attached in the letter which would be more reasonable  than the
  earlier edition.
 > Please go over the manuscript and give suggestion again .
 > The following are my answers to Caleb's questions.
 > - Does this function require PostGIS to also be
 > installed? If yes, it would be better
 > if we disable the function if
 > PostGIS is not present rather than introduce PostGIS
 > as a dependency. (Similar
 > to what we do with our requirement on the xml module with our PMML
  export
 > functionality).
 >
 >
 >
 > A:Yes. I am trying to avoid
 > input any spatial datatypes in the interface of GWR.
 > But I have no
 > idea if it is necessary to provide simple alternative when PostGIS is
  not
 > available.
 >
 >
 >
 > - What are 

Re: How to contribute a spatial module to MADlib manipulating objects from PostGIS

[Frank McQuillan]

Thanks ChenLiang Wang for your interest.

I would repeat Ivan's welcome to you, and I look forward to your
contributions in the area of GIS.

To answer your questions:

1.  Yes, it is possible to call PostGIS functions from MADlib.

2.  Yes, spatial statistics are suitable for MADlib.

For documentation, please refer to the Apache MADlib wiki
http://madlib.incubator.apache.org/

which includes:
Quick Start Guides

Get going with a minimum of fuss.

   - Installation Guide
   
   - Quick Start Guide for Users
   

   - Quick Start Guide for Developers
   



As Ivan mentioned, writing down the functions you would like to build and
the interface is a good place to begin.  Then we can discuss on the open
mailing list.

Regards,
Frank

On Thu, Dec 17, 2015 at 8:11 PM, 王晨 亮  wrote:

> Thanks for your quick reply. Your suggestion is great. I will give a
> definitions and description for the spatial statistic functions and
> comparison with ordinary statistic models.
>
>
> > Date: Thu, 17 Dec 2015 21:56:06 -0500
> > Subject: Re: How to contribute a spatial module to MADlib manipulating
> objects from PostGIS
> > From: inov...@pivotal.io
> > To: dev@madlib.incubator.apache.org
> >
> > Hi ChenLiang,
> >
> > I think your proposal is good and worth trying to do it!
> >
> > Can I suggest the first steps if you send a proposal of the function
> > definitions and the parameters and return values as well as description
> of
> > the functions and what they do.
> >
> > Based on that we can discuss the design of the interface and once it
> looks
> > good you can start working on the actual implementation of the coding.
> > When you get to implementation we can help you on technical challenges.
> >
> > Cheers,
> > Ivan
> >
> >
> >
> >
> >
> > On Thu, Dec 17, 2015 at 9:50 PM, 王晨 亮  wrote:
> >
> > > Hi MADlib Developers,
> > >
> > >
> > >
> > >
> > > I am a GIS Researcher and have some knowledge on PostGIS, Python,
> > > C/C++,Java and R.
> > >
> > >
> > >
> > > I have learned some spatial statistical models during My PhD research
> in
> > > GIS. Recently, I have done a job translating GWR (Geographical Weighted
> > > Regression) from R into Java for my company.  And I would like to
> > > contribute to MADLib if possible.  I believe PostGIS and MADlib are the
> > > most powerful extensions of PostgreSQL . Therefore, a spatial
> statistical
> > > module connecting the two libraries could be significant . If I can
> start
> > > the task , the first goal to implement will be GWR model.
> > >
> > >
> > >
> > > Now I am reading the developer guide of MADlib. I not quite sure how to
> > > contribute a geospatial module to MADlib. Is it possible to manipulate
> > > spatial object or attribute from PostGIS in MADlib ?
> > >
> > >
> > >
> > > So could anyone suggest a few pointers & links that I can follow to get
> > > to know:
> > >
> > >
> > >
> > > 1. how to deal with these dependencies about MADlib?
> > >
> > >
> > >
> > > 2. whether the spatial statistics module is suitable for MADlib？
> > >
> > >
> > >
> > > Thank you in advance.
> > >
> > >
> > > ChenLiang Wang
> > >
> > >
>
>