Meeting minutes with alibaba

2017-07-31 Thread William Guo
hi all,


Here is the meeting minutes with Alibaba.


We have discussed following issues.


  *   How to enforce and leverage schema registration mechanism for different 
streaming data source as Kafka, rocketmq?
  *   How handle different typical scenarios in different bundles, is it 
possible to split griffin into streaming and batch model artifacts?
  *   How to make model general enough but still easily to handle special cases?


Todos:


We will document streaming process diagram in wiki for next round review.



Thanks,


William


[ANNOUNCE] Apache Griffin-0.1.5-incubating released

2017-07-31 Thread William Guo
hi all,


The Apache Griffin (incubating) team is pleased to announce the release of 
Griffin 0.1.5.

Apache Griffin is data quality solution for modern data system,
it defines a standard process to define, measure data quality for well-known 
dimensions.

The release is available at:
https://www.apache.org/dyn/closer.cgi/incubator/griffin

Thanks,

The Apache Griffin (incubating) team


=
*DISCLAIMER*
Apache Griffin is an effort undergoing incubation at the Apache Software 
Foundation (ASF), sponsored by the Apache Incubator.

Incubation is required of all newly accepted projects until a further review 
indicates that the infrastructure, communications, and decision making process 
have stabilized in a manner consistent with other successful ASF projects.

While incubation status is not necessarily a reflection of the completeness or 
stability of the code, it does indicate that the project has yet to be fully 
endorsed by the ASF.





Re: hipchat

2017-07-31 Thread William Guo
hi all,


I have created our griffin slack channel under the-asf.slack.com.


https://the-asf.slack.com/?redir=%2Fmessages%2FC6G77MZM0


Please join and discuss if necessary.



Thanks,

William



From: William GUO 
Sent: Tuesday, August 1, 2017 7:20:10 AM
To: dev@griffin.incubator.apache.org
Subject: Re: hipchat

Slack is not blocked yet by China, we can use slack as real-time communication 
tool so far.


Who knows what will happen in the future.


Thanks,

William


From: Henry Saputra 
Sent: Tuesday, August 1, 2017 2:46:38 AM
To: dev@griffin.incubator.apache.org
Subject: Re: hipchat

Is the Slack or Gitter blocked in China?

If not we could probably set channel in one of the collab app above to get
people real-time interactions.

- Henry

On Thu, Jul 27, 2017 at 4:11 PM, William Guo  wrote:

> hi guys,
>
>
> We can chat with hipchat apps , recommended chat solution in apache
> community.
>
> You can find me by https://apache.hipchat.com/chat/user/5149522 or mobile
> apps.
>
>
>
>
>
> Thanks,
>
> William
>


Re: hipchat

2017-07-31 Thread William GUO
Slack is not blocked yet by China, we can use slack as real-time communication 
tool so far.


Who knows what will happen in the future.


Thanks,

William


From: Henry Saputra 
Sent: Tuesday, August 1, 2017 2:46:38 AM
To: dev@griffin.incubator.apache.org
Subject: Re: hipchat

Is the Slack or Gitter blocked in China?

If not we could probably set channel in one of the collab app above to get
people real-time interactions.

- Henry

On Thu, Jul 27, 2017 at 4:11 PM, William Guo  wrote:

> hi guys,
>
>
> We can chat with hipchat apps , recommended chat solution in apache
> community.
>
> You can find me by https://apache.hipchat.com/chat/user/5149522 or mobile
> apps.
>
>
>
>
>
> Thanks,
>
> William
>


Re: hipchat

2017-07-31 Thread Henry Saputra
Is the Slack or Gitter blocked in China?

If not we could probably set channel in one of the collab app above to get
people real-time interactions.

- Henry

On Thu, Jul 27, 2017 at 4:11 PM, William Guo  wrote:

> hi guys,
>
>
> We can chat with hipchat apps , recommended chat solution in apache
> community.
>
> You can find me by https://apache.hipchat.com/chat/user/5149522 or mobile
> apps.
>
>
>
>
>
> Thanks,
>
> William
>


Re: Griffin support & roadmap

2017-07-31 Thread Mara Preotescu
Hi William,

Would 10:00 am CST (Beijing) work for you on Wednesday 08/02?

Thanks,
Mara

On Sun, Jul 30, 2017 at 10:59 PM, William Guo  wrote:

> hi Mara,
>
>
> We are in China, it is hard to arrange a meeting for US, CHINA, INDIA
> together.
>
>
> China day time is fine for me.
>
>
> Thanks,
>
> William
> --
> *From:* Mara Preotescu 
> *Sent:* Monday, July 31, 2017 10:54:25 AM
>
> *To:* William Guo
> *Cc:* Lv, Alex; Guo, William; dev@griffin.incubator.apache.org
> *Subject:* Re: Griffin support & roadmap
>
> Hi William,
>
> Either Wednesday or Thursday will work for us.  Any better time working
> for you?   What time zone are you in?   I am in US ET time, a colleague of
> mine who I would like to join our discussion is in India, Chennai.
>
> Thanks,
> Mara
>
> On Sun, Jul 30, 2017 at 7:34 PM, William Guo  wrote:
>
>> hi Mara,
>>
>>
>> Sure, We could schedule a meeting to discuss background, requirements,
>> status and milestone.
>>
>>
>> We should be fine in Wednesday or Thursday, what is your proposal?
>>
>>
>>
>> Thanks,
>>
>> William
>> --
>> *From:* Mara Preotescu 
>> *Sent:* Friday, July 28, 2017 7:57:45 PM
>> *To:* William Guo
>> *Cc:* Lv, Alex; Guo, William; dev@griffin.incubator.apache.org
>> *Subject:* Re: Griffin support & roadmap
>>
>> HI Alex, William,
>>
>> THANK YOU so much for your responses.  Thank you for the links.  And, I
>> hope you don't mind if I'll take up your offer to contact you if needed.
>> We are considering, here at Nielsen, using Griffin for our new Data Quality
>> framework  ... we know the project is still in the incubator but we would
>> like give it a try and even contributing, if needed.   We already install
>> it and ran a few tests.
>>
>> If your time permits I would like scheduling a quick call so we could
>> understand the current status and, most importantly if the roadmap stays as
>> in the published documents.
>>
>> Thanks again,
>> Mara
>>
>>
>> On Fri, Jul 28, 2017 at 4:21 AM, William Guo  wrote:
>>
>>> hi Mara,
>>>
>>> Few links might help, you can contact us by
>>> dev@griffin.incubator.apache.org or my personal account gu...@apache.org
>>>
>>>
>>> GitHub : https://github.com/apache/incubator-griffin
>>> 
>>> Website : https://griffin.incubator.apache.org
>>> Contact: mailto://subscribe-...@griffin.incubator.apache.org
>>> 
>>> Apache Griffin JIRA: https://issues.apache.org/jira/browse/GRIFFIN
>>> Apache Griffin Wiki :https://cwiki.apache.org/conf
>>> luence/display/GRIFFIN/Griffin
>>>
>>> Thanks, William
>>>
>>> --
>>> *From:* Lv, Alex 
>>> *Sent:* Friday, July 28, 2017 9:10:09 AM
>>> *To:* Mara Preotescu; Guo, William; gu...@apache.org
>>> *Cc:* dev@griffin.incubator.apache.org
>>> *Subject:* RE: Griffin support & roadmap
>>>
>>>
>>> *<>*
>>>
>>> Hi Mara,
>>>
>>>
>>>
>>> Glad to hear from you, you may discuss the details with William.
>>>
>>> Thx.
>>>
>>>
>>>
>>> Best regards,
>>>
>>> Alex Lv
>>>
>>>
>>>
>>> *From:* Mara Preotescu [mailto:mara.preote...@nielsen.com]
>>> *Sent:* 2017年7月28日 6:14
>>> *To:* Lv, Alex ; Vaidya, Amber 
>>> *Subject:* Griffin support & roadmap
>>>
>>>
>>>
>>> Hello Alex, Amber,
>>>
>>>
>>>
>>> I am writing you trying to reach the support for Griffin, both support
>>> e-mails for the product returned as invalid addresses (
>>> subscribe-...@griffin.incubator.apache.org,
>>> ebay-griffin-d...@googlegroups.com).
>>>
>>>
>>>
>>> Could you please let me know who should we contact to discuss about
>>> Griffin's roadmap?
>>>
>>>
>>>
>>> We are looking, here at Nielsen, to use the Griffin framework for our DQ
>>> processes.  As of today we learned,  and tested, the only dimension
>>> available, Accuracy.   Would you be able to share the roadmap for any other
>>> DQ dimensions availability?
>>>
>>>
>>>
>>> We are looking as well to add a few custom validations - does the tool
>>> offer any APIs that can be used for this purpose?
>>>
>>>
>>>
>>> Any information you could provide would be very, very helpful.
>>>
>>>
>>>
>>>
>>>
>>> Thank you in advance for your help and time.
>>>
>>> Mara Preotescu
>>>
>>> VP Technology,  DevOps Nielsen
>>>
>>
>>
>