Re: [DISCUSS] Graduate Apache Griffin (incubating) as a TLP

2018-10-09 Thread Eugene Liu
Awesome!


two years' incubation makes Griffin more mature, it's time to enter the next 
stage!



On Tue, Oct 9, 2018 at 11:51 PM William Guo 
mailto:gu...@apache.org>> wrote:



> Hi All,

>

> With the 0.3.0-incubating release officially out, the Apache Griffin

> community and its mentors believe it is time to consider graduation to

> the TLP.

>

> Apache Griffin entered incubation in December of 2016, since then, the

> Griffin community learned a lot about how to do things in Apache ways.

> Now we have a healthy and engaged community, ready to help with all

> questions from the Griffin community. We delivered five releases, now

> we can do self-driving releases in good cadence. The PPMC has

> demonstrated a good understanding of growing the community by electing

> 9 individuals as committers and PPMC members.

> The PPMC addressed the maturity issues one by one followed by Apache

> Project Maturity Model, currently all the License and IP issues are

> resolved.

> This demonstrated our understanding of ASF's IP policies.

>

> All in all, I believe this project is qualified as a true TLP and we

> should recognize this fact by formally awarding it such a status. This

> thread means to open up the very same discussion that we had among the

> mentors and Griffin community to the rest of the IPMC. It is a DISCUSS

> thread so feel free to ask questions.

>

> To get you all going, here are a few data points which may help:

>

> Project status:

> https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fincuba

> tor.apache.org%2Fprojects%2Fgriffin.html&data=02%7C01%7Cliujin%40v

> mware.com%7C4d60598672dd4a6e537a08d62e71bdf8%7Cb39138ca3cee4b4aa4d6cd8

> 3d9dd62f0%7C1%7C0%7C636747463383762102&sdata=ul2DNy59oT8hutBRK4ZaF

> Coshfb6tjbZHFApq1hhUYg%3D&reserved=0

>

> Project website:

> https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgriffi

> n.incubator.apache.org%2F&data=02%7C01%7Cliujin%40vmware.com%7C4d6

> 0598672dd4a6e537a08d62e71bdf8%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C1%7

> C0%7C636747463383762102&sdata=1KmQR8cQZOQlYngAsM8%2BKL43eo95FcXhxp

> U1oeTBC5w%3D&reserved=0

>

> Project documentation:

> https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgriffi

> n.incubator.apache.org%2Fdocs%2Fquickstart.html&data=02%7C01%7Cliu

> jin%40vmware.com%7C4d60598672dd4a6e537a08d62e71bdf8%7Cb39138ca3cee4b4a

> a4d6cd83d9dd62f0%7C1%7C0%7C636747463383762102&sdata=WfgLsej3MeN%2F

> CrF5f%2FZ5gT%2BlpQG2w%2B%2Fezu%2BrXXlXrBg%3D&reserved=0

> https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgriffi

> n.incubator.apache.org%2Fdocs%2Fdownload.html&data=02%7C01%7Cliuji

> n%40vmware.com%7C4d60598672dd4a6e537a08d62e71bdf8%7Cb39138ca3cee4b4aa4

> d6cd83d9dd62f0%7C1%7C0%7C636747463383762102&sdata=dCSfB9btCt0yyAKf

> Dgg7uIq4IHGvkNx7D1q%2BRmHIMUc%3D&reserved=0

>

> Maturity assessment:

> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki

> .apache.org%2Fconfluence%2Fdisplay%2FGRIFFIN%2FASF%2BMaturity%2BEvalua

> tion&data=02%7C01%7Cliujin%40vmware.com%7C4d60598672dd4a6e537a08d6

> 2e71bdf8%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C1%7C0%7C6367474633837621

> 02&sdata=zof3kAe0B8eg04qrLAjz8GMhSiiM6%2BCBnB1y8N2jsiA%3D&rese

> rved=0

>

> DRAFT of the board resolution is at the bottom of this email

>

> Proposed PMC size: 18 members

>

> Total number of committers: 18 members

>

> PMC affiliation (* indicated chair):

>

>  - eBay * (7)

>  - Meituan (1)

>  - VMWare (1)

>  - Ontario Institute for Cancer Research (1)

>  - NetEase (1)

>  - ASF (1)

>  - Pingan Bank (1)

>  - Satori Software (1)

>  - Grid Dynamics (1)

>  - JD.com (1)

>  - IBM (1)

>  - Huawei (1)

>

>

> 452 commits on develop

> 431 PR”s on GitHub

> 30 contributors across all branches

>

> 200 issues created

> 195 issues resolved

>

> dev list averaged ~20 msgs/month over last 12 months

>

>

> committer affiliations:

>

> active

>

> * eBay

> * meituan

> * VMWare

> * Grid Dynamics

>

> occasional

>

>  * Ontario Institute for Cancer Research

>  * NetEase

>  * ASF

>  * Pingan Bank

>  * Satori Software

>  * JD.com

>  * IBM

>  * Huawei

>

>

> Thanks,

> William

>

>

> **Notes:**

>

> * I'm proposing myself as initial PMC chair -- Please comment this or

> propose other persons as well

>

> * This draft includes all existing PPMC members and mentors into the

> new PMC.

>

> - For all: please indicate if you want to keep being part of the PMC

> or if you prefer to be removed.

>

>

> --

>

> ## Resolution to create a TLP from graduating Incubator podling

>

> X. Establish the Apache Griffin Project

>

> WHEREAS, the Board of Directors deems it to be in the best interests

> of the Foundation and consistent with the Foundation's purpose to

> establish a Project Management Committee charged with the creation and

> maintenance of open-source software, for distribution at no charge to

> the public, related to a data quality solution f

Re: [DISCUSS] Graduate Apache Griffin (incubating) as a TLP

2018-10-09 Thread Uma gangumalla
I feel, this project is ready for TLP. So far it has evolved very well and
consistently grown with community.

+1 on the proposal, LGTM.

I would love to see this project as TLP soon.

Regards,
Uma

On Tue, Oct 9, 2018 at 8:51 AM William Guo  wrote:

> Hi All,
>
> With the 0.3.0-incubating release officially out, the Apache Griffin
> community and its mentors believe it is time to consider graduation to the
> TLP.
>
> Apache Griffin entered incubation in December of 2016, since then, the
> Griffin
> community learned a lot about how to do things in Apache ways. Now we have
> a healthy and engaged community, ready to help with all questions from the
> Griffin community. We delivered five releases, now we can do self-driving
> releases in good cadence. The PPMC has demonstrated a good understanding of
> growing the community by electing 9 individuals as committers and PPMC
> members.
> The PPMC addressed the maturity issues one by one followed by
> Apache Project Maturity Model, currently all the License and IP issues are
> resolved.
> This demonstrated our understanding of ASF's IP policies.
>
> All in all, I believe this project is qualified as a true TLP and we should
> recognize this fact by formally awarding it such a status. This thread
> means to open up the very same discussion that we had among the mentors and
> Griffin community to the rest of the IPMC. It is a DISCUSS thread so feel
> free
> to ask questions.
>
> To get you all going, here are a few data points which may help:
>
> Project status:
> http://incubator.apache.org/projects/griffin.html
>
> Project website:
> http://griffin.incubator.apache.org/
>
> Project documentation:
> http://griffin.incubator.apache.org/docs/quickstart.html
> http://griffin.incubator.apache.org/docs/download.html
>
> Maturity assessment:
> https://cwiki.apache.org/confluence/display/GRIFFIN/ASF+Maturity+Evaluation
>
> DRAFT of the board resolution is at the bottom of this email
>
> Proposed PMC size: 18 members
>
> Total number of committers: 18 members
>
> PMC affiliation (* indicated chair):
>
>  - eBay * (7)
>  - Meituan (1)
>  - VMWare (1)
>  - Ontario Institute for Cancer Research (1)
>  - NetEase (1)
>  - ASF (1)
>  - Pingan Bank (1)
>  - Satori Software (1)
>  - Grid Dynamics (1)
>  - JD.com (1)
>  - IBM (1)
>  - Huawei (1)
>
>
> 452 commits on develop
> 431 PR”s on GitHub
> 30 contributors across all branches
>
> 200 issues created
> 195 issues resolved
>
> dev list averaged ~20 msgs/month over last 12 months
>
>
> committer affiliations:
>
> active
>
> * eBay
> * meituan
> * VMWare
> * Grid Dynamics
>
> occasional
>
>  * Ontario Institute for Cancer Research
>  * NetEase
>  * ASF
>  * Pingan Bank
>  * Satori Software
>  * JD.com
>  * IBM
>  * Huawei
>
>
> Thanks,
> William
>
>
> **Notes:**
>
> * I'm proposing myself as initial PMC chair -- Please comment this or
> propose other persons as well
>
> * This draft includes all existing PPMC members and mentors into the new
> PMC.
>
> - For all: please indicate if you want to keep being part of the
> PMC or if you prefer to be removed.
>
>
> --
>
> ## Resolution to create a TLP from graduating Incubator podling
>
> X. Establish the Apache Griffin Project
>
> WHEREAS, the Board of Directors deems it to be in the best
> interests of the Foundation and consistent with the
> Foundation's purpose to establish a Project Management
> Committee charged with the creation and maintenance of
> open-source software, for distribution at no charge to
> the public, related to a data quality solution for big data,
> including both streaming and batch mode. It offers an unified
> process to measure data quality from different perspectives.
>
> NOW, THEREFORE, BE IT RESOLVED, that a Project Management
> Committee (PMC), to be known as the "Apache Griffin Project",
> be and hereby is established pursuant to Bylaws of the
> Foundation; and be it further
>
> RESOLVED, that the Apache Griffin Project be and hereby is
> responsible for the creation and maintenance of software
> related to a data quality solution for big data,
> including both streaming and batch mode. It offers an unified
> process to measure data quality from different perspectives;
> and be it further
>
> RESOLVED, that the office of "Vice President, Apache Griffin" be
> and hereby is created, the person holding such office to
> serve at the direction of the Board of Directors as the chair
> of the Apache Griffin Project, and to have primary responsibility
> for management of the projects within the scope of
> responsibility of the Apache Griffin Project; and be it further
>
> RESOLVED, that the persons listed immediately below be and
> hereby are appointed to serve as the initial members of the
> Apache Griffin Project:
>
> * Alex Lv 
> * Deyi Yao 
> * Eugene Liu 
> * Grant Guo 
> * He Wang 
> * Henry Saputra 
> * Jason Liao 
> * John Liu 
> * Juan Li 
> * Liang Shao 
> * Lionel Liu 
> * Luciano Resende 
> * Nick Sokolov 
> * Shawn Sha 
> * Uma Maheswara 

Re: [DISCUSS] Graduate Apache Griffin (incubating) as a TLP

2018-10-09 Thread Lionel Liu
I think it's the time to graduate, I agree with this proposal, and I'd like
to keep being part of PPMC to contribute to Griffin community.

Thanks,
Lionel

On Tue, Oct 9, 2018 at 11:51 PM William Guo  wrote:

> Hi All,
>
> With the 0.3.0-incubating release officially out, the Apache Griffin
> community and its mentors believe it is time to consider graduation to the
> TLP.
>
> Apache Griffin entered incubation in December of 2016, since then, the
> Griffin
> community learned a lot about how to do things in Apache ways. Now we have
> a healthy and engaged community, ready to help with all questions from the
> Griffin community. We delivered five releases, now we can do self-driving
> releases in good cadence. The PPMC has demonstrated a good understanding of
> growing the community by electing 9 individuals as committers and PPMC
> members.
> The PPMC addressed the maturity issues one by one followed by
> Apache Project Maturity Model, currently all the License and IP issues are
> resolved.
> This demonstrated our understanding of ASF's IP policies.
>
> All in all, I believe this project is qualified as a true TLP and we should
> recognize this fact by formally awarding it such a status. This thread
> means to open up the very same discussion that we had among the mentors and
> Griffin community to the rest of the IPMC. It is a DISCUSS thread so feel
> free
> to ask questions.
>
> To get you all going, here are a few data points which may help:
>
> Project status:
> http://incubator.apache.org/projects/griffin.html
>
> Project website:
> http://griffin.incubator.apache.org/
>
> Project documentation:
> http://griffin.incubator.apache.org/docs/quickstart.html
> http://griffin.incubator.apache.org/docs/download.html
>
> Maturity assessment:
> https://cwiki.apache.org/confluence/display/GRIFFIN/ASF+Maturity+Evaluation
>
> DRAFT of the board resolution is at the bottom of this email
>
> Proposed PMC size: 18 members
>
> Total number of committers: 18 members
>
> PMC affiliation (* indicated chair):
>
>  - eBay * (7)
>  - Meituan (1)
>  - VMWare (1)
>  - Ontario Institute for Cancer Research (1)
>  - NetEase (1)
>  - ASF (1)
>  - Pingan Bank (1)
>  - Satori Software (1)
>  - Grid Dynamics (1)
>  - JD.com (1)
>  - IBM (1)
>  - Huawei (1)
>
>
> 452 commits on develop
> 431 PR”s on GitHub
> 30 contributors across all branches
>
> 200 issues created
> 195 issues resolved
>
> dev list averaged ~20 msgs/month over last 12 months
>
>
> committer affiliations:
>
> active
>
> * eBay
> * meituan
> * VMWare
> * Grid Dynamics
>
> occasional
>
>  * Ontario Institute for Cancer Research
>  * NetEase
>  * ASF
>  * Pingan Bank
>  * Satori Software
>  * JD.com
>  * IBM
>  * Huawei
>
>
> Thanks,
> William
>
>
> **Notes:**
>
> * I'm proposing myself as initial PMC chair -- Please comment this or
> propose other persons as well
>
> * This draft includes all existing PPMC members and mentors into the new
> PMC.
>
> - For all: please indicate if you want to keep being part of the
> PMC or if you prefer to be removed.
>
>
> --
>
> ## Resolution to create a TLP from graduating Incubator podling
>
> X. Establish the Apache Griffin Project
>
> WHEREAS, the Board of Directors deems it to be in the best
> interests of the Foundation and consistent with the
> Foundation's purpose to establish a Project Management
> Committee charged with the creation and maintenance of
> open-source software, for distribution at no charge to
> the public, related to a data quality solution for big data,
> including both streaming and batch mode. It offers an unified
> process to measure data quality from different perspectives.
>
> NOW, THEREFORE, BE IT RESOLVED, that a Project Management
> Committee (PMC), to be known as the "Apache Griffin Project",
> be and hereby is established pursuant to Bylaws of the
> Foundation; and be it further
>
> RESOLVED, that the Apache Griffin Project be and hereby is
> responsible for the creation and maintenance of software
> related to a data quality solution for big data,
> including both streaming and batch mode. It offers an unified
> process to measure data quality from different perspectives;
> and be it further
>
> RESOLVED, that the office of "Vice President, Apache Griffin" be
> and hereby is created, the person holding such office to
> serve at the direction of the Board of Directors as the chair
> of the Apache Griffin Project, and to have primary responsibility
> for management of the projects within the scope of
> responsibility of the Apache Griffin Project; and be it further
>
> RESOLVED, that the persons listed immediately below be and
> hereby are appointed to serve as the initial members of the
> Apache Griffin Project:
>
> * Alex Lv 
> * Deyi Yao 
> * Eugene Liu 
> * Grant Guo 
> * He Wang 
> * Henry Saputra 
> * Jason Liao 
> * John Liu 
> * Juan Li 
> * Liang Shao 
> * Lionel Liu 
> * Luciano Resende 
> * Nick Sokolov 
> * Shawn Sha 
> * Uma Maheswara Rao Gangumalla 
> * Vincent Zhao 
> * Will

[GitHub] incubator-griffin-site pull request #11: update committer list and contribut...

2018-10-09 Thread bhlx3lyx7
GitHub user bhlx3lyx7 opened a pull request:

https://github.com/apache/incubator-griffin-site/pull/11

update committer list and contributor list



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bhlx3lyx7/incubator-griffin-site update-list

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-griffin-site/pull/11.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #11


commit 23fc9245e7bfd3657a7f3cc95bdf5c2d5e614cf7
Author: Lionel Liu 
Date:   2018-10-10T02:56:49Z

update committer list and contributor list




---


Re: Jira permissions

2018-10-09 Thread William Guo
Let me look into this.

On Wed, Oct 10, 2018 at 1:55 AM Nick Sokolov  wrote:

> Hi all,
>
> I've discovered, that it's not possible to reassign jira ticket to other
> contributors (non-committers), and non-committers can not assign tickets
> (even if they have created it and want to assign it to themselves). Is that
> expected behavior?
>
> I remember that in Hive jira non-committers have these permissions, and
> ticket can be assigned to anyone within Apache jira. Should project
> settings be adjusted?
>


Re: How to assign Griffin's Jira to myself?

2018-10-09 Thread Henry Saputra
Right now yes. Please indicate you will be working on it. What is your JIRA
username?

I will file ticket to Apache INFRA to change this.

Thanks,

Henry

On Tue, Oct 9, 2018 at 11:00 AM Artem Shutak  wrote:

> Hello!
>
> I've created a Jira (https://issues.apache.org/jira/browse/GRIFFIN-205)
> and
> I'm not able to assign it to myself.
> Is it okey? Should I ask someone to grant me additional Jira rights? Or
> only committers/PPC members have such rights?
>
> Thanks,
> Artem
>


How to assign Griffin's Jira to myself?

2018-10-09 Thread Artem Shutak
Hello!

I've created a Jira (https://issues.apache.org/jira/browse/GRIFFIN-205) and
I'm not able to assign it to myself.
Is it okey? Should I ask someone to grant me additional Jira rights? Or
only committers/PPC members have such rights?

Thanks,
Artem


Jira permissions

2018-10-09 Thread Nick Sokolov
Hi all,

I've discovered, that it's not possible to reassign jira ticket to other
contributors (non-committers), and non-committers can not assign tickets
(even if they have created it and want to assign it to themselves). Is that
expected behavior?

I remember that in Hive jira non-committers have these permissions, and
ticket can be assigned to anyone within Apache jira. Should project
settings be adjusted?


[DISCUSS] Graduate Apache Griffin (incubating) as a TLP

2018-10-09 Thread William Guo
Hi All,

With the 0.3.0-incubating release officially out, the Apache Griffin
community and its mentors believe it is time to consider graduation to the
TLP.

Apache Griffin entered incubation in December of 2016, since then, the
Griffin
community learned a lot about how to do things in Apache ways. Now we have
a healthy and engaged community, ready to help with all questions from the
Griffin community. We delivered five releases, now we can do self-driving
releases in good cadence. The PPMC has demonstrated a good understanding of
growing the community by electing 9 individuals as committers and PPMC
members.
The PPMC addressed the maturity issues one by one followed by
Apache Project Maturity Model, currently all the License and IP issues are
resolved.
This demonstrated our understanding of ASF's IP policies.

All in all, I believe this project is qualified as a true TLP and we should
recognize this fact by formally awarding it such a status. This thread
means to open up the very same discussion that we had among the mentors and
Griffin community to the rest of the IPMC. It is a DISCUSS thread so feel
free
to ask questions.

To get you all going, here are a few data points which may help:

Project status:
http://incubator.apache.org/projects/griffin.html

Project website:
http://griffin.incubator.apache.org/

Project documentation:
http://griffin.incubator.apache.org/docs/quickstart.html
http://griffin.incubator.apache.org/docs/download.html

Maturity assessment:
https://cwiki.apache.org/confluence/display/GRIFFIN/ASF+Maturity+Evaluation

DRAFT of the board resolution is at the bottom of this email

Proposed PMC size: 18 members

Total number of committers: 18 members

PMC affiliation (* indicated chair):

 - eBay * (7)
 - Meituan (1)
 - VMWare (1)
 - Ontario Institute for Cancer Research (1)
 - NetEase (1)
 - ASF (1)
 - Pingan Bank (1)
 - Satori Software (1)
 - Grid Dynamics (1)
 - JD.com (1)
 - IBM (1)
 - Huawei (1)


452 commits on develop
431 PR”s on GitHub
30 contributors across all branches

200 issues created
195 issues resolved

dev list averaged ~20 msgs/month over last 12 months


committer affiliations:

active

* eBay
* meituan
* VMWare
* Grid Dynamics

occasional

 * Ontario Institute for Cancer Research
 * NetEase
 * ASF
 * Pingan Bank
 * Satori Software
 * JD.com
 * IBM
 * Huawei


Thanks,
William


**Notes:**

* I'm proposing myself as initial PMC chair -- Please comment this or
propose other persons as well

* This draft includes all existing PPMC members and mentors into the new
PMC.

- For all: please indicate if you want to keep being part of the
PMC or if you prefer to be removed.


--

## Resolution to create a TLP from graduating Incubator podling

X. Establish the Apache Griffin Project

WHEREAS, the Board of Directors deems it to be in the best
interests of the Foundation and consistent with the
Foundation's purpose to establish a Project Management
Committee charged with the creation and maintenance of
open-source software, for distribution at no charge to
the public, related to a data quality solution for big data,
including both streaming and batch mode. It offers an unified
process to measure data quality from different perspectives.

NOW, THEREFORE, BE IT RESOLVED, that a Project Management
Committee (PMC), to be known as the "Apache Griffin Project",
be and hereby is established pursuant to Bylaws of the
Foundation; and be it further

RESOLVED, that the Apache Griffin Project be and hereby is
responsible for the creation and maintenance of software
related to a data quality solution for big data,
including both streaming and batch mode. It offers an unified
process to measure data quality from different perspectives;
and be it further

RESOLVED, that the office of "Vice President, Apache Griffin" be
and hereby is created, the person holding such office to
serve at the direction of the Board of Directors as the chair
of the Apache Griffin Project, and to have primary responsibility
for management of the projects within the scope of
responsibility of the Apache Griffin Project; and be it further

RESOLVED, that the persons listed immediately below be and
hereby are appointed to serve as the initial members of the
Apache Griffin Project:

* Alex Lv 
* Deyi Yao 
* Eugene Liu 
* Grant Guo 
* He Wang 
* Henry Saputra 
* Jason Liao 
* John Liu 
* Juan Li 
* Liang Shao 
* Lionel Liu 
* Luciano Resende 
* Nick Sokolov 
* Shawn Sha 
* Uma Maheswara Rao Gangumalla 
* Vincent Zhao 
* William Guo 
* Yuqin Xuan 

NOW, THEREFORE, BE IT FURTHER RESOLVED, that William Guo
be appointed to the office of Vice President, Apache Griffin, to
serve in accordance with and subject to the direction of the
Board of Directors and the Bylaws of the Foundation until
death, resignation, retirement, removal or disqualification,
or until a successor is appointed; and be it further

RESOLVED, that the initial Apache Griffin PMC be and hereby is
tasked with the creation of a set of bylaws intended to

[jira] [Created] (GRIFFIN-205) Accuracy measure check should provide matchedFraction to store

2018-10-09 Thread Artem Shutak (JIRA)
Artem Shutak created GRIFFIN-205:


 Summary: Accuracy measure check should provide matchedFraction to 
store
 Key: GRIFFIN-205
 URL: https://issues.apache.org/jira/browse/GRIFFIN-205
 Project: Griffin (Incubating)
  Issue Type: Improvement
  Components: accuracy-batch, accuracy-real-time
Affects Versions: 1.0.0-incubating
Reporter: Artem Shutak


Currently, {{accuracy}} measure results contains "total", "miss" and "matched" 
counts.

As a result, It's hard to analyze accuracy fraction based on results stored in 
ElasticSearch, because ElasticSearch does not provide straight forward 
capability to get "field divided by field" query results.

{{Accuracy}} measure results should also contain {{matchedFraction}} field. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work started] (GRIFFIN-204) postman collection is not up to date, some APIs don't work well, like create measure

2018-10-09 Thread Eugene (JIRA)


 [ 
https://issues.apache.org/jira/browse/GRIFFIN-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on GRIFFIN-204 started by Eugene.
--
> postman collection is not up to date, some APIs don't work well, like create 
> measure
> 
>
> Key: GRIFFIN-204
> URL: https://issues.apache.org/jira/browse/GRIFFIN-204
> Project: Griffin (Incubating)
>  Issue Type: Bug
>Affects Versions: 0.2.0-incubating
>Reporter: Eugene
>Assignee: Eugene
>Priority: Minor
> Fix For: 1.0.0-incubating
>
>
> apply 
> [https://github.com/apache/incubator-griffin/blob/master/griffin-doc/service/postman/griffin.json,]
>  and launch create measure api, then get an error. I find the json is not 
> matched to latest implementation
> {
>     "timestamp": 1539073909006,
>     "status": 400,
>     "error": "Bad Request",
>     "exception": 
> "org.springframework.http.converter.HttpMessageNotReadableException",
>     "message": "Could not read document: Can not construct instance of 
> org.apache.griffin.core.measure.entity.DqType from String value 'accuracy': 
> value not one of declared Enum instance names: [COMPLETENESS, TIMELINESS, 
> PROFILING, CONSISTENCY, ACCURACY, UNIQUENESS]\n at [Source: 
> java.io.PushbackInputStream@565f5e70; line: 4, column: 15] (through reference 
> chain: org.apache.griffin.core.measure.entity.GriffinMeasure[\"dq.type\"]); 
> nested exception is 
> com.fasterxml.jackson.databind.exc.InvalidFormatException: Can not construct 
> instance of org.apache.griffin.core.measure.entity.DqType from String value 
> 'accuracy': value not one of declared Enum instance names: [COMPLETENESS, 
> TIMELINESS, PROFILING, CONSISTENCY, ACCURACY, UNIQUENESS]\n at [Source: 
> java.io.PushbackInputStream@565f5e70; line: 4, column: 15] (through reference 
> chain: org.apache.griffin.core.measure.entity.GriffinMeasure[\"dq.type\"])",
>     "path": "/api/v1/measures"
> }



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (GRIFFIN-204) postman collection is not up to date, some APIs don't work well, like create measure

2018-10-09 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/GRIFFIN-204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16643456#comment-16643456
 ] 

ASF GitHub Bot commented on GRIFFIN-204:


GitHub user toyboxman opened a pull request:

https://github.com/apache/incubator-griffin/pull/433

Fix a bug in postman script

postman collection is not up to date, some APIs don't work well.
script has been refreshed in this patch by postman 2.1 standard.

Jira task: GRIFFIN-204

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/toyboxman/incubator-griffin doc/postman

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-griffin/pull/433.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #433


commit 46bc51526836353cf58e06947d23542415d2e64c
Author: Eugene 
Date:   2018-10-09T13:13:35Z

Fix a bug in postman script

postman collection is not up to date, some APIs don't work well.
script has been refreshed in this patch by postman 2.1 standard.

Jira task: GRIFFIN-204




> postman collection is not up to date, some APIs don't work well, like create 
> measure
> 
>
> Key: GRIFFIN-204
> URL: https://issues.apache.org/jira/browse/GRIFFIN-204
> Project: Griffin (Incubating)
>  Issue Type: Bug
>Affects Versions: 0.2.0-incubating
>Reporter: Eugene
>Assignee: Eugene
>Priority: Minor
> Fix For: 1.0.0-incubating
>
>
> apply 
> [https://github.com/apache/incubator-griffin/blob/master/griffin-doc/service/postman/griffin.json,]
>  and launch create measure api, then get an error. I find the json is not 
> matched to latest implementation
> {
>     "timestamp": 1539073909006,
>     "status": 400,
>     "error": "Bad Request",
>     "exception": 
> "org.springframework.http.converter.HttpMessageNotReadableException",
>     "message": "Could not read document: Can not construct instance of 
> org.apache.griffin.core.measure.entity.DqType from String value 'accuracy': 
> value not one of declared Enum instance names: [COMPLETENESS, TIMELINESS, 
> PROFILING, CONSISTENCY, ACCURACY, UNIQUENESS]\n at [Source: 
> java.io.PushbackInputStream@565f5e70; line: 4, column: 15] (through reference 
> chain: org.apache.griffin.core.measure.entity.GriffinMeasure[\"dq.type\"]); 
> nested exception is 
> com.fasterxml.jackson.databind.exc.InvalidFormatException: Can not construct 
> instance of org.apache.griffin.core.measure.entity.DqType from String value 
> 'accuracy': value not one of declared Enum instance names: [COMPLETENESS, 
> TIMELINESS, PROFILING, CONSISTENCY, ACCURACY, UNIQUENESS]\n at [Source: 
> java.io.PushbackInputStream@565f5e70; line: 4, column: 15] (through reference 
> chain: org.apache.griffin.core.measure.entity.GriffinMeasure[\"dq.type\"])",
>     "path": "/api/v1/measures"
> }



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] incubator-griffin pull request #433: Fix a bug in postman script

2018-10-09 Thread toyboxman
GitHub user toyboxman opened a pull request:

https://github.com/apache/incubator-griffin/pull/433

Fix a bug in postman script

postman collection is not up to date, some APIs don't work well.
script has been refreshed in this patch by postman 2.1 standard.

Jira task: GRIFFIN-204

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/toyboxman/incubator-griffin doc/postman

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-griffin/pull/433.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #433


commit 46bc51526836353cf58e06947d23542415d2e64c
Author: Eugene 
Date:   2018-10-09T13:13:35Z

Fix a bug in postman script

postman collection is not up to date, some APIs don't work well.
script has been refreshed in this patch by postman 2.1 standard.

Jira task: GRIFFIN-204




---


[jira] [Created] (GRIFFIN-204) postman collection is not up to date, some APIs don't work well, like create measure

2018-10-09 Thread Eugene (JIRA)
Eugene created GRIFFIN-204:
--

 Summary: postman collection is not up to date, some APIs don't 
work well, like create measure
 Key: GRIFFIN-204
 URL: https://issues.apache.org/jira/browse/GRIFFIN-204
 Project: Griffin (Incubating)
  Issue Type: Bug
Affects Versions: 0.2.0-incubating
Reporter: Eugene
Assignee: Eugene
 Fix For: 1.0.0-incubating


apply 
[https://github.com/apache/incubator-griffin/blob/master/griffin-doc/service/postman/griffin.json,]
 and launch create measure api, then get an error. I find the json is not 
matched to latest implementation

{
    "timestamp": 1539073909006,
    "status": 400,
    "error": "Bad Request",
    "exception": 
"org.springframework.http.converter.HttpMessageNotReadableException",
    "message": "Could not read document: Can not construct instance of 
org.apache.griffin.core.measure.entity.DqType from String value 'accuracy': 
value not one of declared Enum instance names: [COMPLETENESS, TIMELINESS, 
PROFILING, CONSISTENCY, ACCURACY, UNIQUENESS]\n at [Source: 
java.io.PushbackInputStream@565f5e70; line: 4, column: 15] (through reference 
chain: org.apache.griffin.core.measure.entity.GriffinMeasure[\"dq.type\"]); 
nested exception is com.fasterxml.jackson.databind.exc.InvalidFormatException: 
Can not construct instance of org.apache.griffin.core.measure.entity.DqType 
from String value 'accuracy': value not one of declared Enum instance names: 
[COMPLETENESS, TIMELINESS, PROFILING, CONSISTENCY, ACCURACY, UNIQUENESS]\n at 
[Source: java.io.PushbackInputStream@565f5e70; line: 4, column: 15] (through 
reference chain: 
org.apache.griffin.core.measure.entity.GriffinMeasure[\"dq.type\"])",
    "path": "/api/v1/measures"
}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Comment Edited] (GRIFFIN-202) Allow viewing of raw measure details from UI

2018-10-09 Thread William Guo (JIRA)


[ 
https://issues.apache.org/jira/browse/GRIFFIN-202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642931#comment-16642931
 ] 

William Guo edited comment on GRIFFIN-202 at 10/9/18 8:10 AM:
--

we can leverage some open source widgets, but we need to pay attention to their 
license.

if you have some candidates, please discuss in dev mailing list, or we need to 
ensure its compliant with apache license 2.0.

please check this document for license segment.

https://cwiki.apache.org/confluence/display/GRIFFIN/5.+How+to+Verify+Release+Package

Thanks,
William 


was (Author: guoyp):
we can leverage some open source widgets, but we need to pay attention to their 
license.

if you have some candidates, please discuss in dev mailing list, or we need to 
ensure its compliance with apache license 2.0.

please check this document for license segment.

https://cwiki.apache.org/confluence/display/GRIFFIN/5.+How+to+Verify+Release+Package

Thanks,
William 

> Allow viewing of raw measure details from UI
> 
>
> Key: GRIFFIN-202
> URL: https://issues.apache.org/jira/browse/GRIFFIN-202
> Project: Griffin (Incubating)
>  Issue Type: Improvement
>Reporter: Nikolay Sokolov
>Priority: Minor
>
> Sometimes it's desirable to see raw JSON of specific measure. This is 
> especially useful when custom measurements are created from API.
> Two implementations are possible (one or even both can be implemented):
> * show link with URL of measure details API on UI
> * add section under "Mapping Rules", showing formatted plain text of API 
> response on UI



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (GRIFFIN-202) Allow viewing of raw measure details from UI

2018-10-09 Thread William Guo (JIRA)


[ 
https://issues.apache.org/jira/browse/GRIFFIN-202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642931#comment-16642931
 ] 

William Guo commented on GRIFFIN-202:
-

we can leverage some open source widgets, but we need to pay attention to their 
license.

if you have some candidates, please discuss in dev mailing list, or we need to 
ensure its compliance with apache license 2.0.

please check this document for license segment.

https://cwiki.apache.org/confluence/display/GRIFFIN/5.+How+to+Verify+Release+Package

Thanks,
William 

> Allow viewing of raw measure details from UI
> 
>
> Key: GRIFFIN-202
> URL: https://issues.apache.org/jira/browse/GRIFFIN-202
> Project: Griffin (Incubating)
>  Issue Type: Improvement
>Reporter: Nikolay Sokolov
>Priority: Minor
>
> Sometimes it's desirable to see raw JSON of specific measure. This is 
> especially useful when custom measurements are created from API.
> Two implementations are possible (one or even both can be implemented):
> * show link with URL of measure details API on UI
> * add section under "Mapping Rules", showing formatted plain text of API 
> response on UI



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (GRIFFIN-194) [service] Hive API improvement

2018-10-09 Thread William Guo (JIRA)


[ 
https://issues.apache.org/jira/browse/GRIFFIN-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642921#comment-16642921
 ] 

William Guo commented on GRIFFIN-194:
-

Cool, we might can increase performance by limit network roundtrip.

> [service] Hive API improvement
> --
>
> Key: GRIFFIN-194
> URL: https://issues.apache.org/jira/browse/GRIFFIN-194
> Project: Griffin (Incubating)
>  Issue Type: Sub-task
>Reporter: Nikolay Sokolov
>Priority: Minor
>
> Purpose is mainly to support GRIFFIN-195 with single request to get table 
> list information, while avoiding transferring all table metadata and making 
> lots of metastore requests.
> Hive API provides following relevant APIs right now:
> * listing DBs
> * getting all table names in DB
> * listing all table _objects_ in all _dbs_
> What's seems to be missing, is API call for all table names in all DBs (as 
> middle ground between n+1 API requests and 1 API request with huge payload 
> and n*m+1 metastore requests on backend).
> This api request should take no parameters, and return Map List> in response.
> Proposed API endpoint: TBD



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)