[jira] [Commented] (GRIFFIN-160) Anomaly detection for thousands of tables

2018-05-11 Thread Enrico D'Urso (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472199#comment-16472199 ] Enrico D'Urso commented on GRIFFIN-160: --- Hi, there are several ways to go for anom

RE: No Index Formation in Elastic Search

2018-05-11 Thread Karan Gupta
Hi Lionel, I searched the source to find where the metrics are stored in ES. We found that "addMetricValues" implementation in metricStoreImpl.java is the one that uses "bulk" API of ES to update the metrics in ES. I added a few print statements out there to examine what is being written But my

[jira] [Created] (GRIFFIN-164) Make 'Regular expression detection count' available in UI

2018-05-11 Thread Enrico D'Urso (JIRA)
Enrico D'Urso created GRIFFIN-164: - Summary: Make 'Regular expression detection count' available in UI Key: GRIFFIN-164 URL: https://issues.apache.org/jira/browse/GRIFFIN-164 Project: Griffin (Incubati

RE: No Index Formation in Elastic Search

2018-05-11 Thread Karan Gupta
Hi Lionel, Thank you for your quick revert. I recreated the ES index as you suggested. I no more see any errors on Griffin console as I used to see earlier. But I don’t see any documents on the ES index either… The Jobs are running and completing though and HDFS is having the latest job run metr

Re: No Index Formation in Elastic Search

2018-05-11 Thread Lionel Liu
Hi Karan, I've double checked my environment, sorry for the last reply, I pasted the old version one. In the current version, the metric does like this: { "name" : "accu_job", "tmst" : 152481240, "value" : { "total" : 125000, "miss" : 505,

RE: No Index Formation in Elastic Search

2018-05-11 Thread Karan Gupta
Hi, Following is a sample JSON that is stored in HDFS by Griffin. It resides in : hdfs:///griffin/streaming/persist/job_names/152580492/_METRICS There are also _LOG, _START, __missRecords files created for each Job. I assume they are not meant for storage in ES. Sample JSON: {"metricName":

[RESULT][VOTE] Release of Apache-Griffin-0.2.0-incubating [RC4]

2018-05-11 Thread Lionel Liu
Dear IPMC Community, I am pleased to announce that the Incubator PMC has approved the release of Apache Griffin-0.2.0-incubating. The vote has passed with: 3 binding "+1" votes, and 4 non-binding "+1" votes no "0" votes no "-1" votes The votes were https://lists.apache.org/thread.ht

[jira] [Assigned] (GRIFFIN-129) [Community] Build charter for Griffin community

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu reassigned GRIFFIN-129: -- Assignee: Alex Lv (was: Juan Li) > [Community] Build charter for Griffin community >

[jira] [Created] (GRIFFIN-163) [Measure] Merge 0.2.0 for spark 2 into master branch

2018-05-11 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-163: -- Summary: [Measure] Merge 0.2.0 for spark 2 into master branch Key: GRIFFIN-163 URL: https://issues.apache.org/jira/browse/GRIFFIN-163 Project: Griffin (Incubating)

[jira] [Updated] (GRIFFIN-123) [Measure] Code review of measure module, refactor and enhance the code style

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-123: --- Sprint: Apache Sprint 2, Apache Sprint 4 (was: Apache Sprint 2, Apache Sprint 3) > [Measure] Code r

[jira] [Updated] (GRIFFIN-133) [UI] Add missing records download link on UI

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-133: --- Sprint: Apache Sprint 4 > [UI] Add missing records download link on UI >

[jira] [Assigned] (GRIFFIN-133) [UI] Add missing records download link on UI

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu reassigned GRIFFIN-133: -- Assignee: Yuqin Xuan (was: Alex Lv) > [UI] Add missing records download link on UI >

[jira] [Updated] (GRIFFIN-114) [Service][UT] Enhance unit test of config, info, util in service module

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-114: --- Sprint: Apache Sprint 2, Apache Sprint 4 (was: Apache Sprint 2, Apache Sprint 3) > [Service][UT] En

[jira] [Assigned] (GRIFFIN-113) [Service][UT] Enhance unit test of measure, job, metric in service module

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu reassigned GRIFFIN-113: -- Assignee: Qiyuan Zhou (was: wanyin) > [Service][UT] Enhance unit test of measure, job, metric

[jira] [Assigned] (GRIFFIN-115) [Measure][UT] Enhance UT of rule part in measure module

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu reassigned GRIFFIN-115: -- Assignee: William Guo (was: Qiyuan Zhou) > [Measure][UT] Enhance UT of rule part in measure m

[jira] [Updated] (GRIFFIN-147) [Doc] Griffin use case document of Personalization Platform in eBay

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-147: --- Summary: [Doc] Griffin use case document of Personalization Platform in eBay (was: [Doc] Use case do

[jira] [Updated] (GRIFFIN-113) [Service][UT] Enhance unit test of measure, job, metric in service module

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-113: --- Sprint: Apache Sprint 4 > [Service][UT] Enhance unit test of measure, job, metric in service module >

[jira] [Updated] (GRIFFIN-147) [Doc] Use case document of Bullseye

2018-05-11 Thread Lionel Liu (JIRA)
[ https://issues.apache.org/jira/browse/GRIFFIN-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionel Liu updated GRIFFIN-147: --- Sprint: Apache Sprint 4 (was: Apache Sprint 3) > [Doc] Use case document of Bullseye > -

[jira] [Created] (GRIFFIN-162) UI improvement for deployment in specific production env

2018-05-11 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-162: -- Summary: UI improvement for deployment in specific production env Key: GRIFFIN-162 URL: https://issues.apache.org/jira/browse/GRIFFIN-162 Project: Griffin (Incubating)

[jira] [Created] (GRIFFIN-161) FAQ from user questions

2018-05-11 Thread Lionel Liu (JIRA)
Lionel Liu created GRIFFIN-161: -- Summary: FAQ from user questions Key: GRIFFIN-161 URL: https://issues.apache.org/jira/browse/GRIFFIN-161 Project: Griffin (Incubating) Issue Type: Task