[jira] [Work logged] (GRIFFIN-1) Refactor service code to make it more open and extensible.

2017-03-16 Thread William Guo (JIRA)

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-1?focusedWorklogId=39392=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-39392
 ]

William Guo logged work on GRIFFIN-1:
-

Author: William Guo
Created on: 16/Mar/17 19:49
Start Date: 16/Mar/17 19:47
Worklog Time Spent: 1h 
  Work Description: Customize serializable function with jpa is not our 
first priority.
We can create function registry center somehow later on.

Issue Time Tracking
---

Worklog Id: (was: 39392)
Time Spent: 17h  (was: 16h)
Remaining Estimate: 319h  (was: 320h)

> Refactor service code to make it more open and extensible.
> --
>
> Key: GRIFFIN-1
> URL: https://issues.apache.org/jira/browse/GRIFFIN-1
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: William Guo
>Assignee: William Guo
>  Labels: github-import
>   Original Estimate: 336h
>  Time Spent: 17h
>  Remaining Estimate: 319h
>
> This project was embedded some legacy features from previous version.
> We need to make it more open and extensible for service layer.
> 1 Let users to configure data source service endpoint.
> 2 Let users to configure underlying database instead of hardcode it as mongo.
> 3 Replace jersey service with spring mvc.
> 4 Replace jdbc connection with JPA Spring implemetation.
> 5 Refactor core modesl like data assert, DQSpec, DQRule to make it more 
> extensible.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Work logged] (GRIFFIN-1) Refactor service code to make it more open and extensible.

2017-03-16 Thread William Guo (JIRA)

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-1?focusedWorklogId=39389=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-39389
 ]

William Guo logged work on GRIFFIN-1:
-

Author: William Guo
Created on: 16/Mar/17 18:51
Start Date: 16/Mar/17 18:50
Worklog Time Spent: 4h 
  Work Description: it seems jpa don't support crud for lambda.

Issue Time Tracking
---

Worklog Id: (was: 39389)
Time Spent: 16h  (was: 12h)
Remaining Estimate: 320h  (was: 324h)

> Refactor service code to make it more open and extensible.
> --
>
> Key: GRIFFIN-1
> URL: https://issues.apache.org/jira/browse/GRIFFIN-1
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: William Guo
>Assignee: William Guo
>  Labels: github-import
>   Original Estimate: 336h
>  Time Spent: 16h
>  Remaining Estimate: 320h
>
> This project was embedded some legacy features from previous version.
> We need to make it more open and extensible for service layer.
> 1 Let users to configure data source service endpoint.
> 2 Let users to configure underlying database instead of hardcode it as mongo.
> 3 Replace jersey service with spring mvc.
> 4 Replace jdbc connection with JPA Spring implemetation.
> 5 Refactor core modesl like data assert, DQSpec, DQRule to make it more 
> extensible.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Work logged] (GRIFFIN-1) Refactor service code to make it more open and extensible.

2017-03-14 Thread William Guo (JIRA)

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-1?focusedWorklogId=39173=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-39173
 ]

William Guo logged work on GRIFFIN-1:
-

Author: William Guo
Created on: 14/Mar/17 22:52
Start Date: 14/Mar/17 22:51
Worklog Time Spent: 8h 
  Work Description: 1,2 done.
4 done.

3, 5 developing.

Issue Time Tracking
---

Worklog Id: (was: 39173)
Time Spent: 12h  (was: 4h)
Remaining Estimate: 324h  (was: 332h)

> Refactor service code to make it more open and extensible.
> --
>
> Key: GRIFFIN-1
> URL: https://issues.apache.org/jira/browse/GRIFFIN-1
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: William Guo
>Assignee: William Guo
>  Labels: github-import
>   Original Estimate: 336h
>  Time Spent: 12h
>  Remaining Estimate: 324h
>
> This project was embedded some legacy features from previous version.
> We need to make it more open and extensible for service layer.
> 1 Let users to configure data source service endpoint.
> 2 Let users to configure underlying database instead of hardcode it as mongo.
> 3 Replace jersey service with spring mvc.
> 4 Replace jdbc connection with JPA Spring implemetation.
> 5 Refactor core modesl like data assert, DQSpec, DQRule to make it more 
> extensible.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Work logged] (GRIFFIN-1) Refactor service code to make it more open and extensible.

2017-03-09 Thread William Guo (JIRA)

 [ 
https://issues.apache.org/jira/browse/GRIFFIN-1?focusedWorklogId=38834=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-38834
 ]

William Guo logged work on GRIFFIN-1:
-

Author: William Guo
Created on: 10/Mar/17 07:03
Start Date: 10/Mar/17 06:57
Worklog Time Spent: 4h 
  Work Description: refactoring 
existing accuracy measure model is like

{
  "source": "soj_view_event",
  "target": "be_view_event_queue",
  "accuracyMapping": [
{
  "sourceColId": 0,
  "sourceColName": "uid",
  "targetColId": 0,
  "targetColName": "uid",
  "matchFunction": "true",
  "isPK": true
},
{
  "sourceColId": 2,
  "sourceColName": "page_id",
  "targetColId": 1,
  "targetColName": "page_id",
  "matchFunction": "false",
  "isPK": false
},
{
  "sourceColId": 1,
  "sourceColName": "site_id",
  "targetColId": 2,
  "targetColName": "site_id",
  "matchFunction": "false",
  "isPK": false
},
{
  "sourceColId": 3,
  "sourceColName": "curprice",
  "targetColId": 5,
  "targetColName": "curprice",
  "matchFunction": "false",
  "isPK": false
},
{
  "sourceColId": 4,
  "sourceColName": "itm",
  "targetColId": 6,
  "targetColName": "itm",
  "matchFunction": "false",
  "isPK": false
}
  ],
  "srcPartitions": [
{
  "colName": "dt",
  "colValue": "20160703"
},
{
  "colName": "hour",
  "colValue": "20"
}
  ],
  "tgtPartitions": [
[
  {
"colName": "dt",
"colValue": "20160703"
  },
  {
"colName": "hour",
"colValue": "20"
  }
],
[
  {
"colName": "dt",
"colValue": "20160703"
  },
  {
"colName": "hour",
"colValue": "21"
  }
]
  ]
}

We need to separate partition(dt and hour) out of DataAsset abstract, we can 
create a new interface under data asset to encapsulate WHICH 
PART(partition-timeline based perspective or other dimensions) of DataAsset.

Issue Time Tracking
---

Worklog Id: (was: 38834)
Time Spent: 4h
Remaining Estimate: 332h  (was: 336h)

> Refactor service code to make it more open and extensible.
> --
>
> Key: GRIFFIN-1
> URL: https://issues.apache.org/jira/browse/GRIFFIN-1
> Project: Griffin (Incubating)
>  Issue Type: Task
>Reporter: William Guo
>Assignee: William Guo
>  Labels: github-import
>   Original Estimate: 336h
>  Time Spent: 4h
>  Remaining Estimate: 332h
>
> This project was embedded some legacy features from our company.
> We need to make it more open and extensible for service layer.
> 1 Let users to configure data source service endpoint.
> 2 Let users to configure underlying database instead of hardcode it as mongo.
> 3 Replace jersey service with spring mvc.
> 4 Replace jdbc connection with JPA Spring implemetation.
> 5 Refactor core modesl like data assert, DQSpec, DQRule to make it more 
> extensible.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)