[jira] [Updated] (KYLIN-2035) Auto Merge Submit Continuously
[ https://issues.apache.org/jira/browse/KYLIN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang updated KYLIN-2035: --- Attachment: (was: 0001-KYLIN-2035-Auto-Merge-Submit-Continuously.patch) > Auto Merge Submit Continuously > -- > > Key: KYLIN-2035 > URL: https://issues.apache.org/jira/browse/KYLIN-2035 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: Future, v1.5.2 > Environment: CentOS6.0, Hadoop Env >Reporter: Copperfield >Assignee: Dong Li > Labels: features > Fix For: Future, v1.5.4 > > Attachments: 0001-KYLIN-2035-Auto-Merge-Submit-Continuously-v2.patch > > Original Estimate: 252h > Remaining Estimate: 252h > > If you set merge job's time range, once the time trigger, then kylin > automatically start merging cube. But if the merge job error, then the > administrator has to discard it manually, but merge job will continuously > submit, so new segment can not be build. > On the other hand, we'll hope merge job can run in parallel with build job. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (KYLIN-2035) Auto Merge Submit Continuously
[ https://issues.apache.org/jira/browse/KYLIN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513204#comment-15513204 ] Xiaoyu Wang edited comment on KYLIN-2035 at 9/22/16 12:46 PM: -- This is the new patch v2 was (Author: wangxiaoyu): This is the new patch > Auto Merge Submit Continuously > -- > > Key: KYLIN-2035 > URL: https://issues.apache.org/jira/browse/KYLIN-2035 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: Future, v1.5.2 > Environment: CentOS6.0, Hadoop Env >Reporter: Copperfield >Assignee: Dong Li > Labels: features > Fix For: Future, v1.5.4 > > Attachments: 0001-KYLIN-2035-Auto-Merge-Submit-Continuously-v2.patch > > Original Estimate: 252h > Remaining Estimate: 252h > > If you set merge job's time range, once the time trigger, then kylin > automatically start merging cube. But if the merge job error, then the > administrator has to discard it manually, but merge job will continuously > submit, so new segment can not be build. > On the other hand, we'll hope merge job can run in parallel with build job. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-2035) Auto Merge Submit Continuously
[ https://issues.apache.org/jira/browse/KYLIN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang updated KYLIN-2035: --- Attachment: 0001-KYLIN-2035-Auto-Merge-Submit-Continuously-v2.patch This is the new patch > Auto Merge Submit Continuously > -- > > Key: KYLIN-2035 > URL: https://issues.apache.org/jira/browse/KYLIN-2035 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: Future, v1.5.2 > Environment: CentOS6.0, Hadoop Env >Reporter: Copperfield >Assignee: Dong Li > Labels: features > Fix For: Future, v1.5.4 > > Attachments: 0001-KYLIN-2035-Auto-Merge-Submit-Continuously-v2.patch > > Original Estimate: 252h > Remaining Estimate: 252h > > If you set merge job's time range, once the time trigger, then kylin > automatically start merging cube. But if the merge job error, then the > administrator has to discard it manually, but merge job will continuously > submit, so new segment can not be build. > On the other hand, we'll hope merge job can run in parallel with build job. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-2035) Auto Merge Submit Continuously
[ https://issues.apache.org/jira/browse/KYLIN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513017#comment-15513017 ] Xiaoyu Wang commented on KYLIN-2035: Sorry, the patch has a bug! I will fixed it soon! > Auto Merge Submit Continuously > -- > > Key: KYLIN-2035 > URL: https://issues.apache.org/jira/browse/KYLIN-2035 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: Future, v1.5.2 > Environment: CentOS6.0, Hadoop Env >Reporter: Copperfield >Assignee: Dong Li > Labels: features > Fix For: Future, v1.5.4 > > Attachments: 0001-KYLIN-2035-Auto-Merge-Submit-Continuously.patch > > Original Estimate: 252h > Remaining Estimate: 252h > > If you set merge job's time range, once the time trigger, then kylin > automatically start merging cube. But if the merge job error, then the > administrator has to discard it manually, but merge job will continuously > submit, so new segment can not be build. > On the other hand, we'll hope merge job can run in parallel with build job. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-2035) Auto Merge Submit Continuously
[ https://issues.apache.org/jira/browse/KYLIN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang updated KYLIN-2035: --- Attachment: 0001-KYLIN-2035-Auto-Merge-Submit-Continuously.patch Here is the patch, please review. [~lidong_sjtu] > Auto Merge Submit Continuously > -- > > Key: KYLIN-2035 > URL: https://issues.apache.org/jira/browse/KYLIN-2035 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: Future, v1.5.2 > Environment: CentOS6.0, Hadoop Env >Reporter: Copperfield >Assignee: Dong Li > Labels: features > Fix For: Future, v1.5.4 > > Attachments: 0001-KYLIN-2035-Auto-Merge-Submit-Continuously.patch > > Original Estimate: 252h > Remaining Estimate: 252h > > If you set merge job's time range, once the time trigger, then kylin > automatically start merging cube. But if the merge job error, then the > administrator has to discard it manually, but merge job will continuously > submit, so new segment can not be build. > On the other hand, we'll hope merge job can run in parallel with build job. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1726) Scalable streaming cubing
[ https://issues.apache.org/jira/browse/KYLIN-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326455#comment-15326455 ] Xiaoyu Wang commented on KYLIN-1726: What is the problem about join in streaming cube? Dimension table's size?Dimension table's update? > Scalable streaming cubing > - > > Key: KYLIN-1726 > URL: https://issues.apache.org/jira/browse/KYLIN-1726 > Project: Kylin > Issue Type: New Feature >Reporter: liyang >Assignee: liyang > > We try to achieve: > 1. Scale streaming cubing workload on a computation cluster, e.g. YARN > 2. Support Kafka as a formal data source > 3. Guarantee no data loss reading from Kafka, even records are not strictly > ordered by time -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1726) Scalable streaming cubing
[ https://issues.apache.org/jira/browse/KYLIN-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326313#comment-15326313 ] Xiaoyu Wang commented on KYLIN-1726: Does streaming cube only support one streaming fact table in cube? Not support join in streaming cube now? > Scalable streaming cubing > - > > Key: KYLIN-1726 > URL: https://issues.apache.org/jira/browse/KYLIN-1726 > Project: Kylin > Issue Type: New Feature >Reporter: liyang >Assignee: liyang > > We try to achieve: > 1. Scale streaming cubing workload on a computation cluster, e.g. YARN > 2. Support Kafka as a formal data source > 3. Guarantee no data loss reading from Kafka, even records are not strictly > ordered by time -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1764) Add a document of RAW measure
[ https://issues.apache.org/jira/browse/KYLIN-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15320634#comment-15320634 ] Xiaoyu Wang commented on KYLIN-1764: In version 1.5.1 has already contains the feature! > Add a document of RAW measure > - > > Key: KYLIN-1764 > URL: https://issues.apache.org/jira/browse/KYLIN-1764 > Project: Kylin > Issue Type: Bug > Components: Documentation >Reporter: Xiaoyu Wang >Assignee: Xiaoyu Wang >Priority: Minor > > Add a document of RAW measure -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1764) Add a document of RAW measure
[ https://issues.apache.org/jira/browse/KYLIN-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319893#comment-15319893 ] Xiaoyu Wang commented on KYLIN-1764: http://kylin.apache.org/blog/2016/05/29/raw-measure-in-kylin/ > Add a document of RAW measure > - > > Key: KYLIN-1764 > URL: https://issues.apache.org/jira/browse/KYLIN-1764 > Project: Kylin > Issue Type: Bug > Components: Documentation >Reporter: Xiaoyu Wang >Assignee: Xiaoyu Wang >Priority: Minor > > Add a document of RAW measure -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (KYLIN-1764) Add a document of RAW measure
[ https://issues.apache.org/jira/browse/KYLIN-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang resolved KYLIN-1764. Resolution: Fixed fixed > Add a document of RAW measure > - > > Key: KYLIN-1764 > URL: https://issues.apache.org/jira/browse/KYLIN-1764 > Project: Kylin > Issue Type: Bug > Components: Documentation >Reporter: Xiaoyu Wang >Assignee: Xiaoyu Wang >Priority: Minor > > Add a document of RAW measure -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1764) Add a document of RAW measure
Xiaoyu Wang created KYLIN-1764: -- Summary: Add a document of RAW measure Key: KYLIN-1764 URL: https://issues.apache.org/jira/browse/KYLIN-1764 Project: Kylin Issue Type: Bug Components: Documentation Reporter: Xiaoyu Wang Assignee: Xiaoyu Wang Priority: Minor Add a document of RAW measure -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1569) Select any column when adding a custom aggregation in GUI
Xiaoyu Wang created KYLIN-1569: -- Summary: Select any column when adding a custom aggregation in GUI Key: KYLIN-1569 URL: https://issues.apache.org/jira/browse/KYLIN-1569 Project: Kylin Issue Type: Bug Components: Web Affects Versions: v1.3.0, v1.5.0 Reporter: Xiaoyu Wang Assignee: Zhong,Jason Fix For: v1.3.1, v1.5.1 For the last comment from liyang at KYLIN-1122. "should have modified GUI such that user can select any column when adding a custom aggregation. We have extended the role of aggregation types, it makes sense to allow selecting from both dimension columns and measure columns." -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang updated KYLIN-1122: --- Fix Version/s: (was: Backlog) v1.5.1 v1.3.1 > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v1.3.1, v1.5.1 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > -I change some code to support this issue:- > -Add a "VALUE" measure function : the same value and datatype in the input > and output of this function.- > -If you want to query detail data from fact table- > -*require*:- > -1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value)- > -2.The source table must has an unique value column and configure it as > dimension.- > If you have the better solution please comment here. > 2016-03-21: > The final solution: > Add a "RAW" measure function which return the list of all the value by one > key. > If query detail data from fact table > *require*: > Configure the column to "RAW" measure.(If not configure measure function in > the column and do the RAW query will get the incorrect value!) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (KYLIN-1476) Support measure dictionary in 1.3
[ https://issues.apache.org/jira/browse/KYLIN-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang resolved KYLIN-1476. Resolution: Fixed Fixed in 1.3.x branch > Support measure dictionary in 1.3 > - > > Key: KYLIN-1476 > URL: https://issues.apache.org/jira/browse/KYLIN-1476 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v1.3.1 > > > In 2.x-staging branch, custom measure function can use dictionary to save > values. > so,get it back to 1.x branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang resolved KYLIN-1122. Resolution: Fixed Fixed at master and 1.3.x branch > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: Backlog > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > -I change some code to support this issue:- > -Add a "VALUE" measure function : the same value and datatype in the input > and output of this function.- > -If you want to query detail data from fact table- > -*require*:- > -1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value)- > -2.The source table must has an unique value column and configure it as > dimension.- > If you have the better solution please comment here. > 2016-03-21: > The final solution: > Add a "RAW" measure function which return the list of all the value by one > key. > If query detail data from fact table > *require*: > Configure the column to "RAW" measure.(If not configure measure function in > the column and do the RAW query will get the incorrect value!) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[
https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204098#comment-15204098
]
Xiaoyu Wang commented on KYLIN-1122:
I merge the code into {{1.3.x}} and {{master}} branch.
IT tests is passed at the two branches!
For the 1.3.x branch. {{SQLDigest.isRawQuery}} is a little different with
master branch:in 1.3.x branch,the {{metricColumns}} may be empty in some
scenario like
{noformat}
SELECT
sum(test_kylin_fact.price) as GMV
, count(*) as TRANS_CNT
FROM test_kylin_fact
inner JOIN edw.test_cal_dt as test_cal_dt
ON test_kylin_fact.cal_dt = test_cal_dt.cal_dt
inner JOIN test_category_groupings
ON test_kylin_fact.leaf_categ_id = test_category_groupings.leaf_categ_id AND
test_kylin_fact.lstg_site_id = test_category_groupings.site_id
inner JOIN edw.test_sites as test_sites
ON test_kylin_fact.lstg_site_id = test_sites.site_id
inner JOIN edw.test_seller_type_dim as test_seller_type_dim
ON test_kylin_fact.slr_segment_cd = test_seller_type_dim.seller_type_cd
{noformat}
So I change to derive from both {{groupbyColumns}} and {{aggregations}}!
> Kylin support detail data query from fact table
> ---
>
> Key: KYLIN-1122
> URL: https://issues.apache.org/jira/browse/KYLIN-1122
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Affects Versions: v1.2
>Reporter: Xiaoyu Wang
>Assignee: liyang
> Fix For: Backlog
>
> Attachments:
> 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch,
> 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch,
>
> 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch
>
>
> Now Kylin does not support query correct detail rows from fact table like:
> select column1,column2,column3 from fact_table
> The jira KYLIN-1075 add the "SUM" function on the measure column if defined.
> But only the column number type is support.
> -I change some code to support this issue:-
> -Add a "VALUE" measure function : the same value and datatype in the input
> and output of this function.-
> -If you want to query detail data from fact table-
> -*require*:-
> -1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If
> not configure measure function in the column will get NULL value)-
> -2.The source table must has an unique value column and configure it as
> dimension.-
> If you have the better solution please comment here.
> 2016-03-21:
> The final solution:
> Add a "RAW" measure function which return the list of all the value by one
> key.
> If query detail data from fact table
> *require*:
> Configure the column to "RAW" measure.(If not configure measure function in
> the column and do the RAW query will get the incorrect value!)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang updated KYLIN-1122: --- Description: Now Kylin does not support query correct detail rows from fact table like: select column1,column2,column3 from fact_table The jira KYLIN-1075 add the "SUM" function on the measure column if defined. But only the column number type is support. -I change some code to support this issue:- -Add a "VALUE" measure function : the same value and datatype in the input and output of this function.- -If you want to query detail data from fact table- -*require*:- -1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If not configure measure function in the column will get NULL value)- -2.The source table must has an unique value column and configure it as dimension.- If you have the better solution please comment here. 2016-03-21: The final solution: Add a "RAW" measure function which return the list of all the value by one key. If query detail data from fact table *require*: Configure the column to "RAW" measure.(If not configure measure function in the column and do the RAW query will get the incorrect value!) was: Now Kylin does not support query correct detail rows from fact table like: select column1,column2,column3 from fact_table The jira KYLIN-1075 add the "SUM" function on the measure column if defined. But only the column number type is support. I change some code to support this issue: Add a "VALUE" measure function : the same value and datatype in the input and output of this function. -If you want to query detail data from fact table- -*require*:- -1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If not configure measure function in the column will get NULL value)- -2.The source table must has an unique value column and configure it as dimension.- If you have the better solution please comment here. 2016-03-21: The final solution: Add a "RAW" measure function which return the list of all the value by one key. If query detail data from fact table *require*: Configure the column to "RAW" measure.(If not configure measure function in the column and do the RAW query will get the incorrect value!) > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: Backlog > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > -I change some code to support this issue:- > -Add a "VALUE" measure function : the same value and datatype in the input > and output of this function.- > -If you want to query detail data from fact table- > -*require*:- > -1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value)- > -2.The source table must has an unique value column and configure it as > dimension.- > If you have the better solution please comment here. > 2016-03-21: > The final solution: > Add a "RAW" measure function which return the list of all the value by one > key. > If query detail data from fact table > *require*: > Configure the column to "RAW" measure.(If not configure measure function in > the column and do the RAW query will get the incorrect value!) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang updated KYLIN-1122: --- Description: Now Kylin does not support query correct detail rows from fact table like: select column1,column2,column3 from fact_table The jira KYLIN-1075 add the "SUM" function on the measure column if defined. But only the column number type is support. I change some code to support this issue: Add a "VALUE" measure function : the same value and datatype in the input and output of this function. -If you want to query detail data from fact table- -*require*:- -1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If not configure measure function in the column will get NULL value)- -2.The source table must has an unique value column and configure it as dimension.- If you have the better solution please comment here. 2016-03-21: The final solution: Add a "RAW" measure function which return the list of all the value by one key. If query detail data from fact table *require*: Configure the column to "RAW" measure.(If not configure measure function in the column and do the RAW query will get the incorrect value!) was: Now Kylin does not support query correct detail rows from fact table like: select column1,column2,column3 from fact_table The jira KYLIN-1075 add the "SUM" function on the measure column if defined. But only the column number type is support. I change some code to support this issue: Add a "VALUE" measure function : the same value and datatype in the input and output of this function. If you want to query detail data from fact table *require*: 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If not configure measure function in the column will get NULL value) 2.The source table must has an unique value column and configure it as dimension. If you have the better solution please comment here. 2016-03-21: The final solution: Add a "RAW" measure function which return the list of all the value by one key. If query detail data from fact table *require*: Configure the column to "RAW" measure.(If not configure measure function in the column will get NULL value) > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: Backlog > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > -If you want to query detail data from fact table- > -*require*:- > -1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value)- > -2.The source table must has an unique value column and configure it as > dimension.- > If you have the better solution please comment here. > 2016-03-21: > The final solution: > Add a "RAW" measure function which return the list of all the value by one > key. > If query detail data from fact table > *require*: > Configure the column to "RAW" measure.(If not configure measure function in > the column and do the RAW query will get the incorrect value!) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang updated KYLIN-1122: --- Description: Now Kylin does not support query correct detail rows from fact table like: select column1,column2,column3 from fact_table The jira KYLIN-1075 add the "SUM" function on the measure column if defined. But only the column number type is support. I change some code to support this issue: Add a "VALUE" measure function : the same value and datatype in the input and output of this function. If you want to query detail data from fact table *require*: 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If not configure measure function in the column will get NULL value) 2.The source table must has an unique value column and configure it as dimension. If you have the better solution please comment here. 2016-03-21: The final solution: Add a "RAW" measure function which return the list of all the value by one key. If query detail data from fact table *require*: Configure the column to "RAW" measure.(If not configure measure function in the column will get NULL value) was: Now Kylin does not support query correct detail rows from fact table like: select column1,column2,column3 from fact_table The jira KYLIN-1075 add the "SUM" function on the measure column if defined. But only the column number type is support. I change some code to support this issue: Add a "VALUE" measure function : the same value and datatype in the input and output of this function. If you want to query detail data from fact table *require*: 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If not configure measure function in the column will get NULL value) 2.The source table must has an unique value column and configure it as dimension. If you have the better solution please comment here. > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: Backlog > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. > 2016-03-21: > The final solution: > Add a "RAW" measure function which return the list of all the value by one > key. > If query detail data from fact table > *require*: > Configure the column to "RAW" measure.(If not configure measure function in > the column will get NULL value) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[
https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203245#comment-15203245
]
Xiaoyu Wang commented on KYLIN-1122:
for the {{SQLDigest.isRawQuery}} property .
I think it derive from both {{groupbyColumns}} and {{metricColumns}} will be
correct!
if only derive from {{groupbyColumns}}, the sql: "select sum(price) as GMV,
count(1) as TRANS_CNT from test_kylin_fact" will be identified "RawQuery". and
in "RawQuery",it will add RAW agg function on all column which defined RAW
measure,and remove SUM agg on the column which hack from {{OLAPEnumerator}}.
that is not expect! [~liyang.g...@gmail.com]
> Kylin support detail data query from fact table
> ---
>
> Key: KYLIN-1122
> URL: https://issues.apache.org/jira/browse/KYLIN-1122
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Affects Versions: v1.2
>Reporter: Xiaoyu Wang
>Assignee: liyang
> Fix For: Backlog
>
> Attachments:
> 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch,
> 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch,
>
> 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch
>
>
> Now Kylin does not support query correct detail rows from fact table like:
> select column1,column2,column3 from fact_table
> The jira KYLIN-1075 add the "SUM" function on the measure column if defined.
> But only the column number type is support.
> I change some code to support this issue:
> Add a "VALUE" measure function : the same value and datatype in the input and
> output of this function.
> If you want to query detail data from fact table
> *require*:
> 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If
> not configure measure function in the column will get NULL value)
> 2.The source table must has an unique value column and configure it as
> dimension.
> If you have the better solution please comment here.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203067#comment-15203067 ] Xiaoyu Wang commented on KYLIN-1122: Thanks [~liyang.g...@gmail.com] I will move the logic to the constructor of SQLDigest! and IT tests,finally merge into master. > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: Backlog > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187167#comment-15187167 ] Xiaoyu Wang commented on KYLIN-1122: KYLIN-1122-B1 branch base on 1.x-staging is created! IT test and mvn test is passed! Please help to review [~liyang.g...@gmail.com] > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.1, v1.4 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1476) Support measure dictionary in 1.x
[ https://issues.apache.org/jira/browse/KYLIN-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185115#comment-15185115 ] Xiaoyu Wang commented on KYLIN-1476: The patch will in the KYLIN-1122-B1 branch. > Support measure dictionary in 1.x > - > > Key: KYLIN-1476 > URL: https://issues.apache.org/jira/browse/KYLIN-1476 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v1.4 > > > In 2.x-staging branch, custom measure function can use dictionary to save > values. > so,get it back to 1.x branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1476) Support measure dictionary in 1.x
Xiaoyu Wang created KYLIN-1476: -- Summary: Support measure dictionary in 1.x Key: KYLIN-1476 URL: https://issues.apache.org/jira/browse/KYLIN-1476 Project: Kylin Issue Type: Bug Components: Query Engine Affects Versions: v1.2 Reporter: Xiaoyu Wang Assignee: liyang Fix For: v1.4 In 2.x-staging branch, custom measure function can use dictionary to save values. so,get it back to 1.x branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181972#comment-15181972 ] Xiaoyu Wang commented on KYLIN-1122: Sorry for my late contribute! recently busy! I create a branch KYLIN-1122-B2 base on 2.x-staging. The IT tests run successful! Please [~liyang.g...@gmail.com] help to review! I'm working on the patch for 1.x. and create a branch base on 1.x-staging later! > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.1, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15133552#comment-15133552 ] Xiaoyu Wang commented on KYLIN-1122: Thanks hongbin! I will take a look. > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[
https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15132352#comment-15132352
]
Xiaoyu Wang commented on KYLIN-1122:
Hi hongbin!
In branch 2.x-staging , the custom agg function can overwrite the function
"onlyAggrInBaseCuboid" in "MeasureType",if return true , when use this custom
function to query, it will only query the base cuboid data!
for example:
I write a RAW custom function, and want the raw data store only in base cuboid,
the "onlyAggrInBaseCuboid" return true.
In cube desc only config RAW measure on "col1"
when query like "select col1,col2 from fact_table" will be translate to "select
raw(col1),col2 from fact_table", and the query engine will route to extract the
base cuboid data.
the column col2 which does not config RAW measure will return null value!
so the sql "select col1,col2 from fact_table" will return :
{noformat}
col1 col2
v1 null
v2 null
v3 null
{noformat}
and the II test case will fail!
> Kylin support detail data query from fact table
> ---
>
> Key: KYLIN-1122
> URL: https://issues.apache.org/jira/browse/KYLIN-1122
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Affects Versions: v1.2
>Reporter: Xiaoyu Wang
>Assignee: liyang
> Fix For: v2.0, v1.3
>
> Attachments:
> 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch,
> 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch,
>
> 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch
>
>
> Now Kylin does not support query correct detail rows from fact table like:
> select column1,column2,column3 from fact_table
> The jira KYLIN-1075 add the "SUM" function on the measure column if defined.
> But only the column number type is support.
> I change some code to support this issue:
> Add a "VALUE" measure function : the same value and datatype in the input and
> output of this function.
> If you want to query detail data from fact table
> *require*:
> 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If
> not configure measure function in the column will get NULL value)
> 2.The source table must has an unique value column and configure it as
> dimension.
> If you have the better solution please comment here.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15132216#comment-15132216 ] Xiaoyu Wang commented on KYLIN-1122: When I add the integration test case for RAW query. I see the InvertedIndex test case in kylin-it/src/test/resources/query/sql_ii folder. The II case is support to query RAW data! This case is conflict with my RAW query case, because if one column defined RAW function,when select the column with out group by and other metric, it will be route to only query the base cuboid! so the II case will fail! Any suggestions? [~mahongbin] > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15104133#comment-15104133 ] Xiaoyu Wang commented on KYLIN-1122: I created a new request on review board. https://reviews.apache.org/r/42447/ > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15104085#comment-15104085 ] Xiaoyu Wang commented on KYLIN-1122: Thanks hongbin! I see, I agree with you to work with review board for both 1.x and 2.x branch, I will create a new request! > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15104082#comment-15104082 ] Xiaoyu Wang commented on KYLIN-1122: About this issue,How we can work together to do this? 1.Work on the KYLIN-1122 branch? and merge to 2.x-staging finally. After that I create a patch for 1.x-staging,and PMC can merge it. 2.Work on review board with "pre-commit" mode on 2.x-staging branch? We submit changes to review board, and merge to 2.x-staging branch finally. Is there any place where I understand that there is a mistake for review board? I try to submit change to review https://reviews.apache.org/r/42251/ and no permission! > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15101928#comment-15101928 ] Xiaoyu Wang commented on KYLIN-1122: rbt post -u or rbt post -r 42251 don't have permission too. > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[
https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15101790#comment-15101790
]
Xiaoyu Wang commented on KYLIN-1122:
Why I don't have permission on https://reviews.apache.org/r/42251/ to modify
review request or attach file?
I try to
{noformat}
rbt attach --caption "KYLIN-1122 add UT and bug fixed" 42251
0001-KYLIN-1122-add-UT-and-bug-fixed.patch
{noformat}
but got
{noformat}
ERROR: Error uploading file: You don't have permission for this (HTTP 403, API
Error 101)
{noformat}
> Kylin support detail data query from fact table
> ---
>
> Key: KYLIN-1122
> URL: https://issues.apache.org/jira/browse/KYLIN-1122
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Affects Versions: v1.2
>Reporter: Xiaoyu Wang
>Assignee: liyang
> Fix For: v2.0, v1.3
>
> Attachments:
> 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch,
> 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch,
>
> 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch
>
>
> Now Kylin does not support query correct detail rows from fact table like:
> select column1,column2,column3 from fact_table
> The jira KYLIN-1075 add the "SUM" function on the measure column if defined.
> But only the column number type is support.
> I change some code to support this issue:
> Add a "VALUE" measure function : the same value and datatype in the input and
> output of this function.
> If you want to query detail data from fact table
> *require*:
> 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If
> not configure measure function in the column will get NULL value)
> 2.The source table must has an unique value column and configure it as
> dimension.
> If you have the better solution please comment here.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15101225#comment-15101225 ] Xiaoyu Wang commented on KYLIN-1122: I see the review is create on 2.x-staging branch. And I create a branch KYLIN-1122, Is discard the 1122 branch or not ? > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Issue Comment Deleted] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang updated KYLIN-1122: --- Comment: was deleted (was: for the "3)" adjustSqlDigest may be contain the parameter "cubeDesc" will be better, In the raw custom function scenario, will use all columns or dimensions. ) > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095778#comment-15095778 ] Xiaoyu Wang commented on KYLIN-1122: for the "3)" adjustSqlDigest may be contain the parameter "cubeDesc" will be better, In the raw custom function scenario, will use all columns or dimensions. > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095779#comment-15095779 ] Xiaoyu Wang commented on KYLIN-1122: for the "3)" adjustSqlDigest may be contain the parameter "cubeDesc" will be better, In the raw custom function scenario, will use all columns or dimensions. > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093740#comment-15093740 ] Xiaoyu Wang commented on KYLIN-1122: I created a new branch "KYLIN-1122" base on 2.x-staging. and submit my patch. > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15091033#comment-15091033 ] Xiaoyu Wang commented on KYLIN-1122: Thanks [~liyang.g...@gmail.com] for the "1)" when create cube in frontend,it will call BasicMeasureType.validate() and it does not call the custom function's validate() funciton. I agree with you to create new branch to collaborate. about the patch, you are right, I will submit the new patch to 1.x-staging branch when the 2.x-staging patch is stable. > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang updated KYLIN-1122: --- Attachment: 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch Here is the new impl under the refactoring in 2.x-staging branch. [~liyang.g...@gmail.com],please help to review! and any suggestions? > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch, > > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact-new-impl-under-refactoring-2.x-staging.patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15070845#comment-15070845 ] Xiaoyu Wang commented on KYLIN-1122: Very nice! Another problem is RAW query is require the cube design with "left join" type. because it will let all RAW data in fact table save to hbase. I think user can accept this. > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15066011#comment-15066011 ] Xiaoyu Wang commented on KYLIN-1122: I have one problem in the custom function which RAW query: When the fact table does not include unique column, And the cube design the dimensions use the low cardinality column. then the measure value will very large even storage the dictionary value. like one dimension "dt" value "20151212" has 100W rows, when only "dt" dimension design in the cube. all the raw data which the other one column will save to one row in hbase. and the value is large. when sql query 100 rows, we will extract the one row in hbase with 100W rows and return 100 rows. it will influence the query performance. [~liyang.g...@gmail.com] What do you think? > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (KYLIN-1215) minor, update website member's info on community page
[ https://issues.apache.org/jira/browse/KYLIN-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang resolved KYLIN-1215. Resolution: Fixed > minor, update website member's info on community page > - > > Key: KYLIN-1215 > URL: https://issues.apache.org/jira/browse/KYLIN-1215 > Project: Kylin > Issue Type: Bug > Components: Website >Affects Versions: v1.1.1 >Reporter: Xiaoyu Wang >Assignee: Xiaoyu Wang >Priority: Minor > Fix For: v1.3 > > > Update the member's github id and apache id on community page. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1215) minor, update website member's info on community page
Xiaoyu Wang created KYLIN-1215: -- Summary: minor, update website member's info on community page Key: KYLIN-1215 URL: https://issues.apache.org/jira/browse/KYLIN-1215 Project: Kylin Issue Type: Bug Components: Website Affects Versions: v1.1.1 Reporter: Xiaoyu Wang Assignee: Xiaoyu Wang Priority: Minor Fix For: v1.3 Update the member's github id and apache id on community page. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1122) Kylin support detail data query from fact table
[ https://issues.apache.org/jira/browse/KYLIN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044569#comment-15044569 ] Xiaoyu Wang commented on KYLIN-1122: OK, Thanks liyang! I will try to change the code based on the new refactoring. > Kylin support detail data query from fact table > --- > > Key: KYLIN-1122 > URL: https://issues.apache.org/jira/browse/KYLIN-1122 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: v1.2 >Reporter: Xiaoyu Wang >Assignee: liyang > Fix For: v2.0, v1.3 > > Attachments: > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(2.x-staging).patch, > 0001-KYLIN-1122-Kylin-support-detail-data-query-from-fact(update-v2-1.x-staging).patch > > > Now Kylin does not support query correct detail rows from fact table like: > select column1,column2,column3 from fact_table > The jira KYLIN-1075 add the "SUM" function on the measure column if defined. > But only the column number type is support. > I change some code to support this issue: > Add a "VALUE" measure function : the same value and datatype in the input and > output of this function. > If you want to query detail data from fact table > *require*: > 1.Configure the column which not dimensions to "VALUE" or "SUM" measure.(If > not configure measure function in the column will get NULL value) > 2.The source table must has an unique value column and configure it as > dimension. > If you have the better solution please comment here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
