Re: [Dev] [BPS][DAS] Sorting feature and range faceting for the aggregated records
Hi,
On Tue, Nov 24, 2015 at 6:21 AM, Gimantha Bandara wrote:
> Hi Chathura,
>
> In DAS 3.0.0, aggregation of bucketed range is not supported. But if the
> aggregation is summation, we can use score-functions and use facet count
> APIs to aggregate per range.
>
> @Anjana, Shall we add this functionality as an improvement to DAS 3.0.1?
>
+1, let's discuss and plan the required functionality properly and add it.
Cheers,
Anjana.
>
> On Mon, Nov 23, 2015 at 1:46 AM, Chathura Ekanayake
> wrote:
>
>> Hi Gimantha,
>>
>> Instead of getting record counts, is there a way to get aggregates of
>> some numerical field with range faceting?
>>
>> Also, it would be useful to specify ranges as start value, end value and
>> gap, in addition to the method mentioned in the sample.
>>
>> Regards,
>> Chathura
>>
>>
>> On Mon, Nov 23, 2015 at 7:45 AM, Gimantha Bandara
>> wrote:
>>
>>> Hi Isuru,
>>>
>>> 1. DAS 3.0.0 does not support sorting aggregated data. But it can be
>>> considered as an improvement in 3.0.01
>>>
>>> 2. DAS 3.0.0 REST API support ranged faceting. You will have to give
>>> the boundaries for each range with a label name. Please refer to [1] for
>>> more info.
>>>
>>> [1]
>>> https://docs.wso2.com/display/DAS300/Retrieving+the+Event+Count+of+Range+Facets
>>>
>>>
>>> On Fri, Nov 20, 2015 at 12:01 PM, Rukshan Premathunga
>>> wrote:
>>>
Hi Isuru,
For 2nd issue, you can try with lucene range search[1].
[1] https://lucene.apache.org/core/2_9_4/queryparsersyntax.html#Range
Searches
Thanks and Regards.
On Fri, Nov 20, 2015 at 5:37 PM, Isuru Wijesinghe
wrote:
> Hi All,
>
> We're currently developing the dashboard for BPS statistics data and
> we encounter some problems mentioned below.
>
> 1.) Does DAS already support a sorting feature to retrieve the
> aggregated data in the ascending order ?
>
> Why we need sorting feature here because let's say as an example, if
> we are analyzing the involvement of different users in a particular
> process, we have to provide the process ID as the primary filter. There
> can
> be a large number of users in the system which could result in too many
> entries in the X axis. To overcome this, most graphs have to provide a
> secondary filter to obtain only top X or bottom X entries (asc or dsc
> ordering).
>
> When retrieving the records through the faceted search for the columns
> which have the aggregated values(eg: avg, sum, etc) from the DAS REST API,
> the data is usually listed in random order. As a solution for that, need
> to
> provide a mechanism in the DAS side to sort the records in the column such
> a way that they will be retrieved in a specific order so that it can be
> used to sort in ascending order, descending order according to the given
> column or multiple columns.
>
> eg: {
> "tableName": "USER_INVOLVE_SUMMARY_DATA",
> "groupByField": "processDefKey",
> "query": "assignee:admin",
> *"sort":"totalInvolvedTime asc"*,
> "aggregateFields": [
> {
> "fieldName": "duration",
> "aggregate": "SUM",
> "alias": "totalInvolvedTime"
> }
> ]
> }
>
> 2.) Is it possible to do range faceting in DAS?
>
> (Here the range facet produces multiple range buckets over numeric
> fields or date fields.)
> Let's say as an example we have a field called *price* in one of the
> summarized tables and we have that field faceted. We want to get the
> facets
> as ranges of values (*eg:* *0-100, 100-500, 500-1000, etc* - these
> are the ranges that prices fall into). Is it possible to calculate the
> ranges (facet counts for the ranges of prices - eg: say for 5 values)
> based
> on the values in the table ?
>
> --
> Isuru Wijesinghe
> *Software Engineer*
> WSO2 inc : http://wso2.com
> lean.enterprise.middleware
> Mobile: 0710933706
> isur...@wso2.com
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>
--
Rukshan Chathuranga.
Software Engineer.
WSO2, Inc.
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>> --
>>> Gimantha Bandara
>>> Software Engineer
>>> WSO2. Inc : http://wso2.com
>>> Mobile : +94714961919
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>
>
> --
> Gimantha Bandara
> Software Engineer
> WSO2. Inc : http://wso2.com
> Mobile : +94714961919
>
--
*Anjana Fernando*
Senior Technical Lead
WSO2 Inc. | http://wso2.com
lean . enterprise . midd
Re: [Dev] [BPS][DAS] Sorting feature and range faceting for the aggregated records
Hi Chathura,
In DAS 3.0.0, aggregation of bucketed range is not supported. But if the
aggregation is summation, we can use score-functions and use facet count
APIs to aggregate per range.
@Anjana, Shall we add this functionality as an improvement to DAS 3.0.1?
On Mon, Nov 23, 2015 at 1:46 AM, Chathura Ekanayake
wrote:
> Hi Gimantha,
>
> Instead of getting record counts, is there a way to get aggregates of some
> numerical field with range faceting?
>
> Also, it would be useful to specify ranges as start value, end value and
> gap, in addition to the method mentioned in the sample.
>
> Regards,
> Chathura
>
>
> On Mon, Nov 23, 2015 at 7:45 AM, Gimantha Bandara
> wrote:
>
>> Hi Isuru,
>>
>> 1. DAS 3.0.0 does not support sorting aggregated data. But it can be
>> considered as an improvement in 3.0.01
>>
>> 2. DAS 3.0.0 REST API support ranged faceting. You will have to give the
>> boundaries for each range with a label name. Please refer to [1] for more
>> info.
>>
>> [1]
>> https://docs.wso2.com/display/DAS300/Retrieving+the+Event+Count+of+Range+Facets
>>
>>
>> On Fri, Nov 20, 2015 at 12:01 PM, Rukshan Premathunga
>> wrote:
>>
>>> Hi Isuru,
>>>
>>> For 2nd issue, you can try with lucene range search[1].
>>>
>>> [1] https://lucene.apache.org/core/2_9_4/queryparsersyntax.html#Range
>>> Searches
>>>
>>> Thanks and Regards.
>>>
>>> On Fri, Nov 20, 2015 at 5:37 PM, Isuru Wijesinghe
>>> wrote:
>>>
Hi All,
We're currently developing the dashboard for BPS statistics data and we
encounter some problems mentioned below.
1.) Does DAS already support a sorting feature to retrieve the
aggregated data in the ascending order ?
Why we need sorting feature here because let's say as an example, if
we are analyzing the involvement of different users in a particular
process, we have to provide the process ID as the primary filter. There can
be a large number of users in the system which could result in too many
entries in the X axis. To overcome this, most graphs have to provide a
secondary filter to obtain only top X or bottom X entries (asc or dsc
ordering).
When retrieving the records through the faceted search for the columns
which have the aggregated values(eg: avg, sum, etc) from the DAS REST API,
the data is usually listed in random order. As a solution for that, need to
provide a mechanism in the DAS side to sort the records in the column such
a way that they will be retrieved in a specific order so that it can be
used to sort in ascending order, descending order according to the given
column or multiple columns.
eg: {
"tableName": "USER_INVOLVE_SUMMARY_DATA",
"groupByField": "processDefKey",
"query": "assignee:admin",
*"sort":"totalInvolvedTime asc"*,
"aggregateFields": [
{
"fieldName": "duration",
"aggregate": "SUM",
"alias": "totalInvolvedTime"
}
]
}
2.) Is it possible to do range faceting in DAS?
(Here the range facet produces multiple range buckets over numeric
fields or date fields.)
Let's say as an example we have a field called *price* in one of the
summarized tables and we have that field faceted. We want to get the facets
as ranges of values (*eg:* *0-100, 100-500, 500-1000, etc* - these are
the ranges that prices fall into). Is it possible to calculate the ranges
(facet counts for the ranges of prices - eg: say for 5 values) based on the
values in the table ?
--
Isuru Wijesinghe
*Software Engineer*
WSO2 inc : http://wso2.com
lean.enterprise.middleware
Mobile: 0710933706
isur...@wso2.com
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>> --
>>> Rukshan Chathuranga.
>>> Software Engineer.
>>> WSO2, Inc.
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>> Gimantha Bandara
>> Software Engineer
>> WSO2. Inc : http://wso2.com
>> Mobile : +94714961919
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
--
Gimantha Bandara
Software Engineer
WSO2. Inc : http://wso2.com
Mobile : +94714961919
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [BPS][DAS] Sorting feature and range faceting for the aggregated records
Hi Gimantha,
Instead of getting record counts, is there a way to get aggregates of some
numerical field with range faceting?
Also, it would be useful to specify ranges as start value, end value and
gap, in addition to the method mentioned in the sample.
Regards,
Chathura
On Mon, Nov 23, 2015 at 7:45 AM, Gimantha Bandara wrote:
> Hi Isuru,
>
> 1. DAS 3.0.0 does not support sorting aggregated data. But it can be
> considered as an improvement in 3.0.01
>
> 2. DAS 3.0.0 REST API support ranged faceting. You will have to give the
> boundaries for each range with a label name. Please refer to [1] for more
> info.
>
> [1]
> https://docs.wso2.com/display/DAS300/Retrieving+the+Event+Count+of+Range+Facets
>
>
> On Fri, Nov 20, 2015 at 12:01 PM, Rukshan Premathunga
> wrote:
>
>> Hi Isuru,
>>
>> For 2nd issue, you can try with lucene range search[1].
>>
>> [1] https://lucene.apache.org/core/2_9_4/queryparsersyntax.html#Range
>> Searches
>>
>> Thanks and Regards.
>>
>> On Fri, Nov 20, 2015 at 5:37 PM, Isuru Wijesinghe
>> wrote:
>>
>>> Hi All,
>>>
>>> We're currently developing the dashboard for BPS statistics data and we
>>> encounter some problems mentioned below.
>>>
>>> 1.) Does DAS already support a sorting feature to retrieve the
>>> aggregated data in the ascending order ?
>>>
>>> Why we need sorting feature here because let's say as an example, if we
>>> are analyzing the involvement of different users in a particular process,
>>> we have to provide the process ID as the primary filter. There can be a
>>> large number of users in the system which could result in too many entries
>>> in the X axis. To overcome this, most graphs have to provide a secondary
>>> filter to obtain only top X or bottom X entries (asc or dsc ordering).
>>>
>>> When retrieving the records through the faceted search for the columns
>>> which have the aggregated values(eg: avg, sum, etc) from the DAS REST API,
>>> the data is usually listed in random order. As a solution for that, need to
>>> provide a mechanism in the DAS side to sort the records in the column such
>>> a way that they will be retrieved in a specific order so that it can be
>>> used to sort in ascending order, descending order according to the given
>>> column or multiple columns.
>>>
>>> eg: {
>>> "tableName": "USER_INVOLVE_SUMMARY_DATA",
>>> "groupByField": "processDefKey",
>>> "query": "assignee:admin",
>>> *"sort":"totalInvolvedTime asc"*,
>>> "aggregateFields": [
>>> {
>>> "fieldName": "duration",
>>> "aggregate": "SUM",
>>> "alias": "totalInvolvedTime"
>>> }
>>> ]
>>> }
>>>
>>> 2.) Is it possible to do range faceting in DAS?
>>>
>>> (Here the range facet produces multiple range buckets over numeric
>>> fields or date fields.)
>>> Let's say as an example we have a field called *price* in one of the
>>> summarized tables and we have that field faceted. We want to get the facets
>>> as ranges of values (*eg:* *0-100, 100-500, 500-1000, etc* - these are
>>> the ranges that prices fall into). Is it possible to calculate the ranges
>>> (facet counts for the ranges of prices - eg: say for 5 values) based on the
>>> values in the table ?
>>>
>>> --
>>> Isuru Wijesinghe
>>> *Software Engineer*
>>> WSO2 inc : http://wso2.com
>>> lean.enterprise.middleware
>>> Mobile: 0710933706
>>> isur...@wso2.com
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>> Rukshan Chathuranga.
>> Software Engineer.
>> WSO2, Inc.
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> Gimantha Bandara
> Software Engineer
> WSO2. Inc : http://wso2.com
> Mobile : +94714961919
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [BPS][DAS] Sorting feature and range faceting for the aggregated records
Hi Isuru,
1. DAS 3.0.0 does not support sorting aggregated data. But it can be
considered as an improvement in 3.0.01
2. DAS 3.0.0 REST API support ranged faceting. You will have to give the
boundaries for each range with a label name. Please refer to [1] for more
info.
[1]
https://docs.wso2.com/display/DAS300/Retrieving+the+Event+Count+of+Range+Facets
On Fri, Nov 20, 2015 at 12:01 PM, Rukshan Premathunga
wrote:
> Hi Isuru,
>
> For 2nd issue, you can try with lucene range search[1].
>
> [1] https://lucene.apache.org/core/2_9_4/queryparsersyntax.html#Range
> Searches
>
> Thanks and Regards.
>
> On Fri, Nov 20, 2015 at 5:37 PM, Isuru Wijesinghe
> wrote:
>
>> Hi All,
>>
>> We're currently developing the dashboard for BPS statistics data and we
>> encounter some problems mentioned below.
>>
>> 1.) Does DAS already support a sorting feature to retrieve the aggregated
>> data in the ascending order ?
>>
>> Why we need sorting feature here because let's say as an example, if we
>> are analyzing the involvement of different users in a particular process,
>> we have to provide the process ID as the primary filter. There can be a
>> large number of users in the system which could result in too many entries
>> in the X axis. To overcome this, most graphs have to provide a secondary
>> filter to obtain only top X or bottom X entries (asc or dsc ordering).
>>
>> When retrieving the records through the faceted search for the columns
>> which have the aggregated values(eg: avg, sum, etc) from the DAS REST API,
>> the data is usually listed in random order. As a solution for that, need to
>> provide a mechanism in the DAS side to sort the records in the column such
>> a way that they will be retrieved in a specific order so that it can be
>> used to sort in ascending order, descending order according to the given
>> column or multiple columns.
>>
>> eg: {
>> "tableName": "USER_INVOLVE_SUMMARY_DATA",
>> "groupByField": "processDefKey",
>> "query": "assignee:admin",
>> *"sort":"totalInvolvedTime asc"*,
>> "aggregateFields": [
>> {
>> "fieldName": "duration",
>> "aggregate": "SUM",
>> "alias": "totalInvolvedTime"
>> }
>> ]
>> }
>>
>> 2.) Is it possible to do range faceting in DAS?
>>
>> (Here the range facet produces multiple range buckets over numeric fields
>> or date fields.)
>> Let's say as an example we have a field called *price* in one of the
>> summarized tables and we have that field faceted. We want to get the facets
>> as ranges of values (*eg:* *0-100, 100-500, 500-1000, etc* - these are
>> the ranges that prices fall into). Is it possible to calculate the ranges
>> (facet counts for the ranges of prices - eg: say for 5 values) based on the
>> values in the table ?
>>
>> --
>> Isuru Wijesinghe
>> *Software Engineer*
>> WSO2 inc : http://wso2.com
>> lean.enterprise.middleware
>> Mobile: 0710933706
>> isur...@wso2.com
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> Rukshan Chathuranga.
> Software Engineer.
> WSO2, Inc.
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>
--
Gimantha Bandara
Software Engineer
WSO2. Inc : http://wso2.com
Mobile : +94714961919
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [BPS][DAS] Sorting feature and range faceting for the aggregated records
Hi Isuru,
For 2nd issue, you can try with lucene range search[1].
[1] https://lucene.apache.org/core/2_9_4/queryparsersyntax.html#Range
Searches
Thanks and Regards.
On Fri, Nov 20, 2015 at 5:37 PM, Isuru Wijesinghe wrote:
> Hi All,
>
> We're currently developing the dashboard for BPS statistics data and we
> encounter some problems mentioned below.
>
> 1.) Does DAS already support a sorting feature to retrieve the aggregated
> data in the ascending order ?
>
> Why we need sorting feature here because let's say as an example, if we
> are analyzing the involvement of different users in a particular process,
> we have to provide the process ID as the primary filter. There can be a
> large number of users in the system which could result in too many entries
> in the X axis. To overcome this, most graphs have to provide a secondary
> filter to obtain only top X or bottom X entries (asc or dsc ordering).
>
> When retrieving the records through the faceted search for the columns
> which have the aggregated values(eg: avg, sum, etc) from the DAS REST API,
> the data is usually listed in random order. As a solution for that, need to
> provide a mechanism in the DAS side to sort the records in the column such
> a way that they will be retrieved in a specific order so that it can be
> used to sort in ascending order, descending order according to the given
> column or multiple columns.
>
> eg: {
> "tableName": "USER_INVOLVE_SUMMARY_DATA",
> "groupByField": "processDefKey",
> "query": "assignee:admin",
> *"sort":"totalInvolvedTime asc"*,
> "aggregateFields": [
> {
> "fieldName": "duration",
> "aggregate": "SUM",
> "alias": "totalInvolvedTime"
> }
> ]
> }
>
> 2.) Is it possible to do range faceting in DAS?
>
> (Here the range facet produces multiple range buckets over numeric fields
> or date fields.)
> Let's say as an example we have a field called *price* in one of the
> summarized tables and we have that field faceted. We want to get the facets
> as ranges of values (*eg:* *0-100, 100-500, 500-1000, etc* - these are
> the ranges that prices fall into). Is it possible to calculate the ranges
> (facet counts for the ranges of prices - eg: say for 5 values) based on the
> values in the table ?
>
> --
> Isuru Wijesinghe
> *Software Engineer*
> WSO2 inc : http://wso2.com
> lean.enterprise.middleware
> Mobile: 0710933706
> isur...@wso2.com
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>
--
Rukshan Chathuranga.
Software Engineer.
WSO2, Inc.
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [BPS][DAS] Sorting feature and range faceting for the aggregated records
Hi All,
We're currently developing the dashboard for BPS statistics data and we
encounter some problems mentioned below.
1.) Does DAS already support a sorting feature to retrieve the aggregated
data in the ascending order ?
Why we need sorting feature here because let's say as an example, if we
are analyzing the involvement of different users in a particular process,
we have to provide the process ID as the primary filter. There can be a
large number of users in the system which could result in too many entries
in the X axis. To overcome this, most graphs have to provide a secondary
filter to obtain only top X or bottom X entries (asc or dsc ordering).
When retrieving the records through the faceted search for the columns
which have the aggregated values(eg: avg, sum, etc) from the DAS REST API,
the data is usually listed in random order. As a solution for that, need to
provide a mechanism in the DAS side to sort the records in the column such
a way that they will be retrieved in a specific order so that it can be
used to sort in ascending order, descending order according to the given
column or multiple columns.
eg: {
"tableName": "USER_INVOLVE_SUMMARY_DATA",
"groupByField": "processDefKey",
"query": "assignee:admin",
*"sort":"totalInvolvedTime asc"*,
"aggregateFields": [
{
"fieldName": "duration",
"aggregate": "SUM",
"alias": "totalInvolvedTime"
}
]
}
2.) Is it possible to do range faceting in DAS?
(Here the range facet produces multiple range buckets over numeric fields
or date fields.)
Let's say as an example we have a field called *price* in one of the
summarized tables and we have that field faceted. We want to get the facets
as ranges of values (*eg:* *0-100, 100-500, 500-1000, etc* - these are the
ranges that prices fall into). Is it possible to calculate the ranges
(facet counts for the ranges of prices - eg: say for 5 values) based on the
values in the table ?
--
Isuru Wijesinghe
*Software Engineer*
WSO2 inc : http://wso2.com
lean.enterprise.middleware
Mobile: 0710933706
isur...@wso2.com
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
