[jira] [Created] (FLINK-8324) Expose another offsets metrics by using new metric API to specify user defined variables

[Wei-Che Wei (JIRA)]

Wei-Che Wei created FLINK-8324:
--

 Summary: Expose another offsets metrics by using new metric API to 
specify user defined variables
 Key: FLINK-8324
 URL: https://issues.apache.org/jira/browse/FLINK-8324
 Project: Flink
  Issue Type: Improvement
  Components: Kafka Connector
Affects Versions: 1.5.0
Reporter: Wei-Che Wei
Assignee: Wei-Che Wei


The {{current-offsets}} and {{committed-offsets}} metrics are now attached with 
topic name and partition id in the metric identity.
It is not convenient to use these metrics in Prometheus, because user usually 
uses the same metric group name to group by those metrics which have the same 
meaning and uses tags to get the individual metric.
For example, I will prefer to access {{current-offsets}} metric group and use 
{{partition-x}} tag to get the offset of partition x, instead of getting metric 
directly from {{current-offsets-partition-x}} metric.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (FLINK-8323) Fix Mod scala function bug

[sunjincheng (JIRA)]

sunjincheng created FLINK-8323:
--

 Summary: Fix Mod scala function bug
 Key: FLINK-8323
 URL: https://issues.apache.org/jira/browse/FLINK-8323
 Project: Flink
  Issue Type: Sub-task
  Components: Table API & SQL
Affects Versions: 1.5.0
Reporter: sunjincheng
Assignee: sunjincheng


As we know mod(151435632,6)=0, but currently  we get `-15488` when call 
`MOD(151435632,6)`.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Re: CEP: Dynamic Patterns

[Ufuk Celebi]

Hey Rafi,

this is indeed a very nice feature to have. :-) I'm afraid that this
is currently hard to do manually with CEP. Let me pull in Dawid and
Klou (cc'd) who have worked a lot on CEP. They can probably update you
on the plan for FLINK-7129.

Best,

Ufuk


On Tue, Dec 26, 2017 at 8:47 PM, Shivam Sharma <28shivamsha...@gmail.com> wrote:
> Hi Rafi,
>
> Even I also wanted this facility from Flink Core. But I think this is
> already solved by Uber on Flink.
>
> https://eng.uber.com/athenax/
>
> Best
>
> On Tue, Dec 26, 2017 at 6:21 PM, Rafi Aroch  wrote:
>
>> Hi,
>>
>> I'm Rafi, Data Architect at WalkMe.
>>
>> Our Mobile platform generates events coming from the end-users mobile
>> device for different actions that the user does.
>>
>> The use case I wanted to implement using Flink CEP is as follows:
>>
>> We would like to expose a UI where we could define a set of rules. Rules
>> can be statefull, like:
>>
>> User did X 4 times in the last hour
>> AND
>> User did Y and then did Z in a session
>> AND
>> User average session duration is > 60 seconds
>>
>> As the set of rules are met, we would like to trigger an action. Like a
>> REST call, fire event, etc.
>>
>> This sounds like a good fit for Flink CEP, except that currently, I
>> understand that CEP patterns have to be "hard-coded" in my jobs code in
>> order to build the graph.
>> This set of rules may change many times a day. So re-deploying a Flink job
>> is not an option (or is it?).
>>
>> I found this ticket: https://issues.apache.org/jira/browse/FLINK-7129 and
>> was hoping you plan to add this feature soon :)
>>
>> This would make a powerful feature and open up many interesting use-cases.
>>
>> Meanwhile, can you suggest a way of implementing this use-case?
>>
>> Hope this makes sense.
>> Would love to hear your thoughts.
>>
>> Thanks,
>> Rafi
>>
>
>
>
> --
> Shivam Sharma
> Data Engineer @ Goibibo
> Indian Institute Of Information Technology, Design and Manufacturing
> Jabalpur
> Mobile No- (+91) 8882114744
> Email:- 28shivamsha...@gmail.com
> LinkedIn:-*https://www.linkedin.com/in/28shivamsharma
> *