[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384626#comment-17384626
]
Jungtaek Lim commented on SPARK-10816:
--
I don't think I could finalize this one without your
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384592#comment-17384592
]
L. C. Hsieh commented on SPARK-10816:
-
Yea, excited to have the great work in the next 3.2 release!
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384586#comment-17384586
]
Yuanjian Li commented on SPARK-10816:
-
Thrilled to see this issue got resolved finally! Thank you
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306675#comment-17306675
]
Apache Spark commented on SPARK-10816:
--
User 'HeartSaVioR' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306676#comment-17306676
]
Apache Spark commented on SPARK-10816:
--
User 'HeartSaVioR' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287585#comment-17287585
]
Yuanjian Li commented on SPARK-10816:
-
Great thanks for your heads up! [~viirya] [~kabhwan]
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285018#comment-17285018
]
Apache Spark commented on SPARK-10816:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285017#comment-17285017
]
Apache Spark commented on SPARK-10816:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284964#comment-17284964
]
Jungtaek Lim commented on SPARK-10816:
--
Probably the code size is different because the design is
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284959#comment-17284959
]
Jungtaek Lim commented on SPARK-10816:
--
cc. [~XuanYuan]
> EventTime based sessionization
>
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284950#comment-17284950
]
Jungtaek Lim commented on SPARK-10816:
--
First of all, I'd like to say thanks for finding the value
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284931#comment-17284931
]
L. C. Hsieh commented on SPARK-10816:
-
This feature is inactive in last two years. We have interests
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011732#comment-17011732
]
Rafat commented on SPARK-10816:
---
same question above
Is there SLA for this feature ?
Thanks
>
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918222#comment-16918222
]
ShuMing Li commented on SPARK-10816:
Same Question:
Is there any progress on this issue now?
>
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887561#comment-16887561
]
Chang chen commented on SPARK-10816:
Hi guys
Any updates on this issue?
> EventTime based
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701275#comment-16701275
]
Yuanjian Li commented on SPARK-10816:
-
Thanks for the fix and benchmark by [~ivoson], fix commit
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16698433#comment-16698433
]
huangtengfei commented on SPARK-10816:
--
Ran the benchmark [~kabhwan] mentioned above last week, and
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16672478#comment-16672478
]
Jungtaek Lim commented on SPARK-10816:
--
UPDATE: I just discovered the performance critical issue on
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668157#comment-16668157
]
Jungtaek Lim commented on SPARK-10816:
--
I feel we would be OK even we load sessions for a key into
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668151#comment-16668151
]
Jungtaek Lim commented on SPARK-10816:
--
Let me summarize about new benchmark run:
For data pattern
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668120#comment-16668120
]
Jungtaek Lim commented on SPARK-10816:
--
UPDATE:
1. Added additional new data pattern in benchmark
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662007#comment-16662007
]
Jungtaek Lim commented on SPARK-10816:
--
UPDATE: Since we don't access state session list by index
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658935#comment-16658935
]
Jungtaek Lim commented on SPARK-10816:
--
Have been thinking about [3] but can't find good approach
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658599#comment-16658599
]
Jungtaek Lim commented on SPARK-10816:
--
Just going back to review the origin comment of [~zsxwing].
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656435#comment-16656435
]
Jungtaek Lim commented on SPARK-10816:
--
[~msukmanowsky]
In case if you would like to still
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654940#comment-16654940
]
Jungtaek Lim commented on SPARK-10816:
--
Just updated the code to move out logic to load/store state
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654627#comment-16654627
]
Jungtaek Lim commented on SPARK-10816:
--
Just ran another performance test to check my new trial of
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652925#comment-16652925
]
Jungtaek Lim commented on SPARK-10816:
--
I've been thinking about requirements on state store for
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652878#comment-16652878
]
Jungtaek Lim commented on SPARK-10816:
--
Update on test results for both data patterns:
1. plenty
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651404#comment-16651404
]
Jungtaek Lim commented on SPARK-10816:
--
Update: I've crafted another performance test for testing
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647923#comment-16647923
]
Jungtaek Lim commented on SPARK-10816:
--
Btw, I've just rebuilt with Baidu's updated patch and reran
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647816#comment-16647816
]
Jungtaek Lim commented on SPARK-10816:
--
I'd add my thought about the approach 2. It would work best
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646177#comment-16646177
]
Li Yuanjian commented on SPARK-10816:
-
Thanks [~zsxwing] for your comment and discussion, great
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645745#comment-16645745
]
Jungtaek Lim commented on SPARK-10816:
--
Btw, while there was some inactivity on this issue, I've
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645720#comment-16645720
]
Jungtaek Lim commented on SPARK-10816:
--
[~zsxwing] [~tdas]
{quote}In addition, it's better to also
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645705#comment-16645705
]
Jungtaek Lim commented on SPARK-10816:
--
[~zsxwing] [~tdas]
Thanks for spending time to read my
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645370#comment-16645370
]
Shixiong Zhu commented on SPARK-10816:
--
Thanks a lot for the design docs and prototypes. I had a
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631751#comment-16631751
]
Li Yuanjian commented on SPARK-10816:
-
Design doc:
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631733#comment-16631733
]
Apache Spark commented on SPARK-10816:
--
User 'xuanyuanking' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631398#comment-16631398
]
Li Yuanjian commented on SPARK-10816:
-
Great thanks for [~kabhwan] notice me, just linked
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631206#comment-16631206
]
Jungtaek Lim commented on SPARK-10816:
--
To avoid any concerns/wonders, I believe my proposal and
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630697#comment-16630697
]
Arun Mahadevan commented on SPARK-10816:
Reiterating earlier point. "map/flapMapGroupsWithState"
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630044#comment-16630044
]
Jungtaek Lim commented on SPARK-10816:
--
[~marmbrus]
Could you please provide your opinion on this?
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623749#comment-16623749
]
Jungtaek Lim commented on SPARK-10816:
--
[~msukmanowsky]
Thanks for showing your interest on this!
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623659#comment-16623659
]
Mike Sukmanowsky commented on SPARK-10816:
--
In case it helps to have a more concrete example, I
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622826#comment-16622826
]
Jungtaek Lim commented on SPARK-10816:
--
[~rxin]
I completely agreed on we would be better to
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622807#comment-16622807
]
Reynold Xin commented on SPARK-10816:
-
I will let [~marmbrus] chime in ... As the initial person
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622729#comment-16622729
]
Arun Mahadevan commented on SPARK-10816:
[~rxin], "map/flapMapGroupsWithState" looks to suited
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622659#comment-16622659
]
Jungtaek Lim commented on SPARK-10816:
--
I would be also appreciated if you can provide some
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622623#comment-16622623
]
Jungtaek Lim commented on SPARK-10816:
--
I'm aware of the needs for more advanced cases (like
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622599#comment-16622599
]
Reynold Xin commented on SPARK-10816:
-
So I've actually run this idea by a lot of users, and almost
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622578#comment-16622578
]
Apache Spark commented on SPARK-10816:
--
User 'HeartSaVioR' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622581#comment-16622581
]
Apache Spark commented on SPARK-10816:
--
User 'HeartSaVioR' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621512#comment-16621512
]
Jungtaek Lim commented on SPARK-10816:
--
WIP version of patch:
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621497#comment-16621497
]
Jungtaek Lim commented on SPARK-10816:
--
Just attached the doc. I also have shareable version of doc
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621483#comment-16621483
]
Jungtaek Lim commented on SPARK-10816:
--
I would like to propose native support on session window,
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576503#comment-16576503
]
Mike Sukmanowsky commented on SPARK-10816:
--
Voted, but want to express that we're definitely
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462149#comment-16462149
]
Jungtaek Lim commented on SPARK-10816:
--
I'm still curious about out-of-box support on session
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939156#comment-15939156
]
Michael Armbrust commented on SPARK-10816:
--
Just a quick note for people interested in this
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674147#comment-15674147
]
Amit Sela commented on SPARK-10816:
---
[~rxin] it might be worth taking into account a more generic
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627075#comment-15627075
]
Reynold Xin commented on SPARK-10816:
-
Sounds good!
> EventTime based sessionization
>
[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627072#comment-15627072
]
Michael Armbrust commented on SPARK-10816:
--
Windows were added in [SPARK-14160], so I'm going to
62 matches
Mail list logo